How to aggregate analytics from Google, Twitter, YouTube, Facebook, etc [closed] - twitter

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 2 years ago.
Improve this question
I have a video blog for which I would like to track certain statistics, including stats from Google Analytics, Twitter, YouTube, Facebook, etc.
The problem is that the various stats are on different websites, which require different logins, etc. It takes a long time to actually view everything. I am looking for a way to be able to aggregate all of this information in one place.
I have searched quite a bit on Google, Mashable, Delicious, etc and I haven't found any websites that do what I want. Are my searching skills bad, or does this really not exist?
The data in which I am interested appears to be available in readily parsable forms (see below), but I am hesitant to write an app to do this myself, because of an already more than full workload.
Data I want to aggregate:
Google Analytics -- tracking on my website
number of visitors
traffic sources
use Data Export API -- http://code.google.com/apis/analytics/docs/gdata/gdataDeveloperGuide.html
Twitter
number of followers
number of retweets
new # messages
new direct messages
Twitter API -- (sorry, I can only post one hyperlink because I am new)
Facebook fan page
number of fans
new posts on wall
Facebook API -- (sorry, I can only post one hyperlink because I am new)
Tumblr
number of followers
Video
number of views
view location
number of comments
number of channel subscribers
do this for
YouTube -- CSV report available at (sorry, I can only post one hyperlink because I am new)
MetaCritic
Feed burner (RSS)
number of subscribers
CSV report available at (sorry, I can only post one hyperlink because I am new)
SEO stuff
Google PageRank
Alexa rankings
So is there an app that does this already, or should I do this myself? I would like a quick and dirty way to do this -- I was thinking something like Yahoo pipes, but it appears to not be up to the task. I could probably get it done in Grails, but that might be more trouble than it's worth. Other ideas?

I have a better answer. YQL has community data tables for all the services you listed. You can pull in all the different values through their API.
http://developer.yahoo.com/yql/

You could try creating a Google Spreadsheet and use their external data import tools.
http://docs.google.com/support/bin/answer.py?hl=en&answer=75507
The biggest problem will probably be access authenticated APIs.

Presumably that all of the services above has fashioned a statistics API, I would advice you to write it yourself rather than battling an integration war with a bunch of aggregating programs.

Here's an iphone app that does at least a bit of this:
http://ego-app.com/

I don't know a single tool that can do this, off the top of my head. But you can chain a few tools together to do this.
1- If you're on Windows, use Website Watcher. It has a macro-recording tool to login a webpage, a regex-based tool to filter content and a scripting language that let you email/export the result. IMO, this will let you extract data from just any web page/RSS/forums.
2- Then use Dropbox to automatically upload the result files to your Dropbox's public folder (because you will need the public link to these file).
3- Use Yahoo Pipes to consolidate/aggregate the result files.

I suggest you try Metricly http://metricly.com/ that is natively intergating Facebook & Google Analytics data. It is extensible by nature and with a little bit of tweaking you can push any meric to it. I enjoy it.

I originally suggested this as an edit to abraham's answer but it was rejected:
Mikael Thuneberg has written a freely available google script for pulling GA data into Google Docs using the GA API: http://www.automateanalytics.com/2010/04/google-analytics-data-to-google-docs.html
I use it for creating client dashboards all the time. I suspect there may be others for pulling in twitter/facebook data etc.
And Google have just released this tool for importing GA data into Google Docs:
http://analytics.blogspot.co.uk/2012/08/automate-google-analytics-reporting.html
Also see SEOTools for Excel which can pull some facebook and twitter data as well as Google Analytics through the API.

YouTube has a public API http://developers.google.com/youtube/analytics to retrieve reports for your videos and channels.

Related

What is a good strategy for staying up-to-date with external API's?

My project is reliant on several API's, like Twitter and Youtube for example. Recently, Youtube deprecated their old API, and it caused issues with my team's iPad app.
We could have stayed ahead of the change if we were paying attention to Youtube's announcements of the upcoming deprecation. But alas, we were not and the idea of staying up to date with all of our dependencies manually(browsing the web) seems exhausting and inefficient.
I have found the following tool to help notify when changes occur with external library dependencies, https://libraries.io. However, this does not help with API dependencies.
Besides checking the API source webpages every so often, I was wondering if anyone had suggestions on how to stay notified and up-to-date with news regarding updates to a specified list of external API's?
After some time looking at different options, I have found a solution that is not perfect, but seems to work best at fitting this need.
Solution Description
This solution uses a combination of Twitter, Google Scripts, and website blogtrottr.com. I am creating a twitter list of reliable dev handles that often post updates on new API. For example I made a list that contained #twitterapi and #YouTubeDev. Used Google Scripts to create an online feed out of the twitter list. Then used blogtrottr to email me every time that feed gets a new posting.
Steps to Implement
Create a twitter list of reliable handles that often post about updates to their API
Create an RSS Feed from that Twitter list. The details for how to do this can be found here.
Plug that url that you get from Google Script into blogtrotter.
I did find some other ways to do this, but so far this is the only solution that was 100% free!

App Store price drops and updates info

I found a couple of websites which somehow collect App store price changes, updates, etc.
My question is - where does websites like:
148apps.com
appdropp.com
etc.
get their info? I signed up as Apple affiliate and found that I can request apps info using the search or lookup APIs. But I can't send thousands of requests to check all apps day by day, it seems to be a huge task.
Is there any other available option to get this info?
They may be using this, Enterprise Partner Feed
It looks like it would provide what you're looking.
They are using EPF feed, provided by Apple.
You can check their Python tool to import feed to database.
You can also take a look on websites like:
http://www.apptweak.com, or http://www.appsocean.com
If you know PHP (for example), you can write a simple spider to grab price drops and updates.
Just read more about PHP CURL library.

where can I find a machine-readable list of the most popular users on twitter?

I'm interested in building a simple demo and need a list of top twitter users. Is there a web site that offers a JSON or RSS feed (or otherwise easily parseable list) of the top 1000 twitter users by number of followers. Is there a web site that offers something like this? (I know I can scrape one of the many sites like Twitaholic but I'd rather not bother with that if there is an easier alternative.)
Twitter Counter , they also have a nice REST api that I like. Lady Gaga is #1 of course.
Edit based on comment
Here is a Yahoo Pipe for Top5 which can probably be edited for more
http://pipes.yahoo.com/pipes/pipe.info?_id=10ba4ad51d85cbf06d97236a2a291ac6
http://twittercounter.com/
http://twittercounter.com/pages/api?ref=footer

Allow users to rate embedded videos in Wordpress site

I'm an awful programmer, so if there is just an easy plugin, that would be a huge help.
I have a few issues:
1. Is there a plugin that allows visitors to my Wordpress site to easily upload their own Youtube vids for other visitors to see?
I'd like to be able to have other visitors rate the user uploaded Youtube vids and then allow other visitors to sort the vids based on rating, is there an easy way to set that up in my Wordpress site?
Finally, I'd like a create a forum similar to StackOverflow in my Wordpress site, anyone know how I can do that?
Thanks to everyone in advance. As you can tell, I'm not very smart with all of this.
I am not aware of a WordPress plug in like you describe. However, if you have the budget for a programmer to do some custom work, I would investigate some existing video plug ins for WP like andrewk suggests and then hire a programmer to implement the voting stuff and any other customizations you need.
I'd also check out the group blogging functionality from Posterous [http://posterous.com]. In the settings panel, there is a setting that you can toggle labeled "Who should be allowed to post on your site?" You can set it to "Anyone can post and I will moderate." Users can then submit posts via email. This solution is ideal for someone with limited programming knowledge since Posterous is easy to use and easy to set up. But it might be limiting in customizing certain aspects of the site. (E.g., implementing the rating and sorting stuff you describe.) Learn more about Posterous Groups: http://help.posterous.com/introducing-group-sites-tutorial
Stack Overflow is powered by software called Stack Exchange [http://stackexchange.com/]. You can submit a proposal for a new Stack Exchange community here: http://area51.stackexchange.com.
However, if you wish to set up a forum on your own site there are several hosted forum solutions that you might consider such as http://www.ninjapost.com, http://www.lefora.com, or http://discussions.zoho.com. A hosted forum solution is advantageous for someone with limited programming knowledge because the set up/installation does not require much programming knowledge compared to a script that you'd install and configure yourself such as phpBB.

Getting stats for Twitter app

I'm using Twitter's OAuth for my app (DroidIn)
To my dismay I can't find any way to track who and how often is using the app. Searching Twitter for "sent from DroidIn" does not yield any results. I suppose I can call some sort of counter app from my code but that doesn't seem to be fair to my users. Any ideas or suggestions?
It seems that yet again I have to answer my own question. After some investigation and feedback from question posted on Google Twitter developer group it seems that for now there are no stats easily accessible or available. Said that I found 2 interesting things:
You can search Twitter using source:yourapp switch. For example you can try this query
android source:API
There is very exciting streaming API from Twitter. I have a short write-up in my dev blog.
But if you want some actual stats there's no other choice today but implement it as part of your app. There's one more possibility if you have some sort of web-based interface you may want to use Google Analytics to trigger some Google javascript while submitting the update. I'm trying that right now and may end up with article in the blog

Resources