Tried, after auth, to call:
https://api.twitter.com/1.1/search/tweets.json?q=%23archimedecreativa&src=hash
If I do it directly on Twitter :
https://api.twitter.com/1.1/search/tweets.json?q=%23archimedecreativa&src=hash
I get more than 6 results. Why with api only 6 result? (which are in the last 7 days).
I can't get all tweets with that Hashtag through api at the moment? I'm afraid reading this...
Their API documentation states it is limited to 6-9 days.
Related
I want to get all tweets from my country.I tried to get all tweet by using Standart api search method. But it has some rule and limit. I want to do it limitless. Which api method can i use?
If you'd like to get all tweets for the past 7 days you could easily do it with standard API with a geocode cursor search for your country (if you specify language would be better). It will take some time as it will wait 15 minutes everytime it reaches the request limit for 15 min window. You could easily get a million tweets if you run it for 3 - 4 days.
If you need tweets more than 7 days ago you will need premium api but I wouldn't recommend it.
First of all, it is extremely expensive and second, it has a monthly limit of requests. (i am not sure how many but I reckon something about 500). Which means it will actually take you longer than waiting for the 15min rate limit every time.
Use the Premium search API :
https://developer.twitter.com/en/docs/tweets/search/api-reference/premium-search.html
You will be able to search for all tweets since 2006... it may be a lot.
The "query" parameters are listed here : https://developer.twitter.com/en/docs/tweets/search/overview/premium#AvailableOperators so you can filter by lang or with geospatial operators.
I am working since last 3 days to find solution about how we can get old data from twitter api around 3 month over limitation of twitter api about 1 week. can some one help me to know best solution.
You cannot get any tweet for the last 3 months apart if you store them in your own database.
The only solution for you would be to pay Twitter GNIP to access historical data.
The Twitter API only provides the most recent tweets for a given search, up to ~3200.
The so-called "firehose" and some datasets are available mostly for research or developer purposes.
There are some services which sell custom datasets, including Twitter itself (which purchased Gnip). The overview by Justin Littman at GWU is rather comprehensive.
I am trying to use the youtube query API. From the google developers page, I got this sample:
https://gdata.youtube.com/feeds/api/videos?q=football+-soccer&orderby=published&start-index=11&max-results=10&v=2
But this does not work. What I really want to do is find a list of videos, not more than 10 min in length but with views more than 10,000, launched within the last 30 days.
This is the old depriciated API. Use the new V3 Api https://developers.google.com/youtube/v3/?hl=en
Is it possible to get more than 6-9 days old data(tweets) using "https://search.twitter.com/search.json?q=" I've tried multiple things mentioned at https://dev.twitter.com/docs/api/1/get/search and https://dev.twitter.com/docs/using-search but still not able to get more than 7 days old tweets.
I can see older tweets using the UI (twitter.com) but not through search.twitter.com query string which is my actual requirement.
Is it a known thing ? or am i missing something here? Please help !!
Nope, this is a limitation of the Twitter Search API. You can find it documented here:
You cannot use the Search API to find Tweets older than about a
week.
If you need Tweets older than a week Gnip offers historical Tweets all the way back to the very first Tweet from #jack.
https://gnip.com/sources/twitter/
Disclosure: I work at Gnip.
For an academic usage, I would like to analyze about three months of tweets. However, it seems the official Twitter search API doesn't provide tweets older than one week.
I've tried to write a self crawler, however, given a search keyword, Twitter page will not show tweets older than about one week.
Is there any trick that I can get older tweets? Or my best bet is to hit the API once a week and do it for the following three months?
From the Twitter API documentation regarding limitations:
- The Search API is not complete index of all Tweets, but instead an index of recent Tweets.
- At the moment that index includes between 6-9 days of Tweets.
- You cannot use the Search API to find Tweets older than about a week.
So, yes, if you need to collect a certain span of time, it will require multiple queries, as you suggested.
(You should also read this answer: retrieving tweets from specific user older than 7 days)
There are also currently two commercial companies that have access to the Twitter firehose and can provide this data (they are called "licensed re-syndicators"):
Gnip - offers 30 days of Twitter data
DataSift - up to two years of Twitter data