When I run the program using the youtube data API, sometimes I get a dailyLimitExceeded error and a quotaExceeded error. In the case of dailyLimitExceeded, if I run it again after a few seconds,
sometimes it works, sometimes it doesn't work. However, in the case of quotaExceeded, quota is not initialized until 5 o'clock of the next day in the Pacific. Only after the quota has been initialized can the program resume normal operation.
I understand quotaExceeded to some extent, but I don't know exactly what dailyLimitExceeded is.
It's because of the latency of the data refresh rate. if you sending a request to Youtube frequently. Youtube protects himself and gives us Daily Limit exceeded results temporarily, but a bit time later it will work properly with a new request.
Check out the report:
https://issuetracker.google.com/150106191
Related
I have a very simple message and getting the v3 youtube data api to get the list of comments. I am just fetching the list of videos and then fetching the comments (at frequency of 5 sec) to get updated messages. using the page token as needed to minimize the load and computaion.
Today after some time while internally testing the application i started getting the quota exceeded exception. I know the youtube provided by default 10000 units and since reading the comments (and videos as well) is just 1 unit, i should expect to get similar numbers.
However, the data is wrongly calculated.
Following are request details
If you see, there are 2895 total requests LiveChatMessages-> List.
However, when i go to IAM-> Quotas, it showed 14k earlier, then 12.6k in quota usage
There seems to be some problem either with the computation or with the Documentation that defines the units for queries. Can someone help please..
PS: Just using the two apis as mentioned above in screenshot. Both are list.
If you see, there are 2895 total requests LiveChatMessages-> List. However, when i go to IAM-> Quotas, it showed 14k earlier, then 12.6k in quota usage
Yes i can see that there are 2895 requests, but how do you know what the qutoa costs are for those requests. You are using the YouTube Live Streaming api for those requests. Not the YouTube-Data-api
There is no documentation of the quota cost for the YouTube Live Streaming api calls. If Google says you used all your quota then you probably have.
I would post an issue over on the issue forum asking them to document the quota cost for the calls Issue forum
I have an application where I need to get complete, realtime search results from twitter (preferably polling every 500ms or less). Based on my understanding, doing this using the search API will run into rate limits very quickly. However, the streaming API doesn't seem to support getting complete anything (only a 5% sample).
More specifically, I have a search query term which typically comes up with <20 matching tweets per hour, and I would like to be informed of these new tweets within 1-2 seconds, and it is considered a failure if I am not notified within 5 seconds. Due to the relatively low frequency of posting, missing even one tweet is very undesirable.
Is there any way I can realistically do this using twitter API, or is my only choice to write a browser extension to repeatedly refresh the search page?
The answer is "yes". Although you are rate limited (the limit is closer to 1% than 5%), that is only a cutoff based on your query results. Very roughly, you can stream about 60 tweets per second max. In your case, you say you expect under 20 tweets per hour, so you should have no problem getting all those tweets.
You also require a latency less than 5 seconds. In my experience latency has always been a second or two. I think you should be fine.
I am trying to fetch all the subscriptions ids of a youtube channel that has 100k+ subscribers. When fetching the first page of results, youtube returns properly the total amount of subscriptions and the next page token.
After a few hundred calls (because you can only fetch 50 results per call), the api doesn't provide anymore the nextPageToken, and the listing stops with only ~20k subscriptions listed.
I tried this on several big youtube channels, and always the same behaviour when I reach around 20k subscriptions listed.
In the documentation I couldn't find anything about any limit on listing subscriptions...
Anybody encountered the same issue ? :-)
Thanks
I think you need to check for an error, If you have reached the quota limit you should get an error when you try and make another request.
Daily quota is 50,000,000 units/day
depending upon which part you request from subscriptions.list some of them like snippet count double against the quota.
Math time
If you have 100000 subscriptions and you have to fetch them in 50 subscription bites that's going to take you 2000 requests. Even if you are using one of the double parts its still should only be around 4000 requests.
I don't think the problem is quota check to see if you are getting an error.
Googling found
issue request might be related. Youtube api impossible to get all results
YouTube api page tokens
possible hack
I keep getting:
Response:
{"errors":[{"message":"You have made too many requests recently. Please, be chill."}]}
When trying to download all my tasks - is there a published QPS or other quota limit so I know how liong I should pause between requests?
(I work at Asana)
As stated in the documentation, the current request limit is around 100 / minute. The error response you are getting back also contains a Retry-After header which contains the number of seconds you must wait until you can make a request again.
We may also be institute a daily limit at some point in the future -- we think 100 / minute is a reasonable burst rate, but not a reasonable sustained rate throughout the day. However, we are not enforcing a daily limit yet.
I've got a program that splits market research videos into 30 minute chunks and uploads them to YouTube, via the API. I know there are API limits, but they don't seem to be published. Is there a set limit to how frequently you can upload videos via the API?
What I'm doing now is uploading a video, and if it takes less than 5 minutes, the program sleeps until 5 minutes have passed. I realize I could just continuously upload them, and catch the "too many recent calls" API exception, but then I have to make the program wait 10 minutes to reset the quota. If there is a limit, I'd just like to be able to adjust the program around that.
The canonical source of information is this blog post. We recently covered this topic as part of a YouTube Developers Live broadcast, and there's a new embedded video at the bottom of that post in which I answer the question in a lot more detail.
To summarize a more specific answer from the video (which I recommend watching, anyway), waiting 10 minutes can often be overkill, but was a handy interval to give out as a best practice. You won't be penalized if you keep uploading as fast you can and then wait for fewer than 10 minutes once you encounter a quota error. An exponential backoff in which you start with waiting a minute and then work your way up to 2, 4, 8, 16, etc. is reasonable, too.