How do I import data from Google Analysis into a local database and how much data the free version of Google Analysis can hold? - analysis

Questions about Google Analysis:
How do I import data from Google Analysis into a local database?
How much data does the free version of Google Analysis hold?

Regarding question one: There's an API (via this and especially this answers)
Regarding question two: You'll find information about the limitations here.

Related

Can google adwords conversion tracking be implemented with a backend integration?

We're setting up adwords tracking at the moment, but one of the requirements is that we let adwords optimise based on our net earnings figures, which only our backend is aware of. For google analytics, we send these figures via the data measurement protocol. Is there something similar to use for adwords? Or what is the approach given those requirements?
https://developers.google.com/adwords/api/docs/guides/conversion-tracking
I've seen there's offline conversion tracking here: https://support.google.com/google-ads/answer/2998031?hl=en
But if my understanding is correct, this will require some manual work. Is there a way to achieve the same thing in an automated way?

Did Yahoo Finance just discontinue their CSV download? [duplicate]

This question already has answers here:
Has Yahoo suddenly today terminated its finance download API?
(4 answers)
Closed 5 years ago.
This used to work yesterday:
http://finance.yahoo.com/d/quotes.csv?s=AAPL+GOOG+MSFT
Now I get this message:
It has come to our attention that this service is being used in violation of the Yahoo Terms of Service. As such, the service is being discontinued. For all future markets and equities data research, please refer to finance.yahoo.com.
But this makes no sense. Finance.Yahoo.com isn't a download that is usable in excel or a program. Does Yahoo still have a way to do this via some other URL or did they just cut us all off? Does anyone know a good alternative?
Yes, they just discontinued it without a warning ... It's such a shame it's so difficult to find a free source of stock quotes. This information should be in the public domain.
[EDIT] I found this alternative, which is free and seems reliable: www.alphavantage.co.
It works for stock quotes (US-only though) and currency rates.
Only thing we can't do is ask for several stocks at the same time, you need to send several requests (hello DispatchGroup).

How can I build a corpus from unstructured text (pdf, txt, html) and train IBM Watson? And then ask questions via API calls?

I want to train a machine learning system such as IBM Watson using some PDF, txt, html unstructured data, and then ask questions and get answers via API calls. How can I achieve that? GUI based training or API based training. From Bluemix, it is hard to decide which service is best to achieve this requirement. Can you please suggest the best options?
Retrieve and Rank- Retrieve and Rank can surface the most relevant information from a collection of documents. For example, using R&R, an experienced technician can quickly find solutions from dense product manuals. A contact center agent can also quickly find answers to improve average call handle times. The Retrieve and Rank service works "out of the box," but can also be customized to improve the results. More details here
Discovery Service- Extract value from unstructured data by converting, normalizing, enriching it. Use a simplified query language to explore that data or to quickly tap into pre-enriched datasets like the Discovery News collection. More details here
I would recommend Watson Discovery (https://www.ibm.com/watson/services/discovery) for your purpose.
It's very complete and supports many features in both GUI and API. It supports questions in natural language or in query format.
Its documentation is here: https://console.bluemix.net/docs/services/discovery/getting-started.html#getting-started-with-the-api
If you create a free instance of Watson Discovery, you can test its API here: https://watson-api-explorer.mybluemix.net/apis/discovery-v1
There are examples of each API call here: https://www.ibm.com/watson/developercloud/discovery/api/v1/
There is also a demo and respective code here:
https://discovery-news-demo.mybluemix.net/?cm_mc_uid=30407807098515090430617&cm_mc_sid_50200000=1509636542&cm_mc_sid_52640000=1509636542
and
https://github.com/watson-developer-cloud/discovery-nodejs

XBRL Generator(Mapping tool)

I am now developing an accounting web application to generate XBRL file then post to a government host web service. Now I have taxonomy prepared and user data ready. What I need is a software which can quickly map those data base on the taxonomy and generate XBRL files. Could anyone provide me some software which can achieve this? Open source is the best that I can implement into my project. Thanks in advance.
XBRL is a broad area, from detailed accounting data (XBRL GL) to summary reports to highly dimensional, data warehouse type content.
Commercially, products like Altova MapForce are really good for mapping from underlying data sources to XBRL taxonomies and creating content.
I assume you have already looked through SourceForge and found tools like Gepsio (https://gepsio.codeplex.com/). Arelle is a great start for people who know Python. (www.arelle.org). And there is a ton of Open Source and XBRL at xbrlwiki.info.

Finance historical options data (with strikes etc) on google finance API

Can anyone provide how to get historical options data with strikes by Google Finance API? Mbe Yahoo API can do it?
Thx.
AFAIK, there's no free API that lets you query for historical option prices easily.
Your best shot may be to collect it daily for the stocks you're interested in:
http://www.google.com/finance/option_chain?q=AAPL&output=json
I've never seen free historical option data prices. Neither Yahoo or Google provide them. I downloaded 2012 end of day data from optiondata.net. It includes daily prices, greeks and IV. As far as I can tell it seems accurate. There are several other paid sources out there but I have not tested their data.

Resources