I want to visualize the data present in big query by a iOS app just like tableau . Any suggestions are welcomed . I have visualized the data present in big query , in tableau and i want to know are there any other visualization tools cause tableau is paid where as i want to visualize the data for free and i want to implement the functionality in iOS app. Please help me on this ..........
have done some r&d and from there i know the data can be visualized by using Google chart any help on that
My favorite new open source dashboard for BigQuery is re:dash, check it out:
Code: https://github.com/EverythingMe/redash
Demo: http://demo.redash.io/
If you have GCE (Google Compute Engine) you can run your own private instance:
Instructions: https://github.com/EverythingMe/redash/wiki/Setting-up-re:dash-instance
Currently: gcutil addimage redash-040b563 gs://redash-images/redash-040b563.tar.gz
If you're willing to write a little bit of code, there is a sample appengine app here that runs BigQuery queries and saves the results in a dashboard.
Another good option is to use Apps Script to write queries and chart the results in Google Sheets. Step by step instructions are in the book Google BigQuery Analytics, but you may be able to just read the relevant snippet here or the blog post here. Sample Apps Script code is here.
You can build reports in Google Sheets using a free BigQuery Reports Add-on.
Benefits:
No CSV-files or coding required,
Queries are saved for future use,
Analysts and developers can create shared SQL-queries with pre-defined variables,
Variables allow modifying the result without editing SQL-syntax,
Everything works in Google Cloud.
Related
I am trying to create a google sheet that updates and stacks the data from a Salesforce report on a daily basis. I tried to use the Data connector for Salesforce add, it exports the data just fine but when I change the date, it replaces everything it exported the first time. What I wanted it to do is to Extract the data today, store it in the sheet, and Export another time tomorrow adding the data to the existing one. I have no coding knowledge and SQL stuff and I'm trying to learn things to help my work.
Your response is highly appreciated
Existing working connections to Bigquery from Google Sheets (using the new data connector) just stopped working yesterday, and now do not show up in the "Data" menu as before.
Anyone else experiencing? And, knows how to mitigate?
Support suggested trying to make a new sheet in incognito mode, but it still is just missing from the menu now:
It appears the exiting sheets just don't have "Refresh" as an option anymore, despite remaining in the sheet:
you are right. It was available for "Business", but now it is restricted to Entreprise+.
Below the response I got from Sheets Team.
Thanks for contacting Google Cloud Support, my name is XXXXXXXX and I
am with the Sheets Specialist Team. (...). I see that you have lost
access to Bigquery in Sheets. I regret to inform you that the feature
is no longer available for G Suite Business accounts, you would need
to upgrade to G Suite Enterprise for the feature to be available
again, you will find additional information in this Help Center
article: https://support.google.com/a/answer/9604541. Please let me
know if this answers your question or if additional support is
required.
Best Regards.
Gabriel
It appears Google has released a big update to the Data Connector for bigquery, which actually adds a lot of functionality (including pivots, calculated columns within the sheet, and a refresh schedule).
However, they have now limited which types of accounts can use the connector:
See https://support.google.com/docs/answer/9077536?co=GENIE.Platform%3DDesktop&hl=en
And, this list (at least as of 7/18/2020) no longer includes "Business" tier -- which is disappointing to say the least.
I want to connect a Google Sheets to a new BigQuery table that populates and updates the data automatically from Sheets to BigQuery. I'm using this tutorial from Google itself to do the setup.
My problem: the table connected with spreadsheet was created empty so I had to query it and save the result as another table to see and use the data.
I can't post images yet so I ask you please to check this imgur post, please.
I'm not expert in these things but does not seems to be the best way to do it. I found some spreadsheet add-ons but I'm trying to avoid them.
Any ideas what's the best way to do this kind of setup/connection?
I had to configure each column manually
BigQuery provides a variety of tools which make it pretty simple to connect the external table to BigQuery.
One option is to simply use the WebUi and the Auto Detect option which help you not to enter each column manually
This works perfectly for me also when inserting and adding data to the external table.
You can refer to BigQuery official manual on an external table for more help
I'm using Talend for several ETL-jobs. Main focus on inserting and updating data defined in local Excel files to Salesforce. Excel and Salesforce are used as Input- and Output-Connections massively.
This works like a charm!
Now instead of Excel I need to use Google Spreadsheets as data inputs/outputs. Just manually download as Excel isn't good enough. Reason: I need a highspeed repeatable process executed thousands of times bi-directional. Uploading/Downloading XLS/CSV is not an option.
As an unfortunate, my researches concluded that there is NO Google spreadsheet connector available. I found this legacy-project which seems to be abandoned: https://code.google.com/p/google-talend-components/ - it is outdated from Talend-side as well as from Google (old API versions).
One other thing I've seen, is that Talend comes with Google Big Data Support: https://www.youtube.com/watch?v=BK6G3sTmwVE - Also Google Big Data might be somehow connectable to Google Spreadsheet - but I wasn't able to figure out how. Is this easy or hard? How to start? What to read?
I need to know if there is any viable approach to read and write data with Talend from and to Google-Spreadsheet.
Alternatively is there an other ETL-tool like Talend which has connectors to Google Spreadsheet AND Salesforce out-of-the-box?
Is there a direct google docs connector in Talend, no. But you can do what you are looking to do if you think of the problem a little differently. It sounds like you need to read and write to spreadsheets then upload/download from google. Lets take each problem separately.
Upload/Download
Google storage. If you need to upload and download files from google Talend has excellent integration with their API. As you mentioned, Talend --> Big Data has components to interact with Google Storage. This type of storage is primary meant as back end storage for an application.
In Talend under Cloud-->Google Drive there are components to upload and download from Google Drive. Google Drive is primarily meant as Chrome app and has direct integration with Google Docs.
Writing to Google Docs
Regarding your need to interact with google docs, you do not need any special components for this. Google docs can utilize csv and Excel formats. If you create and modify your documents in Talend using the standard file interaction components ( delimited, Excel, etc.) you can upload and download these documents using one of the two methods I described above (Google Storage or Drive) depending on what type of storage you are using.
I want to use Google spreadsheets to store data online so multiple people can enter and maintain data, then publish or export (csv, xls, ods) the sheet for their application. What is the easiest way to process the sheet? If the data can be accessed as a link the updates could be immediately reflected in the client's app.
This article Data Scraping Wikipedia with Google Spreadsheets discusses using Google spreadsheets as an application platform.
It already has features that allow you to share the spreadsheet with multiple editors, as well as the ability to define forms that you can invite people to fill out who's results will be entered into the spreadsheet as a row.
Just in case its still vaguely of interest 5 months later, there is a SQL-like wrapper language for Google Spreadsheets at:
http://gqlx.twyst.co.za
Its very much an alpha release - but maybe its of some use or perhaps the code could give you some ideas.
I think if I am clear on your requirements, you want to store your data online in a Google Spreadsheet where multiple people can access that right? Then you want an app to use that data? Correct me if I am wrong.
It is possible to have Google spreadsheet as a database and the client app can directly access that data through APIs - spreadsheet APIs . If you want a simple link where people can go and update - you can also have a web app using google apps scripting. very simple to use and would solve your purpose too , why to export your data to ods, xls, csv, make your app directly over Google Spreadsheet. Would be maintainable too.