I am new to the world of APIs. I am trying to utilize a REST API to GET and POST from a certain website and persist those values once a day into a SAP HANA table via SDI replication. I was able to successfully test the API in Postman using a JSON file for my parameters. Now I'm unsure of the next step of how to put it all together and get it into our HANA system.
Related
I have been trying to build a pipeline in Google Cloud Data Fusion where data source is a 3rd party API endpoint. I have been unable to successfully use the HTTP Plugin, but it has been suggested that I use Pub/Sub for the data ingest.
I've been trying to follow this tutorial as a starting point, but it doesn't help me out with the very first step of the process: ingesting data from API endpoint.
Can anyone provide examples of using Pub/Sub -- or any other viable method -- to ingest data from an API endpoint and send that data down to Data Fusion for transformation and ultimately to BigQuery?
I will also need to be able to dynamically modify the URI (e.g., date filter parameters) in the GET request in this pipeline.
In order to achieve the first step in the tutorial you are following
Ingest CSV (Comma-separated values) data to BigQuery using Cloud Data Fusion.
You need to set up a functioning pub/sub system. This can be done via the command line, the console, or in your case the best would be to use, one of the client libraries. If you follow this tutorial you should have a functioning pub/sub system.
At that point you should be able to follow the original tutorial
I want to download some data from Microsoft Planner and I have used the Microsoft Graph Explorer API online and have my three GET requests ready.
Let's say one of the GET requests is:
https://graph.microsoft.com/v1.0/planner/plans/E2d-w1xIyUOc6nZPfMerEmQAB266/buckets
This returns a JSON file in the 'Response Preview' pane in Microsoft Graph Explorer online.
I want to somehow initiate this GET request from a server using a script (.bat/.ps/.sh/.bash) and get this output JSON file stored on the same server.
If anyone can point me in the direction on how to achieve this, I'd be really glad?
since you want a background task to run you are best registering an application without a user then once you've authenticated you can run that in a script to run say via a cron job.
If you use Laravel I've written a wrapper for graph that supports both users and tenants https://github.com/daveismyname/laravel-microsoft-graph.
Otherwise, study https://learn.microsoft.com/en-us/graph/auth-v2-service
The documentation on RelayJS says the RelayJS can use node.js as a GraphQL server, but not ASP.NET web service.
How can I use RelayJS with ASP.NET web api end point?
How can I use RelayJS with ASP.NET web api end point?
TL;DR;
By placing a GraphQL server in-between Relay client-side and ASP.NET web api end point.
The Getting Started page of Relay documentation clearly mentions that 2 additional things are needed to use Relay:
A GraphQL Schema: This is your data model. You need to map your ASP.NET web API to a GraphQL schema.
A GraphQL Server: Your client-side speaks to this server. In your case, this GraphQL server will talk to your ASP.NET web API.
A good example of this is GraphQL schema and server wrapping Star Wars API.
Some conecptual clarifications about your question
Relay is a specification. It's actually called GraphQL Relay Specification. It's not restricted to JavaScript. Check Awesome Relay to find the list of languages for which Relay libraries are already available.
It helps to think of Relay and GraphQL as 2 sides:
server-side consisting of GraphQL server, which speaks the schema. It can receive queries and mutation requests. How you prepare and provide the requested data depend on back-end logic. For example, you may have your own database, which you use directly to fetch / prepare the exposed data. Or you may use an external API to fetch / prepare data.
There are libraries in languages other than JavaScript to help you write GraphQL schema and server. Check Awesome GraphQL.
client-side using Relay library, which talks to a GraphQL server and fetches data as needed.
There are a lot of ways to have a database on server ( I can use my own server or I can use MS Azure (for Azure I found REST API Description https://msdn.microsoft.com/en-us/library/azure/gg715283.aspx , but I didn't find a way to add some rows to a table or to get information from the table)), but I want to edit the database and get proper rows from the server database from iOS code without having server API. There are a lot of ready solutions such as Backendless.com , but they are not stable.
So is there any way to connect to the remote SQL server database on the remove server or to MS Azure database and to edit rows and fetch data?
May there are some framework for iOS to do than? (for example in .Net there are Linq framework and Entity Framework).
In your question, you linked to a management API for SQL Database service - this has nothing to do with data manipulation; it's strictly a management API for dealing with servers and databases.
If you want to direct-connect from an IOS app to SQL Database Service (or SQL Server in a VM), you'd need to find a client library for IOS (and recommendations of such a library are not in scope for StackOverflow). There is no native SQL Server client library specifically provided through the Azure SDKs / APIs.
Outside of a native client library, there is Azure Mobile Services, which provides an API stack specifically designed around use by mobile apps (whether IOS, Android, Windows Phone, or even JavaScript). The API stack provided here, by default, gives CRUD operations for SQL Database tables. Additionally, it supports adding custom API calls, where you have complete control of your API calls.
Any other API stack would require you to choose the stack and run it yourself (whether in a Linux or Windows VM, Cloud Service, or Web App - there's no single right way to do this).
Documentation for Azure Mobile Apps (and related API feature, such as monitoring) is here.
Since you are developing in Azure consider automatic REST API from SlashDB, which is available from their Marketplace.
https://azure.microsoft.com/en-us/marketplace/partners/vte/slashdb-slashdb-azure/
SlashDB reflects the entire database as URL-linked structure so a lot of queries need not even be written. It supports SELECT, INSERT and UPDATE. In addition to that it allows for defining an API end-point to call a stored procedure or return results of a SQL query.
Disclosure: I am the founder and CEO of the company behind SlashDB, but you don't have to take my word it - just try it.
Is there any REST API associated with Quick books Desktop ?
I am aware of Quickbooks SDK and one can build its requests via QBFC or QBXML.
However,I have set of hardcoded request xmls ,I was wondering is it possible to test these XMLs by sending directly to Quickbooks Desktop via tool like SOAPUI.
Is there any REST API associated with Quick books Desktop
Yes, but it's deprecated. You can't build new apps for it -- only existing apps already using it are allowed to use it.
However,I have set of hardcoded request xmls ,I was wondering is it possible to test these XMLs by sending directly to Quickbooks Desktop via tool like SOAPUI.
You could easily write your own little SOAP server that sits and listens for requests and runs them against QuickBooks if you wanted to. Or use the SDK Test+ tool included with the SDK and feed them to QuickBooks directly from files.