I want to call an web service with flume and load the data into HDFS. Is it possible? I am new to flume. Can you help me understand?
You can use Flume's HTTP Source with the JSON Handler, and then call that as if it was a web service. Then use the HDFS Sink to write to HDFS.
Related
I have been playing around with the RPC package in Dart which makes it easy to add a Document Discovery service to Dart server.
After a bit of Googling I found out about the API Discovery Service https://developers.google.com/discovery/ which explained how to create client code for a given Discovery Document.
I then found Google Cloud Endpoint which looks like the server end of the a Document Discovery service. Is this true.
My real question is that I would like to use the Document Discovery service on a standard web site that is based on (say) Spring and running (say) an embedded Jetty server? Is this possible or would my application be intertwined with the App Engine Technology?
You application just needs to provide a Document Discovery service.
It shouldn't be to hard to get the information what is expected out of the source of https://pub.dartlang.org/packages/discovery_api_client_generator which is the Dart client which generates Dart client code from discovery documents. As far as I know your service doesn't even need to provide the discovery documents. The discovery_api_client_generator package can also use discovery documents stored locally but the service is of course the preferred way if you want to make it available to everyone.
I would see it as equivalent to SOAP which also allows to create client code from meta-information provided as XML.
Also the shelf_rpc package doesn't need to run on AppEngine or Managed VM. You can run it locally or on any server you want.
How to Store particular website tweets in HDFS ?
Suppose one website www.abcd.com and I want to collect all user's tweet for this website and stored into HDFS or Hive.
Flume and sqoop also helpful for storing data.
so anyone please suggest me how flume and sqoop work in storing tweets in HDFS?
Sqoop was not made for this purpose. Flume is used for these kind of needs. You can write your custom Flume source that will pull the tweets and dump them into your HDFS. See this for example. It shows how to use Flume to collect data from the Twitter Streaming API, and forward it to HDFS.
You can find more in the official documentation.
I am new to web services even after watching a lot of videos and reading a large number of tutorials on WSDL I am unable to understand how to get URL for a method of web service from WSDL. the WSDL file I am provided with is this http://cons.epackagepro.com/m/Service.svc?wsdl I want to call a login method of this web service. Can somebody explain that how to extract exact url for a web service/web service method from a WSDL file and how to pass parameters to a web service (in this particular case I want to call login). All the tutorials I watched tells that service tag of WSDL file has an address tag which tells about the url of the service but this WSDL does not contains one.
One last thing, can I call this service with soap, even soap is not used in binding. And what if I want to call it using HTTP GET / HTTP POST method, how parameters will be provided.
My main concern is how to get url of a web service / web service method from WSDL? The platform for which I want to use it is IOS.
Thanks in advance.
I have built a WCF Data Service with an updatable data context. I want to capture the Request and Response messages when I consume this service using my client. How do I go about it?
Appreciate any ideas.
You can use Fiddler from http://www.fiddlertool.com/fiddler/.
It's very very difficult to get Fiddler to work with the built-in Web server in VS (between localhost and the non-standard port). Your time is better spent getting the data service to run in IIS.
It might be possible to dump the messages using a WCF Message Inspector.
Does anyone have code for a Web Service with works with the Quickbooks Web Connector in Grails.
Grails runs on the JVM and can easily call java code such as that generated when using Apache Access to call web services. For more info on the QuickBooks web service and how to call it from Java see
http://developer.intuit.com/support/technical/?id=392
The info in this article should work with grails assuming you get the Apache Access library. You can also look at using Groovy WS to call any WSDL based web service. I've tried it but had issues with complex types; maybe you'll have better luck.