could not load Twitter source data into Flume - flume

I am getting the following error while running import twitter source data
could not find or load main class flume.node.Application error
can anyone help me resolve this issue?

Take a look at Error: Could not find or load main class org.apache.flume.node.Application - Install flume on hadoop version 1.2.1 the error your getting similar to that. Its might not be about twitter the error that your getting could be more about how to run flume
After that you can take a look at Configuring Flume to use Twitter as Source for twitter integration

Related

How to Update a python library thats already present in GCP dataflow

I am using avro version 1.11.0 for parsing an avro file and decoding it. We have a custom requirement, so i am not able to use ReadFromAvro. When trying this with dataflow there arises a dependency issues as avro-python3 with version 1.82 is already available. The issue is of class TimestampMillisSchema which is not present in avro-python3. It fails stating Attribute TimestampMillisSchema not found in avro.schema.
I then tried passing a requirements file with avro==1.11.0 but now the dataflow was not able to start giving error "Error syncing pod" which seems to be because of dependencies conflicts.
Any Idea/help on how this should be resolved.
Thanks

YouTube API Java Samples Do Not Complile

I'm experiencing issues compiling the latest Java YouTube API samples. After downloading (cloning) the git YouTube api-samplesrepo (https://github.com/youtube/api-samples), I followed the README instructions and typed "mvn compile". I received a bunch of errors. It seems like the POM file is trying to use older Google API client libs but not sure of the exact cause.
A few of the errors I receive are:
Captions.java:[27,46] error: cannot find symbol [ERROR] class YouTube
and
Captions.java:[31,44] error: cannot find symbol [ERROR] package com.google.api.services.youtube.model
and
Captions.java:[252,38] error: cannot find symbol [ERROR] variable youtube of type YouTube
Anyone experiencing similar errors - all I'm doing is following the instructions in the README (https://github.com/youtube/api-samples/blob/master/java/README).
Thanks
-Ron
I tested with this same source and it got worked.
First I installed maven (mvn) from https://maven.apache.org/guides/getting-started/windows-prerequisites.html
after this from path xxxxxxx\api-samples-master\java>mvn compile
It downloaded some links related to dependent files all accepted.
and then run using: mvn exec:java -Dexec.mainClass=
Example for running ListStreams test app:
mvn exec:java -Dexec.mainClass=com.google.api.services.samples.youtube.cmdline.live.ListStreams
It simply worked.
Hope this helps you.
Not sure how much this will help but while setting up my youtube API I changed the "project.youtube.version:" so that it ended like "project.youtube.version: v3-rev174-1.22.0". If you're planning on using either the CommentHandling or CommentThreads classes then you'll need to take the "V3" from the front of the two of their used imports.
Hope this helps.

Logstash filter plugin, cant import dependency

I am having an issue with a custom filter plugin, and importing a dependency. Can anyone please help me? I get "Trying to load the X filter plugin resulted in this error: no such file to load -- memcache". The code does "require 'memcache". This is available as if I do that in any other script and run it on the CLI, it works, just not when logstash runs it? Does it use some bundled ruby or smth with a different import path? Its 1.4.2 on Debian, if that matters. Driving me insane (Im not a ruby hacker, so im spinning my wheels a bit).

how to run adword api from localhost

Anyone know how to run google adword api from localhost?
I am using adword( aw_4.6.1 version) php library.
Besides after setting all the things i got the following error
I have run it from command prompt using windows7.
C:\xampp\1.8.0\php>php C:\Apps\xampp\1.8.0\htdocs\aw_4.6.1\examples\Adx\v201309\BasicOperations\GetCampaigns.php
An error has occurred: SOAP-ERROR: Parsing WSDL: Couldn't load from
'adwords.google.com/api/adwords/cm/v201309/CampaignService?wsdl' : failed to load external entity
"adwords.google.com/api/adwords/cm/v201309/CampaignService?wsdl"
Get the following error. Looking for suggestion.
An error has occurred: SOAP-ERROR: Parsing WSDL: Couldn't load from 'adw
ords.google.com/api/adwords/cm/v201309/CampaignService?wsdl' : failed to load ex
ternal entity "https://adwords.google.com/api/adwords/cm/v201309/CampaignService
?wsdl"
Use before SOAP call:
libxml_disable_entity_loader(false);
I spent several hours searching for solution and this works.

symfony plugin installation failing [bhLDAPAuthPlugin]

I'm working on a symfony project and I need a user access conected to an LDAP server. So I searched for something already done to add to my app and found this plugin that has all I wanted.
So I tried to install with the command $ php symfony plugin:install bhLDAPAuthPlugin
for some reason it throws me this error:
No release avaiable for plugin "bhLDAPAuthPlugin"
I don't really understand what that message means. I've checked the spell of the command (also copied the command given in the page of the plugin) and same error appears. If I had no all requeriments for instalation, other errors would be thrown, right?
PS: If you know some easy way to implement by myself the comunication with LDAP (Microsoft Active Directory) will also be appreciated.
No exactly sure how to solve the error message, perhaps it helps is specifically specify which version you wish to install.
Otherwise there's an easy workaround:
Just download the tgz file from here:
http://www.symfony-project.org/plugins/bhLDAPAuthPlugin/6_0_0
and do
php symfony plugin:install bhLDAPAuthPlugin-etc-etc.tgz

Resources