Blackberry BBM : connecting MDS to simulator - blackberry

I am unable to get my simulators to talk to the BBM MDS. I have followed all the instructions in the BBM getting started giude.Since i am behind a proxy , i have also added the proxy comfiguration to the rimconfig file in the MDS1 folder of BBM.After i execute run.bat of the BBM MDS,i get the following output in the MDS window.
SCM 3.5.3.30 30 20110614
<2011-12-27 10:21:07.563 IST>:[0]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, Admin. Task- H
TTP Proxy Mappings>
<2011-12-27 10:21:07.706 IST>:[1]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, Admin. Task- r
efresh media management>
<2011-12-27 10:21:08.127 IST>:[2]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, The push servi
ce is ready to receive requests>
<2011-12-27 10:21:09.618 IST>:[3]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = J2SE 1
.6.0_22 Charsets supported:Big5,Big5-HKSCS,EUC-JP,EUC-KR,GB18030,GB2312,GBK,IBM-
Thai,IBM00858,IBM01140,IBM01141,IBM01142,IBM01143,IBM01144,IBM01145,IBM01146,IBM
01147,IBM01148,IBM01149,IBM037,IBM1026,IBM1047,IBM273,IBM277,IBM278,IBM280,IBM28
4,IBM285,IBM297,IBM420,IBM424,IBM437,IBM500,IBM775,IBM850,IBM852,IBM855,IBM857,I
BM860,IBM861,IBM862,IBM863,IBM864,IBM865,IBM866,IBM868,IBM869,IBM870,IBM871,IBM9
18,ISO-2022-CN,ISO-2022-JP,ISO-2022-JP-2,ISO-2022-KR,ISO-8859-1,ISO-8859-13,ISO-
8859-15,ISO-8859-2,ISO-8859-3,ISO-8859-4,ISO-8859-5,ISO-8859-6,ISO-8859-7,ISO-88
59-8,ISO-8859-9,JIS_X0201,JIS_X0212-1990,KOI8-R,KOI8-U,Shift_JIS,TIS-620,US-ASCI
I,UTF-16,UTF-16BE,UTF-16LE,UTF-32,UTF-32BE,UTF-32LE,UTF-8,windows-1250,windows-1
251,windows-1252,windows-1253,windows-1254,windows-1255,windows-1256,windows-125
7,windows-1258,windows-31j,x-Big5-Solaris,x-euc-jp-linux,x-EUC-TW,x-eucJP-Open,x
-IBM1006,x-IBM1025,x-IBM1046,x-IBM1097,x-IBM1098,x-IBM1112,x-IBM1122,x-IBM1123,x
-IBM1124,x-IBM1381,x-IBM1383,x-IBM33722,x-IBM737,x-IBM834,x-IBM856,x-IBM874,x-IB
M875,x-IBM921,x-IBM922,x-IBM930,x-IBM933,x-IBM935,x-IBM937,x-IBM939,x-IBM942,x-I
BM942C,x-IBM943,x-IBM943C,x-IBM948,x-IBM949,x-IBM949C,x-IBM950,x-IBM964,x-IBM970
,x-ISCII91,x-ISO-2022-CN-CNS,x-ISO-2022-CN-GB,x-iso-8859-11,x-JIS0208,x-JISAutoD
etect,x-Johab,x-MacArabic,x-MacCentralEurope,x-MacCroatian,x-MacCyrillic,x-MacDi
ngbat,x-MacGreek,x-MacHebrew,x-MacIceland,x-MacRoman,x-MacRomania,x-MacSymbol,x-
MacThai,x-MacTurkish,x-MacUkraine,x-MS932_0213,x-MS950-HKSCS,x-mswin-936,x-PCK,x
-SJIS_0213,x-UTF-16LE-BOM,X-UTF-32BE-BOM,X-UTF-32LE-BOM,x-windows-50220,x-window
s-50221,x-windows-874,x-windows-949,x-windows-950,x-windows-iso2022jp>
<2011-12-27 10:21:09.622 IST>:[4]:<BBM_MDS>:<INFO >:<LAYER = SCM, DefaultJobPool
Pool size = 10>
<2011-12-27 10:21:09.622 IST>:[5]:<BBM_MDS>:<INFO >:<LAYER = SCM, DefaultJobPool
Queue length = 20>
<2011-12-27 10:21:09.622 IST>:[6]:<BBM_MDS>:<INFO >:<LAYER = SCM, maxMem: 518979
584 maxPoolSize: 10>
<2011-12-27 10:21:09.853 IST>:[7]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Connec
ted, TOPSERVICE = KEYNEGO, LOWERSERVICE = GME>
<2011-12-27 10:21:09.854 IST>:[8]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Connec
ted, TOPSERVICE = SERVICE_BOOK, LOWERSERVICE = GME>
<2011-12-27 10:21:09.854 IST>:[9]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Connec
ted, TOPSERVICE = SRPH, LOWERSERVICE = GME>
<2011-12-27 10:21:09.854 IST>:[10]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = CMIME, LOWERSERVICE = GME>
<2011-12-27 10:21:09.855 IST>:[11]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = RIM_IM, LOWERSERVICE = GME>
<2011-12-27 10:21:09.855 IST>:[12]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = IPPP, LOWERSERVICE = GME>
<2011-12-27 10:21:09.855 IST>:[13]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = GME, LOWERSERVICE = MDP>
<2011-12-27 10:21:09.856 IST>:[14]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = REG, LOWERSERVICE = MDP>
<2011-12-27 10:21:09.856 IST>:[15]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = MDP, LOWERSERVICE = GPAK>
<2011-12-27 10:21:09.856 IST>:[16]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = GPAK, LOWERSERVICE = UDP>
<2011-12-27 10:21:10.078 IST>:[17]:<BBM_MDS>:<EVENT>:<LAYER = SCM, BBM MDS_START
MDS; >
<2011-12-27 10:21:10.085 IST>:[18]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, LAYER = SRPH
, EVENT = Initialization>
<2011-12-27 10:21:10.194 IST>:[19]:<BBM_MDS>:<INFO >:<maxMem: 518979584 maxQueue
Size: 250>
<2011-12-27 10:21:10.201 IST>:[20]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, LAYER = SRPH
, EVENT = Started>
<2011-12-27 10:21:10.205 IST>:[21]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHprotocolMainThread>
<2011-12-27 10:21:10.208 IST>:[22]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHListenOnDatagramStatus>
<2011-12-27 10:21:10.208 IST>:[23]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHListenForClientsPackets>
<2011-12-27 10:21:10.212 IST>:[24]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHQueuesManager>
<2011-12-27 10:21:10.321 IST>:[25]:<BBM_MDS>:<DEBUG>:<LAYER = SB, EVENT = Starte
d, THREAD = ListenOnDatagramStatus>
<2011-12-27 10:21:10.357 IST>:[26]:<BBM_MDS>:<DEBUG>:<LAYER = SB, EVENT = Starte
d, THREAD = ListenForClientsStatus>
<2011-12-27 10:21:10.358 IST>:[27]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, EVENT = Initi
alization>
<2011-12-27 10:21:10.516 IST>:[28]:<BBM_MDS>:<INFO >:<LAYER = SCM, BBMSessionJob
Pool Pool size = 10>
<2011-12-27 10:21:10.519 IST>:[29]:<BBM_MDS>:<INFO >:<LAYER = SCM, BBMSessionJob
Pool Queue length = 20>
<2011-12-27 10:21:10.522 IST>:[30]:<BBM_MDS>:<INFO >:<LAYER = SCM, BBMSessionJob
Pool Queue length = 1280>
<2011-12-27 10:21:11.989 IST>:[31]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, EVENT = Start
ed>
<2011-12-27 10:21:11.992 IST>:[32]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Try to create
BBMPinFilter instance>
<2011-12-27 10:21:11.992 IST>:[33]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, EVENT = Start
ed, THREAD = BBM::ListenOnDatagramStatus>
<2011-12-27 10:21:11.997 IST>:[34]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, EVENT = Start
ed, THREAD = QueuesManager>
<2011-12-27 10:21:12.060 IST>:[35]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Start loading
filteredPins>
<2011-12-27 10:21:12.195 IST>:[36]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, 0 filtered pi
ns have been loaded successfully>
<2011-12-27 10:21:12.198 IST>:[37]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Schedule relo
ad filteredPins task with interval [86400s>
<2011-12-27 10:21:12.249 IST>:[38]:<BBM_MDS>:<INFO >:<LAYER = SCM, EP2PJobManage
rDefaultJobPool Pool size = 10>
<2011-12-27 10:21:12.301 IST>:[39]:<BBM_MDS>:<INFO >:<LAYER = EP2P, Start loadin
g the store file ep2p_store.dat. Size is 0 bytes [0.0 MB].>
<2011-12-27 10:21:12.307 IST>:[40]:<BBM_MDS>:<INFO >:<LAYER = EP2P, Removed 0 fr
ee block(s) from ep2p_store.dat
End loading the store file ep2p_store.dat. Size is 0 bytes [0.0 MB].>
<2011-12-27 10:21:12.344 IST>:[41]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Try to create
BBMVersionFilter instance>
<2011-12-27 10:21:12.395 IST>:[42]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Start loading
VersionsReleased>
<2011-12-27 10:21:12.422 IST>:[43]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, 0 versions re
leased have been loaded successfully>
<2011-12-27 10:21:12.424 IST>:[44]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Schedule relo
ad versionReleased task with interval [86400s]>
<2011-12-27 10:21:12.486 IST>:[45]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Start loading
plugin controls>
<2011-12-27 10:21:12.556 IST>:[46]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, 0 platform ap
p controls have been loaded successfully>
<2011-12-27 10:21:12.559 IST>:[47]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, Schedule relo
ad plugin controls task with interval [86400s]>
Dec 27, 2011 10:21:12 AM org.apache.catalina.startup.Embedded start
INFO: Starting tomcat server
<2011-12-27 10:21:12.782 IST>:[48]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, Admin. Task-
HTTP Proxy Mappings>
<2011-12-27 10:21:12.785 IST>:[49]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, Admin. Task-
refresh media management>
Dec 27, 2011 10:21:14 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.28
<2011-12-27 10:21:15.143 IST>:[50]:<BBM_MDS>:<ERROR>:<LAYER = KeyNego, Cannot in
itialize AES-256: Did you install Unlimited Strength Jurisdiction Policy Files?>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, net.rim.application.ipproxyservice.b.a: Initialize failed>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.application.ipproxyservice.IPProxyServiceApplication.start(Un
known Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.application.ipproxyservice.IPProxyServiceApplication.main(Unk
nown Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, Caused by: java.security.InvalidKeyException: Illegal key size>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at javax.crypto.Cipher.a(DashoA13*..)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at javax.crypto.Cipher.a(DashoA13*..)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at javax.crypto.Cipher.a(DashoA13*..)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at javax.crypto.Cipher.init(DashoA13*..)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at javax.crypto.Cipher.init(DashoA13*..)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.protocol.keynego.a.c.Xg(Unknown Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.protocol.keynego.a.c.<init>(Unknown Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.protocol.keynego.KeyNegoProtocol.kE(Unknown Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.protocol.keynego.KeyNegoProtocol.start(Unknown Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.service.c.start(Unknown Source)>
<2011-12-27 10:21:15.156 IST>:[51]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, ... 2 more>
C:\BBM SDK v1.1 for BlackBerry Java\MDS Simulator\MDSv3.5.3\sdk\mds\Servers\MDS1
After this point , when i run the sim1.bat and sim2.bat and try to connect to the internet,i don see anything happening in the MDS window. In the simulator i get an error "Cannot find the requested server" .Has anyone faced the same problem?

There are 2 things....
1) BBM is incompatible with Java 7... If you are using tat, it wont work... See to it you use Blackberry 6 simulators also, i mean the 9800 and not the 9900...
2) BBM is incompatible with jre-64-bit.... Normally if you have automatic update installed on your Windows7, there are very high changes of you having the 64-bit version.... Go to control panel, remove the 64-bit... If still not working, then uninstall 32-bit also and reinstall only the 32-bit.
If the above mentioned things doesnt work for you, let me know.

Related

How to resolve the Flume Syslog set up error - "Event size larger than specified event size: 2500. Consider increasing the max event size"

I am trying to set up Flume syslog source using org.apache.flume.source.MultiportSyslogTCPSource. Set up and configuration successful but I get the following error while flume generates the event from syslog.
[INFO ] [2019-03-28 13:22:27.217] [[channel=file-channel] - CheckpointBackUpThread] [org.apache.flume.channel.file.EventQueueBackingStoreFile] - Checkpoint backup completed.
[WARN ] [2019-03-28 13:22:31.853] [NioProcessor-2]
[org.apache.flume.source.MultiportSyslogTCPSource] - Event size larger than specified event size: 2500. Consider increasing the max event size.
[INFO ] [2019-03-28 13:22:35.686] [SinkRunner-PollingRunner-DefaultSinkProcessor] [org.apache.flume.sink.LoggerSink] - Event: { headers:{flume.syslog.status=Invalid} body: 31 33 33 62 32 20 74 3C 31 33 34 3E 4D 61 72 20 133b2 t<134>Mar }
Here is my configuration looks like:
#source,channel and sink
testagent.sources = testlog
testagent.channels = file-channel
testagent.sinks = logger-sink
#source
testagent.sources.testlog.type = org.apache.flume.source.MultiportSyslogTCPSource
testagent.sources.testlog.ports = 9002
testagent.sources.testlog.host = 127.0.0.1
#sink
testagent.sinks.logger-sink.type = logger
#channel
testagent.channels.file-channel.type = file
testagent.channels.file-channel.dataDirs = /test/data/01/
testagent.channels.file-channel.checkpointDir = /test/data/01/checkpoint
testagent.channels.file-channel.useDualCheckpoints = true
testagent.channels.file-channel.backupCheckpointDir = /test/data/01/checkpoint-backup
testagent.channels.file-channel.transactionCapacity = 10000
testagent.channels.file-channel.checkpointInterval = 20000
testagent.channels.file-channel.maxFileSize = 1072692224
testagent.channels.file-channel.minimumRequiredSpace = 524288000
testagent.channels.file-channel.capacity = 1000000
testagent.channels.file-channel.keep-alive = 3
testagent.channels.file-channel.checkpointOnClose = true
testagent.sinks.logger-sink.channel = file-channel
testagent.sources.testlog.channels = file-channel
Logs generated out of my test application should successfully be displayed into the flume agent log and events should be generated out of each log statement(line).
Update the size of the event in the configuration as shown below:
testagent.sinks.logger-sink.maxBytesToLog = 256
The default size of the event is 16 bytes.

kafka bootstrap broker disconnected using docker-compose

Good morning.
First of all, I've created a docker swarm with 2 physical hosts and an overlay network. In the same host I've created 2 containers (postgres and ambari servers) and one with ambari agent in which I'll install kafka, zookeeper, spark,... from ambari. The scope is installing several containers in several hosts, but I'm trying first like this as I'm not getting it working.
The fact is that once deployed with Ambari, I change kafka configuration to add advertised.host.name to the physical host's ip and advertised.port to 9092 to bind it to physical host's 9092 port.
When trying it, I'm always getting the following errors:
WARN Error while fetching metadata with correlation id 17 : {prueba2=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)
If trying by sending to container's 6667 port
or
[2018-08-30 12:06:28,758] WARN Bootstrap broker 192.168.0.28:9092 disconnected (org.apache.kafka.clients.NetworkClient)
If trying to physical host's port 9092.
Thanks for help and please ask for any further information needed to help solving this problem.
EDIT1:
Configuration changed to the following properties.
and kafka-broker is not running. server.log is showing following trace:
root#host1:/usr/hdp/2.6.3.0-235/kafka# cat /var/log/kafka/server.log
[2018-09-04 09:17:46,964] INFO KafkaConfig values:
advertised.host.name = host1.ambari
advertised.listeners = INTERNO://host1.ambari:6667,EXTERNO://192.168.0.28:9092
advertised.port = 9092
authorizer.class.name =
auto.create.topics.enable = true
auto.leader.rebalance.enable = true
background.threads = 10
broker.id = -1
broker.id.generation.enable = true
broker.rack = null
compression.type = producer
connections.max.idle.ms = 600000
controlled.shutdown.enable = true
controlled.shutdown.max.retries = 3
controlled.shutdown.retry.backoff.ms = 5000
controller.socket.timeout.ms = 30000
default.replication.factor = 1
delete.topic.enable = false
fetch.purgatory.purge.interval.requests = 10000
group.max.session.timeout.ms = 300000
group.min.session.timeout.ms = 6000
host.name =
inter.broker.protocol.version = 0.10.1-IV2
leader.imbalance.check.interval.seconds = 300
leader.imbalance.per.broker.percentage = 10
listeners = INTERNO://host1.ambari:6667,EXTERNO://host1.ambari:6667
log.cleaner.backoff.ms = 15000
log.cleaner.dedupe.buffer.size = 134217728
log.cleaner.delete.retention.ms = 86400000
log.cleaner.enable = true
log.cleaner.io.buffer.load.factor = 0.9
log.cleaner.io.buffer.size = 524288
log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
log.cleaner.min.cleanable.ratio = 0.5
log.cleaner.min.compaction.lag.ms = 0
log.cleaner.threads = 1
log.cleanup.policy = [delete]
log.dir = /tmp/kafka-logs
log.dirs = /kafka-logs
log.flush.interval.messages = 9223372036854775807
log.flush.interval.ms = null
log.flush.offset.checkpoint.interval.ms = 60000
log.flush.scheduler.interval.ms = 9223372036854775807
log.index.interval.bytes = 4096
log.index.size.max.bytes = 10485760
log.message.format.version = 0.10.1-IV2
log.message.timestamp.difference.max.ms = 9223372036854775807
log.message.timestamp.type = CreateTime
log.preallocate = false
log.retention.bytes = -1
log.retention.check.interval.ms = 300000
log.retention.hours = 168
log.retention.minutes = null
log.retention.ms = null
log.roll.hours = 168
log.roll.jitter.hours = 0
log.roll.jitter.ms = null
log.roll.ms = null
log.segment.bytes = 1073741824
log.segment.delete.delay.ms = 60000
max.connections.per.ip = 2147483647
max.connections.per.ip.overrides =
message.max.bytes = 1000000
metric.reporters = []
metrics.num.samples = 2
metrics.sample.window.ms = 30000
min.insync.replicas = 1
num.io.threads = 8
num.network.threads = 3
num.partitions = 1
num.recovery.threads.per.data.dir = 1
num.replica.fetchers = 1
offset.metadata.max.bytes = 4096
offsets.commit.required.acks = -1
offsets.commit.timeout.ms = 5000
offsets.load.buffer.size = 5242880
offsets.retention.check.interval.ms = 600000
offsets.retention.minutes = 86400000
offsets.topic.compression.codec = 0
offsets.topic.num.partitions = 50
offsets.topic.replication.factor = 3
offsets.topic.segment.bytes = 104857600
port = 6667
principal.builder.class = class org.apache.kafka.common.security.auth.DefaultPrincipalBuilder
producer.purgatory.purge.interval.requests = 10000
queued.max.requests = 500
quota.consumer.default = 9223372036854775807
quota.producer.default = 9223372036854775807
quota.window.num = 11
quota.window.size.seconds = 1
replica.fetch.backoff.ms = 1000
replica.fetch.max.bytes = 1048576
replica.fetch.min.bytes = 1
replica.fetch.response.max.bytes = 10485760
replica.fetch.wait.max.ms = 500
replica.high.watermark.checkpoint.interval.ms = 5000
replica.lag.time.max.ms = 10000
replica.socket.receive.buffer.bytes = 65536
replica.socket.timeout.ms = 30000
replication.quota.window.num = 11
replication.quota.window.size.seconds = 1
request.timeout.ms = 30000
reserved.broker.max.id = 1000
sasl.enabled.mechanisms = [GSSAPI]
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.principal.to.local.rules = [DEFAULT]
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism.inter.broker.protocol = GSSAPI
security.inter.broker.protocol = PLAINTEXT
socket.receive.buffer.bytes = 102400
socket.request.max.bytes = 104857600
socket.send.buffer.bytes = 102400
ssl.cipher.suites = null
ssl.client.auth = none
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
unclean.leader.election.enable = true
zookeeper.connect = host1.ambari:2181
zookeeper.connection.timeout.ms = 25000
zookeeper.session.timeout.ms = 30000
zookeeper.set.acl = false
zookeeper.sync.time.ms = 2000
(kafka.server.KafkaConfig)
[2018-09-04 09:17:46,974] FATAL (kafka.Kafka$)
java.lang.IllegalArgumentException: Error creating broker listeners from 'INTERNO://host1.ambari:6667,EXTERNO://host1.ambari:6667': No enum constant org.apache.kafka.common.protocol.SecurityProtocol.INTERNO
at kafka.server.KafkaConfig.validateUniquePortAndProtocol(KafkaConfig.scala:994)
at kafka.server.KafkaConfig.getListeners(KafkaConfig.scala:1013)
at kafka.server.KafkaConfig.<init>(KafkaConfig.scala:966)
at kafka.server.KafkaConfig$.fromProps(KafkaConfig.scala:779)
at kafka.server.KafkaConfig$.fromProps(KafkaConfig.scala:776)
at kafka.server.KafkaServerStartable$.fromProps(KafkaServerStartable.scala:28)
at kafka.Kafka$.main(Kafka.scala:58)
at kafka.Kafka.main(Kafka.scala)
If you're deploying Kafka within Docker, you need to configure the listener to be accessible if you want to be able to access it from outside your Docker network too. This article explains the details.

configuration for flume to write large file in HDFS

My config file :
agent1.sources = source1
agent1.channels = channel1
agent1.sinks = sink1
agent1.sources.source1.type = spooldir
agent1.sources.source1.spoolDir = /var/SpoolDir
agent1.sinks.sink1.type = hdfs
agent1.sinks.sink1.hdfs.path = hdfs://templatecentosbase.oneglobe.com:8020/user/Banking4
agent1.sinks.sink1.hdfs.filePrefix = Banking_Details
agent1.sinks.sink1.hdfs.fileSuffix = .avro
agent1.sinks.sink1.hdfs.serializer = avro_event
agent1.sinks.sink1.hdfs.serializer = DataStream
#agent1.sinks.sink1.hdfs.callTimeout = 20000
agent1.sinks.sink1.hdfs.rollCount = 0
agent1.sinks.sink1.hdfs.rollsize = 100000000
#agent1.sinks.sink1.hdfs.txnEventMax = 40000
agent1.sinks.sink1.hdfs.rollInterval = 0
#agent1.sinks.sink1.serializer.codeC =
agent1.channels.channel1.type = memory
agent1.channels.channel1.capacity = 100000000
agent1.channels.channel1.transactionCapacity = 100000000
agent1.sources.source1.channels = channel1
agent1.sinks.sink1.channel = channel1
Can anyone help me in getting this resolved. Source file is nearly 400MB its writing bits and pieces in HDFS. example ( 1.5mb to 2mb )

ROBLOX - Why is this fly script working only in the Studio?

I really need help..
I have this code for fly, as a backpack item:
Name = "Fly"
pi = 3.141592653589793238462643383279502884197163993751
a = 0
s = 0
ndist = 13
rs = 0.025
siz = Vector3.new(1, 1, 1)
form = 0
flow = {}
function CFC(P1,P2)
local Place0 = CFrame.new(P1.CFrame.x,P1.CFrame.y,P1.CFrame.z)
local Place1 = P2.Position
P1.Size = Vector3.new(P1.Size.x,P1.Size.y,(Place0.p - Place1).magnitude)
P1.CFrame = CFrame.new((Place0.p + Place1)/2,Place0.p)
end
function checktable(table, parentneeded)
local i
local t = {}
for i = 1, #table do
if table[i] ~= nil then
if string.lower(type(table[i])) == "userdata" then
if parentneeded == true then
if table[i].Parent ~= nil then
t[#t + 1] = table[i]
end
else
t[#t + 1] = table[i]
end
end
end
end
return t
end
if script.Parent.Name ~= Name then
User = game:service("Players").Nineza
HB = Instance.new("HopperBin")
HB.Name = Name
HB.Parent = User.StarterGear
script.Parent = HB
User.Character:BreakJoints()
end
speed = 50
script.Parent.Selected:connect(function(mar)
s = 1
torso = script.Parent.Parent.Parent.Character.Torso
LeftShoulder = torso["Left Shoulder"]
RightShoulder = torso["Right Shoulder"]
LeftHip = torso["Left Hip"]
RightHip = torso["Right Hip"]
human = script.Parent.Parent.Parent.Character.Humanoid
bv = Instance.new("BodyVelocity")
bv.maxForce = Vector3.new(0,math.huge,0)
bv.velocity = Vector3.new(0,0,0)
bv.Parent = torso
bg = Instance.new("BodyGyro")
bg.maxTorque = Vector3.new(0,0,0)
bg.Parent = torso
connection = mar.Button1Down:connect(function()
a = 1
bv.maxForce = Vector3.new(math.huge,math.huge,math.huge)
bg.maxTorque = Vector3.new(900000,900000,900000)
bg.cframe = CFrame.new(torso.Position,mar.hit.p) * CFrame.fromEulerAnglesXYZ(math.rad(-90),0,0)
bv.velocity = CFrame.new(torso.Position,mar.hit.p).lookVector * speed
moveconnect = mar.Move:connect(function()
bg.maxTorque = Vector3.new(900000,900000,900000)
bg.cframe = CFrame.new(torso.Position,mar.hit.p) * CFrame.fromEulerAnglesXYZ(math.rad(-90),0,0)
bv.velocity = CFrame.new(torso.Position,mar.hit.p).lookVector * speed
end)
upconnect = mar.Button1Up:connect(function()
a = 0
moveconnect:disconnect()
upconnect:disconnect()
bv.velocity = Vector3.new(0,0,0)
bv.maxForce = Vector3.new(0,math.huge,0)
torso.Velocity = Vector3.new(0,0,0)
bg.cframe = CFrame.new(torso.Position,torso.Position + Vector3.new(torso.CFrame.lookVector.x,0,torso.CFrame.lookVector.z))
wait(1)
end)
end)
while s == 1 do
wait(0.02)
flow = checktable(flow, true)
local i
for i = 1,#flow do
flow[i].Transparency = flow[i].Transparency + rs
if flow[i].Transparency >= 1 then flow[i]:remove() end
end
if a == 1 then
flow[#flow + 1] = Instance.new("Part")
local p = flow[#flow]
p.formFactor = form
p.Size = siz
p.Anchored = true
p.CanCollide = false
p.TopSurface = 0
p.BottomSurface = 0
if #flow - 1 > 0 then
local pr = flow[#flow - 1]
p.Position = torso.Position - torso.Velocity/ndist
CFC(p, pr)
else
p.CFrame = CFrame.new(torso.Position - torso.Velocity/ndist, torso.CFrame.lookVector)
end
p.BrickColor = BrickColor.new("Cyan")
p.Transparency = 1
p.Parent = torso
local marm = Instance.new("BlockMesh")
marm.Scale = Vector3.new(1.9, 0.9, 1.725)
marm.Parent = p
local amplitude
local frequency
amplitude = pi
desiredAngle = amplitude
RightShoulder.MaxVelocity = 0.4
LeftShoulder.MaxVelocity = 0.4
RightHip.MaxVelocity = pi/10
LeftHip.MaxVelocity = pi/10
RightShoulder.DesiredAngle = desiredAngle
LeftShoulder.DesiredAngle = -desiredAngle
RightHip.DesiredAngle = 0
LeftHip.DesiredAngle = 0
end
end
end)
script.Parent.Deselected:connect(function()
a = 0
s = 0
bv:remove()
bg:remove()
if connection ~= nil then
connection:disconnect()
end
if moveconnect ~= nil then
moveconnect:disconnect()
end
if upconnect ~= nil then
upconnect:disconnect()
end
while s == 0 do
wait()
if #flow > 0 then
flow = checktable(flow, true)
local i
for i = 1,#flow do
flow[i].Transparency = flow[i].Transparency + rs
if flow[i].Transparency >= 1 then flow[i]:remove() end
end
end
end
end)
while true do
wait()
if s == 1 then
return
end
end
script:remove()
The script is in a HopperBin Object in the game's StarterPack Folder.
Now if you try it on your own, you'll see that it will work, BUT if you publish the game, play it via ROBLOX(not the studio) and try to use the item, you won't fly.
Any ideas why?
It's been a long time since I haven't played ROBLOX, so my answer might be inaccurate.
First, you need to understand the difference between a Script and a Localscript. In a nutshell, a script runs server-side whereas a Localscript runs client-side. Your fly script is expected to run on a player's client, thus you have to use a Localscript.
Your regular script works in build-mode because scripts are run on your client, and thus are considered as Localscripts. When you publish your game and play it, your computer doesn't work as a server anymore, but as a client.
In addition to this, as you use a localscript, you may have to change the following line :
-- gets the client (local player) on which the script is running
User = Game:GetService("Players").LocalPlayer
Also, avoid relative paths such as script.Parent.Parent.Parent..... You want to get the client's torso, so just use your User variable as per : User.Character.Torso. Do the same for the character's Humanoid object.
I think it's because the time to load not existing try this at line1:
repeat wait() until game.Players.LocalPlayer.Character

Blackberry MDS Simulator installation problem

I'm developing an app that needs to send something via BBM, so I wanted to try it out.
The problem is I can't get the BBM simulator to run.
I followed the instructions found on the Blackberry Messenger page but when I execute run.bat it says the following:
<2011-09-01 23:26:08.530 PYT>:[0]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, Admin. Task- H
TTP Proxy Mappings>
<2011-09-01 23:26:08.538 PYT>:[1]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, Admin. Task- r
efresh media management>
<2011-09-01 23:26:08.577 PYT>:[2]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, The push servi
ce is ready to receive requests>
<2011-09-01 23:26:08.635 PYT>:[3]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = J2SE 1
.7.0 Charsets supported:Big5,Big5-HKSCS,EUC-JP,EUC-KR,GB18030,GB2312,GBK,IBM-Tha
i,IBM00858,IBM01140,IBM01141,IBM01142,IBM01143,IBM01144,IBM01145,IBM01146,IBM011
47,IBM01148,IBM01149,IBM037,IBM1026,IBM1047,IBM273,IBM277,IBM278,IBM280,IBM284,I
BM285,IBM297,IBM420,IBM424,IBM437,IBM500,IBM775,IBM850,IBM852,IBM855,IBM857,IBM8
60,IBM861,IBM862,IBM863,IBM864,IBM865,IBM866,IBM868,IBM869,IBM870,IBM871,IBM918,
ISO-2022-CN,ISO-2022-JP,ISO-2022-JP-2,ISO-2022-KR,ISO-8859-1,ISO-8859-13,ISO-885
9-15,ISO-8859-2,ISO-8859-3,ISO-8859-4,ISO-8859-5,ISO-8859-6,ISO-8859-7,ISO-8859-
8,ISO-8859-9,JIS_X0201,JIS_X0212-1990,KOI8-R,KOI8-U,Shift_JIS,TIS-620,US-ASCII,U
TF-16,UTF-16BE,UTF-16LE,UTF-32,UTF-32BE,UTF-32LE,UTF-8,windows-1250,windows-1251
,windows-1252,windows-1253,windows-1254,windows-1255,windows-1256,windows-1257,w
indows-1258,windows-31j,x-Big5-HKSCS-2001,x-Big5-Solaris,x-euc-jp-linux,x-EUC-TW
,x-eucJP-Open,x-IBM1006,x-IBM1025,x-IBM1046,x-IBM1097,x-IBM1098,x-IBM1112,x-IBM1
122,x-IBM1123,x-IBM1124,x-IBM1364,x-IBM1381,x-IBM1383,x-IBM33722,x-IBM737,x-IBM8
33,x-IBM834,x-IBM856,x-IBM874,x-IBM875,x-IBM921,x-IBM922,x-IBM930,x-IBM933,x-IBM
935,x-IBM937,x-IBM939,x-IBM942,x-IBM942C,x-IBM943,x-IBM943C,x-IBM948,x-IBM949,x-
IBM949C,x-IBM950,x-IBM964,x-IBM970,x-ISCII91,x-ISO-2022-CN-CNS,x-ISO-2022-CN-GB,
x-iso-8859-11,x-JIS0208,x-JISAutoDetect,x-Johab,x-MacArabic,x-MacCentralEurope,x
-MacCroatian,x-MacCyrillic,x-MacDingbat,x-MacGreek,x-MacHebrew,x-MacIceland,x-Ma
cRoman,x-MacRomania,x-MacSymbol,x-MacThai,x-MacTurkish,x-MacUkraine,x-MS932_0213
,x-MS950-HKSCS,x-MS950-HKSCS-XP,x-mswin-936,x-PCK,x-SJIS_0213,x-UTF-16LE-BOM,X-U
TF-32BE-BOM,X-UTF-32LE-BOM,x-windows-50220,x-windows-50221,x-windows-874,x-windo
ws-949,x-windows-950,x-windows-iso2022jp>
<2011-09-01 23:26:08.637 PYT>:[4]:<BBM_MDS>:<INFO >:<LAYER = SCM, DefaultJobPool
Pool size = 10>
<2011-09-01 23:26:08.638 PYT>:[5]:<BBM_MDS>:<INFO >:<LAYER = SCM, DefaultJobPool
Queue length = 20>
<2011-09-01 23:26:08.639 PYT>:[6]:<BBM_MDS>:<INFO >:<LAYER = SCM, maxMem: 518979
584 maxPoolSize: 10>
<2011-09-01 23:26:08.653 PYT>:[7]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Connec
ted, TOPSERVICE = KEYNEGO, LOWERSERVICE = GME>
<2011-09-01 23:26:08.654 PYT>:[8]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Connec
ted, TOPSERVICE = SERVICE_BOOK, LOWERSERVICE = GME>
<2011-09-01 23:26:08.655 PYT>:[9]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Connec
ted, TOPSERVICE = SRPH, LOWERSERVICE = GME>
<2011-09-01 23:26:08.656 PYT>:[10]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = CMIME, LOWERSERVICE = GME>
<2011-09-01 23:26:08.657 PYT>:[11]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = RIM_IM, LOWERSERVICE = GME>
<2011-09-01 23:26:08.658 PYT>:[12]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = IPPP, LOWERSERVICE = GME>
<2011-09-01 23:26:08.659 PYT>:[13]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = GME, LOWERSERVICE = MDP>
<2011-09-01 23:26:08.660 PYT>:[14]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = REG, LOWERSERVICE = MDP>
<2011-09-01 23:26:08.661 PYT>:[15]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = MDP, LOWERSERVICE = GPAK>
<2011-09-01 23:26:08.662 PYT>:[16]:<BBM_MDS>:<DEBUG>:<LAYER = SCM, EVENT = Conne
cted, TOPSERVICE = GPAK, LOWERSERVICE = UDP>
<2011-09-01 23:26:08.674 PYT>:[17]:<BBM_MDS>:<EVENT>:<LAYER = SCM, BBM MDS_START
MDS; >
<2011-09-01 23:26:08.676 PYT>:[18]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, LAYER = SRPH
, EVENT = Initialization>
<2011-09-01 23:26:08.699 PYT>:[19]:<BBM_MDS>:<INFO >:<maxMem: 518979584 maxQueue
Size: 250>
<2011-09-01 23:26:08.701 PYT>:[20]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, LAYER = SRPH
, EVENT = Started>
<2011-09-01 23:26:08.702 PYT>:[21]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHprotocolMainThread>
<2011-09-01 23:26:08.703 PYT>:[22]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHListenOnDatagramStatus>
<2011-09-01 23:26:08.705 PYT>:[23]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHListenForClientsPackets>
<2011-09-01 23:26:08.705 PYT>:[24]:<BBM_MDS>:<DEBUG>:<LAYER = SRPH, EVENT = Star
ted, THREAD = SRPHQueuesManager>
<2011-09-01 23:26:08.708 PYT>:[25]:<BBM_MDS>:<DEBUG>:<LAYER = SB, EVENT = Starte
d, THREAD = ListenOnDatagramStatus>
<2011-09-01 23:26:08.708 PYT>:[26]:<BBM_MDS>:<DEBUG>:<LAYER = SB, EVENT = Starte
d, THREAD = ListenForClientsStatus>
<2011-09-01 23:26:08.709 PYT>:[27]:<BBM_MDS>:<DEBUG>:<LAYER = BBM, EVENT = Initi
alization>
<2011-09-01 23:26:08.737 PYT>:[28]:<BBM_MDS>:<INFO >:<LAYER = SCM, BBMSessionJob
Pool Pool size = 10>
<2011-09-01 23:26:08.737 PYT>:[29]:<BBM_MDS>:<INFO >:<LAYER = SCM, BBMSessionJob
Pool Queue length = 20>
<2011-09-01 23:26:08.739 PYT>:[30]:<BBM_MDS>:<INFO >:<LAYER = SCM, BBMSessionJob
Pool Queue length = 1280>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, net.rim.application.ipproxyservice.b.a: Initialize failed>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.application.ipproxyservice.IPProxyServiceApplication.start(Un
known Source)>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.application.ipproxyservice.IPProxyServiceApplication.main(Unk
nown Source)>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, Caused by: java.lang.Exception: java.lang.Exception: java.lang.SecurityExc
eption>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.protocol.bbm.BBMProtocol.initialize(Unknown Source)>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.protocol.bbm.BBMProtocol.start(Unknown Source)>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, at net.rim.service.c.start(Unknown Source)>
<2011-09-01 23:26:08.789 PYT>:[31]:<BBM_MDS>:<ERROR>:<LAYER = SCM, EVENT = Excep
tion, ... 2 more>
Java SE Development Kit 7 installed: C:\jdk1.7.0\
Java JRE installed: C:\jdk1.7.0\jre7\
(Note that there is another jre folder: C:\jdk1.7.0\jre)
JAVA_HOME variable points to: C:\jdk1.7.0\
Added "C:\jdk1.7.0\bin\;" to the front of path variable.
Copied files local_policy.jar and US_export_policy.jar to both
1) C:\jdk1.7.0\jre\lib\security ; and
2) C:\jdk1.7.0\jre7\lib\security
(I first copied them only to C:\jdk1.7.0\jre7\lib\security but it said "Did you install Unlimited Strength Jurisdiction Policy Files?")
I downloaded the SDK, extracted the contents to "C:\BBM\", got into MDS Simulator and extracted the contents right there as well.
Running Windows 7 64 bits.
What am I missing here?
The BBM SDK does work with Java 7 JDK x86 on Windows x64.
But if you install Java 7, then you must install "Java Cryptography Extension (JCE) Unlimited Strength Jurisdiction Policy Files 7" from http://www.oracle.com/technetwork/java/javase/downloads/jce-7-download-432124.html , and not version 6 of the JCE files as per the instructions.
Extract the contents of this zip, then copy the extracted policy files to C:\Program Files (x86)\Java\jdk1.7.0_01\jre\lib\security
Hope this helps.
BBM must work on java 32bits and not 64. I was mentioned in install documentation
Not sure about java 7.

Resources