How to use subnets in blueprints of Apache Brooklyn - jclouds
I am trying to use a subnet (precreated in AWS) in my Blueprint to run it in Apache Brooklyn.
I have the following Blueprint without subnet, which works correctly. (Ambari Server, with Cluster of two Hadoop nodes)
name: IDA Ambari All Services without Security Group
description: This Application is used to build one Ambari Server and a Cluster of Ambari Agents
origin: vendor
location:
jclouds:aws-ec2:
region: eu-central-1
identity: identity
credential: credential
osFamily: RHEL
osVersionRegex: 6.*
hardwareId: m3.medium
services:
- type: io.brooklyn.ambari.AmbariCluster
brooklyn.config:
initialSize: 2
install.version: 2.1.0
services:
- FALCON
And in the moment that I add the new name of the subnet (last lines of the following blueprint), the deployment in Apache Brooklyn fails.
name: IDA Ambari All Services without Security Group
description: This Application is used to build one Ambari Server and a Cluster of Ambari Agents
origin: vendor
location:
jclouds:aws-ec2:
region: eu-central-1
identity: identity
credential: credential
osFamily: RHEL
osVersionRegex: 6.*
hardwareId: m3.medium
services:
- type: io.brooklyn.ambari.AmbariCluster
brooklyn.config:
initialSize: 2
install.version: 2.1.0
services:
- FALCON
provisioning.properties:
networkName: subnet-003dfb7b
I suppose that the problem comes with the configuration of jclouds in the Blueprint. But I do not know.
The errors:
In Nodes
start failed with error: java.lang.IllegalStateException: Node in
cluster DynamicClusterImpl{id=tEESwAU9} failed: 2 of 2 parallel child
tasks failed, 2 errors including: Error invoking start at
AmbariAgentImpl{id=AS9jZ9AC}: org.jclouds.compute.RunNodesException:
error running 1 node
group(brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j)
location(eu-central-1) image(ami-6cd3ee71) size(m3.medium)
options({inboundPorts=[22, 2], scriptPresent=true,
userMetadata={Name=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j-jn19,
brooklyn-user=root, brooklyn-app-id=XYDdTpTx, brooklyn-app-name=IDA
Ambari All Services without Security Group,
brooklyn-entity-id=AS9jZ9AC, brooklyn-entity-name=AmbariAgent:AS9j,
brooklyn-server-creation-date=2015-08-10-1421},
userDataCksum=2f4a740b, subnetId=subnet-003dfb7b}) Execution failures:
0 error[s] Node failures: 1) NoSuchElementException on node
eu-central-1/i-4af7818b: java.util.NoSuchElementException: could not
connect to any ip address port 22 on node {id=eu-central-1/i-4af7818b,
providerId=i-4af7818b, location={scope=ZONE, id=eu-central-1b,
description=eu-central-1b, parent=eu-central-1, iso3166Codes=[DE-HE]},
group=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j,
imageId=eu-central-1/ami-6cd3ee71, os={family=rhel, arch=hvm,
version=6.6,
description=411009282317/RightImage_RHEL_6.6_x64_v14.2.1_HVM_EBS,
is64Bit=true}, status=RUNNING[running], loginPort=22,
hostname=ip-172-31-17-195, privateAddresses=[172.31.17.195],
publicAddresses=[52.28.233.226], hardware={id=m3.medium,
providerId=m3.medium, processors=[{cores=1.0, speed=3.0}], ram=3840,
volumes=[{type=LOCAL, size=4.0, device=/dev/sdb, bootDevice=false,
durable=false}, {id=vol-e940020b, type=SAN, device=/dev/sda1,
bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=Predicates.and(Predicates.alwaysTrue(),Predicates.or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),Predicates.alwaysTrue(),Predicates.alwaysTrue())},
loginUser=root} at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745) 1 error[s] Failure running
task starting 2 nodes (parallel) (OnIRxglV): 2 of 2 parallel child
tasks failed, 2 errors including: Error invoking start at
AmbariAgentImpl{id=AS9jZ9AC}: org.jclouds.compute.RunNodesException:
error running 1 node
group(brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j)
location(eu-central-1) image(ami-6cd3ee71) size(m3.medium)
options({inboundPorts=[22, 2], scriptPresent=true,
userMetadata={Name=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j-jn19,
brooklyn-user=root, brooklyn-app-id=XYDdTpTx, brooklyn-app-name=IDA
Ambari All Services without Security Group,
brooklyn-entity-id=AS9jZ9AC, brooklyn-entity-name=AmbariAgent:AS9j,
brooklyn-server-creation-date=2015-08-10-1421},
userDataCksum=2f4a740b, subnetId=subnet-003dfb7b}) Execution failures:
0 error[s] Node failures: 1) NoSuchElementException on node
eu-central-1/i-4af7818b: java.util.NoSuchElementException: could not
connect to any ip address port 22 on node {id=eu-central-1/i-4af7818b,
providerId=i-4af7818b, location={scope=ZONE, id=eu-central-1b,
description=eu-central-1b, parent=eu-central-1, iso3166Codes=[DE-HE]},
group=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j,
imageId=eu-central-1/ami-6cd3ee71, os={family=rhel, arch=hvm,
version=6.6,
description=411009282317/RightImage_RHEL_6.6_x64_v14.2.1_HVM_EBS,
is64Bit=true}, status=RUNNING[running], loginPort=22,
hostname=ip-172-31-17-195, privateAddresses=[172.31.17.195],
publicAddresses=[52.28.233.226], hardware={id=m3.medium,
providerId=m3.medium, processors=[{cores=1.0, speed=3.0}], ram=3840,
volumes=[{type=LOCAL, size=4.0, device=/dev/sdb, bootDevice=false,
durable=false}, {id=vol-e940020b, type=SAN, device=/dev/sda1,
bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=Predicates.and(Predicates.alwaysTrue(),Predicates.or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),Predicates.alwaysTrue(),Predicates.alwaysTrue())},
loginUser=root} at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745) 1 error[s]
In the Ambari Server
start failed with error: java.lang.IllegalStateException: Node in
cluster DynamicClusterImpl{id=tEESwAU9} failed: 2 of 2 parallel child
tasks failed, 2 errors including: Error invoking start at
AmbariAgentImpl{id=AS9jZ9AC}: org.jclouds.compute.RunNodesException:
error running 1 node
group(brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j)
location(eu-central-1) image(ami-6cd3ee71) size(m3.medium)
options({inboundPorts=[22, 2], scriptPresent=true,
userMetadata={Name=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j-jn19,
brooklyn-user=root, brooklyn-app-id=XYDdTpTx, brooklyn-app-name=IDA
Ambari All Services without Security Group,
brooklyn-entity-id=AS9jZ9AC, brooklyn-entity-name=AmbariAgent:AS9j,
brooklyn-server-creation-date=2015-08-10-1421},
userDataCksum=2f4a740b, subnetId=subnet-003dfb7b}) Execution failures:
0 error[s] Node failures: 1) NoSuchElementException on node
eu-central-1/i-4af7818b: java.util.NoSuchElementException: could not
connect to any ip address port 22 on node {id=eu-central-1/i-4af7818b,
providerId=i-4af7818b, location={scope=ZONE, id=eu-central-1b,
description=eu-central-1b, parent=eu-central-1, iso3166Codes=[DE-HE]},
group=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j,
imageId=eu-central-1/ami-6cd3ee71, os={family=rhel, arch=hvm,
version=6.6,
description=411009282317/RightImage_RHEL_6.6_x64_v14.2.1_HVM_EBS,
is64Bit=true}, status=RUNNING[running], loginPort=22,
hostname=ip-172-31-17-195, privateAddresses=[172.31.17.195],
publicAddresses=[52.28.233.226], hardware={id=m3.medium,
providerId=m3.medium, processors=[{cores=1.0, speed=3.0}], ram=3840,
volumes=[{type=LOCAL, size=4.0, device=/dev/sdb, bootDevice=false,
durable=false}, {id=vol-e940020b, type=SAN, device=/dev/sda1,
bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=Predicates.and(Predicates.alwaysTrue(),Predicates.or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),Predicates.alwaysTrue(),Predicates.alwaysTrue())},
loginUser=root} at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745) 1 error[s] Failure running
task starting 2 nodes (parallel) (OnIRxglV): 2 of 2 parallel child
tasks failed, 2 errors including: Error invoking start at
AmbariAgentImpl{id=AS9jZ9AC}: org.jclouds.compute.RunNodesException:
error running 1 node
group(brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j)
location(eu-central-1) image(ami-6cd3ee71) size(m3.medium)
options({inboundPorts=[22, 2], scriptPresent=true,
userMetadata={Name=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j-jn19,
brooklyn-user=root, brooklyn-app-id=XYDdTpTx, brooklyn-app-name=IDA
Ambari All Services without Security Group,
brooklyn-entity-id=AS9jZ9AC, brooklyn-entity-name=AmbariAgent:AS9j,
brooklyn-server-creation-date=2015-08-10-1421},
userDataCksum=2f4a740b, subnetId=subnet-003dfb7b}) Execution failures:
0 error[s] Node failures: 1) NoSuchElementException on node
eu-central-1/i-4af7818b: java.util.NoSuchElementException: could not
connect to any ip address port 22 on node {id=eu-central-1/i-4af7818b,
providerId=i-4af7818b, location={scope=ZONE, id=eu-central-1b,
description=eu-central-1b, parent=eu-central-1, iso3166Codes=[DE-HE]},
group=brooklyn-gaho-root-ida-ambar-xydd-ambariagent-as9j-as9j,
imageId=eu-central-1/ami-6cd3ee71, os={family=rhel, arch=hvm,
version=6.6,
description=411009282317/RightImage_RHEL_6.6_x64_v14.2.1_HVM_EBS,
is64Bit=true}, status=RUNNING[running], loginPort=22,
hostname=ip-172-31-17-195, privateAddresses=[172.31.17.195],
publicAddresses=[52.28.233.226], hardware={id=m3.medium,
providerId=m3.medium, processors=[{cores=1.0, speed=3.0}], ram=3840,
volumes=[{type=LOCAL, size=4.0, device=/dev/sdb, bootDevice=false,
durable=false}, {id=vol-e940020b, type=SAN, device=/dev/sda1,
bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=Predicates.and(Predicates.alwaysTrue(),Predicates.or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),Predicates.alwaysTrue(),Predicates.alwaysTrue())},
loginUser=root} at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745) 1 error[s]
Any idea??
The stack trace is a bit dense but in the middle of it we can see:
could not connect to any ip address port 22 on node
This indicates that jclouds is trying to connect to the new node, but it is unable to do so.
The most likely cause is that the instance does not have correctly-configured security groups.
jclouds has a bug which prevents it creating security groups, if a subnet ID is given: see JCLOUDS-987: AWS EC2: if specifying subnet ID, security groups are not created.
You can work around this by creating a security group ahead of time that opens up the required ports - this will be port 22, plus whatever ports are needed by the entity (Ambari in this case). You then pass this to jclouds using Brooklyn's templateOptions property in the blueprint.
For example:
name: IDA Ambari All Services with explicit Security Group
description: This Application is used to build one Ambari Server and a Cluster of Ambari Agents
origin: vendor
location:
jclouds:aws-ec2:
region: eu-central-1
identity: identity
credential: credential
osFamily: RHEL
osVersionRegex: 6.*
hardwareId: m3.medium
services:
- type: io.brooklyn.ambari.AmbariCluster
brooklyn.config:
initialSize: 2
install.version: 2.1.0
services:
- FALCON
provisioning.properties:
networkName: subnet-003dfb7b
templateOptions:
securityGroupIds: sg-12345678
Related
Keycloak docker image not running any more Failed to start service org.wildfly.undertow.listener.ajp
i'm a new to keycloak, sorry for this newby post.
I have a docker image that was working perfectly, the same image is deployed on AWS and everything is working fine but suddenly the execution fails for this image locally and it doesn't want to be executed after a system reboot here are the logs if anyone had the same error:
KC version 8.2.0 Config:
{
"KC_DOMAIN": "http://keycloak:8080",
"KC_PRIVATE_DOMAIN": "http://keycloak:8080",
"KC_LIFE_SPAN_DISTRIBUTOR": "1200",
"KC_LIFE_SPAN_IMPLICIT_FLOW_DISTRIBUTOR": "1200",
"KC_SESSION_IDLE_TIMEOUT_DISTRIBUTOR": "3600",
"KC_SESSION_MAX_LIFE_SPAN_DISTRIBUTOR": "43200",
"KC_XFRAME_OPTIONS_DISTRIBUTOR": "ALLOW ORIGIN *",
"KC_CONTENT_SECURITY_POLICY_DISTRIBUTOR": "frame-src 'self' *; frame-ancestors 'self' *; object-src 'none';",
"KEYCLOAK_LOGLEVEL": "INFO",
"EVENT_LOGLEVEL": "DEBUG",
"ROOT_LOGLEVEL": "INFO",
"JGROUP_LOGLEVEL": "INFO",
"KEYCLOAK_LOG_ROTATE_SIZE":"10240k",
"KEYCLOAK_LOG_MAX_BACKUP_INDEX":"50",
"ENABLE_INFINISPAN_STATISTICS": "false",
"DB_USER": "keycloak",
"DB_PASSWORD": "******",
"DB_ADDR": "mysql",
"DB_PORT": "3306",
"DB_DATABASE": "keycloak",
"JDBC_PARAMS": "",
"PROXY_ADDRESS_FORWARDING": "false",
"KC_SSL_REQUIRED": "none",
"MAX_CONCURRENT_REQUESTS": "25",
"QUEUE_SIZE": "100"
}
Error when i execute the docker image:
...
13:35:42,295 INFO [org.jboss.as.ejb3] (MSC service thread 1-8) WFLYEJB0481: Strict pool slsb-strict-max-pool is using a max instance size of 128 (per class), which is derived from thread worker pool sizing.
13:35:42,366 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 58) WFLYUT0014: Creating file handler for path '/opt/keycloak/welcome-content' with options [directory-listing: 'false', follow-symlink: 'false', case-sensitive: 'true', safe-symlink-paths: '[]']
13:35:42,448 INFO [org.wildfly.extension.undertow] (MSC service thread 1-3) WFLYUT0012: Started server default-server.
13:35:42,486 INFO [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0018: Host default-host starting
13:35:42,674 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-8) MSC000001: Failed to start service org.wildfly.undertow.listener.ajp: org.jboss.msc.service.StartException in service org.wildfly.undertow.listener.ajp: WFLYUT0082: Could not start 'ajp' listener.
at org.wildfly.extension.undertow.ListenerService.start(ListenerService.java:211)
at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1739)
at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1701)
at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1559)
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1982)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Protocol family unavailable
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:461)
at sun.nio.ch.Net.bind(Net.java:453)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
at org.xnio.nio.NioXnioWorker.createTcpConnectionServer(NioXnioWorker.java:178)
at org.xnio.XnioWorker.createStreamConnectionServer(XnioWorker.java:310)
at org.wildfly.extension.undertow.AjpListenerService.startListening(AjpListenerService.java:64)
at org.wildfly.extension.undertow.ListenerService.start(ListenerService.java:199)
... 8 more
13:35:42,674 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-6) MSC000001: Failed to start service org.wildfly.undertow.listener.default: org.jboss.msc.service.StartException in service org.wildfly.undertow.listener.default: WFLYUT0082: Could not start 'default' listener.
at org.wildfly.extension.undertow.ListenerService.start(ListenerService.java:211)
at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1739)
at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1701)
at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1559)
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1982)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Protocol family unavailable
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:461)
at sun.nio.ch.Net.bind(Net.java:453)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
at org.xnio.nio.NioXnioWorker.createTcpConnectionServer(NioXnioWorker.java:178)
at org.xnio.XnioWorker.createStreamConnectionServer(XnioWorker.java:310)
at org.wildfly.extension.undertow.HttpListenerService.startListening(HttpListenerService.java:106)
at org.wildfly.extension.undertow.ListenerService.start(ListenerService.java:199)
... 8 more
2021-11-19T13:35:43.686Z WARN [org.jboss.as.dependency.private] (MSC service thread 1-7) WFLYSRV0018: Deployment "deployment.keycloak-server.war" is using a private module ("org.kie") which may be changed or removed in future versions without notice.
2021-11-19T13:35:45.327Z ERROR [org.jgroups.protocols.JDBC_PING] (ServerService Thread Pool -- 60) JGRP000138: Error reading JDBC_PING table: org.h2.jdbc.JdbcSQLException: Table "JGROUPSPING" not found; SQL statement:
SELECT ping_data, own_addr, cluster_name FROM JGROUPSPING WHERE cluster_name=? [42102-193]
at org.h2.message.DbException.getJdbcSQLException(DbException.java:345)
at org.h2.message.DbException.get(DbException.java:179)
at org.h2.message.DbException.get(DbException.java:155)
at org.h2.command.Parser.readTableOrView(Parser.java:5389)
at org.h2.command.Parser.readTableFilter(Parser.java:1257)
at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1897)
at org.h2.command.Parser.parseSelectSimple(Parser.java:2045)
at org.h2.command.Parser.parseSelectSub(Parser.java:1891)
at org.h2.command.Parser.parseSelectUnion(Parser.java:1709)
at org.h2.command.Parser.parseSelect(Parser.java:1697)
at org.h2.command.Parser.parsePrepared(Parser.java:445)
at org.h2.command.Parser.parse(Parser.java:317)
at org.h2.command.Parser.parse(Parser.java:289)
at org.h2.command.Parser.prepareCommand(Parser.java:254)
at org.h2.engine.Session.prepareLocal(Session.java:561)
at org.h2.engine.Session.prepareCommand(Session.java:502)
at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1203)
at org.h2.jdbc.JdbcPreparedStatement.<init>(JdbcPreparedStatement.java:73)
at org.h2.jdbc.JdbcConnection.prepareStatement(JdbcConnection.java:676)
at org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.doPrepareStatement(BaseWrapperManagedConnection.java:758)
at org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.prepareStatement(BaseWrapperManagedConnection.java:744)
at org.jboss.jca.adapters.jdbc.WrappedConnection$5.produce(WrappedConnection.java:516)
at org.jboss.jca.adapters.jdbc.WrappedConnection$5.produce(WrappedConnection.java:514)
at org.jboss.jca.adapters.jdbc.SecurityActions.executeInTccl(SecurityActions.java:97)
at org.jboss.jca.adapters.jdbc.WrappedConnection.prepareStatement(WrappedConnection.java:514)
at org.jgroups.protocols.JDBC_PING.prepareStatement(JDBC_PING.java:209)
at org.jgroups.protocols.JDBC_PING.readAll(JDBC_PING.java:221)
at org.jgroups.protocols.JDBC_PING.readAll(JDBC_PING.java:197)
at org.jgroups.protocols.FILE_PING.findMembers(FILE_PING.java:124)
at org.jgroups.protocols.Discovery.invokeFindMembers(Discovery.java:216)
at org.jgroups.protocols.Discovery.findMembers(Discovery.java:241)
at org.jgroups.protocols.Discovery.down(Discovery.java:380)
at org.jgroups.protocols.FILE_PING.down(FILE_PING.java:119)
at org.jgroups.protocols.MERGE3.down(MERGE3.java:278)
at org.jgroups.protocols.FD_SOCK.down(FD_SOCK.java:377)
at org.jgroups.protocols.FD.down(FD.java:320)
at org.jgroups.protocols.VERIFY_SUSPECT.down(VERIFY_SUSPECT.java:102)
at org.jgroups.protocols.pbcast.NAKACK2.down(NAKACK2.java:553)
at org.jgroups.protocols.UNICAST3.down(UNICAST3.java:581)
at org.jgroups.protocols.pbcast.STABLE.down(STABLE.java:347)
at org.jgroups.protocols.pbcast.ClientGmsImpl.joinInternal(ClientGmsImpl.java:72)
at org.jgroups.protocols.pbcast.ClientGmsImpl.join(ClientGmsImpl.java:40)
at org.jgroups.protocols.pbcast.GMS.down(GMS.java:1044)
at org.jgroups.protocols.FlowControl.down(FlowControl.java:295)
at org.jgroups.protocols.FRAG3.down(FRAG3.java:135)
at org.jgroups.protocols.FORK.down(FORK.java:109)
at org.jgroups.stack.ProtocolStack.down(ProtocolStack.java:928)
at org.jgroups.JChannel.down(JChannel.java:627)
at org.jgroups.JChannel._connect(JChannel.java:855)
at org.jgroups.JChannel.connect(JChannel.java:352)
at org.jgroups.JChannel.connect(JChannel.java:343)
at org.jboss.as.clustering.jgroups.subsystem.ChannelServiceConfigurator.get(ChannelServiceConfigurator.java:112) at org.jboss.as.clustering.jgroups.subsystem.ChannelServiceConfigurator.get(ChannelServiceConfigurator.java:58)
at org.wildfly.clustering.service.FunctionalService.start(FunctionalService.java:67)
at org.wildfly.clustering.service.AsyncServiceConfigurator$AsyncService.lambda$start$0(AsyncServiceConfigurator.java:117)
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1982)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
at java.lang.Thread.run(Thread.java:748)
at org.jboss.threads.JBossThread.run(JBossThread.java:485)
Suppressed: org.h2.jdbc.JdbcSQLException: Table "JGROUPSPING" not found; SQL statement:
SELECT ping_data, own_addr, cluster_name FROM JGROUPSPING WHERE cluster_name=? [42102-193]
at org.h2.message.DbException.getJdbcSQLException(DbException.java:345)
at org.h2.message.DbException.get(DbException.java:179)
at org.h2.message.DbException.get(DbException.java:155)
at org.h2.command.Parser.readTableOrView(Parser.java:5389)
at org.h2.command.Parser.readTableFilter(Parser.java:1257)
at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1897)
at org.h2.command.Parser.parseSelectSimple(Parser.java:2045)
at org.h2.command.Parser.parseSelectSub(Parser.java:1891)
at org.h2.command.Parser.parseSelectUnion(Parser.java:1709)
at org.h2.command.Parser.parseSelect(Parser.java:1697)
at org.h2.command.Parser.parsePrepared(Parser.java:445)
at org.h2.command.Parser.parse(Parser.java:317)
at org.h2.command.Parser.parse(Parser.java:289)
at org.h2.command.Parser.prepareCommand(Parser.java:254)
at org.h2.engine.Session.prepareLocal(Session.java:561)
at org.h2.engine.Session.prepareCommand(Session.java:502)
at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1203)
at org.h2.jdbc.JdbcPreparedStatement.<init>(JdbcPreparedStatement.java:73)
at org.h2.jdbc.JdbcConnection.prepareStatement(JdbcConnection.java:676)
at org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.doPrepareStatement(BaseWrapperManagedConnection.java:758)
at org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnection.prepareStatement(BaseWrapperManagedConnection.java:744)
at org.jboss.jca.adapters.jdbc.WrappedConnection$4.produce(WrappedConnection.java:478)
at org.jboss.jca.adapters.jdbc.WrappedConnection$4.produce(WrappedConnection.java:476)
at org.jboss.jca.adapters.jdbc.SecurityActions.executeInTccl(SecurityActions.java:97)
at org.jboss.jca.adapters.jdbc.WrappedConnection.prepareStatement(WrappedConnection.java:476)
at org.jgroups.protocols.JDBC_PING.prepareStatement(JDBC_PING.java:212)
... 35 more
2021-11-19T13:35:45.330Z ERROR [org.jgroups.protocols.JDBC_PING] (ServerService Thread Pool -- 60) JGRP000145: Error updating JDBC_PING table: org.h2.jdbc.JdbcSQLException: Table "JGROUPSPING" not found; SQL statement:
DELETE FROM JGROUPSPING WHERE own_addr=? AND cluster_name=? [42102-193]
at org.h2.message.DbException.getJdbcSQLException(DbException.java:345)
at org.h2.message.DbException.get(DbException.java:179)
...
The main problem was this error: 13:35:42,674 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-8) MSC000001: Failed to start service org.wildfly.undertow.listener.ajp: org.jboss.msc.service.StartException in service org.wildfly.undertow.listener.ajp: WFLYUT0082: Could not start 'ajp' listener. This is a an error from the JBOSS application server (Wildfly) that failed to open a socket to listen for incoming connections due to attempting to open an IPv6 socket And the solution that worked for me is that the JAVA_OPTS environment variable must be set to contain -Djava.net.preferIPv4Stack=true And here is how i apply this to change keycloak jvm arguments via CLI in standalone configuration, i modify the commons.sh script which is executed in the standalone.sh by adding this enty: if [[ "$JAVA_OPTS" != *"-Djava.net.preferIPv4Stack=true"* ]]; then export JAVA_OPTS="$JAVA_OPTS -Djava.net.preferIPv4Stack=true" fi You can find more informations in this link
SSL Connectivity fails between corda node and artemis deployed in kubernetes cluster
We are trying to connect Corda node to a standalone Artemis server (both are deployed in kubernetes cluster) as described in the Corda documentation. After starting the Corda node we get below error: Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid cert ification path to requested target at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397)~[?:1.8.0_212] at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)~[?:1.8.0_212] at sun.security.validator.Validator.validate(Validator.java:262)~[?:1.8.0_212] at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324)~[?:1.8.0_212] at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:281)~[?:1.8.0_212] at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:136)~[?:1.8.0_212] at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1626)~[?:1.8.0_212] at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)~[?:1.8.0_212] at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)~[?:1.8.0_212] at sun.security.ssl.Handshaker$1.run(Handshaker.java:970) ~[?:1.8.0_212] at sun.security.ssl.Handshaker$1.run(Handshaker.java:967) ~[?:1.8.0_212] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_212] at sun.security.ssl.Handshaker$DelegatedTask.run(Handshaker.java:1459)~[?:1.8.0_212] at io.netty.handler.ssl.SslHandler.runDelegatedTasks(SslHandler.java:1457)~[netty-handler-4.1.29.Final.jar:4.1.29.Final] at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1365)~[netty-handler-4.1.29.Final.jar:4.1.29.Final] ... 17 more Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)~[?:1.8.0_212] at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)~[?:1.8.0_212] at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)~[?:1.8.0_212] at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392)~[?:1.8.0_212] at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)~[?:1.8.0_212] at sun.security.validator.Validator.validate(Validator.java:262)~[?:1.8.0_212] at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324)~[?:1.8.0_212] at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:281)~[?:1.8.0_212] at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:136)~[?:1.8.0_212] at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1626)~[?:1.8.0_212] at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)~[?:1.8.0_212] at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)~[?:1.8.0_212] at sun.security.ssl.Handshaker$1.run(Handshaker.java:970) ~[?:1.8.0_212] at sun.security.ssl.Handshaker$1.run(Handshaker.java:967) ~[?:1.8.0_212] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_212] at sun.security.ssl.Handshaker$DelegatedTask.run(Handshaker.java:1459)~[?:1.8.0_212] at io.netty.handler.ssl.SslHandler.runDelegatedTasks(SslHandler.java:1457)~[netty-handler-4.1.29.Final.jar:4.1.29.Final] at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1365)~[netty-handler-4.1.29.Final.jar:4.1.29.Final] ... 17 more
Please refer to our tutorials on deploy corda node via kubernetes at Part1 and Part2 Most likely, you have missed some steps during the setups, and your nodes are not really even started.
Jenkins Slave unable to connect to master hosted on Openshift instance
Unable to connect jenkins master hosted On Openshift Cluster. Terminates with below error after handshaking: Apr 03, 2018 4:37:17 AM hudson.remoting.jnlp.Main$CuiListener status INFO: Handshaking Apr 03, 2018 4:37:17 AM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.211.41:30863 Apr 03, 2018 4:37:48 AM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.211.41:30863 (retrying:2) java.io.IOException: Failed to connect to 172.30.211.41:30863 at org.jenkinsci.remoting.engine.JnlpAgentEndpoint.open(JnlpAgentEndpoin t.java:242) at hudson.remoting.Engine.connect(Engine.java:671) at hudson.remoting.Engine.innerRun(Engine.java:532) at hudson.remoting.Engine.run(Engine.java:455) Caused by: java.net.ConnectException: Connection timed out: connect at sun.nio.ch.Net.connect0(Native Method) at sun.nio.ch.Net.connect(Unknown Source) at sun.nio.ch.Net.connect(Unknown Source) at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) at java.nio.channels.SocketChannel.open(Unknown Source) at org.jenkinsci.remoting.engine.JnlpAgentEndpoint.open(JnlpAgentEndpoin t.java:203) ... 3 more I am connecting windows machine (VM) as a slave. Any suggestions? TIA.
The instance is not able to connect. INFO: Connecting to 172.30.211.41:30863 (retrying:2) java.io.IOException: Failed to connect to 172.30.211.41:30863 ... Caused by: java.net.ConnectException: Connection timed out: connect The IP address of the Service in openshift, right? This IP is only accessible within the OpenShift cluster. Try to use route if the slave is running outside of the cluster.
I have used NodePort to connect the slave. And configuring hostname:Port under tunneling option in slave configuration under jenkins. It works!
How to configure JMX exporter to monitor spring boot application in Prometheus
Monitoring Spring boot application(TestMonitoring) using JMX exporter and Prometheus. Prometheus and spring boot application Pods are up and running in kubernetes cluster. Now the pain is to get JMX exporter running and the application should expose metrics via JMX. In TestMonitoring application , the application.properties file has the following setting: endpoints.jmx.enabled=true spring.jmx.enabled=true Now how to install the JMX exporter as an agent: i have download the jar and executed: java -javaagent:./jmx_prometheus_javaagent-0.9.jar=1234:config.yml In the config.yml -> the following hostPort:xx.x.x.x:30001 (target port of myspring boot application which is available as a service) The following exception is thrown: Sep 22, 2017 4:12:31 PM io.prometheus.jmx.shaded.io.prometheus.jmx.JmxCollector collect SEVERE: JMX scrape failed: java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.CommunicationException [R oot exception is java.rmi.ConnectIOException: non-JRMP server at remote endpoint] at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:370) at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:268) at io.prometheus.jmx.shaded.io.prometheus.jmx.JmxScraper.doScrape(JmxScraper.java:106) at io.prometheus.jmx.shaded.io.prometheus.jmx.JmxCollector.collect(JmxCollector.java:401) at io.prometheus.jmx.shaded.io.prometheus.client.CollectorRegistry.collectorNames(CollectorRegistry.java:99) at io.prometheus.jmx.shaded.io.prometheus.client.CollectorRegistry.register(CollectorRegistry.java:50) at io.prometheus.jmx.shaded.io.prometheus.client.Collector.register(Collector.java:128) at io.prometheus.jmx.shaded.io.prometheus.client.Collector.register(Collector.java:121) at io.prometheus.jmx.shaded.io.prometheus.jmx.JavaAgent.premain(JavaAgent.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at sun.instrument.InstrumentationImpl.loadClassAndStartAgent(InstrumentationImpl.java:382) at sun.instrument.InstrumentationImpl.loadClassAndCallPremain(InstrumentationImpl.java:397) Caused by: javax.naming.CommunicationException [Root exception is java.rmi.ConnectIOException: non-JRMP server at remote endpoint] at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:142) at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:204) at javax.naming.InitialContext.lookup(InitialContext.java:415) at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1928) at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1895) at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:287) What could be the reason of the such exception,Just not able to figure it? any suggestions will be very helpful
Try https://github.com/fabric8io/agent-bond It works fine. Use it like this: -javaagent:/opt/agent-bond/agent-bond.jar=/etc/config/agent-bond.properties
Unable to connect to slave from master. "Invalid encoded sequence encountered:"
I have Box Master and Box Slave in AWS EC2 instances. I created jenkins user in Box Slave and I copied the master's public keys to slave. Now I created a new node in Jenkins Master. However, when I connect to slave using Launch agent via execution of command on master using command ssh -tt jenkins#10.15.0.10, it gives me the following error: just before slave Services-Slave gets launched ... executing pre-launch scripts ... [06/26/17 16:25:28] Launching agent $ ssh -tt jenkins#10.15.0.10 Welcome to Ubuntu 16.04.2 LTS (GNU/Linux 4.4.0-1020-aws x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/advantage Get cloud support with Ubuntu Advantage Cloud Guest: http://www.ubuntu.com/business/services/cloud 5 packages can be updated. 0 updates are security updates. Last login: Mon Jun 26 20:19:51 2017 from 10.15.0.5 <===[JENKINS REMOTING CAPACITY]===>To run a command as administrator (user "root"), use "sudo <command>". See "man sudo_root" for details. jenkins#ip-10-94-0-63:~$ <===[JENKINS REMOTING CAPACITY]===ERROR: Unable to launch the agent for Services-Slave java.io.IOException: Invalid encoded sequence encountered: 08 08 08 08 at hudson.remoting.BinarySafeStream$1._read(BinarySafeStream.java:194) at hudson.remoting.BinarySafeStream$1.read(BinarySafeStream.java:80) at hudson.remoting.BinarySafeStream$1.read(BinarySafeStream.java:97) at java.io.FilterInputStream.read(FilterInputStream.java:107) at hudson.remoting.BinarySafeStream$1._read(BinarySafeStream.java:189) at hudson.remoting.BinarySafeStream$1.read(BinarySafeStream.java:125) at java.io.FilterInputStream.read(FilterInputStream.java:107) at hudson.remoting.BinarySafeStream$1._read(BinarySafeStream.java:189) at hudson.remoting.BinarySafeStream$1.read(BinarySafeStream.java:125) at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2338) at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2351) at java.io.ObjectInputStream$BlockDataInputStream.readUTFBody(ObjectInputStream.java:3092) at java.io.ObjectInputStream$BlockDataInputStream.readUTF(ObjectInputStream.java:2892) at java.io.ObjectInputStream.readUTF(ObjectInputStream.java:1075) at java.io.ObjectStreamClass.readNonProxy(ObjectStreamClass.java:684) at java.io.ObjectInputStream.readClassDescriptor(ObjectInputStream.java:833) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1609) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1781) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:373) at hudson.remoting.Capability.read(Capability.java:140) at hudson.remoting.ChannelBuilder.negotiate(ChannelBuilder.java:391) at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:310) at hudson.slaves.SlaveComputer.setChannel(SlaveComputer.java:389) at hudson.slaves.CommandLauncher.launch(CommandLauncher.java:132) at hudson.slaves.SlaveComputer$1.call(SlaveComputer.java:262) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) If I run the same command from my username from master it is able to ssh successfully. Any idea why this is happening? I tried giving the .pem file I also did sudo -u jenkins. Nothing works.
Several things were going wrong here too, while configuring master-node communication. Somewhere it seemed like, master is caching the configurations for nodes. Sometimes removing and adding the node did work! But in the end, this helped every-time. https://docs.google.com/document/d/1Qq-EkiUnC5x8BuM4AZWo-yRUQTrkberzz8JfdCM6yuc/edit?pli=1