Umbraco Courier gets a Soap Exception connecting to remote site - umbraco

So I am running an Umbraco site locally, and the same site on my live server. But I can't get Courier to work to transfer my data between the 2 (although I have had no issues in the past).
I am using an SQL CE database locally, and MSSQL for the live site (the Courier support team don't think this should be an issue).
Now the issue is not connecting between the sites, because my localhost connects to the live site, and passes across a package as you can see from the log below, but then it has an error extracting the package. In the browser, the pop-out window just goes blank, and never completes, but the log tells me the following report:
2016-02-04 09:27:34,215 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 35] Unloading (count: 0)
2016-02-04 09:27:34,215 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 35] Unloading (count: 0)
2016-02-04 09:27:36,703 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 44] Unloading (count: 0)
2016-02-04 09:27:40,561 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 56] Unloading (count: 0)
2016-02-04 09:27:40,562 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 56] Unloading (count: 0)
2016-02-04 09:27:40,562 [20] INFO Umbraco.Courier.Core.TaskManager - [Thread 56] Added PackagingTask behind queue of : 0
2016-02-04 09:27:40,562 [20] INFO Umbraco.Courier.Core.BackgroundTaskRunner - [Thread 56] Task added Umbraco.Courier.Core.Tasks.PackagingTask
2016-02-04 09:27:40,562 [20] INFO Umbraco.Courier.Core.TaskManager - [Thread 25] Starting PackagingTask with id: dbdaaa27-12f0-453e-a272-ee86f42ee320
2016-02-04 09:27:40,562 [20] DEBUG Umbraco.Courier.RepositoryProviders.Local - [Thread 25] Opening session: 5d218615-ecf8-430d-8853-bf7b7a27299a
2016-02-04 09:27:40,563 [20] DEBUG Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider - [Thread 25] Opening session to http://www.adamanthony.co.uk
2016-02-04 09:27:44,390 [20] INFO Umbraco.Courier.Core.Packaging.RevisionPackaging - [Thread 25] Document types: SkillItem hash-mismatch (local/remote) d1572093dd52efbce27132025a9b70f7 / 736e152936c2d2fbcf35e3f28c23b3bb
2016-02-04 09:27:45,532 [20] DEBUG Umbraco.Courier.RepositoryProviders.Local - [Thread 25] Disposing: True
2016-02-04 09:27:45,532 [20] DEBUG Umbraco.Courier.RepositoryProviders.Local - [Thread 25] Closing session: 5d218615-ecf8-430d-8853-bf7b7a27299a
2016-02-04 09:27:45,532 [20] DEBUG Umbraco.Courier.Persistence.V6.NHibernate.NHibernateProvider - [Thread 25] Closing session, UseGlobalSession: False, key: 5d218615-ecf8-430d-8853-bf7b7a27299a
2016-02-04 09:27:45,532 [20] DEBUG Umbraco.Courier.Persistence.V6.NHibernate.NHibernateGlobalSessionManager - [Thread 25] Closing session, IsInWebContext: False
2016-02-04 09:27:45,532 [20] DEBUG Umbraco.Courier.RepositoryProviders.Local - [Thread 25] Disposing: True
2016-02-04 09:27:45,532 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 25] Unloading (count: 0)
2016-02-04 09:27:45,532 [20] INFO Umbraco.Courier.Core.TaskManager - [Thread 25] Completed PackagingTask with id: dbdaaa27-12f0-453e-a272-ee86f42ee320
2016-02-04 09:27:45,746 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 35] Unloading (count: 0)
2016-02-04 09:27:45,748 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 35] Unloading (count: 0)
2016-02-04 09:27:45,748 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 35] Unloading (count: 0)
2016-02-04 09:27:45,766 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 35] Unloading (count: 0)
2016-02-04 09:27:45,779 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 34] Unloading (count: 0)
2016-02-04 09:27:45,783 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 18] Unloading (count: 0)
2016-02-04 09:27:46,021 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 44] Unloading (count: 0)
2016-02-04 09:27:47,958 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 42] Unloading (count: 0)
2016-02-04 09:27:47,958 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 42] Unloading (count: 0)
2016-02-04 09:27:47,958 [20] INFO Umbraco.Courier.Core.TaskManager - [Thread 42] Added ExtractionTask behind queue of : 0
2016-02-04 09:27:47,958 [20] INFO Umbraco.Courier.Core.BackgroundTaskRunner - [Thread 42] Task added Umbraco.Courier.Core.Tasks.ExtractionTask
2016-02-04 09:27:47,958 [20] INFO Umbraco.Courier.Core.TaskManager - [Thread 22] Starting ExtractionTask with id: cba12ffe-c730-4e38-838d-2c278463332b
2016-02-04 09:27:47,958 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Running PopulateGraph
2016-02-04 09:27:47,959 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Finished PopulateGraph (took 2ms)
2016-02-04 09:27:47,959 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 22] Adding event DeleteContentAndMedia To Queue: DeploymentComplete for session: 8d502ccd-e4ea-49b1-a9b3-4159ea5a8fa3
2016-02-04 09:27:47,959 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Starting extraction
2016-02-04 09:27:47,959 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Opens database session
2016-02-04 09:27:47,959 [20] DEBUG Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider - [Thread 22] Opening session to http://www.adamanthony.co.uk
2016-02-04 09:27:48,215 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Transfering pre-extraction files
2016-02-04 09:27:48,215 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Running ExtractReadyRevisionBatch
2016-02-04 09:27:48,215 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Extracting batch of 1 items
2016-02-04 09:27:48,215 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Extracting: AdamAnthony - Umbraco.Courier.Core.DependencyGraph+GraphNode
2016-02-04 09:27:48,441 [20] WARN Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Finished ExtractItem (took 230ms)
2016-02-04 09:27:48,441 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Finished ExtractReadyRevisionBatch (took 230ms)
2016-02-04 09:27:48,441 [20] ERROR Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] There was a problem with extracting database information for the item: Name:AdamAnthony | Id:Adamanthony | Provider:Document types
System.Web.Services.Protocols.SoapException: System.Web.Services.Protocols.SoapException: Server was unable to process request. ---> System.InvalidOperationException: A call to SetContextId must occur before getting/setting a context
at Umbraco.Courier.Core.GlobalExecutionContextManager.get_CurrentContext()
at Umbraco.Courier.Core.GlobalExecutionContextManager.GetContext(Boolean createIfNoneExists)
at Umbraco.Courier.RepositoryProviders.Webservices.Repository.Extract(String sessionKey, Byte[] item, ItemIdentifier itemId, Boolean overwrite, String user, String pass)
--- End of inner exception stack trace ---
at System.Web.Services.Protocols.SoapHttpClientProtocol.ReadResponse(SoapClientMessage message, WebResponse response, Stream responseStream, Boolean asyncCall)
at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
at Umbraco.Courier.RepositoryProviders.WebServiceProvider.RepositoryWebservice.Extract(String sessionKey, Byte[] item, ItemIdentifier itemId, Boolean overwrite, String user, String pass)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.ExtractItem(Item item, Boolean overwrite)
at Umbraco.Courier.Core.Extraction.RevisionExtraction.ExtractItem(GraphNode node, Boolean isDependency)
at Umbraco.Courier.Core.Extraction.RevisionExtraction.ExtractReadyRevisionBatch()
at Umbraco.Courier.Core.Extraction.RevisionExtraction.Extract()
2016-02-04 09:27:48,441 [20] INFO Umbraco.Courier.Core.Extraction.RevisionExtraction - [Thread 22] Rolling back changes due to errors
2016-02-04 09:27:48,809 [20] DEBUG Umbraco.Courier.RepositoryProviders.Local - [Thread 22] Disposing: True
2016-02-04 09:27:48,809 [20] WARN Umbraco.Courier.RepositoryProviders.Local - [Thread 22] Closing session called but there is no session open: 8d502ccd-e4ea-49b1-a9b3-4159ea5a8fa3
2016-02-04 09:27:49,502 [20] DEBUG Umbraco.Courier.Core.EventManager - [Thread 22] Unloading (count: 1)
2016-02-04 09:27:49,502 [20] ERROR Umbraco.Courier.Core.TaskManager - [Thread 22] Error ExtractionTask with id: cba12ffe-c730-4e38-838d-2c278463332b
System.Web.Services.Protocols.SoapException: System.Web.Services.Protocols.SoapException: Server was unable to process request. ---> System.InvalidOperationException: Tried opening session with id: 8d502ccd-e4ea-49b1-a9b3-4159ea5a8fa3. - There is already an active session with id: 5d218615-ecf8-430d-8853-bf7b7a27299a and there can only be one
at Umbraco.Courier.Persistence.V6.NHibernate.NHibernateGlobalSessionManager.set_CurrentSessionId(String value)
at Umbraco.Courier.Persistence.V6.NHibernate.NHibernateProvider.CloseSession(String key)
at Umbraco.Courier.RepositoryProviders.Local.CloseSession(String key)
at Umbraco.Courier.RepositoryProviders.Webservices.Repository.CloseSession(String sessionKey, String username, String password)
--- End of inner exception stack trace ---
at System.Web.Services.Protocols.SoapHttpClientProtocol.ReadResponse(SoapClientMessage message, WebResponse response, Stream responseStream, Boolean asyncCall)
at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
at Umbraco.Courier.RepositoryProviders.WebServiceProvider.RepositoryWebservice.CloseSession(String sessionKey, String username, String password)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.CloseSession(String sessionKey)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.Dispose(Boolean disposing)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.Dispose()
at Umbraco.Courier.Core.Common.Extensions.GlobalExtensions.DisposeIfDisposable(Object input)
at Umbraco.Courier.Core.Repository.Dispose(Boolean disposing)
at Umbraco.Courier.Core.Repository.Dispose()
at Umbraco.Courier.Core.BaseRevisionHandler.Dispose(Boolean disposing)
at Umbraco.Courier.Core.Extraction.RevisionExtraction.Dispose(Boolean disposing)
at Umbraco.Courier.Core.BaseRevisionHandler.Dispose()
at Umbraco.Courier.Core.Tasks.ExtractionTask.Run()
at Umbraco.Courier.Core.BackgroundTaskRunner`1.ConsumeTaskInternal(T task)
2016-02-04 09:27:49,502 [20] ERROR Umbraco.Courier.Core.BackgroundTaskRunner - [Thread 22] An error occurred consuming task
System.Web.Services.Protocols.SoapException: System.Web.Services.Protocols.SoapException: Server was unable to process request. ---> System.InvalidOperationException: Tried opening session with id: 8d502ccd-e4ea-49b1-a9b3-4159ea5a8fa3. - There is already an active session with id: 5d218615-ecf8-430d-8853-bf7b7a27299a and there can only be one
at Umbraco.Courier.Persistence.V6.NHibernate.NHibernateGlobalSessionManager.set_CurrentSessionId(String value)
at Umbraco.Courier.Persistence.V6.NHibernate.NHibernateProvider.CloseSession(String key)
at Umbraco.Courier.RepositoryProviders.Local.CloseSession(String key)
at Umbraco.Courier.RepositoryProviders.Webservices.Repository.CloseSession(String sessionKey, String username, String password)
--- End of inner exception stack trace ---
at System.Web.Services.Protocols.SoapHttpClientProtocol.ReadResponse(SoapClientMessage message, WebResponse response, Stream responseStream, Boolean asyncCall)
at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
at Umbraco.Courier.RepositoryProviders.WebServiceProvider.RepositoryWebservice.CloseSession(String sessionKey, String username, String password)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.CloseSession(String sessionKey)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.Dispose(Boolean disposing)
at Umbraco.Courier.RepositoryProviders.CourierWebserviceRepositoryProvider.Dispose()
at Umbraco.Courier.Core.Common.Extensions.GlobalExtensions.DisposeIfDisposable(Object input)
at Umbraco.Courier.Core.Repository.Dispose(Boolean disposing)
at Umbraco.Courier.Core.Repository.Dispose()
at Umbraco.Courier.Core.BaseRevisionHandler.Dispose(Boolean disposing)
at Umbraco.Courier.Core.Extraction.RevisionExtraction.Dispose(Boolean disposing)
at Umbraco.Courier.Core.BaseRevisionHandler.Dispose()
at Umbraco.Courier.Core.Tasks.ExtractionTask.Run()
at Umbraco.Courier.Core.BackgroundTaskRunner`1.ConsumeTaskInternal(T task)
Or to make this a little easier to read:
[Thread 56] Unloading (count: 0)
[Thread 56] Added PackagingTask behind queue of : 0
[Thread 56] Task added Umbraco.Courier.Core.Tasks.PackagingTask
[Thread 25] Starting PackagingTask with id: dbdaaa27-12f0-453e-a272-ee86f42ee320
[Thread 25] Opening session: 5d218615-ecf8-430d-8853-bf7b7a27299a
[Thread 25] Opening session to http://www.adamanthony.co.uk
[Thread 25] Document types: SkillItem hash-mismatch (local/remote) d1572093dd52efbce27132025a9b70f7 / 736e152936c2d2fbcf35e3f28c23b3bb
[Thread 25] Disposing: True
[Thread 25] Closing session: 5d218615-ecf8-430d-8853-bf7b7a27299a
[Thread 25] Closing session, UseGlobalSession: False, key: 5d218615-ecf8-430d-8853-bf7b7a27299a
[Thread 25] Closing session, IsInWebContext: False
[Thread 25] Disposing: True
[Thread 25] Unloading (count: 0)
[Thread 25] Completed PackagingTask with id: dbdaaa27-12f0-453e-a272-ee86f42ee320
[Thread 42] Unloading (count: 0)
[Thread 42] Added ExtractionTask behind queue of : 0
[Thread 42] Task added Umbraco.Courier.Core.Tasks.ExtractionTask
[Thread 22] Starting ExtractionTask with id: cba12ffe-c730-4e38-838d-2c278463332b
[Thread 22] Running PopulateGraph
[Thread 22] Finished PopulateGraph (took 2ms)
[Thread 22] Adding event DeleteContentAndMedia To Queue: DeploymentComplete for session: 8d502ccd-e4ea-49b1-a9b3-4159ea5a8fa3
[Thread 22] Starting extraction
[Thread 22] Opens database session
[Thread 22] Opening session to http://www.adamanthony.co.uk
[Thread 22] Transfering pre-extraction files
[Thread 22] Running ExtractReadyRevisionBatch
[Thread 22] Extracting batch of 1 items
[Thread 22] Extracting: AdamAnthony - Umbraco.Courier.Core.DependencyGraph+GraphNode
[Thread 22] Finished ExtractItem (took 230ms)
[Thread 22] Finished ExtractReadyRevisionBatch (took 230ms)
[Thread 22] There was a problem with extracting database information for the item: Name:AdamAnthony | Id:Adamanthony | Provider:Document types
System.Web.Services.Protocols.SoapException: System.Web.Services.Protocols.SoapException: Server was unable to process request. ---> System.InvalidOperationException: A call to SetContextId must occur before getting/setting a context
[Thread 22] Rolling back changes due to errors
[Thread 22] Disposing: True
[Thread 22] Closing session called but there is no session open: 8d502ccd-e4ea-49b1-a9b3-4159ea5a8fa3
[Thread 22] Unloading (count: 1)
Further info:
My environment is a Rackspace Cloud Site
Permissions are all set with the maximum freedom I can give
My username and password are included in the courier.config file
I surely can't be the only one who has received this error? Anyone info on this would be great. Thanks

Has the user you are using the same credentials in both databases?
Have you applied the Courier hotfix?
Have you tried rebooting your site and recycling the AppPool? It could be related to a stuck previous deployment.

Related

Xdebug don't catch breakpoints in PhpStorm

I configured Xdebug according to this guide
It`s resulting xdebug_config:
zend_extension=xdebug
xdebug.remote_port=9004
xdebug.remote_host=172.24.240.47
xdebug.remote_enable=1
xdebug.remote_connect_back=0
xdebug.remote_log=/var/www/html/xdebug.log
In PhpStorm, I registered port 9004 in the Xdebug menu
It`s xdebug log:
[20] Log opened at 2022-03-23 10:29:32
[20] I: Connecting to configured address/port: 172.24.240.47:9004.
[20] I: Connected to client. :-)
[20] -> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" fileuri="file:///var/www/html/index.php" language="PHP" xdebug:language_version="7.2.34" protocol_version="1.0" appid="20" idekey="16813"><engine version="2.7.2"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[https://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2019 by Derick Rethans]]></copyright></init>
[20]
[20] -> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
[20]
[20] Log closed at 2022-03-23 10:29:32
But breakpoint does not work :(
if I use xdebug3, i catch next error:
[17] Log opened at 2022-03-23 12:36:17.689724
[17] [Step Debug] INFO: Checking remote connect back address.
[17] [Step Debug] INFO: Checking header 'HTTP_X_FORWARDED_FOR'.
[17] [Step Debug] INFO: Checking header 'REMOTE_ADDR'.
[17] [Step Debug] INFO: Client host discovered through HTTP header, connecting to 172.25.0.1:9003.
[17] [Step Debug] WARN: Creating socket for '172.25.0.1:9003', poll success, but error: Operation now in progress (29).
[17] [Step Debug] WARN: Could not connect to client host discovered through HTTP headers, connecting to configured address/port: 172.24.240.47:9003. :-|
[17] [Step Debug] WARN: Creating socket for '172.24.240.47:9003', poll success, but error: Operation now in progress (29).
[17] [Step Debug] ERR: Could not connect to debugging client. Tried: 172.25.0.1:9003 (from REMOTE_ADDR HTTP header), 172.24.240.47:9003 (fallback through xdebug.client_host/xdebug.client_port) :-(
[17] Log closed at 2022-03-23 12:36:17.691381
I tried to share port in docker-compose file
ports:
- 80:80
- 9009:9009
And log now
[19] Log opened at 2022-03-23 15:52:45.549575
[19] [Step Debug] INFO: Checking remote connect back address.
[19] [Step Debug] INFO: Checking header 'HTTP_X_FORWARDED_FOR'.
[19] [Step Debug] INFO: Checking header 'REMOTE_ADDR'.
[19] [Step Debug] INFO: Client host discovered through HTTP header, connecting to 172.26.0.1:9009.
[19] [Step Debug] INFO: Connected to debugging client: 172.26.0.1:9009 (from REMOTE_ADDR HTTP header). :-)
[19] [Step Debug] -> <init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" fileuri="file:///var/www/html/index.php" language="PHP" xdebug:language_version="7.2.34" protocol_version="1.0" appid="19"><engine version="3.1.3"><![CDATA[Xdebug]]></engine><author><![CDATA[Derick Rethans]]></author><url><![CDATA[https://xdebug.org]]></url><copyright><![CDATA[Copyright (c) 2002-2022 by Derick Rethans]]></copyright></init>
[19] [Step Debug] -> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" status="stopping" reason="ok"></response>
[19] [Step Debug] WARN: 2022-03-23 15:52:45.554242: There was a problem sending 179 bytes on socket 11: Broken pipe.
[19] Log closed at 2022-03-23 15:52:45.554442

Kylin start fail java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata#hbase

I install kylin by https://github.com/cas-packone/ambari-kylin-service/
2020-01-13 01:52:16,673 INFO [main] utils.Compatibility:41 : Running in ZooKeeper 3.4.x compatibility mode
2020-01-13 01:52:16,710 INFO [main] imps.CuratorFrameworkImpl:284 : Starting
2020-01-13 01:52:16,715 INFO [main] zookeeper.ZooKeeper:438 : Initiating client connection, connectString=node1:2181 sessionTimeout=120000 watcher=org.apache.curator.ConnectionState#6c000e0c
2020-01-13 01:52:16,717 INFO [main-SendThread(node1:2181)] zookeeper.ClientCnxn:1013 : Opening socket connection to server node1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2020-01-13 01:52:16,719 INFO [main-SendThread(node1:2181)] zookeeper.ClientCnxn:856 : Socket connection established, initiating session, client: /127.0.0.1:49768, server: node1/127.0.0.1:2181
2020-01-13 01:52:16,721 INFO [main-SendThread(node1:2181)] zookeeper.ClientCnxn:1273 : Session establishment complete on server node1/127.0.0.1:2181, sessionid = 0x16f798087cc03af, negotiated timeout = 60000
2020-01-13 01:52:16,722 INFO [main] imps.CuratorFrameworkImpl:326 : Default schema
2020-01-13 01:52:16,725 DEBUG [main] util.ZookeeperDistributedLock:142 : 6521#node1 trying to lock /kylin/kylin_metadata/create_htable/kylin_metadata/lock
2020-01-13 01:52:16,730 INFO [main-EventThread] state.ConnectionStateManager:237 : State change: CONNECTED
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata#hbase
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:89)
at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:101)
at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:94)
at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:83)
... 3 more
Caused by: java.lang.NoSuchMethodError: org.apache.curator.framework.api.CreateBuilder.creatingParentsIfNeeded()Lorg/apache/curator/framework/api/ProtectACLCreateModePathAndBytesable;
at org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:145)
at org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:166)
at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:305)
at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:110)
at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:91)
... 8 more
2020-01-13 01:52:16,772 INFO [Curator-Framework-0] imps.CuratorFrameworkImpl:924 : backgroundOperationsLoop exiting
2020-01-13 01:52:16,773 INFO [Thread-1] zookeeper.ReadOnlyZKClient:344 : Close zookeeper connection 0x7b94089b to node1:2181
2020-01-13 01:52:16,775 INFO [ReadOnlyZKClient-node1:2181#0x7b94089b] zookeeper.ZooKeeper:692 : Session: 0x16f798087cc03ae closed
2020-01-13 01:52:16,775 INFO [ReadOnlyZKClient-node1:2181#0x7b94089b-EventThread] zookeeper.ClientCnxn:517 : EventThread shut down
2020-01-13 01:52:16,777 INFO [Thread-4] zookeeper.ZooKeeper:692 : Session: 0x16f798087cc03af closed
2020-01-13 01:52:16,777 INFO [main-EventThread] zookeeper.ClientCnxn:517 : EventThread shut down
ERROR: Unknown error. Please check full log.

Atomikos silently rollback transaction without any Exception

I am testing global transaction and timeout in atomikos. I created test where I am inserting data to first db and then call procedure in second db so I am using global transaction. Here is my test service code:
#Transactional(timeout = 5)
public void rollbackTest2x() {
SqlSession sqlLogSession = getSession(LOGRWX);
wsZadostDao.insert(sqlLogSession, new Record().withUUID(UUID.randomUUID().toString()));
SqlSession sqlSession = getSession(REFRWX);
procDelayDao.procDelay(sqlSession, new ProcDelay().withSecond(10));
// procDelayDao.procDelay(sqlSession, new ProcDelay().withSecond(10));
}
This test throw no exception but the data are rollback. There is just exception in Atomikos PooledAlarmTimer which is not propagated to main thread. So my test ends OK but data are not inserted. Any idea how should I fix it ?
2018-11-12 11:57:39.948 [main] DEBUG o.sqlproc.engine.spring.SpringQuery - callUpdate, query=call PROC_DELAY(?)
2018-11-12 11:57:40.021 [main] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): registering listener atomikos connection pool 'REFRW1X'
2018-11-12 11:57:40.023 [main] TRACE com.atomikos.thread.TaskManager - ThreadFactory: creating new thread: Atomikos:6
2018-11-12 11:57:40.025 [main] TRACE c.a.jdbc.AbstractDataSourceBean - AtomikosDataSoureBean 'REFRW1X': init done.
2018-11-12 11:57:40.025 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.025 [main] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): updating last time acquired
2018-11-12 11:57:40.025 [main] TRACE c.a.jdbc.AtomikosXAPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): testing connection with query [SELECT 1 FROM DUAL]
2018-11-12 11:57:40.026 [main] TRACE c.a.jdbc.AtomikosXAPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): connection tested OK
2018-11-12 11:57:40.026 [main] TRACE c.a.jdbc.AtomikosXAPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): creating connection proxy...
2018-11-12 11:57:40.026 [main] DEBUG c.a.jdbc.JdbcConnectionProxyHelper - setting isolation level to 2
2018-11-12 11:57:40.026 [main] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 0 context(s): notifySessionBorrowed
2018-11-12 11:57:40.026 [main] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing to state com.atomikos.datasource.xa.session.NotInBranchStateHandler#6f07d414
2018-11-12 11:57:40.026 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.026 [main] DEBUG c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: calling toString...
2018-11-12 11:57:40.026 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: toString returning oracle.jdbc.driver.LogicalConnection#40faff12
2018-11-12 11:57:40.026 [main] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 1 context(s): returning proxy oracle.jdbc.driver.LogicalConnection#40faff12
2018-11-12 11:57:40.026 [main] TRACE c.a.datasource.pool.ConnectionPool - atomikos connection pool 'REFRW1X': current size: 0/1
2018-11-12 11:57:40.026 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.026 [main] DEBUG c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: calling toString...
2018-11-12 11:57:40.026 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: toString returning oracle.jdbc.driver.LogicalConnection#40faff12
2018-11-12 11:57:40.026 [main] TRACE c.a.jdbc.AbstractDataSourceBean - AtomikosDataSoureBean 'REFRW1X': returning oracle.jdbc.driver.LogicalConnection#40faff12
2018-11-12 11:57:40.026 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.026 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: notifyBeforeUse a SessionHandleState with 1 context(s)
2018-11-12 11:57:40.026 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.027 [main] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 1 context(s): checking XA context for transaction com.atomikos.icatch.imp.CompositeTransactionImp#f881a272
2018-11-12 11:57:40.027 [main] TRACE c.atomikos.icatch.imp.CoordinatorImp - Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 entering state: ACTIVE
2018-11-12 11:57:40.027 [main] DEBUG c.a.i.imp.CompositeTransactionImp - addParticipant ( XAResourceTransaction: 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343432 ) for transaction my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.027 [main] TRACE c.a.d.xa.XAResourceTransaction - XAResourceTransaction: 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343432: about to switch to XAResource oracle.jdbc.driver.T4CXAResource#223967ea
2018-11-12 11:57:40.027 [main] TRACE c.a.d.xa.XAResourceTransaction - XAResourceTransaction my-app-7879c2825b02389836785ecff7ca2c44154202025958600001my-app-7879c2825b02389836785ecff7ca2c442: switched to XAResource oracle.jdbc.driver.T4CXAResource#223967ea
2018-11-12 11:57:40.027 [main] DEBUG c.a.d.xa.XAResourceTransaction - XAResource.start ( 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343432 , XAResource.TMNOFLAGS ) on resource REFRW1X represented by XAResource instance oracle.jdbc.driver.T4CXAResource#223967ea
2018-11-12 11:57:40.027 [main] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing to state com.atomikos.datasource.xa.session.BranchEnlistedStateHandler#4a6a6a69
2018-11-12 11:57:40.027 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: detected transaction com.atomikos.icatch.imp.CompositeTransactionImp#f881a272
2018-11-12 11:57:40.027 [main] DEBUG c.a.i.imp.CompositeTransactionImp - registerSynchronization ( com.atomikos.jdbc.AtomikosConnectionProxy$JdbcRequeueSynchronization#f881a272 ) for transaction my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:40.027 [main] DEBUG c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: calling prepareCall({ call PROC_DELAY(?)})...
2018-11-12 11:57:40.048 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: prepareCall returning oracle.jdbc.driver.OracleCallableStatementWrapper#16ac4d3d
2018-11-12 11:57:44.703 [Atomikos:4] WARN c.a.icatch.imp.ActiveStateHandler - Transaction my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 has timed out - rolling back...
2018-11-12 11:57:44.704 [Atomikos:4] TRACE c.atomikos.icatch.imp.CoordinatorImp - Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 entering state: ABORTING
2018-11-12 11:57:44.708 [Atomikos:4] TRACE com.atomikos.thread.TaskManager - ThreadFactory: creating new thread: Atomikos:7
2018-11-12 11:57:44.708 [Atomikos:4] TRACE com.atomikos.thread.TaskManager - ThreadFactory: creating new thread: Atomikos:8
2018-11-12 11:57:44.710 [Atomikos:8] DEBUG c.a.d.xa.XAResourceTransaction - XAResource.end ( 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343432 , XAResource.TMSUCCESS ) on resource REFRW1X represented by XAResource instance oracle.jdbc.driver.T4CXAResource#223967ea
2018-11-12 11:57:44.711 [Atomikos:7] DEBUG c.a.d.xa.XAResourceTransaction - XAResource.end ( 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343431 , XAResource.TMSUCCESS ) on resource LOGRW1X represented by XAResource instance oracle.jdbc.driver.T4CXAResource#446c8c72
2018-11-12 11:57:50.055 [Atomikos:7] DEBUG c.a.d.xa.XAResourceTransaction - XAResource.rollback ( 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343431 ) on resource LOGRW1X represented by XAResource instance oracle.jdbc.driver.T4CXAResource#446c8c72
2018-11-12 11:57:50.058 [Atomikos:8] DEBUG c.a.d.xa.XAResourceTransaction - XAResource.rollback ( 726F622D6170702D3738373963323832356230323338393833363738356563666637636132633434313534323032303235393538363030303031:726F622D6170702D373837396332383235623032333839383336373835656366663763613263343432 ) on resource REFRW1X represented by XAResource instance oracle.jdbc.driver.T4CXAResource#223967ea
2018-11-12 11:57:50.059 [main] DEBUG o.sqlproc.engine.spring.SpringQuery - callUpdate, number of updated rows=-1
2018-11-12 11:57:50.059 [main] DEBUG o.sqlproc.engine.SqlProcedureEngine - << callUpdate, result=-1
2018-11-12 11:57:50.059 [main] TRACE org.my.app.db.ProcDelayDao - sql procDelay result: -1
2018-11-12 11:57:50.060 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.060 [Atomikos:4] TRACE c.atomikos.icatch.imp.CoordinatorImp - Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 entering state: TERMINATED
2018-11-12 11:57:50.060 [main] DEBUG c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#72eed547: close()...
2018-11-12 11:57:50.060 [main] TRACE c.a.jdbc.AbstractConnectionProxy - Forcing close of pending statement: oracle.jdbc.driver.OraclePreparedStatementWrapper#37b1149b
2018-11-12 11:57:50.060 [main] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 1 context(s): entering notifySessionClosed
2018-11-12 11:57:50.060 [main] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 1 context(s): delegating session close to a TransactionContext
2018-11-12 11:57:50.061 [main] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing state to com.atomikos.datasource.xa.session.BranchEndedStateHandler#5409dfdd
2018-11-12 11:57:50.061 [main] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing to state com.atomikos.datasource.xa.session.BranchEndedStateHandler#5409dfdd
2018-11-12 11:57:50.061 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#72eed547: closed.
2018-11-12 11:57:50.061 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.061 [main] DEBUG c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: close()...
2018-11-12 11:57:50.061 [main] TRACE c.a.jdbc.AbstractConnectionProxy - Forcing close of pending statement: oracle.jdbc.driver.OracleCallableStatementWrapper#16ac4d3d
2018-11-12 11:57:50.061 [main] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 1 context(s): entering notifySessionClosed
2018-11-12 11:57:50.061 [main] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 1 context(s): delegating session close to a TransactionContext
2018-11-12 11:57:50.061 [main] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing state to com.atomikos.datasource.xa.session.BranchEndedStateHandler#45f9d394
2018-11-12 11:57:50.061 [main] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing to state com.atomikos.datasource.xa.session.BranchEndedStateHandler#45f9d394
2018-11-12 11:57:50.061 [main] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: closed.
2018-11-12 11:57:50.061 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.062 [Atomikos:4] TRACE c.atomikos.icatch.imp.CoordinatorImp - Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 : stopping timer...
2018-11-12 11:57:50.062 [Atomikos:4] TRACE c.atomikos.icatch.imp.CoordinatorImp - Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 : disposing statehandler TERMINATED...
2018-11-12 11:57:50.062 [Atomikos:4] TRACE c.atomikos.icatch.imp.CoordinatorImp - Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 : disposed.
2018-11-12 11:57:50.062 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.062 [main] TRACE c.a.i.i.CompositeTransactionManagerImp - getCompositeTransaction() returning instance with id my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.064 [main] DEBUG c.a.i.imp.CompositeTransactionImp - commit() done (by application) of transaction my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.064 [main] TRACE c.atomikos.icatch.imp.CoordinatorImp - prepare() of Coordinator my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 returning READONLY
2018-11-12 11:57:50.066 [Atomikos:4] TRACE c.atomikos.icatch.imp.CoordinatorImp - Error during setRollbackOnly
java.lang.IllegalStateException: my-app-7879c2825b02389836785ecff7ca2c44154202025958600001 is no longer active but in state TERMINATED
at com.atomikos.icatch.imp.CoordinatorImp.addParticipant(CoordinatorImp.java:383)
at com.atomikos.icatch.imp.CoordinatorImp.setRollbackOnly(CoordinatorImp.java:703)
at com.atomikos.icatch.imp.TransactionStateHandler.setRollbackOnly(TransactionStateHandler.java:260)
at com.atomikos.icatch.imp.CompositeTransactionImp.setRollbackOnly(CompositeTransactionImp.java:262)
at com.atomikos.icatch.imp.CompositeTransactionImp.entered(CompositeTransactionImp.java:343)
at com.atomikos.finitestates.FSMImp.notifyListeners(FSMImp.java:166)
at com.atomikos.finitestates.FSMImp.setState(FSMImp.java:256)
at com.atomikos.icatch.imp.CoordinatorImp.setState(CoordinatorImp.java:312)
at com.atomikos.icatch.imp.CoordinatorImp.setStateHandler(CoordinatorImp.java:222)
at com.atomikos.icatch.imp.CoordinatorStateHandler.rollbackFromWithinCallback(CoordinatorStateHandler.java:506)
at com.atomikos.icatch.imp.ActiveStateHandler$1.doRollback(ActiveStateHandler.java:85)
at com.atomikos.icatch.imp.CoordinatorStateHandler.rollbackWithAfterCompletionNotification(CoordinatorStateHandler.java:563)
at com.atomikos.icatch.imp.ActiveStateHandler.onTimeout(ActiveStateHandler.java:80)
at com.atomikos.icatch.imp.CoordinatorImp.alarm(CoordinatorImp.java:650)
at com.atomikos.timing.PooledAlarmTimer.notifyListeners(PooledAlarmTimer.java:95)
at com.atomikos.timing.PooledAlarmTimer.run(PooledAlarmTimer.java:82)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-11-12 11:57:50.067 [Atomikos:4] DEBUG c.a.i.imp.CompositeTransactionImp - setRollbackOnly() called for transaction my-app-7879c2825b02389836785ecff7ca2c44154202025958600001
2018-11-12 11:57:50.068 [Atomikos:4] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#72eed547: detected termination of transaction com.atomikos.icatch.imp.CompositeTransactionImp#f881a272
2018-11-12 11:57:50.069 [Atomikos:4] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing to state com.atomikos.datasource.xa.session.TerminatedStateHandler#3a06f087
2018-11-12 11:57:50.069 [Atomikos:4] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 0 context(s): all contexts terminated, firing TerminatedEvent for a SessionHandleState with 0 context(s)
2018-11-12 11:57:50.069 [Atomikos:4] TRACE c.a.jdbc.AtomikosXAPooledConnection - SessionHandleState terminated, firing XPooledConnectionTerminated event for an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s)
2018-11-12 11:57:50.069 [Atomikos:4] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): updating last time released
2018-11-12 11:57:50.069 [Atomikos:4] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): notifying listener: atomikos connection pool 'LOGRW1X'
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.datasource.pool.ConnectionPool - atomikos connection pool 'LOGRW1X': connection an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s) became available, notifying potentially waiting threads
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): updating last time released
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.jdbc.AtomikosConnectionProxy - atomikos connection proxy for oracle.jdbc.driver.LogicalConnection#40faff12: detected termination of transaction com.atomikos.icatch.imp.CompositeTransactionImp#f881a272
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.d.xa.session.TransactionContext - a TransactionContext: changing to state com.atomikos.datasource.xa.session.TerminatedStateHandler#38415c0d
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.d.xa.session.SessionHandleState - a SessionHandleState with 0 context(s): all contexts terminated, firing TerminatedEvent for a SessionHandleState with 0 context(s)
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.jdbc.AtomikosXAPooledConnection - SessionHandleState terminated, firing XPooledConnectionTerminated event for an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s)
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): updating last time released
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): notifying listener: atomikos connection pool 'REFRW1X'
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.datasource.pool.ConnectionPool - atomikos connection pool 'REFRW1X': connection an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s) became available, notifying potentially waiting threads
2018-11-12 11:57:50.070 [Atomikos:4] TRACE c.a.d.pool.AbstractXPooledConnection - an AtomikosXAPooledConnection with a SessionHandleState with 0 context(s): updating last time released
UPDATE:
I dont understand this atomikos code. I have two participants in transaction with state: TerminatedState which return READ_ONLY in prepare method so there is no commit and no exception is thrown
protected void terminate ( boolean commit ) throws HeurRollbackException,
HeurMixedException, SysException, java.lang.SecurityException,
HeurCommitException, HeurHazardException, RollbackException,
IllegalStateException
{
synchronized ( fsm_ ) {
if ( commit ) {
if ( participants_.size () <= 1 ) {
commit ( true );
} else {
int prepareResult = prepare ();
// make sure to only do commit if NOT read only
if ( prepareResult != Participant.READ_ONLY )
commit ( false );
}
} else {
rollback ();
}
}
}
If all the work is READ_ONLY then there is nothing to commit. It means your SQL did not change any records.

neo4j ::how to set shortpath query timeout property in embedded model?

I'm using neo4j 1.9.4 embedded model .It tooks too long when executed the shortpath query(50 milion nodes and 600 milion relations). I read the manual and found the two properties :
1. conf/neo4j-server.properties
org.neo4j.server.webserver.limit.executiontime=1000
2. conf/neo4j.properties
execution_guard_enabled=true
But here is the question, it seems to there isn't the 'neo4j-server.properties' file in embedded model .How can I set it ? Or the 'time out ' property is just not supported in embedded model ?
Please help. Thanks a lot !
code :
PathFinder<Path> finder = GraphAlgoFactory.shortestPath(Traversal
.expanderForTypes(RelationshipTypes.r01, Direction.BOTH)
.add(RelationshipTypes.r02, Direction.BOTH), 10);
paths = finder.findAllPaths(node1, node2);
for (Path shortestPath : paths) {
List<NodeBean> nodeList = new ArrayList<NodeBean>();
List<String> rList = new ArrayList<String>();
... ...
}
part of message.log :
2014-11-24 02:06:42.107+0000 INFO [org.neo4j]: --- INITIALIZED diagnostics END ---
2014-11-24 02:06:42.217+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.relationshiptypestore.db.names non clean shutdown detected
2014-11-24 02:06:42.217+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=114b)
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.relationshiptypestore.db non clean shutdown detected
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=10b)
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.strings non clean shutdown detected
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.propertystore.db.strings] brickCount=10 brickSize=20864b mappedMem=20971520b (storeSize=209664b)
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.index.keys non clean shutdown detected
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.propertystore.db.index.keys] brickCount=50 brickSize=20938b mappedMem=20971520b (storeSize=1048572b)
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.index non clean shutdown detected
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.propertystore.db.index] brickCount=261 brickSize=20970b mappedMem=20971520b (storeSize=5473170b)
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.arrays non clean shutdown detected
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.propertystore.db.arrays] brickCount=0 brickSize=20864b mappedMem=20971520b (storeSize=128b)
2014-11-24 02:06:42.232+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db non clean shutdown detected
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.propertystore.db] brickCount=23513 brickSize=104837b mappedMem=104857600b (storeSize=2465619255b)
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.relationshipstore.db non clean shutdown detected
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.relationshipstore.db] brickCount=100000 brickSize=221826b mappedMem=104857600b (storeSize=22183075860b)
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.nodestore.db non clean shutdown detected
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore.nodestore.db] brickCount=4733 brickSize=104877b mappedMem=104857600b (storeSize=496395405b)
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore non clean shutdown detected
2014-11-24 02:06:42.248+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\neostore] brickCount=0 brickSize=0b mappedMem=0b (storeSize=54b)
2014-11-24 02:06:42.263+0000 INFO [org.neo4j]: Non clean shutdown detected on log [D:\FTP\graph1.db\nioneo_logical.log.1]. Recovery started ...
2014-11-24 02:06:42.279+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\nioneo_logical.log.1] logVersion=4730 with committed tx=1072646
2014-11-24 02:06:42.279+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\nioneo_logical.log.1] entries found=0 lastEntryPos=16
2014-11-24 02:06:42.279+0000 INFO [org.neo4j]: Opened logical log [D:\FTP\graph1.db\nioneo_logical.log.1] version=4730, lastTxId=-1 (recovered)
2014-11-24 02:06:42.279+0000 INFO [org.neo4j]: XaResourceManager[nioneo_logical.log] sorting 0 xids
2014-11-24 02:06:42.279+0000 INFO [org.neo4j]: XaResourceManager[nioneo_logical.log] checkRecoveryComplete 0 xids
2014-11-24 02:06:42.419+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.relationshiptypestore.db.names rebuild id generator, highId=3 defragged count=0
2014-11-24 02:06:42.934+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.index.keys rebuild id generator, highId=3 defragged count=0
2014-11-24 02:06:46.351+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.index rebuild id generator, highId=2 defragged count=0
2014-11-24 02:06:46.444+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.strings rebuild id generator, highId=1490 defragged count=0
2014-11-24 02:06:46.538+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db.arrays rebuild id generator, highId=1 defragged count=0
2014-11-24 02:06:46.694+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.propertystore.db rebuild id generator, highId=60134068 defragged count=0
2014-11-24 02:06:46.943+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.relationshipstore.db rebuild id generator, highId=672185416 defragged count=0
2014-11-24 02:06:47.255+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore.nodestore.db rebuild id generator, highId=55117690 defragged count=0
2014-11-24 02:06:47.349+0000 INFO [org.neo4j]: D:\FTP\graph1.db\neostore rebuild id generator, highId=6 defragged count=0
2014-11-24 02:06:47.411+0000 INFO [org.neo4j]: XaResourceManager[nioneo_logical.log] recovery completed.
2014-11-24 02:06:47.411+0000 INFO [org.neo4j]: Recovery on log [D:\FTP\graph1.db\nioneo_logical.log.1] completed.
2014-11-24 02:06:47.411+0000 INFO [org.neo4j]: TM opening log: D:\FTP\graph1.db\tm_tx_log.1
2014-11-24 02:06:47.567+0000 INFO [org.neo4j]: BackupServer communication server started and bound to /0.0.0.0:6362
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: Non clean shutdown detected on log [D:\FTP\graph1.db\index\lucene.log.1]. Recovery started ...
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\index\lucene.log.1] logVersion=252 with committed tx=5514
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: [D:\FTP\graph1.db\index\lucene.log.1] entries found=0 lastEntryPos=16
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: Opened logical log [D:\FTP\graph1.db\index\lucene.log.1] version=252, lastTxId=-1 (recovered)
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: XaResourceManager[lucene.log] sorting 0 xids
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: XaResourceManager[lucene.log] checkRecoveryComplete 0 xids
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: XaResourceManager[lucene.log] recovery completed.
2014-11-24 02:06:47.599+0000 INFO [org.neo4j]: Recovery on log [D:\FTP\graph1.db\index\lucene.log.1] completed.
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for KernelDiagnostics:Versions START ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Graph Database: org.neo4j.kernel.EmbeddedGraphDatabase StoreId[time:1414568675229, id:-3029933565465970314, store version: 13561656364791302]
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Kernel version: Neo4j - Graph Database Kernel 1.9.4
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Neo4j component versions:
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Neo4j - Graph Database Kernel 1.9.4
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for KernelDiagnostics:Versions END ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for NEO_STORE_VERSIONS START ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Store versions:
Store versions:
NeoStore v0.A.0
NodeStore v0.A.0
RelationshipStore v0.A.0
RelationshipTypeStore v0.A.0
PropertyStore v0.A.0
PropertyIndexStore v0.A.0
StringPropertyStore v0.A.0
ArrayPropertyStore v0.A.0
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for NEO_STORE_VERSIONS END ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for NEO_STORE_ID_USAGE START ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Id usage:
Id usage:
NodeStore: used=55155045 high=55155044
RelationshipStore: used=672214420 high=672214419
RelationshipTypeStore: used=2 high=1
PropertyStore: used=60137055 high=60137054
PropertyIndexStore: used=608130 high=608129
StringPropertyStore: used=1638 high=1637
ArrayPropertyStore: used=1 high=0
2014-11-24 02:06:47.614+0000 INFO [org
.neo4j]: --- STARTED diagnostics for NEO_STORE_ID_USAGE END ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for PERSISTENCE_WINDOW_POOL_STATS START ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for PERSISTENCE_WINDOW_POOL_STATS END ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: --- STARTED diagnostics for KernelDiagnostics:StoreFiles START ---
2014-11-24 02:06:47.614+0000 INFO [org.neo4j]: Disk space on partition (Total / Free / Free %): 316763721728 / 32676884480 / 10
Storage files: (filename : modification date - size)
active_tx_log: 2014-11-21T08:52:51+0800 - 11.00 B
index:
lucene:
node:
nodes:
segments.gen: 2014-11-21T12:28:14+0800 - 20.00 B
segments_4z: 2014-11-21T12:28:14+0800 - 5.25 kB
_111.fdt: 2014-11-21T12:28:53+0800 - 223.40 MB
_111.fdx: 2014-11-21T12:28:24+0800 - 55.69 MB
_111.fnm: 2014-11-21T12:28:24+0800 - 18.00 B
_111.frq: 2014-11-21T12:28:34+0800 - 53.68 MB
_111.nrm: 2014-11-21T12:28:35+0800 - 6.96 MB
_111.prx: 2014-11-21T12:28:37+0800 - 13.92 MB
_111.tii: 2014-11-21T12:28:38+0800 - 1.62 MB
_111.tis: 2014-11-21T12:28:58+0800 - 115.02 MB
_1ri.fdt: 2014-11-21T12:29:40+0800 - 263.73 MB
_1ri.fdx: 2014-11-21T12:29:09+0800 - 63.93 MB
_1ri.fnm: 2014-11-21T12:29:10+0800 - 18.00 B
_1ri.frq: 2014-11-21T12:29:21+0800 - 61.92 MB
_1ri.nrm: 2014-11-21T12:29:22+0800 - 7.99 MB
_1ri.prx: 2014-11-21T12:29:25+0800 - 15.98 MB
_1ri.tii: 2014-11-21T12:29:25+0800 - 1.84 MB
_1ri.tis: 2014-11-21T12:29:48+0800 - 129.59 MB
_2lv.fdt: 2014-11-21T12:30:33+0800 - 303.36 MB
_2lv.fdx: 2014-11-21T12:30:01+0800 - 73.55 MB
_2lv.fnm: 2014-11-21T12:30:01+0800 - 18.00 B
_2lv.frq: 2014-11-21T12:30:14+0800 - 71.53 MB
_2lv.nrm: 2014-11-21T12:30:16+0800 - 9.19 MB
_2lv.prx: 2014-11-21T12:30:19+0800 - 18.39 MB
_2lv.tii: 2014-11-21T12:30:20+0800 - 2.14 MB
_2lv.tis: 2014-11-21T12:30:46+0800 - 150.79 MB
_3gr.fdt: 2014-11-21T12:31:28+0800 - 311.85 MB
_3gr.fdx: 2014-11-21T12:31:00+0800 - 75.61 MB
_3gr.fnm: 2014-11-21T12:31:00+0800 - 18.00 B
_3gr.frq: 2014-11-21T12:31:13+0800 - 73.59 MB
_3gr.nrm: 2014-11-21T12:31:15+0800 - 9.45 MB
_3gr.prx: 2014-11-21T12:31:18+0800 - 18.90 MB
_3gr.tii: 2014-11-21T12:31:19+0800 - 2.18 MB
_3gr.tis: 2014-11-21T12:31:46+0800 - 154.25 MB
_4ah.fdt: 2014-11-21T12:32:23+0800 - 306.20 MB
_4ah.fdx: 2014-11-21T12:31:59+0800 - 74.23 MB
_4ah.fnm: 2014-11-21T12:31:59+0800 - 18.00 B
_4ah.frq: 2014-11-21T12:32:12+0800 - 72.22 MB
_4ah.nrm: 2014-11-21T12:32:14+0800 - 9.28 MB
_4ah.prx: 2014-11-21T12:32:17+0800 - 18.56 MB
_4ah.tii: 2014-11-21T12:32:17+0800 - 2.14 MB
_4ah.tis: 2014-11-21T12:32:44+0800 - 152.60 MB
_4d9.cfs: 2014-11-21T12:32:34+0800 - 65.42 MB
_4g1.cfs: 2014-11-21T12:32:46+0800 - 65.54 MB
_4hz.cfs: 2014-11-21T12:32:46+0800 - 6.42 MB
_4ij.cfs: 2014-11-21T12:32:47+0800 - 6.44 MB
_4it.cfs: 2014-11-21T12:32:57+0800 - 65.35 MB
_4ll.cfs: 2014-11-21T12:32:58+0800 - 65.73 MB
_4od.cfs: 2014-11-21T12:33:09+0800 - 65.89 MB
_4on.cfs: 2014-11-21T12:33:00+0800 - 6.50 MB
_4ox.cfs: 2014-11-21T12:33:01+0800 - 6.57 MB
_4p7.cfs: 2014-11-21T12:33:02+0800 - 6.57 MB
_4ph.cfs: 2014-11-21T12:33:03+0800 - 6.60 MB
_4pr.cfs: 2014-11-21T12:33:05+0800 - 6.60 MB
_4px.cfs: 2014-11-21T12:33:05+0800 - 718.54 kB
_4py.cfs: 2014-11-21T12:33:05+0800 - 723.03 kB
_4pz.cfs: 2014-11-21T12:33:05+0800 - 719.12 kB
_4q1.cfs: 2014-11-21T12:33:07+0800 - 6.59 MB
_gf.fdt: 2014-11-21T12:33:29+0800 - 131.96 MB
_gf.fdx: 2014-11-21T12:33:15+0800 - 33.04 MB
_gf.fnm: 2014-11-21T12:33:15+0800 - 18.00 B
_gf.frq: 2014-11-21T12:33:20+0800 - 31.02 MB
_gf.nrm: 2014-11-21T12:33:21+0800 - 4.13 MB
_gf.prx: 2014-11-21T12:33:23+0800 - 8.26 MB
_gf.tii: 2014-11-21T12:33:23+0800 - 1.01 MB
_gf.tis: 2014-11-21T12:33:33+0800 - 73.32 MB
- Total: 2014-11-24T10:06:47+0800 - 3.51 GB
- Total: 2014-11-21T12:28:14+0800 - 3.51 GB
- Total: 2014-11-21T12:28:14+0800 - 3.51 GB
lucene-store.db: 2014-11-22T17:39:30+0800 - 40.00 B
lucene.log.1: 2014-11-21T18:34:32+0800 - 16.00 B
lucene.log.active: 2014-11-21T18:33:31+0800 - 4.00 B
- Total: 2014-11-22T11:40:56+0800 - 3.51 GB
index.db: 2014-11-21T08:52:48+0800 - 103.00 B
lock: 2014-11-22T15:32:04+0800 - 0.00 B
messages.log: 2014-11-24T10:06:44+0800 - 37.60 MB
neostore: 2014-11-24T10:06:42+0800 - 54.00 B
neostore.id: 2014-11-24T10:06:47+0800 - 9.00 B
neostore.nodestore.db: 2014-11-22T15:32:04+0800 - 473.40 MB
neostore.nodestore.db.id: 2014-11-24T10:06:47+0800 - 9.00 B
neostore.propertystore.db: 2014-11-22T15:32:04+0800 - 2.30 GB
neostore.propertystore.db.arrays: 2014-11-22T15:32:04+0800 - 128.00 B
neostore.propertystore.db.arrays.id: 2014-11-24T10:06:46+0800 - 9.00 B
neostore.propertystore.db.id: 2014-11-24T10:06:46+0800 - 9.00 B
neostore.propertystore.db.index: 2014-11-22T17:03:23+0800 - 5.22 MB
neostore.propertystore.db.index.id: 2014-11-24T10:06:46+0800 - 9.00 B
neostore.propertystore.db.index.keys: 2014-11-22T15:32:04+0800 - 1024.00 kB
neostore.propertystore.db.index.keys.id: 2014-11-24T10:06:42+0800 - 9.00 B
neostore.propertystore.db.strings: 2014-11-22T15:32:04+0800 - 204.75 kB
neostore.propertystore.db.strings.id: 2014-11-24T10:06:46+0800 - 9.00 B
neostore.relationshipstore.db: 2014-11-22T15:32:04+0800 - 20.66 GB
neostore.relationshipstore.db.id: 2014-11-24T10:06:46+0800 - 9.00 B
neostore.relationshiptypestore.db: 2014-11-24T10:06:42+0800 - 10.00 B
neostore.relationshiptypestore.db.id: 2014-11-24T10:06:42+0800 - 9.00 B
neostore.relationshiptypestore.db.names: 2014-11-22T15:32:04+0800 - 114.00 B
neostore.relationshiptypestore.db.names.id: 2014-11-24T10:06:42+0800 - 9.00 B
nioneo_logical.log.1: 2014-11-22T15:32:23+0800 - 16.00 B
nioneo_logical.log.active: 2014-11-22T15:32:04+0800 - 4.00 B
nioneo_logical.log.v4729: 2014-11-22T15:31:23+0800 - 16.00 B
store_lock: 2014-11-21T12:21:37+0800 - 0.00 B
tm_tx_log.1: 2014-11-24T10:06:47+0800 - 0.00 B
tm_tx_log.2: 2014-11-21T12:21:38+0800 - 28.68 kB
2014-11-24 02:06:47.630+0000 INFO [org.neo4j]: --- STARTED diagnostics for KernelDiagnostics:StoreFiles END ---
2014-11-24 02:06:47.630+0000 INFO [org.neo4j]: Started - database is now available
2014-11-24 02:06:47.630+0000 INFO [org.neo4j]: GC Monitor started.
2014-11-24 02:24:00.340+0000 INFO [org.neo4j]: GC Monitor: Application threads blocked for an additional 142ms [total block time: 0.142s]
2014-11-24 02:42:44.771+0000 INFO [org.neo4j]: GC Monitor: Application threads blocked for an additional 373ms [total block time: 0.515s]
neo4j.properties:
dump_configuration=false
use_memory_mapped_buffers:true
neostore.nodestore.db.mapped_memory=100M
neostore.relationshipstore.db.mapped_memory=100M
neostore.propertystore.db.mapped_memory=100M
neostore.propertystore.db.strings.mapped_memory=20M
neostore.propertystore.db.arrays.mapped_memory=20M /* file cache*/
neostore.propertystore.db.index.keys.mapped_memory=20M
neostore.propertystore.db.index.mapped_memory=20M
cache_type=soft
cache.memory_radio=50%
node_cache_size=2000M
relationship_cache_size=800M
excution_guard_enabled=true
keep_logical_logs=false
online_backup_enabled=true
ha.pull_interval=10
Direction.BOTH is an indication that it goes in circles.
You MMIO settings should be much larger (closer to the file sizes),
and your heap probably too (as it includes the mmio sections on Windows -> at least 12G to 16G heap).
You didn't share the part of messages.log that gives indication about heap sizes.
neostore.nodestore.db.mapped_memory=500M
neostore.relationshipstore.db.mapped_memory=6G
neostore.propertystore.db.mapped_memory=1G
neostore.propertystore.db.strings.mapped_memory=1G
If you run enterprise anyway you should use:
cache_type=hpc
or
cache_type=none
For the Guard, besides setting the config you've already got, the code to add it is something like this:
((GraphDatabaseAPI)graphDB).getDependencyResolver().resolveDependency(Guard.class);
guard.startTimeout(timeLimit);
guard.startOperationsCount(maxOps);
try {
return doOperation();
} catch (GuardException e) {
LOG.warn("Aborting Operation ");
throw new RuntimeException(e);
} finally {
guard.stop();
}

Timeout errors in cassandra

Read Queries Are timing out in cassandra whenever secondary indexes are involved...
Getting the following errors in cassandra logs
DEBUG [Thrift:275] 2013-11-15 02:30:56,565 ClientState.java (line 130) logged out: #<User allow_all groups=[]>
DEBUG [Thrift:280] 2013-11-15 02:30:56,764 CassandraServer.java (line 588) batch_mutate
DEBUG [Thrift:280] 2013-11-15 02:30:56,765 StorageProxy.java (line 175) Mutations/ConsistencyLevel are [RowMutation(keyspace='Checkout', key='37396539383637612d33616433
2d343636662d383135612d303163386562343839616437', modifications=[ColumnFamily(User [content:false:294#1384504256763002,email_address:false:13#1384504256763001,user_id:fa
lse:36#1384504256763000,])])]/QUORUM
DEBUG [Thrift:280] 2013-11-15 02:30:56,765 StorageProxy.java (line 448) insert writing local RowMutation(keyspace='Checkout', key='37396539383637612d336164332d343636662
d383135612d303163386562343839616437', modifications=[User])
DEBUG [Thrift:280] 2013-11-15 02:30:56,765 StorageProxy.java (line 212) Write timeout java.util.concurrent.TimeoutException for one (or more) of:
DEBUG [Thrift:280] 2013-11-15 02:30:56,765 CassandraServer.java (line 641) ... timed out
DEBUG [Thrift:280] 2013-11-15 02:30:56,765 CustomTThreadPoolServer.java (line 196) Thrift transport error occurred during processing of message.
org.apache.thrift.transport.TTransportException: Cannot read. Remote side has closed. Tried to read 4 bytes, but only got 0 bytes. (This is often indicative of an inter
nal error on the server side. Please check your server logs.)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:22)
at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:186)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
DEBUG [Thrift:280] 2013-11-15 02:30:56,765 ClientState.java (line 130) logged out: #<User allow_all groups=[]>
DEBUG [Thrift:204] 2013-11-15 02:30:56,768 CassandraServer.java (line 588) batch_mutate
DEBUG [Thrift:204] 2013-11-15 02:30:56,768 StorageProxy.java (line 175) Mutations/ConsistencyLevel are [RowMutation(keyspace='Checkout', key='37396539383637612d33616433
2d343636662d383135612d303163386562343839616437', modifications=[ColumnFamily(User [content:false:294#1384504256763002,email_address:false:13#1384504256763001,user_id:fa
lse:36#1384504256763000,])])]/QUORUM
Also getting this sometimes
ERROR 13:54:12,177 Exception in thread Thread[SSTableBatchOpen:7,5,main]
java.lang.ClassCastException: java.math.BigInteger cannot be cast to java.nio.ByteBuffer
at org.apache.cassandra.db.marshal.UTF8Type.compare(UTF8Type.java:27)
at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:45)
at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:89)
at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:38)
at java.util.TreeMap.getEntry(TreeMap.java:328)
at java.util.TreeMap.containsKey(TreeMap.java:209)
at java.util.TreeSet.contains(TreeSet.java:217)
at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:396)
at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:187)
at org.apache.cassandra.io.sstable.SSTableReader$1.run(SSTableReader.java:225)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
INFO 13:54:12,181 reading saved cache /opt/cassandra/saved_caches/OpsCenter-pdps-KeyCache

Resources