Every morning, the first person that tries to access Redmine at my work is waiting almost one minute for redmine to load the page. After that, the rest of the team have no problem and almost every page are loading in less than 200ms.
Here is the log between the last "good" loading and the first "bad" loading of this morning:
App 103 output: I, [2021-04-16T00:19:24.965247 #103] INFO -- : Completed 200 OK in 829ms (Views: 553.2ms | ActiveRecord: 1.8ms)
App 103 output: I, [2021-04-16T03:09:12.511395 #103] INFO -- : Started GET "/login?back_url=https%3A%2F%2Fmyapp.com%2F" for WWW.XXX.YYY.ZZZ at 2021-04-16 03:09:12 +0000
App 103 output: I, [2021-04-16T03:09:12.532015 #103] INFO -- : Processing by AccountController#login as HTML
App 103 output: I, [2021-04-16T03:09:12.532084 #103] INFO -- : Parameters: {"back_url"=>"https://myapp.com/"}
App 103 output: I, [2021-04-16T03:09:12.694146 #103] INFO -- : Redirected to https://myapp.com/login?back_url=https%3A%2F%2Fmyapp.com%2Flogin%3Fback_url%3Dhttps%253A%252F%252Fmyapp.com%252F
App 103 output: I, [2021-04-16T03:09:12.694280 #103] INFO -- : Filter chain halted as :session_expiration rendered or redirected
App 103 output: I, [2021-04-16T03:09:12.694473 #103] INFO -- : Completed 302 Found in 162ms (ActiveRecord: 2.7ms)
App 103 output: I, [2021-04-16T03:09:13.201746 #103] INFO -- : Started GET "/login?back_url=https%3A%2F%2Fmyapp.com%2Flogin%3Fback_url%3Dhttps%253A%252F%252Fmyapp.com%252F" for WWW.XXX.YYY.ZZZ at 2021-04-16 03:09:13 +0000
App 103 output: I, [2021-04-16T03:09:13.205997 #103] INFO -- : Processing by AccountController#login as HTML
App 103 output: I, [2021-04-16T03:09:13.206088 #103] INFO -- : Parameters: {"back_url"=>"https://myapp.com/login?back_url=https%3A%2F%2Fmyapp.com%2F"}
App 103 output: I, [2021-04-16T03:09:13.283815 #103] INFO -- : Current user: anonymous
App 103 output: I, [2021-04-16T03:09:13.300562 #103] INFO -- : Rendering account/login.html.erb within layouts/base
App 103 output: I, [2021-04-16T03:09:13.304521 #103] INFO -- : Rendered account/login.html.erb within layouts/base (3.8ms)
App 103 output: I, [2021-04-16T03:09:13.526917 #103] INFO -- : Completed 200 OK in 321ms (Views: 242.1ms | ActiveRecord: 50.2ms)
App 103 output: I, [2021-04-16T03:09:15.396901 #103] INFO -- : Started POST "/login" for WWW.XXX.YYY.ZZZ at 2021-04-16 03:09:15 +0000
App 103 output: I, [2021-04-16T03:09:15.400666 #103] INFO -- : Processing by AccountController#login as HTML
App 103 output: I, [2021-04-16T03:09:15.400741 #103] INFO -- : Parameters: {"utf8"=>"✓", "authenticity_token"=>"*********************************", "username"=>"myuser", "password"=>"[FILTERED]", "login"=>"Connexion"}
App 103 output: I, [2021-04-16T03:09:15.461825 #103] INFO -- : Current user: anonymous
App 103 output: I, [2021-04-16T03:09:16.117981 #103] INFO -- : Successful authentication for 'myuser' from WWW.XXX.YYY.ZZZ at 2021-04-16 03:09:16 UTC
App 103 output: I, [2021-04-16T03:09:16.454431 #103] INFO -- : Redirected to https://myapp.com/my/page
App 103 output: I, [2021-04-16T03:09:16.454677 #103] INFO -- : Completed 302 Found in 1054ms (ActiveRecord: 778.5ms)
App 103 output: I, [2021-04-16T03:09:16.929227 #103] INFO -- : Started GET "/my/page" for WWW.XXX.YYY.ZZZ at 2021-04-16 03:09:16 +0000
App 103 output: I, [2021-04-16T03:09:17.650222 #103] INFO -- : Processing by MyController#page as HTML
App 103 output: I, [2021-04-16T03:09:18.625577 #103] INFO -- : Current user: myuser (id=208)
App 103 output: I, [2021-04-16T03:09:18.923542 #103] INFO -- : Rendering my/page.html.erb within layouts/base
App 103 output: I, [2021-04-16T03:09:35.622052 #103] INFO -- : Rendered queries/_columns.html.erb (509.9ms)
App 103 output: I, [2021-04-16T03:09:39.698459 #103] INFO -- : Rendered issues/_list.html.erb (3990.1ms)
App 103 output: I, [2021-04-16T03:09:39.736960 #103] INFO -- : Rendered my/blocks/_issues.erb (5549.7ms)
App 103 output: I, [2021-04-16T03:09:44.899092 #103] INFO -- : Rendered queries/_columns.html.erb (1643.8ms)
App 103 output: I, [2021-04-16T03:09:48.195990 #103] INFO -- : Rendered issues/_list.html.erb (3114.5ms)
App 103 output: I, [2021-04-16T03:09:48.238683 #103] INFO -- : Rendered my/blocks/_issues.erb (5564.4ms)
App 103 output: I, [2021-04-16T03:09:48.271494 #103] INFO -- : Rendered my/page.html.erb within layouts/base (29347.8ms)
App 103 output: I, [2021-04-16T03:10:17.568436 #103] INFO -- : Completed 200 OK in 59918ms (Views: 57311.4ms | ActiveRecord: 2235.3ms)
App 103 output: I, [2021-04-16T03:11:32.073474 #103] INFO -- : Started GET "/projects/myapp-v2?jump=my" for WWW.XXX.YYY.ZZZ at 2021-04-16 03:11:32 +0000
App 103 output: I, [2021-04-16T03:11:32.075240 #103] INFO -- : Processing by ProjectsController#show as HTML
App 103 output: I, [2021-04-16T03:11:32.075285 #103] INFO -- : Parameters: {"jump"=>"my", "id"=>"myapp-v2"}
App 103 output: I, [2021-04-16T03:11:32.083287 #103] INFO -- : Current user: myuser (id=208)
App 103 output: I, [2021-04-16T03:11:34.636170 #103] INFO -- : Rendering projects/show.html.erb within layouts/base
App 103 output: I, [2021-04-16T03:11:36.682491 #103] INFO -- : Rendered projects/_members_box.html.erb (157.3ms)
App 103 output: I, [2021-04-16T03:11:36.684234 #103] INFO -- : Rendered projects/show.html.erb within layouts/base (2048.0ms)
App 103 output: I, [2021-04-16T03:11:37.452800 #103] INFO -- : Completed 200 OK in 5377ms (Views: 2762.9ms | ActiveRecord: 620.0ms)
At 2021-04-16T03:10:17.568436 you can see a 200 OK response in 59918ms.
I run Remdine docker with a docker-compose file. Redmine is connecting to the host MySQL server and uses the host mail server too (no problem with that).
Here is the redmine-docker-compose.yml file content:
version: '3.1'
services:
redmine:
image: redmine:4.2-passenger
user: "$UID:$GID"
logging:
driver: "journald"
options:
tag: "redmine-docker"
mode: "non-blocking"
max-buffer-size: "4m"
ports:
- 8792:3000
environment:
REDMINE_DB_MYSQL: 172.17.0.1
REDMINE_DB_DATABASE: redmine
REDMINE_DB_PORT: 3306
REDMINE_DB_USERNAME: redmine
REDMINE_DB_PASSWORD: ***************
REDMINE_DB_ENCODING: utf8
REDMINE_SECRET_KEY_BASE: *************************
volumes:
- ./redmine/files:/usr/src/redmine/files
- ./redmine/themes/PurpleMine2-master:/usr/src/redmine/public/themes/PurpleMine2-master
- ./redmine/config/configuration.yml:/usr/src/redmine/config/configuration.yml
- ./redmine/repos:/usr/src/redmine/repos
- ./redmine/etc/passwd:/etc/passwd:ro
- ./redmine/usr/src/redmine/Passengerfile.json:/usr/src/redmine/Passengerfile.json
networks:
default:
external:
name: br-redmine-docker
Here is the configuration.yml content:
production:
email_delivery:
delivery_method: :smtp
smtp_settings:
address: 172.17.0.1
port: 25
enable_starttls_auto: false
And the Passengerfile.json content:
{
"max_pool_size": 15,
"pool_idle_time": 60,
"min_instances": 4
}
Note that I created the Passengerfile.json because of this exact same problem but it did not resolve it at all.
Here is the content of passwd file (it is just a copy of the file present in the docker image with one more line at the end):
root:x:0:0:root:/root:/bin/bash
daemon:x:1:1:daemon:/usr/sbin:/usr/sbin/nologin
bin:x:2:2:bin:/bin:/usr/sbin/nologin
sys:x:3:3:sys:/dev:/usr/sbin/nologin
sync:x:4:65534:sync:/bin:/bin/sync
games:x:5:60:games:/usr/games:/usr/sbin/nologin
man:x:6:12:man:/var/cache/man:/usr/sbin/nologin
lp:x:7:7:lp:/var/spool/lpd:/usr/sbin/nologin
mail:x:8:8:mail:/var/mail:/usr/sbin/nologin
news:x:9:9:news:/var/spool/news:/usr/sbin/nologin
uucp:x:10:10:uucp:/var/spool/uucp:/usr/sbin/nologin
proxy:x:13:13:proxy:/bin:/usr/sbin/nologin
www-data:x:33:33:www-data:/var/www:/usr/sbin/nologin
backup:x:34:34:backup:/var/backups:/usr/sbin/nologin
list:x:38:38:Mailing List Manager:/var/list:/usr/sbin/nologin
irc:x:39:39:ircd:/var/run/ircd:/usr/sbin/nologin
gnats:x:41:41:Gnats Bug-Reporting System (admin):/var/lib/gnats:/usr/sbin/nologin
nobody:x:65534:65534:nobody:/nonexistent:/usr/sbin/nologin
_apt:x:100:65534::/nonexistent:/usr/sbin/nologin
redmine:x:999:999::/home/redmine:/bin/sh
hostuser:x:998:996::/home/hostuser:/bin/sh
And I created a .env file with this:
UID=998
GID=996
hostuser is a user that exists on my host (it's name is redmine on the host but I only needed to assign the right UID and GID in order to keep ownership of the redmine files to this user).
I also checked the wait_timeout MySQL variable that closes connections after a period of inactivity but it is on the default value which is 8 hours and my problem appears within approximately 4 hours so it can't be the cause.
I also wanted to disable tini in case it was that but I can't find any way to do that.
Any help is appreciated.
Thank you.
As a workaround, I ended up with writing a cron task that keep redmine awake with the curl command launched every hour. Here is a sample of my crontab:
0 */1 * * * /usr/bin/curl "https://my.redmine.com/login?keep-redmine-awake-cron" >/dev/null 2>&1
The URL parameter ?keep-redmine-awake-cron is only here to identify these requests in the web server logs.
The output of the command is ignored with >/dev/null 2>&1 because I don't want cron to send an email containing this useless output.
Though, I was not able to spot the real cause of those long requests after some inactivity.
I'm trying to ssh to a remote server using a private key through Heroku.
I'm using this gem https://github.com/net-ssh/net-ssh to complete the request and have everything working fine locally.
The reason why everything works fine locally is because I have the private key saved with the passphrase entered. When I deploy to Heroku, I'm unable to use the agent like I have it on my PC and so the connection fails.
I have changed the settings on the connection using net-ssh to not use the agent but still can't get it functioning.
Worst case I will have to create a separate API call in php hosted elsewhere to complete this connection but I'm hoping I can make it work through my rails app in Heroku.
This is what I'm currently doing:
options = {}
options[:key_data] = ENV['LANDING_PAGE_SSH_KEY']
options[:keys_only] = true
options[:use_agent] = false
options[:verbose] = :debug
options[:port] = '18765'
options[:passphrase] = ENV['SSH_KEY_PASSPHRASE']
Net::SSH.start(ENV['SERVER_HOSTNAME'], ENV['SERVER_USERNAME'], options) do |ssh|
end
I've entered the private key in a global variable and everything else that I would need. This also works locally without using the agent but fails on Heroku with this message:
[2017-07-21T19:20:35.506794 #4] DEBUG -- socket[383b2bc]: read 52 bytes
2017-07-21T19:20:35.507070+00:00 app[web.1]: D, [2017-07-21T19:20:35.507016 #4] DEBUG -- socket[383b2bc]: received packet nr 3 type 6 len 28
2017-07-21T19:20:35.507262+00:00 app[web.1]: D, [2017-07-21T19:20:35.507210 #4] DEBUG -- net.ssh.authentication.session[3fd3f610f914]: trying none
2017-07-21T19:20:35.507477+00:00 app[web.1]: D, [2017-07-21T19:20:35.507412 #4] DEBUG -- socket[383b2bc]: queueing packet nr 4 type 50 len 44
2017-07-21T19:20:35.507603+00:00 app[web.1]: D, [2017-07-21T19:20:35.507553 #4] DEBUG -- socket[383b2bc]: sent 68 bytes
2017-07-21T19:20:35.536336+00:00 app[web.1]: D, [2017-07-21T19:20:35.536194 #4] DEBUG -- socket[383b2bc]: read 52 bytes
2017-07-21T19:20:35.536472+00:00 app[web.1]: D, [2017-07-21T19:20:35.536422 #4] DEBUG -- socket[383b2bc]: received packet nr 4 type 51 len 28
2017-07-21T19:20:35.536573+00:00 app[web.1]: D, [2017-07-21T19:20:35.536526 #4] DEBUG -- net.ssh.authentication.session[3fd3f610f914]: allowed methods: publickey
2017-07-21T19:20:35.536657+00:00 app[web.1]: D, [2017-07-21T19:20:35.536612 #4] DEBUG -- net.ssh.authentication.methods.none[3fd3f6103e84]: none failed
2017-07-21T19:20:35.536749+00:00 app[web.1]: D, [2017-07-21T19:20:35.536703 #4] DEBUG -- net.ssh.authentication.session[3fd3f610f914]: trying publickey
2017-07-21T19:20:35.537566+00:00 app[web.1]: Enter passphrase for <key in memory>:Completed 500 Internal Server Error in 337ms (ActiveRecord: 1.4ms)
2017-07-21T19:20:35.538404+00:00 app[web.1]:
2017-07-21T19:20:35.538406+00:00 app[web.1]: Errno::ENOTTY (Inappropriate ioctl for device):
Any suggestions?
In my case I needed to add the private key to the server's ssh setup
ssh-add ~/.ssh/path-to-private-key
and it started working.
I have an issue where if I'm trying to create a ssh connection to a specific host, the connection hangs without timing out. I have tried connecting to this host from the same machine from outside the rails console and it works so I'm assuming this shouldn't be anything related to routing/firewall. I can also confirm I have several other hosts with the exact same OS configuration in different places and they work.
This is the log when running Net::SSH.start in debug mode:
ssh = Net::SSH.start("1.2.3.4", "user", password: "password", verbose: :debug)
2014-02-27 13:17:43 +0100 [DEBUG] establishing connection to 1.2.3.4:22
2014-02-27 13:17:43 +0100 [DEBUG] connection established
2014-02-27 13:17:43 +0100 [INFO] negotiating protocol version
2014-02-27 13:17:43 +0100 [DEBUG] remote is `SSH-2.0-OpenSSH_4.3'
2014-02-27 13:17:43 +0100 [DEBUG] local is `SSH-2.0-Ruby/Net::SSH_2.6.8 i686-linux'
2014-02-27 13:17:43 +0100 [DEBUG] read 704 bytes
2014-02-27 13:17:43 +0100 [DEBUG] received packet nr 0 type 20 len 700
2014-02-27 13:17:43 +0100 [INFO] got KEXINIT from server
2014-02-27 13:17:43 +0100 [INFO] sending KEXINIT
2014-02-27 13:17:43 +0100 [DEBUG] queueing packet nr 0 type 20 len 1620
2014-02-27 13:17:43 +0100 [DEBUG] sent 1624 bytes
2014-02-27 13:17:43 +0100 [INFO] negotiating algorithms
2014-02-27 13:17:43 +0100 [DEBUG] negotiated:
* kex: diffie-hellman-group-exchange-sha1
* host_key: ssh-rsa
* encryption_server: aes128-cbc
* encryption_client: aes128-cbc
* hmac_client: hmac-sha1
* hmac_server: hmac-sha1
* compression_client: none
* compression_server: none
* language_client:
* language_server:
2014-02-27 13:17:43 +0100 [DEBUG] exchanging keys
2014-02-27 13:17:43 +0100 [DEBUG] queueing packet nr 1 type 34 len 20
2014-02-27 13:17:43 +0100 [DEBUG] sent 24 bytes
At this point the ssh connection just hangs and could stay like this for 15-30 minutes.
Unfortunately I have no error message or anything so I'm really clueless about what the problem might be.
Some specs:
ruby-2.0.0-p0
rails (3.2.13)
net-ssh-2.8.0
The IP address in the log is not a real IP on purpose.
Any suggestion about what the problem could be? Or maybe some other log or place I could check out? I found a similar problem outside SO but it didn't get a solution so I'm trying to ask here...
I solved by reducing maximum transmission unit (MTU). My environment was some specific case. I was trying ssh from VMware Virtual Machine to Openstack Instance. And openstack needed smaller packet to be connected by kitchen-openstack which is using fog, using NET::SSH. Not sure if this works for you, but have a try for these commands (assuming in Ubuntu):
check your MTU
sudo netstat -i
You'll get some output like this, in the second column, you can check MTU:
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
eth0 1500 0 9658 0 0 0 308 0 0 0 BMRU
lo 16436 0 12952 0 0 0 12952 0 0 0 LRU
For network interface eth0, you can try to reduce MTU from 1500 to, for example 1400 like this:
sudo ifconfig eth0 mtu 1400
try net ssh
ssh = Net::SSH.start("1.2.3.4", "user", password: "password", verbose: :debug)
I built my first Rails app and am running production off a home server. Capistrano 3 worked for about a month and now it just stopped deploying. When I run cap production deploy, my app does not change on the server. It uploads my git-ssh.sh file to the root temp directory, then exits "successfully". I haven't changed anything except modifying some html since it was originally working.
My remote repo is on bitbucket and has the latest commits. I can go as far as commenting out the :repo_url in deploy.rb and not have an error.
Since there isn't an error and since I am a newb, I have a feeling that this is a very general behavior and I have overlooked something small. Any ideas?
Normal Output:
INFO [38ef66f0] Running /usr/bin/env mkdir -p /tmp/PATH/ on MYSERVER.com
INFO [38ef66f0] Finished in 1.571 seconds with exit status 0 (successful).
INFO Uploading /tmp/PATH/git-ssh.sh 100.0%
INFO [aae6143c] Running /usr/bin/env chmod +x /tmp/PATH/git-ssh.sh on MYSERVER.com
INFO [aae6143c] Finished in 0.109 seconds with exit status 0 (successful).
Verbose Output:
INFO [b15bb422] Running /usr/bin/env mkdir -p /tmp/PATH/ on MYSERVER.com
D, [TIME:14.310370] DEBUG -- net.ssh.transport.session[SESSION]: establishing connection to MYSERVER.com:PORT
D, [TIME:14.814878] DEBUG -- net.ssh.transport.session[SESSION]: connection established
I, [TIME:14.815000] INFO -- net.ssh.transport.server_version[VERSION]: negotiating protocol version
D, [TIME:14.882919] DEBUG -- net.ssh.transport.server_version[VERSION]: remote is `SSH-2.0-OpenSSH_5.9p1 Debian-5ubuntu1.1'
D, [TIME:14.883020] DEBUG -- net.ssh.transport.server_version[VERSION]: local is `SSH-2.0-Ruby/Net::SSH_2.7.0 x86_64-darwin12.3.0'
D, [TIME:14.934561] DEBUG -- tcpsocket[SOCKET]: read 984 bytes
D, [TIME:14.934662] DEBUG -- tcpsocket[SOCKET]: received packet nr 0 type 20 len 980
I, [TIME:14.934719] INFO -- net.ssh.transport.algorithms[ALGORITHMS]: got KEXINIT from server
I, [TIME:14.934810] INFO -- net.ssh.transport.algorithms[ALGORITHMS]: sending KEXINIT
D, [TIME:14.934914] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 0 type 20 len 1620
D, [TIME:14.934974] DEBUG -- tcpsocket[SOCKET]: sent 1624 bytes
I, [TIME:14.934999] INFO -- net.ssh.transport.algorithms[ALGORITHMS]: negotiating algorithms
D, [TIME:14.935071] DEBUG -- net.ssh.transport.algorithms[ALGORITHMS]: negotiated:
* kex: diffie-hellman-group-exchange-sha1
* host_key: ssh-rsa
* encryption_server: aes128-cbc
* encryption_client: aes128-cbc
* hmac_client: hmac-sha1
* hmac_server: hmac-sha1
* compression_client: none
* compression_server: none
* language_client:
* language_server:
D, [TIME:14.935093] DEBUG -- net.ssh.transport.algorithms[ALGORITHMS]: exchanging keys
D, [TIME:14.935202] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 1 type 34 len 20
D, [TIME:14.935238] DEBUG -- tcpsocket[SOCKET]: sent 24 bytes
D, [TIME:15.035995] DEBUG -- tcpsocket[SOCKET]: read 152 bytes
D, [TIME:15.036218] DEBUG -- tcpsocket[SOCKET]: received packet nr 1 type 31 len 148
D, [TIME:15.038033] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 2 type 32 len 140
D, [TIME:15.038149] DEBUG -- tcpsocket[SOCKET]: sent 144 bytes
D, [TIME:15.113155] DEBUG -- tcpsocket[SOCKET]: read 720 bytes
D, [TIME:15.113304] DEBUG -- tcpsocket[SOCKET]: received packet nr 2 type 33 len 700
D, [TIME:15.114762] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 3 type 21 len 20
D, [TIME:15.114857] DEBUG -- tcpsocket[SOCKET]: sent 24 bytes
D, [TIME:15.114923] DEBUG -- tcpsocket[SOCKET]: received packet nr 3 type 21 len 12
D, [TIME:15.115172] DEBUG -- net.ssh.authentication.session[SESSION]: beginning authentication of `USER'
D, [TIME:15.115267] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 4 type 5 len 28
D, [TIME:15.115315] DEBUG -- tcpsocket[SOCKET]: sent 52 bytes
D, [TIME:15.245792] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:15.246035] DEBUG -- tcpsocket[SOCKET]: received packet nr 4 type 6 len 28
D, [TIME:15.246215] DEBUG -- net.ssh.authentication.session[SESSION]: trying publickey
D, [TIME:15.246510] DEBUG -- net.ssh.authentication.agent[AGENT]: connecting to ssh-agent
D, [TIME:15.246633] DEBUG -- net.ssh.authentication.agent[AGENT]: sending agent request 1 len 51
D, [TIME:15.246750] DEBUG -- net.ssh.authentication.agent[AGENT]: received agent packet 2 len 5
D, [TIME:15.246801] DEBUG -- net.ssh.authentication.agent[AGENT]: sending agent request 11 len 0
D, [TIME:15.246921] DEBUG -- net.ssh.authentication.agent[AGENT]: received agent packet 12 len 5
D, [TIME:15.247091] DEBUG -- net.ssh.authentication.methods.publickey[PUBKEY]: trying publickey
D, [TIME:15.247242] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 5 type 50 len 348
D, [TIME:15.247341] DEBUG -- tcpsocket[SOCKET]: sent 372 bytes
D, [TIME:15.298246] DEBUG -- tcpsocket[SOCKET]: read 324 bytes
D, [TIME:15.298404] DEBUG -- tcpsocket[SOCKET]: received packet nr 5 type 60 len 300
D, [TIME:15.300524] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 6 type 50 len 620
D, [TIME:15.300583] DEBUG -- tcpsocket[SOCKET]: sent 644 bytes
D, [TIME:15.347646] DEBUG -- tcpsocket[SOCKET]: read 36 bytes
D, [TIME:15.347769] DEBUG -- tcpsocket[SOCKET]: received packet nr 6 type 52 len 12
D, [TIME:15.347829] DEBUG -- net.ssh.authentication.methods.publickey[PUBKEY]: publickey succeeded
D, [TIME:15.348064] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 7 type 90 len 44
D, [TIME:15.348175] DEBUG -- tcpsocket[SOCKET]: sent 68 bytes
D, [TIME:15.928356] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:15.928650] DEBUG -- tcpsocket[SOCKET]: received packet nr 7 type 91 len 28
I, [TIME:15.928842] INFO -- net.ssh.connection.session[SESSION]: channel_open_confirmation: 0 0 0 32768
I, [TIME:15.928956] INFO -- net.ssh.connection.channel[CHANNEL]: sending channel request "auth-agent-req#openssh.com"
D, [TIME:15.929074] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 8 type 98 len 44
I, [TIME:15.929227] INFO -- net.ssh.connection.channel[CHANNEL]: sending channel request "env"
D, [TIME:15.929324] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 9 type 98 len 44
I, [TIME:15.929511] INFO -- net.ssh.connection.channel[CHANNEL]: sending channel request "exec"
D, [TIME:15.929607] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 10 type 98 len 76
D, [TIME:15.929751] DEBUG -- tcpsocket[SOCKET]: sent 236 bytes
D, [TIME:15.974678] DEBUG -- tcpsocket[SOCKET]: read 124 bytes
D, [TIME:15.974830] DEBUG -- tcpsocket[SOCKET]: received packet nr 8 type 99 len 12
I, [TIME:15.974895] INFO -- net.ssh.connection.session[SESSION]: channel_success: 0
D, [TIME:15.974950] DEBUG -- net.ssh.service.forward[FORWARD]: authentication agent forwarding is active
D, [TIME:15.975012] DEBUG -- tcpsocket[SOCKET]: received packet nr 9 type 93 len 28
I, [TIME:15.975052] INFO -- net.ssh.connection.session[SESSION]: channel_window_adjust: 0 +2097152
D, [TIME:15.975111] DEBUG -- tcpsocket[SOCKET]: received packet nr 10 type 99 len 12
I, [TIME:15.975145] INFO -- net.ssh.connection.session[SESSION]: channel_success: 0
D, [TIME:15.980283] DEBUG -- tcpsocket[SOCKET]: read 36 bytes
D, [TIME:15.980403] DEBUG -- tcpsocket[SOCKET]: received packet nr 11 type 96 len 12
I, [TIME:15.980455] INFO -- net.ssh.connection.session[SESSION]: channel_eof: 0
D, [TIME:15.985198] DEBUG -- tcpsocket[SOCKET]: read 104 bytes
D, [TIME:15.985276] DEBUG -- tcpsocket[SOCKET]: received packet nr 12 type 98 len 44
I, [TIME:15.985337] INFO -- net.ssh.connection.session[SESSION]: channel_request: 0 exit-status false
INFO [b15bb422] Finished in 1.677 seconds with exit status 0 (successful).
D, [TIME:15.985583] DEBUG -- tcpsocket[SOCKET]: received packet nr 13 type 97 len 12
I, [TIME:15.985633] INFO -- net.ssh.connection.session[SESSION]: channel_close: 0
D, [TIME:15.985706] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 11 type 97 len 28
D, [TIME:15.985916] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 12 type 90 len 44
D, [TIME:15.986043] DEBUG -- tcpsocket[SOCKET]: sent 120 bytes
D, [TIME:16.029662] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.029837] DEBUG -- tcpsocket[SOCKET]: received packet nr 14 type 91 len 28
I, [TIME:16.029900] INFO -- net.ssh.connection.session[SESSION]: channel_open_confirmation: 1 2 0 32768
I, [TIME:16.030024] INFO -- net.ssh.connection.channel[3fdef9deb620]: sending channel request "env"
D, [TIME:16.030116] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 13 type 98 len 44
I, [TIME:16.030238] INFO -- net.ssh.connection.channel[3fdef9deb620]: sending channel request "exec"
D, [TIME:16.030309] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 14 type 98 len 76
D, [TIME:16.030389] DEBUG -- tcpsocket[SOCKET]: sent 168 bytes
D, [TIME:16.075046] DEBUG -- tcpsocket[SOCKET]: read 88 bytes
D, [TIME:16.075278] DEBUG -- tcpsocket[SOCKET]: received packet nr 15 type 93 len 28
I, [TIME:16.075359] INFO -- net.ssh.connection.session[SESSION]: channel_window_adjust: 1 +2097152
D, [TIME:16.075448] DEBUG -- tcpsocket[SOCKET]: received packet nr 16 type 99 len 12
I, [TIME:16.075501] INFO -- net.ssh.connection.session[SESSION]: channel_success: 1
D, [TIME:16.081736] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.081907] DEBUG -- tcpsocket[SOCKET]: received packet nr 17 type 94 len 28
I, [TIME:16.081982] INFO -- net.ssh.connection.session[SESSION]: channel_data: 1 1b
D, [TIME:16.082185] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 15 type 94 len 44
D, [TIME:16.082273] DEBUG -- tcpsocket[SOCKET]: sent 68 bytes
D, [TIME:16.136866] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.137045] DEBUG -- tcpsocket[SOCKET]: received packet nr 18 type 94 len 28
I, [TIME:16.137113] INFO -- net.ssh.connection.session[SESSION]: channel_data: 1 1b
INFO Uploading /tmp/PATH/git-ssh.sh 100.0%
D, [TIME:16.137318] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 16 type 94 len 108
D, [TIME:16.137408] DEBUG -- tcpsocket[SOCKET]: sent 132 bytes
D, [TIME:16.137514] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 17 type 94 len 28
D, [TIME:16.137574] DEBUG -- tcpsocket[SOCKET]: sent 52 bytes
D, [TIME:16.258376] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.258656] DEBUG -- tcpsocket[SOCKET]: received packet nr 19 type 94 len 28
I, [TIME:16.258789] INFO -- net.ssh.connection.session[SESSION]: channel_data: 1 1b
D, [TIME:16.258974] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 18 type 96 len 28
D, [TIME:16.259094] DEBUG -- tcpsocket[SOCKET]: sent 52 bytes
D, [TIME:16.303592] DEBUG -- tcpsocket[SOCKET]: read 140 bytes
D, [TIME:16.303733] DEBUG -- tcpsocket[SOCKET]: received packet nr 20 type 96 len 12
I, [TIME:16.303788] INFO -- net.ssh.connection.session[SESSION]: channel_eof: 1
D, [TIME:16.303861] DEBUG -- tcpsocket[SOCKET]: received packet nr 21 type 98 len 44
I, [TIME:16.303907] INFO -- net.ssh.connection.session[SESSION]: channel_request: 1 exit-status false
D, [TIME:16.303966] DEBUG -- tcpsocket[SOCKET]: received packet nr 22 type 97 len 12
I, [TIME:16.304003] INFO -- net.ssh.connection.session[SESSION]: channel_close: 1
D, [TIME:16.304068] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 19 type 97 len 28
INFO [265118f7] Running /usr/bin/env chmod +x /tmp/PATH/git-ssh.sh on MYSERVER.com
D, [TIME:16.304365] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 20 type 90 len 44
D, [TIME:16.312579] DEBUG -- tcpsocket[SOCKET]: sent 120 bytes
D, [TIME:16.354938] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.355150] DEBUG -- tcpsocket[SOCKET]: received packet nr 23 type 91 len 28
I, [TIME:16.355235] INFO -- net.ssh.connection.session[SESSION]: channel_open_confirmation: 2 0 0 32768
I, [TIME:16.355389] INFO -- net.ssh.connection.channel[CHANNEL]: sending channel request "env"
D, [TIME:16.355501] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 21 type 98 len 44
I, [TIME:16.355650] INFO -- net.ssh.connection.channel[CHANNEL]: sending channel request "exec"
D, [TIME:16.355734] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 22 type 98 len 76
D, [TIME:16.355856] DEBUG -- tcpsocket[SOCKET]: sent 168 bytes
D, [TIME:16.401684] DEBUG -- tcpsocket[SOCKET]: read 88 bytes
D, [TIME:16.401888] DEBUG -- tcpsocket[SOCKET]: received packet nr 24 type 93 len 28
I, [TIME:16.401970] INFO -- net.ssh.connection.session[SESSION]: channel_window_adjust: 2 +2097152
D, [TIME:16.402037] DEBUG -- tcpsocket[SOCKET]: received packet nr 25 type 99 len 12
I, [TIME:16.402070] INFO -- net.ssh.connection.session[SESSION]: channel_success: 2
D, [TIME:16.409522] DEBUG -- tcpsocket[SOCKET]: read 36 bytes
D, [TIME:16.409723] DEBUG -- tcpsocket[SOCKET]: received packet nr 26 type 96 len 12
I, [TIME:16.409811] INFO -- net.ssh.connection.session[SESSION]: channel_eof: 2
D, [TIME:16.409866] DEBUG -- tcpsocket[SOCKET]: read 104 bytes
D, [TIME:16.409916] DEBUG -- tcpsocket[SOCKET]: received packet nr 27 type 98 len 44
I, [TIME:16.409960] INFO -- net.ssh.connection.session[SESSION]: channel_request: 2 exit-status false
INFO [265118f7] Finished in 0.106 seconds with exit status 0 (successful).
D, [TIME:16.410112] DEBUG -- tcpsocket[SOCKET]: received packet nr 28 type 97 len 12
I, [TIME:16.410144] INFO -- net.ssh.connection.session[SESSION]: channel_close: 2
D, [TIME:16.410203] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 23 type 97 len 28
D, [TIME:16.424746] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 24 type 90 len 44
D, [TIME:16.435241] DEBUG -- tcpsocket[SOCKET]: sent 120 bytes
D, [TIME:16.476281] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.476476] DEBUG -- tcpsocket[SOCKET]: received packet nr 29 type 91 len 28
I, [TIME:16.476569] INFO -- net.ssh.connection.session[SESSION]: channel_open_confirmation: 3 2 0 32768
I, [TIME:16.476736] INFO -- net.ssh.connection.channel[3fdefac6f7f0]: sending channel request "env"
D, [TIME:16.476833] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 25 type 98 len 44
I, [TIME:16.477009] INFO -- net.ssh.connection.channel[3fdefac6f7f0]: sending channel request "exec"
D, [TIME:16.477088] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 26 type 98 len 172
D, [TIME:16.477186] DEBUG -- tcpsocket[SOCKET]: sent 264 bytes
D, [TIME:16.521258] DEBUG -- tcpsocket[SOCKET]: read 88 bytes
D, [TIME:16.521526] DEBUG -- tcpsocket[SOCKET]: received packet nr 30 type 93 len 28
I, [TIME:16.521663] INFO -- net.ssh.connection.session[SESSION]: channel_window_adjust: 3 +2097152
D, [TIME:16.521816] DEBUG -- tcpsocket[SOCKET]: received packet nr 31 type 99 len 12
I, [TIME:16.521879] INFO -- net.ssh.connection.session[SESSION]: channel_success: 3
D, [TIME:16.945782] DEBUG -- tcpsocket[SOCKET]: read 68 bytes
D, [TIME:16.946049] DEBUG -- tcpsocket[SOCKET]: received packet nr 32 type 90 len 44
I, [TIME:16.946157] INFO -- net.ssh.connection.session[SESSION]: channel open auth-agent#openssh.com
I, [TIME:16.946343] INFO -- net.ssh.connection.channel[CHANNEL]: sending channel request "env"
D, [TIME:16.946458] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 27 type 98 len 44
I, [TIME:16.946576] INFO -- net.ssh.service.forward[FORWARD]: opening auth-agent channel
D, [TIME:16.946641] DEBUG -- net.ssh.authentication.agent[AGENT]: connecting to ssh-agent
D, [TIME:16.946758] DEBUG -- net.ssh.authentication.agent[AGENT]: sending agent request 1 len 51
D, [TIME:16.946886] DEBUG -- net.ssh.authentication.agent[AGENT]: received agent packet 2 len 5
D, [TIME:16.947073] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 28 type 91 len 28
D, [TIME:16.947252] DEBUG -- tcpsocket[SOCKET]: sent 120 bytes
D, [TIME:16.990720] DEBUG -- tcpsocket[SOCKET]: read 52 bytes
D, [TIME:16.990882] DEBUG -- tcpsocket[SOCKET]: received packet nr 33 type 94 len 28
I, [TIME:16.990963] INFO -- net.ssh.connection.session[SESSION]: channel_data: 4 5b
D, [TIME:16.991002] DEBUG -- net.ssh.service.forward[FORWARD]: data:5 on agent forwarded channel
D, [TIME:16.991282] DEBUG -- unixsocket[SOCKET]: sent 5 bytes
D, [TIME:16.991351] DEBUG -- unixsocket[SOCKET]: read 9 bytes
D, [TIME:16.991412] DEBUG -- net.ssh.connection.channel[CHANNEL]: read 9 bytes from client, sending over agent forwarded connection
D, [TIME:16.991489] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 29 type 94 len 28
D, [TIME:16.991555] DEBUG -- tcpsocket[SOCKET]: sent 52 bytes
D, [TIME:17.066021] DEBUG -- tcpsocket[SOCKET]: read 84 bytes
D, [TIME:17.066253] DEBUG -- tcpsocket[SOCKET]: received packet nr 34 type 95 len 60
I, [TIME:17.066392] INFO -- net.ssh.connection.session[SESSION]: channel_extended_data: 3 1 32b
D, [TIME:17.068527] DEBUG -- tcpsocket[SOCKET]: read 36 bytes
D, [TIME:17.068733] DEBUG -- tcpsocket[SOCKET]: received packet nr 35 type 96 len 12
I, [TIME:17.068798] INFO -- net.ssh.connection.session[SESSION]: channel_eof: 4
D, [TIME:17.068855] DEBUG -- net.ssh.service.forward[FORWARD]: eof agent on agent forwarded channel
D, [TIME:17.068945] DEBUG -- tcpsocket[SOCKET]: read 240 bytes
D, [TIME:17.069009] DEBUG -- tcpsocket[SOCKET]: received packet nr 36 type 95 len 76
I, [TIME:17.069067] INFO -- net.ssh.connection.session[SESSION]: channel_extended_data: 3 1 43b
D, [TIME:17.069151] DEBUG -- tcpsocket[SOCKET]: received packet nr 37 type 98 len 44
I, [TIME:17.069207] INFO -- net.ssh.connection.session[SESSION]: channel_request: 3 exit-status false
D, [TIME:17.069293] DEBUG -- tcpsocket[SOCKET]: received packet nr 38 type 96 len 12
I, [TIME:17.069335] INFO -- net.ssh.connection.session[SESSION]: channel_eof: 3
D, [TIME:17.069397] DEBUG -- tcpsocket[SOCKET]: received packet nr 39 type 97 len 12
I, [TIME:17.069455] INFO -- net.ssh.connection.session[SESSION]: channel_close: 3
D, [TIME:17.069539] DEBUG -- tcpsocket[SOCKET]: queueing packet nr 30 type 97 len 28
Not that anyone was following, but for the record:
My issue was that I had just set up a github key for other reasons since my last deployment. In doing so, a github_rsa.pub file was created in my .ssh directory. Apparently that made my id_rsa.pub no longer locally known, so Capistrano wasn't sending any of my keys to the server and not getting any errors back.
To fix it, I simply had to run ssh-add to add my key back to my ssh-agent.
Credits go to How to add a ssh key to remote server?, though not completely.