Cant run mysql command on docker in jenkins pipeline - docker

Question

I have this docker-compose.yml file
version: '3'
services:
# MySQL
app-name-ci-mysql-service:
image: mysql
container_name: app-name-ci-mysql-container
restart: always
environment:
MYSQL_ROOT_PASSWORD: example
expose:
- 3306
networks:
- app-name-ci-mysql-network
volumes:
- /var/www/address.co/ci/mysql/my.cnf:/my.cnf
# PHP Service
app-name-ci-php-service:
build:
context: .
dockerfile: Dockerfile
container_name: app-name-ci-php-container
working_dir: /var/www/project
volumes:
- /var/www/address.co/ci/public/.env.main:/var/www/project/.env.main
- /var/www/address.co/ci/public/.env.testing:/var/www/project/.env.testing
networks:
- app-name-ci-network
- app-name-ci-mysql-network
#Nginx Service
app-name-ci-nginx-service:
image: nginx:latest
container_name: app-name-ci-nginx-container
expose:
- 80
- 443
environment:
VIRTUAL_HOST: address.co
LETSENCRYPT_HOST: address.co
LETSENCRYPT_EMAIL: admin#address.lt
networks:
- app-name-ci-network
- nginx-proxy
volumes:
- ./nginx/conf.d/:/etc/nginx/conf.d/
#Docker Networks
networks:
app-name-ci-network:
driver: bridge
app-name-ci-mysql-network:
driver: bridge
nginx-proxy:
external: true
When I run docker-compose up -d. I can use this command to create a mysql database:
docker exec app-name-ci-mysql-container mysql --defaults-extra-file=/my.cnf -e "create database reseraco_ci_testing"
where my.cnf is file with my database credentials. And everything works fine. But when I try to move everything to jenkins, it looks weird:
This is my Jenkinsfile
pipeline {
agent any
stages {
stage('Build') {
steps {
sh 'cd ./ci && docker-compose up -d'
sh 'sleep 10'
sh "docker exec app-name-ci-mysql-container mysql --defaults-extra-file=/my.cnf -e \\\"create database reseraco_ci_testing\\\""
}
}
stage('Test'){
steps {
sh 'docker exec app-name-ci-php-container /var/www/project/vendor/bin/phpunit'
}
}
stage('Deploy') {
steps {
echo "DEPLOYING"
}
}
}
post {
always {
sh 'docker rm app-name-ci-php-container app-name-ci-nginx-container app-name-ci-mysql-container -f'
}
}
}
And when I try to run the pipeline, I get this:
Obtained Jenkinsfile from git https://github.com/resera/project-resera-co
Running in Durability level: MAX_SURVIVABILITY
[Pipeline] Start of Pipeline
[Pipeline] node
Running on Jenkins in /var/jenkins_home/workspace/pipeline2
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Declarative: Checkout SCM)
[Pipeline] checkout
using credential fe238fde-2a82-4f2f-992c-e6a6fcaa805c
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/resera/project-resera-co # timeout=10
Fetching upstream changes from https://github.com/resera/project-resera-co
> git --version # timeout=10
using GIT_ASKPASS to set credentials
> git fetch --tags --progress https://github.com/resera/project-resera-co +refs/heads/*:refs/remotes/origin/*
> git rev-parse refs/remotes/origin/master^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 5ff27e842bc5f4be1e35a0dc77997cd7b497de39 (refs/remotes/origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 5ff27e842bc5f4be1e35a0dc77997cd7b497de39
Commit message: "quotes"
> git rev-list --no-walk fb92cb934b1b9820bbf9e51f5b295b20b7d2a810 # timeout=10
[Pipeline] }
[Pipeline] // stage
[Pipeline] withEnv
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Build)
[Pipeline] sh
+ cd ./ci
+ docker-compose up -d
The Docker Engine you're using is running in swarm mode.
Compose does not use swarm mode to deploy services to multiple nodes in a swarm. All containers will be scheduled on the current node.
To deploy your application across the swarm, use `docker stack deploy`.
Creating app-name-ci-php-container ...
Creating app-name-ci-mysql-container ...
Creating app-name-ci-nginx-container ...
[1A[2K
Creating app-name-ci-nginx-container ... [32mdone[0m
[1B[3A[2K
Creating app-name-ci-php-container ... [32mdone[0m
[3B[2A[2K
Creating app-name-ci-mysql-container ... [32mdone[0m
[2B
[Pipeline] sh
+ sleep 10
[Pipeline] sh
+ docker exec app-name-ci-mysql-container mysql --defaults-extra-file=/my.cnf -e "create database reseraco_ci_testing"
mysql Ver 8.0.17 for Linux on x86_64 (MySQL Community Server - GPL)
Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Usage: mysql [OPTIONS] [database]
-?, --help Display this help and exit.
-I, --help Synonym for -?
--auto-rehash Enable automatic rehashing. One doesn't need to use
'rehash' to get table and field completion, but startup
and reconnecting may take a longer time. Disable with
--disable-auto-rehash.
(Defaults to on; use --skip-auto-rehash to disable.)
-A, --no-auto-rehash
No automatic rehashing. One has to use 'rehash' to get
table and field completion. This gives a quicker start of
mysql and disables rehashing on reconnect.
--auto-vertical-output
Automatically switch to vertical output mode if the
result is wider than the terminal width.
-B, --batch Don't use history file. Disable interactive behavior.
(Enables --silent.)
--bind-address=name IP address to bind to.
--binary-as-hex Print binary data as hex
--character-sets-dir=name
Directory for character set files.
--column-type-info Display column type information.
-c, --comments Preserve comments. Send comments to the server. The
default is --skip-comments (discard comments), enable
with --comments.
-C, --compress Use compression in server/client protocol.
-#, --debug[=#] This is a non-debug version. Catch this and exit.
--debug-check This is a non-debug version. Catch this and exit.
-T, --debug-info This is a non-debug version. Catch this and exit.
-D, --database=name Database to use.
--default-character-set=name
Set the default character set.
--delimiter=name Delimiter to be used.
--enable-cleartext-plugin
Enable/disable the clear text authentication plugin.
-e, --execute=name Execute command and quit. (Disables --force and history
file.)
-E, --vertical Print the output of a query (rows) vertically.
-f, --force Continue even if we get an SQL error.
--histignore=name A colon-separated list of patterns to keep statements
from getting logged into syslog and mysql history.
-G, --named-commands
Enable named commands. Named commands mean this program's
internal commands; see mysql> help . When enabled, the
named commands can be used from any line of the query,
otherwise only from the first line, before an enter.
Disable with --disable-named-commands. This option is
disabled by default.
-i, --ignore-spaces Ignore space after function names.
--init-command=name SQL Command to execute when connecting to MySQL server.
Will automatically be re-executed when reconnecting.
--local-infile Enable/disable LOAD DATA LOCAL INFILE.
-b, --no-beep Turn off beep on error.
-h, --host=name Connect to host.
-H, --html Produce HTML output.
-X, --xml Produce XML output.
--line-numbers Write line numbers for errors.
(Defaults to on; use --skip-line-numbers to disable.)
-L, --skip-line-numbers
Don't write line number for errors.
-n, --unbuffered Flush buffer after each query.
--column-names Write column names in results.
(Defaults to on; use --skip-column-names to disable.)
-N, --skip-column-names
Don't write column names in results.
--sigint-ignore Ignore SIGINT (CTRL-C).
-o, --one-database Ignore statements except those that occur while the
default database is the one named at the command line.
--pager[=name] Pager to use to display results. If you don't supply an
option, the default pager is taken from your ENV variable
PAGER. Valid pagers are less, more, cat [> filename],
etc. See interactive help (\h) also. This option does not
work in batch mode. Disable with --disable-pager. This
option is disabled by default.
-p, --password[=name]
Password to use when connecting to server. If password is
not given it's asked from the tty.
-P, --port=# Port number to use for connection or 0 for default to, in
order of preference, my.cnf, $MYSQL_TCP_PORT,
/etc/services, built-in default (3306).
--prompt=name Set the mysql prompt to this value.
--protocol=name The protocol to use for connection (tcp, socket, pipe,
memory).
-q, --quick Don't cache result, print it row by row. This may slow
down the server if the output is suspended. Doesn't use
history file.
-r, --raw Write fields without conversion. Used with --batch.
--reconnect Reconnect if the connection is lost. Disable with
--disable-reconnect. This option is enabled by default.
(Defaults to on; use --skip-reconnect to disable.)
-s, --silent Be more silent. Print results with a tab as separator,
each row on new line.
-S, --socket=name The socket file to use for connection.
--server-public-key-path=name
File path to the server public RSA key in PEM format.
--get-server-public-key
Get server public key
--ssl-mode=name SSL connection mode.
--ssl-ca=name CA file in PEM format.
--ssl-capath=name CA directory.
--ssl-cert=name X509 cert in PEM format.
--ssl-cipher=name SSL cipher to use.
--ssl-key=name X509 key in PEM format.
--ssl-crl=name Certificate revocation list.
--ssl-crlpath=name Certificate revocation list path.
--tls-version=name TLS version to use, permitted values are: TLSv1, TLSv1.1,
TLSv1.2, TLSv1.3
--ssl-fips-mode=name
SSL FIPS mode (applies only for OpenSSL); permitted
values are: OFF, ON, STRICT
--tls-ciphersuites=name
TLS v1.3 cipher to use.
-t, --table Output in table format.
--tee=name Append everything into outfile. See interactive help (\h)
also. Does not work in batch mode. Disable with
--disable-tee. This option is disabled by default.
-u, --user=name User for login if not current user.
-U, --safe-updates Only allow UPDATE and DELETE that uses keys.
-U, --i-am-a-dummy Synonym for option --safe-updates, -U.
-v, --verbose Write more. (-v -v -v gives the table output format).
-V, --version Output version information and exit.
-w, --wait Wait and retry if connection is down.
--connect-timeout=# Number of seconds before connection timeout.
--max-allowed-packet=#
The maximum packet length to send to or receive from
server.
--net-buffer-length=#
The buffer size for TCP/IP and socket communication.
--select-limit=# Automatic limit for SELECT when using --safe-updates.
--max-join-size=# Automatic limit for rows in a join when using
--safe-updates.
--show-warnings Show warnings after every statement.
-j, --syslog Log filtered interactive commands to syslog. Filtering of
commands depends on the patterns supplied via histignore
option besides the default patterns.
--plugin-dir=name Directory for client-side plugins.
--default-auth=name Default authentication client-side plugin to use.
--binary-mode By default, ASCII '\0' is disallowed and '\r\n' is
translated to '\n'. This switch turns off both features,
and also turns off parsing of all clientcommands except
\C and DELIMITER, in non-interactive mode (for input
piped to mysql or loaded using the 'source' command).
This is necessary when processing output from mysqlbinlog
that may contain blobs.
--connect-expired-password
Notify the server that this client is prepared to handle
expired password sandbox mode.
--network-namespace=name
Network namespace to use for connection via tcp with a
server.
Default options are read from the following files in the given order:
/etc/my.cnf /etc/mysql/my.cnf /my.cnf ~/.my.cnf
The following groups are read: mysql client
The following options may be given as the first argument:
--print-defaults Print the program argument list and exit.
--no-defaults Don't read default options from any option file,
except for login file.
--defaults-file=# Only read default options from the given file #.
--defaults-extra-file=# Read this file after the global files are read.
--defaults-group-suffix=#
Also read groups with concat(group, suffix)
--login-path=# Read this path from the login file.
Variables (--variable-name=value)
and boolean options {FALSE|TRUE} Value (after reading options)
--------------------------------- ----------------------------------------
auto-rehash TRUE
auto-vertical-output FALSE
bind-address (No default value)
binary-as-hex FALSE
character-sets-dir (No default value)
column-type-info FALSE
comments FALSE
compress FALSE
database (No default value)
default-character-set auto
delimiter ;
enable-cleartext-plugin FALSE
vertical FALSE
force FALSE
histignore (No default value)
named-commands FALSE
ignore-spaces FALSE
init-command (No default value)
local-infile FALSE
no-beep FALSE
host (No default value)
html FALSE
xml FALSE
line-numbers TRUE
unbuffered FALSE
column-names TRUE
sigint-ignore FALSE
port 0
prompt mysql>
quick FALSE
raw FALSE
reconnect FALSE
socket (No default value)
server-public-key-path (No default value)
get-server-public-key FALSE
ssl-ca (No default value)
ssl-capath (No default value)
ssl-cert (No default value)
ssl-cipher (No default value)
ssl-key (No default value)
ssl-crl (No default value)
ssl-crlpath (No default value)
tls-version (No default value)
tls-ciphersuites (No default value)
table FALSE
user root
safe-updates FALSE
i-am-a-dummy FALSE
connect-timeout 0
max-allowed-packet 16777216
net-buffer-length 16384
select-limit 1000
max-join-size 1000000
show-warnings FALSE
plugin-dir (No default value)
default-auth (No default value)
binary-mode FALSE
connect-expired-password FALSE
network-namespace (No default value)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test)
Stage "Test" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Deploy)
Stage "Deploy" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] sh
+ docker rm app-name-ci-php-container app-name-ci-nginx-container app-name-ci-mysql-container -f
app-name-ci-php-container
app-name-ci-nginx-container
app-name-ci-mysql-container
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
ERROR: script returned exit code 1
Finished: FAILURE
I mean, instead of creating the new database, I get this mysql help response. Trying to fix this for 5 hours. At first I tried to use -p with password, but mysql gave me a warning that it is unsafe, and I guess that warning is breaking the pipeline. So I found a solution, by adding my credentials to cnf file and specify it by using default-extra-file option. Now file is seems found, but I cant understand why Im getting mysql help instead of command executon. maybe someone can help me?

Answer 1

Mostly the -e parameters you are passing to the docker command is not working properly, you could try printing the values of the given parameters inside the container and see if you are reading them correctly

Answer 2

I had the same problem, I was able to solve it by copying the cnf configuration file in the container
Following my error in jenkins
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
Build step 'Execute shell' marked build as failure
The error occurs when you put the password in the command line
Solved by using docker cp in my job before run mysql command
https://docs.docker.com/engine/reference/commandline/cp/
docker cp [OPTIONS] CONTAINER:SRC_PATH DEST_PATH
or
docker cp [OPTIONS] SRC_PATH|- CONTAINER:DEST_PATH
Hope it's help :-)