MySQL notes

From Noah.org
Revision as of 16:31, 25 August 2008 by Root (talk | contribs) (MySQL moved to MySQL notes)
Jump to navigationJump to search

MySQL isn't my first choice of database, but it isn't a bad choice either. I prefer PostgreSQL, but everyone uses MySQL.

\G on the end of a query for pretty output.

~/.my.cnf

[mysql]
database = my_favorite_database
user = noah
password = ze_zecret_passwort
host = localhost
auto-rehash=true
prompt="\\R:\\m:\\s[\d] mysql> "
#i-am-a-dummy

Create a user

This creates a new user with full root privileges named USERNAME with no password.

 $ mysql -u root -e "GRANT ALL ON *.* to USERNAME@localhost;"
 $ mysql -u root -e "GRANT ALL ON *.* to USERNAME@'%';"

This creates a new user full root privileges named USERNAME with the given password.

 $ mysql -u root -e "GRANT ALL ON *.* to USERNAME@localhost IDENTIFIED BY 'some_pass' WITH GRANT OPTION;"
 $ mysql -u root -e "GRANT ALL ON *.* to USERNAME@'%' IDENTIFIED BY 'some_pass' WITH GRANT OPTION;"

Handy CLI arguments when scripting

Often you want to get results from the mysql client without all the ASCII box table formatting and column names. The documentation for the '-e' option lies. It claims that '-e' will "Execute command and quit.(Output like with --batch)", but the output is not like with '--batch'. If output is to stdout it will still be formatted with ASCII boxes. The "-B" or "--batch" option will force the output to be TAB delimited no matter where the output is going. The "-N" option will turn off column names in the output. The following outputs the result of the query in TAB delimited format without column names:

mysql -B -N -e "select distinct table_schema from information_schema.tables"

If you pipe or redirect output mysql CLI will automatically use TAB delimited format, but it still output column names.

Error mixing old MySQL client with newer MySQL server

If you are using an old MySQL client to connect to a later version of MySQL you may get an error:

 Client does not support authentication protocol requested by server; consider upgrading MySQL client

This happens when using a MySQL client prior to version 4.1 with a server later than version 4.1. The best thing to do is to upgrade the client. If that cannot be done then set the password on the server to use the old password hash:

 SET PASSWORD FOR 'USERNAME'@'some_host' = OLD_PASSWORD('some_pass');

create root user directly

Some automatic installations will install without creating a root user. If you start mysqld with 'skip-grant-tables' then it won't allow you to create or update a user. You can still create the root user directly by inserting into the mysql.user table. This will create a root user and set the password to "password". After running this INSERT statement you should restart mysqld.

INSERT INTO `user` VALUES ('localhost','root','*2470C0C06DEE42FD1618BB99005ADCA2EC9D1E19','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','','','','',0,0,0,0),
('%','root','*2470C0C06DEE42FD1618BB99005ADCA2EC9D1E19','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','Y','','','','',0,0,0,0);

lost root password

This is how you can reset your root password if it is lost (you cannot recover the password).

Stop mysql server.

 /etc/init.d/mysql stop

Edit /etc/my.cnf or /etc/mysql/my.cnf and add this line anywhere after the [mysqld] section:

 skip-grant-tables

Start mysql server:

 /etc/init.d/mysql start

Now you can connect without a password. Grant commands won't work. You can reset the password by directly updating the User table:

 mysql> use mysql
 mysql> update mysql.user set Password=password('newpassword') where User='root';

Remove skip-grant-tables from /etc/my.cnf.

Restart mysql server:

 /etc/init.d/mysql restart

show process info on server

See what is locking and blocking other sessions on the server.

show full processlist\G

show server status

This will show server status:

show status;

You can reset many of the counters like this:

flush status;

show run-time server config

This shows the state of the server as currently running:

show variables;

You can filter:

show variables like 'log%';

You can also set some run-time variables.

set global foo = bar;

select into file

I always forget this:

SELECT * FROM foo INTO OUTFILE '/tmp/foo.sql';

select into CSV file

SELECT * FROM foo INTO OUTFILE '/tmp/foo.csv' FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY '"' LINES TERMINATED BY '\n';

load table from file

LOAD DATA INFILE '/tmp/foo.csv' INTO TABLE foo FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY '"' LINES TERMINATED BY '\n';

dump shared memory files

It is pretty easy to read directly from MySQL memmapped files. This can be handy when you need to hack a search through data files rather than doing a proper query. Sometimes it's faster to dump data this way.

#!/usr/bin/env python

import mmap
import os, sys, string

def hex_filter (b, offset, block_size = 8):
    """Any unprintable characters are converted to line feeds, but
    only one line feed is printed per cluster of unprintable characters.
    """
    unprintable_flag = True # used to track unprintable chunk state.
    for i in xrange (offset, offset+block_size):
        #if b[i] in string.printable:
        if ord(b[i])>=ord(' ') and ord(b[i])<=ord('~'):
            sys.stdout.write("%s"%b[i])
            unprintable_flag = False
        else:
            if not unprintable_flag:
                sys.stdout.write("\n")
            unprintable_flag = True

def main ():
    filename="/var/lib/mysql/var/test/rmscrub.MYI"

    file = open(filename, "rb")
    size = os.path.getsize(filename)
    data = mmap.mmap(file.fileno(), size, access=mmap.ACCESS_READ)

    print "Note that 'data' is a memmapped file and 'size' is taken from the memmapped file size,"
    print "so len(data) and size should be the same:"
    print "len(data):", len(data)
    print "size:     ", size

    block_size = 2048
    size = 1000000
    for i in xrange(0,size, block_size):
        hex_filter(data,i, block_size)

main()

I hate MySQL client

OK, it's better than Oracle SQL*Plus, but that isn't saying much. One thing that really annoys me are the \ commands. I got burned by this in the worst possible way. I had a database name with a dot in it, "wikidb.old". I can't remember how it got there, but it was old and I wanted to drop it.

mysql> drop database wikidb.old;
ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '.old' at line 1

Oh yeah, so the dot is used as a namespace separator in SQL, so it was getting confused by the ".old" part of the name. So that's easy. You just gotta escape the dot, right? Well everything uses backslash to escape special characters, right?

mysql> drop database wikidb\.old;
ERROR:
Usage: \. <filename> | source <filename>
    ->
    ->
    -> ;
Query OK, 33 rows affected (0.24 sec)

I got both an "ERROR" and a "Query OK". Uhhh... what just happened to me? Oh no! It thinks "\." means to source a file name ".old". But apparently it also thing "\" means to end a statement just like ";", so it reads "drop database wikidb" as a single statement and executes it. Terrific! Of course, I just happened to have a database named "wikidb" on that server.

and don't do this...

Don't do this:

sudo mysql -N -e "select distinct concat('drop ', table_schema,';') from information_schema.tables" | xargs -r -i echo mysql -e "{}"

or this:

sudo ps axwwo cmd | grep -i mysqld | grep -m1 -E -o datadir=[^[:space:]]* | sed -e "s/datadir=\(.*\)/\\1/" | xargs -r -i echo rm -rf "{}"

OK, I'm not that mean -- see? I put an echo in the xargs statement to show what would have happened if someone was foolish enough to enter these commands.