This project is read-only.

How to speed up XML import to MySQL?

May 27, 2014 at 3:34 PM
I try to import the 4 *.xml data dump files to MySQL.
The 'smaller' three files (artists, labels, masters) finished after 12 minutes, 75 seconds and 13 minutes.

Actually the biggest 16GB releases XML is running. It seems that needs severel ours to import.

Do you know any hints how I can speed up this import?
What are the most important settings I can make for MySQL?
May 27, 2014 at 10:09 PM
I have no ideia, sorry
May 28, 2014 at 4:17 PM
It took more then 4 hours to complete the import of the biggest 16GB XML file.

The whole MySQL-database contains actually 137,973,136 entries and needs about 8,1 GiB space.

A full dump of this database in a single *.sql file will be created in about 13 minutes. It has nearly the same size ~7.8 GiB.
The import of this full dump *.sql file needs 17 minutes.

If you ever try to optimize your import, you could combine your millions of single INSERT INTO in to fewer, combined ones. Like the ones you get in a full dump created by mysqldump.exe .-)

If someone has much better import times, I'm really interested in the my.cnf/my.ini settings. Maybe such settings could speedup the import too?