mysql:import_a_file
Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
| mysql:import_a_file [2016/07/19 15:03] – created peter | mysql:import_a_file [2020/07/15 09:30] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 13: | Line 13: | ||
| ===== Loading Large Flat Files ===== | ===== Loading Large Flat Files ===== | ||
| - | Loading Large Flat Files Into MySQL With LOAD DATA INFILE and Pt-fifo-split | + | Loading Large Flat Files Into MySQL With LOAD DATA INFILE and [[http:// |
| It’s easy to load multiple rows of data from a file into a MySQL table with a single LOAD DATA INFILE command, but if the file is over a certain size you may want to load it in multiple chunks. When I have a file with millions of lines I typically use pt-fifo-split to separate the file into multiple chunks in order to limit the size of each transaction. Unlike most tools in Percona Toolkit, pt-fifo-split doesn’t actually interact with your database, but this is one MySQL use case where it’s very helpful. | It’s easy to load multiple rows of data from a file into a MySQL table with a single LOAD DATA INFILE command, but if the file is over a certain size you may want to load it in multiple chunks. When I have a file with millions of lines I typically use pt-fifo-split to separate the file into multiple chunks in order to limit the size of each transaction. Unlike most tools in Percona Toolkit, pt-fifo-split doesn’t actually interact with your database, but this is one MySQL use case where it’s very helpful. | ||
mysql/import_a_file.1468940631.txt.gz · Last modified: 2020/07/15 09:30 (external edit)