The current method is:

    function tableInsertBatch($tableName, $fields, $values);

• Piwik.php: to allow arbitrary file loading, we should refactor the reading & writing into separate methods.
• ArchiveProcessing.php: bulk insertion stores all the rows in memory before writing to file; perhaps, we could test the LOAD DATA capability beforehand, and if known to be available, write rows concurrently to the infile
• there are MySQL tuning parameters that users may not be able to change, but might want to be aware of (via FAQ?), e.g., bulk_insert_buffer_size, and key_buffer_size

Question(s):

• how well does the new code perform for users who have changed the storage engine to InnoDB?
• there are multiple indices on the archive tables; for a non-empty table, should we be using:

ALTER TABLE $tableName DISABLE KEYS;
LOAD DATA INFILE $path REPLACE INTO  $tableName ...etc...;
ALTER TABLE $tableName ENABLE KEYS;