Loading Data Into MyRocks

Best practices and methods for efficiently loading large datasets into MyRocks tables, including using bulk loading features to improve performance.

Being a write-optimized storage engine, MyRocks has special ways to load data much faster than normal INSERTs would.

See:

• the section about "Migrating from InnoDB to MyRocks in production" has some clues.

• Data-Loading covers the topic in greater detail.

When loading data with rocksdb_bulk_load=1 and the data conflicts with the data already in the database, one may get non-trivial errors, for example:

ERROR 1105 (HY000): [./.rocksdb/test.t1_PRIMARY_2_0.bulk_load.tmp] bulk load error: 
  Invalid argument: External file requires flush

_{This page is licensed: CC BY-SA / Gnu FDL}