All pages
Powered by GitBook
1 of 1

Loading...

Loading Data Into MyRocks

Best practices and methods for efficiently loading large datasets into MyRocks tables, including using bulk loading features to improve performance.

Being a write-optimized storage engine, MyRocks has special ways to load data much faster than normal INSERTs would.

See:

  • the section about "Migrating from InnoDB to MyRocks in production" has some clues.

  • Data-Loading covers the topic in greater detail.

When loading data with and the data conflicts with the data already in the database, one may get non-trivial errors, for example:

This page is licensed: CC BY-SA / Gnu FDL

ERROR 1105 (HY000): [./.rocksdb/test.t1_PRIMARY_2_0.bulk_load.tmp] bulk load error: 
  Invalid argument: External file requires flush
rocksdb_bulk_load=1