Comments - Using CONNECT - Importing File Data Into MariaDB Tables

9 years, 11 months ago John Zobolas

Hi!

Is there anyway to use Connect Engine in this scenario:

I have one table and multiple files that are created and inserted into this table. I am using LOAD DATA INFILE command and insert these files to the table. Every such file (which has a specific format) is created periodicaly, lets say every 3 secs. The table can be really huge, up to 400M rows (each file has 3-7000 rows). Can i create a Connect table that "understands" when a new such file is created (in a specific directory lets say that has the name of the Connect table!) and indexing it automatically? What about querying at the same time? Can this scenario be functional somehow with Connect Engine?

Thanks, John.

 
Content reproduced on this site is the property of its respective owners, and this content is not reviewed in advance by MariaDB. The views, information and opinions expressed by this content do not necessarily represent those of MariaDB or any other party.