The Ultimate Guide to High Availability with MariaDB

Queries of large tables buffers and use memory

Hi, in a data warehouse, one source is MariaDB holding rather large tables up to 40-60,000,000 rows and about 50GB. Other equal sized tables from other databases take up about 1GB when being extracted, but MariaDB tables need around 20GB of RAM to select the full table, and data does not start to load until all data is transferred.

We have tried a number of JDBC drivers, including the newest mariaDB 2.2 with the same result.

Is there a setting, preferably in the connection string, that may be set to change this behaviour, so that data is not buffered, but start "streaming" immediately?

Answer Answered by Ian Gilfillan in this comment.

Does Streaming Result Sets help?

Comments

Comments loading...
Content reproduced on this site is the property of its respective owners, and this content is not reviewed in advance by MariaDB. The views, information and opinions expressed by this content do not necessarily represent those of MariaDB or any other party.