Comments - Can we extend the max length of the data types varchar and varbinary to 65535?
Content reproduced on this site is the property of its respective owners,
and this content is not reviewed in advance by MariaDB. The views, information and opinions
expressed by this content do not necessarily represent those of MariaDB or any other party.
We only use the ColumnStore for structured data. But we need create more columns without the limitation of the total column number * length less than 65535.
Our case is described as follows: We have a very large table required to support many years' transactions. We don't want to partition the table according to specific columns. So we plan to keep 6 months' records in row store and migrate older history data to column store. However, we are blocked by the data type issues, such as the length limitation of varchar and varbinary, not supporting text and blob.
We don't want to keep the text or blob data in row store for the count of records is very large, such as 1 billion. In addition the join speed is not acceptable for complex queries. Actually, we only need get the value of text or blob after queries.
By the way, can you provide such a feature to support mixed storage for the same table? In other words, the system can migrate older data to column store automatically. Right now, I have to migrate the old records from row store to column store online. Please give me ideas for my case. Thank you very much.
The column limit is a function of the mariadb server (and also mysql) so is a more complex problem to solve in terms of impact. The mixed storage engine is an interesting use case - i have filed improvement https://jira.mariadb.org/browse/MCOL-362 to track this. At this point in time the mariadb team is focused on completing the port and moving towards a stable GA version. I think your only option for now is to consider a different storage architecture for your texts or blobs.
Ok. Thanks for your feedback.