MariaDB ColumnStore 1.2.2 GA Release Notes
Release date: 3rd December 2018
MariaDB ColumnStore 1.2.2 is a GA release of MariaDB ColumnStore. The MariaDB ColumnStore 1.2 series provides several new features and improvements over the MariaDB ColumnStore 1.1 release.
For an overview of MariaDB ColumnStore see MariaDB ColumnStore Architectural Overview
Please provide feedback in JIRA for anything that is not working as expected so that we can fix it before we make the release available for the larger community. For general "how to questions" ask questions here or subscribe to [email protected]
Notable changes
- MCOL-1952 - The base MariaDB server version is now 10.3.11 which include several maintenance and security fixes.
- MCOL-1847 - NumBlocksPct and TotalUmMemory can take fixed memory sizes instead of percentages
- MCOL-1739 - mcsapi has been split into separate packages for every programming language
- MCOL-1890 - The kafka package has been renamed
Bugs and issues fixed
- MCOL-1519 - Query doesn't process certain JOIN types with GROUP BY handler.
- MCOL-1558 - BRM_saves_current should use a relative path
- MCOL-1638 - Suse12 regression failure test023 median::nextValue crashing PrimProc
- MCOL-1716 - GROUP BY handler incorrectly process filters with subquery as IN predicate
- MCOL-1718 - Clarify configuration requirements for usage of the -z option
- MCOL-1742 - CentOS 7 - data-adapter repository installation broken
- MCOL-1777 - regr tests depend on table that doesn't exist yet
- MCOL-1778 - WF regression tests need fixing
- MCOL-1779 - tablemode test failing in develop
- MCOL-1793 - regr_slope() and regr_r2() produce incorrect result when used as window functions
- MCOL-1800 - test022 regression
- MCOL-1847 - need to be able to specify NumBlocksPct and TotalUmMemory explicitly
- MCOL-1855 - ColumnStore table whose name contains $ cannot be renamed
- MCOL-1868 - func_concat_ws type
- MCOL-1875 - getsystemcpu & related commands always return 0 cpu usage
- MCOL-1877 - getactivesqlstatements returns 'file open error'
- MCOL-1879 - csv text "true" is mapped to 0 during import but should be parsed to 1
- MCOL-1885 - Cross engine / Query stats doesn't show specific query errors
- MCOL-1900 - PDI Plugin unresponsive if CS is not available
- MCOL-1945 - mxs_adapter throws malloc error
- MCOL-1947 - Our aliases break BASH
- MCOL-1949 - vTpch10.sql and vTpch21.sql regression
- MCOL-1953 - columnstoreClusterTester.sh script fails
- MCOL-1959 - mxs_adapter assertion crash on multi table stream
- MCOL-1094 - mcsapi should have view/clear table lock features
- MCOL-1362 - Add a export function that utilizes (sequential) write from Spark workers
- MCOL-1739 - Split mcsapi installation into different packages for C++, Java and Python
- MCOL-1740 - mcsimport - depend on mcsapi only
- MCOL-1844 - Allow prior/custom changes made to myCnf-include-args.text be added to new myCnf-include-args.text after upgrading
- MCOL-1790 - Implement new CASE item type detection
- MCOL-1866 - Change logo in mcsapi, PDI and mcsimport
- MCOL-1944 - /var/log/mariadb/columnstore ownership set to 777 recursive
- MCOL-1952 - Rebase develop 10.3.11
In addition, all bugs fixed in MariaDB ColumnStore 1.2.1 and earlier are implicitly included in this release.
Upgrade
The following procedure outlines upgrading a 1.1.6 ColumnStore install to 1.2.2:
Multi version upgrades generally will work using the same procedure however we can't test every possible permutation so you should test your specific scenario outside of production first if you wish to try this (and this is good practice regardless).
Known issues and limitations
There are a number bugs and known limitations within this version of MariaDB ColumnStore, the most serious of these are listed below.
- MCOL-1662 - INSERT...SELECT and LOAD DATA INFILE when used in a transaction as well as mcsapi can cause dictionary columns to be badly cached
- MCOL-1797 - resumeDatabaseWrites can cause DML/DDL to go active all on UMs simultaneously
- MCOL-1990 - localquery mode tries to turn on replication and fails.
- MCOL-2061 - Running TRUNCATE on a table that has been upgraded from 1.1 -> 1.2 can cause MariaDB server to crash. As a workaround you can DROP and recreate the table.
Documentation
MariaDB ColumnStore Documentation
Packaging
RPM, Debian, and binary packages are provided for the Linux distributions supported by MariaDB ColumnStore 1.2.2 GA version.
- The supported OS for the GA version are CentOS 6, CentOS 7, Debian 8, Debian 9, RedHat 6, RedHat 7, SUSE 12, Ubuntu 16.04 and Ubuntu 18.04.
- Packages can be downloaded here or can be installed from the repositories.
- An Amazon AWS AMI Image is available for this release, please search for AMI name "MariaDB-ColumnStore-1.2.2". AMI specific installation instructions can be found here.
- Certified to run in Google Cloud Environment in the GA OSs.
Source code
The source code of MariaDB ColumnStore is tagged at GitHub with a tag, which is identical with the version of MariaDB ColumnStore. For instance, the tag of version X.Y.Z of MariaDB ColumnStore is columnstore-X.Y.Z. Further, master always refers to the latest released non-beta version.
The source code is available at these locations
- Storage Engine - Source code for engine specific processes on UM and PM node
- MariaDB Server - Source code based on MariaDB Server 10.3.11 modified to support the ColumnStore storage engine
- Tools - Source code for MariaDB ColumnStore Tools
- Write Data API - Source code for Write Data API /SDK
- MaxScale CDC and Kafka Data Adapters - Source Code for data adapters