MaxScale CDC and Kafka Data Adapters - Source Code for data adapters

Bugs and issues fixed

• MCOL-1519 - Query doesn't process certain JOIN types with GROUP BY handler.

• MCOL-1558 - BRM_saves_current should use a relative path

• MCOL-1638 - Suse12 regression failure test023 median::nextValue crashing PrimProc

• MCOL-1716 - GROUP BY handler incorrectly process filters with subquery as IN predicate

• - Clarify configuration requirements for usage of the -z option

• - CentOS 7 - data-adapter repository installation broken

• - regr tests depend on table that doesn't exist yet

• - WF regression tests need fixing

• - tablemode test failing in develop

• - regr_slope() and regr_r2() produce incorrect result when used as window functions

• - test022 regression

• - need to be able to specify NumBlocksPct and TotalUmMemory explicitly

• - ColumnStore table whose name contains $ cannot be renamed

• - func_concat_ws type

• - getsystemcpu & related commands always return 0 cpu usage

• - getactivesqlstatements returns 'file open error'

• - csv text "true" is mapped to 0 during import but should be parsed to 1

• - Cross engine / Query stats doesn't show specific query errors

• - PDI Plugin unresponsive if CS is not available

• - mxs_adapter throws malloc error

• - Our aliases break BASH

• - vTpch10.sql and vTpch21.sql regression

• - columnstoreClusterTester.sh script fails

• - mxs_adapter assertion crash on multi table stream

• - mcsapi should have view/clear table lock features

• - Add a export function that utilizes (sequential) write from Spark workers

• - Split mcsapi installation into different packages for C++, Java and Python

• - mcsimport - depend on mcsapi only

• - Allow prior/custom changes made to myCnf-include-args.text be added to new myCnf-include-args.text after upgrading

• - Implement new CASE item type detection

• - Change logo in mcsapi, PDI and mcsimport

• - /var/log/mariadb/columnstore ownership set to 777 recursive

• - Rebase develop 10.3.11

In addition, all bugs fixed in MariaDB ColumnStore 1.2.1 and earlier are implicitly included in this release.

Upgrade

The following procedure outlines upgrading a 1.1.6 ColumnStore install to 1.2.2:

• 1.1.6 GA to 1.2.2 GA upgrade procedure

Multi version upgrades generally will work using the same procedure however we can't test every possible permutation so you should test your specific scenario outside of production first if you wish to try this (and this is good practice regardless).

Known issues and limitations

There are a number bugs and known limitations within this version of MariaDB ColumnStore, the most serious of these are listed below.

• MCOL-1662 - INSERT...SELECT and LOAD DATA INFILE when used in a transaction as well as mcsapi can cause dictionary columns to be badly cached

• MCOL-1797 - resumeDatabaseWrites can cause DML/DDL to go active all on UMs simultaneously

• MCOL-1990 - localquery mode tries to turn on replication and fails.

• MCOL-2061 - Running TRUNCATE on a table that has been upgraded from 1.1 -> 1.2 can cause MariaDB server to crash. As a workaround you can DROP and recreate the table.

Documentation

MariaDB ColumnStore Documentation

Packaging

RPM, Debian, and binary packages are provided for the Linux distributions supported by MariaDB ColumnStore 1.2.2 GA version.

• The supported OS for the GA version are CentOS 6, CentOS 7, Debian 8, Debian 9, RedHat 6, RedHat 7, SUSE 12, Ubuntu 16.04 and Ubuntu 18.04.

• Packages can be downloaded here or can be installed from the repositories.

• An Amazon AWS AMI Image is available for this release, please search for AMI name "MariaDB-ColumnStore-1.2.2". AMI specific installation instructions can be found here.

• Certified to run in Google Cloud Environment in the GA OSs.

Source code

The source code of MariaDB ColumnStore is tagged at GitHub with a tag, which is identical with the version of MariaDB ColumnStore. For instance, the tag of version X.Y.Z of MariaDB ColumnStore is columnstore-X.Y.Z. Further, master always refers to the latest released non-beta version.

The source code is available at these locations

• Storage Engine - Source code for engine specific processes on UM and PM node

• MariaDB Server - Source code based on MariaDB Server 10.3.11 modified to support the ColumnStore storage engine

• Tools - Source code for MariaDB ColumnStore Tools

• Write Data API - Source code for Write Data API /SDK

• MaxScale CDC and Kafka Data Adapters -

Bugs and issues fixed

• MCOL-901 - group_concat() consumes a great amount of memory

• MCOL-1456 - Query doesn't try REDO_PHASE1

• MCOL-1559 - Regression on working_tpch1/misc/bug3669 string pad compare not correct

• MCOL-1607 - postConfigure must support hostnames as cluster nodes network endpoints.

• - causes regression

• - WriteEngine bulk methods do not version dictionaries correctly

• - Joblist thread pool leaks if mariadb client connection drops its connection early.

• - mcsapi stale transactions

• - Debian 9 - data-adapter package dependencies broken

• - Informatica: delete statement doesn't escape reserved names for column names

• - Remote Cpimport / API: Text overlaps MariaDB logo in installer windows

• - resumedatabasewrites causes both DDL/DML to go active on um1/um2

• - Output of 'select * (with order by limit) queries' returns unexpected result

• - RENAME crashes when tablename contains / symbol

• - Deb package name change broken

• - mxs_adapter throws malloc error

• - javamcsapi's shared library gets generated with the version number appended twice

• - regr_avgx and regr_avgy should return NULL if count is zero

• - regr_intercept, regr_r2, regr_slope and possibly other regr functions should return NULL with only one row.

• - javamcsapi - MillionRow test fails on Ubuntu 16.04 and 18.04

• - Fix jobstep abort

• - Dictionary null comparison check can crash

• - ORDER BY with OFFSET in subquery produces random and incorrect result

• - IS.columnstore_files maximum contains incorrect number of records for any relation.

• - cpimport scientific notation conversion problem

• - pentaho kettle adapter lock session with bulk columnstore and dml transaction(delete/update operation).

• - PDI CS Bulk Load plugin not able to read transformations with empty configuration

• - Autoswitch broken in some cases in 1.2.2

• - UDAF docs are currently broken

• - PrimProc crash - signal 11, Segmentation fault - funcexp::Func_lpad::getStrVal

• - Informatica PowerCenter Bulk Write Connector

• - Add Windows builder to buildbot for Kettle

• - Add Windows builder to buildbot for mcsimport

• - Change the default to use double when overflow occurs in SUM() and AVG()

• - Add API test suite to buildbot

• - Add data-adapters test suite to buildbot

• - Add tools test suite to buildbot

• - javamcsapi, pymcsapi known isTableLock and TableLockInfo limitations

• - Write Spark and PySpark documentation for mcsapi

• - Cant build engine out-of-source

• - Check NUMA devel package is installed on BuildBot instances

• - Use jemalloc as the main memory allocator - testing for 1.2.3-1

• - Rebase 1.2 on

In addition, all bugs fixed in MariaDB ColumnStore 1.2.2 and earlier are implicitly included in this release.

Upgrade

The following procedure outlines upgrading a 1.1.7 ColumnStore install to 1.2.3:

• 1.1.7 GA to 1.2.3 GA upgrade procedure

Multi version upgrades generally will work using the same procedure however we can't test every possible permutation so you should test your specific scenario outside of production first if you wish to try this (and this is good practice regardless).

Known issues and limitations

There are a number bugs and known limitations within this version of MariaDB ColumnStore, the most serious of these are listed below.

• MCOL-1990 - localquery mode tries to turn on replication and fails.

• MCOL-2061 - Running TRUNCATE on a table that has been upgraded from 1.1 -> 1.2 can cause MariaDB server to crash. As a workaround you can DROP and recreate the table.

Documentation

MariaDB ColumnStore Documentation

Packaging

RPM, Debian, and binary packages are provided for the Linux distributions supported by MariaDB ColumnStore 1.2.3 GA version.

• The supported OS for the GA version are CentOS 6, CentOS 7, Debian 8, Debian 9, RedHat 6, RedHat 7, SUSE 12, Ubuntu 16.04 and Ubuntu 18.04.

• Packages can be downloaded here or can be installed from the repositories.

• An Amazon AWS AMI Image is available for this release, please search for AMI name "MariaDB-ColumnStore-1.2.3". AMI specific installation instructions can be found here.

• Certified to run in Google Cloud Environment in the GA OSs.

Source code

The source code of MariaDB ColumnStore is tagged at GitHub with a tag, which is identical with the version of MariaDB ColumnStore. For instance, the tag of version X.Y.Z of MariaDB ColumnStore is columnstore-X.Y.Z. Further, master always refers to the latest released non-beta version.

The source code is available at these locations

• Storage Engine - Source code for engine specific processes on UM and PM node

• MariaDB Server - Source code based on MariaDB Server 10.3.13 modified to support the ColumnStore storage engine

• Tools - Source code for MariaDB ColumnStore Tools

• Write Data API - Source code for Write Data API /SDK

• MaxScale CDC and Kafka Data Adapters -

• MCOL-3315 - The base MariaDB server version is now 10.3.15 which include several maintenance and security fixes.

• MCOL-3270 - cpimport performance for dictionary data is up to 2x faster.

• MCOL-2061 - If you are performing a major version upgrade or have in the past there is a new stored procedure called columnstore_info.columnstore_upgrade() should be executed.

Bugs and issues fixed

• MCOL-537 - Some compiler warnings need fixing

• MCOL-1495 - Memory leak in WriteEngineServ

• MCOL-1951 - Crash when MySQL aggregate UDF is called against Columnstore table

• MCOL-1984 - SystemConfig / WaitPeriod change lost during upgrade

• - mscadmin redistributeData parameters are not accepted as suggested by the help information.

• - Some regr_* tests aren't deterministic so comparisons are iffy. RANK()

• - MariaDB shows warnings and could crash on DDL after upgrade

• - High CPU usage and slow performance appears when load data with remote mcsimport

• - UDAF doesn't work if there are two count(distinct) in projection list

• - There is no way to identify execution thread that causes bottleneck

• - Query with SUM() erroring - /rowgroup.h@677: assertion '0' failed

• - getSystemDisk showing incorrect root usage and reporting incorrect alarm

• - Probably Kafka DA produces '\0' in the end of TEXT or VARCHAR with width > 7

• - javamcsapi compatibility test fails

• - UPDATE performance improvement contribution - Contributed by ABS Global

• - ctrl+c sometimes leaves DMLProc in bad state

• - Non-Columnstore Window function causes debug assert

• - regression test212 logs integer expression expected error

• - RPM warnings appear when installing ColumnStore's MariaDB Server

• - support columnstore tables as slaves to innodb master tables

• - Add hidden switch for MariaDB async replication

• - API .NET support - Alpha - Contributed by Bill Adams

• - Allow simple replication to ColumnStore

• - Add a new postConfigure flag to resolve submitted hostnames to correct reverse dns names

• - Support ORDER BY within UNION subqueries

• - Improve cpimport ingest speed into Dictionary columns - Contributed by ABS Global

• - add support for using and defaulting memory based settings to docker image

• - Rebase on

Additional typo fix contribution by Kabike

In addition, all bugs fixed in MariaDB ColumnStore 1.2.3 and earlier are implicitly included in this release.

Upgrade

The following procedure outlines upgrading a 1.1.7 ColumnStore install to 1.2.4:

• 1.1.7 GA to 1.2.4 GA upgrade procedure

The following procedure outlines upgrading a 1.2.x ColumnStore install to 1.2.4:

• 1.2.x GA to 1.2.4 GA upgrade procedure

Multi version upgrades generally will work using the same procedure however we can't test every possible permutation so you should test your specific scenario outside of production first if you wish to try this (and this is good practice regardless).

Known issues and limitations

There are a number bugs and known limitations within this version of MariaDB ColumnStore, the most serious of these are listed below.

• MCOL-1990 - localquery mode tries to turn on replication and fails.

Documentation

MariaDB ColumnStore Documentation

Packaging

RPM, Debian, and binary packages are provided for the Linux distributions supported by MariaDB ColumnStore 1.2.4 GA version.

• The supported OS for the GA version are CentOS 6, CentOS 7, Debian 8, Debian 9, RedHat 6, RedHat 7, SUSE 12, Ubuntu 16.04 and Ubuntu 18.04.

• Packages can be downloaded here or can be installed from the repositories.

• An Amazon AWS AMI Image is available for this release, please search for AMI name "MariaDB-ColumnStore-1.2.4". AMI specific installation instructions can be found here.

• Certified to run in Google Cloud Environment in the GA OSs.

Source code

The source code of MariaDB ColumnStore is tagged at GitHub with a tag, which is identical with the version of MariaDB ColumnStore. For instance, the tag of version X.Y.Z of MariaDB ColumnStore is columnstore-X.Y.Z. Further, master always refers to the latest released non-beta version.

The source code is available at these locations

• Storage Engine - Source code for engine specific processes on UM and PM node

• MariaDB Server - Source code based on MariaDB Server 10.3.15 modified to support the ColumnStore storage engine

• Tools - Source code for MariaDB ColumnStore Tools

• Write Data API - Source code for Write Data API /SDK

• MaxScale CDC and Kafka Data Adapters -

MaxScale CDC and Kafka Data Adapters - Source Code for data adapters

MaxScale CDC and Kafka Data Adapters - Source Code for data adapters

_{This page is: Copyright © 2025 MariaDB. All rights reserved.}

_{This page is: Copyright © 2025 MariaDB. All rights reserved.}

_{This page is: Copyright © 2025 MariaDB. All rights reserved.}

_{This page is: Copyright © 2025 MariaDB. All rights reserved.}

_{This page is: Copyright © 2025 MariaDB. All rights reserved.}

_{This page is: Copyright © 2025 MariaDB. All rights reserved.}