Release Notes for MariaDB Xpand 6.0.3
MariaDB Xpand is a distributed SQL database that is part of MariaDB Enterprise. This is the first General Availability (GA) release in the MariaDB Xpand 6 series.
MariaDB Xpand 6.0.3 was released on 2022-03-10.
MariaDB Xpand 6 provides support for columnar indexes, which can be used to speed up performance of OLAP-style queries.
Columnar indexes can improve performance of ad-hoc queries, where the fields in a query are not known in advance, because Columnar indexes provide efficient filtration capabilities that are not dependent on column order.
Columnar indexes can improve performance of operational analytics, where real-time analytics are performed on transactional data, because Columnar indexes outperform row-based secondary indexes for analytical queries that perform range scans and aggregations.
Columnar indexes are compressed automatically.
A single Columnar index can be created for each table.
Single column and composite (multi-column) Columnar indexes can be defined.
To add a Columnar index to an existing table, execute
ALTER TABLE .. ADD COLUMNAR INDEX:
ALTER TABLE hq_sales.invoices ADD COLUMNAR INDEX cols (invoice_date, invoice_total);
For best performance, MariaDB recommends loading data into the table prior to adding a Columnar index.
cost_read_columnsystem variable is used for costing columnar reads. The default value of
cost_read_columnin Xpand 5.3 was
0.01. For deployments upgrading to Xpand 6 from previous versions, the value of
cost_read_columnshould be set to
For additional information, see "MariaDB Xpand Columnar Index Architecture".
In MariaDB Xpand 6, parallel replication is Generally Available (GA) and suitable for production.
Parallel replication minimizes latency and slave lag.
Parallel replication provides extremely scalable replication. When parallel replication is configured to use a specified number of parallel Slave Event Readers / Applicators, Xpand uses the consistent hashing algorithm to uniformly distribute the Slave Event Readers / Applicators between all of the nodes. The Slave Event Readers / Applicators on each node independently perform work in parallel. Each Slave Event Reader / Applicator independently streams and applies binary log events in parallel, which allows the full power of the cluster to be used without any choke points.
When parallel replication is used, MariaDB Xpand ensures transactional consistency and commits transactions in the same order as the replication primary.
Parallel replication requires row-based replication (RBR).
CREATE SLAVE slave_name PARALLEL_LOG = master_log_name, PARALLEL_POS = position, SLICES = num_slices, BATCH_SIZE_MS = batch_size [, MASTER_HOST = master_host] [, MASTER_USER = master_user] [, MASTER_PASSWORD = master_password] [, MASTER_PORT = master_port];
For additional information, see "MariaDB Xpand Parallel Replication Architecture".
MariaDB Xpand 6 includes some improvements related to strict mode.
sql_mode=STRICT_TRANS_TABLESis set, MariaDB Xpand 6 validates when values are out of range and performs type checks on input. Errors will be raised for invalid input for all data types except:
For compatibility, MariaDB Xpand 6 adds dummy support for MariaDB Server's
Exclude Statements from Binlogs
MariaDB Xpand 6 provides a new system variable to exclude statements in the current session from being written to specific binlogs. (XPT-117)
sql_log_skip_binlogssystem variable can be set at the session-level and accepts a comma-separated list of binlog names.
To exclude the current session's statements from
binlogB, set the system variable by executing
To re-enable writes to all binlogs for the current session, set the system variable back to
Static PDs (Probability Distributions)
MariaDB Xpand 6 provides the ability to statically collect PDs (Probability Distributions).
Probability Distributions (PDs) are statistics on data distribution used to generate optimal query execution plans.
Prior to this release, all Probability Distributions were dynamic.
With this release, Static PDs allow statistics to be gathered on-demand, removing the overhead of continual statistics collection. With Static PDs, statistics can be collected off-peak and persisted indefinitely.
MariaDB Xpand 6 provides support for
Prior to this release, the
CREATE TABLE .. ENGINE=XPANDand
ALTER TABLE .. ENGINE=XPANDwas only available when using the Xpand Storage Engine Topology to select Xpand rather than the default storage engine, and the syntax would cause a syntax error to be raised when using the Xpand Performance Topology.
MariaDB Xpand 6 includes some branding-related changes to directory names, file names, and messages.
As part of re-branding efforts, some Clustrix-related files and directories have been changed to reference Xpand:
Xpand's Alerter looks for
Xpand's Upgrader uses
/etc/xpanddoesn't exist, the upgrader will print instructions on how to create a symbolic link to from
/etc/xpand, and the upgrade will be aborted.
Once a symbolic link exists, the upgrade can be re-run.
Upgrade messages reference Xpand instead of Clustrix.
A command line argument has been added to specify the node's hostname. (XPT-44)
rsynchas been added to the list of RPM dependencies.
wal_fs_dumputilities are part of the standard Xpand rpm.
_utf8mb3character set literals has been added.
OOM protection applies only when Xpand runs as
clx_importwill not re-slice
clx_importcan prompt for password:
Prior to this release,
clx_importrequired password to be specified on the command-line.
With this release,
clx_importprompts for password when not specified on the command-line. (XPT-68)
sierra_allow_right_deep_tree=1is set, query plans are improved.
When a query contains a
LEFT JOINwith an
IN(..)list predicate, cardinality estimates are improved.
Can result in data loss
After a partial rollback, corruption could occur when writing undo log records due to an issue with cache validation.
Can result in a hang or crash
STOP SLAVEis executed, the slave node could crash.
When parallel replication is configured, an Xpand node could crash due to an out of memory condition. (XPT-135)
During query optimization, internal statistics could be erroneously re-used and cause a crash.
When multiple sessions concurrently execute
ANALYZE TABLEon the same table, a crash could occur.
Can result in unexpected behavior
Logging for an RBR replication slave does not correctly surface information about errors. (XPT-255)
REPAIR TABLEdoes not work with generated columns.
When a query containing an
IN(..)list is executed as a prepared statement, the prepared statement could be translated multiple times.
Upgrades could re-set variables that were aliased, such as
A group change could result in a container being leaked. (XPT-98)
Replication to or from MariaDB Server 10.6 does not work.
Logging should occur earlier in the group change process to optimize group change performance for environments where the HugeTLB is not enabled. (XPT-183)
Arguments to the
utc_time()functions are not required to be in a valid range.
uninstall_clustrixis not replaced with
uninstall_xpandwhen upgrading from previous Xpand versions.
clxoptions could not be used in conjunction with
The CLX tool can not parse Unicode characters.
clxnode.confare not applied.
USE INDEXhint does not work with
Added System Variables
Compression algorithm to use for columnar containers
Number of values per frame
Number of values to add to a columnar extent before creating a new one
Dummy variable for compatibility.
How many batches unused
RSA private key file
RSA public key file
Do not log to the specified comma-separated binlogs
Changed System Variable Defaults
Renamed Files and Directories
Added stats to