All pages
Powered by GitBook
1 of 29

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Data-at-Rest Encryption

Secure MariaDB Server data at rest with encryption. This section details how to protect your sensitive information stored on disk, ensuring data confidentiality and compliance.

Aria Encryption

Learn about Aria encryption in MariaDB Server for data at rest. This section details how to encrypt Aria tablespaces, providing enhanced security for your stored data.

Encrypting Binary Logs

MariaDB Server can encrypt the server's binary logs and relay logs. This ensures that your binary logs are only accessible through MariaDB.

Basic Configuration

Since , MariaDB can also encrypt binary logs (including relay logs). Encryption of binary logs is configured by the encrypt_binlog system variable.

Users of data-at-rest encryption will also need to have a key management and encryption plugin configured. Some examples are the File Key Management Plugin and AWS Key Management Plugin.

Encryption Keys

support . Each encryption key can be defined with a different 32-bit integer as a key identifier.

MariaDB uses the encryption key with ID 1 to encrypt .

Key Rotation

Some allow you to automatically rotate and version your encryption keys. If a plugin supports key rotation, and if it rotates the encryption keys, then InnoDB's can re-encrypt InnoDB pages that use the old key version with the new key version. However, the binary log does not have a similar mechanism, which means that existing binary logs remain encrypted with the older key version, but new binary logs will be encrypted with the new key version. For more information, see .

In order for key rotation to work, both the backend key management service (KMS) and the corresponding have to support key rotation. See to determine which plugins currently support key rotation.

Enabling Encryption

Encryption of binary logs can be enabled by following the process:

  • First, stop the server.

  • Then, set in the MariaDB configuration file.

  • Then, start the server.

From that point forward, any new will be encrypted. To delete old unencrypted , you can use or .

Disabling Encryption

Encryption of can be disabled by following the process:

  • First, stop the server.

  • Then, set in the MariaDB configuration file.

  • Then, start the server.

From that point forward, any new will be unencrypted. If you would like the server to continue to have access to old encrypted , then make sure to keep your loaded.

Understanding Binlog Encryption

When starting with binary log encryption, MariaDB Server logs a Format_descriptor_log_event and a START_ENCRYPTION_EVENT, then encrypts all subsequent events for the binary log.

Each event's header and footer are created and processed to produce encrypted blocks. These encrypted blocks are produced before transactions are committed and before the events are flushed to the binary log. As such, they exist in an encrypted state in memory buffers and in the IO_CACHE files for user connections.

Effects of Data-at-Rest Encryption on Replication

When using encrypted binary logs with , it is completely supported to have different encryption keys on the master and slave. The master decrypts encrypted binary log events as it reads them from disk, and before its sends them to the slave, so the slave actually receives the unencrypted binary log events.

If you want to ensure that binary log events are encrypted as they are transmitted between the master and slave, then you will have to use .

Effects of Data-at-Rest Encryption on mariadb-binlog

does not currently have the ability to decrypt encrypted on its own (see about that). In order to use mariadb-binlog with encrypted , you have to use the command-line option, so that the server can decrypt the for mariadb-binlog.

Note, using the --read-from-remote-server option on versions of the mariadb-binlog utility that do not have the fix (<=, , ) can corrupt binlog positions when the binary log is encrypted.

This page is licensed: CC BY-SA / Gnu FDL

[mariadb]
...

# File Key Management
plugin_load_add = file_key_management
file_key_management_filename = /etc/mysql/encryption/keyfile.enc
file_key_management_filekey = FILE:/etc/mysql/encryption/keyfile.key
file_key_management_encryption_algorithm = AES_CTR

# Binary Log Encryption
encrypt_binlog=ON
Key management and encryption plugins
using multiple encryption keys
binary logs
key management and encryption plugins
background encryption threads
MDEV-20098
key management and encryption plugin
Encryption Key Management: Support for Key Rotation in Encryption Plugins
encrypt_binlog=ON
binary logs
binary logs
RESET MASTER
PURGE BINARY LOGS
binary logs
encrypt_binlog=OFF
binary logs
binary logs
key management and encryption plugin
replication
binary log dump thread
TLS with the replication connection
mariadb-binlog
binary logs
MDEV-8813
binary logs
--read-from-remote-server
binary logs
MDEV-20574

Why Encrypt MariaDB Data?

Nearly everyone owns data of immense value: customer data, construction plans, recipes, product designs and other information. These data are stored in clear text on your storage media. Everyone with file system access is able to read and modify the data. If this data falls into the wrong hands (criminals or competitors) this may result in serious consequences.

With encryption you protect Data At Rest (see the Wikipedia article). That way, the database files are protected against unauthorized access.

When Does Encryption Help to Protect Your Data?

Encryption helps in case of threats against the database files:

  • An attacker gains access to the system and copies the database files to avoid the MariaDB authorization check.

  • MariaDB is operated by a service provider who should not gain access to the sensitive data.

When is Encryption No Help?

Encryption provides no additional protection against threats caused by authorized database users. Specifically, SQL injections aren’t prevented.

What to Encrypt?

All data that is not supposed to fall into possible attackers hands should be encrypted. Especially information, subject to strict data protection regulations, is to be protected by encryption (e.g. in the healthcare sector: patient records). Additionally, data being of interest for criminals should be protected. Data which should be encrypted are:

  • Personal related information

  • Customer details

  • Financial and credit card data

  • Public authorities' data

How to Handle Key Management?

There are currently three options for key management:

See for details.

This page is licensed: CC BY-SA / Gnu FDL

Construction plans and research and development results
File Key Management Plugin
AWS Key Management Plugin
Hashicorp Key Management Plugin
Encryption Key Management

InnoDB Encryption

Learn about InnoDB encryption for data at rest. This section details how to encrypt InnoDB tablespaces, ensuring strong data security and compliance for your mission-critical applications.

Key Management and Encryption Plugins

Explore key management and encryption plugins for MariaDB Server. This section details how to manage encryption keys and leverage plugins for robust data-at-rest protection.

Aria Encryption Keys

As with other storage engines that support data-at-rest encryption, Aria relies on an Encryption Key Management plugin to handle its encryption keys. Where the support is available, Aria can use multiple keys.

Encryption Keys

MariaDB keeps track of each encryption key internally using a 32-bit integer, which serves as the key identifier. Unlike InnoDB, Aria does not support the ENCRYPTION_KEY_ID table option (for more information, see MDEV-18049), which allows the user to specify the encryption key to use. Instead, Aria defaults to specific encryption keys provided by the Encryption Key Management plugin.

  • When working with user-created tables, Aria encrypts them to disk using the ID 1 key.

  • When working with internal temporary tables written to disk, Aria encrypts them to disk using the ID 2 key, unless there is no ID 2 key, then it falls back on the ID 1 key.

Key Rotation

Some allow you to automatically rotate and version your encryption keys. If a plugin support key rotation, and if it rotates the encryption keys, then InnoDB's can re-encrypt InnoDB pages that use the old key version with the new key version. However, Aria does not have a similar mechanism, which means that the tables remain encrypted with the older key version. For more information, see .

In order for key rotation to work, both the backend key management service (KMS) and the corresponding have to support key rotation. See to determine which plugins currently support key rotation.

This page is licensed: CC BY-SA / Gnu FDL

Uninstall Key Management Plugins

Once all data and logs have been decrypted, you can safely remove key management plugins, if desired. For example, if using the file key management plugin:

Comment out or remove the following lines 
plugin_load_add = file_key_management 
file_key_management_filename = /etc/mysql/encryption/keyfile

Restart the server after editing the configuration.

  • Ensure that all tables no longer report encryption in CREATE_OPTIONS.

  • Confirm that redo logs and binary logs are unencrypted by checking server variables and log headers.

  • Confirm that no key management plugin is loaded:

Aria Enabling Encryption

In order to enable data-at-rest encryption for tables using the storage engine, you first need to configure the server to use an plugin. Once this is done, you can enable encryption by setting the relevant system variables.

Encrypting User-created Tables

With tables that the user creates, you can enable encryption by setting the system variable to ON, then restart the Server. Once this is set, Aria automatically enables encryption on all tables you create after with the table option set to PAGE.

Currently, Aria does not support encryption on tables where the

key management and encryption plugins
background encryption threads
MDEV-18971
key management and encryption plugin
Encryption Key Management: Support for Key Rotation in Encryption Plugins
SHOW PLUGINS;
ROW_FORMAT
table option is set to the
FIXED
or
DYNAMIC
values.

Unlike InnoDB, Aria does not support the ENCRYPTED table option (see MDEV-18049 about that). Encryption for Aria can only be enabled globally using the aria_encrypt_tables system variable.

Encrypting Existing Tables

In cases where you have existing Aria tables that you would like to encrypt, the process is a little more complicated. Unlike InnoDB, Aria does not utilize background encryption threads to automatically perform encryption changes (see MDEV-18971 about that). Therefore, to encrypt existing tables, you need to identify each table that needs to be encrypted, and then you need to manually rebuild each table.

First, set the aria_encrypt_tables system variable to encrypt new tables.

Identify Aria tables that have the ROW_FORMAT table option set to PAGE.

For each table in the result-set, issue an ALTER TABLE statement to rebuild the table.

This statement causes Aria to rebuild the table using the ROW_FORMAT table option. In the process, with the new default setting, it encrypts the table when it writes to disk.

Encrypting Internal On-disk Temporary Tables

During the execution of queries, MariaDB routinely creates internal temporary tables. These internal temporary tables initially use the MEMORY storage engine, which is entirely stored in memory. When the table size exceeds the allocation defined by the max_heap_table_size system variable, MariaDB writes the data to disk using another storage engine. If you have the aria_used_for_temp_tables set to ON, MariaDB uses Aria in writing the internal temporary tables to disk.

Encryption for internal temporary tables is handled separately from encryption for user-created tables. To enable encryption for these tables, set the encrypt_tmp_disk_tables system variable to ON. Once set, all internal temporary tables that are written to disk using Aria are automatically encrypted.

Manually Encrypting Tables

Currently, Aria does not support manually encrypting tables through the ENCRYPTED and ENCRYPTION_KEY_ID table options. For more information, see MDEV-18049.

In cases where you want to encrypt tables manually or set the specific encryption key, use InnoDB.

This page is licensed: CC BY-SA / Gnu FDL

Aria
Encryption Key Management
aria_encrypt_tables
ROW_FORMAT
SET GLOBAL aria_encrypt_tables=ON;
SELECT TABLE_SCHEMA, TABLE_NAME 
FROM information_schema.TABLES 
WHERE ENGINE='Aria' 
  AND ROW_FORMAT='PAGE'
  AND TABLE_SCHEMA != 'information_schema';
ALTER TABLE test.aria_table ENGINE=Aria ROW_FORMAT=PAGE;

Aria Disabling Encryption

The process involved in safely disabling data-at-rest encryption for your Aria tables is very similar to that of enabling encryption. To disable, you need to set the relevant system variables and then rebuild each table into an unencrypted state.

Don't remove the Encryption Key Management plugin from your configuration file until you have unencrypted all tables in your database. MariaDB cannot read encrypted tables without the relevant encryption key.

Disabling Encryption on User-Created Tables

For user-created tables, you can disable encryption by setting the aria_encrypt_tables system variable to OFF. Once this is set, MariaDB no longer encrypts new tables created with the Aria storage engine.

Unlike , Aria does not currently use background encryption threads. Before removing the plugin from the configuration file, you need to manually rebuild each table to an unencrypted state.

To find the encrypted tables, query the Information Schema, filtering the table for those that use the Aria storage engine and the PAGE .

Each table in that result set was written to disk in an encrypted state.

To remove the encryption of those tables,

  • Set the aria_encrypt_tables variable to OFF;

  • Leave the configuration for the encryption keys in place (otherwise, you cannot decrypt tables!);

  • Run the following statement for each encrypted table.

Once all of the Aria tables are rebuilt, they're unencrypted.

Optionally, you can remove the configuration for the encryption keys now.

Disabling Encryption for Internal On-Disk Temporary Tables

MariaDB routinely creates internal temporary tables. When these temporary tables are written to disk and the system variable is set to ON, MariaDB uses the Aria storage engine.

To decrypt these tables, set the to OFF. Once set, all internal temporary tables that are created from that point on are written unencrypted to disk.

This page is licensed: CC BY-SA / Gnu FDL

Decrypt Binary Logs

This page covers how to confirm that binlogs are encrypted, recommended approaches for getting decrypted output.

When binary log encryption is enabled, the server writes binlog files to disk in encrypted form. This ensures that anyone with direct access to the filesystem cannot read the contents.

The encryption keys are managed through a keyring or key-management plugin. Whenever the server itself needs to access a binlog—such as during replication, recovery, or when tools like mysqlbinlog connect to it—the server transparently decrypts the events using the appropriate active keys.

Since the keys are stored in a server-accessible keyring, the most reliable and secure method to access decrypted binlog data is to request it directly from the running server. In other words, instead of trying to decrypt raw encrypted files offline, you should allow the server to stream already-decrypted events to you.

For more information, refer to MDEV-17271.

Approaches to decrypt binary logs

There are two common approaches depending on where you run the decryption and how keys are stored:

  1. Run mysqlbinlog on a server that already has access to the key material (recommended).

    • The server's key provider configuration (for example, a mounted key file or KMS credentials) is already present, so mysqlbinlog inherits the ability to open and decrypt logs.

    • This reduces key distribution since the keys remain on the server.

Using mysqlbinlog to decrypt

mysqlbinlog will attempt to decrypt binary logs when launched in an environment that allows it to access the same key provider configuration used by the server.

Basic example (server with key access):

If the environment is correctly configured, mysqlbinlog will read, decrypt, and write the plaintext SQL (events) to decrypted.sql.

Decrypting compressed or rotated logs

If your environment compresses or rotates binary logs outside the standard server rotation, decompress the file before passing to mysqlbinlog (or use process substitution):

Decrypt local binlog to file:

Decrypt and decode row events verbosely:

Decrypt from a compressed backup:

Decrypt InnoDB Redo Logs

When data-at-rest encryption is enabled in MariaDB Enterprise Server, InnoDB can encrypt redo logs. If you later disable encryption or need to recover data from encrypted redo logs, you may need to decrypt the redo log files before MariaDB can process them.

For more information, refer to MDEV-17270.

  1. Stop MariaDB Enterprise Server

  2. Locate the redo log files By default, InnoDB redo log files are stored in the data directory, typically as:

    or in the #innodb_redo directory for MariaDB versions using the new redo log format.

  3. Prepare configuration for decryption

    • Make sure innodb_redo_log_encrypt is set to ON (to ensure the redo logs are recognized as encrypted).

    • Ensure that the key management plugin (such as file_key_management or aws_key_management) is configured exactly as it was when the redo logs were created.

  4. Start MariaDB with decryption enabled

    • Start the server normally. MariaDB will automatically attempt to decrypt redo logs at startup using the configured key management plugin.

    • If successful, the redo logs are decrypted on-the-fly and crash recovery proceeds.

  5. Disable redo log encryption if no longer required After recovery or once you confirm that decrypted redo logs are no longer needed, you can disable redo log encryption in the configuration:

    Then restart the server. New redo logs will be created in plaintext.

Verification

You can verify the redo log encryption status with:

Example output:

Disabling Data-at-Rest Encryption for Standalone Servers

In certain situations, you may need to turn off data-at-rest encryption in a standalone or single-node MariaDB Enterprise Server deployment. For instance, you might have originally enabled encryption using a key management plugin, but later determine that encryption is no longer necessary.

This page explains how to safely disable data-at-rest encryption on a single server. The steps assume that your server already contains encrypted tables or logs, and that your goal is to revert the system to an unencrypted state without losing any data.

  • This procedure is only intended for standalone MariaDB Enterprise Server environments.

  • For replication or Galera Cluster setups, additional considerations are required and are not covered here.

  • Always back up your data before performing encryption or decryption operations.

Prerequisites

Before you can disable data-at-rest encryption in MariaDB Enterprise Server, ensure the following:

  • MariaDB Enterprise Server with Encryption Enabled The server must currently be running with data-at-rest encryption enabled.

  • Key Management Access You must have access to the same key management plugin and configuration that were originally used to encrypt the data.

  • Sufficient Disk Space Make sure adequate free disk space is available to decrypt and rewrite all affected data files.

Related Documentation

SET GLOBAL aria_encrypt_tables = OFF;
sudo systemctl stop mariadb
Data-at-Rest Encryption
Aria Table Encryption
InnoDB Table Encryption
InnoDB
Encryption Key Management
TABLES
ROW_FORMAT
ALTER TABLE
aria_used_for_temp_tables
encrypt_tmp_disk_tables

Copy encrypted binlog files to an admin workstation and decrypt locally.

  • Requires secure transfer of the encrypted binlog file(s) and the decryption key or key-access configuration to the workstation.

  • Use this only when you can ensure secure temporary storage and key handling.

Example:
SELECT TABLE_SCHEMA, TABLE_NAME
FROM information_schema.TABLES
WHERE ENGINE = 'Aria'
  AND ROW_FORMAT = 'PAGE'
  AND TABLE_SCHEMA != 'information_schema'
  AND CREATE_OPTIONS LIKE '%`encrypted`=yes%';
ALTER TABLE test.aria_table ENGINE = Aria ROW_FORMAT = PAGE;
# On the MariaDB server (or a host with access to key material)mysqlbinlog /var/lib/mysql/binlog.000012 > decrypted.sql
gzip -dc /backup/binlog.000012.gz | mysqlbinlog - > decrypted.sql
mysqlbinlog /var/lib/mysql/binlog.000012 > /tmp/binlog.000012.sql
mysqlbinlog --base64-output=DECODE-ROWS --verbose /var/lib/mysql/binlog.000012 > /tmp/binlog.decoded.sql
gzip -dc /backup/binlog.000012.gz | mysqlbinlog - > /tmp/binlog.000012.sql
ib_logfile0
ib_logfile1
sudo systemctl start mariadb
[mysqld]
innodb_redo_log_encrypt = OFF
SHOW GLOBAL VARIABLES LIKE 'innodb_redo_log_encrypt';
+------------------------+-------+
| Variable_name          | Value |
+------------------------+-------+
| innodb_redo_log_encrypt| OFF   |
+------------------------+-------+
[mysqld]
plugin_load_add = file_key_management
file_key_management_filename = /etc/mysql/encryption/keyfile.enc
file_key_management_filekey = FILE:/etc/mysql/encryption/keyfile.key
innodb_redo_log_encrypt = ON

InnoDB Encryption Overview

MariaDB supports data-at-rest encryption for tables using the InnoDB storage engines. When enabled, the server encrypts data when it writes it to and decrypts data when it reads it from the file system. You can configure InnoDB encryption to automatically have all new InnoDB tables automatically encrypted, or specify encrypt per table.

For encrypting data with the Aria storage engine, see Encrypting Data for Aria.

InnoDB Encryption and Decryption Behavior

When data-at-rest encryption is enabled for InnoDB, encryption and decryption occur at specific points during disk I/O operations.

When is InnoDB data encrypted?

When InnoDB pages are written to disk, they are automatically encrypted.

When is InnoDB data decrypted?

InnoDB pages are decrypted before they are read from disk and stored in the InnoDB buffer pool. A page remains decrypted in memory while it is in the buffer pool. As a result, decrypted memory pages may include data from rows, columns, or even tables that the current query does not directly access.

Basic Configuration

Using data-at-rest encryption requires that you first configure an plugin, such as the or plugins. MariaDB uses this plugin to store, retrieve and manage the various keys it uses when encrypting data to and decrypting data from the file system.

Once you have the plugin configured, you need to set a few additional system variables to enable encryption on InnoDB tables, including , , , and .

For more information on system variables for encryption and other features, see the InnoDB page.

Creating Encrypted Tables

To create encrypted tables, specify the table options ENCRYPTED=YES and ENCRYPTION_KEY_ID= with a corresponding key id;

Finding Encrypted Tables

When using data-at-rest encryption with the InnoDB storage engine, it is not necessary that you encrypt every table in your database. You can check which tables are encrypted and which are not by querying the table in the . This table provides information on which tablespaces are encrypted, which encryption key each tablespace is encrypted with, and whether the background encryption threads are currently working on the tablespace. Since the can also contain tables, it can be helpful to join the INNODB_TABLESPACES_ENCRYPTION table with the table to find out the encryption status of each specific table, rather than each tablespace. For example:

Redo Logs

Using data-at-rest encryption with InnoDB, the system variable only encrypts the InnoDB tablespaces. In order to also encrypt the InnoDB Redo Logs, you also need to set the system variable.

Where the encryption key management plugin supports key rotation, the InnoDB Redo Log can also rotate encryption keys. In previous releases, the Redo Log can only use the first encryption key.

See Also

This page is licensed: CC BY-SA / Gnu FDL

InnoDB Background Encryption Threads

InnoDB performs some encryption and decryption operations with background encryption threads. The innodb_encryption_threads system variable controls the number of threads that the storage engine uses for encryption-related background operations, including encrypting and decrypting pages after key rotations or configuration changes, and scrubbing data to permanently delete it.

Background Operations

InnoDB performs the following encryption and decryption operations using background encryption threads:

  • When rotating encryption keys, InnoDB's background encryption threads re-encrypt pages that use key versions older than to the new key version.

  • When changing the system variable to FORCE, InnoDB's background encryption threads encrypt the tablespace and any tablespaces that have the table option set to DEFAULT.

  • When changing the system variable to OFF, InnoDB's background encryption threads decrypt the tablespace and any tablespacs that have the ENCRYPTED table option set to DEFAULT.

The system variable can be used to configure how many I/O operations you want to allow for the operations performed by InnoDB's background encryption threads.

Whenever you change the value on the system variable, InnoDB's background encryption threads perform the necessary encryption or decryption operations. Because of this, you must have a non-zero value set for the system variable. InnoDB also considers these operations to be key rotations internally. Because of this, you must have a non-zero value set for the system variable. For more information, see .

Non-Background Operations

InnoDB performs the following encryption and decryption operations without using background encryption threads:

  • When a tablespaces and using to manually set the table option to YES, InnoDB does not use background threads to encrypt the tablespaces.

  • Similarly, when using file-per-table tablespaces and using to manually set the table option to NO, InnoDB does not use background threads to decrypt the tablespaces.

In these cases, InnoDB performs the encryption or decryption operation using the server thread for the client connection that executes the statement. This means that you can update encryption on tablespaces with an statement, even when the and/or the system variables are set to 0.

InnoDB does not permit manual encryption changes to tables in the tablespace using . Encryption of the tablespace can only be configured by setting the value of the system variable. This means that when you want to encrypt or decrypt the tablespace, you must also set a non-zero value for the system variable, and you must also set the system variable to 1 to ensure that the system tablespace is properly encrypted or decrypted by the background threads. See for more information.

Checking the Status of Background Operations

InnoDB records the status of background encryption operations in the table in the database.

For example, to see which InnoDB tablespaces are currently being decrypted or encrypted on by background encryption, you can check which InnoDB tablespaces have the ROTATING_OR_FLUSHING column set to 1:

And to see how many InnoDB tablespaces are currently being decrypted or encrypted by background encryption threads, you can call the aggregate function.

And to see how many InnoDB tablespaces are currently being decrypted or encrypted by background encryption threads, while comparing that to the total number of InnoDB tablespaces and the total number of encrypted InnoDB tablespaces, you can join the table with the table in the database:

This page is licensed: CC BY-SA / Gnu FDL

Encryption Key Management

MariaDB's data-at-rest encryption requires the use of a key management and encryption plugin. These plugins are responsible both for the management of encryption keys and for the actual encryption and decryption of data.

MariaDB supports the use of multiple encryption keys. Each encryption key uses a 32-bit integer as a key identifier. If the specific plugin supports key rotation, then encryption keys can also be rotated, which creates a new version of the encryption key.

Supported Key Management Plugins list

Plugin
Status
Key Rotation Support
Notes

Choosing an Encryption Key Management Solution

How MariaDB manages encryption keys depends on which encryption key management solution you choose. Currently, MariaDB has three options:

File Key Management Plugin

The File Key Management plugin that ships with MariaDB is a basic key management and encryption plugin that reads keys from a plain-text file. It can also serve as an example and as a starting point when developing a key management plugin.

For more information, see .

Hashicorp Key Management Plugin

Integrates MariaDB encryption with Vault for secure key management.

For more information, refer to the .

AWS Key Management Plugin

The AWS Key Management plugin is a key management and encryption plugin that uses the Amazon Web Services (AWS) Key Management Service (KMS). The AWS Key Management plugin depends on the , which uses the . The license is not compatible with MariaDB Server's , so we are not able to distribute packages that contain the AWS Key Management plugin. Therefore, the only way to currently obtain the plugin is to install it from the source.

For more information, see .

Using Multiple Encryption Keys

Key management and encryption plugins support using multiple encryption keys. Each encryption key can be defined with a different 32-bit integer as a key identifier.

The support for multiple keys opens up some potential use cases. For example, let's say that a hypothetical key management and encryption plugin is configured to provide two encryption keys. One encryption key might be intended for "low security" tables. It could use short keys, which might not be rotated, and data could be encrypted with a fast encryption algorithm. Another encryption key might be intended for "high security" tables. It could use long keys, which are rotated often, and data could be encrypted with a slower but more secure encryption algorithm. The user would specify the identifier of the key that they want to use for different tables, only using high-level security where it's needed.

There are two encryption key identifiers that have special meanings in MariaDB. An encryption key 1 is intended for encrypting system data, such as InnoDB redo logs, binary logs, and so on. It must always exist when is enabled. An encryption key 2 is intended for encrypting temporary data, such as temporary files and temporary tables. It is optional. If it doesn't exist, then MariaDB uses an encryption key 1 for these purposes instead.

When , the key that is used to encrypt tables .

When , the key that is used to encrypt tables .

Key Rotation

Encryption key rotation is optional in MariaDB Server. Key rotation is only supported if the backend key management service (KMS) supports key rotation and if the corresponding key management and encryption plugin for MariaDB also supports key rotation. When a key management and encryption plugin supports key rotation, users can opt to rotate one or more encryption keys, which creates a new version of each rotated encryption key.

Key rotation allows users to improve data security in the following ways:

  • If the server is configured to automatically re-encrypt table data with the newer version of the encryption key after the key is rotated, then that prevents an encryption key from being used for long periods of time.

  • If the server is configured to simultaneously encrypt table data with multiple versions of the encryption key after the key is rotated, then that prevents all data from being leaked if a single encryption key version is compromised.

The has that can .

The does .

Support for Key Rotation in Encryption Plugins

Encryption Plugins with Key Rotation Support

  • The supports encryption key rotation, and the corresponding also supports encryption key rotation.

  • HashiCorp Key Management Plugin: The HashiCorp Key Management Plugin integrates MariaDB with for centralized encryption key storage and lifecycle management. environments.

Encryption Plugins without Key Rotation Support

  • The does not support encryption key rotation because it does not use a backend key management service (KMS).

Encryption Plugin API

New key management and encryption plugins can be developed using the .

This page is licensed: CC BY-SA / Gnu FDL

InnoDB Encryption Troubleshooting

Wrong Create Options

With InnoDB tables using encryption, there are several cases where a or statement can throw Error 1005, due to the InnoDB error 140, Wrong create options. For instance,

When this occurs, you can usually get more information about the cause of the error by following it with a statement.

This error is known to occur in the following cases:

Encryption Key Management
file_key_management
aws_key_management
innodb_encrypt_tables
innodb_encrypt_log
innodb_encryption_threads
innodb_encrypt_temporary_tables
innodb_encryption_rotate_key_age
system variables
INNODB_TABLESPACES_ENCRYPTION
Information Schema
system tablespace
INNODB_SYS_TABLES
innodb_encrypt_tables
innodb_encrypt_log
Data at Rest Encryption
Why Encrypt MariaDB Data?
Encryption Key Management
Information Schema INNODB_TABLESPACES_ENCRYPTION table
innodb_encryption_rotate_key_age
innodb_encrypt_tables
system
file-per-table
ENCRYPTED
innodb_encrypt_tables
system
file-per-table
innodb_encryption_rotation_iops
innodb_encrypt_tables
innodb_encryption_threads
innodb_encryption_rotate_key_age
disabling key rotations
file-per-table
ALTER TABLE
ENCRYPTED
ALTER TABLE
ENCRYPTED
file-per-table
ALTER TABLE
innodb_encryption_threads
innodb_rotate_key_age
system
ALTER TABLE
system
innodb_encrypt_tables
system
innodb_encryption_threads
innodb_system_rotate_key_age
MDEV-14398
INNODB_TABLESPACES_ENCRYPTION
information_schema
COUNT()
INNODB_SYS_TABLESPACES
information_schema

Encrypting a table by setting the ENCRYPTED table option to YES when the innodb_file_per_table is set to OFF.In this case, SHOW WARNINGS would return the following:

  • Encrypting a table by setting the ENCRYPTED table option to YES, and the innodb_default_encryption_key_id system variable or the ENCRYPTION_KEY_ID table option refers to a non-existent key identifier. In this case, SHOW WARNINGS would return the following:

  • In some versions, this could happen while creating a table with the ENCRYPTED table option set to DEFAULT while the innodb_encrypt_tables system variable is set to OFF, and the innodb_default_encryption_key_id system variable or the ENCRYPTION_KEY_ID table option are not set to 1. In this case, SHOW WARNINGS would return the following:

Creating a table with the ENCRYPTED table option set to DEFAULT while the innodb_encrypt_tables system variable is set to OFF, and the innodb_default_encryption_key_id system variable or the ENCRYPTION_KEY_ID table option are not set to 1 no longer fail, and it no longer throws a warning.

For more information, see MDEV-18601.

Setting Encryption Key ID For an Unencrypted Table

If you set the ENCRYPTION_KEY_ID table option for a table that is unencrypted because the innodb_encrypt_tables system variable is set to OFF and the ENCRYPTED table option set to DEFAULT, then this encryption key ID will be saved in the table's .frm file, but the encryption key will not be saved to the table's .ibd file.

As a side effect, with the current encryption design, if the innodb_encrypt_tables system variable is later set to ON, and InnoDB goes to encrypt the table, then the InnoDB background encryption threads will not read this encryption key ID from the .frm file. Instead, the threads may encrypt the table with the encryption key with ID 1, which is internally considered the default encryption key when no key is specified. For example:

A similar problem is that, if you set the ENCRYPTION_KEY_ID table option for a table that is unencrypted because the ENCRYPTED table option is set to NO, then this encryption key ID will be saved in the table's .frm file, but the encryption key will not be saved to the table's .ibd file.

Recent versions of MariaDB will throw warnings in the case where the ENCRYPTED table option is set to NO, but they will allow the operation to succeed. For example:

However, in this case, if you change the ENCRYPTED table option to YES or DEFAULT with ALTER TABLE, then it will actually use the proper key. For example:

For more information, see MDEV-17230, MDEV-18601, and MDEV-19086.

Tablespaces Created on MySQL 5.1.47 or Earlier

MariaDB's data-at-rest encryption implementation re-used previously unused fields in InnoDB's buffer pool pages to identify the encryption key version and the post-encryption checksum. Prior to MySQL 5.1.48, these unused fields were not initialized in memory due to performance concerns. These fields still had zero values most of the time, but since they were not explicitly initialized, that means that these fields could have occasionally had non-zero values that could have been written into InnoDB's tablespace files. If MariaDB were to encounter an unencrypted page from a tablespace file that was created on an early version of MySQL that also had non-zero values in these fields, then it would mistakenly think that the page was encrypted.

The fix for MDEV-12112 changed the way that MariaDB distinguishes between encrypted and unencrypted pages, so that it is less likely to mistake an unencrypted page for an encrypted page.

If innodb_checksum_algorithm is set to full_crc32 or strict_full_crc32, and if the table does not use ROW_FORMAT=COMPRESSED, then data files are guaranteed to be zero-initialized.

For more information, see MDEV-18097.

Spatial Indexes

Support for encrypting spatial indexes. To enable, set the innodb_checksum_algorithm to full_crc32 or to strict_full_crc32. Note that MariaDB only encrypts spatial indexes when the ROW_FORMAT table option is not set to COMPRESSED.

For more information, see MDEV-12026.

This page is licensed: CC BY-SA / Gnu FDL

CREATE TABLE
ALTER TABLE
SHOW WARNINGS
[mariadb]
...

# File Key Management
plugin_load_add = file_key_management
file_key_management_filename = /etc/mysql/encryption/keyfile.enc
file_key_management_filekey = FILE:/etc/mysql/encryption/keyfile.key
file_key_management_encryption_algorithm = AES_CTR

# InnoDB Encryption
innodb_encrypt_tables = ON
innodb_encrypt_temporary_tables = ON
innodb_encrypt_log = ON
innodb_encryption_threads = 4
innodb_encryption_rotate_key_age = 1
CREATE TABLE t (i INT PRIMARY KEY) ENGINE=InnoDB ENCRYPTED=YES ENCRYPTION_KEY_ID=2;
SELECT st.SPACE, st.NAME, te.ENCRYPTION_SCHEME, te.ROTATING_OR_FLUSHING
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION te
JOIN information_schema.INNODB_SYS_TABLES st
   ON te.SPACE = st.SPACE \G
*************************** 1. row ***************************
               SPACE: 0
                NAME: SYS_DATAFILES
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 2. row ***************************
               SPACE: 0
                NAME: SYS_FOREIGN
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 3. row ***************************
               SPACE: 0
                NAME: SYS_FOREIGN_COLS
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 4. row ***************************
               SPACE: 0
                NAME: SYS_TABLESPACES
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 5. row ***************************
               SPACE: 0
                NAME: SYS_VIRTUAL
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 6. row ***************************
               SPACE: 0
                NAME: db1/default_encrypted_tab1
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 7. row ***************************
               SPACE: 416
                NAME: db1/default_encrypted_tab2
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 8. row ***************************
               SPACE: 402
                NAME: db1/tab
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 9. row ***************************
               SPACE: 185
                NAME: db1/tab1
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 10. row ***************************
               SPACE: 184
                NAME: db1/tab2
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 11. row ***************************
               SPACE: 414
                NAME: db1/testgb2
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 12. row ***************************
               SPACE: 4
                NAME: mysql/gtid_slave_pos
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 13. row ***************************
               SPACE: 2
                NAME: mysql/innodb_index_stats
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 14. row ***************************
               SPACE: 1
                NAME: mysql/innodb_table_stats
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
*************************** 15. row ***************************
               SPACE: 3
                NAME: mysql/transaction_registry
   ENCRYPTION_SCHEME: 1
ROTATING_OR_FLUSHING: 0
15 rows in set (0.000 sec)
SELECT SPACE, NAME
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE ROTATING_OR_FLUSHING = 1;
SELECT COUNT(*) AS 'encrypting' 
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE ROTATING_OR_FLUSHING = 1;
/* information_schema.INNODB_TABLESPACES_ENCRYPTION does not always have rows for all tablespaces,
  so let's join it with information_schema.INNODB_SYS_TABLESPACES */
WITH tablespace_ids AS (
   SELECT SPACE
   FROM information_schema.INNODB_SYS_TABLESPACES ist
   UNION
   /* information_schema.INNODB_SYS_TABLESPACES doesn't have a row for the system tablespace (MDEV-20802) */
   SELECT 0 AS SPACE
)
SELECT NOW() AS 'time', 
   'tablespaces', COUNT(*) AS 'tablespaces', 
   'encrypted', SUM(IF(ite.ENCRYPTION_SCHEME IS NOT NULL, ite.ENCRYPTION_SCHEME, 0)) AS 'encrypted', 
   'encrypting', SUM(IF(ite.ROTATING_OR_FLUSHING IS NOT NULL, ite.ROTATING_OR_FLUSHING, 0)) AS 'encrypting'
FROM tablespace_ids
LEFT JOIN information_schema.INNODB_TABLESPACES_ENCRYPTION ite
   ON tablespace_ids.SPACE = ite.SPACE
CREATE TABLE `test`.`table1` ( `id` INT(4) PRIMARY KEY , `name` VARCHAR(50));
ERROR 1005 (HY000): Can't create table `test`.`table1` (errno: 140 "Wrong create options")
SHOW WARNINGS;
+---------+------+---------------------------------------------------------------------+
| Level   | Code | Message                                                             |
+---------+------+---------------------------------------------------------------------+
| Warning |  140 | InnoDB: ENCRYPTED requires innodb_file_per_table                    |
| Error   | 1005 | Can't create table `db1`.`tab3` (errno: 140 "Wrong create options") |
| Warning | 1030 | Got error 140 "Wrong create options" from storage engine InnoDB     |
+---------+------+---------------------------------------------------------------------+
3 rows in set (0.00 sec)
SHOW WARNINGS;
+---------+------+---------------------------------------------------------------------+
| Level   | Code | Message                                                             |
+---------+------+---------------------------------------------------------------------+
| Warning |  140 | InnoDB: ENCRYPTION_KEY_ID 500 not available                         |
| Error   | 1005 | Can't create table `db1`.`tab3` (errno: 140 "Wrong create options") |
| Warning | 1030 | Got error 140 "Wrong create options" from storage engine InnoDB     |
+---------+------+---------------------------------------------------------------------+
3 rows in set (0.00 sec)
SHOW WARNINGS;
+---------+------+---------------------------------------------------------------------+
| Level   | Code | Message                                                             |
+---------+------+---------------------------------------------------------------------+
| Warning |  140 | InnoDB: innodb_encrypt_tables=OFF only allows ENCRYPTION_KEY_ID=1   |
| Error   | 1005 | Can't create table `db1`.`tab3` (errno: 140 "Wrong create options") |
| Warning | 1030 | Got error 140 "Wrong create options" from storage engine InnoDB     |
+---------+------+---------------------------------------------------------------------+
3 rows in set (0.00 sec)
SET GLOBAL innodb_encrypt_tables=OFF;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTION_KEY_ID=100;

SET GLOBAL innodb_encrypt_tables=ON;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |              1 |
+----------+-------------------+----------------+
CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=NO ENCRYPTION_KEY_ID=100;
Query OK, 0 rows affected, 1 warning (0.01 sec)

SHOW WARNINGS;
+---------+------+--------------------------------------------------+
| Level   | Code | Message                                          |
+---------+------+--------------------------------------------------+
| Warning |  140 | InnoDB: ENCRYPTED=NO implies ENCRYPTION_KEY_ID=1 |
+---------+------+--------------------------------------------------+
1 row in set (0.00 sec)
SET GLOBAL innodb_encrypt_tables=ON;

ALTER TABLE tab1 ENCRYPTED=DEFAULT;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME = 'db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+

File-based key management

Supported

Supported from MariaDB Enterprise Server 11.8

Simple but lacks rotation

HashiCorp Vault plugin

Supported, Recommended

Yes

Best for secure, scalable deployments

File Key Management Plugin
Hashicorp Key Management Plugin
AWS SDK for C++
Apache License, Version 2.0
AWS Key Management Plugin
data-at-rest encryption
encrypting InnoDB tables
can be changed
encrypting Aria tables
cannot currently be changed
InnoDB storage engine
background encryption threads
automatically re-encrypt pages when key rotations occur
Aria storage engine
not currently have a similar mechanism to re-encrypt pages in the background when key rotations occur
AWS Key Management Service (KMS)
AWS Key Management Plugin
Hashicorp Key Management Plugin
File Key Management Plugin

InnoDB Encryption Keys

InnoDB uses encryption key management plugins to support the use of multiple encryption keys.

Encryption Keys

Each encryption key has a 32-bit integer that serves as a key identifier.

The default key is set using the innodb_default_encryption_key_id system variable.

Encryption keys can also be specified with the ENCRYPTION_KEY_ID table option for tables that use file-per-table tablespaces.

InnoDB encrypts the temporary tablespace using the encryption key with the ID 1.

InnoDB encrypts the using the encryption key with the ID 1.

Keys with Manually Encrypted Tablespaces

With tables that use enabled encryption, one way to set the specific encryption key for the table is to use the table option. For example:

If the table option is not set for a table that uses enabled encryption, then it will inherit the value from the system variable. For example:

Keys with Automatically Encrypted Tablespaces

With tables that use enabled encryption, one way to set the specific encryption key for the table is to use the system variable. For example:

InnoDB tables that are part of the tablespace can only be encrypted using the encryption key set by the system variable.

If the table is in a tablespace, and if is set to ON or FORCE, and if is set to a value greater than 0, then you can also set the specific encryption key for the table by using the table option. For example:

However, if is set to OFF or if is set to 0, then this will not work. See for more information.

Key Rotation

Some allow you to automatically rotate and version your encryption keys. If a plugin support key rotation, and if it rotates the encryption keys, then InnoDB's can re-encrypt InnoDB pages that use the old key version with the new key version.

You can set the maximum age for an encryption key using the system variable. When this variable is set to a non-zero value, background encryption threads constantly check pages to determine if any page is encrypted with a key version that's too old. When the key version is too old, any page encrypted with the older version of the key is automatically re-encrypted in the background to use a more current version of the key. Bear in mind, this constant checking can sometimes result in high CPU usage.

Key rotation for the InnoDB is only supported in and later. For more information, see .

In order for key rotation to work, both the backend key management service (KMS) and the corresponding have to support key rotation. See to determine which plugins currently support key rotation.

Disabling Background Key Rotation Operations

In the event that you encounter issues with background key encryption, you can disable it by setting the system variable to 0. You may find this useful when the constant key version checks lead to excessive CPU usage. It's also useful in cases where your encryption key management plugin does not support key rotation, (such as with the plugin). For more information, see .

There are, however, issues that can arise when the background key rotation is disabled.

Pending Encryption Operations

When updating the value on the system variable, InnoDB internally treats the subsequent to encrypt and decrypt tablespaces as background key rotations. See for more information.

You can check the status of background encryption operations by querying the table in the database.

See for some example queries.

For more information, see .

This page is licensed: CC BY-SA / Gnu FDL

Hashicorp Key Management Plugin

Key Rotation and Cache Flushing

As of MariaDB 12.3, you can manually rotate keys and flush the cache without restarting the server. See Key Rotation and Cache Flushing for details.

The Hashicorp Key Management Pugin is used to implement encryption using keys stored in the Hashicorp Vault KMS. For more information, see Hashicorp Vault and MariaDB, and for how to install Vault, see Install Vault, as well as MySQL/MariaDB Database Secrets Engine.

The current version of this plugin implements the following features:

  • Authentication is done using the Hashicorp Vault's token authentication method.

  • If additional client authentication is required, then the path to the CA authentication bundle file may be passed as a plugin parameter;

  • The creation of the keys and their management is carried out using the Hashicorp Vault KMS and their tools.

  • The plugin uses libcurl (https) as an interface to the HashiCorp Vault server;

  • JSON parsing is performed through the JSON service (through the include/mysql/service_json.h);

  • HashiCorp Vault 1.2.4 was used for development and testing.

  • As of MariaDB 10.6.24, the plugin is configured to use cached keys for all communication errors, not just for timeouts. This ensures continuous operation when the Vault server is temporarily unreachable.

  • As of MariaDB 10.6.24, the default setting for cache usage on error is ON.

Since we require support for key versioning, the key-value storage must be configured in Hashicorp Vault as a key-value storage that uses the interface of the second version. For example, you can create it as follows:

Key names must correspond to their numerical identifiers. Key identifiers itself, their possible values and rules of use are described in more detail in the MariaDB main documentation.

From the point of view of the key-value storage (in terms of Hashicorp Vault), the key is a secret containing one key-value pair with the name "data" and a value representing a binary string containing the key value, for example:

Keys values are strings containing binary data. MariaDB currently uses the AES algorithm with 256-bit keys as the default encryption method. In this case, the keys that will be stored in the Hashicorp Vault should be 32-byte strings. Most likely you will use some utilities for creating and administering keys designed to work with Hashicorp Vault. But in the simplest case, keys can be created from the command line through the vault utility, for example, as follows:

If you use default encryption (AES), you should ensure that the key length is 32 bytes, otherwise it may fail to use InnoDB as a data storage.

The plugin currently does not unseal Hashicorp Vault on its own, you must do this in advance and on your own.

To use Hashicorp Vault KMS, the plugin must be preloaded and activated on the server. Most of its parameters should not be changed during plugin operation and therefore must be preconfigured as part of the server configuration through configuration file or command line options:

Options

The plugin supports the following parameters, which must be set in advance and cannot be changed during server operation:

hashicorp-key-management-vault-url

  • Description: HTTP[s] URL that is used to connect to the Hashicorp Vault server. It must include the name of the scheme (https:// for a secure connection) and, according to the API rules for storages of the key-value type in Hashicorp Vault, after the server address, the path must begin with the "/v1/" string (as prefix), for example: https://127.0.0.1:8200/v1/my_secrets. By default, the path is not set, therefore you must replace with the correct path to your secrets.

  • Command line: --[loose-]hashicorp-key-management-vault-url="<url>"

hashicorp-key-management-token

  • Description: Authentication token that passed to the Hashicorp Vault in the request header. By default, this parameter contains an empty string, so you must specify the correct value for it, otherwise the Hashicorp Vault server will refuse authorization. Alternatively, you can define an environment variable VAULT_TOKEN and store the token there.

  • Command line: --[loose-]hashicorp-key-management-token="<token>"

hashicorp-key-management-vault-ca

  • Description: Path to the Certificate Authority (CA) bundle (is a file that contains root and intermediate certificates). By default, this parameter contains an empty string, which means no CA bundle.

  • Command line: --[loose-]hashicorp-key-management-vault-ca="<path>"

hashicorp-key-management-timeout

  • Description: Set the duration (in seconds) for the Hashicorp Vault server connection timeout. The default value is 15 seconds. The allowed range is from 1 to 86400 seconds. The user can also specify a zero value, which means the default timeout value set by the libcurl library (currently 300 seconds).

  • Command line: --[loose-]hashicorp-key-management-timeout=<timeout>

hashicorp-key-management-max-retries

  • Description: Number of server request retries in case of timeout. Default is three retries.

  • Command line: ----[loose-]hashicorp-key-management-max-retries=<retries>

hashicorp-key-management-caching-enabled

  • Description: Enable key caching (storing key values received from the Hashicorp Vault server in the local memory). By default caching is enabled.

  • Command line: --[loose-]hashicorp-key-management-caching-enabled="on"|"off"

hashicorp-key-management-use-cache-on-timeout

  • Description: This parameter instructs the plugin to use the key values or version numbers taken from the cache in the event of a timeout when accessing the vault server. By default this option is disabled. Please note that key values or version numbers will be read from the cache when the timeout expires only after the number of attempts to read them from the storage server that specified by the parameter has been exhausted.

  • Command line: --[loose-]hashicorp-key-management-use-cache-on-timeout="on"|"off"

hashicorp-key-management-cache-timeout

  • Description: The time (in milliseconds) after which the value of the key stored in the cache becomes invalid and an attempt to read this data causes a new request send to the vault server. By default, cache entries become invalid after 60,000 milliseconds (after one minute). If the value of this parameter is zero, then the keys will always be considered invalid, but they still can be used if the vault server is unavailable and the corresponding cache operating mode (--[loose-]hashicorp-key-management-use-cache-on-timeout="on") is enabled.

  • As of MariaDB 10.6.24, the default value is 1 year (specified in milliseconds).

  • Command line: --[loose-]hashicorp-key-management-cache-timeout=<timeout>

hashicorp-key-management-cache-version-timeout

  • Description: The time (in milliseconds) after which the information about latest version number of the key (which stored in the cache) becomes invalid and an attempt to read this information causes a new request send to the vault server. If the value of this parameter is zero, then information about latest key version numbers always considered invalid, unless there is no communication with the vault server and use of the cache is allowed when the server is unavailable. By default, this parameter is zero, that is, the latest version numbers for the keys stored in the cache are considered always invalid, except when the vault server is unavailable and use of the cache is allowed on server failures.

  • Command line: --[loose-]hashicorp-key-management-cache-version-timeout=<timeout>

hashicorp-key-management-check-kv-version

  • Description: This parameter enables ("on", this is the default value) or disables ("off") checking the kv storage version during plugin initialization. The plugin requires storage to be version 2 or older in order for it to work properly.

  • Command line: --[loose-]hashicorp-key-management-check-kv-version="on"|"off"

Key Rotation and Cache Flushing

Available as of MariaDB 12.3

The HashiCorp Key Management plugin supports key versioning provided by the HashiCorp Vault Server. In previous versions, rotating keys required a server restart to clear the internal cache. As of MariaDB 12.3, you can flush the plugin cache manually while the server is running.

Flushing the Cache

To rotate keys, you must flush the cached keys using the FLUSH command. This clears the local cache, forcing the server to re-fetch the latest key versions from the HashiCorp Vault server upon the next access.

Executing this command requires the RELOAD privilege.

Verifying Key Versions

To view the current Key IDs and Key Versions stored in the latest version cache, you can query the Information Schema table or use the SHOW command.

See for table details.

Using the SHOW command:

See Also

This page is licensed: CC BY-SA / Gnu FDL

--[loose-]hashicorp-key-management-max-retries
Information Schema HASHICORP_KEY_MANAGEMENT_CACHE
HashiCorp Vault and MariaDB
~$ vault secrets enable -path /test -version=2 kv
~$ vault kv get /test/1

====== Metadata ======
Key              Value
---              -----
created_time     2019-12-14T14:19:19.42432951Z
deletion_time    n/a
destroyed        false
version          1

==== Data ====
Key     Value
---     -----
data    0123456789ABCDEF0123456789ABCDEF
~$ vault kv put /test/1 data="0123456789ABCDEF0123456789ABCDEF"
--plugin-load-add=hashicorp_key_management.so
--loose-hashicorp-key-management
--loose-hashicorp-key-management-vault-url="$VAULT_ADDR/v1/test"
--loose-hashicorp-key-management-token="$VAULT_TOKEN"
FLUSH HASHICORP_KEY_MANAGEMENT_CACHE;
SHOW HASHICORP_KEY_MANAGEMENT_CACHE;
Redo Log
manually
ENCRYPTION_KEY_ID
ENCRYPTION_KEY_ID
manually
innodb_default_encryption_key_id
automatically
innodb_default_encryption_key_id
system
innodb_default_encryption_key_id
file-per-table
innodb_encrypt_tables
innodb_encryption_threads
ENCRYPTION_KEY_ID
innodb_encrypt_tables
innodb_encryption_threads
InnoDB Encryption Troubleshooting: Setting Encryption Key ID For an Unencrypted Table
key management and encryption plugins
background encryption threads
innodb_encryption_rotate_key_age
Redo Log
MDEV-12041
key management and encryption plugin
Encryption Key Management: Support for Key Rotation in Encryption Plugins
innodb_encryption_rotate_key_age
file_key_management
MDEV-14180
innodb_encrypt_tables
background operations
MDEV-14398
INNODB_TABLESPACES_ENCRYPTION
information_schema
InnoDB Background Encryption Threads: Checking the Status of Background Operations
MDEV-14398
CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=YES ENCRYPTION_KEY_ID=100;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
SET SESSION innodb_default_encryption_key_id=100;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=YES;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
SET GLOBAL innodb_encryption_threads=4;

SET GLOBAL innodb_encrypt_tables=ON;

SET SESSION innodb_default_encryption_key_id=100;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
);

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
SET GLOBAL innodb_encryption_threads=4;

SET GLOBAL innodb_encrypt_tables=ON;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTION_KEY_ID=100;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
    -> FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
    -> WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+

Enabling InnoDB Encryption

In order to enable data-at-rest encryption for tables using the InnoDB storage engines, you first need to configure the Server to use an Encryption Key Management plugin. Once this is done, you can enable encryption by setting the innodb_encrypt_tables system variable to encrypt the InnoDB system and file tablespaces and setting the innodb_encrypt_log system variable to encrypt the InnoDB Redo Log.

Setting these system variables enables the encryption feature for InnoDB tables on your server. To use the feature, you need to use the ENCRYPTION_KEY_ID table option to set what encryption key you want to use and set the ENCRYPTED table option to enable encryption.

When encrypting any InnoDB tables, the best practice is also enable encryption for the Redo Log. If you have encrypted InnoDB tables and have not encrypted the Redo Log, data written to an encrypted table may be found unencrypted in the Redo Log.

Enabling Encryption for Automatically Encrypted Tablespaces

The system variable controls the configuration of automatic encryption of InnoDB tables. It has the following possible values:

Option
Description

When is set to ON, InnoDB tables are automatically encrypted by default. For example, the following statements create an encrypted table and confirm that it is encrypted:

When is set to ON, an unencrypted InnoDB table can be created by setting the table option to NO for the table. For example, the following statements create an unencrypted table and confirm that it is not encrypted:

When is set to FORCE, InnoDB tables are automatically encrypted by default, and unencrypted InnoDB tables can not be created. In this scenario, if you set the table option to NO for a table, then you will encounter an error. For example:

When is set to ON or FORCE, then you must ensure that is set to a non-zero value, so that InnoDB can perform any necessary encryption operations in the background. See for more information about that. must also be set to a non-zero value for the initial encryption operations to happen in the background. See for more information about that.

Enabling Encryption for Manually Encrypted Tablespaces

If you do not want to automatically encrypt every InnoDB table, then it is possible to manually enable encryption for just the subset of InnoDB tables that you would like to encrypt. MariaDB provides the and table options that can be used to manually enable encryption for specific InnoDB tables. These table options can be used with and statements. These table options can only be used with InnoDB tables that have their own , meaning that tables that were created with set.

Table Option
Value
Description

You can manually enable or disable encryption for a table by using the table option. If you only need to protect a subset of InnoDB tables with encryption, then it can be a good idea to manually encrypt each table that needs the extra protection, rather than encrypting all InnoDB tables globally with . This allows you to balance security with speed, as it means the encryption and decryption performance overhead only applies to those tables that require the additional security.

If a manually encrypted InnoDB table contains a , then the internal table for the full-text index will not also be manually encrypted. To encrypt internal tables for InnoDB full-text indexes, you must by setting to ON or FORCE.

You can also manually specify a for a table by using the table option. This allows you to use different encryption keys for different tables. For example, you might create a table using a statement like this:

If the table option is not specified, then the table will be encrypted with the key identified by the system variable. For example, you might create a table using a statement like this:

In the event that you have an existing table and you want to manually enable encryption for that table, then you can do the same with an statement. For example:

InnoDB does not permit manual encryption changes to tables in the tablespace using . Encryption of the tablespace can only be configured by setting the value of the system variable. This means that when you want to encrypt or decrypt the tablespace, you must also set a non-zero value for the system variable, and you must also set the system variable to 1 to ensure that the system tablespace is properly encrypted or decrypted by the background threads. See for more information.

Enabling Encryption for Temporary Tablespaces

The system variable controls the configuration of encryption for the . It has the following possible values:

Option
Description

This system variable can be specified as a command-line argument to or it can be specified in a relevant server in an . For example:

Enabling Encryption for the Redo Log

InnoDB uses the in crash recovery. By default, these events are written to file in an unencrypted state. In configuring MariaDB for data-at-rest encryption, ensure that you also enable encryption for the Redo Log.

To encrypt the Redo Log, first the server process. Then, set the to ON in a relevant server in an . For example:

Then, start MariaDB. When the server starts back up, it checks to recover InnoDB in the event of a crash. Once it is back online, it begins writing encrypted data to the Redo Log.

Key rotation for the Redo Log is supported. See for more information.

See Also

This page is licensed: CC BY-SA / Gnu FDL

Amazon Web Services (AWS) Key Management Service (KMS) Encryption Plugin Setup Guide

Overview

MariaDB contains a robust, full instance, at-rest encryption. This feature uses a flexible plugin interface to allow actual encryption to be done using a key management approach that meets the customer's needs. MariaDB Server includes a plugin that uses the Amazon Web Services (AWS) Key Management Service (KMS) to facilitate separation of responsibilities and remote logging & auditing of key access requests.

Rather than storing the encryption key in a local file, this plugin keeps the master key in AWS KMS. When you first start MariaDB, the AWS KMS plugin will connect to the AWS Key Management Service and ask it to generate a new key. MariaDB will store that key on-disk in an encrypted form. The key stored on-disk cannot be used to decrypt the data; rather, on each startup, MariaDB connects to AWS KMS and has the service decrypt the locally-stored key(s). The decrypted key is stored in-memory as long as the MariaDB server process is running, and that in-memory decrypted key is used to encrypt the local data.

This guide is based on CentOS 7, using systemd with SELinux enabled. Some steps will differ if you use other operating systems or configurations.

OFF

Disables table encryption.

ON

Enables table encryption, but allows unencrypted tables to be created.

FORCE

Enables table encryption, and doesn't allow unencrypted tables to be created.

ENCRYPTED

YES / NO / DEFAULT

Defines whether or not to encrypt the table. DEFAULT means that the decision is based on the global innodb_encrypt_tables setting.

ENCRYPTION_KEY_ID

32-bit integer

Defines the identifier for the encryption key to use

OFF

Disables temporary table encryption.

ON

Enables temporary table encryption.

innodb_encrypt_tables
innodb_encrypt_tables
innodb_encrypt_tables
ENCRYPTED
innodb_encrypt_tables
ENCRYPTED
innodb_encrypt_tables
innodb_encryption_threads
background operations
innodb_encryption_rotate_key_age
disabling key rotations
ENCRYPTED
ENCRYPTION_KEY_ID
CREATE TABLE
ALTER TABLE
InnoDB's file-per-table tablespaces
innodb_file_per_table=ON
ENCRYPTED
innodb_encrypt_tables
FULLTEXT INDEX
enable automatic InnoDB encryption
innodb_encrypt_tables
encryption key
ENCRYPTION_KEY_ID
ENCRYPTION_KEY_ID
innodb_default_encryption_key_id
ALTER TABLE
system
ALTER TABLE
system
innodb_encrypt_tables
system
innodb_encryption_threads
innodb_system_rotate_key_age
MDEV-14398
innodb_encrypt_temporary_tables
temporary tablespace
mysqld
option group
option file
Redo Log
stop
innodb_encrypt_log
option group
option file
InnoDB Encryption Keys: Key Rotation
Disabling InnoDB encryption
SET GLOBAL innodb_encryption_threads=4;

SET GLOBAL innodb_encrypt_tables=ON;

SET SESSION innodb_default_encryption_key_id=100;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
);

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
SET GLOBAL innodb_encryption_threads=4;

SET GLOBAL innodb_encrypt_tables=ON;

SET SESSION innodb_default_encryption_key_id=100;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=NO;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 0 |            100 |
+----------+-------------------+----------------+
SET GLOBAL innodb_encryption_threads=4;

SET GLOBAL innodb_encrypt_tables='FORCE';

SET SESSION innodb_default_encryption_key_id=100;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=NO;
ERROR 1005 (HY000): Can't create table `db1`.`tab1` (errno: 140 "Wrong create options")

SHOW WARNINGS;
+---------+------+----------------------------------------------------------------------+
| Level   | Code | Message                                                              |
+---------+------+----------------------------------------------------------------------+
| Warning |  140 | InnoDB: ENCRYPTED=NO implies ENCRYPTION_KEY_ID=1                     |
| Warning |  140 | InnoDB: ENCRYPTED=NO cannot be used with innodb_encrypt_tables=FORCE |
| Error   | 1005 | Can't create table `db1`.`tab1` (errno: 140 "Wrong create options")  |
| Warning | 1030 | Got error 140 "Wrong create options" from storage engine InnoDB      |
+---------+------+----------------------------------------------------------------------+
4 rows in set (0.00 sec)
CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=YES ENCRYPTION_KEY_ID=100;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
SET SESSION innodb_default_encryption_key_id=100;

CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=YES;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
CREATE TABLE tab1 (
   id INT PRIMARY KEY,
   str VARCHAR(50)
) ENCRYPTED=NO;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 0 |            100 |
+----------+-------------------+----------------+

ALTER TABLE tab1
   ENCRYPTED=YES ENCRYPTION_KEY_ID=100;

SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
WHERE NAME='db1/tab1';
+----------+-------------------+----------------+
| NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
+----------+-------------------+----------------+
| db1/tab1 |                 1 |            100 |
+----------+-------------------+----------------+
[mariadb]
...
innodb_encrypt_temporary_tables=ON
[mariadb]
...
innodb_encrypt_log = ON

Installing the Plugin's Package

The AWS Key Management plugin depends on the AWS SDK for C++, which uses the Apache License, Version 2.0. This license is not compatible with MariaDB Server's GPL 2.0 license, so we are not able to distribute packages that contain the AWS Key Management plugin. Therefore, the only way to currently obtain the plugin is to install it from source.

Installing from Source

When compiling MariaDB from source, the AWS Key Management plugin is built by default on systems that support it.

Compilation is controlled by the -DPLUGIN_AWS_KEY_MANAGEMENT=DYNAMIC -DAWS_SDK_EXTERNAL_PROJECT=1 cmake arguments.

The plugin uses AWS C++ SDK, which introduces the following restrictions:

  • The plugin can only be built on Windows, Linux, and macOS.

  • The plugin requires that one of the following compilers is used: gcc 4.8 or later, clang 3.3 or later, or Visual Studio 2013 or later.

  • On Unix, the libcurl development package (e.g., libcurl3-dev on Debian Jessie), the uuid development package, and openssl need to be installed.

  • You may need to use a newer version of than is provided by default in your OS.

Installing the Plugin

Even after the package that contains the plugin's shared library is installed on the operating system, the plugin is not actually installed by MariaDB by default. There are two methods that can be used to install the plugin with MariaDB.

The first method can be used to install the plugin without restarting the server. You can install the plugin dynamically by executing INSTALL SONAME or INSTALL PLUGIN. For example:

The second method can be used to tell the server to load the plugin when it starts up. The plugin can be installed this way by providing the --plugin-load or the --plugin-load-add options. This can be specified as a command-line argument to mysqld, or it can be specified in a relevant server option group in an option file. For example:

Sign up for Amazon Web Services

If you already have an AWS account, you can skip this section.

  1. Load.

  2. Click "Create a Free Account" and complete the steps.

  3. You'll need to enter credit card information. Charges related only to your use of the AWS KMS service should be limited to about $1/month for the single master key we will create. If you use other services, additional charges may apply. Consult AWS Cloud Pricing Principles for more information about the pricing of AWS services.

  4. You'll need to complete the AWS identity verification process.

Create an IAM User and/or Role

After creating an account or logging in to an existing account, follow these steps to create an IAM User or Role with restricted privileges that will use (but not administer) your master encryption key.

If you intend to run MariaDB Server on an EC2 instance, you should create a Role (or modify an existing Role already attached to your instance). If you intend to run MariaDB Server outside of AWS, you may want to create a User.

Creating an IAM Role

  1. Load the Identity and Access Management Console at.

  2. Click "Roles" in the left-hand sidebar

  3. Click "Create new role"

  4. Select "AWS Service Role"

  5. Click the "Select" button next to "Amazon EC2 / Allows EC2 instances to call AWS services on your behalf."

  6. Do not select any policies on the "Attach Policy" screen. Click "Next Step"

  7. Click "Next Step"

  8. Give your Role a "Role name"

  9. Click "Create role"

Creating an IAM User

  1. Load the Identity and Access Management Console at.

  2. Click "Users" in the left-hand sidebar.

  3. Click the "Create New Users" button

  4. Enter a single User Name of your choosing. We'll use "MDBEnc" for this demonstration. Keep the "Generate an access key for each user" box checked.

  5. Click "Create".

  6. Click "Show User Security Credentials".

  7. Copy the Access Key ID and Secret Access Key. Optionally, you can click "Download Credentials". We will need these in order for local programs to interact with AWS using its API.

  8. Create a file on your computer to hold the credentials for this user. We'll use this file later. It should have this structure:

  1. Click "Close". If prompted because you did not Download Credentials, ensure that you've saved them somewhere, and click "Close".

Create a Master Encryption Key

Now, we'll create a master encryption key. This key can never be retrieved by any application or user. This key is used remotely to encrypt (and decrypt) the actual encryption keys that will be used by MariaDB. If this key is deleted or you lose access to it, you will be unable to use the contents of your MariaDB data directory.

  1. Click "Encryption Keys" in the left-hand sidebar.

  2. Click the "Get Started Now" button.

  3. Use the "Filter" dropdown to choose the region where you'd like to create your master key.

  4. Click the "Create Key" button.

  5. Enter an Alias and Description of your choosing.

  6. Click "Next Step".

  7. Do not check the box to make your IAM Role or IAM User a Key Administrator.

  8. Click "Next Step" again.

  9. Check the boxes to give your IAM Role and/or IAM User permissions to use this key.

  10. Click "Next Step".

  11. Click "Finish".

You should now see your key listed in the console:

You'll use the "Alias" you provided when you configure MariaDB later.

We now have a Customer Master Key and an IAM user that has privileges to access it using access credentials. This is enough to begin using the AWS KMS plugin.

Configure AWS Credentials

There are a number of ways to give the IAM credentials to the AWS KMS plugin. The plugin supports reading credentials from all standard locations used across the various AWS API clients.

The easiest approach is to run MariaDB Server in an EC2 instance that has an IAM Role with User access to the CMK you wish to use. You can give key access privileges to a Role already attached to your EC2 instance, or you can create a new IAM Role and attach it to an already-running EC2 instance. If you've done that, no further credentials management is required, and you do not need to create a credentials file.

If you're not running MariaDB Server on an EC2 instance, you can also place the credentials in the MariaDB data directory. The AWS API client looks for a credentials file in the .aws subdirectory of the home directory of the user running the client process. In the case of MariaDB, its home directory is its datadir.

  1. Create a credentials file that MariaDB can read. Use the region you selected when creating the key. Master keys cannot be used across regions. For example:

  1. Change the permissions of the file so that it is owned by, and can only be read by, the mysql user:

Configure MariaDB

  1. Create a new option file to tell MariaDB to enable encryption functionality and to use the AWS KMS plugin. Create a new file under /etc/my.cnf.d/ (or wherever your OS may have you create such files) with contents like this:

  1. Append the "Alias" value you copied above to alias/ to use as the value for the aws-key-management-master-key-id option.

Note that you must include aws-key-management-region in your .cnf file if you are not using the us-east-1 region.

Now, you have told MariaDB to use the AWS KMS plugin, and you've put credentials for the plugin in a location where the plugin will find them. The /etc/my.cnf.d/enable_encryption.preset file contains a set of options that enable all available encryption functionality.

When you start MariaDB, the AWS KMS plugin will connect to the AWS Key Management Service and ask it to generate a new key. MariaDB will store that key on-disk in an encrypted form. The key stored on-disk cannot be used to decrypt the data; rather, on each startup, MariaDB must connect to AWS KMS and have the service decrypt the locally-stored key. The decrypted version is stored in-memory as long as the MariaDB server process is running, and that in-memory decrypted key is used to encrypt the local data.

SELinux and Outbound Connections from MariaDB

Because MariaDB needs to connect to the AWS KMS service, you must ensure that the host has outbound network connectivity over port 443 to AWS, and you must ensure that local policies allow the MariaDB server process to make those outbound connections. By default, SELinux restricts MariaDB from making such connections.

The most simple way to cause SELinux to allow outbound HTTPS connections from MariaDB is to enable to mysql_connect_any boolean, like this:

There are more complex alternatives that have a more granular effect, but those are beyond the scope of this document.

Start MariaDB

Start MariaDB using the systemctl tool:

If you do not use systemd, you may have to start MariaDB using some other mechanism.

You should see journal output similar to this:

Note the several lines of output that refer explicitly to the "AWS KMS plugin". You can see that the plugin generates a "datakey", loads that data key, and then later generates and loads a second data key. The 2nd data key is used to encrypt temporary files and temporary tables.

You can see the encrypted keys stored on-disk in the datadir:

Note that those keys are not useful alone. They are encrypted. When MariaDB starts up, the AWS KMS plugin decrypts those keys by interacting with AWS KMS.

For maximum security, you should start from an empty datadir and run mariadb-install-db after configuring encryption. Then you should re-import your data so that it is fully encrypted. Use sudo to run mariadb-install-db so that it finds your credentials file:

Create Encrypted Tables

With innodb-encrypt-tables=ON, new InnoDB tables will be encrypted by default, using the key ID set in innodb_default_encryption_key_id (default 1). With innodb-encrypt-tables=FORCE enabled, it is not possible to manually bypass encryption when creating a table.

You can cause the AWS KMS plugin to create new encryption keys at-will by specifying a new ENCRYPTION_KEY_ID when creating a table:

Read more about encrypting data in the Data at Rest Encryption section of the MariaDB Documentation.

AWS KMS Plugin Option Reference

  • aws_key_management_master_key_id: AWS KMS Customer Master Key ID (ARN or alias prefixed by alias/) for master encryption key. Used to create new data keys. If not set, no new data keys will be created.

  • aws_key_management_rotate_key: Set this variable to a data key ID to perform rotation of the key to the master key given in aws_key_management_master_key_id. Specify -1 to rotate all keys.

  • aws_key_management_key_spec: Encryption algorithm used to create new keys. Allowed values are AES_128 (default) or AES_256.

  • aws_key_management_log_level: Logging for AWS API. Allowed values, in increasing verbosity, are "Off" (default), "Fatal", "Error", "Warn", "Info", "Debug", and "Trace".

Next Steps

For more information about advanced usage, including strategies to manage credentials, enforce separation of responsibilities, and even require 2-factor authentication to start your MariaDB server, please review Amazon Web Services (AWS) Key Management Service (KMS) Encryption Plugin Advanced Usage.

This page is licensed: CC BY-SA / Gnu FDL

Data-at-Rest Encryption Overview

Overview

Having tables encrypted makes it almost impossible for someone to access or steal a hard disk and get access to the original data. This functionality is also known as Transparent Data Encryption (TDE).

All of the following assumes that encryption keys are stored on another system.

Using encryption has an overhead of roughly 3-5%.

Encryption and Decryption Lifecycle

MariaDB performs data-at-rest encryption at specific points during disk I/O operations. When data is written to disk, encryption usually takes place; when data is read back into memory, decryption takes place. Data stored in memory (for example, in buffer pools) is often decrypted while in use.

Which Storage Engines Does MariaDB Encryption Support?

MariaDB encryption is fully supported for the storage engines. Encryption is also supported for the Aria storage engine, but only for tables created with ROW_FORMAT=PAGE (the default), and for the binary log (replication log).

MariaDB allows the user to configure flexibly what to encrypt. In or InnoDB, one can choose to encrypt:

  • everything — all tablespaces (with all tables) (with )

  • individual tables

  • everything, excluding individual tables

Additionally, one can choose to encrypt InnoDB log files (recommended, with ) and InnoDB Temporary Tables (with ).

When or an encryption key of 1 must be defined. See .

Limitations

These limitations exist in the data-at-rest encryption implementation:

  • Only data and only at rest is encrypted. Metadata (for example .frm files) and data sent to the client are not encrypted (but see ).

  • Only the MariaDB server knows how to decrypt the data, in particular

    • can read encrypted binary logs only when --read-from-remote-server is used ().

Encryption Key Management

MariaDB's data-at-rest encryption requires the use of a . These plugins are responsible both for the management of encryption keys and for the actual encryption and decryption of data.

MariaDB supports the use of . Each encryption key uses a 32-bit integer as a key identifier. If the specific plugin supports , then encryption keys can also be rotated, which creates a new version of the encryption key.

How MariaDB manages encryption keys depends on which encryption key management solution you choose. Currently, MariaDB has three options:

Once you have an key management and encryption plugin set up and configured for your server, you can begin using encryption options to better secure your data.

Encrypting Data

Encryption occurs whenever MariaDB writes pages to disk. Encrypting table data requires that you install a , such as the plugin. Once you have a plugin set up and configured, you can enable encryption for your InnoDB and Aria tables.

Encrypting Table Data

MariaDB supports data-at-rest encryption for InnoDB and Aria storage engines. Additionally, it supports encrypting the and internal on-disk temporary tables that use the Aria storage engine..

Encrypting Temporary Files

MariaDB also creates temporary files on disk. For example, a binary log cache will be written to a temporary file if the binary log cache exceeds or , and temporary files are also often used for filesorts during query execution. These temporary files can also be encrypted if is set.

Temporary files created internally by InnoDB, such as those used for merge sorts and row logs can also be encrypted if is set. These files are encrypted regardless of whether the tables involved are encrypted or not, and regardless of whether is set or not.

Encrypting Binary Logs

MariaDB can also encrypt (including ).

Binary and Relay Log Encryption Behavior

When is an event encrypted?

When binary log and relay log events are written to the IO_CACHE, they are encrypted. This happens regardless of whether the cache is stored on disk or in memory, depending on the transaction size and the values of binlog_cache_size and binlog_stmt_cache_size. Hence, before events are written to the actual binary log and relay log files, they are encrypted.

When is an event decrypted?

When a START_ENCRYPTION_EVENT appears in the binary log or relay log, events are decrypted as they are read. This event comes right after the FORMAT_DESCRIPTION_EVENT in encrypted binary logs and relay logs, making it the second event in the log file.

Encryption and Page Compression

Data-at-rest encryption and can be used together. When they are used together, data is first compressed, and then it is encrypted. In this case you save space and still have your data protected.

Thanks

  • Tablespace encryption was donated to the MariaDB project by Google.

We are grateful to these companies for their support of MariaDB!

See Also

  • A with benchmark results

This page is licensed: CC BY-SA / Gnu FDL

AWS Key Management Encryption Plugin

Due to license incompatibilities between the MariaDB server source code and the Amazon AWS C++ SDK, we can only distribute the plugin in source code form, and not as ready-to-use binaries. See for details.

MariaDB's requires the use of a . These plugins are responsible both for the management of encryption keys and for the actual encryption and decryption of data.

MariaDB supports the use of . Each encryption key uses a 32-bit integer as a key identifier. If the specific plugin supports , then encryption keys can also be rotated, which creates a new version of the encryption key.

The AWS Key Management plugin is a that uses the .

Overview

INSTALL SONAME 'aws_key_management';
[mariadb]
...
plugin_load_add = aws_key_management
[default]
aws_access_key_id = AKIAIG6IZ6TKF52FVV5A
aws_secret_access_key = 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
$ cat /var/lib/mysql/.aws/credentials
[default]
aws_access_key_id = AKIAIG6IZ6TKF52FVV5A
aws_secret_access_key = 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
region = us-east-1
chown mysql /var/lib/mysql/.aws/credentials
chmod 600 /var/lib/mysql/.aws/credentials
[mariadb]
plugin_load_add = aws_key_management
aws-key-management = FORCE_PLUS_PERMANENT
aws-key-management-master-key-id = alias/mariadb-encryption
aws-key-management-region = us-east-1
!include /etc/my.cnf.d/enable_encryption.preset
setsebool -P mysql_connect_any 1
systemctl start mariadb
# journalctl --no-pager -o cat -u mariadb.service

[Note] /usr/sbin/mysqld (mysqld 10.1.9-MariaDB-enterprise-log) starting as process 19831 ...
[Note] AWS KMS plugin: generated encrypted datakey for key id=1, version=1
[Note] AWS KMS plugin: loaded key 1, version 1, key length 128 bit
[Note] InnoDB: Using mutexes to ref count buffer pool pages
[Note] InnoDB: The InnoDB memory heap is disabled
[Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
[Note] InnoDB: Memory barrier is not used
[Note] InnoDB: Compressed tables use zlib 1.2.7
[Note] InnoDB: Using CPU crc32 instructions
[Note] InnoDB: Initializing buffer pool, size = 2.0G
[Note] InnoDB: Completed initialization of buffer pool
[Note] InnoDB: Highest supported file format is Barracuda.
[Note] InnoDB: 128 rollback segment(s) are active.
[Note] InnoDB: Waiting for purge to start
[Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.26-74.0 started; log sequence number 1616819
[Note] InnoDB: Dumping buffer pool(s) not yet started
[Note] Plugin 'FEEDBACK' is disabled.
[Note] AWS KMS plugin: generated encrypted datakey for key id=2, version=1
[Note] AWS KMS plugin: loaded key 2, version 1, key length 128 bit
[Note] Using encryption key id 2 for temporary files
[Note] Server socket created on IP: '::'.
[Note] Reading of all Master_info entries succeded
[Note] Added new Master_info '' to hash table
[Note] /usr/sbin/mysqld: ready for connections.
# ls -l /var/lib/mysql/aws*
-rw-rw----. 1 mysql mysql 188 Feb 25 18:55 /var/lib/mysql/aws-kms-key.1.1
-rw-rw----. 1 mysql mysql 188 Feb 25 18:55 /var/lib/mysql/aws-kms-key.2.1
# sudo -u mysql mariadb-install-db
Installing MariaDB/MySQL system tables in '/var/lib/mysql' ...
2016-02-25 23:16:06 139731553998976 [Note] /usr/sbin/mysqld (mysqld 10.1.11-MariaDB-enterprise-log) starting as process 39551 ...
2016-02-25 23:16:07 139731553998976 [Note] AWS KMS plugin: generated encrypted datakey for key id=1, version=1
2016-02-25 23:16:07 139731553998976 [Note] AWS KMS plugin: loaded key 1, version 1, key length 128 bit
...
MariaDB [test]> CREATE TABLE t1 (id serial, v VARCHAR(32)) ENCRYPTION_KEY_ID=3;
Query OK, 0 rows affected (0.91 sec)
[Note] AWS KMS plugin: generated encrypted datakey for key id=3, version=1
[Note] AWS KMS plugin: loaded key 3, version 1, key length 128 bit
# ls -l /var/lib/mysql/aws*
-rw-rw----. 1 mysql mysql 188 Feb 25 18:55 /var/lib/mysql/aws-kms-key.1.1
-rw-rw----. 1 mysql mysql 188 Feb 25 18:55 /var/lib/mysql/aws-kms-key.2.1
-rw-rw----. 1 mysql mysql 188 Feb 25 19:10 /var/lib/mysql/aws-kms-key.3.1
cmake
Percona XtraBackup cannot back up instances that use encrypted InnoDB. However, MariaDB's fork, MariaDB Backup, can back up encrypted instances.
  • The Audit plugin cannot create encrypted output. Send it to syslog and configure the protection there instead.

  • File-based general query log and slow query log cannot be encrypted (MDEV-9639).

  • The Aria log is not encrypted (MDEV-8587). This affects only non-temporary Aria tables though.

  • The MariaDB error log is not encrypted. The error log can contain query text and data in some cases, including crashes, assertion failures, and cases where InnoDB write monitor output to the log to aid in debugging. It can sent to syslog too, if needed.

  • InnoDB
    innodb_encrypt_tables=1
    innodb_encrypt_log=1
    innodb_encrypt_temporary_tables=1
    innodb_encrypt_log=1
    innodb_encrypt_temporary_tables=1
    Enabling InnoDB Encryption
    Secure Connections
    mariadb-binlog
    MDEV-8813
    key management and encryption plugin
    multiple encryption keys
    key rotation
    File Key Management Plugin
    AWS Key Management Plugin
    Hashicorp Key Management Plugin
    key management and encryption plugin
    File Key Management
    InnoDB redo log
    Encrypting Data for InnoDB
    Encrypting Data for Aria
    binlog_cache_size
    binlog_stmt_cache_size
    encrypt_tmp_files=ON
    innodb_encrypt_log=ON
    encrypt_tmp_files
    binary logs
    relay logs
    Encrypting Binary Logs
    InnoDB page compression
    Encryption functions
    DES_DECRYPT()
    DES_ENCRYPT()
    blog post about table encryption
    The AWS Key Management plugin uses the Amazon Web Services (AWS) Key Management Service (KMS) to generate and store AES keys on disk, in encrypted form, using the Customer Master Key (CMK) kept in AWS KMS. When MariaDB Server starts, the plugin will decrypt the encrypted keys, using the AWS KMS "Decrypt" API function. MariaDB data will then be encrypted and decrypted using the AES key. It supports multiple encryption keys. It supports key rotation.

    Tutorials

    Tutorials related to the AWS Key Management plugin can be found at the following pages:

    • Amazon Web Services (AWS) Key Management Service (KMS) Encryption Plugin Setup Guide

    • Amazon Web Services (AWS) Key Management Service (KMS) Encryption Plugin Advanced Usage

    Preparation

    • Before you use the plugin, you need to create a Customer Master Key (CMK). Create a key using the AWS Console as described in the AMS KMS developer guide.

    • The easiest way to give the AWS key management plugin access to the key is to create an IAM Role with access to the key, and to apply that IAM Role to an EC2 instance where MariaDB Server runs.

    • Make sure that MariaDB Server runs under the correct AWS identity that has access to the above key. For example, you can store the AWS credentials in an AWS credentials file for the user who runs mysqld. More information about the credentials file can be found in the AWS CLI Getting Started Guide.

    Installing the Plugin's Package

    The AWS Key Management plugin depends on the AWS SDK for C++, which uses the Apache License, Version 2.0. This license is not compatible with MariaDB Server's , so we are not able to distribute packages that contain the AWS Key Management plugin. Therefore, the only way to currently obtain the plugin is to install it from source.

    Installing from Source

    When compiling MariaDB from source, the AWS Key Management plugin is built by default, on systems that support it.

    Compilation is controlled by the following cmake arguments:

    • -DPLUGIN_AWS_KEY_MANAGEMENT=DYNAMIC to build a loadable plugin library

    • -DAWS_SDK_EXTERNAL_PROJECT=ON to download the AWS C++ SDK code

    • -DNOT_FOR_DISTRIBUTION=ON to confirm that you know to not distribute the resulting binaries

    The plugin uses AWS C++ SDK, which introduces the following restrictions:

    • The plugin can only be built on Windows, Linux, and macOS.

    • The plugin requires that one of the following compilers is used: gcc 4.8 or later, clang 3.3 or later, Visual Studio 2013 or later.

    • On Unix, the libcurl development package (e.g. libcurl3-dev on Debian Jessie), uuid development package, and openssl need to be installed.

    • You may need to use a newer version of than is provided by default in your OS.

    You do not need to download/install the AWS C++ SDK yourself; the correct version of the SDK GitHub repository will be cloned into the build directory at build time, and only the libraries for AWS components actually needed by the key management plugin will be built, which takes much less time than building the full AWS C++ SDK.

    Building on Linux

    With all prerequisites installed, the actual build process pretty much comes down to:

    Cmake will print the following warning as part of its output. Please take it seriously and do not distribute the aws_key_management.so file to any third parties: You have linked MariaDB with Apache 2.0 libraries! You may not distribute the resulting binary. If you do, you will put yourself into a legal problem with the Free Software Foundation.

    After make succeeded you can copy the created aws_key_management.so plugin library file to the plugin directory of your actual MariaDB Server machines installation, e.g. /usr/lib64/mysql/plugin on RedHat/Fedora based systems or /usr/lib/mysql/plugin on Debian-based systems.

    Installing the Plugin

    Even after the package that contains the plugin's shared library is installed on the operating system, the plugin is not actually installed by MariaDB by default. There are two methods that can be used to install the plugin with MariaDB.

    The first method can be used to install the plugin without restarting the server. You can install the plugin dynamically by executing INSTALL SONAME or INSTALL PLUGIN. For example:

    The second method can be used to tell the server to load the plugin when it starts up. The plugin can be installed this way by providing the --plugin-load or the --plugin-load-add options. This can be specified as a command-line argument to mysqld or it can be specified in a relevant server option group in an option file. For example:

    Uninstalling the Plugin

    Before you uninstall the plugin, you should ensure that data-at-rest encryption is completely disabled, and that MariaDB no longer needs the plugin to decrypt tables or other files.

    You can uninstall the plugin dynamically by executing UNINSTALL SONAME or UNINSTALL PLUGIN. For example:

    If you installed the plugin by providing the --plugin-load or the --plugin-load-add options in a relevant server option group in an option file, then those options should be removed to prevent the plugin from being loaded the next time the server is restarted.

    Configuring the AWS Key Management Plugin

    To enable the AWS Key Management plugin, you also need to set the plugin's system variables. The aws_key_management_master_key_id system variable is the primary one to set. These system variables can be specified as command-line arguments to mysqld or they can be specified in a relevant server option group in an option file. For example:

    Once you've updated the configuration file, restart the MariaDB server to apply the changes and make the key management and encryption plugin available for use.

    Using the AWS Key Management Plugin

    Once the AWS Key Management Plugin is enabled, you can use it by creating an encrypted table:

    Now, table t will be encrypted using the encryption key generated by AWS.

    For more information on how to use encryption, see Data at Rest Encryption.

    Using Multiple Encryption Keys

    The AWS Key Management Plugin supports using multiple encryption keys. Each encryption key can be defined with a different 32-bit integer as a key identifier. If a previously unused identifier is used, then the plugin will automatically generate a new key.

    When encrypting InnoDB tables, the key that is used to encrypt tables can be changed.

    When encrypting Aria tables, the key that is used to encrypt tables cannot currently be changed.

    Key Rotation

    The AWS Key Management plugin does support key rotation. To rotate a key, set the aws_key_management_rotate_key system variable. For example, to rotate key with ID 2:

    Or to rotate all keys, set the value to -1:

    Versions

    Version
    Status
    Introduced

    1.0

    Stable

    ,

    1.0

    Beta

    1.0

    Experimental

    System Variables

    aws_key_management_key_spec

    • Description: Encryption algorithm used to create new keys

    • Commandline: --aws-key-management-key-spec=value

    • Scope: Global

    • Dynamic: No

    • Data Type: enumerated

    • Default Value: AES_128

    • Valid Values: AES_128, AES_256

    aws_key_management_log_level

    • Description: Dump log of the AWS SDK to MariaDB error log. Permitted values, in increasing verbosity, are Off (default), Fatal, Error, Warn, Info, Debug, and Trace.

    • Commandline: --aws-key-management-log-level=value

    • Scope: Global

    • Dynamic: No

    • Data Type: enumerated

    • Default Value: Off

    • Valid Values: Off, Fatal, Warn, Info, Debug and Trace

    aws_key_management_master_key_id

    • Description: AWS KMS Customer Master Key ID (ARN or alias prefixed by alias/) for the master encryption key. Used to create new data keys. If not set, no new data keys will be created.

    • Commandline: --aws-key-management-master-key-id=value

    • Scope: Global

    • Dynamic: No

    • Data Type: string

    • Default Value:

    aws_key_management_mock

    • Description: Mock AWS KMS calls (for testing). Must be enabled at compile-time.

    • Commandline: --aws-key-management-mock

    • Scope: Global

    • Dynamic: No

    • Data Type: boolean

    • Default Value: OFF

    • Valid Values: OFF, ON

    aws_key_management_region

    • Description: AWS region name, e.g us-east-1 . Default is SDK default, which is us-east-1.

    • Commandline: --aws-key-management-region=value

    • Scope: Global

    • Dynamic: No

    • Data Type: string

    • Default Value: 'us-east-1'

    aws_key_management_request_timeout

    • Description: Timeout in milliseconds for create HTTPS connection or execute AWS request. Specify 0 to use SDK default.

    • Commandline: --aws-key-management-request-timeout=value

    • Scope: Global

    • Dynamic: No

    • Data Type: integer

    • Default Value: 0

    aws_key_management_rotate_key

    • Description: Set this variable to a data key ID to perform rotation of the key to the master key given in aws_key_management_master_key_id. Specify -1 to rotate all keys.

    • Commandline: --aws-key-management-rotate-key=value

    • Scope: Global

    • Dynamic: Yes

    • Data Type: integer

    • Default Value:

    Options

    aws_key_management

    • Description: Controls how the server should treat the plugin when the server starts up.

      • Valid values are:

        • OFF - Disables the plugin without removing it from the mysql.plugins table.

        • ON - Enables the plugin. If the plugin cannot be initialized, then the server will still continue starting up, but the plugin will be disabled.

        • FORCE - Enables the plugin. If the plugin cannot be initialized, then the server will fail to start with an error.

        • FORCE_PLUS_PERMANENT - Enables the plugin. If the plugin cannot be initialized, then the server will fail to start with an error. In addition, the plugin cannot be uninstalled with or while the server is running.

      • See for more information.

    • Commandline: --aws-key-management=value

    • Data Type: enumerated

    • Default Value: ON

    • Valid Values: OFF, ON, FORCE, FORCE_PLUS_PERMANENT

    This page is licensed: CC BY-SA / Gnu FDL

    Installing the Plugin's Package
    data-at-rest encryption
    key management and encryption plugin
    multiple encryption keys
    key rotation
    key management and encryption plugin
    Amazon Web Services (AWS) Key Management Service (KMS)

    Decrypt Aria Tables

    This page describes how to decrypt datdata at resta-at-rest for tables that use the Aria storage engine.

    If you have Aria tables encrypted, you must first decrypt them:

    Repeat this for each Aria table that is encrypted.

    For more information, refer to MDEV-17268.

    • Ensure the server can currently read encrypted data Keep your key management/encryption plugin configured and loaded so MariaDB can read existing encrypted Aria tables. Don’t remove the plugin yet. MariaDB

    • Turn off Aria encryption for future writes Set the global variable to off and restart if set in config:

      Also set in the option file to persist:

      With encryption disabled, any newly rebuilt Aria table will be written unencrypted.

    • Rebuild Aria tables to rewrite them unencrypted Rebuilding causes MariaDB to rewrite data and index files (.MAD/.MAI) in the current (now unencrypted) mode. Typical ways to rebuild:

      • ALTER TABLE t ENGINE=Aria;

      • ALTER TABLE t ALGORITHM=COPY; (forces a copy/rebuild)

    • Repeat for all Aria tables you want decrypted Generate statements for every Aria table:

      Review and run the generated DDL. (System tables may use Aria in newer releases—handle with care.)

    • Verify and then remove encryption dependencies (optional) Once all targeted Aria tables are rebuilt and unencrypted, and you have no other encrypted assets relying on the plugin (e.g., InnoDB encryption, binlog encryption), you can remove or disable the key management/encryption plugin.

    File Key Management Encryption Plugin

    MariaDB's requires the use of a . These plugins are responsible both for the management of encryption keys and for the actual encryption and decryption of data.

    MariaDB supports the use of . Each encryption key uses a 32-bit integer as a key identifier. If the specific plugin supports , then encryption keys can also be rotated, which creates a new version of the encryption key.

    The File Key Management plugin that ships with MariaDB is a that reads encryption keys from a plain-text file.

    Overview

    The File Key Management plugin is the for users who want to use . Some of the plugin's primary features are:

    # clone the MariaDB Server source code repository
    git clone https://github.com/MariaDB/server.git
    cd server
    
    # prepare the build
    mkdir _build
    cd _build
    cmake .. -DNOT_FOR_DISTRIBUTION=ON \
      -DPLUGIN_AWS_KEY_MANAGEMENT=DYNAMIC \
      -DAWS_SDK_EXTERNAL_PROJECT=1
    
    # build the plugin only
    cd plugin/aws_key_management
    make
    INSTALL SONAME 'aws_key_management';
    [mariadb]
    ...
    plugin_load_add = aws_key_management
    UNINSTALL SONAME 'aws_key_management';
    [mariadb]
    ...
    aws_key_management_master_key_id=alias/<your key's alias>
    CREATE TABLE t (i INT) ENGINE=InnoDB ENCRYPTED=YES
    SET GLOBAL aws_key_management_rotate_key=2;
    SET GLOBAL aws_key_management_rotate_key=-1;
    ALTER TABLE my_table ENCRYPTED=NO;
    OPTIMIZE TABLE t; (for Aria this rebuilds the table)

    Example (single table):

    MariaDB
    MariaDB
    -- Immediate effect for the running instance
    SET GLOBAL aria_encrypt_tables = OFF;
    [mysqld]
    aria_encrypt_tables=OFF
    SELECT CONCAT('ALTER TABLE `', table_schema, '`.`', table_name, 
                  '` ENGINE=Aria, ALGORITHM=COPY;') AS ddl
    FROM information_schema.tables
    WHERE ENGINE='Aria'
      AND table_schema NOT IN ('mysql','information_schema','performance_schema','sys');
    ALTER TABLE db1.my_aria_table ENGINE=Aria, ALGORITHM=COPY, LOCK=SHARED;
  • It reads encryption keys from a plain-text key file.

  • As an extra protection mechanism, the plain-text key file can be encrypted.

  • It supports multiple encryption keys.

  • It supports key rotation with MariaDB Enterprise Server from MariaDB Enterprise Server 11.8.

  • It supports two different algorithms for encrypting data.

  • It can also serve as an example and as a starting point when developing a key management and encryption plugin with the .

    Installing the File Key Management Plugin's Package

    The File Key Management plugin is included in MariaDB packages as the file_key_management.so or file_key_management.dll shared library. The shared library is in the main server package, so no additional package installations are necessary. The plug-in must be installed into MariaDB however as follows.

    Installing the Plugin

    Although the plugin's shared library is distributed with MariaDB by default, the plugin is not actually installed by MariaDB by default. The plugin can be installed by providing the --plugin-load or the --plugin-load-add options. This can be specified as a command-line argument to mariadbd or it can be specified in a relevant server option group in an option file. For example:

    Uninstalling the Plugin

    Before you uninstall the plugin, you should ensure that data-at-rest encryption is completely disabled, and that MariaDB no longer needs the plugin to decrypt tables or other files.

    You can uninstall the plugin dynamically by executing UNINSTALL SONAME or UNINSTALL PLUGIN. For example:

    If you installed the plugin by providing the --plugin-load or the --plugin-load-add options in a relevant server option group in an option file, then those options should be removed to prevent the plugin from being loaded the next time the server is restarted.

    Creating the Key File

    In order to encrypt your tables with encryption keys using the File Key Management plugin, create the file containing the encryption keys. File name and location don't matter; see in the following what configuration is needed.

    For each encryption key, the file contains these options, separated by a semicolon:

    • The key identifier (format: 32-bit integer)

    • The key version (optional, and only available as of Enterprise Server 11.8)

    • The key itself (format: hex-encoded)

    Entries look like this:

    You can also optionally encrypt the key file to make it less accessible from the file system. That is explained further in the section below.

    The File Key Management plugin uses Advanced Encryption Standard (AES) to encrypt data. It supports 128-bit, 192-bit, and 256-bit encryption keys, just like the plugin does.

    Generate random encryption keys using the openssl rand command. To create a random 256-bit (32-byte) encryption key, run the following command:

    The key file needs to have a key identifier for each encryption key added to the beginning of each line. Key identifiers do not have to be contiguous. For example, to append three new encryption keys to a new key file, issue this command:

    The resulting key file looks like this:

    The key identifiers give you a way to reference the encryption keys from MariaDB. In the example above, you could reference these encryption keys using the key identifiers 1, 2 or 100 with the ENCRYPTION_KEY_ID table option or with system variables such as innodb_default_encryption_key_id. You do not necessarily need multiple encryption keys; an encryption key with the key identifier 1 is the only mandatory one.

    If the key file is left unencrypted, the File Key Management plugin only requires the file_key_management_filename system variable to be configured.

    This system variable can be specified as a command-line argument to mariadbd , or it can be specified in a server option group of an option file, like this:

    Encrypting the Key File

    This step is optional, but highly recommended.

    If you use an unencrypted key file, keys are stored in plain text on your system, posing a security risk. It's recommended to encrypt the key file, with these hints in mind:

    • MariaDB only supports the Cipher Block Chaining (CBC) mode of Advanced Encryption Standard (AES).

    • The encryption key size can be 128-bits, 192-bits, or 256-bits.

    • The encryption key is created from the SHA-1 hash of the encryption password.

    • The encryption password has a maximum length of 256 characters.

    Generate a random encryption password using the openssl rand command. To create a random 256 character encryption password, execute the following:

    Encrypt the key file using the openssl enc command. To encrypt the key file with the encryption password created in the previous step, execute, for example, one of the following commands:

    The resulting keys.enc file is the encrypted version of keys.txt file. Delete the unencrypted key file.

    Having the key file encrypted requires both the file_key_management_filename and the file_key_management_filekey system variables to be configured.

    The file_key_management_filekey variable can be provided in two forms:

    • As a plain-text encryption password. This is not recommended, since the plain-text encryption password would be visible in the output of the SHOW VARIABLES statement.

    • Prefixed with FILE:, it can be a path to a file that contains the plain-text encryption password.

    These variables can be specified as command-line arguments to mariadbd, or they can be specified in a relevant server option group in an option file:

    Choosing an Encryption Algorithm

    The File Key Management plugin currently supports two encryption algorithms for encrypting data: AES_CBC and AES_CTR. Both of these algorithms use Advanced Encryption Standard (AES) in different modes. AES uses 128-bit blocks, and supports 128-bit, 192-bit, and 256-bit keys. The modes are:

    • The AES_CBC mode uses AES in the Cipher Block Chaining (CBC) mode.

    • The AES_CTR mode uses AES in two slightly different modes in different contexts. When encrypting tablespace pages (such as pages in InnoDB, XtraDB, and Aria tables), it uses AES in the Counter (CTR) mode. When encrypting temporary files (where the cipher text is allowed to be larger than the plain text), it uses AES in the authenticated Galois/Counter Mode (GCM).

    The recommended algorithm is AES_CTR, but this algorithm is only available when MariaDB is built with OpenSSL. If the server is built with wolfSSL then this algorithm is not available. See TLS and Cryptography Libraries Used by MariaDB for more information about which libraries are used on which platforms.

    Configuring the Encryption Algorithm

    The encryption algorithm can be configured by setting the file_key_management_encryption_algorithm system variable.

    This system variable can be set to one of the following values:

    System Variable Value
    Description

    AES_CBC

    Data is encrypted using AES in the mode. This is the default value.

    AES_CTR

    Data is encrypted using AES either in the mode or in the authenticated mode, depending on context. This is only supported in some builds. See the previous section for more information.

    This system variable can be specified as command-line arguments to mariadbd, or it can be specified in a relevant server option group in an option file. For example:

    Note that the loose option prefix is specified. This option prefix is used in case the plugin hasn't been installed yet.

    Note that this variable does not affect the algorithm that MariaDB uses to decrypt the key file. This variable only affects the encryption algorithm that MariaDB uses to encrypt and decrypt data. The only algorithm that MariaDB currently supports to encrypt the key file is Cipher Block Chaining (CBC) mode of Advanced Encryption Standard (AES).

    Using the File Key Management Plugin

    Once the File Key Management Plugin is enabled, you can use it by creating an encrypted table:

    Now, table t will be encrypted using the encryption key from the key file. For more information on how to use encryption, see Data at Rest Encryption.

    Using Multiple Encryption Keys

    The File Key Management Plugin supports using multiple encryption keys. Each encryption key can be defined with a different 32-bit integer as a key identifier.

    When encrypting InnoDB tables, the key that is used to encrypt tables can be changed. When encrypting Aria tables, the key that is used to encrypt tables cannot currently be changed.

    Key Rotation

    The plugin supports key rotation and allows an optional key version in the key file. The keys can be rotated using the FLUSH FILE_KEY_MANAGEMENT_KEYS statement, without needing to restart the server. The plugin remains compatible with old key file format, and when version is not specified, it defaults to version 1.

    Generation of New Key Versions

    How would new key versions be generated?

    The plugin doesn't generate any encryption keys itself, and it doesn't have a backend KMS to generate encryption keys for it either.

    Any encryption keys need to be generated by the user with external tools, such as OpenSSL. For example:

    Keys need to be manually saved to the key file. See this section.

    The format of the key file is simplistic. It stores encryption keys in a plain-text file.

    The File Key Management plugin does not support .

    Versions

    Version
    Status
    Introduced

    1.0

    Stable

    From MariaDB 10.1.18

    System Variables

    file_key_management_encryption_algorithm

    • This system variable is used to determine which algorithm the plugin will use to encrypt data.

      • The recommended algorithm is AES_CTR, but this algorithm is only available when MariaDB is built with OpenSSL. If the server is built with wolfSSL then this algorithm is not available. See TLS and Cryptography Libraries Used by MariaDB for more information about which libraries are used on which platforms.

    • Command line: --file-key-management-encryption-algorithm=value

    • Scope: Global

    • Dynamic: No

    • Data Type: enumerated

    • Default Value: AES_CBC

    • Valid Values: AES_CBC, AES_CTR

    file_key_management_digest

    • Specifies the digest function to use in key derivation of the key used for decrypting the key file.

    • Command line: --file-key-management-digest=value

    • Scope: Global

    • Dynamic: No

    • Data type: enumerated

    • Default value: sha1

    • Valid values: sha1, sha224, sha256, sha384, sha512

    • Available from MariaDB 12.0

    file_key_management_filekey

    • Used to determine the encryption password that is used to decrypt the key file defined by file_key_management_filename.

      • If this system variable's value is prefixed with FILE:, then it is interpreted as a path to a file that contains the plain-text encryption password.

      • If this system variable's value is not prefixed with FILE:, then it is interpreted as the plain-text encryption password. However, this is not recommended.

      • The encryption password has a max length of 256 characters.

      • The only algorithm that MariaDB currently supports when decrypting the key file is mode of . The encryption key size can be 128-bits, 192-bits, or 256-bits. The encryption key is calculated by taking a hash of the encryption password. Instead of SHA-1, SHA-2 can be used as well.

    • Command line: --file-key-management-filekey=value

    • Scope: Global

    • Dynamic: No

    • Data type: string

    • Default value: (empty)

    file_key_management_filename

    • Used to determine the path to the file that contains the encryption keys. If file_key_management_filekey is set, this file can be encrypted with Cipher Block Chaining (CBC) mode of Advanced Encryption Standard (AES).

    • Command line: --file-key-management-filename=value

    • Scope: Global

    • Dynamic: No

    • Data type: string

    • Default value: (empty)

    file_key_management_use_pbkdf2

    • Specifies whether pbkdf2 is used in key derivation, and if so, how many iterations.

    • Command line: --file-key-management-use-pbkdf2=number

    • Scope: Global

    • Dynamic: No

    • Data type: numeric

    • Default value: 0

    • Valid values: integers ≥ 0 (reasonable value: 600000 for sha256, less for sha512)

    • Available from MariaDB 12.0

    Options

    file_key_management

    • Controls how the server should treat the plugin when the server starts up.

      • Valid values are:

        • OFF - Disables the plugin without removing it from the mysql.plugins table.

        • ON - Enables the plugin. If the plugin cannot be initialized, then the server will still continue starting up, but the plugin will be disabled.

        • FORCE - Enables the plugin. If the plugin cannot be initialized, then the server will fail to start with an error.

        • FORCE_PLUS_PERMANENT - Enables the plugin. If the plugin cannot be initialized, then the server will fail to start with an error. In addition, the plugin cannot be uninstalled with or while the server is running.

      • See for more information.

    • Command line: --file-key-management=value

    • Data type: enumerated

    • Default value: ON

    • Valid values: OFF, ON, FORCE, FORCE_PLUS_PERMANENT

    This page is licensed: CC BY-SA / Gnu FDL

    data-at-rest encryption
    key management and encryption plugin
    multiple encryption keys
    key rotation
    key management and encryption plugin
    key management and encryption plugin
    data-at-rest encryption
    cmake
    UNINSTALL SONAME
    UNINSTALL PLUGIN
    Plugin Overview: Configuring Plugin Activation at Server Startup
    MariaDB 10.1.13
    <encryption_key_id>;<encryption_key_version>;<hex-encoded_encryption_key>
    <encryption_key_id>;<hex-encoded_encryption_key>
    1;1;a7addd9adea9978fda19f21e6be987880e68ac92632ca052e5bb42b1a506939a
    2;1;49c16acc2dffe616710c9ba9a10b94944a737de1beccb52dc1560abfdd67388b
    100;2;8db1ee74580e7e93ab8cf157f02656d356c2f437d548d5bf16bf2a56932954a3
    1;a7addd9adea9978fda19f21e6be987880e68ac92632ca052e5bb42b1a506939a
    2;49c16acc2dffe616710c9ba9a10b94944a737de1beccb52dc1560abfdd67388b
    100;8db1ee74580e7e93ab8cf157f02656d356c2f437d548d5bf16bf2a56932954a3
    -- Generate a new 256-bit key
    openssl rand -hex 32
    [mariadb]
    ...
    plugin_load_add = file_key_management
    UNINSTALL SONAME 'file_key_management';
    $ openssl rand -hex 32
    a7addd9adea9978fda19f21e6be987880e68ac92632ca052e5bb42b1a506939a
    mkdir -p /etc/mysql/encryption
    echo $(echo -n "1;" ; openssl rand -hex 32) | sudo tee -a  /etc/mysql/encryption/keyfile
    echo $(echo -n "2;" ; openssl rand -hex 32) | sudo tee -a  /etc/mysql/encryption/keyfile
    echo $(echo -n "100;" ; openssl rand -hex 32) | sudo tee -a  /etc/mysql/encryption/keyfile
    [mariadb]
    ...
    loose_file_key_management_filename = /etc/mysql/encryption/keyfile
    $ sudo openssl rand -hex 128 > /etc/mysql/encryption/keyfile.key
    $ sudo openssl enc -aes-256-cbc -md sha256 -pbkdf2 -pass pass:secret -in /tmp/keys.txt -out /tmp/keys.enc
    $ sudo openssl enc -aes-256-cbc -md sha256 -iter 20000 -pass pass:secret -in /tmp/keys.txt -out /tmp/keys.enc
    [mariadb]
    ...
    loose_file_key_management_filename = /etc/mysql/encryption/keyfile.enc
    loose_file_key_management_filekey = FILE:/etc/mysql/encryption/keyfile.key
    [mariadb]
    ...
    loose_file_key_management_encryption_algorithm = AES_CTR
    CREATE TABLE t (i INT) ENGINE=InnoDB ENCRYPTED=YES
    key rotation
    Cipher Block Chaining (CBC)
    Advanced Encryption Standard (AES)
    SHA-1
    UNINSTALL SONAME
    UNINSTALL PLUGIN
    Plugin Overview: Configuring Plugin Activation at Server Startup
    Cipher Block Chaining (CBC)
    Counter (CTR)
    Galois/Counter Mode (GCM)

    Amazon Web Services (AWS) Key Management Service (KMS) Encryption Plugin Advanced Usage

    This document assumes you've already set up an Amazon Web Services (AWS) account, created a master key in the Key Management Service (KMS), and have done the basic work to set up the MariaDB AWS KMS plugin. These steps are all described in Amazon Web Services (AWS) Key Management Service (KMS) Encryption Plugin Setup Guide.

    Ultimately, keeping all the credentials required to read the key on a single host means that a user who has gained access to the host has enough information to read the encrypted files in the datadir, read the encrypted keys from the datadir, interact with AWS KMS to decrypt the encrypted keys, and then used the decrypted keys to decrypt the encrypted data.

    Theoretically, a superuser can read the memory of the MariaDB server process to read the decrypted keys or restart MariaDB with password authentication disabled in order to dump data, or add new users to MariaDB in order to allow a user to connect and dump the data. Resolving these issues is beyond the scope of this document. A user who gains root access to your operating system or root access to your MariaDB server will have the ability to decrypt your data. Plan accordingly.

    Managing AWS credentials

    Putting the AWS credentials in a file inside the MariaDB home directory is not ideal. By default, any user with the FILE privilege can read any files that the MariaDB server has permission to read, which would include the credentials file. To protect against this, you should set secure_file_priv to restrict the location the server will allow a user to read from when executing LOAD DATA INFILE or the LOAD_FILE() function.

    But putting them in other locations requires passing additional data to the server, which in the case of CentOS 7 requires customizing the systemd startup procedure. This is most easily done by creating a "drop-in" file in /etc/systemd/system/mariadb.service.d/. The file should end in ".conf" but can otherwise be named whatever you like. After making any changes to systemd files, execute systemctl daemon-reload and then start (or restart) the service as usual.

    You can place the credentials file in a location of your choosing and then refer to that file by setting the AWS_CREDENTIAL_PROFILES_FILE environment variable in the drop-in file:

    The credentials file will need to be readable by the "mysql" user, but it does not need to be readable by any other user.

    AWS credentials can also be put directly into a "drop-in" systemd file that will be read when starting the MariaDB service:

    However, any OS user can read this information from systemd, which could be considered a security risk. Another solution is to put the credentials in a separate file that is only readable by root and then refer to that file using an EnvironmentFile directive in a drop-in systemd file.

    That has the advantage the credentials can only be read directly by root. systemd adds those variables to the environment of the MariaDB server when starting it, and MariaDB can use the credentials to interact with AWS. Note, though, that any process running as the "mysql" user can still read the credentials from the proc filesystem on Linux.

    AWS KMS Key Policy

    AWS KMS allows flexible, user-editable key policy. This offers fine-grained control over which users can operate on keys. The possibilities range from simply restricting which IP addresses are allowed to perform operations on the key, to requiring a MFA (Multi-Factor Authentication) device to use the key, to enforcing separation of responsibilities by creating an additional user with limited privileges to enable and disable the key. All 3 of these options will be outlined in this section.

    For more details about customizing the Key Policy for your master keys, please consult the documentation.

    Source IP restrictions

    A simple, common-sense restriction to put in place is to restrict the range of IP addresses that are allowed to use your master key. This way, even if someone obtains API credentials, they'll be unable to use them to decrypt your encryptions keys from a different host.

    To restrict API access from only a specific IP address or range of IP addresses, you'll need to manually edit the key policy.

    1. Load the IAM console at.

    2. Click "Encryption Keys" in the left-hand sidebar.

    3. Click the name of your encryption key to view its details.

    4. Click the link labeled "Switch to policy view", to the right of the heading of the "Key Policy" section.

    ... replacing 10.1.2.3/32 above with an IP address or range of IP addresses in CIDR format. For example, a single address would be 192.168.12.34/32, while a range of addresses might be 192.168.0.0/24.

    1. Click "Save Changes".

    2. Click "Proceed" if prompted with a warning about using the default view in the future.

    Access to the API will now be restricted to requests coming from the IP address or range of IP addresses specified in the policy.

    Using a Multi-Factor Authentication (MFA) device

    One approach is to modify the key policy for the master key so that MFA (Multi-Factor Authentication) is required in order to use the key. This is achieved with a wrapper that handles prompting the user for an MFA token, acquires temporary, limited-privilege credentials from the AWS Security Token Service (STS), and puts those credentials into the environment of the MariaDB server process. The credentials can expire after as little as 15 minutes.

    To require an MFA token for users of the key, you'll need to manually edit the key policy.

    1. Load the IAM console at.

    2. Click "Encryption Keys" in the left-hand sidebar.

    3. Click the name of your encryption key to view its details.

    4. Click the link labeled "Switch to policy view", to the right of the heading of the "Key Policy" section.

    1. Click "Save Changes".

    2. Click "Proceed" if prompted with a warning about using the default view in the future.

    Now, add an MFA device for your user. You'll need to have a hardware MFA device or an application such as Google Authenticator installed on your smartphone.

    1. Click "Users" in the left-hand sidebar.

    2. Click the name of your user.

    3. Click the "Security Credentials" tab.

    4. In the "Sign-In Credentials" section, click the "Manage MFA Device" button.

    Now, set up the wrapper program.

    1. Copy the iam-kms-wrapper file to /usr/local/bin/, and ensure that it is executable.

    2. Create a drop-in systemd config file in /etc/systemd/system/mariadb.service.d/:

    1. Execute systemctl daemon-reload.

    2. Create a file at /etc/my.cnf.d/iam-kms-wrapper.config with these contents, using the ARN for your MFA device as the value for kms_mfa_id:

    When you start the MariaDB service now, the wrapper will temporarily create a socket file at the location given by the kms_mfa_socket option. The wrapper will read the MFA code from the socket and will use it to authenticate to KMS. To give the MFA code, simply write the digits to the socket file using echo: echo 111676 > /tmp/kms_mfa_socket.

    The systemctl command will block until MariaDB starts, so you will need to write the code to the socket file via a separate terminal.

    Note that the temporary credentials put into the environment of the MariaDB process will expire after a period of time defined by the request to the AWS Security Token Service (STS). In the example below, they will expire after 900 seconds. After that time, MariaDB may be unable to generate new encrypted data keys, which means that, for example, an attempt to create a table with a previously-unused key ID would fail.

    Wrapper program example

    Here's an example wrapper program written in go. Build this into an executable named iam-kms-wrapper and use it as instructed above. This could of course be written in any language for which an appropriate AWS SDK exists, but go has the benefit of compiling to a static binary, which means you do not have to worry about interpreter versions or installing complex dependencies on the host that runs your MariaDB server.

    Disabling keys when not needed

    Another possibility is to use the API to disable access to the master key and enable it only when a trusted administrator knows that the MariaDB service needs to be started. A specialized tool on a separate host could be used to enable the key for a very short period of time while the service starts and then quickly disable the key.

    To do this, you can create an extra IAM User that can only use the kms:EnableKey and kms:DisableKey API endpoints for your key. This user will not be able to encrypt or decrypt any data using the key.

    First, create a new user.

    1. Load the IAM console at.

    2. Click "Users" in the left-hand sidebar.

    3. Click "Create New Users".

    4. Enter a new user name. (The examples will use "MDBEncAdmin".)

    1. Click "Close".

    2. Click "Close" again if prompted.

    3. Click the name of your new user to open the details view.

    4. Copy the "User ARN" value for your user (for example "arn:aws:iam::551888181234:user/MDBEncAdmin"). You will need this for the next step.

    Now, give the new user permission to perform API operations on your key.

    1. Click "Encryption Keys" in the left-hand sidebar.

    2. Click the name of your key to open the details view.

    3. Click "Switch to policy view" if it is not already open. (The "policy view" is a large text field that contains JSON describing the key policy.)

    4. Create a new item in the Statement array with this structure:

    ...so that your Key Policy looks like this:

    1. Click "Save Changes".

    You've now added a new IAM user and you've given that user privileges to enable and disable your key. This user will be able to perform those operations using the AWS CLI or via a script of your own design using the AWS API. For example, using the :

    In order for MariaDB to start, this new user will have to enable the master key, then the DBA can start MariaDB, and this user can once again disable the master key after the service has started. Note that in this workflow, MariaDB will be unable to create new encryption keys, such as would be done when a user creates a table that refers to a non-existent key ID. The AWS KMS plugin will encounter an error if it tries to generate a new encryption key while the master key is disabled. In that scenario, the key administrator would have to enable the key before the operation could succeed. Here's what you should expect to see in the journal if MariaDB tries to interact with a disabled master key:

    Adding MFA

    It's also possible to add MFA to this technique so that the user that enables & disables the master key has to authenticate using an MFA device. Adapt the instructions in the MFA section above to add MFA to the policy section for the user with EnableKey and DisableKeys privileges, add an MFA device for that user, use Security Token Service (STS) to get temporary security credentials, and then use those credentials to make the API calls. Here's an example Python script that follows that workflow:

    Logging and auditing

    CloudTrail

    Amazon's CloudTrail service creates JSON-formatted text log files for every API interaction. Enabling CloudTrail requires S3, which incurs additional fees.

    First, enable CloudTrail and add a trail.

    1. Load the CloudTrail console at.

    2. If you've never used CloudTrail before, click "Get Started Now".

    3. Enter a value for "trail name". This example uses "mariadb-encryption-key".

    4. Create a new S3 bucket, using a globally unique name, or use an existing S3 bucket, according to your needs.

    If you navigate to the S3 bucket you created, you should find log files that contain JSON-formatted descriptions of your API interactions.

    CloudWatch

    Amazon's CloudWatch service allows you to create alarms and event rules that monitor log information.

    First, send your CloudTrail logs to CloudWatch.

    1. Load the CloudTrail console at.

    2. Click "Trails" in the left-hand navigation sidebar.

    3. Click the name of your trail to open the Configuration view.

    4. In the "CloudWatch Logs" section, click "Configure".

    Now, set up an SNS topic to facilitate email notifications.

    1. Open.

    2. Make sure the region in the console (look in the upper-right corner) is the same as the region where you created your key!

    3. Click "Get Started" is prompted.

    4. Click "Events" in the left-hand sidebar.

    Now, configure CloudWatch and create an Event Rule.

    1. Open.

    2. Make sure the region in the console (look in the upper-right corner) is the same as the region where you created your key and your SNS topic!

    3. Click "Events" in the left-hand sidebar.

    4. Click "Create rule".

    You should now get emails any time someone executes API calls on the KMS service in the region where you've created the CloudWatch Event rule. That means you should get email any time the key is enabled or disabled, and any time the AWS KMS plugin generates new keys or decrypts the keys stored on disk on the MariaDB server.

    You may also wish to create an event rule (or an additional event) that matches only when an unauthorized user tries to access the key. You might accomplish that by manually editing the Event selector of the rule to look something like this:

    The emails are formatted as JSON. Further customization of the CloudWatch email workflow is beyond the scope of this document.

    There are many other workflows available using CloudWatch, including workflows with alarms and dashboards. Those are beyond the scope of this document.

    This page is licensed: CC BY-SA / Gnu FDL

    Disabling InnoDB Encryption

    The process involved in safely disabling encryption for your InnoDB tables is a little more complicated than that of enabling encryption. Turning off the relevant system variables doesn't decrypt the tables. If you turn it off and remove the encryption key management plugin, it'll render the encrypted data inaccessible.

    In order to safely disable encryption, you first need to decrypt the tablespaces and the Redo Log, then turn off the system variables. The specifics of this process depends on whether you are using automatic or manual encryption of the InnoDB tablespaces.

    Disabling Encryption for Automatically Encrypted Tablespaces

    When an InnoDB tablespace has the ENCRYPTED table option set to DEFAULT and the innodb_encrypt_tables system variable is set to ON or FORCE, the tablespace's encryption is automatically managed by the background encryption threads. When you want to disable encryption for these tablespaces, you must ensure that the background encryption threads decrypt the tablespaces before removing the encryption keys. Otherwise, the tablespace remains encrypted and becomes inaccessible once you've removed the keys.

    To safely decrypt the tablespaces, first, set the system variable to OFF:

    Next, set the system variable to a non-zero value:

    Then, set the system variable to 1:

    Once set, any InnoDB tablespaces that have the table option set to DEFAULT will be in the background by the InnoDB .

    Decryption Status

    You can of the decryption process using the table in the database.

    This query shows the number of InnoDB tablespaces that currently using background encryption threads. Once the count reaches 0, then all of your InnoDB tablespaces are unencrypted. Be sure to also remove encryption on the and the storage engine before removing the encryption key management settings from your configuration file.

    Disabling Encryption for Manually Encrypted Tablespaces

    In the case of manually encrypted InnoDB tablespaces, (that is, those where the table option is set to YES), you must issue an statement to decrypt each tablespace before removing the encryption keys. Otherwise, the tablespace remains encrypted and becomes inaccessible without the keys.

    First, query the Information Schema table to find the encrypted tables. This can be done with a WHERE clause filtering the CREATE_OPTIONS column.

    For each table in the result-set, issue an statement, setting the table option to NO.

    Once you have removed encryption from all the tables, your InnoDB deployment is unencrypted. Be sure to also remove encryption from the as well as and any other storage engines that support encryption before removing the encryption key management settings from your configuration file.

    InnoDB does not permit manual encryption changes to tables in the tablespace using . Encryption of the tablespace can only be configured by setting the value of the system variable. This means that when you want to encrypt or decrypt the tablespace, you must also set a non-zero value for the system variable, and you must also set the system variable to 1 to ensure that the system tablespace is properly encrypted or decrypted by the background threads. See for more information.

    Disabling Encryption for Temporary Tablespaces

    The system variable controls the configuration of encryption for the . To disable it, remove the system variable from your server's , and then restart the server.

    Disabling Encryption for the Redo Log

    InnoDB uses the in crash recovery. By default, these events are written to file in an unencrypted state. In removing data-at-rest encryption for InnoDB, be sure to also disable encryption for the Redo Log before removing encryption key settings. Otherwise the Redo Log can become inaccessible without the encryption keys.

    First, set the system variable to OFF in a server in an . Once this is done, restart the MariaDB Server. When the Server comes back online, it begins writing unencrypted data to the Redo Log.

    After the server has been successfully restarted with encryption disabled, you may remove the that had been used. If you try to disable encryption for the Redo Log and remove the plugin in a single step, InnoDB will be unable to decrypt the log in order to remove the encryption.

    See Also

    This page is licensed: CC BY-SA / Gnu FDL

    Locate the section that contains "Sid": "Allow use of the key".
  • Add this text below the "Sid" line:

  • Locate the section that contains "Sid": "Allow use of the key".
  • Add this text below the "Sid" line:

  • Complete the steps to activate your MFA device.
  • Copy the ARN for your MFA device. You will need to use this when configuring the wrapper program.

  • Click "Show User Security Credentials".
  • Copy the credentials and put them in a credentials file with this structure:

  • Click "Turn On".

    Click "Continue".
  • Click "Allow".

  • Click "Create new topic".
  • Enter a Topic name of your choosing.

  • Enter a Display name of your choosing.

  • Click "Create topic".

  • Click the ARN of your new SNS topic.

  • Click "Create Subscription".

  • Select "Email" from the Protocol dropdown.

  • Enter the desired notification email address in the Endpoint field.

  • Wait for the confirmation email to show up and follow the instructions.

  • Choose "AWS API call" from the "Select event source" dropdown.
  • Choose "KMS" from the "Service name" dropdown.

  • Decide which operations should trigger the event. (You can eep "Any operation" selected for simplicity.)

  • Click "Add target".

  • Select "SNS target" from the dropdown.

  • Select the SNS topic you created in the previous steps.

  • Click "Configure details".

  • Enter a Name and Description of your choosing.

  • Click "Create rule".

  • AWS Key Management Service Key Policy
    AWS CLI
    innodb_encrypt_tables
    innodb_encryption_threads
    innodb_encryption_rotate_key_age
    ENCRYPTED
    decrypted
    background encryption threads
    check the status
    INNODB_TABLESPACES_ENCRYPTION
    information_schema
    Redo Log
    Aria
    ENCRYPTED
    ALTER TABLE
    TABLES
    ALTER TABLE
    ENCRYPTED
    Redo Log
    Aria
    system
    ALTER TABLE
    system
    innodb_encrypt_tables
    system
    innodb_encryption_threads
    innodb_encryption_rotate_key_age
    MDEV-14398
    innodb_encrypt_temporary_tables
    temporary tablespace
    option file
    Redo Log
    innodb_encrypt_log
    option group
    option file
    key management and encryption plugin
    Enabling InnoDB encryption
    [Service]
    Environment=AWS_CREDENTIAL_PROFILES_FILE=/etc/aws-kms-credentials
    # cat /etc/systemd/system/mariadb.service.d/aws-kms.conf
    [Service]
    Environment=AWS_ACCESS_KEY_ID=AKIAIRSG2XYZATCJLZ4A
    Environment=AWS_SECRET_ACCESS_KEY=ux91LZIxCp4ZXabcdefgIViQNtTan42QAmJqJVqV
    # cat /etc/systemd/system/mariadb.service.d/aws-kms.env
    AWS_ACCESS_KEY_ID=AKIAIRSG2XYZATCJLZ4A
    AWS_SECRET_ACCESS_KEY=ux91LZIxCp4ZXabcdefgIViQNtTan42QAmJqJVqV
    
    # chown root /etc/systemd/system/mariadb.service.d/aws-kms.env
    # chmod 600 /etc/systemd/system/mariadb.service.d/aws-kms.env
    
    # cat /etc/systemd/system/mariadb.service.d/aws-kms.conf
    [Service]
    EnvironmentFile=/etc/systemd/system/mariadb.service.d/aws-kms.env
    $ whoami
    mysql
    $ cat /proc/$(pgrep mysqld)/environ | tr '\0' '\n' | grep AWS
    AWS_ACCESS_KEY_ID=AKIAIRSG2XYZATCJLZ4A
    AWS_SECRET_ACCESS_KEY=ux91LZIxCp4ZXabcdefgIViQNtTan42QAmJqJVqV
    "Condition": {
     "IpAddress": {
     "aws:SourceIp": [
     "10.1.2.3/32"
     ]
     }
     },
    "Condition": {
     "Bool": {
     "aws:MultiFactorAuthPresent": "True"
     }
     },
    [Service]
    EnvironmentFile=/etc/systemd/system/mariadb.service.d/aws-kms.env
    ExecStart=
    ExecStart=/usr/local/bin/iam-kms-wrapper --config=/etc/my.cnf.d/iam-kms-wrapper.config /usr/sbin/mysqld $MYSQLD_OPTS
    [kms]
    kms_mfa_id = arn:aws:iam::551888187628:mfa/MDBEnc
    kms_mfa_socket = /tmp/kms_mfa_socket
    package main
    
    import (
        "syscall"
        "os"
        "log"
        "flag"
        "github.com/aws/aws-sdk-go/aws"
        "github.com/aws/aws-sdk-go/aws/session"
        "github.com/aws/aws-sdk-go/aws/awserr"
        "github.com/aws/aws-sdk-go/service/sts"
        "github.com/robfig/config"
    )
    
    func main() {
    
        config_file_p := flag.String("config", "", "location of the config file")
        flag.Parse()
    
        if flag.NArg() < 1 {
            log.Fatal("Command to wrap must be given as first command-line argument")
        }
    
        cmd := flag.Arg(0)
        args := flag.Args()[0:]
    
        conf, err := config.ReadDefault(*config_file_p)
        if err != nil {
            log.Fatal(err)
        }
    
        kms_mfa_id, err := conf.String("kms","kms_mfa_id")
        mfa_socket_file, err := conf.String("kms","kms_mfa_socket")
    
        sess := session.New()
        svc := sts.New(sess)
    
        syscall.Umask(0044)
    
        log.Printf("Reading MFA token from %s\n",mfa_socket_file)
    
        if err := syscall.Mknod(mfa_socket_file, syscall.S_IFIFO|uint32(os.FileMode(0622)), 0); err != nil {
            log.Fatal(err)
        }
    
        file, err := os.Open(mfa_socket_file)
        if err != nil {
            log.Fatal(err)
        }
    
        token := make([]byte, 6)
    
        if _, err := file.Read(token); err != nil {
            log.Fatal(err)
        }
    
        file.Close()
    
        if err := syscall.Unlink(mfa_socket_file); err != nil {
            log.Fatal(err)
        }
    
        mfa_token := string(token)
    
        token_params := &sts.GetSessionTokenInput{
            DurationSeconds: aws.Int64(900),
            SerialNumber:    aws.String(kms_mfa_id),
            TokenCode:       aws.String(mfa_token),
        }
    
        resp, err := svc.GetSessionToken(token_params)
        if err != nil {
            if awsErr, ok := err.(awserr.Error); ok {
                // Prints out full error message, including original error if there was one.
                log.Fatal("Error:", awsErr.Error())
            } else {
                log.Fatal("Error:", err.Error())
            }
        }
    
        creds := resp.Credentials
    
        os.Setenv("AWS_ACCESS_KEY_ID",*creds.AccessKeyId)
        os.Setenv("AWS_SECRET_ACCESS_KEY",*creds.SecretAccessKey)
        os.Setenv("AWS_SESSION_TOKEN",*creds.SessionToken)
    
        execErr := syscall.Exec(cmd, args, os.Environ())
        if execErr != nil {
            panic(execErr)
        }
    }
    [MDBEncAdmin]
    aws_access_key_id=AKIAJMPPNO7EBKABCDEF
    aws_secret_access_key=pVdGwbuK5/jG64aBK1oEJOXRlkdM0aAylgabCDef
    {
     "Sid": "Allow Enable and Disable of the key",
     "Effect": "Allow",
     "Principal": {
     "AWS": "arn:aws:iam::551888181234:user/MDBEncAdmin"
     },
     "Action": [
     "kms:EnableKey",
     "kms:DisableKey"
     ]
     },
    {
     "Version": "2012-10-17",
     "Id": "key-consolepolicy-2",
     "Statement": [
     {
     "Sid": "Allow Enable and Disable of the key",
     "Effect": "Allow",
     "Principal": {
     ...
    $ cat ~/.aws/credentials
    [MDBEncAdmin]
    aws_access_key_id=AKIAJMPPNO7EBKABCDEF
    aws_secret_access_key=pVdGwbuK5/jG64aBK1oEJOXRlkdM0aAylgabCDef
    
    $ AWS_PROFILE=MDBEncAdmin aws --region us-east-1 kms disable-key --key-id arn:aws:kms:us-east-1:551888181234:key/abcdf8f6-084b-4cff-99ca-abcdef6c7907c
    [ERROR] AWS KMS plugin : GenerateDataKeyWithoutPlaintext failed : DisabledException - Unable to parse ExceptionName: DisabledException Message: arn:aws:kms:us-east-1:551888181234:key/abcdf8f6-084b-4cff-99ca-abcdef6c7907c is disabled.
    #!/usr/bin/env python
    
    import boto3
    import sys
    
    # Command-line argument processing should be more robust than this...
    action= sys.argv[1]
    mfa_token= sys.argv[2]
    
    # These should perhaps go into a config file instead of here
    mfa_serial= 'arn:aws:iam::551888181234:mfa/MDBEncAdmin'
    key_id= 'arn:aws:kms:us-east-1:551888181234:key/abcdf8f6-084b-4cff-99ca-abcdef6c7907c'
    
    # Make the connection to the Security Token Service to get temporary credentials
    token_client= boto3.client('sts')
    token_response= token_client.get_session_token(
        DurationSeconds= 900,
        SerialNumber= mfa_serial,
        TokenCode= mfa_token
    )
    
    cred= token_response['Credentials']
    
    # Start new session using temporary, MFA-authenticated credentials
    kms_session= boto3.session.Session(
        aws_access_key_id= cred['AccessKeyId'],
        aws_secret_access_key= cred['SecretAccessKey'],
        aws_session_token= cred['SessionToken'],
        region_name= key_id.split(':')[3]
    )
    
    # Start KMS client and execute operation against key
    kms_client= kms_session.client('kms')
    if action == 'enable' or action == 'e':
        action_f= kms_client.enable_key
    elif action == 'disable' or action == 'd':
        action_f= kms_client.disable_key
    else:
        raise Exception('Action must be either "disable" or "enable"')
    
    action_f(KeyId=key_id)
    $ AWS_PROFILE=MDBEncAdmin python kms-manage-key disable 575290
    $ AWS_PROFILE=MDBEncAdmin python kms-manage-key enable 799870
    {
      "detail-type": [
        "AWS API Call via CloudTrail"
      ],
      "detail": {
        "eventSource": [
          "kms.amazonaws.com"
        ],
        "errorCode": [
          "AccessDenied",
          "UnauthorizedOperation"
        ]
      }
    }
    SET GLOBAL innodb_encrypt_tables = OFF;
    SET GLOBAL innodb_encryption_threads = 4;
    SET GLOBAL innodb_encryption_rotate_key_age = 1;
    SELECT COUNT(*) AS "Number of Encrypted Tablespaces"
    FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
    WHERE ENCRYPTION_SCHEME != 0
       OR ROTATING_OR_FLUSHING != 0;
    SELECT TABLE_SCHEMA AS "Database", TABLE_NAME AS "Table"
    FROM information_schema.TABLES
    WHERE ENGINE='InnoDB' 
          AND CREATE_OPTIONS LIKE '%`ENCRYPTED`=YES%';
    SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
    FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
    WHERE NAME='db1/tab1';
    +----------+-------------------+----------------+
    | NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
    +----------+-------------------+----------------+
    | db1/tab1 |                 1 |            100 |
    +----------+-------------------+----------------+
    
    ALTER TABLE tab1
       ENCRYPTED=NO;
    
    SELECT NAME, ENCRYPTION_SCHEME, CURRENT_KEY_ID
    FROM information_schema.INNODB_TABLESPACES_ENCRYPTION
    WHERE NAME='db1/tab1';
    +----------+-------------------+----------------+
    | NAME     | ENCRYPTION_SCHEME | CURRENT_KEY_ID |
    +----------+-------------------+----------------+
    | db1/tab1 |                 0 |            100 |
    +----------+-------------------+----------------+

    Aria Encryption Overview

    MariaDB can encrypt data in tables that use the Aria storage engine. This includes both user-created tables and internal on-disk temporary tables that use the Aria storage engine. This ensures that your Aria data is only accessible through MariaDB.

    For encryption with the InnoDB and XtraDB storage engines, see Encrypting Data for InnoDB/XtraDB.

    Basic Configuration

    In order to enable encryption for tables using the Aria storage engine, there are a couple server system variables that you need to set and configure. Most users will want to set aria_encrypt_tables and encrypt_tmp_disk_tables.

    Users of data-at-rest encryption will also need to have a key management and encryption plugin configured. Some examples are File Key Management Plugin and AWS Key Management Plugin.

    Determining Whether a Table is Encrypted

    The has the that can be used to get information about which tables are encrypted. Aria does not currently have anything like that (see about that).

    To determine whether an Aria table is encrypted, you currently have to search the data file for some plain text that you know is in the data.

    For example, let's say that we have the following table:

    Then, we could search the data file that belongs to db1.aria_tab for str1 using a command-line tool, such as :

    If you can find the plain text of the string, then you know that the table is not encrypted.

    Encryption and the Aria Log

    Only Aria tables are currently encrypted. The is not yet encrypted. See about that.

    This page is licensed: CC BY-SA / Gnu FDL

    To avoid startup failures, the loose option prefix can be specified. No error is produced in case the plugin hasn't been installed yet.

    To avoid startup failures, the loose option prefix can be specified. No error is produced in case the plugin hasn't been installed yet.

    Decrypt InnoDB Tables

    When data-at-rest encryption is enabled, InnoDB tables and tablespaces are transparently encrypted and decrypted by the storage engine. In some cases, administrators may need to decrypt an InnoDB table—for example, when migrating data to an environment where encryption is not required, or when disabling encryption to simplify configuration.

    For more information, refer to, .

    [mariadb]
    ...
    
    # File Key Management
    plugin_load_add = file_key_management
    file_key_management_filename = /etc/mysql/encryption/keyfile.enc
    file_key_management_filekey = FILE:/etc/mysql/encryption/keyfile.key
    file_key_management_encryption_algorithm = AES_CTR
    
    # Aria Encryption
    aria_encrypt_tables=ON
    encrypt_tmp_disk_tables=ON
    InnoDB storage engine
    information_schema.INNODB_TABLESPACES_ENCRYPTION table
    MDEV-17324
    strings
    Aria log
    MDEV-8587
    Decrypting a Table

    To decrypt a specific InnoDB table, use the ENCRYPTION clause with ALTER TABLE:

    This statement rewrites the table in an unencrypted format.

    • If the table is stored in a file-per-table tablespace, the corresponding .ibd file is decrypted and rewritten.

    • If the table resides in the system tablespace, the data is also rewritten unencrypted.

    Decrypting All Tables in a Schema

    To decrypt all tables in a schema, you can generate and run ALTER TABLE statements programmatically:

    Copy and execute the generated statements.

    Verifying Decryption

    After decryption, you can verify the encryption status of a table with:

    If the table is unencrypted, the create_options column will not include ENCRYPTION="Y".

    MDEV-17269
    SELECT * FROM db1.aria_tab LIMIT 1;
    +----+------+
    | id | str  |
    +----+------+
    |  1 | str1 |
    +----+------+
    1 row IN SET (0.00 sec
    $ sudo strings /var/lib/mysql/db1/aria_tab.MAD | grep "str1"
    str1
    ALTER TABLE mydb.mytable ENCRYPTION='N';
    SELECT CONCAT('ALTER TABLE ', table_schema, '.', table_name, ' ENCRYPTION="N";')
    FROM information_schema.tables
    WHERE engine='InnoDB'
      AND table_schema='mydb';
    SELECT table_name, create_options
    FROM information_schema.tables
    WHERE table_schema='mydb';
    GPL 2.0 license
    encryption plugin API
    encryption plugin API
    GPL 2.0 license
    MariaDB 10.1.7
    MariaDB 10.4.9
    MariaDB 10.3.19
    MariaDB 10.2.28
    MariaDB 10.4.0
    MariaDB 10.2.6
    MariaDB 10.1.24
    MariaDB 10.1.18