Moving Data Between SQL Server and MariaDB

There are several ways to move data between SQL Server and MariaDB. Here we will discuss them and we will highlight some caveats.

Moving Data Definition from SQL Server to MariaDB

To copy SQL Server data structures to MariaDB, one has to:

1. Generate a CSV file from SQL Server data.

2. Modify the syntax so that it works in MariaDB.

3. Run the file in MariaDB.

Variables That Affect DDL Statements

DDL statements are affected by some server system variables.

determines the behavior of some SQL statements and expressions, including how strict error checking is, and some details regarding the syntax. Objects like , and , are always executed with the sql_mode that was in effect during their creation. can be used to have MariaDB behaving as close to SQL Server as possible.

enables the so-called InnoDB strict mode. Normally some errors in the options are ignored. When InnoDB strict mode is enabled, the creation of InnoDB tables will fail with an error when certain mistakes are made.

determines whether view updates can be made with an or statement with a LIMIT clause if the view does not contain all primary or not null unique key columns from the underlying table.

Dumps and sys.sql_modules

SQL Server Management Studio allows one to create a working SQL script to recreate a database - something that MariaDB users refer to as a dump. Several options allow fine-tuning the generated syntax. It could be necessary to adjust some of these options to make the output compatible with MariaDB. It is possible to export schemas, data or both. One can create a single global file, or one file for each exported object. Normally, producing a single file is more practical.

Alternatively, the procedure returns information about how to recreate a certain object. Similar information is also present in the table (definition column), in the sys schema. Such information, however, is not a ready-to-use set of SQL statements.

Remember however that . An SQL Server schema is approximately a MariaDB database.

To execute a dump, we can pass the file to , the MariaDB command-line client.

Provided that a dump file contains syntax that is valid in MariaDB, it can be executed in this way:

--show-warnings tells MariaDB to output any warnings produced by the statements contained in the dump. Without this option, warnings will not appear on screen. Warnings don't stop the dump execution.

Errors will appear on screen. Errors will stop the dump execution, unless the --force option (or just -f) is specified.

For other mariadb options, see .

Another way to achieve the same purpose is to start the mariadb client in interactive mode first, and then run the source command. For example:

In this case, to show warnings we used the \W command, where "w" is uppercase. To hide warnings (which is the default), we can use \w (lowercase).

For other mariadb commands, see .

CSV Data

If the table structures are already in MariaDB, we need only to import table data. While this can still be done as explained above, it may be more practical to export CSV files from SQL Server and import them into MariaDB.

SQL Server Management Studio and several other Microsoft tools allow one to export CSV files.

MariaDB allows importing CSV files with the statement, which is essentially the MariaDB equivalent of BULK INSERT.

It can happen that we don't want to import the whole data, but some filtered or transformed version of it. In that case, we may prefer to use the storage engine to access CSV files and query them. The results of a query can be inserted into a table using .

Moving Data from MariaDB to SQL Server

There are several ways to move data from MariaDB to SQL Server:

• If the tables don't exist at all in SQL Server, we need to generate a dump first. The dump can include data or not.

• If the tables are already in SQL Server, we can use CSV files instead of dumps to move the rows. CSV files are the most concise format to move data between different technologies.

• With the tables already in SQL Server, another way to move data is to insert the rows into tables that "point" to remote SQL Server tables.

Using a Dump (Structure)

can be used to generate dumps of all databases, a specified database, or a set of tables. It is even possible to only dump a set of rows by specifying the WHERE clause.

By specifying the --no-data option we can dump the table structures without data.

--compatible=mssql will produce an output that should be usable in SQL Server.

Using a Dump (Data)

mariadb-dump by default produces an output with both data and structure.

--no-create-info can be used to skip the statements.

--compatible=mssql will produce an output that should be usable in SQL Server.

--single-transaction should be specified to select the source data in a single transaction, so that a consistent dump is produced.

--quick speeds up the dump process when dumping big tables.

Using a CSV File

CSV files can also be used to export data to SQL Server. There are several ways to produce CSV files from MariaDB:

• The statement.

• The storage engine, with the .

• The storage engine (note that it doesn't support NULL and indexes).

Using CONNECT Tables

The storage engine allows one to access external data, in many forms:

• (, , , HTML and more).

• Remote databases, using the or standards, or .

• Some .

CONNECT was mentioned previously because it could allow one to read a CSV file and query it in SQL, filtering and transforming the data that we want to move into regular MariaDB tables.

However, CONNECT can also access remote SQL Server tables. We can read data from it, or even write data.

To enable CONNECT to work with SQL Server, we need to fulfill these requirements:

• Install the ODBC driver, downloadable form website. The driver is also available for Linux and MacOS.

• Install .

• (unless it is already installed).

Here is an example of a CONNECT table that points to a SQL Server table:

The key points here are:

• ENGINE=CONNECT tells MariaDB that we want to create a CONNECT table.

• TABLE_TYPE must be 'ODBC', so CONNECT knows what type of data source it has to use.

• CONNECTION is the connection string to use, including server address, username and password.

CONNECT is able to query SQL Server to find out the remote table structure. We can use this feature to avoid specifying the column names and types:

However, we may prefer to manually specify the MariaDB types, sizes and character sets to use.

Linked Server

Instead of using MariaDB CONNECT, it is possible to use SQL Server Linked Server functionality. This will allow one to read data from a remote MariaDB database and copy it into local SQL Server tables. However, note that CONNECT allows more control on mapping.

Refer to section in Microsoft documentation.

_{This page is licensed: CC BY-SA / Gnu FDL}