CONNECT TBL Table Type: Table List

You are viewing an old version of this article. View the current version here.

This type allows defining a table as a list of tables of any engine and type. This is more flexible than multiple tables that must be all of the same file type. This type does, but is more powerful than, what is done with the MERGE engine.

The list of the columns of the TBL table may not necessarily include all the columns of the tables of the list. If the name of some columns is different in the sub-tables, the column to use can be specified by its position given by the FLAG option of the column. If the ACCEPT option is set to true (Y or 1) columns that do not exist in some of the sub-tables are accepted and their value will be null or pseudo-null (this depends on the nullability of the column) for the tables not having this column. The column types can also be different and an automatic conversion will be done if necessary.

Note: If not specified, the column definitions are retrieved from the first table of the table list.

The default database of the sub-tables is the current database or if not, can be specified in the DBNAME option. For the tables that are not in the default database, this can be specified in the table list. For instance, to create a table based on the French table employe in the current database and on the English table employee of the db2 database, the syntax of the create statement can be:

CREATE TABLE allemp (
  SERIALNO char(5) NOT NULL flag=1,
  NAME varchar(12) NOT NULL flag=2,
  SEX smallint(1),
  TITLE varchar(15) NOT NULL flag=3,
  MANAGER char(5) DEFAULT NULL flag=4,
  DEPARTMENT char(4) NOT NULL flag=5,
  SECRETARY char(5) DEFAULT NULL flag=6,
  SALARY double(8,2) NOT NULL flag=7)
ENGINE=CONNECT table_type=TBL
table_list='employe,db2.employee' option_list='Accept=1';

The search for columns in sub tables is done by name and, if they exist with a different name, by their position given by a not null FLAG option. Column sex exists only in the English table (FLAG is 0). Its values will null value for the French table.

For instance, the query:

select name, sex, title, salary from allemp where department = 318;

Can reply:

NAMESEXTITLESALARY
BARBOUDNULLVENDEUR9700.00
MARCHANTNULLVENDEUR8800.00
MINIARDNULLADMINISTRATIF7500.00
POUPINNULLINGENIEUR7450.00
ANTERPENULLINGENIEUR6850.00
LOULOUTENULLSECRETAIRE4900.00
TARTINENULLOPERATRICE2800.00
WERTHERNULLDIRECTEUR14500.00
VOITURINNULLVENDEUR10130.00
BANCROFT2SALESMAN9600.00
MERCHANT1SALESMAN8700.00
SHRINKY2ADMINISTRATOR7500.00
WALTER1ENGINEER7400.00
TONGHO1ENGINEER6800.00
HONEY2SECRETARY4900.00
PLUMHEAD2TYPIST2800.00
WERTHER1DIRECTOR14500.00
WHEELFOR1SALESMAN10030.00

The first 9 rows, coming from the French table, have a null for the sex value. They would have 0 if the sex column had been created NOT NULL.

Sub-tables of not CONNECT engines

Sub-tables are accessed as PROXY tables. For not CONNECT sub-tables that are accessed via the MySQL API, it is possible like with PROXY to change the MYSQL default options. Of course, this will apply to all not CONNECT tables of the list.

Using the TABID special column

The TABID special column can be used to see from which table the rows come from and to restrict the access to only some of the sub-tables.

Let us see the following example where t1 and t2 are MyISAM tables similar to the ones given in the MERGE description:

create table xt1 (
  a int(11) not null,
  message char(20))
engine=CONNECT table_type=MYSQL tabname='t1'
option_list='database=test,user=root';

create table xt2 (
  a int(11) not null,
  message char(20))
engine=CONNECT table_type=MYSQL tabname='t2'
option_list='database=test,user=root';

create table toto (
  tabname char(8) not null special='TABID',
  a int(11) not null,
  message char(20))
engine=CONNECT table_type=TBL table_list='xt1,xt2';

select * from total;

The result returned by the SELECT statement is:

tabnameamessage
xt11Testing
xt12table
xt13t1
xt21Testing
xt22table
xt23t2

Now if you send the query:

select * from total where tabname = 'xt2';

CONNECT will analyze the where clause and only read the xt1 table. This can save time if you want to retrieve only a few sub-tables from a TBL table containing many sub-tables.

Parallel Execution

Parallel Execution is currently unavailable until some bugs are fixed.

When the sub-tables are located on different servers, it is possible to execute the remote queries simultaneously instead of sequentially. To enable this, set the thread option to yes.

Additional options available for this table type:

OptionDescription
MaxerrThe max number of missing tables in the table list before an error is raised. Defaults to 0.
AcceptIf true, missing columns are accepted and return null values. Defaults to false.
ThreadIf true, enables parallel execution of remote sub-tables.

These options can be specified in the OPTION_LIST.

    Comments

     
    10 years, 11 months ago John Zobolas

    Hi!

    I was trying to use Connect engine to "connect" two TokuDB tables with exact the same structure (i have done this successfully with 2 MyISAM tables and Merge Engine) to gain the parallel insertion speed of such an employment (insert to two underlying tables, query the one who "sees" them - Merge/Connect).

    With the Merge engine setup, the only difference was that i had to make the auto_increment primary key of the 2 MyISAM tables into a simple key in the definition of the Merge table. Sadly, that was not the case with the setup on the Connect table. Issues i encountered were:

    1)Storage engine CONNECT doesn't support AUTO_INCREMENT columns. (i just erased this index from both the TokuDB tables and the Connect one - its for testing so no problem) 2)Unknown option 'CLUSTERING': the 2 underlying TokuDB tables had 5 clustering indexes each (defined the same) and at the definition of the Connect TBL type table this was not recognised. (i just erased the clustering=YES to the table schema of the Connect table) 3) Table handler doesn't support NULL in given index ->Why not! But well i changed some of the definitions i had: column int(3) default null, to: column int(3) not null default '0', and not a problem anymore. 4)After all that, i got the: Query OK, 0 rows affected (0.00 sec) (the loaded table schema for Connect engine was OK), but when i executed: show table status; i got -> ERROR 2013 (HY000): Lost connection to MySQL server during query. I suppose this happens because the Connect engine is corrupted or something!!!

    Is there any suggestion that may make my setup functional using the new Connect engine?

    Thanks, John.

     
    10 years, 11 months ago John Zobolas

    I forgot to mention that between the 3th and 4th step, i got the error: ERROR 1105 (HY000): Table type TBL is not indexable!!! and after that, i just deleted all the indexes from the Connect table schema and then i got the 4th (last) problem.

     
    Content reproduced on this site is the property of its respective owners, and this content is not reviewed in advance by MariaDB. The views, information and opinions expressed by this content do not necessarily represent those of MariaDB or any other party.
    Back to Top