Google Summer of Code 2015
We intend to participate in the Google Summer of Code 2015. MariaDB and the MariaDB Foundation believe we are making a better database that remains a drop-in replacement to MySQL. We also work on making LGPL connectors (currently in C, Java, C++ in development) and on MariaDB Galera Cluster, which allows you to scale your reads & writes. Lately, we also have MariaDB MaxScale which is a pluggable database proxy.
- Where to start
- Some suggested projects
- Enhancing mysqlbinlog
- Indexes on virtual columns
- UDFs returning arrays
- GIS enhancements
- Query rewrite plugin API
- User defined events
- Port InnoDB memcached interface to MariaDB
- Automatic provisioning of slave
- Indexes for BLOBs (in MyISAM and Aria)
- Provide GTID support for MHA
- MaxScale filter to capture incoming operations for consumption in external sources
- MaxScale filter to real Microsoft SQL Server syntax
- Suggest a task
Where to start
Please join us at
irc.freenode.net at #maria to mingle with the community. Don't forget to subscribe to email@example.com (this is the main list where we discuss development).
At the moment, tasks that may be suitable for GSoC 2015 are listed in the MariaDB Issue Tracker under «GSoC 2015 tasks»
Some suggested projects
This project consists of two parts -- it can either be performed by 2 students or 1 student with the relevant skills:
Support for GTID in mysqlbinlog
The mysqlbinlog tool needs to be updated to understand the replication feature called Global Transaction IDs (GTIDs) in MariaDB 10. The current version does not support GTIDs and the MySQL variant does not speak MariaDB 10's GTIDs.
Remote backup of binary logs
mysqlbinlog in MySQL 5.6 also supports streaming binlog servers for backups. This is important as the MHA tool can also use this feature.
Indexes on virtual columns
We have the concept of virtual (non-materialized) columns, and currently to have an index on a virtual column one has to materialize it. To support indexes on fully virtual columns, a storage engine must call back into the server to calculate the value of the virtual column.
UDFs returning arrays
Having the possibility that User Defined Functions (UDFs) to return arrays / result sets would be a nice feature to have. A possible implementation could be: the UDF exports a generator, we create a handler of the hidden "storage engine" class, no indexes, and convert this generator to rnd_init/rnd_next. Need to disable rnd_pos somehow.
GIS enhancements for 10.1 that we want to work on include adding support for altitude (the third coordinate), converters (eg. ST_GeomFromGeoJSON - ST_AsGeoJSON, ST_GeomFromKML - ST_AsKML, etc.), Getting data from SHP format (shp2sql convertor), as well as making sure we are fully OpenGIS compliant.
Query rewrite plugin API
The task is to create a plugin API and an example plugin to do query transformations. This API should not force plugin to parse or work with the SQL string. Instead it may provide a DOM-like representation of the query and let the plugin to manipulate the tree nodes.
User defined events
User defined events are supported on several other databases in different form and semantics (like DB2, PostgreSQL, etc.). Events are used to signal an named event in the database. Applications can use named events instead of polling, which uses more resources.
Port InnoDB memcached interface to MariaDB
MySQL 5.6 has a memcached plugin to InnoDB. MySQL 5.7 has improved performance of this. The task would be to port this to run against MariaDB, and make it work against XtraDB/InnoDB for the 10.2 series of MariaDB.
Automatic provisioning of slave
The purpose of this task is to create an easy-to-use facility for setting up a new MariaDB replication slave.
Indexes for BLOBs (in MyISAM and Aria)
MyISAM and Aria support special kinds of indexes that only store the hash of the data in the index tree. When two hashes match in the index, the engine compares actual row data to find whether the rows are identical. This is used in internal temporary tables that the optimizer creates to resolve SELECT DISTINCT queries. Normal unique indexes cannot always be used here, because the select list can be very long or include very long strings.
This task is to provide a direct SQL interface to this feature and to allow users to create these indexes explicitly. This way we can have unique constraints for blobs and very longs strings.
Provide GTID support for MHA
MySQL Master HA (MHA) is a tool to assist with automating master failover and slave promotion within short downtime, without suffering from replication consistency problems, and without performance penalty. We would like to have this tool support MariaDB 10 GTIDs.
MaxScale filter to capture incoming operations for consumption in external sources
Design a filter that will capture incoming inserts, updates and deletes, for specified tables (as regex) in a separate log file that is consumable as JSON or CSV form. So that external ETL processes can process it for data uploading into DWH or big data platform. Optionally a plugin that takes this log into a Kafka broker that can put this data on Hadoop node can be developed as next step.
MaxScale filter to real Microsoft SQL Server syntax
Develop a MaxScale filter that will translate SQL Server syntax to MariaDB syntax. Develop a SQL Server client protocol plugin.
|Mentor:||Markus Makela & Massimiliano Pinto|
Suggest a task
Are you a student interested in working on something? Let us know here.