Google Summer of Code 2016 - Source

You are viewing an old version of this article. View the current version here

Revision: 43399
User: colin charles
Date: 2016-03-10 08:45

We would like to participate in the [[https://summerofcode.withgoogle.com/|Google Summer of Code 2016]] (we have participated previously in [[google-summer-of-code-2015|2015]], [[google-summer-of-code-2014|2014]], and [[google-summer-of-code-2013|2013]]). The [[https://www.mariadb.org|MariaDB Foundation]] believes we are making a better database that remains application compatible with MySQL. We also work on making LGPL connectors (currently in C, Java, C++ in development) and on [[galera|MariaDB Galera Cluster]], which allows you to scale your reads & writes. Lately, we also have MariaDB MaxScale which is a pluggable database proxy.

<<toc>>

= Where to start 
Please join us at <<code>>irc.freenode.net<</code>> at #maria to mingle with the community. Don't forget to subscribe to [[https://launchpad.net/~maria-developers|maria-developers@lists.launchpad.net]] (this is the main list where we discuss development).

<<style style="display:none;">>
Please keep in mind that in April we travel a lot (conferences, busy time focusing on a release), so if you have a question and nobody on IRC answers, don't feel disappointed, ask in an email to maria-developers@lists.launchpad.net. Asking on the mailing list means others benefit from your Q&A too!
<</style>>

The complete list of tasks suggested for GSoC 2016 is located in the [[https://jira.mariadb.org/issues/?jql=labels%3Dgsoc16|MariaDB Jira]]. A subset is listed below:

== Enhancing mysqlbinlog
This project consists of two parts -- it can either be performed by 2 students or 1 student with the relevant skills:

=== Support for GTID in mysqlbinlog

The [[mysqlbinlog]] tool needs to be updated to understand the replication feature called [[global-transaction-id|Global Transaction IDs]] (GTIDs) in MariaDB 10. The current version does not support GTIDs and the MySQL variant does not speak MariaDB 10's GTIDs.

=== Remote backup of binary logs

[[mysqlbinlog]] in MySQL 5.6 also supports streaming [[binary-log|binlog]] servers for [[backing-up-and-restoring|backups]]. This is important as the MHA tool can also use this feature.

== Aggregate stored functions

With [[create-function|CREATE FUNCTION]] one can create functions in SQL, but this syntax doesn't allow one to create an aggregate function (like [[sum|SUM]], [[avg|AVG]], etc). This task is to add support for aggregate [[stored-functions|stored functions]].

== GIS enhancements

[[gis-functionality|GIS]] enhancements for 10.1 that we want to work on include adding support for altitude (the third coordinate), converters (eg. ST_GeomFromGeoJSON - ST_AsGeoJSON, ST_GeomFromKML - ST_AsKML, etc.), Getting data from SHP format (shp2sql convertor), as well as making sure we are fully OpenGIS compliant.

== Indexes for BLOBs (in MyISAM and Aria)

MyISAM and Aria support special [[storage-engine-index-types|kinds of indexes]] that only store the hash of the data in the index tree. When two hashes match in the index, the engine compares actual row data to find whether the rows are identical. This is used in internal temporary tables that the optimizer creates to resolve SELECT DISTINCT queries. Normal unique indexes cannot always be used here, because the select list can be very long or include very long strings.

This task is to provide a direct SQL interface to this feature and to allow users to create these indexes explicitly. This way we can have unique constraints for blobs and very longs strings.

== Provide GTID support for MHA
MySQL Master HA (MHA) is a tool to assist with automating master failover and slave promotion within short downtime, without suffering from replication consistency problems, and without performance penalty. We would like to have this tool support MariaDB 10 [[global-transaction-id|GTIDs]].

== Import and export popular data formats from and to dynamic columns
Provide import and export functions for popular data formats like JSON, XML (limited), PHP, ...
for Connector/C and MariaDB Server (which use same code base for dynamic columns)

== MaxScale filter to capture incoming operations for consumption in external sources
Design a filter that will capture  incoming inserts, updates and deletes, for specified tables (as regex) in a separate log file that is consumable as JSON or CSV form. So that external ETL processes can process it for data uploading into DWH or big data platform. Optionally a plugin that takes this log into a Kafka broker that can put this data on Hadoop node can be developed as next step.

== MaxScale filter to real Microsoft SQL Server syntax
Develop a MaxScale filter that will translate SQL Server syntax to MariaDB syntax. Develop a SQL Server client protocol plugin.

== Additional libraries for MaxScale's experimental Luafilter
Create additional entry points into MaxScale that the Lua side scripts can use. Various types of functions can be added ranging from
SQL processing functions to utility functions which communicate with MaxScale.

== Query Injection Filter
Create a filter which can inject queries before the client executes any queries. This filter could be used for various purposes for example auditing.

== Cassandra Storage Engine V2

Current Cassandra Storage Engine was developed against Cassandra 1.1 and it uses Thrift API to communicate with Cassandra.
However, starting from Cassandra 1.2, the preferred way to access Cassandra database is use CQL (Cassandra Query Language)
and DataStax C++ Driver (https://github.com/datastax/cpp-driver). Thrift-based access is deprecated and places heavy constraints on 
the schema.

This task is about re-implementing Cassandra Storage Engine using DataStax C++ Driver and CQL.

= Suggest a task
Are you a student interested in working on something? Let us know here.

Content reproduced on this site is the property of its respective owners, and this content is not reviewed in advance by MariaDB. The views, information and opinions expressed by this content do not necessarily represent those of MariaDB or any other party.

Google Summer of Code 2016 - Source

Products

Services

Pricing

Resources

About Us

Download MariaDB