The Ultimate Guide to High Availability with MariaDB

Plugins & Storage Engines Summit for MySQL/MariaDB/Drizzle 2011

You are viewing an old version of this article. View the current version here.

Continuing the tradition of having a storage engine summit (see notes from 2010) after the O'Reilly MySQL Conference, this year it has been decided that the focus of the summit to be expanded.

Location

The Facebook Campus, 1601 S. California Ave. Palo Alto, CA 94304.

For directions, use Google Maps. However, if you're at the O'Reilly MySQL Conference, you can take the light rail from the conference center to Mountain View and then Caltrain from Mountain View to the California Ave exit and then walk 1 mile to the Facebook campus.

Date and Time

April 15 2011, from 10am - 4pm. Lunch will be served, courtesy of Facebook.

Target Audience

Developers who are writing storage engines and plugins, knowing the plugin architecture of either MySQL, the extensions in MariaDB as well as the differences in Drizzle. User defined function (UDF) writers are welcome too.

Its expanded from just an invited audience of MySQL storage engine vendors this year.

Seats are limited to twenty-four (24) attendees.

Who's Attending

If you're attending, this is the signup form! Please fill up your name, email address, company, and any other contact information you may have (like Facebook, Twitter). You will need to login to the Knowledgebase (OpenID login is available).

  1. Michael "Monty" Widenius, monty at askmonty dot org, Monty Program Ab
  2. Sergei Golubchik, serg at askmonty dot org, Monty Program Ab
  3. Colin Charles, colin at montyprogram dot com, Monty Program Ab, @bytebot, fb:bytebot
  4. Zardosht Kasheff, zardosht at gmail dot com, Tokutek
  5. Mark Callaghan, mdcallag at gmail dot com, Facebook
  6. Paul McCullagh, paul dot mccullagh at primebase dot org, PrimeBase
  7. Konstantin Osipov, kostja dot osipov at gmail dot com, Mail.Ru
  8. Oleksandr "Sanja" Byelkin, sanja at askmonty dot org, Monty Program Ab
  9. Bradley C. Kuszmaul, bradley@tokutek.com, Tokutek
  10. Felix Schupp, felix.schupp@softmethod.de, BlackRay Data Engine, fb:fschupp
  11. Hartmut Holzgraefe, hartmut@php,net
  12. Timour Katchaounov, timour at askmonty dot org, Monty Program Ab
  13. praburam upendran, ramu@scaledb.com, scaledb
  14. Rich Kelm, richard at sphinxsearch dot com, Sphinx Search
  15. Antony T Curtis, atcurtis at gmail dot com, Blizzard Entertainment and Open Query.
  16. Daijiro MORI, morita at razil dot jp, Brazil Inc.
  17. Tasuku SUENAGA, a at razil dot jp, Brazil Inc.
  18. Kentoku SHIBA, kentokushiba at gmail dot com, WildGrowth
  19. Peter Zaitsev, peter at percona dot com, Percona
  20. Vadim Tkachenko, vadim at percona dot com, Percona
  21. Louis Fahrberger, louis.fahrberger at infobright dot com, Infobright
  22. Sergey Petrunya, psergey at askmonty.org, Monty Program Ab
  23. Serge Frezefond
  24. Igor Babaev, igor at askmonty.org Monty Program Ab
  25. Volker Oboda, PrimeBase
  26. Jeff Rothschild, Facebook
  27. Rasmus Johansson, Monty Program Ab
  28. Moshe Shadmon, ScaleDB
  29. Chip Turner, Facebook

Notes

Linking with the Storage Engine Advisory Board at Oracle

Volker Odoba - member of the storage engine advisory board at Oracle

  • an explanation from Oracle as to why/if/when Oracle will take patches to extend the storage engine layer from the community
  • its been mentioned that you might have to pay to be on the advisory board (i.e. you must be a customer)
  • next meeting is at Oracle OpenWorld in October
  • Schooner, Primebase, InnoDB, Infobright, Kickfire was there (now no longer since they do not exist)

Topics

  • HBase storage engine layer to work with dynamic columns
  • Discovery (Shared metadata)
  • Materialised views
  • Online ALTER TABLE
  • Parallel replication (not SE, but a related topic)
  • Group commit
  • Parallel execution
  • Fulltext search for every storage engine
  • Cross-engine Online Backup
  • Finish off server definition interface for FederatedX. Make it generic enough so that Spider can also use it.
  • Pluggable data types

HBase by Chip Turner

Distributed key value store. Single index on a given table. Distributed servers each serving a row, multiple rows. Lexicographically sorted. No C API, there's a proxy API and Chip is fixing that now. Current protocol is serialized Java. Eventually each HBase server will speak Thrift. See http://wiki.apache.org/hadoop/Hbase/ThriftApi and http://incubator.apache.org/thrift/

Index Condition Pushdown and MRR are useful here.

Messages is a HBase application.

Index Condition Pushdown

  • idx_cond_push()
  • opt_index_condition_pushdown.cc
  • EXPLAIN will say Using index condition
  • Don't copy HA_NDBCLUSTER::COND_PUSH() since it is not done in a seinsble way. Much smarter implementations are possible with easy code - psergey
  • This will be continued in discussion via email (sphinx, infobright, tokutek, spider, oqgraph)
    • TODO: Timour will create a Worklog entry and involve appropriate attendees

Comments

Comments loading...
Content reproduced on this site is the property of its respective owners, and this content is not reviewed in advance by MariaDB. The views, information and opinions expressed by this content do not necessarily represent those of MariaDB or any other party.