Boost Your Replication Throughput with Parallel Apply, Prefetch, and Batching
------------------------------------------------------
Slave lag is the bane master/slave replication. This talk will explain why slave lag occurs and show you three important ways that Tungsten Replicator can banish it for MySQL slaves. Parallel apply uses multiple threads to execute slave transactions. Prefetch uses parallel threads to read ahead of the slave position and fetch pages that will be needed by the slave. Batching uses CSV files to load row updates in extremely large transactions that bypass SQL completely. We will explain each technique, show you how to use it, and provide performance numbers that illustrate the gain you can expect. We will round the talk out with a discussion of non-Tungsten tools that offer similar benefits. With these techniques in hand, you'll be well-prepared to attack any replication performance problem.
The talk taken by Robert Hodges with Stephane Giron, was as expected very interesting, and give to the audience a good insight abut how to implement Replicator efficiently.
I also think that at the current moment Continuent Replicator, is the only production ready solution that can be use for:
- Parallel replication by schema (or combination of them)
- Multi master one slave solution
- on process filtering and data processing
- Oracle to MySQL
- MySQL to oracle.
I enjoy it, and I have immediate plan to use the solution for solving current customer need.
I am in particular interested in the FILTER option, and to see how it can really become helpful when talking of data processing.
Finally a small note some times ago I publish a blog describing a dream about replication, my dream, and Rob was the only one of the mega-expert in the fields, who honors me with an answer and a good explanation why it could not work, at the current state of arts.
My blog
http://www.tusacentral.net/joomla/index.php/mysql-blogs/96-a-dream-on-mysql-parallel-replication
Rob clear and really appreciated explanation
http://scale-out-blog.blogspot.ca/2011/03/parallel-replication-using-shards-is.html