Justin Swanhart

is creating the WARP storage engine and analytics extensions for MySQL

Select a membership level

Open source supporter

$5
per month
Support WarpSQL development through a small monthly contribution.
Includes Discord benefits
  • Access to packages for currently supported Linux distributions
  • Patron-only posts and messages

Open source supporter II

$25
per month
Provide even more support to WarpSQL open source development. 

Influence WarpSQL development by participation in voting for priority of new features.
Includes Discord benefits
  • Patron-only voting power for priority of new features.
  • Patron-only posts and messages
  • Access to packages for currently supported Linux distributions

Open Source supporter III

$50
per month
Be an open source hero, and support WarpSQL development.

Influence WarpSQL development by participation in voting for priority of new features.

Your name will be featured in the WarpSQL README file upon request.
Includes Discord benefits
  • Patron-only posts and messages
  • Access to packages for currently supported Linux distributions
  • Patron-only voting power for priority of new features.
  • Mention in the WarpSQL README if desired

8

patrons

About

WarpSQL is an open source distribution of MySQL.

WarpSQL is not intended to be a hard fork of MySQL like MariaDB, but is more like Percona Server, which is an enhanced MySQL server which strives to be nearly 100% compatible with upstream MySQL. WarpSQL features the WARP storage engine.

WARP storage engine

The WARP storage engine is a columnar storage engine with compressed bitmap indexes, based on a fork of Fastbit.  WarpSQL is an adaptation of Fastbit to the MySQL database pluggable storage engine interface. WARP both horizontally and vertically partitions data sets automatically. Standard MySQL partitioning is not yet supported. Data compression is not yet supported.

Columnar storage

WARP stores data for different columns separately on disk.  This is known as columnar storage and differs from other MySQL storage engines which store all of the row data together on disk, which is known as row storage.  Column stores reduce the amount of IO necessary to answer queries that read only a subset of columns from the disk.  By optimizing IO, WARP allows faster querying of data sets that are many times larger than available RAM.  For efficient querying and indexing, most row stores require the data set to fit inside of the database cache, which is typically 80% of available RAM.

WAH compressed bitmap indexing

WARP supports compressed bitmaps indexes which do not require decompression for most query processing.  On 500MB of integer data, a WAH compressed bitmap may require only 5MB of disk usage.  WARP can evaluate complex query conditions which can not be answered efficiently (or at all) by traditional RDBMS btree indexing methods.  WARP is the only available open source SQL RDBMS with WAH compressed bitmap indexes.  WARP can often efficiently answer queries hundreds of times faster than traditional btree indexing methods.  

WARP can combine indexes to answer queries

Bitmap indexes can be combined for efficient searching.  MySQL typically can use only one index to answer a query.  WARP can efficiently index a large number of columns and combine the indexes to return amazingly fast query results.

Automatic indexing

WARP automatically indexes any fields that are used in queries.  This means data sets can be loaded and then queried with fantastic results without planning ahead about which fields need to be indexes.  When desired, columns can be excluded from automatic indexing, or specific bitmap index methods can be specified for columns such as multi-level bitmap indexes.  These multi-level bitmap indexes can be up to 10x faster than commercial bitmap indexing methods in many cases.

Become a patron to

2
Unlock 2 exclusive posts
Be part of the community
Connect via private message

Recent posts by Justin Swanhart

How it works

Get started in 2 minutes

Choose a membership
Sign up
Add a payment method
Get benefits