RocksDB

RocksDB
Developer(s) Facebook
Initial release May 2012 (2012-05)
Stable release
4.9.0 / August 17, 2016 (2016-08-17)
Development status production
Written in C++
Operating system Linux, OS X, FreeBSD, Windows
Type Embedded database
License BSD 3-clause
Website www.rocksdb.org

RocksDB is a high performance[1][2][3][4][5] embedded database for key-value data. It is a fork of LevelDB which was then optimized to exploit many central processing unit (CPU) cores, and make efficient use of fast storage, such as solid-state drives (SSD), for input/output (I/O) bound workloads. It is based on a log-structured merge-tree (LSM tree) data structure. It is written in C++ and provides official application programming interface (API) language bindings for C++, C, and Java; alongside many 3rd-party language bindings. RocksDB is open-source software, released under a BSD 3-clause license.[6][7][8]

RocksDB is used in production systems at various web-scale enterprises[9] including Facebook, Yahoo!,[10] and LinkedIn.[11]

Features

RocksDB, like LevelDB, stores keys and values in arbitrary byte arrays, and data is sorted byte-wise by key or by providing a custom comparator.

RocksDB provides all of the features of LevelDB, plus:

RocksDB is not an SQL database (although #MyRocks combines RocksDB with MySQL). Like other NoSQL and Dbm stores, it has no relational data model, and it does not support SQL queries. Also, it has no direct support for secondary indexes, however a user may build their own internally using Column Families or externally. Applications use RocksDB as a library, as it does not provide a server or command-line interface.

History

RocksDB was begun at Facebook by Dhruba Borthakur[20][21] in April 2012, as a fork of LevelDB with the initial stated goal of improving performance for server workloads.[22][23]

Integration

As an embeddable database, RocksDB can be used as a storage engine within a larger database management system (DBMS). For example, CockroachDB uses RocksDB as its storage engine.[24]

Alternative Backend

The following projects have been started to replace or offer an alternative storage engines for already-established database systems with RocksDB:

MongoDB

The MongoRocks project provides a storage module for MongoDB where the storage engine is RocksDB.[25][26][27]

A related program is Rocks Strata, a tool written in Go, which allows managing incremental backups of MongoDB when RocksDB is used as the storage engine.[28]

MySQL

The MyRocks project creates a new RocksDB based storage engine for MySQL.[29][30] In-depth details about MyRocks were presented at Percona Live 2016.[31]

Embedded

The following database systems have chosen to use RocksDB as their embedded storage engine:

Dgraph

The Dgraph project uses RocksDB as the storage engine for the Dgraph NoSQLGraph Database.

SSDB

The ssdb-rocks project uses RocksDB as the storage engine for the SSDB NoSQL Database.

3rd-party Language Bindings

3rd-party programming language bindings available for RocksDB, include:

References

  1. "Performance Benchmarks". Retrieved November 29, 2015.
  2. "Benchmarking the leveldb family". Retrieved March 10, 2016.
  3. "Comparing LevelDB and RocksDB, take 2". Retrieved March 10, 2016.
  4. "Benchmarking LevelDB vs. RocksDB vs. HyperLevelDB vs. LMDB Performance for InfluxDB". Retrieved March 10, 2016.
  5. Golan-Gueta, Guy; Bortnikov, Edward; Hillel, Eschar; Keidar, Idit (April 21, 2015). "Scaling Concurrent Log-Structured Data Stores". EuroSys '15 Proceedings of the Tenth European Conference on Computer Systems. doi:10.1145/2741948.2741973.
  6. "Facebook's latest open source effort: a flash-powered database called RocksDB". Retrieved March 10, 2016.
  7. "Under the Hood: Building and open-sourcing RocksDB". Retrieved March 10, 2016.
  8. "RocksDB - Facebook's Database Now Open Source". Retrieved March 10, 2016.
  9. "Users.md". Retrieved December 1, 2015.
  10. "RocksDB on Steroids". Retrieved March 10, 2016.
  11. "Benchmarking Apache Samza: 1.2 million messages per second on a single node". Retrieved March 10, 2016.
  12. "Column families in RocksDB". GitHub. Retrieved 2016-04-04.
  13. "RocksDB bloom filters". GitHub. Retrieved 2016-04-04.
  14. "RocksDB transactions". GitHub. Retrieved 2016-04-04.
  15. "RocksDB TTL support". GitHub. Retrieved 2016-04-04.
  16. "Universal compaction". GitHub. Retrieved 2016-04-04.
  17. "RocksDB merge operator". GitHub. Retrieved 2016-04-04.
  18. "RocksDB perf context and IO stats context". GitHub. Retrieved 2016-04-04.
  19. "Spatial indexing in RocksDB « RocksDB". rocksdb.org. Retrieved 2016-04-04.
  20. "First commit where RocksDB diverges from LevelDB". May 10, 2012. Retrieved March 15, 2016.
  21. "rocksdb README file". Nov 30, 2012. Retrieved March 15, 2016.
  22. "The History of RocksDB". November 24, 2013. Retrieved March 10, 2016.
  23. Borthakur, Dhruba (November 22, 2013). "RocksDB: A High Performance Embedded Key-Value Store for Flash Storage - Data@Scale". Retrieved March 10, 2016. ... The story of why we decided to do RocksDB ...
  24. Edwards, Jessica (2015-10-29). "Hello World: Meet CockroachDB, the Resilient SQL Database". The New Stack. Retrieved 2016-07-08.
  25. MongoRocks
  26. "Integrating RocksDB with MongoDB". Retrieved December 1, 2015.
  27. "MongoDB + RocksDB at Parse". Retrieved December 1, 2015.
  28. Rocks Strata
  29. MyRocks
  30. "MyRocks: MySQL on RocksDB" (PDF). Retrieved November 29, 2015.
  31. "MyRocks Deep Dive". Retrieved May 9, 2016.
This article is issued from Wikipedia - version of the 10/20/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.