▲Show HN: ToplingDB - A Persistent Key-Value Store for External Storage(github.com)
51 points by rockeetterark 9 hours ago | 10 comments
▲esafak 3 hours ago
A distributed KV-store plus a relational layer makes it a competitor to NewSQL databases like TiDB, which is also based on Facebook's RocksDB.

It doesn't look like it's very actively developed: https://github.com/topling/toplingdb/pulse/monthly

To the OP who's developing it: I suggest polishing your README. Provide a simple installation tutorial, maybe a trial offering like tidbcloud.com, and comparative benchmark results, since you advertise your performance.

▲jauntywundrkind 58 minutes ago
It's quite active. They just aren't using GitHub pull requests in their workflow, which is what GitHub Pulse measures. https://github.com/topling/toplingdb/commits/memtable_as_log...
▲dangoodmanUT 5 hours ago
Without better (english) docs it will be hard to get adoption, unfortunately. 8x perf gain over rocksdb is... a lot... unless you're poking at particularly bad metrics.
▲ozgrakkurt 3 hours ago
Would be really interesting to have faster compilation and more simplicity (auto tuning parameters etc.) compared to rocksdb. In my experience rocksdb performance is very good and it is reliable but it is a pain to integrate into the build process and has too many configurations
▲absoluteunit1 5 hours ago
For the laymen folks reading this - what are the ideal use cases for this?
▲nbf_1995 1 hour ago
Like RocksDB from which this appears to be forked, the primary usage is as a storage engine for other applications/databases. Compared to rocksdb, it seems like ToplingDB has added more facilities to better support distributed use-cases.

Some databases that utilize RocksDB for their storage engine: https://kvrocks.apache.org/ - Redis/ValKey compatible distributed database with disk persistence via RockDB. https://github.com/pingcap/tidb - MySQL compatible distributed database. Mentioned elsewhere in this thread. https://github.com/tikv/tikv - Distributed, transactional, key value store. Originally by the same company as TiDB.

In theory you could use it as an in-process KV store similar to how SQLite provides an in process sql database, but the api is far from ergonomic for that use case.

▲alexpadula 6 hours ago
Very extensive, great work on TerarkDB and Topling!
▲ 9 hours ago
▲andybak 6 hours ago
This is failing my "Can I figure out what the hell it is in 60 seconds?" test.

Sometimes that means I'm just not the target market. I do do web dev (among other things) so that doesn't seem to be the case at first glance?

▲faizshah 6 hours ago
It’s RocksDB but faster because data can be searched while still compressed allowing you to load more records in less cache/ram leading to up to 10x performance of RocksDB. It adds an embedded http control plane as well as supporting other extensions like MyRocks (MySQL) and Todis (redis compatibility).

Or at least thats what I got from it correct me if I am wrong rockeet.

▲ 6 hours ago
▲ChocolateGod 7 hours ago
I'm confused what makes this cloud native?
▲faizshah 4 hours ago
From what I gather it has an embedded http control plane, yaml/json config for plugins, prometheus integration, and distributed compaction workers on separate, potentially serverless, hosts.
▲dboreham 5 hours ago
It has an embedded http server?
▲ 7 hours ago
▲b0a04gl 4 hours ago
[dead]
▲ 4 hours ago
▲alex7o 3 hours ago
What does it have to do with external storage in this context, does it mean S3. Initially I thought it is a db for thumb drives?