danielealbano/cachegrand logo

danielealbano/cachegrand

Free

cachegrand - a modern data ingestion, processing and serving platform built for today's hardware

FreeFree tier
Type
Open Source

About danielealbano/cachegrand

cachegrand is a high-performance key-value store and data platform designed to optimize performance on modern hardware. It features its own database engine, supports in-memory and on-disk storage, and can handle millions of operations per second with sub-millisecond latency. Currently, cachegrand supports the Redis protocol and includes a Prometheus monitoring endpoint. It plans to add Kafka, Memcache, HTTPS, AWS S3, DataDog, and other protocols, as well as WebAssembly support for server-side data processing using languages like Python and Rust. The platform is open source and still in active development, with some features (e.g., Kafka interface, WebAssembly) still in progress.

Key Features

High-performance key-value store optimized for modern hardware
Redis protocol support (currently the only fully implemented interface)
Prometheus endpoint for monitoring
Blazing fast hashtable capable of 2.1 billion records per second on a 1x AMD EPYC 7502
Vertical scaling (2x CPUs yields ~2x requests)
In-memory and on-disk storage
Support for multiple collection data types (Streams, Lists, Hashsets, Sorted Sets) - work in progress
Planned WebAssembly support for user-defined functions and event hooks
Planned support for Kafka, Memcache, HTTPS, AWS S3, DataDog, and other protocols
Ad-hoc UDP network stack based on Linux XDP (planned)

Pros & Cons

Pros
  • Extremely high throughput and low latency (millions of ops/sec, sub-millisecond)
  • Open source with permissive license
  • Supports vertical scaling efficiently
  • Compatible with widely adopted Redis protocol, easing integration
  • Planned support for multiple protocols and streaming interfaces
  • WebAssembly integration enables flexible server-side logic
Cons
  • Still in active development; many planned features (Kafka, WebAssembly) not yet implemented
  • Currently only the Redis protocol is fully supported
  • Limited documentation and community compared to established alternatives
  • Performance claims based on specific hardware benchmarks

Best For

High-performance key-value store for caching and session storageReal-time data ingestion using Kafka or Redis streaming methodsServer-side data processing with WebAssembly (e.g., Python, Rust)Streamlined real-time operations by combining ingestion, processing, and delivery in one platformStandalone use of the key-value store via Redis protocol

FAQ

What protocols does cachegrand currently support?
Currently, cachegrand supports only the Redis protocol for the key-value store. Support for Kafka, Memcache, HTTPS, and others is planned.
Is cachegrand production-ready?
Cachegrand is still in development. While its core key-value store with Redis protocol is functional, many planned features are still being worked on.
Can I use cachegrand as just a key-value store?
Yes, cachegrand can be used as a standalone high-performance key-value store via the Redis protocol, without the streaming or WebAssembly components.
What performance can I expect from cachegrand?
Cachegrand is designed for high performance. Benchmarks mention a hashtable capable of 2.1 billion records per second on a single AMD EPYC 7502 processor, with sub-millisecond latency.
Does cachegrand support on-disk storage?
Yes, cachegrand supports both in-memory and on-disk storage.