Awesome Go

liftbridge

CategoryDistributed Systems
SubcategoryDistributed Systems
Stars0

Lightweight, fault-tolerant message streams for NATS

About liftbridge

Liftbridge Logo

Build License ReportCard Go Version

Liftbridge provides lightweight, fault-tolerant message streams by implementing a durable, replicated, and scalable message log. The vision for Liftbridge is to deliver a "Kafka-lite" solution designed with the Go community first in mind. Unlike Kafka, which is built on the JVM and whose canonical client library is Java (or the C-based librdkafka), Liftbridge and its canonical client, go-liftbridge, are implemented in Go. The ultimate goal of Liftbridge is to provide a lightweight message-streaming solution with a focus on simplicity and usability. Use it as a simpler and lighter alternative to systems like Kafka and Pulsar or to add streaming semantics to an existing NATS deployment.

See the introduction post on Liftbridge and this post for more context and some of the inspiration behind it.

Maintainers

This project is maintained by Basekick Labs, creators of Arc.

Requirements

  • Go 1.25.6+
  • NATS Server v2.10.0+

Documentation

Performance

Liftbridge delivers high-throughput message ingestion with durable storage. The following benchmarks were run on a single node with replication factor 1:

ConfigurationThroughputLatency (P99)
1 publisher, synchronous~30K msgs/sec306µs
1 publisher, pub-batch=100~139K msgs/sec1.0ms
4 publishers, pub-batch=100~241K msgs/sec2.0ms
256 publishers, synchronous~200K msgs/sec1.4ms

For comparison, NATS JetStream achieves ~220K msgs/sec with similar settings (pubbatch=100, file storage, RF=1).

Running Benchmarks

# Producer benchmark with async batching (recommended for high throughput)
go run ./bench/producer \
  --servers localhost:9292 \
  --messages 100000 \
  --message-size 256 \
  --concurrent 4 \
  --pub-batch 100 \
  --ack-policy leader \
  --create-stream

# Consumer benchmark
go run ./bench/consumer \
  --servers localhost:9292 \
  --stream bench-stream \
  --expected 100000

Community

Frequently Asked Questions

What is liftbridge?

liftbridge is a Distributed Systems library for the Go programming language. Lightweight, fault-tolerant message streams for NATS

How do I install liftbridge?

Install liftbridge with the Go module system using `go get liftbridge-io/liftbridge`. Check the repository for the current installation instructions.

What category does liftbridge belong to?

liftbridge is listed under Distributed Systems, specifically Distributed Systems.

← Back to Distributed Systems