shikhar

Redis is what you'd turn to when you need lots of streams. Then you have to deal with the memory implications. No more! Bringing you bottomless Redis Streams on S3.

we took gists and made them live!

You can now use S2 as a backend for Mastra Durable Agents! The @ s2-dev/mastra-pubsub adapter maps each durable topic to an S2 stream, with live delivery, replay after refreshes or process restarts, and distributed leases for coordinating thread ownership across processes.

no reliability without durability

S2 source and sink plugins are now available for Streamling. Read durable S2 streams into Arrow batches, or write Streamling output back to S2. ClickHouse ingestion, Postgres CDC, and a full Postgres → S2 → ClickHouse example: s2.dev/docs/integr...

me deciphering llmese

thinking about a single-digit ms storage class for @s2.dev it's a plunge from just being s3-based, but gotta do what you gotta do?

try the notion or gdocs experience in a regular editor!

literally serving off his Jetson: streamtts.dev

Seems like Local AI is getting more and more relevant, so I wrote about it! s2.dev/blog/local-ai

If you have wondered whether to use the s2.dev cloud service, or self-host s2-lite (github.com/s2-streamstore/s2) – s2.dev/docs/s2-lite...

Cargo.lock +40 -1,142 nbd just @sbalogh.bsky.social replacing polars with csv

Serverless gets clowned on sometimes (ha ha, there are servers) but is ultimately about pricing usage and not having to provision resources you don't use, or think about such things as "clusters". It is genuinely hard for stateful services, but I don't think there is a better DevX.

turns out "stream per session" is not just for agents. it works for browser sessions too. built RePlaya, a self-hosted session replay tool where each visit is just an @s2.dev stream you can play back or tail live. recording = append playback = read live replay = tail github.com/s2-streamsto...

Streams as a cloud storage primitive, now in more places. S2 is the serverless API for unlimited, durable, real-time streams. Today, we're adding US West and EU North as new basin locations. s2.dev/blog/locatio...

You can plug @s2.dev into your anthropic sdk based chat app and make your chats durable!

oh and tanstack ai too!

Maybe QUIC is an opening for a gRPC challenger. I would call it Spooky. For spooky action at a distance, the outmoded critique of RPC.

On the retirement of S2's gRPC API, realized how to describe our current API: REST-first. REST undersells, it supports append & read sessions over HTTP/2 similar to gRPC. We'll do HTTP/3 too when the ecosystem is ready.

maybe it's not too surprising plaintext can be competitive with vector dbs when you consider agents effectively do semantic grep by query expansion

@s2.dev now supports client-supplied encryption keys for durable streams. Bring your own per-request key, keep key material out of S2 storage and logs, and let S2 handle request-time encryption behind the stream API. s2.dev/blog/encrypt...

Today I felt like a cigarette. I have to say "coding" agents are a champ at operational investigation.

Make your aisdk chat app crash proof by using s2.dev as the persistence layer behind useChat!

gotta constraint to innovate

new Dart SDK for @s2.dev from the community: pub.dev/packages/s2_...

This is video conferencing on S2, but also... video conferencing on S3. Really shows off the power of pipelining writes!

Pipelining is now default in latest s2-lite! 8x increase in throughput and 6x lower latency when running against an S3 standard bucket.

There's two new ways to manage S2 as code! The Terraform provider lets you manage resources with full lifecycle support. Available on the Terraform Registry at s2-streamstore/s2. Or you can use the CLI by `s2 apply` which takes a declarative JSON spec and creates/reconfigures specified resources.

Excited to enable pipelining by default in s2-lite with this upgrade! Expect lower latency and higher throughput. github.com/s2-streamsto...

The s2.dev dashboard now has a Data Plane studio to make it convenient to work with streams. You can: -Do one-shot reads, live tail from any stream, start from an offset, seq no., or timestamp -Append records in multiple modes -Run stream commands -Inspect records with command record aware rendering

The S2 cloud service is now GA! We also raised a $3.85M seed round led by Accel with participation from Y Combinator, and other funds and angels like @t3.gg @chris.blue @fulmicoton.bsky.social s2.dev/blog/ga

It was fun to run multi-agent research cohorts and have them connect over durable streams, making infinitely many reasoning topologies possible!

Curious about the architecture of S2? This is how we cook infinite durable streams for you.

just got finished no-lifing on building a TUI for s2, wdyt?

s2-lite is here – an open source @s2.dev Stream Store! It's a single binary you can run anywhere. Powered by SlateDB, so you can point it at an object storage bucket for durable streams with real-time reads. github.com/s2-streamsto...

www.youtube.com/watch?v=21EY...

The era of experience calls for event sourcing via paper by David Silver and Richard Sutton, storage.googleapis.com/deepmind-med...