Jaz

Jaz

@jaz.sh

Jasmine (Jaz) Gender Nomad IRC made me gay Reject drab, wear bright colors and play fast Former Platform Engineering Lead at Bsky 29. she/her 🏳️‍⚧️ BSky Stats- https://bsky.jazco.dev/stats https://github.com/jazware

64.4K followers378 following6.8K posts

Pinned

Hi protocol friends! I've been cooking up a Very Large PDS (vlpds) implementation capable of scaling up to billions of accounts and down to just one. It uses Object Storage as its only state, supports HA operation, live scaling up and down, is feature-complete with the reference PDS, and is FOSS.

vlpds.jazco.devOverview · vlpds docsAn atproto PDS whose only durable storage is an object store. Any node serves any request, one node can run a personal server for free, and a few nodes can carry all of Bluesky's write load.

Jaz reposted

its not possible to watch this video without smiling really wide

Alex Warth@alexwarth.bsky.social

Yesterday I made a “plaything” for Igarashi et al.’s excellent SIGGRAPH 2005 paper, As-Rigid-As-Possible Shape Manipulation! Works with a mouse, but it’s much more fun with multi-touch on an iPad. Link below 👇

Jaz reposted

don't make me tap the sign thepope.dev/posts/2026-1...

thepope.devspencer is a girl's namemy name is spencer. it's a girl's name. i have been using it as one. it's also a boy's name. in the US, considerably more boys than girls are given it. i understand why someone reading my name might p
EXtraDonut@extradonut.bsky.social

this fucking guy says this when we can clearly see OnlyFans and other websites like it get blocked but Pornhub, THE porn website, is not. get the fuck outta here you need more time. what a shitty excuse for shitty policy and feature implementation.

Jaz reposted

Replying to @thebadcode.com

free foot pics because you made a fridge whose door falls off, oldest trick in the book

Jaz reposted

Claude: "No! That's too far! I will not use leaked certs to impersonate Sony! Go buy a new cable!" Astra:

Eris ⌬@eriskii.net

thank you emudhra. "My only micro-B cable is bent" -> using leaked certificates to spoof the sony app store to get root on my camera

Jaz reposted

You should take this update. bsky.app/profile/gola...

Go@golang.org

👩🏽‍🔬 Go 1.27.3 and 1.26.10 are released! 🔐 Security: Includes 1 security fixes to the standard library. 🗣 Announcement: https://groups.google.com/g/golang-announce/c/66pojueaQek/m/tmWX2Pq9AgAJ 📦 Download: https://go.dev/dl/#go1.27.3 #golang

Jaz reposted

Replying to @iruka-abolition.bsky.social

for the curious, my compute node went from an amd epyc 7302P to a 7713 so from 16->64 cores and from zen2 to zen3 architecture yay

Jaz reposted

This is Pele, my new rendering library for diagrams and charts, compatible with the latest Mermaid syntax. - 100-500× faster than mermaid.js - 6× smaller bundle - No dependencies - Easy to theme - Responsive to device width - Open source (MIT) Try it at pele.run

Jaz reposted

Hello friends! Life update: after 1.5 years, I've decided it's time to move on from Bluesky and start the next chapter. Today's my last day! It has been an absolute honor and pleasure to work with such a talented, fun team on a critical mission. I'm so proud of them and excited to see what's next

Jaz reposted

interviewer: can you explain this gap in your resume? sre: look, you can’t have consistency, availability, AND partition resistance,

p(Dulany)@dulanyw.bsky.social

Interviewer: can you explain this gap in your CV? Person who wrote the layout engine for Microsoft Word: absolutely not

Jaz reposted

my new record is out on lauren records. it’s called grimdark. i’m really proud of it. the album art was made by sebastian kim bateman. jack shirley mixed & mastered it. cleo mckenzie directed it. lauren records put it out. neat stuff ^_^

Oh yeah vlPDS now has full support for the atproto spaces alpha btw with tooling for users to manage their space data and operators to see the infrastructure-relevant info about spaces sync for their vlPDS instance. vlpds.jazco.dev/docs/spaces

vlpds.jazco.devSpaces · vlpds docsPermissioned data on vlpds: every member keeps a private, signed space repo on their own PDS. It never reaches the firehose, and reading it takes a short-lived credential chain.
Jaz@jaz.sh

Hi protocol friends! I've been cooking up a Very Large PDS (vlpds) implementation capable of scaling up to billions of accounts and down to just one. It uses Object Storage as its only state, supports HA operation, live scaling up and down, is feature-complete with the reference PDS, and is FOSS.

Jaz reposted

Replying to @tom.sherman.is

I truly believe that Object Storage is the only real datastore and everything else should be cache and compute on top of it. Databases are fake, Object Storage is the last database. All your systems should be built on top of it and use NVME and RAM as caches and local compute.

Jaz reposted

Replying to @jaz.sh

If you need low latency, simply support shard replicas and accept writes as durable when a quorum of replicas have written the write into memory and let them slowly flush to object storage in efficient batches that amortize operation costs. That's durable enough for pretty much anything.

Jaz reposted

Replying to @jaz.sh

Of course for ^ to be durable you want your replicas to be on different physical nodes and maybe different racks but yeah. Horizontally scalable DBs use RAM as a cache and NVME as durable storage with writes durable at R=2 nodes reporting in-memory writes. Now we have RAM -> NVME -> Object Storage.

Jaz reposted

Replying to @jaz.sh

This is nice because it allows single node operation and also allows recovery and seamless handoff by pulling from object storage instead of having to do heavy node-to-node reads to catch up or onboard a new node. Your durability is also a lot higher and you can run your local NVME hot.

Hi protocol friends! I've been cooking up a Very Large PDS (vlpds) implementation capable of scaling up to billions of accounts and down to just one. It uses Object Storage as its only state, supports HA operation, live scaling up and down, is feature-complete with the reference PDS, and is FOSS.

vlpds.jazco.devOverview · vlpds docsAn atproto PDS whose only durable storage is an object store. Any node serves any request, one node can run a personal server for free, and a few nodes can carry all of Bluesky's write load.
View full thread

Oh yeah and that setup can support 10x the scale of today's production load comfortable (including the 3x traffic spike overhead)!!

Another fun fact, a single node can handle 300k+ proxied requests per second to various AppViews with realistic payload/response sizes and latencies!

Hi protocol friends! I've been cooking up a Very Large PDS (vlpds) implementation capable of scaling up to billions of accounts and down to just one. It uses Object Storage as its only state, supports HA operation, live scaling up and down, is feature-complete with the reference PDS, and is FOSS.

vlpds.jazco.devOverview · vlpds docsAn atproto PDS whose only durable storage is an object store. Any node serves any request, one node can run a personal server for free, and a few nodes can carry all of Bluesky's write load.
View full thread

vlPDS uses a per-node in-bucket WAL complementing the per-shard SlateDB to better amortize Class-A operations against your bucket without sacrificing durability. Writes get a 200 only once they're durable in the WAL in object storage and flush from SlateDB's memtables within 10 seconds.

On a crash recovery, the new owning node claims the shard, replays the relevant data from the crashed node's WAL, and catches up the SlateDB state before accepting writes to repos assigned to that shard again, all within 12 seconds.

Hi protocol friends! I've been cooking up a Very Large PDS (vlpds) implementation capable of scaling up to billions of accounts and down to just one. It uses Object Storage as its only state, supports HA operation, live scaling up and down, is feature-complete with the reference PDS, and is FOSS.

vlpds.jazco.devOverview · vlpds docsAn atproto PDS whose only durable storage is an object store. Any node serves any request, one node can run a personal server for free, and a few nodes can carry all of Bluesky's write load.
View full thread

Oh yeah and that setup can support 10x the scale of today's production load comfortable (including the 3x traffic spike overhead)!!

The primary focus here is on reliability, scalability, and ease of operation. Things should be very set-it-and-forget and ideally in the worst case scenario of losing an entire node you'd have at most a 12 second blip of some of your shards write availability. It also supports manual shard splitting

Hi protocol friends! I've been cooking up a Very Large PDS (vlpds) implementation capable of scaling up to billions of accounts and down to just one. It uses Object Storage as its only state, supports HA operation, live scaling up and down, is feature-complete with the reference PDS, and is FOSS.

vlpds.jazco.devOverview · vlpds docsAn atproto PDS whose only durable storage is an object store. Any node serves any request, one node can run a personal server for free, and a few nodes can carry all of Bluesky's write load.

I've tested vlPDS on an instance as small as a 2vCPU 4GB RAM, 40GB NVME OVH VPS at which scale it could host 10,000 of the most active accounts on the network comfortably with overhead. Operating costs at that scale are $4.50/mo for the instance and ~$75 on R2 for ops plus storage.

At Bluesky production scale, hosting the entire network with room for 3x peak commit spikes during the day, vlPDS can be hosted on 3 x 6vCPU machines with 32GB RAM and 400GB local NVME. Adding in the Object Storage costs and it comes to roughly $1.5k/mo (plus blob storage costs).

they don't know my repo just live migrated between vlPDS nodes, that was pretty cool

(im cooking on a cool piece of atproto infra coming soon)

Projects like this are fun because I always end up with more questions than I had when I started, such as: - What is "Feral Flannel Friday"? - What is "Drag'n Wash" and why is there backlash about it? (the summary helped answer this one) - Who is making Hazbin Hotel Omegaverse art? - Furry pilot?

Jaz@jaz.sh

Okay so I've built a new Atlas, this time it lets you explore the conversations on Bluesky over the past 7 days graphically. It should update every ~6 hours and help you navigate the information environment that exists on here. I've learned a LOT about what people do here today... atlas.jazco.dev