Post

yup that's officially 10 billion atproto backlinks indexed by constellation across every lexicon that you can query at constellation.microcosm.blue

Wow, that's that's a lot (genuine). I'm curious what is the setup running it?

little rust app on a pi5 (16GB), rocksdb on nvme

How much space is this taking up? Would this be at all feasible if you couldn't use nvme? e.g. usb because pi4

bit under 500GiB it got to the first 1B backlinks on a 4GB pi4 with sata ssd over usb, but i don’t think it would do well at current scale on the pi4 anymore. rocks got memory hungrier for one.

50-something bytes average seems surprisingly low to me. Good job!