Post

On the Xet team at @huggingface.bsky.social we're always looking for ways to move bytes to computer near you as fast as possible. To do this, we're redesigning the upload and download infrastructure on the Hub. This post describes how, check the thread for details 🧵 huggingface.co/blog/rearchi...

Very cool! Thanks for sharing all the progress. Any place where we can read more about the CAS side of things? Curious about things like hashing function, block size, ...

Haha! 🙈 I've been in the content-addressed storage world and the git for data / open data ecosystem for a while and am just very excited to see you all work on these sorts of things!

@davidgasquez.com if you're interested, I wrote a follow-up over here! 😀