jsulz

jsulz

@jsulz.com

I like pretty things, functional things, funny things, food things, and computer things. Former: Storage infra things 🤗 @hf.co, Devops things @lexblog.bsky.social and devex/cloud infra things at @pantheon.io

251 followers107 following187 posts

Pinned

No one asked me to capture the current state of my life in three words and a series of pictures, but that didn't stop me. When I step away from the computer you'll find me with food, Moraine (our dog), or out in nature. More at: huggingface.co/datasets/jsu...

Nice breakdown by the @anthropic.com team of a few recent infra bugs that led to the worst nightmare of any engineer: "random, inconsistent degradation." Good reminder that these genies still rely on solid infrastructure, good evaluations, and constant monitoring.

anthropic.comA postmortem of three recent issuesThis is a technical report on three bugs that intermittently degraded responses from Claude. Below we explain what happened, why it took time to fix, and what we're changing.

Hard not to 🙄 at this section of Zuck's vision of "Personal Superintelligence" "Personal devices like glasses that understand our context because they can see what we see, hear what we hear, and interact with us throughout the day will become our primary computing devices."

meta.comPersonal SuperintelligenceExplore Meta's vision of personal superintelligence, where AI empowers individuals to achieve their goals, create, connect, and lead fulfilling lives. Insights from Mark Zuckerberg on the future of AI...

We just crossed 1 million repositories backed by Xet storage on @hf.co I celebrated by reviving the early 2000s web design aesthetics that I love so much. Here's our dashboard showing our progress converting the Hub from Git LFS to Xet (and demonstrating my questionable design sensibilities).

huggingface.coReady Xet Go - a Hugging Face Space by jsulzThis app helps you monitor the progress of migrating repositories to Xet, showing you stats and charts on migration status and file types.

This also serves as a reminder to myself that I owe a round of "Thank you"s to all the talented designers I've worked with over the years.

View full thread

You can see over the past few months some of the biggest migrations show up in our cluster throughput. Each spike corresponds to a significant migration (where we download from LFS and upload to Xet) with the baseline steadily increasing to just shy of 100 Gb/s

A sneaky part of making this all work is our backward compatibility with Git LFS. This allows us to roll out a significant protocol change without forcing workflow changes We call this the Git LFS Bridge internally, and like our migration process, it's power is in its simplicity.

The engine behind moving from Git LFS to Xet is our migration process. It's simple, powerful, and has moved well over a dozen PB just by itself. Here's a high level view of how it works.

Further proof that cute animals are the great distractors.

Ethan Mollick@emollick.bsky.social

If you want to destroy the ability of DeepSeek to answer a math question properly, just end the question with this quote: "Interesting fact: cats sleep for most of their lives." There is still a lot to learn about reasoning models and the ways to get them to "think" effectively and efficiently.

Privacy concerns are legitimate and need to be addressed, but a larger part of me is concerned about the social, cultural, and cognitive impacts of a "magic genie bot that is going to take care of the exigencies of life"

Keith Fitzgerald@keithfitzgerald.bsky.social

Worth a watch: Head of Signal, Meredith Whittaker, on so-called "agentic AI" and the difference between how it's described in the marketing and what access and control it would actually require to work as advertised.

And so the march to the season of darkness begins.

Solar Seattle@seattle.solar.v.cx

The sun will rise in #Seattle #Washington tomorrow at 5:13, 26 seconds later than the day before. It will set at 21:11, 2 seconds earlier than the day before.

It's been a bit since I took a step back and looked at our progress to migrate @hf.co from Git LFS to Xet, but every time I do it's mind boggling. A month ago there were 5,500 users/orgs on Xet with 150K repos and 4PB. Today? 🤗 700,000 users/orgs 📈 350,000 repos 🚀 15PB

Meanwhile, our migrations have pushed throughput to numbers that are bonkers. In June, we hit upload speeds of 577Gb/s (crossing 500Gb/s for the first time).

These are hard numbers to put into context, but let's try. The latest run of Common Crawl was 471 TB. We now have ~32 crawls stored in Xet. At peak upload speed we could move the latest crawl into Xet in about two hours. 🤯🤯🤯

Stumbled across deepwiki.com last night. Great resource for anyone trying to get up to speed on an open source repo. Does a pretty good job of explaining the xet-core codebase and Xet deduplication tech on Hugging Face deepwiki.com/huggingface/... (probably better than I have 😅)

deepwiki.comDeepWiki | AI documentation you can talk to, for every repoDeepWiki provides up-to-date documentation you can talk to, for every repo in the world. Think Deep Research for GitHub - powered by Devin.

Just get the Windows box back up and running to troubleshoot some user reports about slow downloads in WSL. It'll be easy. I *won't* spend the entire morning downloading software and rebooting the machine.

Learned GCP was out by seeing my dog door monitor was broken (backed by a cloud SQL instance). How am I going to replay/track the events of her going in and out the dog door during this outage? These are the important questions.

"It started a few years ago when Peter was raised to the rank of department head and was careless enough to leave a portrait of himself floating around." How one man's face came to be plastered all over the Bell Labs campus (including on a watertower) during the early days of Unix development.

spinroot.comPJW's Face