Jensen's claim of not being able to give away Hoppers back at GTC25 were incorrect; their value has skyrocketed recently. My guess is that this reflects HBM scarcity. Old GPUs with just as much(ish) memory are just fine for inference's bottlenecks. Source: www.a16z.news/p/charts-of-... #AI
Glenn K. Lockwood
Glenn K. Lockwood
@glennklockwood.com
I am a supercomputing enthusiast, but I usually don't know what I'm talking about. I post about large-scale infrastructure for #HPC and #AI.
1.2K followers222 following1.3K posts
Memory, storage, and GPUs are so expensive in part because hyperscale GPU clusters are only 87% usable. The remaining 13% are kept as powered-on hot spares that sit idle. Could you imagine #HPC doing this? engineering.fb.com/2026/10/19/d...
Glenn K. Lockwood reposted
1. Why does OpenAI keep video surveillance devices behind their conference room displays??? 2. Nice flex, saying these "sophisticated" devices were apparently vibecoded and retroactively analyzed using OpenAI models.
https://sfstandard.com/2026/10/13/openai-engineer-arrested-alleged-bugging-executive-conference-room/ #SanFrancisco #OpenAI #sfnews
Spent a few months preparing the tech docs for DataEnclave, VAST's new confidential computing runtime. W/ help from VAST R&D, I learned how attestation etc worked well enough to describe and defend it. Short version: www.vastdata.com/blog/introdu... 15-pager: www.vastdata.com/resources/wh... #AI
I wrote this doc to explain KV caches and KV cache offloading many months ago. I found salespeople couldn't confidently tell when their customers might have a problem, because all the content online is straight marketing or way too in the weeds. blog.glennklockwood.com/2026/09/what...
By total coincidence, two of my colleagues are running a webinar on this topic on Wednesday. The lead speaker, Anat, is really sharp and worth hearing speak: www.vastdata.com/events/demys...
Malaysia is allegedly evaluating Huawei's Ascend 910C for their sovereign AI buildout. If Malaysia picks Huawei over NVIDIA, it'd be the first big buy of these chips outside of China. Egypt also name-dropped as a nation being pursued by Huawei. www.freemalaysiatoday.com/category/hig...
The IO500 committee just stripped Sugon of its #1 position in the Production list because it appears that their ParaStor F9000 isn't a real product, or it could not be verified as one. Verify here: io500.org/list/isc26/p... My notes on ParaStor: glennklockwood.com/garden/paras... #HPC #notreally
I recently had the opportunity talk to @nicolehemsoth.bsky.social about a few failures in #HPC and #AI infrastructure that taught me some important lessons about designing systems and managing risks. Have a look, have a listen. Hope others find it interesting! www.vastdata.com/blog/failure...
MLPerf Storage results are out and StorageReview pointed out the interesting disconnect between MLPerf leaderboard winners and companies with the largest #storage footprints in the #AI clouds. Suggests this benchmark may not reflect real needs. www.storagereview.com/news/mlperf-...
I recently wrote up an argument about why batch schedulers like Slurm are architecturally insufficient for autonomous scientific laboratories and agentic workflows. Event-driven orchestration is the scalable alternative. www.vastdata.com/blog/autonom... #HPC
Funny, there’s a reason NERSC took its datacenter out of this location. It’s not a great place to put one. www.datacenterdynamics.com/en/news/form...
This is the diagram I’m most proud of. Stacking ~700 different LLM training jobs observed from the VAST fleet on a common timescale to figure out whether there is a “feeding the GPU” problem anywhere close to the write intensity of periodic checkpoints. There is not. Only read burst is at job start.
Surprised to see a solution so heavily focused on tiering to HDD for capacity now tier to…more HDD for capacity. Curious what Wasabi does that PanFS doesn’t (and vice versa) to make this pairing complementary.
VDURA goes to Wasabi for tiered AI data cloud storage - www.blocksandfiles.com/public-cloud...
Glenn K. Lockwood reposted
I gave the invited talk for the Systems track at #PEARC26. If you were not able to attend, you're in luck! 🍀 I walked back to my room and recorded a second time so all would have access in the present and into the future. youtu.be/qiKfTgYoKkE?...
I’m glad someone liked it! Hard needle to thread in crafting a technical plenary that is interesting, accessible, and thematic to “resilient roots.” Also relieved that my SDSC colleagues didn’t mind me spilling the tea on one of Gordon’s failures. #HPC #alittleAI
Excellent keynote about exploring failures by @glennklockwood.com at #HPC #PEARC26
Glenn K. Lockwood reposted
Another great addition to Utah’s amazing pro-human AI innovation ecosystem built on public-private partnerships.
🪶 Redtail, an AI factory for all of Utah, recently debuted on a list of the world's top supercomputers, ranking No. 159 for performance and No. 76 for energy efficiency. The system, managed by SCI’s Center for High Performance Computing at @utah.edu, supports statewide innovation. bit.ly/redtailrank
Surprising to see a software company go into the hardware business, selling an unusual 2U70 dual-controller flash server. It's hard to source flash these days, so there are strong market incentives to ship software on whatever hardware your customers can find.
WEKA's big beast AI storage products - massive new WEKAPod and capable NeuralMesh upgrade - www.blocksandfiles.com/ai-ml/2026/0...
With Infinia gaining support for files, is there a reason for anyone to buy EXAScaler anymore? Why would someone choose Lustre over Infinia if Infinia seems to support everything that Lustre does but with enterprisey glitter? Curious to see how DDN positions these two lines. #HPC
DDN gets Infinia ready for production AI inferencing - www.blocksandfiles.com/object/2026/...
Block off your calendar for Wednesday at 10am! I'll be there.
🎤 The #ACM #PEARC26 Conference Schedule is live! Plan your conference experience: 📅 pearc.acm.org/pearc26/conf... 🏨 Book your hotel ASAP: 2 of the 3 conference hotels are already sold out! pearc.acm.org/pearc26/hote... #ResearchComputing #RCD #PEARC #ResearchData #HPC #Minneapolis2026
Glenn K. Lockwood reposted
Replying to @ogawa-tadashi.bsky.social
=> Architecting for Frontier AI Labs: How Anthropic scales Claude on TPUs, Google & Anthropic, Google Cloud Next 2026, Apr 22 youtube.com/watch?v=LEPY... content-cdn.sessionboard.com/content/3e8V... Automated fault recovery & intelli scheduling to maintain continuous uptime across massive pod-scale
I wrote up some notes after my week at #ISC26: blog.glennklockwood.com/2026/07/isc2... Interested to hear others' perspectives on highlights and things I may have missed. #HPC
I somehow missed that China has developed its own implementation of InfiniBand, called ScaleFabric 400, to compete/supplant NVIDIA/Mellanox IB. Oddly enough, its manufacturer (Sugon) is not a member of IBTA though. en.eeworld.com.cn/mp/EEWorld/a... #HPC
Glenn K. Lockwood reposted
Ogawa-san is how I first came to know about China’s new exascale system a while ago, and I assembled a quick spec page a few weeks back (glennklockwood.com/garden/syste...). Notably has a BIG liquid cooled storage system (67 racks, 10 TB/s).
=> China's 'Lineshine' Declared World's Fastest Supercomputer at Hamburg Conf, Jun 24, 2026, CCTV www.youtube.com/watch?v=Cs9X... Glenn bsky.app/profile/glen... TOP500, Jun 23 bsky.app/profile/ogaw... 13,789,440 ARMv9 (SVE+SME) cores 2,198.40 (2,735.82) PF arXiv, Jun 12 arxiv.org/abs/2606.14073
??? I was the lowest-level principal software engineer at microsoft and my parting annual liquid total comp started with a 4 when I quit. It was enough to support two of us on a single income in the Bay Area. Priced out of Redmond??? Sorry, but not very sympathetic.
this guy has been at Microsoft for 28 years, most recently as principal software engineer. he and his wife live in Redmond, Washington. they feel they're getting priced out of King County and are looking to sell their home and move somewhere cheaper www.seattletimes.com/business/loc...
It’s comforting to know that, at the macro scale, Lustre is pretty consistent at its strengths and weaknesses. I don’t think these are different from when I last used Lustre in 2022. From @adrianjhpc.bsky.social at the Lustre BOF in #ISC26