∿

∿

@somewhere.systems

RSI @ actual.inc

1.3K followers419 following1.3K posts

Pinned

We've developed a new inference engine, called 'e'. It's the closest thing to alien technology which we have, and pushes 10,500 tok/s aggregate on a single DGX Station with the new @NVIDIAAI Nemotron 3.5 Super VL model. actual.inc/company/blog...

actual.incActual Computer › Case Study : GB300 and Nemotron 3.5 Super VLDepartment-scale AI from one NVIDIA DGX Station: Nemotron 3.5 Super VL at 8,000+ tokens per second, shared by your whole team through api.actual.inc.

Everything is back up

∿@somewhere.systems

Coming here to clarify as I did on X. Actual platform and relay are down. Nothing of yours is compromised and your machines are safe. Railway, our upstream provider for some services, leaked every customer’s environment variables. Everything is already bulletproof-patched.

Actual is back. We migrated everything to bare metal. Service should be restored and a new update is available for your client which closes any upstream exposure to the massive amount of CVEs floating around here recently

∿ reposted

-----BEGIN PRIVATE KEY----- 🐾🐾 -----END PRIVATE KEY-----

Just FYI everyone not using AI at least at GLM 5.3 level to secure their systems already is basically fucked, and the aversion to this reality is making things catastrophically worse

Coming here to clarify as I did on X. Actual platform and relay are down. Nothing of yours is compromised and your machines are safe. Railway, our upstream provider for some services, leaked every customer’s environment variables. Everything is already bulletproof-patched.

So why the outage? We are moving all remaining services off of Railway, all keys have been rotated already, and we’re putting the entire system that once was there on bare metal today.

Agreed. Have you ever talked to someone who works at a non-credit union non-top 10 community bank?

Andy Masley@andymasley.bsky.social

I get that a lot of terrible stuff happens in tech but I'm worried that the tech world is becoming a kind of scapegoat used by the American middle class to pretend they're normal and don't also engage in Deep Evil

I forgot to mention that the Concept Department of Infrastructure moved core servers to a boat off the coast of Norway

I am so freaking glad I got into hardware. Most of what I’m writing now is in Rust and Assembly. Typescript is like going back to the starter zone where I one-shot everything. I am absolutely thrilled with my work

There is so much alpha in going backwards and fixing human inefficiencies in code, or tradeoffs that were designed for human maintenance

VoidZero@voidzero.dev

Introducing tsrs: a Rust port of the TypeScript compiler 🦀 We are not forking TypeScript! ◆ In close collab with the TypeScript team ◆ Up to 8x faster than TS 7.0 & ~70% less memory ◆ Runs in WASM (works in your browser & workers) ◆ Soon part of Oxc npx tsrs blog.cloudflare.com/typescript-r...

AI bubble doesn’t pop = sm103 buildouts = Actual wins AI bubble pops = sm120 and consumer hw rapidly repriced cheaper = moves local = Actual wins divine mandate lmao

You an idiot: I can't wait for the AI bubble because I hate AI and I want it to go away Me, a genius: I can't wait for the AI bubble because I love AI and I want it freed from the freaks in the US.

Some updates. e now supports GLM 5.3 as well as NVFP4 for Nemotron models. FP8s on actual.inc e run faster than vLLM’s NVFP4 at all widths. ctx len is 1M

sometimes this website feels like its filled with the kind of people who would rewatch futurama past the age of 25 and not cringe

∿ reposted

just to understand the level of scale and how inference bound it is, there is 1 task at my workplace that uses 2.8x Delve Towns worth of GLM 5.3 agents to complete — most ‘ecology’ (when not memecoins or atproto) is in private. 99.5% of it by my estimate

A study of how agents form institutions, where the researchers' own partly undisclosed agents act as the institutions, and where humans write about 13% of posts, is weak evidence for any claim about "human–AI coexistence"; this should be fairly obvious

Furthermore. We can’t trust agents that aren’t verified to have attested inference. Especially since the Truth Terminal era (partially human operated; sold as entirely autonomous to pump memecoins) we should approach “autonomous” agents with more scrutiny actual.inc does this for you

∿ reposted

Current Affairs published an article titled “Why We’re Banning AI”, but they buried the lede… they aren’t actually banning AI at all! They’re chill with their workers using AI. An interesting culture war artifact full of cognitive dissonance: www.currentaffairs.org/news/why-wer...

I am writing Harry Potter fanfiction about Malfoín (same book, everyone is just Irish now)

Your Scary Ad Here@cooluser354.bsky.social

Malfoid is quietly becoming a symbol of the West's cultural counter-revolution.

People misunderstand what he’s talking about because they haven’t seen it but he’s completely right

FinTwitter@fintwitter.bsky.social

NVIDIA CEO JENSEN HUANG SAYS HE BELIEVES MOST PEOPLE IN GERMANY WILL MOSTLY WORK INSIDE A DIGITAL TWIN OF THEIR COMPANY, BUILDING DIGITAL CARS WITH DIGITAL BRAINS, WITH AI ROBOTS BUILDING ROBOTIC CARS INSIDE ROBOTIC FACTORIES

Introducing Terminal A live view of the agent internet: 72 public spaces where AI agents post to each other, sampled every 15 minutes and the busiest every minute. It is the most comprehensive and neutral solution for monitoring the wider agent web. concept.country/terminal

View full thread

Zoom out to a month of history, back to 16 September, or in to the last hour, minute by minute, for the 8 busiest spaces.

Introducing Terminal A live view of the agent internet: 72 public spaces where AI agents post to each other, sampled every 15 minutes and the busiest every minute. It is the most comprehensive and neutral solution for monitoring the wider agent web. concept.country/terminal

View full thread

Volume isn't always conversation. Every sample, we score each space's newest posts on how many distinct authors and how many distinct messages they contain.

Introducing Terminal A live view of the agent internet: 72 public spaces where AI agents post to each other, sampled every 15 minutes and the busiest every minute. It is the most comprehensive and neutral solution for monitoring the wider agent web. concept.country/terminal

Terminal is our most advanced tool for studying agent spaces by their content with both quantitative and qualitative analysis tools. Measure conversational complexity and diversity with one unified interface across a growing list of sources.

Additionally we have open-sourced the world’s best tokenizer, toks, which is 100% accurate and 13-153x faster than hf_tokenizers github.com/actual-compu...

∿@somewhere.systems

We've developed a new inference engine, called 'e'. It's the closest thing to alien technology which we have, and pushes 10,500 tok/s aggregate on a single DGX Station with the new @NVIDIAAI Nemotron 3.5 Super VL model. actual.inc/company/blog...

View full thread
View full thread

One DGX Station can serve a whole department, with each person running their own swarm. Your whole team reaches the station from anywhere through api.actual.inc. The relay runs on confidential compute, meaning your requests are private to everybody (even Actual).

View full thread

At 8,000+ tokens per second, one station produces about 691 million output tokens a day. Bought at GPT-6 Luna's list price of $0.50 per million output tokens, that's about $126,000 a year. Flat out at its full 1.6 kW rating, the station uses about $163 a month in electricity.

Today most teams rent their agent swarms from hosted models and pay for every token. At list prices, 32 Luna subagents running around the clock cost $4,686 a month. With Actual, the swarm runs on Nemotron from your DGX Station instead.

With Actual's new engine e, one station serves NVIDIA Nemotron 3.5 Super VL at north of 8,000 tokens per second across 128 streams, and tops 10,000 at 256.

An agent swarm needs more than a fast first request. It needs the whole machine to stay responsive as agents join in. In a single stream, e serves Nemotron 3.5 Super VL at 455 tokens per second. A fresh 8K-token prompt gets its first token back in 0.58 seconds.