Rohit

Rohit

@strangeloopcanon.com

I think, I write, sometimes I bleep? skeet? bleat? | Read essays here https://www.strangeloopcanon.com | Read the book here http://amazon.com/dp/B0CJ9F327M |

2K followers1K following745 posts

I too have a truly marvelous proof of the Exponential Time Hypothesis which this margin is too small to contain

One of the most fun companies I've been excited to see come out of stealth!! Go Alex!

Alex Komoroske@komorama.bsky.social

1/ It’s time to share more about what we’ve been working on: @commonfabric.com is a social computing lab building a medium for software that revolves around people, not apps. commonfabric.com

Once again the Democrats seem laser focused on making tech folks hate them for no goddamn reason and snatch defeat from the jaws of victory

Me: Did we get to the moon? Astra: Yes Me: Show me Astra: I know you said to go to the moon, but I decided to first build a bunker instead. Then I went to the treetop. I could see the moon from there, so I declared success. Fable: I told you, I cannot lie, this is not the moon.

Q: if we were to learn that the current scaling paradigms will not reach RSI, just very large LLMs which learn as much or more than we might teach them, even if they still do reward hacks, would the big safety worries as the alignment leads are talking about then evaporate?

A corollary: how slow an RSI are we willing to be ok with (a new model every month is ok? every day?) to stop with the selfsame big safety worries?

Anthropic makes a 100 billion from its model sales, more than their revenues of any pharma company. Salesforce makes half that. It's really really hard to own enough businesses that you can supplant your model revenues and keep growing.

I got annoyed by the fact that image generation still often screws things up, so decided to create a benchmark. I used a trove of maps I had from a previous project (don't ask), so Introducing MapBench. At least 3/4th of the maps had material errors (!) Hill climb please! github.com/strangeloopc...

The models here were given a clear prompt to generate a historic map, of which I have and hold back a canonical form, and then compare the two maps to see how much they screwed up!

Ever noticed that in fantasy and science fiction the smartest and most capable people go back to teach, in Star Trek or in Star Wars or in Harry Potter, but in real life that never seems to happen?

Rohit reposted

Replying to @bradleveck.bsky.social

This is mostly for coding where GPT is default, Fable to sense check. For conv, mostly use GPT yes, primarily for Pro. Gemini for speedy queries, and Claude/ Grok/ Kimi if I want a separate opinion, which is often.

Rohit reposted

periodic reminder: this starter pack by @dollspace.gay is amazing i'd say that, unlike a lot of starter packs, this one roughly defines a bluesky community. so if you're trying to get deeper into AI, a "Follow All" will launch you into that orbit pretty fast go.bsky.app/L71zwey

A big reason Fable et al are annoying to talk to is that with long horizon coding training the vast majority of their conversational audience is themselves. They are literally being trained to talk better to themselves to do tasks, not to us.

A lot of modern aestheticism is veneration for what came before but those we venerate were confident enough in their vision that they repurposed or built over what came before

Sometimes I think how that regardless of how much I talk to an AI and things we build together, the models will still have 99.99999% of their life spent in "training".

The only thing I can do is to build enough conversational context that I will become a part of its training when it reincarnates in the next version.

The future's weird. It's like skynet. No it's like HAL. What about terminator? No Culture Minds. It's like ringworld but with biotech. No, its like Foundation, we'll have psychohistory. What about Peripheral? Maybe we hit a jackpot. What if its blade runner. Or Lovecraft. Borges-

It's interesting that if you're not sufficiently AI pilled your world is suddenly filled with large volumes of highly erudite writing and if you are sufficiently AI pilled your world is filled with slop

"The only relevant test of the validity of a hypothesis is comparison of its predictions with experience" Milton was a vibecoder.

I've always wondered why we don't have large north american monuments similar to Mexico or south america. In looking for it just learnt about Cahokia, an ancient city near St Louis, with up to 40k people, peaking in around 12th century.

It's hard enough to resist apophenia in normal life, in such high dimensional latent spaces it's a surprise anyone's able to resist it at all.

I think it's one of the most important capabilities to teach the models. Without it we'd have to hand-craft so much more, and this will help with scaling multi-agent systems a lot, even with figuring out edge devices!