ML Scientist (derogatory), Ex-Cosmologist, Post Large Scale Structuralist
I worked on the Great Problems in AI: Useless Facts about Dark Energy, the difference between a bed and a sofa, and now facilitating bank-on-bank violence. Frequentists DNI.
Your ideal relationship with your vendors is to run the numbers and threaten to self-host once a contract cycle and then never actually do it because they cut you a good enough deal.
Yeah, the most expensive part of all this is the big honking GPU cluster, and after you drop all the cash for it your "ROI" is in many ways determined by how close you can keep utilization at 100% 24/7.
A provider w/ a diverse customer base is likely to do that a lot better than your own workload.
we use sonnet for commit messages
no, not the model. 14 lines, with rhyme scheme and meter. no more empty claude speak. evocative imagery. erudite aura.
these spoiled youngsters will never know this pain
>Reddit post: *describing the exact problem you're having*
>Top reply: [deleted]
>OP's reply: "wow thanks so much that worked perfectly!!!"
mfs out here being like “if I have to see my uncle Teuira and my aunt Uira one more fucking time on this tiny island, I will drown myself in the sea, so guess I’m packing up the outrigger canoe and brushing up on my star navigation”
in practice you can simply stuff a bloom filter full of every plausible key value you have ever seen and make that a reject list and it won't harm your security at all
ok non-tech ppl might be hearing some scary things about "critical vulnerabilities" involving certificates. the main thing you need to know, without getting down in the weeds about it, is that the fourth seal is broken. lo, a rider approacheth upon a pale steed, and his name is Death
Have you considered the possibility that people who aren't so breathlessly angry about the issues most pressing to you that they'll instantly affirm any obvious lie so long as it validates that feeling are actually themselves just enemies who actively will evil upon you?
I remember telling people this was my plan in 2019 and them laughing and laughing because "semi-supervised training is a scam" and "the model will know the data come from different places". Yeah, but it still can generalize to combine them.
For once an ML guess I wasn't on the wrong side of!
at my old job, we taught a model to generate top down views of a scene where the only real data we had were views from the floor, all in one plane. mixed that with synthetic renders from arbitrary angles, learned real scene grammar + how to switch geometry
A concept I've been trying to make more rigorous for a long time is "local rationality", domains where we can reason about cases nearby known ones, but there is no global set of rules we can define.
I think a lot of things work this way.
Like "it's wrong to lie about where anne frank is to the gestapo" or "if I imagine enough brine shrimp flourishing, I can justify wiping out humanity".
It's sort of like a "manifold", but there's no agreement at the boundaries of the charts.
Or maybe more like the little islands of representation you get in VAEs without a prior on the latent distribution.
A concept I've been trying to make more rigorous for a long time is "local rationality", domains where we can reason about cases nearby known ones, but there is no global set of rules we can define.
I think a lot of things work this way.
Like in ethics, we often take some scenario we have an intuitive feel for, and tweak the properties of it to try to derive general rules. And I think those rules can exist when those tweaks are small. But bringing the rules that worked nearby one scenario to a new one will push you to absurdity.
Sometimes the AI consciousness debate reminds me of a SWE colleague who told me they knew QM was obviously fake---actually we could explain things like transistors with the "electron hole theory," which all real physicists used instead of "quantum bullshit".
I'm filled with this profound weariness.
In the matrix of (Am I conscious) x (are AI agents conscious) there's really only one box I feel qualified to rule out---the one where Claude is conscious and I'm not.
Otherwise, someone with the right formalization, knowledge, and evidence could pretty easily convince me of anything else.
My favorite kind of hater post is “you tech bros will never understand the primal, numinous beauty of [most spiritually empty shit imaginable]”
the allegedly sublime:
Doing homework
Taco Bell DoorDash
Writing sql queries
Booking flights
how can something like the Monster group possibly exist?
_yet it does_
i made a mathematical music video about it: 26 sporadic groups, 196,884 dimensions, branching paths computed from real Monster symmetries.
finite. constructed. intruding into reality.
The best cure for ideological bias is find someone on the other side and go to lunch with them.
Sometimes we disagree about facts. Sometimes we disagree about values. Figuring out which is which is fun part. https://newsletter.platypuseconomics.com/p/my-libertarian-friends-were-right
i think we probably do need to do more talking about how to help women heal from sexual assault and less talking about whether and how sexual-assualting men can or should be rehabilitated, based on that realization that i've seen a great deal of discourse on the latter and ~none on the former
So, if I have a prior on the number of bits of the minimal program necessary to produce some output, for it to be a proper prior it must be decreasing in the limit. Great.
But the universe is (probably) discrete and finite. So there is a longest program, and I should assign p = 0 beyond. Uh oh.
In our Nature paper, we introduce the first superhuman Stratego AI, which we built using general techniques that we developed for RL & test-time compute under imperfect information. www.nature.com/articles/s41...
“Inconsistent reasoning about probabilities in limits” is the generating function to the Julia set that is the fractal wrongness of the Rationalist worldview
The raw visceral hatred some men have for women, at least women who step out of line, is shocking. I know it sounds like some sorta "one of the good ones" ploy but I am genuinely taken aback when I see it because I think: I had a fairly normal socialisation as a man in the west, how did I miss this?
Knightian Uncertainty is like Emergence in that even if you deny it exists at an Ideal level, trying to actually *work* with that quickly shows you cannot deny it on a practical one.
If you make a model broad enough to express “nearly anything could happen,” you’ll find its posteriors are worthless
in any large problem, your constraints on your parameters will stay at “nearly anything” until they abruptly collapse to near delta-functions, with the timing of this set by priors.
The smooth transition where multiple qualitative “models” are supported is vanishingly short.
I am very often now in rooms with a lot of senior robotics or ML folks and it’s always just men. Men men men. A sea of men. It sucks! We should be very ashamed.
At this point, ai coding is two things: the pure engineering side of the craft, and workflows around managing the agent once the project gets large enough that it gets confused.
Half the job is stopping it from the equivalent of three cue reading.
I think the gang rapists are bad and while we men as a gender don’t really have a formal procedure to move for censure I think we should consider developing one for these guys
think all straight people who discoursed at great and punishing length about a western mass lesbian bar should have to give equal airtime to this. it’s your own community this time!