Thomas Steinke

Thomas Steinke

@stein.ke

Researcher in computer science, math, machine learning, (differential) privacy, AI, etc. at Anthropic. Kiwi🇳🇿 in California🇺🇸 http://stein.ke/

4.4K followers764 following534 posts

Pinned

I'm going to slowly repost my math notes from the other site🐦 here🦋; it's the only thing I posted over there that I think may have some long-term value & worth not deleting. These started out as notes for myself, but people seem to appreciate them. 😅 I'll keep track of all of them in this thread.

Max is about to get TMI.

My wife's e-bike was stolen. We bought a new e-bike. Two weeks later the new e-bike was also stolen. The thief arrived on a regular bike (likely stolen too) and abandoned it. Then the abandoned regular bike was stolen as well by yet another thief.

After having two e-bikes stolen due to our garage accidentally being left open, I decided to set up automatic closing of the if it is left open for 15 min. As a side effect of this project, Claude now has full control of my garage door. 🙃

My wife's e-bike was stolen. We bought a new e-bike. Two weeks later the new e-bike was also stolen. The thief arrived on a regular bike (likely stolen too) and abandoned it. Then the abandoned regular bike was stolen as well by yet another thief.

To be precise I bought a ratgdo control board for my garage door opener. Claude wrote and installed new firmware (and could update said firmware too). It has full control of the opener including the ability to disable the remotes. 😅

50 years from now it will be widely accepted that a significant fraction of US politics in the 2020s was driven by hostile foreign actors. People studying history will think everything makes sense through this lens.

This post is unavailable.

My wife's e-bike was stolen. We bought a new e-bike. Two weeks later the new e-bike was also stolen. The thief arrived on a regular bike (likely stolen too) and abandoned it. Then the abandoned regular bike was stolen as well by yet another thief.

In a US restaurant, you’ll get water without asking. In Germany, you have to ask twice before they finally relent and give you a glass of water. I bet the Brawndo gag was inspired by this.

What’s the probability that I’ll gain weight over the next year? This question makes sense, but really it distracts from the fact that the outcome is mostly determined by my choices. “p(doom)” similarly distracts from our agency, although it’s a good way to get people’s attention.

AirBnB really needs to stop hosts from demanding personal details from guests. This didn't used to happen, but now half the time I'm being told I have to upload my driver license to some random website or my reservation will be cancelled.

Even if you ignore the serious privacy concerns & identity theft risk, this is just inconvenient. And why do they need this information? Airbnb should handle this & provide hosts with the necessary assurances so that they don't feel they need to collect this information. And Airbnb should forbit it.

I took the kids out for a bike ride today & my bike fell apart - literally, a pedal fell off - so we were stranded. We walked to a restaurant for lunch and plotted how to get back home. The solution ended up being getting doordash to deliver a hex key to the restaurant & I managed to fix my bike. 😅

Thomas Steinke reposted

I was reading an author recently talking about how we don't appreciate the way that email isn't siloed. That is, you don't have to be in gmail to talk to someone else in gmail. The norm is so powerful, it'd be unthinkable to change it. All email is interoperable. Social media could've been this way.

Thomas Steinke reposted

We asked an unreleased research version of Claude to take a stab at the Riemann hypothesis. It didn’t solve it, but it did make strides on a related problem: it increased the lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis from 41.6% to 67.2%.

anthropic.comLearning more about Claude's mathematical capabilitiesAn unreleased version of Claude has made strides on a problem related to the Riemann hypothesis. It improved the lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis, increasing it from 41.6% to 67.2%.

My radical suggestion for peer review: Move from nominal pre-publication review to explicit post-publication review. The original reason for peer review was that journal pages are a limited resource, so we need a filter before publication. That no longer makes sense with digital publishing. 1/

View full thread

Is something like this a perfect system? No. Is it better than the status quo? Maybe. It puts the emphasis on filtering what deserves reviewer attention, rather than wasting reviewer attention to filter what goes on a website. Authors should make a case that their work should be reviewed. 5/

What should happen to conferences like NeurIPS/ICML/ICLR? I think the attitude should be that anyone can present their work – subject to some very lightweight review and a strict one-per-registered-attendee limit. That way the focus is on the actual conference, not the associated review process. 6/

My radical suggestion for peer review: Move from nominal pre-publication review to explicit post-publication review. The original reason for peer review was that journal pages are a limited resource, so we need a filter before publication. That no longer makes sense with digital publishing. 1/

View full thread

Many papers are published on arxiv before being accepted at a conference. And rejected papers are just resubmitted elsewhere. What’s the point of the review process in this? We should just stop pretending that peer review is a meaningful pre-publication gate. 3/

So my suggestion is that we should review papers after they have been published – give the community some time to digest the paper before we formally evaluate it. Only allocate human reviewer time to papers that gain some attention first. E.g. only review papers once they start getting cited. 4/

My radical suggestion for peer review: Move from nominal pre-publication review to explicit post-publication review. The original reason for peer review was that journal pages are a limited resource, so we need a filter before publication. That no longer makes sense with digital publishing. 1/

With the internet making publishing ~free, the limited resource is human attention, not publishing pages. It doesn’t make sense to use human reviewer time as a filter. And the filter is not exactly working well. 2/

Fun fact: You can have two amazon accounts registered to the same email address, as long as they have different passwords. Don't ask how I discovered this or what happens if you change the passwords to be the same.

Buy new phone. Copy photos from old phone. Turn on cloud backup. "Your cloud storage is full." Delete photos from cloud. Photos deleted from phone because backup is on. 🫠 That is not what a "backup" is, Google.

To be clear, this happened to a relative who then asked me for tech support. (I pay for cloud storage.) My relatives were very reluctant to upgrade their phones, but were forced to because the 3G networks were shut down. They were afraid of exactly this kind of nonsense.

What does “tokens per second per request” mean?? www.theatlantic.com/technology/2...

Carl Quintanilla@carlquintanilla.bsky.social

“.. I asked a few AI researchers whether they could name any other real-world software that scales so poorly. None of them could think of any. “.. By economic and engineering measures, generative AI might be the worst technology ever deployed.” @theatlantic.com www.theatlantic.com/technology/2...

Bastille Day 🇫🇷, Independence Day 🇺🇸, Canada Day 🇨🇦 are all in July. Isn’t it a nice coincidence that all these events happened in the middle of summer so we can enjoy national holidays in good weather. 😎 The pattern also holds down under: Australia Day 🇦🇺 is Jan 26, Waitangi Day 🇳🇿 is Feb 6.

I presented this: bsky.app/profile/stei...

I'm excited to share this paper. It answers a question that has bugged me for a long time: Can sample-and-aggregate be made more data-efficient? The answer is yes, but at a steep price in computational efficiency. See 🧵 for more details. Also, it was a fun opportunity to add a new coauthor. 😁

If someone give you used baby stuff, the important thing is not whether it is useful to you, the important thing is that giving it away is a commitment device for them not having another baby.

A handsome red bike, abandoned. By a busy road, outside my home. Locked to a tow away sign. What happened to its owner? Not even a thief has come for it. What will the HOA do? I see it daily and wonder.

You should only cite papers that you have read thoroughly. You should be confident that the papers you are citing are correct; you should also apply due diligence to the references therein. To be safe, you should probably not cite anything, unless maybe it's a self-citation.

I can't believe that in 2026 bibliographies are still more likely to tell you which page of the printed journal the article is on or which city the publisher is based in than to give you a URL. Were page numbers *ever* useful? Did print journals not have a table of contents?

Thomas Steinke reposted

Replying to @gregoryfaletto.com

Here's an example of a "hallucinated" citation from a decade ago (i.e. pre-LLMs). The same bad citation appeared in multiple papers. I eventually traced the source to Google Scholar (and it's now fixed).

While I generally agree with this policy, the focus on hallucinated citations specifically makes me uncomfortable: I usually get my BibTeX from Google Scholar. Yes, GS is sometimes wrong. No, I don't carefully check my references. Is using AI to fill in references really morally any different?

Mark Riedl@markriedl.bsky.social

ArXiV has a new LLM policy (Screenshots with alt text so you don’t have to click through to the other place and see all the stupid responses)

On a different note, it's strange that AI currently seems really bad at the simple task of filling in BibTeX entries. I assume that will get fixed soon. (In which case this discussion becomes moot.)

Thomas Steinke reposted