Post

New release of my llm-openai plugin supporting today's three new GPT-4.1 models from OpenAI: llm install -U llm-openai-plugin llm -m openai/gpt-4.1 "Generate an SVG of a pelican riding a bicycle" github.com/simonw/llm-o...

archtoad.bsky.social

@archtoad.bsky.social

14 Apr 2025

Do you wonder if your “pelican riding a bicycle” test is no longer valid because there’s enough instances of it in the training data from you blogging about it?

Simon Willison

@simonwillison.net

Not yet - the new OpenAI training cutoff date is May 2024, my first pelican benchmark was October 2024 And honestly, if they train on those images so far they'll continue to get some pretty awful pelicans!

14/4/25, 6:52 pm0 reposts0 likes

Bornach

@bornach.bsky.social

14 Apr 2025

"Astronaut riding a horse" was one of the earliest text-to-image challenges. You'd think they would have added every common creature riding some form of transport combo to the training data by now.