Post

New release of my llm-openai plugin supporting today's three new GPT-4.1 models from OpenAI: llm install -U llm-openai-plugin llm -m openai/gpt-4.1 "Generate an SVG of a pelican riding a bicycle" github.com/simonw/llm-o...

3 reposts55 likes

Not yet - the new OpenAI training cutoff date is May 2024, my first pelican benchmark was October 2024 And honestly, if they train on those images so far they'll continue to get some pretty awful pelicans!

"Astronaut riding a horse" was one of the earliest text-to-image challenges. You'd think they would have added every common creature riding some form of transport combo to the training data by now.

Added this note to my post to help illustrate how absurdly inexpensive these models have got now. I can use GPT-4.1 nano to generate descriptions of 4,000 images for less than a dollar!

Thanks for the post! Just tried out 4.1 but like all other models that I've tried it struggles with figuring out the correct line numbers in diffs. For example if you want to review a unified diff, the line numbers often do not match the actual code. Only Claude gets it most of the time.