Post

There needs to be a benchmark that mixes common acronyms with a few undefined fictional ones to test whether the model hallucinates the acronym's expanded definition. I see this even on frontier models, even when they have the tools available to search for and define the acronym properly.