Post

another researcher accuses OpenAI of training on conversations and then claiming a breakthrough

I smell desperation in people who failed to actually make those breakthroughs.

yeah, it definitely looks bad and will force openai to respond (good imo), but i find it highly unlikely that it materially improved their performance, but will be hella difficult to prove that

If a user uses the product with "Improve the model for everyone" turned on, that's what it's meant to do. Alpöge sure should have known that as an employee of a company whose products use a similar option. But I haven't seen anything indicating something like that played any role.

agree, but it would be appropriate for openai to acknowledge any contribution, especially if they plan on continuing work with the scientific community

Why would they claim it contributed if there's no evidence of it? And as far as scientific papers go, Alpöge & Buckmaster papers didn't seem to have been even published when OpenAI wrote theirs. Wouldn't it be more inappropriate if it would mean making false claims?

Which they basically already said there isn't.

Unfortunately we have to rely on the good word of OpenAI. There's no way to independently verify - because OpenAI is not very Open.

Would you expect them to be open with training data and processing? Is that a reasonable expectation for anyone else in the industry?