Some notes on Grok 4: excellent benchmark scores, a mid-quality pelican and a launch that was overshadowed by this week's disastrous Grok 3 system prompt update simonwillison.net/2025/Jul/10/...
Post
simonwillison.netGrok 4Released last night, Grok 4 is now available via both API and a paid subscription for end-users. Key characteristics: image and text input, text output. 256,000 context length (twice that …
Yeah, that's true. Anthropic put an enormous amount of work into their "constitutional AI" work on the base model - if xAI have equivalent work to that they've never described it, and it clearly doesn't work Mind if I quote your tweet there in my post?
0 reposts6 likes
This podcast is what made me realize how much behavior can change post-training twimlai.com/podcast/twim...
arxiv.orgs1: Simple test-time scalingTest-time scaling is a promising new approach to language modeling that uses extra test-time compute to improve performance. Recently, OpenAI's o1 model showed this capability but did not publicly sha...