Post

Harry Roberts
@csswizardry.com

Has anyone written/built an `llms.txt` that they’re really happy with? And have you noticed it working/helping? I recently updated my research agent to check all websites for `/llms.txt` before diving straight into parsing pages of HTML and I’m looking forward to seeing if/how effective it is.

jeremAIas
@jeremias.codes

If done correctly, it definitely helps. It’s mainly a performance improvement, agents get faster to the info they are looking for. I recently did a lot of optimizations like that for @supabase.com docs.

jeremAIas
@jeremias.codes

I recommend adding a redirect at server level when “Accept: text/markdown” header is present to your site. That does the trick for a lot of agents, they don’t have to parse and read the html at all.