Post

General consensus in the replies and quotes of this seems to be that the entire concept of "AI skills" is a joke - how hard is typing text into a chatbot, really? I will continue to argue that it's genuinely difficult, and that the challenge in using these tools is widely underestimated

This post is unavailable.

Having worked over the past 9 in a very corporate environment to roll out a chatbot thing, I have a pretty good view into what the median enterprise user does when they're talking to an AI. I'm continuously moving between awe, despair, shock and hilarity at how bad people are at asking questions.

I'd be fascinated to learn more about that - I don't have a very big old intuition at all right now for how non-expert users interact with these tools

0 reposts2 likes

It's quite intense: most of these users aren't high powered academics, but still they're well paid "white collar" type workers. Some have an IT background, but most of them don't. Invariably, I find bullshit in the logs that makes me want to scream "What are you expecting! This thing isn't magic!"

I am a bloated sack of meat after three days of christmas-esque eateries right now, incapable of writing; I'll see if I can grab a few gems, properly redact sensitive stuff & write it up properly later...

The root cause seems to be an inability to critically assess the quality of one's own questions: asking an ambiguous question or something implicit will get you hallucinations for sure. Call it a pervasive misunderstanding of "question entropy": people just expect the thing to magically grok them

We’re rolling out a chatbot that we’ve used ourselves internally to a few customers now. It works 95% of the time for us where, as eng building the product, we know how to precisely form requests. It’s funny how quickly you realise that won’t be the case rolling out externally.