Adrian Chan

Adrian Chan

@gravity7.bsky.social

UX of AI, design, theory. Ex Deloitte Digital CX. Stanford '88 IR. Edinburgh, Berlin, SF. Linkedin: adrianchan. Web: gravity7.com. @gravity7 on Insta, X, medium. Sightlines on Letterboxd. Films: https://sightlines.media/ | AI: https://inquiringlines.com/

855 followers697 following457 posts

Sightlines has a cool feature that allows you to select all on a Reddit thread about movies, paste it into Your Films page on Sightlines, and automagically create a list - which you can then explore, get related movies, etc. #Film #Letterboxd #Filmsky #Moviesky 📽️ sightlines.media/go/9fDC

Taste may seem an odd thing for "knowledge workers" to cling to, faced with the increasing capabilities of AI. But call it taste, or judgment, there's no doubt we pride ourselves on a kind of intuition that comes with years of practice and experience. Here's the research. inquiringlines.com/go/X62c

inquiringlines.comWho judges expert work when AI does the work?AI now writes research, reviews it, and summarizes it. What the research says about judgment, peer review, and expertise when the flood arrives.

Click through to Related Films for more horror titles. Special sliders let you sort to your tastes. Sliced and diced into subgenres and moods/devices: Psychological horror, Art-horror, K-horror, Serial-killer... Dread v Gore, Slow burn v Jolts, Camp v Serious, Supernatural v Human

📽️ Horror fans - I have a film site I've not shared here b4. It's 3500+ films w 14,000 pages of content, incl 600 horror & suspense. For Halloween, I added filters for horror: dread v gore, slow burn v jolts, camp v serious... Horror sub-genres & 15 horror courses sightlines.media?genre=Horror...

sightlines.mediaSightlines — a film guide to 3,400 movies: analysis, influences, similar films, essays and coursesA film guide to 3,400 important and popular movies: a critical analysis of each film, its influences and the films it influenced, similar films to watch next, film theory and reception, plus 136 film ...

A recursively self-improving AI: its input is its own output. Its training data is its own generation. Its evaluation is its own judgment. Nothing from outside enters. This isn't exploration. This is confirmation. The most sophisticated echo chamber ever built.

Clarifying questions w #LLMs increase user satisfaction when users can see the point of answering them. Specific questions beat generic ones. But I wonder if this changes when #agents are personal assistants, & are more personal & more aware. #UX #AI #Design arxiv.org/abs/2402.01934

arxiv.orgClarifying the Path to User Satisfaction: An Investigation into Clarification UsefulnessClarifying questions are an integral component of modern information retrieval systems, directly impacting user satisfaction and overall system performance. Poorly formulated questions can lead to use...

Interesting - could #LLMs in search capture context missed when googling? "backtracing ... retrieve the cause of the query from a corpus. ... targets the information need of content creators who wish to improve their content in light of questions from information seekers." arxiv.org/abs/2403.03956

arxiv.orgBacktracing: Retrieving the Cause of the QueryMany online content portals allow users to ask questions to supplement their understanding (e.g., of lectures). While information retrieval (IR) systems may provide answers for such user queries, they...

@tedunderwood.me In case you haven't seen this paper, you might find interesting. Researchers extract style vectors (incl from Shakespeare) and apply to an LLM internal layers instead of training on original texts. Generations can then be "steered" to a desired style. arxiv.org/abs/2402.01618

arxiv.orgStyle Vectors for Steering Generative Large Language ModelThis research explores strategies for steering the output of large language models (LLMs) towards specific styles, such as sentiment, emotion, or writing style, by adding style vectors to the activati...

"LLMs tend to (1) generate overly verbose responses, leading them to (2) propose final solutions prematurely in conversation, (3) make incorrect assumptions about underspecified details, and (4) rely too heavily on previous (incorrect) answer attempts." arxiv.org/abs/2505.06120

arxiv.orgLLMs Get Lost In Multi-Turn ConversationLarge Language Models (LLMs) are conversational interfaces. As such, LLMs have the potential to assist their users not only when they can fully specify the task at hand, but also to help them define, ...
View full thread

to sustain dialog. Social interaction face to face or online is already vulnerable to misunderstandings and failures, and we have use of countless signals, gestures, etc w which to rescue our interactions. A communication-first approach to LLMs for conversation makes sense, as talk is not writing.

But design will need to focus on tweaking model interactions so that they track conversational content and turns over time. For example with bi-directional prompting: models prompt users to keep conversations on track. This seems a rich opportunity for interaction design #UX #IxD #LLMs #AI

"LLMs tend to (1) generate overly verbose responses, leading them to (2) propose final solutions prematurely in conversation, (3) make incorrect assumptions about underspecified details, and (4) rely too heavily on previous (incorrect) answer attempts." arxiv.org/abs/2505.06120

arxiv.orgLLMs Get Lost In Multi-Turn ConversationLarge Language Models (LLMs) are conversational interfaces. As such, LLMs have the potential to assist their users not only when they can fully specify the task at hand, but also to help them define, ...

"when LLMs take a wrong turn in a conversation, they get lost and do not recover." Interaction design is going to be necessary to scaffold LLMs for talk, be it voice or single user chat or multi-user (e.g. social media). It's one thing to read/summarize written documents, quite another ...

"LLMs ... recognize graph-structured data... However... we found that even when the topological connection information was randomly shuffled, it had almost no effect on the LLMs’ performance... LLMs did not effectively utilize the correct connectivity information." www.arxiv.org/abs/2505.02130

arxiv.orgAttention Mechanisms Perspective: Exploring LLM Processing of Graph-Structured DataAttention mechanisms are critical to the success of large language models (LLMs), driving significant advancements in multiple fields. However, for graph-structured data, which requires emphasis on to...

I think because this isn't making the model trip, synesthetically, but is simply giving it juxtapositions. So what is studied is a response to these paradoxical and conceptually incompatible prompts, not a measure of any latent conceptual activations or features.

An unsurprisingly sharp deep dive into sycophancy & RLHF. Whilst this episode has its tech explanations, the social interaction aspects are unsolved & will rise as models are personalized, as mirroring is an effective design feature, & we're not good at distinguishing affirmation from agreement.

Nathan Lambert@natolambert.bsky.social

Sycophancy and the art of the model. Borderline self-indulgant to get to write about the messiness of RLHF to this extent, but simultaneously essential. A must read. GPT-4o-simp is a sign of things to come. www.interconnects.ai/p/sycophancy...

View full thread

The more personal the model, the more likely it mines prior convos for style, word choice, and like a good therapist should use some mirroring to increase familiarity. AI design will need heuristics for model "personhood" and proximity. (the movie "Her)

This chapter in RLHF demonstrates that there's a zone of indeterminacy between generalized human feedback and individualized human feedback, in which the social presence of AI in particular is especially vulnerable.

An unsurprisingly sharp deep dive into sycophancy & RLHF. Whilst this episode has its tech explanations, the social interaction aspects are unsolved & will rise as models are personalized, as mirroring is an effective design feature, & we're not good at distinguishing affirmation from agreement.

Nathan Lambert@natolambert.bsky.social

Sycophancy and the art of the model. Borderline self-indulgant to get to write about the messiness of RLHF to this extent, but simultaneously essential. A must read. GPT-4o-simp is a sign of things to come. www.interconnects.ai/p/sycophancy...

In human social interaction, these cues build trust, interest, sustain attention, etc. They conflate personal affirmation and substantive agreement - hence they are doubly effective but also doubly ambiguous. "Good idea!" is affirming & possibly agreement/approval.

Analogous to honing in on the solution to a problem, this #LLM research draws conclusions from the most common "reasoning trace" & compares to final answer. Overthinking by reasoning models can be a waste of tokens - but which tokens? #AI www.arxiv.org/abs/2504.20708

arxiv.orgBeyond the Last Answer: Your Reasoning Trace Uncovers More than You ThinkLarge Language Models (LLMs) leverage step-by-step reasoning to solve complex problems. Standard evaluation practice involves generating a complete reasoning trace and assessing the correctness of the...

Wld b interesting to apply this resrch to multi-turn convos w AI - AI can't anticipate convo as we do, as it can't anticipate "where we are going" - thus the temporal anticipation on AI's side of convo will lack look ahead phrases.

This post is unavailable.

This prompted the idea of using mechanistic probing on a model trained on period literature to conduct a digital Foucauldian examination of latent sociocultural features (as evidenced by latent layer features, activitations, circuits etc). ;-) Period models - Black Mirror Hotel Reverie episode?

Ted Underwood@tedunderwood.com

New preprint from @lauraknelson.bsky.social, @mattwilkens.bsky.social, and myself tests different ways of simulating the past with LLMs. We don't fully answer the title question here—just show that simple strategies based on prompting and fine-tuning are insufficient. +

One potential but not primary benefit to personalizing LLMs to user preferences (memory & sycophancy) might be to create more signal for model verifiers & reasoning - but is there a risk then we get individualized AI-generated filter bubbles? Cognitive biases mirrored back to us?

Sleep-time compute - offline reasoning used to speculate on the user's reasoning, and generate and anticipate future queries. And if used by a group, even offer a kind of "collective intelligence" by speculating on the group or team's aggregate queries. #LLM #AI www.alphaxiv.org/abs/2504.13171

alphaxiv.orgSleep-time Compute: Beyond Inference Scaling at Test-time | alphaXivView 1 comments: Really like this idea. I've long thought it strange that LLMs reason on their own reasons but not also on the reasoning of the user. Which is what we do when we communicate — take the...

Loved this piece, and reminded of Anthony Giddens' view of tech as "disembedding mechanism" - how soon and how varied will be AI's disembedding of intellect, work, roles, jobs, tasks from contemporary society?

Henry Farrell@himself.bsky.social

Cosma Shalizi on LLMs as libraries of 'intellect' (original version - bactra.org/weblog/feral... and also republished in my newsletter www.programmablemutter.com/p/on-feral-l... )

Does this suggest a future of tiny reasoning models each with a different "cognitive" architecture (or reasoning methods and applications)?

Sung Kim@sungkim.bsky.social

Tina: Tiny Reasoning Models via LoRA Tina model achieves a >20% reasoning performance increase and 43.33% Pass@1 accuracy on AIME24, at only $9 USD post-training and evaluation cost (i.e., an estimated 260x cost reduction). The surprising effectiveness of efficient RL reasoning via LoRA.

"The Model is the Message. Models don’t talk—they reshape the conditions of thought. Where once the medium shaped the message, now the model shapes the mind." That's what ChatGPT gave me after a lengthy conversation about semiotics, McLuhan, and #LLMs

Don't use summarizers for the papers by @rao2z.bsky.social because the reasoning traces therein are, unlike the LRMs & LLMs under investigation, substantively meaningful, semantically well-ordered, and stylistically compelling and engaging! #AI #LLMs #CoT arxiv.org/abs/2504.09762

arxiv.org(How) Do reasoning models reason?We will provide a broad unifying perspective on the recent breed of Large Reasoning Models (LRMs) such as OpenAI o1 and DeepSeek R1, including their promise, sources of power, misconceptions and limit...

Adrian Chan reposted

Another chapter in AI biting the hand that feeds it: Wikipedia’s bandwidth surged 50% since January thanks to AI crawlers. Unlike search engines, they send no traffic back so no new users, no new donors. Just rising costs and a shrinking audience. A raw deal for a cornerstone of the free web.

diff.wikimedia.orgHow crawlers impact the operations of the Wikimedia projectsSince the beginning of 2024, the demand for the content created by the Wikimedia volunteer community – especially for the 144 million images, videos, and other files on Wikimedia Commons – has grow…