Pinned
I published Vol. 177 of "Top Information Retrieval Papers of the Week" on Substack. ๐ recsys.substack.com/p/searchjev-...
Sumit
@reachsumit.com
Senior MLE at Meta. Trying to keep up with the Information Retrieval domain! Blog: https://blog.reachsumit.com/ Newsletter: https://recsys.substack.com/
297 followers37 following3.9K posts
Pinned
I published Vol. 177 of "Top Information Retrieval Papers of the Week" on Substack. ๐ recsys.substack.com/p/searchjev-...
EffBench: A Holistic Efficiency Benchmark for CTR Models Introduces a benchmark that compares CTR models on efficiency as well as accuracy, with latency and throughput metrics and a profiling tool that finds bottlenecks. ๐ doi.org/10.1145/3857... ๐จ๐ฝโ๐ป github.com/Yeedzhi/EffB...
ER-RAG: Enhance RAG with ER-Based Unified Modeling of Heterogeneous Data Source Introduces a RAG framework that retrieves from web pages, databases and knowledge graphs through one shared API, with a trained module that picks which sources to query. ๐ doi.org/10.1145/3860...
SearchHorizonBench: A Benchmark for Search Value in AI Agents Introduces a benchmark for judging when an extra web search is worth its cost for an AI agent, using paired runs that either answer directly or search further from the same point. ๐ arxiv.org/abs/2610.34714 ๐จ๐ฝโ๐ป github.com/EthanNing/Se...
MuSID-KD: Multigranularity Knowledge Distillation for Generative Recommendation with Semantic IDs Improves distillation of semantic ID recommenders by aligning candidate group distributions at each ID level. ๐ arxiv.org/abs/2610.35218 ๐จ๐ฝโ๐ป anonymous.4open.science/r/m7k2-revie...
Can System-1-Style Decision Models Replace Dedicated Rerankers in RAG? A Systems Evaluation Tests decision models as reranker replacements. Truncation makes some competitive, but a tuned dedicated reranker is still faster and uses far less GPU memory. ๐ arxiv.org/abs/2610.34816
Memory Tax: Dissecting the Net Value of Agent Memory Finds that many agent memory systems score below naive RAG over raw history. Splits memory's net value into benefit and tax. ๐ arxiv.org/abs/2610.34073 ๐จ๐ฝโ๐ป hexuan21.github.io/MemoryTax ๐ค huggingface.co/datasets/hex...
PinGER: Token-Efficient Generative Retrieval with Semantic IDs Pinterest presents its generative retriever that replaces nearest-neighbor search. An asymmetric attention mask trains with semantic ID supervision but serves only one token per item. ๐ arxiv.org/abs/2610.33435
Rethinking Retrieval in the Long-Context Era: Training-Free Semantic Trees for Adaptive Context Construction Builds a training-free semantic tree of a long document and gives the LLM only relevant sections. ๐ arxiv.org/abs/2610.34146 ๐จ๐ฝโ๐ป anonymous.4open.science/r/treefuse-E...
LoopGR: Parameter-Efficient Scaling for Generative Recommendation via Recurrent Depth Reuses a shared decoder and a light context updater in recurrent loops to add depth without adding parameters, then distills it into a cheaper low-loop student. ๐ arxiv.org/abs/2610.34157
Theoretically Sound Item Similarity Measures for Recommender Systems Derives item similarity measures from Bernoulli and multinomial Naive Bayes, and shows cosine similarity solves a specific optimization problem. ๐ arxiv.org/abs/2610.34402 ๐จ๐ฝโ๐ป github.com/noah-daniels...
Knowing When the Evidence Is Enough: Requirement-Directed Search with Horn-Closure Certificates Decides whether to answer, search again, or abstain using a per-query requirement hypergraph and Horn closure instead of having a model judge the evidence. ๐ arxiv.org/abs/2610.34684
SLIDE: Search-to-List Item Distillation for Single-Rollout Generative Retrieval Distills a teacher model's offline beam-search results into list-wise targets, so a smaller generative retrieval model can produce a full ranked list in one greedy pass. ๐ arxiv.org/abs/2610.34764
Octen-WebGR: Scaling Generative Retrieval to 200 Million Web Pages Introduces a generative retriever that indexes 201 million web pages with two-token identifiers for navigational search. ๐ arxiv.org/abs/2610.35256 ๐จ๐ฝโ๐ป github.com/Octen-Team ๐ค huggingface.co/Octen
Unified Heterogeneous Feature Interaction via Effective-Rank Scaling for Recommender Systems Introduces a ranking model that combines behavior sequence modeling and feature interaction in a single backbone for multi-scenario recommendation. ๐ arxiv.org/abs/2610.35318
Towards a Unified Framework of Optimal Input-Side Dimensional Configuration for Deep CTR Prediction Introduces a framework that jointly selects samples, features, and embedding units for CTR prediction, using optimal transport to align the levels. ๐ arxiv.org/abs/2610.35695
Do Similarity Measures Measure Similarity? How User Activity Creates Phantom Correlation in Recommender Systems Shows that differences in user activity alone make items look similar, even when users share no taste. ๐ arxiv.org/abs/2610.35765 ๐จ๐ฝโ๐ป github.com/Mfavier91/Ph...
ACARe: Agent-Context-Aware Reranker for Iterative Search Introduces a compact reranker for search agents that scores documents using the original question and reasoning trace, not just the agent's sub-query, improving retrieval and cutting searches. ๐ arxiv.org/abs/2610.35840
Retriever-Free Retrieval: Navigating Documents with Decision Models Retrieves by walking down a corpus hierarchy, with a decision model scoring all candidates at each level in a single pass, without generating tokens. ๐ arxiv.org/abs/2610.35868
Beyond Post-Hoc Rewards: Privileged Reasoning Exploration for Multimodal Embeddings Uses training-time positive and negative candidates to guide reasoning exploration for multimodal embeddings, with input-only inference. ๐ arxiv.org/abs/2610.32474
TGR-EvoDAG: A DAG-based Multi-Agent Code Evolution Framework for Generative Recommendation on Tencent Tencent introduces a multi-agent framework that evolves generative recommendation code as a DAG of branches, with GPU cost planning for each pipeline stage. ๐ arxiv.org/abs/2610.32326
MICE to Meet You: From Re-ranking Only to End-to-End Retrieval Introduces MICE-P, which indexes MICE document representations with PLAID to build an end-to-end retrieval pipeline with cross-encoder-like effectiveness. ๐ arxiv.org/abs/2610.31932 ๐จ๐ฝโ๐ป github.com/xpmir/mice
From Item Scores to Semantic Tokens: Test-Time Collaborative Adaptation for Generative Recommendation Introduces a training-free way to use discriminative item scores to guide beam search in a frozen generative recommender before prefixes get pruned. ๐ arxiv.org/abs/2610.32098
PersonalQuery-Benchmark: Evaluating Retrieval Robustness to Personalized User Expression Differences Introduces a benchmark where personalized query syntax and writing errors shift rankings for a fixed information need. ๐ arxiv.org/abs/2610.32164 ๐จ๐ฝโ๐ป github.com/cpxjazz123/P...
System One Models Are Not Better Rerankers Finds that decision (System One) fine-tuning never beats plain reranker fine-tuning on the same Qwen backbones, and its calibration advantage depends on the question wording. ๐ arxiv.org/abs/2610.32318 ๐จ๐ฝโ๐ป github.com/KanishkaGD/d...
Agentic Memory Management Is the Next Frontier of Information Retrieval Presents a perspective paper arguing that managing an AI agent's memory is a natural extension of IR. Also shares a memory framework, a comparison with classic IR, and a research agenda. ๐ arxiv.org/abs/2610.32464
Agentic Memory Management Is the Next Frontier of Information Retrieval Presents a perspective paper arguing that managing an AI agent's memory is a natural extension of IR. Also shares a memory framework, a comparison with classic IR, and a research agenda. ๐ arxiv.org/abs/2610.32464
Knowledge Distillation across Item and Code Spaces for Parallel Generative Recommendation Proposes two objectives that distill a sequential recommender's item scores into a parallel semantic ID model, matching item distributions or code marginals. ๐ arxiv.org/abs/2610.32943
Separating Thinking from Spelling for Efficient Generative Recommendation Presents a GR system where the backbone reads the user history once into a compact concept and a light decoder runs the entire semantic ID beam search, which cuts serving cost. ๐ arxiv.org/abs/2610.32980
Safe and Sufficient Caching: Per-Request Validated Evidence Reuse for Production Retrieval-Augmented Generation Amazon caches evidence chunks and checks access and source freshness before reuse, cutting latency and retrieval cost with zero invalid reuse. ๐ www.amazon.science/publications...
TransX Technical Report: Scaling Sequence Transduction for Recommendation LinkedIn presents a recommender that separates history encoding, behavior memory, and candidate scoring so most work runs offline, letting models scale without raising serving cost. ๐ arxiv.org/abs/2610.20913
Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval Trains a retrieval model to reason step by step and stop once extra reasoning stops helping, cutting generation cost and latency. ๐ arxiv.org/abs/2610.21030 ๐จ๐ฝโ๐ป github.com/yingtaoluo/A...
Beyond Retrieval Failure: Understanding Why LLMs Miss Evidence in Multi-Hop RAG Finds that missing evidence in multi-hop RAG often stems from search drift, not retriever limits. ๐ arxiv.org/abs/2610.21184
RecSoup: Efficient Model Merging Approach for Controllable Multi-Objective Recommendation Merges objective-specific recommenders after pruning conflicting parameters, so trade-offs can be tuned without retraining. ๐ arxiv.org/abs/2610.21220 ๐จ๐ฝโ๐ป github.com/35798642/REC...
Aligning LLMs with Sparse Retrieval via Adaptive Sparse Supervision Aligns an LLM with SPLADE's vocabulary space using input-adaptive truncation, keeping inverted-index retrieval with much lower storage and latency than prior LLM sparse retrievers. ๐ arxiv.org/abs/2610.21877
CASI: Credit Assignment via Set Intervention for Agentic Retrieval Xiaohongshu proposes assigning credit to jointly generated retrieval actions under one shared reward by scoring subsets of cached retrievals with Shapley values. ๐ arxiv.org/abs/2610.20293
Revisiting Generative vs. Dense Retrieval: A Static Value Prior Reverses the Gap Finds that generative retrieval's item-value lead in e-commerce comes largely from popularity. ๐ arxiv.org/abs/2610.19065 ๐จ๐ฝโ๐ป anonymous.4open.science/r/gr-dr-rele...
ListQA: A Benchmark for Evaluating List-Formatted Factual Knowledge Retrieval in Large Language Models Introduces a benchmark where LLMs recall several facts from Wikipedia tables and return them as structured lists. ๐ arxiv.org/abs/2610.19165 ๐จ๐ฝโ๐ป listqa.github.io
RCER: Reconstructing Cross-Evidence Relations for Iterative Retrieval-Augmented Generation Introduces an iterative RAG method that reconstructs relations across retrieved passages to guide retrieval, select complementary passages, and compose answers. ๐ arxiv.org/abs/2610.19398
Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation Uses RL to teach an LLM when to retrieve for translation, and trains the retriever on translation quality, not similarity. ๐ arxiv.org/abs/2610.19528
Cascaded Retrieval with Cross-Modal Query Refinement for Efficient Visual Document Search Introduces a cascaded framework that cuts latency in visual document retrieval by reranking a small candidate pool and refining the query with offline summaries. ๐ arxiv.org/abs/2610.20367
Configuring RAG Systems: What Breaks, Where Originates, and How to Fix Presents an empirical study of configuration issues in open-source RAG systems, categorizing symptoms, root causes, and fix patterns across the pipeline stages. ๐ arxiv.org/abs/2610.18567 ๐จ๐ฝโ๐ป github.com/ideas-labo/r...
Many Right Answers, One Training Example: Removing Responder Noise from GRPO for LLM Recommenders Introduces a system that rewards recommender lists against all responders' titles at once, making GRPO training cheaper. ๐ arxiv.org/abs/2610.17771 ๐จ๐ฝโ๐ป lixin.ai/ReMaRk
DRanker: A Transformer-Based Multi-Task Ranking Model for the Disney+ Homepage Disney describes a transformer ranker for the Disney+ homepage with a lightweight causal debiasing tower for popularity bias. ๐ arxiv.org/abs/2610.15696
Personalized LLM Recommendation with Semantic IDs: Autoregressive Beam Search vs. Multi-Token Prediction at Industry Scale Netflix compares beam search & multi-token prediction for generating Semantic IDs in LLM recommenders. Beam search wins on ranking. ๐ arxiv.org/abs/2610.15864
UniSGR-V2: Stepwise Target-Side Feature Anticipation and Crossing for Generative Recommendation Introduces a system that predicts continuous target-item features at each semantic-ID decoding step and uses them for both code generation and ranking. ๐ arxiv.org/abs/2610.16132
Label-Centric Knowledge Retrieval for Zero-Shot Text Classification Presents a system where a large LLM builds label definitions and boundary rules offline, and a small LLM classifies zero-shot by retrieving that knowledge instead of labeled examples. ๐ arxiv.org/abs/2610.16182
From a Large-Scale Teacher to Efficient Multimodal Students for Search Relevance Prediction eBay distills a GPT-4.1 relevance judge into smaller multimodal Gemma-3 models for e-commerce search, keeping near-teacher quality at much lower cost and latency. ๐ arxiv.org/abs/2610.16569
KNN Implementation Details Can Dramatically Change Performance: An Example from Cover Trees Shows how query mode, base parameter, and micro-optimizations affect cover tree speed. ๐ arxiv.org/abs/2610.16940 ๐จ๐ฝโ๐ป github.com/CrowdStrike/...
WeGR: Unified Generative Retrieval for Industrial Search Systems in WeChat Presents generative retrieval for WeChat search, with a tokenizer that adds collaborative signals without codebook collapse and an RL method that rewards semantic ID prefixes. ๐ arxiv.org/abs/2610.16979
HASTE: Hierarchical and Attribute-aware Supervision for Generative Recommendation Replaces standard cross-entropy in generative recommendation with a level-aware loss over semantic IDs, and adds attribute prediction heads that help tail items. ๐ arxiv.org/abs/2610.17368