Steering vectors can work as activation oracles! Inspired by @isolyth.dev 's recent work on instruct vectors, I've ported the same approach to create Activation Oracles. Seems to work surprisingly well given the param deficit, nearly matching Activation Oracle LoRA performance.
Post
lunnova.devTrained steering vectors may work as activation oracles | lunnova.devPreliminary finding from testing on Qwen 3 8B
1 repost10 likes