Jonathan Frankle on Mythryl: “The hardest part about finetuning is that people don't have labeled…”

The hardest part about finetuning is that people don't have labeled data. Today, @databricks.bsky.social introduced TAO, a new finetuning method that only needs inputs, no labels necessary. Best of all, it actually beats supervised finetuning on labeled data. www.databricks.com/blog/tao-usi...

databricks.comTAO: Using test-time compute to train efficient LLMs without labeled dataLIFT fine-tunes LLMs without labels using reinforcement learning, boosting performance on enterprise tasks.

25/3/25, 5:19 pm6 reposts35 likes

Post