Post

Introducing FACTS Grounding. A new benchmark we’re launching with Google DeepMind to evaluate LLM’s factual accuracy on over 1700 tasks. 🧠📐

Kaggle

@kaggle.com

17 Dec 2024

We’ve partnered with Google DeepMind to publish a leaderboard of models on this new factuality benchmark. Check it out at: www.kaggle.com/facts-leader...

kaggle.comkaggle.com

Kaggle

@kaggle.com

The leaderboard results are calculated using 1719 factual grounding tasks. Each example includes a document, a system instruction requiring the LLM to exclusively reference the provided document, and an accompanying user request.

17/12/24, 3:36 pm0 reposts0 likes

Kaggle

@kaggle.com

17 Dec 2024

We’ve published 860 tasks as a public data set for anyone to use: www.kaggle.com/datasets/dee...

kaggle.comFACTS Grounding 1.0 Public Examples860 public examples for the FACTS Grounding leaderboard from Google DeepMind.

Kaggle

@kaggle.com

17 Dec 2024

For full details, check out the technical report & blog post. 👉Technical Report: goo.gle/FACTS_paper 👉 Blog post: deepmind.google/discover/blo...

We’ll be expanding and maintaining FACTS over time with new models and tasks. We hope FACTS Grounding helps promote the development of knowledgeable and trustworthy AI systems.

Kaggle

@kaggle.com

17 Dec 2024

We’ll also be working with model owners and the community to add more models to the leaderboard over time. Let us know what we should evaluate next! 👀