Nicholas Gates

Nicholas Gates

@ngates.bsky.social

CTO @ Spiral | Creator of Vortex File Format (https://github.com/spiraldb/vortex)

32 followers102 following4 posts

It's still early days, but initial results suggest DataFusion (Vortex, partitioned) knocks ~15% off the total runtime of DataFusion (Parquet, partitioned) 🚀

Nicholas Gates@ngates.bsky.social

This is awesome work! It’s got us curious how much faster we can push ClickBench with DataFusion on Vortex files 🧐 Will report back…

This is awesome work! It’s got us curious how much faster we can push ClickBench with DataFusion on Vortex files 🧐 Will report back…

Andrew Lamb@andrewlamb1111.bsky.social

This has been a long time coming. After the concerted efforts many engineers from across companies and across continents, posted some great benchmark results datafusion.apache.org/blog/2024/11...

You are up to date.