Spiral

Spiral

@spiraldb.com

Bringing simplicity to your multimodal data. SPIRAL = Storage Packed In Recursive Arrays and Layers

63 followers5 following10 posts

Spiral reposted

Frederic Branczyk
@brancz.com

Vortex is incredibly exciting, we’ve already made plans months ago to make it the primary format we will be storing our data in on object storage! www.linuxfoundation.org/press/lf-ai-...

linuxfoundation.orgLF AI & Data Foundation Hosts Vortex Project to Power High Performance Data Access for AI and AnalyticsContributed by SpiralDB, Vortex is an extensible, next-generation columnar storage format designed for building high-performance, future-proof data systems
Spiral
@spiraldb.com

We managed to accelerate the entire TPC-H (sf=100) suite by 30%, with many of the slowest queries seeing a 2-4x speedup. Check out the post for the inside scoop 🧊

Andrew Duffy@a10y.dev

Last month I worked on Apache Iceberg integration for Vortex, the results of which we presented earlier this month at Iceberg Summit. I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark spiraldb.com/post/vortex-...

spiraldb.comVortex on IceUsing Vortex to accelerate Apache Iceberg queries up to 4x
Spiral
@spiraldb.com

We're starting a London Systems meetup, to give a chance for (software) engineers to share and discuss their work on the underlying systems and that power most of our world - databases, compilers, VMs etc. and we're looking for speakers! lu.ma/londonsystems

lu.maLondon Systems · Events CalendarView and subscribe to events from London Systems on Luma. A meetup focus on systems-oriented software engineering topics, from experts to anyone. Focused on systems like compilers, databases, browsers...

Spiral reposted

Nicholas Gates
@ngates.bsky.social

It's still early days, but initial results suggest DataFusion (Vortex, partitioned) knocks ~15% off the total runtime of DataFusion (Parquet, partitioned) 🚀

Nicholas Gates@ngates.bsky.social

This is awesome work! It’s got us curious how much faster we can push ClickBench with DataFusion on Vortex files 🧐 Will report back…

You are up to date.