Ian Cook

Ian Cook

@ian.columnar.tech

I work on Apache Arrow and obsess about interoperability and performance in data analytics systems

184 followers135 following22 posts

Ian Cook reposted

📣 Just released: Version 25 of the ADBC libraries. Release highlights: C# core libraries at 1.0, Windows on ARM packages, Python 3.15 wheels, separate Go modules for core and drivers, less unsafe Rust, and PostgreSQL and SQLite driver improvements. arrow.apache.org/blog/2026/10...

Ian Cook reposted

This release is cool for a lot of reasons but my favorite is that the new Observable does database access with ADBC and returns results as Arrow. And, as a bonus, it uses @columnar.tech 's dbc (dbc.how) to install drivers.

Observable@observablehq.com

For more than a year, we’ve been quietly building an all-new Observable. Today, that new Observable is live on observablehq.com. Read Mike @ocks.org’s announcement: observablehq.com/@observableh...

Ian Cook reposted

This week we announced a new ADBC driver for Apache DataFusion. DataFusion is Rust-native, but now you can use it from 10+ other languages through the same zero-copy Arrow ADBC interface that connects to 30+ other databases and query engines. Learn more: docs.adbc-drivers.org/drivers/data...

Ian Cook reposted

This week we released version 0.3.0 of dbc, the package manager for modern database drivers. This release makes dbc: 🧩 Easier to embed inside apps 🤖 Easier to run with AI agents ⚙️ Easier to set up in CI workflows Read the announcement and install or upgrade 👇 columnar.tech/blog/dbc-0.3.0

columnar.techAnnouncing dbc 0.3.0The third release of dbc improves the experience for applications and agents that need to install and manage ADBC drivers.

Ian Cook reposted

AI coding tools speed up how we build data-driven apps. But legacy database access patterns slow us down. Join us for a live hands-on workshop to learn how ADBC makes database access faster, more portable, and better suited to analytical and agentic work. Register on Luma: luma.com/3lt47cj9

luma.comHands-on workshop: Create data-driven apps faster with ADBC and AI · Zoom · LumaAI coding tools are changing how we build data pipelines and applications, but all of that code still needs to connect to databases, and the connectivity layer…

Ian Cook reposted

The fastest operation is the one you don’t have to do. When a database natively supports @arrow.apache.org, ADBC can speed up fetching and ingestion by eliminating costly row/column conversions. How much faster is it in practice? We ran some benchmarks to find out. Link below 👇

Ian Cook reposted

This week we shipped the second release of dbc, the command-line tool for installing and managing ADBC drivers: 📦 More drivers (Oracle & Teradata) 🔐 Private registries 🛠️ Easier to embed in other tools 🧑‍💻 Better human UX 🤖 Better agent experience Full details in comments 👇

Ian Cook reposted

Apache Arrow is 10 years old 🎉 The first git commit landed on 2016-02-05. Now Arrow has 10+ official implementations and a growing third-party ecosystem. Read our celebratory blog post for some tidbits of Arrow history, and our outlook on the present and future. arrow.apache.org/blog/2026/02...

arrow.apache.orgApache Arrow is 10 years old 🎉The Apache Arrow project was officially established and had its first git commit on February 5th 2016, and we are therefore enthusiastic to announce its 10-year anniversary! Looking back over these 10...

Ian Cook reposted

Fetch query results without ODBC / JDBC bottlenecks. The new ADBC driver for Databricks is now available in early release. Install it with dbc.

Ian Cook reposted

Was anyone else like me, wondering if you can use ADBC with $5 Postgres from @planetscale.com? Well, you can! (No surprise) I wrote up my test at brycemecum.com/2025/11/15/a... #apachearrow #adbc

brycemecum.comUsing ADBC with $5 Planetscale - brycemecum.com

Ian Cook reposted

ADBC drivers in #Java? Yes. The latest release of ADBC adds a JNI layer that lets Java apps load drivers, run queries, and fetch results fast in @arrow.apache.org format. Read the new blog post from @ian.columnar.tech and David Li for examples and perf comparisons vs. JDBC. Link in comments👇

Ian Cook reposted

At Row Zero we get amazing speeds ingesting data from Snowflake and other databases that can export column-oriented data. But there's a long tail of data stores that we're forced to slow down for, because they only allow row-oriented export. Here's hoping we can change that!

Ian Cook@ian.columnar.tech

The future of data connectivity is columnar. Today we launched @columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇

Ian Cook reposted

Today's Future Data Systems Seminar Speaker: Ian Cook (@ian.columnar.tech) will present @columnar.tech's work on Apache Arrow's database connectivity API (ADBC). ADBC is available in modern DBMSs. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/futur...

db.cs.cmu.edu[Future Data] Where We're Going, We Don't Need Rows: Columnar Data Connectivity with ADBC - Carnegie Mellon Database GroupADBC (Arrow Database Connectivity) is Apache Arrow’s answer to ODBC and JDBC:... Read More +

Ian Cook reposted

Ian Cook reposted

Next Tuesday, get ready to meet the mind behind #Pandas & #ApacheArrow! @wesmckinney.com shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss. Mark your calendar for Tuesday & subscribe at thetestset.co! #DataScience #Python

DuckDB@duckdb.org

New post by Pedro Holanda, Ian Cook, Dewey Dunnington and Bryce Mecum: Arrow IPC Support in DuckDB This blog post introduces the new arrow community extension, which boosts interoperability by allowing to consume/produce data through the Arrow IPC Serialization Format. duckdb.org/2025/05/23/a...

Ian Cook reposted

Would love to see more discussion of this. To Andy's point we have this wonderful Arrow eco system that's underdeveloped. In a world of columnar data we're still stuck using ODBC/JDBC for connectivity to most data systems. Hard to get some vendors to even talk about ADBC.

Hannes Mühleisen@hannes.muehleisen.org

I was recently on a panel on "What are important data systems problems, ignored by research?" with @andypavlo.bsky.social and Allison Lee moderated by Viktor Leis - here is the write-up of the discussion databasearchitects.blogspot.com/2024/12/what...

You are up to date.