Christos Kotselidis

Christos Kotselidis

@kotselidis.net

Associate Professor at The University of Manchester Co-founder at Beestream.ai Project Lead #TornadoVM #Java #AI #GPU

126 followers163 following47 posts

Christos Kotselidis reposted

TornadoVM 8.0.0 is out! After 10 years: thank you, Graal. Java kernels are now compiled by TC, our own pure-Java compiler to CUDA, OpenCL and Metal. • AOT ready • No JVMCI • Now Apache 2.0 • Your code doesn't change 👉 www.tornadovm.org/blogs/tornad... #OpenSource #Java #AI #GPU

Christos Kotselidis reposted

Yesterday my colleagues @maryxek.bsky.social and @mikepapadim.bsky.social showed live demos about using NVIDIA cuFFT and cuBLAS with @tornadovm.org for signal filtering and @jitllm.io! NVIDIA performance is a jar away from Java. #Java #CUDA #TornadoVM

TornadoVM@tornadovm.org

Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by NVIDIA, now one jar away for your Java - without caring about JNI. We also show demos with Apache Flink and @jitllm.io. Watch our talk in @devoxx.com 👇 youtu.be/6SPnBmQrYEk?... #opensource #AI #TornadoVM #Java #GPU

With the latest #TornadoVM version you can accelerate end-to-end Apache #Flink pipelines on the GPUs with native #LLM inference. No Python, no external APIs, all in one deployable jar!

TornadoVM@tornadovm.org

Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by NVIDIA, now one jar away for your Java - without caring about JNI. We also show demos with Apache Flink and @jitllm.io. Watch our talk in @devoxx.com 👇 youtu.be/6SPnBmQrYEk?... #opensource #AI #TornadoVM #Java #GPU

Christos Kotselidis reposted

jitLLM is part of the @langchain4j.dev 1.21.0 release! 🚀 Read more here: docs.langchain4j.dev/integrations... #opensource #LLM #GPU #Java #LangChain4j #Inference

docs.langchain4j.devjitLLM | LangChain4jjitLLM runs LLMs in GGUF format inside the JVM.
LangChain4j@langchain4j.dev

#LangChain4j 1.21.0 is out! 🚀 Meet Decision Models: instant yes/no, choice and scale answers with probabilities. Decision Services turn any Java interface into a classifier. Plus model routing, re-ranking, tool selection, guardrails and agentic routing! github.com/langchain4j/...

Our latest addition to the TornadoVM family. Blazing fast AI inference at native speed!

jitLLM@jitllm.io

Can Java compete with llama.cpp/ollama? YES! With @jitllm.io! jitLLM uses NVIDIA CUDA features and libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm.org and will be soon in @langchain4j.dev and @quarkus.io. github.com/beehive-lab/...

Christos Kotselidis reposted

Christos Kotselidis reposted

Java 27 arrived yesterday! And we are compatible since Day-0! #opensource #Java #TornadoVM #GPU

Christos Kotselidis reposted

Last week, at ApplePies Conference 2026, the Department of Information Engineering at the University of Pisa presented new results from our project on #FPGA acceleration for #homomorphicencryption. Read the preprint: zenodo.org/records/2277...

Christos Kotselidis reposted

It’s been a busy week in the #Java ecosystem ➤ The GA release of TornadoVM 6.0; point releases of JReleaser, LangChain4j, Java Operator SDK, JHipster, Kotlin Toolchain and Yupiik Fusion; and maintenance releases of Micronaut and GraalVM Development Kit. 🔗 #InfoQ News Roundup: buff.ly/W01plzL

Christos Kotselidis reposted

New #TornadoVM release, and it's JVMCI-free. 📌No more separate jdk25 branch, no back-syncing every PR from develop - one build for JDK 21–27. 📌Native code also migrated from JNI to Panama's FFM API - 7.5k lines of C++ gone. Kudos to all contributors! 👏 #opensource #Java #GPU #AI

TornadoVM@tornadovm.org

TornadoVM 6.0.0 is here - JVMCI-free and JNI-free. ✅ Compatible with any JDK 21-27 distribution. ✅ Cold start down 37%. ✅ 4.1× faster GEMM with Tensor-Core MMA. ✅ ~7,400 lines of C/C++ glue deleted. 📖 New blog: www.tornadovm.org/blogs/tornad... #Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI

TornadoVM is now modernized and forwards compatible with any JDK > 21 while receiving significant performance boosts! Can't wait to see those benefits translating to our AI inference engine in our next release!

TornadoVM@tornadovm.org

TornadoVM 6.0.0 is here - JVMCI-free and JNI-free. ✅ Compatible with any JDK 21-27 distribution. ✅ Cold start down 37%. ✅ 4.1× faster GEMM with Tensor-Core MMA. ✅ ~7,400 lines of C/C++ glue deleted. 📖 New blog: www.tornadovm.org/blogs/tornad... #Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI

Great news! Three talks accepted at @devoxx.com 2026! Hope to see you all and discuss the future of #Java and #AI!

TornadoVM@tornadovm.org

3 sessions accepted at @devoxx.com Belgium! 🛠️ Tools in Action: NVIDIA ecosystem from Java via #TornadoVM's Hybrid API 🎤 Talk: Building LLM inference engines in Java with TornadoVM 🧑‍💻 Hands-on Lab: From install to insight — a GPU lab for Java devs Stay tuned #Java #CUDA #LLM #AI #GPU #opensource

Christos Kotselidis reposted

Great effort and what an achievement! #LLM inference implemented in #Java, automatically accelerated on #GPUs with #TornadoVM & CUDA native support! #opensource #AI #Java #GPU

TornadoVM@tornadovm.org

GPULlama3 v1.0.0 is out - now #CUDA-native ⚡ ✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill ✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models ✅ An OpenAI-compatible server (llama-tornado --server) Pure #Java. No JNI. github.com/beehive-lab/GPULlama3.java #opensource #AI #LLM #GPU

Our #Java #AI inference engine just got another major update with a huge performance leap and native #CUDA integration!

TornadoVM@tornadovm.org

GPULlama3 v1.0.0 is out - now #CUDA-native ⚡ ✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill ✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models ✅ An OpenAI-compatible server (llama-tornado --server) Pure #Java. No JNI. github.com/beehive-lab/GPULlama3.java #opensource #AI #LLM #GPU

Christos Kotselidis reposted

The final release of the AERO software stack is here! Our new v2.0 leaflet showcases how we've optimized cloud deployments on top of the EU processor designs & accelerators. 📄 Get the brochure: aero-project.eu/posts/aero-v... #OpenSource #cloud @hipeac.bsky.social @euprojectpulse.bsky.social

aero-project.euAERO v2.0 – June 2026 - AERO at a glanceAERO-Software-Stack-Leaflet-v2.0Download AERO-Software-Stack-Leaflet-v2.0 Presentation PPTXDownload

Christos Kotselidis reposted

It’s been a busy week in the #Java ecosystem ➤ a reintroduction of Value Objects (Preview); the GA release of WildFly 41; the July 2026 edition of Open Liberty 26.0.0.7; point releases of TornadoVM, Apache TomEE, Java Operator SDK and LangChain4j; and more. 🔗 #InfoQ News Roundup: bit.ly/4pvegky

Christos Kotselidis reposted

New results presented at #IOLTS2026 by the Dept. of Information Engineering, Università di Pisa! Our work shows how #ARM #SVE accelerates Microsoft SEAL, boosting CKKS #homomorphicencryption performance. 👉 aero-project.eu/posts/aero-i... #Cybersecurity #Research

Christos Kotselidis reposted

Christos Kotselidis reposted

It’s been a busy week in the #Java ecosystem ➤ The GA release of TornadoVM 5.0; point releases of JHipster, Keycloak and Google ADK; maintenance releases of GraalVM Native Build Tools and Micronaut; the OmniFish Build of Payara and introducing Vidocq, and more. 🔗 #InfoQ News Roundup: bit.ly/4pq19Bl

Christos Kotselidis reposted

TornadoVM 5.0.0 beacons a very important milestone: Native CUDA support! JIT-compiled Java kernels and native cuBLAS/cuDNN/cuFFT calls now live in the same task graph - same GPU buffers, same CUDA stream, no round-trips between them. #opensource #Java #TornadoVM #GPU #AI 👇

TornadoVM@tornadovm.org

TornadoVM 5.0.0 is CUDA-native. One line of #Java. 74× faster. TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips. ⚡ Run with the Hybrid API: bit.ly/4vqL7sq 📖 Full engineering deep dive: bit.ly/44VecBf #AI #GPU

TornadoVM has officially transitioned into a new phase. One line of code, > 150x performance. Becoming #CUDA native unlocks new potentials for high performance #Java #AI inference with zero dependencies. Checkout our latest release, blogs, and new website 👇

TornadoVM@tornadovm.org

TornadoVM 5.0.0 is CUDA-native. One line of #Java. 74× faster. TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips. ⚡ Run with the Hybrid API: bit.ly/4vqL7sq 📖 Full engineering deep dive: bit.ly/44VecBf #AI #GPU

Christos Kotselidis reposted

TornadoVM 5.0.0 is CUDA-native. One line of #Java. 74× faster. TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips. ⚡ Run with the Hybrid API: bit.ly/4vqL7sq 📖 Full engineering deep dive: bit.ly/44VecBf #AI #GPU

Christos Kotselidis reposted

All the way from From JVM to GPUs: Building GPU-Accelerated AI Libraries in Java with TornadoVM! Learn about it from Thanos Stratikopoulos! Live at #jPrime26! Grab Your Pass: 🗓️ 3-4 June 2026! 📍 Sofia 🇧🇬! 🎫 jprime.io/tickets

Christos Kotselidis reposted

This week, Mary Xekalaki @maryxek.bsky.social presents the latest work at #ICPE2026! “Pulse: A Profiling & Visualization Infrastructure for Heterogeneous Managed Systems” 📅 Thu, May 7 🕒 14:40–15:00 🔗 github.com/beehive-lab/... 📄 zenodo.org/records/1895... #opensource #Java #GPU #TornadoVM

github.comGitHub - beehive-lab/TornadoVMPulse: A quick analyzer for TornadoVM's profilling logsA quick analyzer for TornadoVM's profilling logs. Contribute to beehive-lab/TornadoVMPulse development by creating an account on GitHub.
TornadoVM@tornadovm.org

New paper accepted at #ICPE2026! We present TornadoVMPulse, a profiling & visualization tool for #TornadoVM to analyze and optimize #Java apps on #GPUs. Results for #GPULlama3: ⚡ 18.4% faster execution 📉 38% lower data-transfer cost 🇪🇺 @aero-project.eu 📍 Florence, May26 zenodo.org/records/1895...

Christos Kotselidis reposted

Great to see this work from the TornadoVM team! As part of the AERO project, we’re excited to support open-source innovation that pushes the boundaries of running local LLMs on GPUs directly from #Java. @euprojectpulse.bsky.social @hipeac.bsky.social @eucloudedgeiot.bsky.social #opensource

TornadoVM@tornadovm.org

Last week we gave two presentations at #OCX26 and @devoxxgreece.bsky.social - and the recordings are now available, scan the QR code! From open-source evolution to running LLMs on GPUs directly from Java - there’s a lot to explore. Stay tuned for more! #opensource #Java #TornadoVM #AI #LLM #GPUs

Christos Kotselidis reposted

Last week we gave two presentations at #OCX26 and @devoxxgreece.bsky.social - and the recordings are now available, scan the QR code! From open-source evolution to running LLMs on GPUs directly from Java - there’s a lot to explore. Stay tuned for more! #opensource #Java #TornadoVM #AI #LLM #GPUs

Christos Kotselidis reposted

TornadoVM is featured in the latest Java Pro Magazine special issue (“Java in the Age of AI”, April 2026). 📌https://javapro.io/wp-content/uploads/2026/04/JAVAPRO_04-2026.pdf#page=42 @hipeac.bsky.social @euprojectpulse.bsky.social @eucloudedgeiot.bsky.social #horizoneurope #opensource #community

TornadoVM@tornadovm.org

TornadoVM is featured in the April 2026 issue of Java Pro Magazine - “Java in the Age of AI”! 👉 javapro.io/wp-content/u... In this article, @mikepapadim.bsky.social shared our experiences on building #GPU accelerated #LLM inference libraries with #TornadoVM. #Java #community #AI

Official #Apple Metal support just landed to #TornadoVM + #CUDA graphs 🚀

TornadoVM@tornadovm.org

TornadoVM v4.0.0 is out! ✔ Apple Metal backend → native Apple Silicon ✔ SIMD intrinsics for PTX → more performance ✔ CUDA Graphs → reduced overhead ✅ Downloads at TornadoVM → www.tornadovm.org/downloads Big thanks to our contributors! 👏 #Java #JDK25 #JDK21 #TornadoVM #opensource #AI #GPUs

Christos Kotselidis reposted

If you're a #Java developer on #Apple computers, #TornadoVM now enables native execution on Apple Silicon via Metal (MSL). Big applause to all contributors! 👏 #opensource #Java #AI #GPUs

TornadoVM@tornadovm.org

TornadoVM v4.0.0 is out! ✔ Apple Metal backend → native Apple Silicon ✔ SIMD intrinsics for PTX → more performance ✔ CUDA Graphs → reduced overhead ✅ Downloads at TornadoVM → www.tornadovm.org/downloads Big thanks to our contributors! 👏 #Java #JDK25 #JDK21 #TornadoVM #opensource #AI #GPUs

Christos Kotselidis reposted

We’re excited to see TornadoVM featured at OCX 2026. Thanos Stratikopoulos will share how TornadoVM evolved from academic research into an open source success story. 🕓 16:00-16:45 📍 Studio 4 www.ocxconf.org/event/2026/a... #OCX2026 #TornadoVM #opensource #Java #HPC #research

Christos Kotselidis reposted

This is a very useful tool for TornadoVM developers working on optimizing Java applications for GPUs. GitHub 👉 github.com/beehive-lab/... Preprint 👉 zenodo.org/records/1895... #opensource #TornadoVM #Java #GPU #ICPE2026

github.comGitHub - beehive-lab/TornadoVMPulse: A quick analyzer for TornadoVM's profilling logsA quick analyzer for TornadoVM's profilling logs. Contribute to beehive-lab/TornadoVMPulse development by creating an account on GitHub.
TornadoVM@tornadovm.org

New paper accepted at #ICPE2026! We present TornadoVMPulse, a profiling & visualization tool for #TornadoVM to analyze and optimize #Java apps on #GPUs. Results for #GPULlama3: ⚡ 18.4% faster execution 📉 38% lower data-transfer cost 🇪🇺 @aero-project.eu 📍 Florence, May26 zenodo.org/records/1895...