Shivansh Vij

Shivansh Vij

@shivanshvij.com

CEO @loopholelabs.io

1.6K followers193 following72 posts

I may be a bit late to the “time to interactive” agent sandbox party, but I wanted to make sure our hypervisor absolutely MOGGED everyone else. 10x faster than Firecracker and 425x faster than Cloud Hypervisor. agx.so is the best agent infra platform, period.

Once the sandbox providers figure out performance and scale, the next hills to climb will be: - agent/harness integration (ie. Shelley from @exe.dev) - agent to agent communication (ie. side channels between your sandboxes) - agent tracing integrations (think raindrop AI)

I think that workload portability will be the next big AI sandbox unblocker. With the ridiculous wave of sandbox compute being deployed right now, having the ability to move long-running workloads between nodes (spot instances!) or even clouds is *the* silver bullet for both availability and cost.

In-kernel filesystem are going to destroy the FUSE ecosystem. Bringing your custom logic into the VFS directly is absolutely incredible for performance and latency.

Who’s going to FOSDEM in Brussels next week? DM me if you'd like to hang out, talk about high performance cloud infrastructure, live migration, eBPF, Spot Instances - or all of the above! Looking forward to meeting all the cool OSS folks!

Who’s going to re:invent in Las Vegas next week? DM me if you'd like to hang out, talk about high performance cloud infrastructure, live migration, eBPF, Spot Instances - or all of the above! Can’t wait to see everyone! #aws #reinvent #reinvent2025

We finally decided to write out how we use XDP in our network plane for live network migrations and more specifically to process outgoing packets! This is the first in a series of promised deep dives into how Loophole's live migration tech works!

Loophole Labs@loopholelabs.io

An eBPF Loophole: Using XDP for Egress Traffic XDP is Linux's fastest packet processor but only handles incoming traffic. We found a loophole in how the kernel determines packet direction to make it work for outgoing traffic too! Blog post with details 👇 loopholelabs.io/blog/xdp-for...

- How to run VMs anywhere (even without KVM support) - How to do L3/4 Checksums in eBPF XDP hooks - How to write an in-kernel filesystem (and why) - Deduplicating memory between VMs - Reverse Engineering the CUDA API

Shivansh Vij reposted

Just got to Malta for the company getaway! It’s really convenient that these EU outlets have a whole THREE USB-C outlets! So great.

Shivansh Vij reposted

I think the most excited thing about this blog post is the one we get to publish next - a deep dive into how Architect works under the hood. There were so many “impossible” problems we had to solve to make Architect a reality - and now that we have I’m having a blast explaining how we did it.

Loophole Labs@loopholelabs.io

New blog post! Run any application on Spot Instances with zero downtime and 75%+ cost savings - and no code changes required. Architect eliminates the reliability concerns that previously made Spot Instances impractical for production workloads. ⬇️ Link in comments ⬇️

Shivansh Vij reposted

Shivansh Vij reposted

This looks super cool. Get up to 75% cost-savings of using spot instances without data loss or interruption. My mental model of what this does is the equivalent of vSphere vMotion, but for spot instance workloads running in the Cloud.

Shivansh Vij@shivanshvij.com

I think the most excited thing about this blog post is the one we get to publish next - a deep dive into how Architect works under the hood. There were so many “impossible” problems we had to solve to make Architect a reality - and now that we have I’m having a blast explaining how we did it.

I think the most excited thing about this blog post is the one we get to publish next - a deep dive into how Architect works under the hood. There were so many “impossible” problems we had to solve to make Architect a reality - and now that we have I’m having a blast explaining how we did it.

Loophole Labs@loopholelabs.io

New blog post! Run any application on Spot Instances with zero downtime and 75%+ cost savings - and no code changes required. Architect eliminates the reliability concerns that previously made Spot Instances impractical for production workloads. ⬇️ Link in comments ⬇️

Shivansh Vij reposted

New blog post! Run any application on Spot Instances with zero downtime and 75%+ cost savings - and no code changes required. Architect eliminates the reliability concerns that previously made Spot Instances impractical for production workloads. ⬇️ Link in comments ⬇️

Shivansh Vij reposted

Who’s going to be at #aws #reinvent in Las Vegas next week? If folks are around I’d love meet up and talk about VMs (like running them on non-metal instances), #eBPF, and live migration (for VMs and GPUs)! DMs Open!

Who’s going to be at #aws #reinvent in Las Vegas next week? If folks are around I’d love meet up and talk about VMs (like running them on non-metal instances), #eBPF, and live migration (for VMs and GPUs)! DMs Open!

Hard won #eBPF lesson: bpf_redirect doesn’t work between interfaces where the sender has an xdp program loaded in native mode and the other has one loaded in generic mode (only with some cloud/os pairs)

Shivansh Vij reposted

The best demo yesterday being able to live to migrate stateful workloads from one cluster to another, allows for blue/green upgrades of Kubernetes with zero downtime For the folks at loophole labs: github.com/loopholelabs #Rejekts #KubeCon #SLC #Kubernetes #CNCF

Shivansh Vij reposted

All I can say is, prepare to have your mind blown 🤯 @pojntfx’s talk from @KubeCon_ last year is pretty famous at this point, but it doesn’t come close to what we’ll be demoing this time. Cloud-Native VMotion is here, and you’ll be able to see it *live* during this talk.

Felicitas Pojtinger 🌅@pojntfx.mastodon.social.ap.brid.gy

Are you into #OpenSource #virtualization, live migration, #Kubernetes, #eBPF, and bleeding-edge network migration tech? If you're at #KubeCon North America in Salt Lake City this week, don't miss my session where I'll live migrate a multi-node Kubernetes […] [Original post on mastodon.social]

All I can say is, prepare to have your mind blown 🤯 @pojntfx’s talk from @KubeCon_ last year is pretty famous at this point, but it doesn’t come close to what we’ll be demoing this time. Cloud-Native VMotion is here, and you’ll be able to see it *live* during this talk.

Felicitas Pojtinger 🌅@pojntfx.mastodon.social.ap.brid.gy

Are you into #OpenSource #virtualization, live migration, #Kubernetes, #eBPF, and bleeding-edge network migration tech? If you're at #KubeCon North America in Salt Lake City this week, don't miss my session where I'll live migrate a multi-node Kubernetes […] [Original post on mastodon.social]

Shivansh Vij reposted

Yes I miss my X network here but Im sure I will be able to build my 50k audience back here as well. If you like Kubernetes, cloud, wasm, content creation, DevRelthen do follow me as thats what I post about most times. See you around if uou are at #kubecon NA