Modal (@modal-labs.bsky.social)

Modal

@modal-labs.bsky.social

Bring your own code, and run CPU, GPU, and data-intensive compute at scale. The serverless platform for AI and data teams.

197 followers 3 following2 posts

Modal

@modal-labs.bsky.social

30 Jan 2025

New blog post diving into the technical details of our container memory snapshot restore functionality. Container memory restores can reduce cold start latency on user functions by more than 50% 💥

Jonathon Belotti@jonathonbelotti.bsky.social

Wrote about how a warmed up container can be saved to disk and later restored for a 2.5x cold start performance boost. Saving live container processes to disk turns out to be pretty whacky and interesting! modal.com/blog/mem-sna...

modal.comMemory Snapshots: Checkpoint/Restore for Sub-second StartupSerializing container state to disk for aggressive cold start optimization.

Modal

@modal-labs.bsky.social

13 Dec 2024

our resident cuda guru dropping some deep gpu knowledge 🧠

Charles Frye@charles-irl.bsky.social

- 44 terms from all across the CUDA stack, each defined in its own article - promiscuous interlinks, so you can drill into details naturally in the flow of reading - slick themes and clean diagrams. who said technical docs had to be ugly? modal.com/gpu-glossary

modal.comGPU GlossaryA glossary of terms related to GPUs.

Modal reposted

Eric Zhang

@ekzhang.bsky.social

2 Dec 2024

new blog post: how at work, we built static IPs for serverless functions via WireGuard VPNs. with some diagrams explaining how container networking works! :D modal.com/blog/vprox

You are up to date.