Skip to main content
Changelog
Avatar for Annie Sexton

Annie Sexton

2 posts

Annie Sexton is a Developer Educator at ngrok with a passion for nerd-sniping developers. She also has over a decade of experience working at PaaS companies such as Heroku, Render, and Fly.io.

Latest posts

  1. Nov 5, 2026

    Latest Post

    Serving open-weight models at scale with vLLM

    Serving LLMs at scale is hard. Learn how inference works and how vLLM uses continuous batching, PagedAttention, prefix caching, and more to keep GPUs busy.

    Avatar for Annie Sexton

    Annie Sexton

    •

    ~4.8K words

    Topics:

  2. Aug 11, 2026

    Compression is prediction

    Compression and LLMs are trying to solve the exact same problem: predicting what comes next. Learn the fundamentals of compression and how better prediction leads to better shrinkage.

    Avatar for Annie Sexton

    Annie Sexton

    •

    ~3.3K words

    Topics: