Packet loss on llama.cpp RPC

What one-way packet loss does to a short llama.cpp RPC request, then to a request held at 128 tokens.

Read in the order below. Publication dates are preserved independently.

  1. At 5% packet loss, 16 of 30 llama.cpp RPC requests fell below half their baseline — 2026-10-06
  2. At 128 tokens, loss slowed llama.cpp RPC down a slope, not off a cliff — 2026-10-07
Back to top