Hossain Pazooki

LLM Inference & Agentic Systems

Carryover: the reuse margin of a stale KV cache in long-horizon agents — carryover.pub

Research

Carryover: The Reuse Margin of a Stale KV Cache in Long-Horizon Agents

First author · NeurIPS 2026 Workshop on Long-Context Foundation Models

When a long-horizon agent hands off, can the next step reuse the cache the last one left behind? We measured it at 35 recorded coding-agent handoffs with 35K–80K-token histories. At a tolerance fixed before any run, the median same-model removal fraction is zero — replicated across three models — yet reused states still shift next-token predictions (median 90.2% top-1 agreement with a fresh cache). Cache agreement and prediction sensitivity have to be checked separately; meeting one does not guarantee the other. The study was pre-registered: hypotheses and decision rules committed before any run, results on a hash-chained ledger, outcomes reported as decided, including the ones the data would not support.

Prefix mortality

◐ in preparation

How long a cached prefix stays useful as an agent's context moves on.

Production

full cv →

Five years building the layer that makes failure loud and early: observability that catches drift before users do, and release gates that earn no credit until they are proven able to fail.

Orawell
Tech lead · 2024 – 2026
New York

Tech lead of a regulated, HIPAA-aligned platform: FastAPI services on Kubernetes (EKS), CI/CD gated by 450+ tests with auto-rollback, an observability and performance-monitoring stack on OpenTelemetry, Prometheus, and Grafana. Carried on-call and led incident response; a production calibration-drift incident was root-caused and closed by rebuilding the decision gate to fail closed, not fail silent.

Engager
Technical co-founder · sole engineer · 2022 – 2024
New York

Sole engineer taking a product from zero to one: architecture, CI/CD, and development practice from the first commit. Designed the data model and core backend in Python and PostgreSQL, shipped the React/TypeScript frontend, and ran containerized AWS deployment, observability, and releases end to end.

3DEO
Founding ML engineer · 2020 – 2022
Los Angeles

Founding ML engineer at an additive-manufacturing R&D org: a unified data layer joining process parameters to outcomes by part ID, and model-serving hooks with drift monitoring against ground truth, built alongside the scientists who used it daily.

linear-ceiling ↗ the harness behind Carryover; results credited only through it, decision rules fixed before any run paper code
rigor ↗ audits the other two: no claim credited until its gate is proven able to fail on a known-bad twin /rigor →
regulatory-rule-engine ↗ irreversible actions pass a deterministic gate; unevaluable never collapses into a pass
intent-plane ↗ agents propose, the gate disposes /intent →

Contact

email hossain@pazooki.com → github github.com/hossainpazooki ↗ linkedin linkedin.com/in/hossainpazooki ↗ scholar Google Scholar ↗ arxiv pending education B.A. International Relations & Global Economy, University of Southern California