Start with model traffic
Point compatible requests through Punk to measure spend and begin finding repeated work.
// a practical comparison
Already have an AI gateway or observability tool?
Keep it. Those products solve different problems. Punk focuses on one job: turning completed agent work into proven capabilities that safely avoid unnecessary model work.
Short answer
A gateway helps requests reach models. Observability helps your team understand what happened. Punk turns successful reasoning, research paths, tool plans, and decisions into reusable know-how for future runs.
// three different jobs
Choose based on the problem you need to solve.
| Product | The question it answers | What it typically does |
|---|---|---|
| AI gateway | How should this request reach a model? | Manages provider access, credentials, limits, retries, and traffic choices. |
| Observability | What happened during this agent run? | Helps teams inspect behavior, evaluate quality, find errors, and monitor the application. |
| Punk | Does this work need another full model call? | Finds repetition, tests reuse, serves proven work, falls back when uncertain, and measures the savings. |
// how Punk fits
Add Punk without rebuilding the stack.
Punk works with supported model interfaces and can sit alongside the tools you already use. The exact integration depends on how much context you want Punk to understand.
Add richer context when useful
Supply tool actions, user scope, approvals, and business outcomes when those details affect safe reuse.
Keep your existing tools
Continue using your gateway for provider operations and your monitoring tools for broader debugging and evaluation.
// questions worth asking
Make sure any optimization can answer these.
Before it goes live
- How was the proposed reuse tested?
- Which customers, applications, and users may share it?
- What happens when the request is new or uncertain?
- Can risky actions be excluded or held for approval?
After it goes live
- Why did this request use saved work?
- How often did the system return to the model?
- Were quality problems detected?
- Are forecasts separate from actual savings?
// frequently asked
Common questions.
Does Punk replace observability?
No. Monitoring and evaluation products help teams inspect and improve the full application. Punk uses focused evidence to decide whether proven work can replace an unnecessary model call.
Is Punk an AI gateway?
Punk accepts compatible model traffic, so it can occupy the same request path. That compatibility is how you connect it—not the problem Punk is built to solve.
Can one endpoint change connect the whole agent?
It can connect supported model traffic. Full tool actions, identity, approvals, browser activity, or business outcomes may require additional application integration.
Find the problem your current stack leaves unsolved.
If your agents repeat expensive, reviewable work, Punk can show you where and whether safe reuse is worthwhile.