Applied AI @ WorkOS · Independent AI Researcher · Consultant
Local inference economics · Eval methodology · Systems from silicon to prompt
I run controlled experiments on local LLM inference, build eval harnesses with proper statistics, and publish everything as interactive technical drawings.
 The Price Floor Local inference break-even analysis M5 Max memory-bandwidth ceilings · Engine tax (llama.cpp vs ds4 = 5×) · ~$34K Blackwell build-or-buy |
 The Eval Harness Coding agent benchmark (60 runs) Local vs cloud vs frontier · Hidden-test design · Wilson interval statistics |
 The Cost Curve DeepSeek V4 Flash economics MoE routing (284B/13B active) · Quantization ladder · Cache-hit dominance (96.6%) |
 The Inference Engine Serving architecture deep-dive Prefill/decode · KV cache & PagedAttention · SARATHI · DistServe |
 The Benchmark Measurement methodology MMLU · SWE-bench · Chatbot Arena · Goodhart's law in eval |
 Practical Local Inference M5 Max + DeepSeek V4 Flash at 30-40 tok/s Workload routing matrix · $17/mo via Gateway |
17 technical drawings covering the full AI stack — each with SVG schematics, equations, academic citations, and interactive demos:
Live tools you can use right now — built into my portfolio site:
 Local vs Cloud Benchmark 60-run evidence explorer |
 Tokenization Lab BPE pricing calculator |
 RAG Visualized Pipeline step-through |
 Embeddings Explorer 3D vector space |
 Voice AI Pipeline Meeting intelligence |
Firecrawl, vertical voice AI, knowledge bases & more |
- Identity Management for Agentic AI (Oct 2025) — Co-authored white paper on authentication, authorization, and security for AI agents. With Tobin South, Alex Pentland (MIT), and others.
- RAG Evaluation chapter — Official contribution to Pinecone's Vector Databases in Production book series.
- 50+ technical articles at WorkOS, Pinecone, Cloudflare, Gruntwork — AI agents, RAG pipelines, fine-grained auth, vector DBs, IaC.
- 180+ essays on zackproser.com + external publications on The New Stack, Prefect.io, Pinecone Learning Center.
| Project | Description | Stars |
|---|---|---|
| coding-agent-eval-harness | Open-source benchmark harness for coding agent comparison | NEW |
| portfolio | zackproser.com — Next.js 15, 17 Blueprints, 9 demos, 180+ essays | — |
| handwave | watchOS app controlling Claude Code from your wrist | — |
| git-xargs | Run commands across many GitHub repos simultaneously | ⭐ 1,086 |
| cloud-nuke | AWS resource cleanup — nuke entire accounts safely | ⭐ 3,121 |
| cf-terraforming | Generate Terraform from existing Cloudflare config | ⭐ 1,324 |
 DevSecCon 2025 Keynote: Walking and Talking in the Woods with AI Voice-first development · Agent autonomy |
 WorkOS × Anthropic Claude Cowork GTM Workshop 800 registrations · Hands-on build with Lydia from Anthropic |
 AI Engineering London Skills at Scale Workshop (80 min) Claude Code skills across workflows & teams |
 AI Engineering London Untethered Productivity Staying healthy, creative & shipping in the AI era |
 WorkOS Applied AI Showcase Three Learnings from Shipping Interface beats stack · Complete the loop |
 a16z San Francisco From Jupyter Notebooks to Production Pinecone AWS Reference Architecture · ~125 attendees |
| Role | Company | Years | What I did |
|---|---|---|---|
| Applied AI | WorkOS | 2025–present | AI workflows, internal tooling, developer education. Created Claude Cowork workshop with Anthropic. |
| Staff DevRel | Pinecone | 2023–2025 | RAG pipelines, AWS reference architectures, dev education during the vector DB explosion. Spoke at a16z SF. |
| Senior Software Engineer | Cloudflare | 2020–2023 | Joined at ~100 engineers globally. Built cf-terraforming (1.3K⭐). APIs, edge infra, dev tools at scale. |
| Infrastructure Engineer | Gruntwork | 2018–2020 | Built git-xargs (1K⭐), contributed to cloud-nuke (3.1K⭐). Multi-account AWS, Terraform, production IaC. |
| Search impressions / yr Google Search Console |
Search clicks / yr avg. position 7.9 |
Visitors / yr +21% YoY |
Page views / yr +18% YoY |
Newsletter subscribers |
Regularly advising hedge funds and PE firms on AI infrastructure, developer tools, and cloud platforms via AlphaSights, Guidepoint, Tegus, GLG, Coleman.
zackproser.com ·
Twitter/X ·
LinkedIn ·
YouTube ·
mindonfire.net