Codex Migration & Refactor Pack
Six Codex skills + a runnable verifier for dev teams: framework upgrades (Next 15, React 19), dependency sweeps, monolith extraction, test backfill, dead-code removal. SHIP or HOLD with proof.
See all
16 items
25+ multi-agent patterns. Full code in Claude Agent SDK + LangGraph. Eval harnesses included.
Build MCP servers useful to agents and safe by default: a grounded four-phase workflow, tool-design + security patterns, an inventory + checklist workbook, and a Pass/Fix/Block tool linter (a leaked secret, over-broad scope, or dangerous capability is a hard Block). Security guidance, not a security audit.
Score the retrieval step of your RAG pipeline — Recall@k, Precision@k, MRR, nDCG — and get a ship / hold / fix verdict with every miss named. Python + TypeScript, any vector DB, gates retrieval in CI. Pairs with AutoChunk: chunk there, grade here.
Before you ground an AI on your documents, gate the corpus. Mark six 0/1/2 content controls (freshness, single source of truth, named ownership, structure & chunkability, access-permission mapping, top-question coverage); the verdict is the weakest control — ANSWER-READY / STALE / UNGROUNDED — with a dispositive worsen-only gate that forces UNGROUNDED on contradictory authoritative docs or unmapped permissions, even at a 92% score. Not a retrieval-metric grader and never touches a vector DB — it grades whether the documents are worth retrieving in the first place. Runnable Python engine + workbook that reproduces it + audit & fix-it playbooks + a 6-corpus sample. Scores the corpus, never people; reads no live data.
Prompt injection ends; a poisoned memory doesn't. A pre-deployment probe for agent memory, RAG indexes, and context stores: mark six OWASP ASI06 lifecycle controls (write-path validation, trust-aware retrieval, provenance, scope isolation, decay/TTL, audit trail) for a weighted 0-100 score and CONTAINED / HARDEN / POROUS, with a two-condition kill-chain gate that forces POROUS when poison can be both written (weak validation) and recalled as ground truth (no trust check) — even at 78/100. Names the control to fix first; rolls a fleet up. Runnable Python engine + workbook + exposure-audit & fix-the-control playbooks + a 7-store sample. The persistence layer beside the Prompt Injection Red Team Kit. Grades the architecture, never people. Not a scanner or attack simulator.
The security check vibe-coding skips. Nearly half of AI-generated code ships with a known vulnerability — run this gate before your first public launch. Mark six controls per app (secrets out of the client bundle, server-side auth on every sensitive route, input validation & injection defense, dependency & supply-chain integrity, no verbose errors/source maps in prod, access control actually tested) for a weighted 0-100 score and LAUNCH-READY / HARDEN FIRST / DO NOT SHIP, with a single-fault gate that forces DO NOT SHIP when either secrets or server-side auth is absent — even at 78/100, the exposed-DB-key-in-the-client pattern. Names the control to fix first; rolls a batch up. Runnable Python engine + workbook + audit & fix-the-control playbooks + a 7-app sample. The launch-moment go/no-go beside the Vibe-Coded App Hardening Kit. Grades the posture you describe, never people. Not a scanner or pentest.
Evaluate AI agents at the trajectory level — tool choice, argument validity, step efficiency, cost, and policy — and gate CI on a ship / hold / fix verdict. Six deterministic evaluators, framework-agnostic, Python, zero dependencies. The fourth dev-tools gate: agent behavior.