vault.systemdrd.com

Everything you need to ship production AI systems.

Digital toolkits, architecture guides, and async cohorts built directly from the AIEWorks newsletter. One purchase. Lifetime access. No live sessions required.

Newsletter
AIEWorks
Subscribers
10K+
Courses shipped
2
Production arcs
4
Repos on GitHub

Free from the newsletter

Every Concept Note and the complete Arc 1 build-along are permanently free. Subscribe once and these never move behind a paywall.

FREE / CONCEPT NOTE

The support ticket that found your eval gap

Why every AI support ticket is already a perfectly structured eval case — and the habit that closes the gap.

Read on Substack →
FREE / ARC 1 — BUILD LOG 1

Golden dataset design + CLI tool

Build the eval case dataset format, versioning schema, and the CLI that turns tickets into test cases. Runnable repo included.

Read on Substack →
FREE / CONCEPT NOTE

Why your QA process has no non-determinism column

The structural gap between traditional test planning and AI feature testing — for QA engineers and engineering managers.

Read on Substack →
FREE / 60-DAY COURSE

AI Engineering with Quiz Platform

The original 60-day hands-on course. Days 1–3 unlocked. System architecture, requirements, database schema — all free.

View curriculum →
FREE / 180-DAY COURSE

AI & Machine Learning from Scratch

180-day curriculum from Python fundamentals to deep learning. Foundation for everything in the vault.

View curriculum →
FREE / CONCEPT NOTE

The architecture review that never happened

What an AI system design review must cover that a traditional architecture review does not.

Read on Substack →

Digital products

Toolkits, playbooks, and reference packs extracted directly from the newsletter's build-along arcs. Buy once, use forever.

GUIDES + DIAGRAMS

Production Eval Playbook

The annotated guide to building eval systems that don't lie to you. Covers LLM-as-judge calibration, inter-rater agreement, and regression testing for non-deterministic systems.

$37
  • LLM-as-judge calibration guide (PDF)
  • Inter-rater agreement calculator (spreadsheet)
  • 20-page annotated architecture guide
  • All Arc 1 SVG diagrams (editable source)
  • Regression testing checklist
Get this playbook →
CROSS-FUNCTIONAL

AI-Native SDLC Role Pack

Checklists and templates for every role on the team. The PM writes a better spec. The designer handles model uncertainty. The SRE knows what to monitor. Built for teams, not just engineers.

$57
  • 11 role-specific checklists (PM / Designer / QA / SRE / DevOps / EM / TW and more)
  • AI feature spec template with eval-based acceptance criteria
  • Cross-functional meeting template pack
  • Architecture review checklist for AI systems
  • Stakeholder communication framework
Get this role pack →
FOR CREATORS

Newsletter Production Prompt Kit

The exact production system used to write the newsletter. Full prompt, banned-phrase automation, post checklist, SVG visual language guide, and Substack scheduling templates.

$27
  • Full production prompt v2 (verified original)
  • Banned-phrase grep script (runs on any draft)
  • Post checklist automation (Markdown + Notion template)
  • SVG visual language guide and node reference
  • Substack scheduling template calendar
Get this kit →
DESIGN ASSETS

Arc 1–4 SVG Diagram Pack

Every architecture, data flow, state machine, and sequence diagram from all four production arcs. Editable SVG source files with the full color system guide.

$17
  • 32 original SVG diagrams (8 per arc)
  • Editable source files — rename, restyle, reuse
  • Color system guide and visual language reference
  • Export instructions for Substack / Notion / Slides
Get this diagram pack →

Cohort programs

Structured learning built around the newsletter's build-along arcs. Weekly exercises, peer community, recorded Q&As, and a completion certificate. Zero scheduling. 100% async.

4 WEEKS · ASYNC

AI Feature Proof System Cohort

Follow Arc 1 as a structured program. Each week adds one layer to the eval harness — golden dataset, automated scorer, LLM-as-judge, CI gate. Ship a complete system in four weeks.

$197
Week 1
Golden dataset + CLIDataset design exercise + peer review of your first 10 eval cases
Week 2
Automated scorerBuild the eval runner + submit a pass/fail report on your dataset
Week 3
LLM-as-judge calibrationCalibration exercise + inter-rater agreement report
Week 4
CI gate + PM dashboardShip and demo the complete system — certificate issued

  • Weekly exercise packs (PDF + repo starters)
  • Private Discord community for cohort members
  • Q&A session recordings (async — watch anytime)
  • Peer review system with structured rubric
  • Completion certificate + LinkedIn badge
  • Lifetime access to all cohort materials
Enroll in this cohort →
8 WEEKS · TEAM · UP TO 5 SEATS

Cross-Functional AI Team Cohort

Designed for delivery pods and engineering teams, not solo learners. Two arcs, structured for multi-role participation. The PM writes the spec, the engineer builds, the QA evaluates, the SRE deploys. Everyone ships the same system from their own role.

$997 up to 5 seats
  • Arcs 1 + 2, team-focused (multi-role assignments per installment)
  • Role-specific exercise tracks — each person gets a different deliverable for the same build
  • Team Slack channel (private, your pod only)
  • Cross-functional retrospective template per arc
  • Team completion certificate — all 5 members
  • Optional: IT services delivery teams can reference for SOW scoping
Enroll your team →

Bundle deals

Everything paired the way it gets used. One price, one Drive folder, one Discord invite.

Starter Bundle

Arc 1 Cohort (4 weeks) + AI Feature Proof System Toolkit. Everything you need to build and ship your first eval system.

AC-01 Cohort DP-01 Toolkit
$244 separately $197 Get bundle →

Team Bundle

Cross-Functional Team Cohort (8 weeks, 5 seats) + AI-Native SDLC Role Pack (5 copies). Ideal for IT services delivery pods, engineering squads, and tech leads running AI transformation projects.

AC-03 Team Cohort × 5 DP-03 Role Pack × 5
$1,282 separately $997 Get Team Bundle →

Before you buy

No live sessions, no deadlines. Everything is async. You buy access, get a Google Drive folder and Discord invite, and work through the material at your own pace. The weekly structure is a guide, not a schedule. Most people finish an arc in 4–6 weeks.
The 60-day AI Engineering course (aieworks.substack.com/p/course-curriculum) is the direct prerequisite for Arc 1. The 180-day ML curriculum (aieworks.substack.com/s/ai-and-ml-course) gives you the foundational theory. If you've worked with Python, LLMs via API, and basic backend services, you can start Arc 1 without either course.
All downloadable content (PDFs, SVGs, templates, exercise packs, cohort guides) is hosted on Google Drive. After purchase you receive a shared Drive link with lifetime access. Source code for all Build Logs lives on GitHub at GitHub — public repos per arc, pinned to the exact version shipped with each lesson.
Yes. Every product is a standalone purchase. If you later buy a bundle, the price difference is credited. Email the address on the purchase receipt with your original order number and the bundle you want — the delta will be invoiced within 48 hours.
7-day no-questions refund on all digital products. For cohorts: full refund within 7 days of purchase if you have not downloaded the exercise packs. After that, partial refunds are handled case by case.
Yes. For team purchases (3+ seats) and amounts over $500, invoicing is available. Contact via the sponsor page at aieworks.substack.com/p/sponsor with your company name, seat count, and required PO information.
Digital products are updated when the corresponding newsletter arc is updated — typically when a dependency breaks or a significant new pattern emerges. All updates go to the same Drive link. Cohort exercise packs are updated quarterly. You get all updates at no extra cost.