Fullscript Logo

Archive search

Find a field note.

73 field notes, newest first

Field note

Is Your IT Team Ready to Build with AI?

How Fullscript's IT team builds internal apps to replace SaaS tools, and the foundation that makes them safe to run.

Open field note →
Field note

From 105 JSON Files to a CMS: Making Merchandising Content Self-Serve at Fullscript

See how we migrated 105 merchandising JSON files to a Payload CMS with zero downtime, no app rewrite, and AI agents doing the heavy lifting.

Open field note →
Engineering

Categorizing Merge Requests with an LLM

See how Fullscript uses an LLM, a priority-ordered decision tree, and a daily CronJob to categorize every merge request.

Open field note →
Technology

Finding The Line: What to Ask AI, What to Ask Code

See how we paired an LLM with deterministic code to auto-crop Supplement Facts labels, and how we decide what to ask AI versus code.

Open field note →
Engineering

Teaching Ruby to Rank: Building a Learning to Rank Ruby Gem

See how Fullscript fixed search with learning to rank in Ruby: NDCG, judgment lists from clicks, XGBoost reranking, and our upcoming ltr gem.

Open field note →
Engineering

MCP-inception: Why we built EKG, the MCP of MCPs

See how Fullscript built EKG, a single MCP gateway that connects any AI client to our services, with guardrails in one place.

Open field note →
Security

L1 on Autopilot: The Analyst Who Never Sleeps

See how Fullscript's SOC built automated L1 triage with 13 AI agents that assess every security alert in under five minutes.

Open field note →
Technology

A Sale Is Just a Row: How Fullscript Ships Promotions Without Deploys

See how Fullscript turned promotions into database records with date windows, cutting sales from multi-deploy projects to one reviewable data change.

Open field note →
Engineering

Building Fullscript Assist, Part 3: One Writer Per Session

How we guarantee one writer per conversation as Fullscript Assist scales across nodes: a durable lease for ownership, an epoch fence for writes.

Open field note →
Security

AI Security: Humans Before The Loop

How Fullscript's Project Glycerin triages and fixes security vulnerabilities in minutes, with engineers owning the standards the AI applies.

Open field note →
Field note

Benchmarking the Agents That Write Our Code

See how we built a benchmark from our own git history to compare AI coding models, skill packs, and agent harnesses on our real codebase.

Open field note →
Technology

Smart Rollouts: Adding Control Groups and Exposure Tracking to Flipper

See how Fullscript added 50/50 experiments to Flipper feature flags using a second salted hash and exposure tracking that waits for first use.

Open field note →
Engineering

Building Fullscript Assist, Part 2: Keeping the Context Small

See how we treat the context window as a budget in Fullscript Assist: on-demand skills, isolated sub-agents, and auditable compaction.

Open field note →
Software

Scaling Shopify's maintenance_tasks (Part 3): Observability and Governance for the Gem

See how Fullscript added durable logs, threaded Slack alerts, metrics, and self-cleaning governance around Shopify's maintenance_tasks gem.

Open field note →
Field note

Building Hospital-Grade Networks for Our Warehouse Operations

How Fullscript IT built hospital-grade network redundancy for automated warehouses — see how we design for the failure case first.

Open field note →
Engineering

Building Fullscript Assist

How Fullscript rebuilt its clinical AI assistant with Elixir, BEAM processes, and MCP to support 120K+ providers with stateful conversations.

Open field note →
Field note

Scaling Shopify's maintenance_tasks (Part 2): Real-Time Progress for the Gem

Part 2: See how Fullscript layered live progress, shared lifecycle hooks, and queue isolation onto a gem they don't own — no fork required.

Open field note →
Field note

Scaling Shopify's maintenance_tasks (Part 1): A Custom UI for the Gem

How Fullscript rebuilt the maintenance_tasks UI as a React app over a JSON API — typed params, masked secrets, live status.

Open field note →
Engineering

Using an LLM as a Test Compiler

End-to-end tests are usually expensive to maintain or too flaky to trust. We treated an LLM as a compiler to get tests that are neither.

Open field note →
Technology

Why green tests stopped meaning shipped

Why green tests aren't enough for AI systems. Learn how evals catch behavioral regressions that unit tests miss.

Open field note →