Fullscript Logo

Archive search

Find a field note.

71 field notes, newest first

Engineering

Categorizing Merge Requests with an LLM

See how Fullscript uses an LLM, a priority-ordered decision tree, and a daily CronJob to categorize every merge request.

Open field note →
Technology

Finding The Line: What to Ask AI, What to Ask Code

See how we paired an LLM with deterministic code to auto-crop Supplement Facts labels, and how we decide what to ask AI versus code.

Open field note →
Engineering

Teaching Ruby to Rank: Building a Learning to Rank Ruby Gem

See how Fullscript fixed search with learning to rank in Ruby: NDCG, judgment lists from clicks, XGBoost reranking, and our upcoming ltr gem.

Open field note →
Engineering

MCP-inception: Why we built EKG, the MCP of MCPs

See how Fullscript built EKG, a single MCP gateway that connects any AI client to our services, with guardrails in one place.

Open field note →
Security

L1 on Autopilot: The Analyst Who Never Sleeps

See how Fullscript's SOC built automated L1 triage with 13 AI agents that assess every security alert in under five minutes.

Open field note →
Technology

A Sale Is Just a Row: How Fullscript Ships Promotions Without Deploys

See how Fullscript turned promotions into database records with date windows, cutting sales from multi-deploy projects to one reviewable data change.

Open field note →
Engineering

Building Fullscript Assist, Part 3: One Writer Per Session

How we guarantee one writer per conversation as Fullscript Assist scales across nodes: a durable lease for ownership, an epoch fence for writes.

Open field note →
Security

AI Security: Humans Before The Loop

How Fullscript's Project Glycerin triages and fixes security vulnerabilities in minutes, with engineers owning the standards the AI applies.

Open field note →
Field note

Benchmarking the Agents That Write Our Code

See how we built a benchmark from our own git history to compare AI coding models, skill packs, and agent harnesses on our real codebase.

Open field note →
Technology

Smart Rollouts: Adding Control Groups and Exposure Tracking to Flipper

See how Fullscript added 50/50 experiments to Flipper feature flags using a second salted hash and exposure tracking that waits for first use.

Open field note →
Engineering

Building Fullscript Assist, Part 2: Keeping the Context Small

See how we treat the context window as a budget in Fullscript Assist: on-demand skills, isolated sub-agents, and auditable compaction.

Open field note →
Software

Scaling Shopify's maintenance_tasks (Part 3): Observability and Governance for the Gem

See how Fullscript added durable logs, threaded Slack alerts, metrics, and self-cleaning governance around Shopify's maintenance_tasks gem.

Open field note →
Field note

Building Hospital-Grade Networks for Our Warehouse Operations

How Fullscript IT built hospital-grade network redundancy for automated warehouses — see how we design for the failure case first.

Open field note →
Engineering

Building Fullscript Assist

How Fullscript rebuilt its clinical AI assistant with Elixir, BEAM processes, and MCP to support 120K+ providers with stateful conversations.

Open field note →
Field note

Scaling Shopify's maintenance_tasks (Part 2): Real-Time Progress for the Gem

Part 2: See how Fullscript layered live progress, shared lifecycle hooks, and queue isolation onto a gem they don't own — no fork required.

Open field note →
Field note

Scaling Shopify's maintenance_tasks (Part 1): A Custom UI for the Gem

How Fullscript rebuilt the maintenance_tasks UI as a React app over a JSON API — typed params, masked secrets, live status.

Open field note →
Engineering

Using an LLM as a Test Compiler

End-to-end tests are usually expensive to maintain or too flaky to trust. We treated an LLM as a compiler to get tests that are neither.

Open field note →
Technology

Why green tests stopped meaning shipped

Why green tests aren't enough for AI systems. Learn how evals catch behavioral regressions that unit tests miss.

Open field note →
Technology

So You Want to Refactor Code with an Agentic Developer

Learn how agentic developers automate large-scale code refactors, reducing migration costs, engineering overhead, and delivery risk.

Open field note →
Engineering

Feature-Flagging a Major Design System Upgrade

Shipping a major mobile redesign without stopping releases: adapters, build flags, and parallel design systems.

Open field note →