AIThis post was created with the assistance of artificial intelligence (AI).

📊 Full opportunity report: The Model Is Only 10%: The Real Lesson of the New SDLC on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

TL;DR

A recent whitepaper from Google emphasizes that in AI-assisted software development, the model itself is only 10% of the system. The real focus should be on harness design and context engineering, which dominate system behavior and costs.

A new Google whitepaper reveals that in AI-driven software development, the AI model constitutes only about 10% of the system’s behavior. The paper emphasizes that harness design and context engineering are where most of the value and control lie, marking a significant shift in how organizations should approach AI integration.

The whitepaper, authored by Addy Osmani, Shubham Saboo, and Sokratis Kartakis, argues that the dominant factor in AI system performance is not the underlying model but the surrounding infrastructure—referred to as the harness. This includes prompts, rules, tools, and observability layers that shape how the model behaves in practice.

Concrete evidence is provided: in benchmark tests, a coding agent’s performance improved dramatically by only changing the harness, with no change to the model itself. For example, moving a coding agent from outside the Top 30 to Top 5 was achieved solely through harness adjustments. Similarly, tweaking prompts and middleware increased an agent’s score by nearly 14 points.

The paper stresses that failures in AI agents are often due to configuration issues—missing tools, vague rules, or noise in context windows—rather than flaws in the model. This shifts the strategic focus for developers and organizations toward building, owning, and improving the harness.

At a glance
reportWhen: published March 2026
The developmentGoogle’s new whitepaper on SDLC with Vibe Coding highlights that the model accounts for only 10% of AI system behavior, shifting focus to harness and context engineering.
The Model Is Only 10% — The New SDLC With Vibe Coding
AI Dispatch · Field Notes
Google · Osmani, Saboo & Kartakis · May 2026

The model is only 10%

A Google whitepaper argues software’s biggest shift is from writing code to expressing intent. Its sharpest claim: the model you obsess over is the smallest part of the system — the scaffolding around it does the real work.

A spectrum, not a binary — the differentiator is how outputs get verified
Vibe Coding
Casual prompts · “does it seem to work?” · disposable code · high risk
Structured AI-Assisted
Detailed prompts + constraints · manual testing · features in real codebases
Agentic Engineering
Formal specs · automated tests + evals + CI gates · production scale · low risk
Tests verify the deterministic; evals verify the rest. Without both, it’s vibe coding — however clever the prompt.
The idea worth building your strategy around
Agent = Model + Harness
~10%
HARNESS — prompts · tools · context · hooks · sandboxes · observability
MODEL~90% IS YOUR SURFACE AREA, NOT THE PROVIDER’S
Outside Top 30 → Top 5 on Terminal Bench 2.0 by changing only the harness — same model.
“Most agent failures, examined honestly, are configuration failures” — a missing tool, a vague rule, a noisy context.
The economics: it’s a token-cost problem (CapEx vs OpEx)
Vibe Coding
Low CapEx · High OpEx
Looks free, hides debt: token burn (fix-it loops), maintenance tax (AI spaghetti), security remediation. Crosses over to 3–10× more per feature.
Agentic Engineering
High CapEx · Low OpEx
Pay upfront (specs, evals, context), then ship cheaply. Levers: context engineering for first-pass success + intelligent model routing — cheap models for the easy work.
85%
of devs use AI coding agents (51% daily)
41%
of all new code is AI-generated
~90%
of agent behavior is the harness, not the model
+19%
longer on some tasks (METR) — verification is the cost
The read

The clearest map yet of how serious AI development works — and mostly tool-agnostic. But it’s a Google funnel: the concepts are neutral, the on-ramps point to Gemini, Jules & the ADK. If the harness is 90% and it’s yours, your moat and your costs both live there — so own your scaffolding, route across models, and remember: AI amplifies whatever engineering culture it lands in.

Source: Osmani, Saboo & Kartakis, “The New SDLC With Vibe Coding,” Google (May 2026). Figures are the paper’s own, incl. METR & LangChain. Analysis is the author’s.
thorstenmeyerai.com

Implications for AI Development Strategies

This shift means that organizations should prioritize harness and context engineering over chasing the latest model upgrades. The cost and complexity of AI systems are driven more by how they are configured and managed than by the raw model capabilities. This approach can significantly reduce costs, improve reliability, and provide a durable competitive advantage, as the harness is within the organization’s control.

Furthermore, the emphasis on cost efficiency—by designing scalable, modular contexts—redefines the economics of AI development. High upfront investment in schemas, testing, and context management can lead to lower marginal costs over time, contrasting with the low-cost but high-maintenance vibe coding approach.

AI for Software Developers: 40 Practical Prompts To Harness AI Tools For Design, Coding, Debugging and DevOps (AI for Professionals)

AI for Software Developers: 40 Practical Prompts To Harness AI Tools For Design, Coding, Debugging and DevOps (AI for Professionals)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on AI System Design and Evolving Practices

Since early 2026, AI adoption among developers has surged, with 85% of professionals regularly using AI coding agents and 41% generating most of their code through AI. Earlier practices focused heavily on model selection and prompt engineering. However, recent developments, including the Google whitepaper, highlight a paradigm shift: the model is only a small part of the overall system.

This evolution reflects a broader understanding that effective AI deployment requires robust system architecture, including tools, rules, and context management, to ensure correctness, security, and cost control.

“The behavior you experience in AI tools is dominated by scaffolding you can build, own, and improve, which means your durable advantage lives there, not in whichever frontier model happens to be ahead this quarter.”

— Addy Osmani

Unresolved Questions About Implementation and Costs

While the paper presents compelling evidence that harness design dominates system behavior, it remains unclear how organizations will effectively scale this approach across diverse use cases. Specific best practices for harness architecture and context management are still evolving, and the long-term cost savings are yet to be fully quantified in complex, real-world deployments.

Additionally, how quickly organizations can retrain teams and adapt existing workflows to prioritize harness and context engineering remains uncertain.

Next Steps for Organizations Adopting the New SDLC Approach

Organizations should begin evaluating their current AI workflows to identify bottlenecks caused by configuration and context issues. Investing in training on system architecture, harness design, and context engineering will become increasingly important. Additionally, monitoring and refining harness components—tools, rules, and observability—will be critical for maintaining system performance and security.

Further research and industry collaboration are expected to develop standardized best practices and frameworks for harness construction, enabling broader adoption of this paradigm shift.

Key Questions

Why is the model only 10% of the system’s behavior?

The model’s core capabilities are only part of the system; most behavior depends on how the model is integrated, controlled, and guided through the harness, which includes prompts, tools, and rules.

How does this shift impact AI development costs?

Focusing on harness and context engineering can reduce ongoing costs by minimizing token usage, improving reliability, and lowering maintenance expenses, despite higher initial investments.

What should organizations prioritize in AI system design?

Organizations should prioritize building robust harnesses and effective context management, as these areas have the greatest impact on system performance and cost efficiency.

Are current AI models becoming less important?

Models remain crucial for core capabilities, but the whitepaper emphasizes that their influence is limited compared to how they are configured and managed within the system architecture.

What are the biggest challenges in adopting this new approach?

Key challenges include retraining teams, developing best practices for harness design, and integrating these principles into existing workflows and infrastructure.

Source: ThorstenMeyerAI.com

You May Also Like

The Bare C++ Signal Monitor: A New Trend In Tech Operations

A new role-filtered signal monitor tracks platform changes like ‘software rendering in 500 lines of bare C++,’ aiding small software teams in rapid decision-making.

Could An AI Message From A Fake CEO Do Harm? Here’s The Truth

A public experiment tested AI models’ responses to impersonation attacks. All refused manipulation attempts, but some failed to complete their tasks, raising security concerns.

2026’S Top AI Student Planners For Better Time Management And Results

Discover the leading AI-powered student planners of 2026, designed to improve time management and academic results for students at all levels.

Different Game, or Already Lost? Reading Mistral’s Sovereignty Bet

Explore if Mistral’s focus on sovereignty and open weights signals a strategic edge or a concession in the AI race. Discover the real game behind Europe’s rising star.