Skip to content
Back to Blog

Why My AI Prompts Are 12 Words Long — And Yours Should Collapse Too

Bashar AyyashJuly 9, 20267 min read1,258 words
Why My AI Prompts Are 12 Words Long — And Yours Should Collapse Too
TL;DR

Shortening AI prompts to 12 words slashes latency, cost, and hallucinations.

7 min read · 1,258 words

The Wall of Words

I used to write prompts like I used to write Laravel controllers in 2014 — verbose, defensive, convinced that more lines meant more control.

Hundreds of tokens setting context. Chain-of-thought examples. Five-shot demonstrations. Personality frameworks. Temperature lectures. I was building prompt cathedrals when I needed sledgehammers.

Then I watched our AI agent handling KYC verification at Alrajhi Bank choke on its own instructions. 400-token prompt. 8-second latency. Context window bleeding. The agent was spending more energy parsing my prose than reasoning about the customer.

That's when I started cutting. Ruthlessly.

Gravity as a Feature

Here's what 20 years of system architecture taught me: constraint creates clarity. Not the other way around.

In Laravel, we learned this with Eloquent. In Next.js, we learned it with server components. In banking infrastructure, we learned it when every millisecond of latency costs real money and regulatory scrutiny.

My current prompt for our fraud-detection agent:

"Flag transaction. Explain in Arabic. Confidence 0-1. No speculation."

Twelve words. The agent doesn't wander. The agent doesn't hallucinate policy interpretations. The agent does one thing with defined boundaries.

The MENA Reality Check

Let me be direct about where I'm sitting. Jordan. Three hours from Riyadh. Building for a market where "enterprise AI" still means most vendors are selling snake oil wrapped in English-language documentation.

Our users don't need AI that sounds like a McKinsey deck. They need decisions. Fast. In Arabic. With audit trails.

The friction of verbose prompts isn't just latency. It's translation debt. English-heavy prompting creates a middle layer of cultural misalignment. Our agents were answering questions nobody asked because the prompts assumed Western banking contexts.

Twelve Arabic words — or twelve English words that map cleanly — cuts through that. No abstraction tsunami. No context collapse.

What I Actually Built

Our stack at Alrajhi: Laravel for core banking APIs, Next.js for internal dashboards, React Native for customer-facing apps. The AI layer sits between, orchestrating agents for credit scoring, document verification, compliance checks.

I rebuilt our three heaviest agents last quarter with the 12-word constraint.

Before: 340-token average prompt, 4.2s response time, 12% hallucination rate on edge cases.

After: 89-token average prompt, 1.8s response time, 3% hallucination rate.

The hallucinations didn't drop because the model got smarter. They dropped because I stopped confusing it.

The Mechanics of Collapse

How do you actually do this? Not by being clever. By being mechanical.

1. One Domain Verb

"Flag." "Extract." "Compare." "Route." Not "analyze and determine whether there might be indicators suggesting." That's not precision. That's throat-clearing.

2. One Output Format

"JSON with keys: decision, confidence, reasoning." Not "please provide your response in a structured format that includes." The model knows JSON. Name the schema and move on.

3. One Constraint Boundary

"No speculation" is doing heavy lifting. It creates a wall. The agent hits it and stops. Without that wall, it keeps generating — confident-sounding nonsense about patterns it half-perceives.

4. One Localization Anchor

"Explain in Arabic." Not optional. Not "if relevant." Our regulators read Arabic. Our customers read Arabic. The default English bias of most LLMs is a compliance risk I'm not taking.

The Infrastructure Angle

From an infra + UX lens, this matters more than it looks.

Short prompts mean smaller context windows. Smaller context windows mean:

  • Cheaper inference — we're seeing 40% cost reduction on our OpenAI bill
  • Faster caching — similar prompts hit Redis more often
  • Cleaner observability — I can actually read the prompts in our logs without scrolling
  • Easier A/B testing — swapping 12 words is surgical; swapping 400 is archaeology

In Next.js terms: it's the difference between server components that ship minimal JS and a bloated bundle that ships everything just in case. The browser — or the LLM — pays for your indecision.

What I Cut (And Don't Miss)

Gone: "You are a helpful assistant." The model already knows this. It's either true and redundant, or false and ignored.

Gone: "Think step by step." Chain-of-thought doesn't need an invitation. The model reasons or it doesn't. The instruction adds tokens, not capability.

Gone: Examples in the prompt. We moved to fine-tuned adapters. One-time cost, permanent behavior. Prompt examples are runtime tax.

Gone: Temperature settings in prose. "Be creative but accurate" is meaningless. We set temperature=0 in the API call and describe the task. The model doesn't need to be told its own hyperparameters.

The React Native Parallel

Our mobile team felt this immediately. They were building a chat interface for our AI agents and drowning in loading states.

Four-second prompts meant four-second spinners. In Jordan's mobile networks — where 3G still exists and patience is a currency — that's abandonment.

Collapsing to 12-word prompts cut perceived latency more than any optimization we tried. The physics are simple: less data over the wire, faster token generation, earlier streaming starts.

They didn't change the UI. I changed the gravity underneath it.

When Long Still Lives

I'm not a fundamentalist. Some problems need walls of text.

Legal contract analysis. Multi-party negotiation. Creative writing where voice matters. Our credit policy agent still carries 200 tokens of regulatory framework because the complexity is real.

But I audit it monthly. I cut 10% every time. The framework creeps. Gravity wins by default.

The difference: intentional complexity versus accumulated cruft. Most long prompts I see are the latter. Written once, never reviewed, cargo-culted across systems.

The Enterprise Trap

Here's what frustrates me about banking AI discourse. Vendors selling "enterprise solutions" with prompt templates that read like terms of service. Layer upon layer of "safety" that just creates ambiguity.

Our procurement team loves these. Boxes checked. Compliance theater complete.

My engineering team hates them. We can't see what the agent actually does. We can't debug failures. We can't optimize.

Twelve-word prompts are un-auditable in the best way. They're so simple that review is instant. No hidden logic. No emergent behavior from prompt interactions.

In emerging markets, this matters double. We don't have the headcount to maintain prompt engineering teams. We need systems that stay comprehensible when the person who built them is on vacation or has left.

The Fine-Tuning Pivot

The real unlock came when we stopped trying to prompt our way to behavior and started training for it.

Laravel's ecosystem taught me this. You don't write 500 lines of validation logic. You write a FormRequest. You declare rules. The framework handles the rest.

We fine-tuned a small model on our 12-word patterns. Now the "prompt" is often just the verb and the data. The behavior lives in weights, not tokens.

Cost: $2,400 for the fine-tuning run. Benefit: 60% inference cost reduction, sub-second responses, behavior that's testable rather than promptable.

This is the direction. Prompts as interface, not implementation. The shorter the interface, the cleaner the contract.

What I'm Watching

Claude's 3.5 Sonnet. Google's Flash. OpenAI's 4o-mini. The race to fast, cheap, capable is compressing the prompt window whether we like it or not.

Models are getting better at implied instruction. They're learning that "flag transaction" in a banking context carries assumptions about what matters. The prompt can shrink because the context is richer.

This is the tsunami coming. Developers still writing 500-token prompts are building on sand. The models don't need your scaffolding anymore. They need your intent, cleanly stated.

The Question

I cut my prompts to 12 words because I was forced to — by latency, by cost, by Arabic localization, by regulatory scrutiny in a market that doesn't forgive slowness.

What's forcing you?

Or are you still building cathedrals nobody asked for, waiting for the gravity you refuse to see?


Building AI agents for banking in Amman. Laravel, Next.js, React Native. Twenty years of watching complexity collapse. Always looking for the 12-word version.

Bashar Ayyash
AUTHOR

Bashar Ayyash (Yabasha)

AI Systems Architect for regulated industries — evals, harness design, AI security.

Bashar Ayyash is an AI engineer and dev lead in Amman, Jordan. 20 years shipping software, 4 years inside a regulated bank building production RAG and agent systems with evals, guardrails and monitoring — in Arabic and English. He writes at yabasha.dev and builds open-source tooling for AI-assisted development.

Newsletter

Practical AI + full-stack insights for MENA builders. No spam.

Read more on the blog

Browse the latest articles or explore the full archive.