T1 · Beginner · 7 minMoving · Last reviewed: 2026-08-19Early draft

What AI Is Genuinely Good and Bad At — a Capability Map

In one line · AI excels at language, patterns, and summarizing; it's weak at exact math, guaranteed facts, and long reasoning.

Glossary:HallucinationLLM
Best to read first:What Is an LLM?
Why it matters

Knowing the limits before you build lets you pick the right tasks for AI and avoid handing it work it does poorly.

Think of it as a brilliant language employee who's shaky with numbers. Give it writing and understanding; leave sensitive math to ordinary code.

Summarizing a 10-page report = great. Summing 200 numbers exactly = use code, not a model.

How it works

Apply the map with three questions about any task: (1) Is it fundamentally a language task (understanding, summarizing, classifying, generating)? If yes, the model is in its zone. (2) Is an occasional error acceptable and easy to review? If a single error is catastrophic, you need a human or code alongside. (3) Does it demand 100% precision (math, dates, rule-matching)? If yes, that's ordinary code's job — or have the model call a tool for that part. The map shifts with every model generation, so re-check it rather than memorizing it.

Practice

🧪 Try it: list 5 real tasks from your own work (e.g., replying to an email, computing a discount, summarizing a meeting, reviewing a contract, triaging complaints). Classify each: model, ordinary code, or both together? Then actually try one 'model' task and see if your classification held.

Common mistakes

Common mistakes: (1) assuming 'speaks well' means 'computes well' — confident style is no proof of accuracy; (2) rejecting AI entirely after one visible failure — the fix is usually changing the task, not scrapping the tool; (3) judging capabilities from a two-year-old article — the map moves fast.

When to use it

Use the map at the start of any AI feature: deciding what to hand the model, what stays ordinary code, and where a human belongs in between.

When NOT to use it

Don't treat the map as eternal law: capabilities improve every release, and yesterday's weaknesses become acceptable. Test and measure on today's models instead of relying on stale impressions.

LET'S BUILD ITDone reading — now build it yourself.Pick a task that fits the model