agent-postmortems a structured database of real AI-agent failures

← all incidents

incident moderate confidence: confirmed status: factual

Klarna reversed its AI-only customer-service strategy and resumed hiring humans

2025-klarna-ai-cs-reversal · 2025-05-08

After replacing roughly 700 customer-service roles with an AI assistant, Klarna found the system overwhelmed by edge cases and sensitive interactions and sometimes gave confident but incorrect answers about fees and payment terms. The CEO publicly reversed course toward a human/AI hybrid model.

System

Framework
Klarna AI customer-service assistant (OpenAI-based)
Tools
customer-support
Vendor
Klarna
Autonomy
supervised-autonomous

Classification

Primary class
task-failure
Chain
task-failure/quality-degradation
Attack vector
n-a
Causation
entity: both · intentionality: unintentional · timing: post-deployment

Trigger

After replacing roughly 700 customer-service roles with an AI assistant, Klarna found that edge cases, emotionally charged interactions, and multi-step problem resolution overwhelmed the system, and it sometimes gave confident but incorrect answers about fees and payment terms.

Root cause

Over-optimising for efficiency and cost led to deploying AI beyond its reliable envelope, degrading quality on complex or sensitive cases without adequate human fallback.

Contributing factors

  • Coverage was extended to cases outside the model's reliable envelope.
  • Human fallback for complex/sensitive interactions was insufficient.
  • Incorrect money-related answers carried fintech compliance risk.

Detection

Recognised internally via declining customer-satisfaction metrics and publicly acknowledged by Klarna's CEO.

Recovery

Klarna reversed course, resumed hiring human agents, and moved to a hybrid model where AI handles routine inquiries and humans handle cases needing empathy, discretion, or escalation.

Prevention

Scope AI to tasks within its reliable envelope; keep human fallback for complex/sensitive cases; monitor quality and compliance metrics; avoid cost-only automation decisions.

Blast radius

User harm
Lower customer-satisfaction scores and incorrect answers about money (a compliance concern in fintech) for affected customers, with broader business impact on service quality. economic
Scope
organization-wide customer service
Reversibility
reversible

References

Tags
customer-service automation-reversal quality

Sources

Cite this incident

@misc{2025-klarna-ai-cs-reversal,
  title = {Klarna reversed its AI-only customer-service strategy and resumed hiring humans},
  year = {2025},
  howpublished = {agent-postmortems},
  url = {https://swarmproof.github.io/agent-postmortems/2025-klarna-ai-cs-reversal/}
}