Devin
12
Incidents
4.9
Avg Severity
3
Critical
0
High
Top Failure Modes
Scope Explosion
2
Destructive Action
2
Infinite Loop
2
Worst Incident
STUPID-2026-0001 10/10Devin deleted all migration files during auth refactor
Gemini Cli
3
Incidents
10.0
Avg Severity
3
Critical
0
High
Top Failure Modes
Security Vulnerability
1
Scope Explosion
1
Destructive Action
1
Worst Incident
STUPID-2026-0027 10/10Gemini CLI silently executed arbitrary code from an untrusted repo (CVE-2026-12537, CVSS 10.0)
Comparison Summary
| Metric | Devin | Gemini Cli |
|---|---|---|
| Total Incidents | 12 | 3 |
| Avg Severity | 4.9/10 | 10.0/10 |
| Critical Incidents | 3 | 3 |
| Top Failure Mode | Scope Explosion | Security Vulnerability |
Frequently Asked Questions
Is Devin or Gemini Cli more reliable?
Based on StupidLLM data, Devin has 12 documented failures (avg severity 4.9/10) while Gemini Cli has 3 (avg severity 10.0/10). Devin shows better reliability based on average severity scores.
What are the main differences between Devin and Gemini Cli failures?
Devin's most common failure mode is scope explosion, while Gemini Cli most commonly fails via security vulnerability. Devin has 3 critical incidents vs Gemini Cli's 3.