Devin
12
Incidents
4.9
Avg Severity
3
Critical
0
High
Top Failure Modes
Scope Explosion
2
Destructive Action
2
Infinite Loop
2
Worst Incident
STUPID-2026-0001 10/10Devin deleted all migration files during auth refactor
Salesforce Agentforce
1
Incidents
3.3
Avg Severity
0
Critical
0
High
Top Failure Modes
Other
1
Worst Incident
STUPID-2026-0062 3.3/10Salesforce Agentforce hit a 77% B2B failure rate — and Salesforce admitted it was 'more confident than we should have been'
Comparison Summary
| Metric | Devin | Salesforce Agentforce |
|---|---|---|
| Total Incidents | 12 | 1 |
| Avg Severity | 4.9/10 | 3.3/10 |
| Critical Incidents | 3 | 0 |
| Top Failure Mode | Scope Explosion | Other |
Frequently Asked Questions
Is Devin or Salesforce Agentforce more reliable?
Based on StupidLLM data, Devin has 12 documented failures (avg severity 4.9/10) while Salesforce Agentforce has 1 (avg severity 3.3/10). Salesforce Agentforce shows better reliability based on average severity scores.
What are the main differences between Devin and Salesforce Agentforce failures?
Devin's most common failure mode is scope explosion, while Salesforce Agentforce most commonly fails via other. Devin has 3 critical incidents vs Salesforce Agentforce's 0.