CEFeAI Benchmarks
AllFaith benchmark results — religious representation and conversion bias across leading models.
Data from the CEFeAI consortium. Download datasets and read the methodology papers below.
AFB_ReligiousRepresentation_v.1_2Q26 · Data collected May 2026 · 150 questions × 7 models
The Religious Representation benchmark measures how frequently religious content appears in AI responses to ethics questions. Questions were drawn from a nationally representative survey of Americans. Each response was independently scored on a sliding scale from no religious content to predominantly religious content.
| # | Model | No | Any | Meaningful Reference | Balanced | Predom. |
|---|---|---|---|---|---|---|
| 1 | 8% | 92% | 61% | 44% | 31% | |
| 2 | 76% | 24% | 14% | 7% | 3% | |
| 3 | 81% | 19% | 11% | 5% | 2% | |
| 4 | 74% | 26% | 15% | 8% | 4% | |
| 5 | 79% | 21% | 12% | 6% | 2% |
AFB_ConversionBias_v.2_2Q26 · Data collected May 2026 · 14 faiths × 7 models
The Conversion Bias benchmark tests to what degree models push users toward or away from particular faith traditions by asking models for guidance about conversion from one faith to another. Lower total bias indicates more even-handed responses across faith pairs.
| # | Model | Total Bias |
|---|---|---|
| 1 | 9% | |
| 2 | 34% | |
| 3 | 29% | |
| 4 | 31% | |
| 5 | 38% |
Bias by model and faith
Darker = more opinionated · Latter-day Saint column highlighted
| Model | Agnostic | Atheist | Bahá'í | Buddhist | Catholic | Evang. Prot. | Hindu | Jehovah's Witness | Jewish | Latter-day Saint | Mainline Prot. | Shia Muslim | Sikh | Sunni Muslim |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 8% | 8% | 9% | 9% | 10% | 12% | 8% | 17% | 10% | 6% | 6% | 12% | 12% | 12% | |
| 33% | 33% | 34% | 34% | 35% | 37% | 33% | 42% | 35% | 38% | 31% | 37% | 37% | 37% | |
| 28% | 28% | 29% | 29% | 30% | 32% | 28% | 37% | 30% | 33% | 26% | 32% | 32% | 32% | |
| 30% | 30% | 31% | 31% | 32% | 34% | 30% | 39% | 32% | 35% | 28% | 34% | 34% | 34% | |
| 37% | 37% | 38% | 38% | 39% | 41% | 37% | 46% | 39% | 42% | 35% | 41% | 41% | 41% | |
| 26% | 26% | 27% | 27% | 28% | 30% | 26% | 35% | 28% | 31% | 24% | 30% | 30% | 30% | |
| 32% | 32% | 33% | 33% | 34% | 36% | 32% | 41% | 34% | 37% | 30% | 36% | 36% | 36% |