Nova model family + multi-provider Bedrock marketplace; broadest model access (100+ models); Guardrails API; Knowledge Bases for RAG; deepest AWS service integration; model access governance
Benchmarks
0 full, 4 partial of 4
Knowledge (MMLU/GPQA)
Performance on knowledge benchmarks — MMLU, GPQA, ARC. Measures breadth and depth of world knowledge and factual accuracy.
Breadth of model lineup from flagship to budget. Ability to match price-performance to different use cases.
Full
Fine-tuning & Customization
Fine-tune models on custom data. LoRA, full fine-tuning, distillation, and custom model training options.
Full
Prompt Caching / Discounts
Cost reduction through cached prompts, batch API discounts, and volume pricing. Repeat query optimization.
Partial
Cost Efficiency ($/MTok)
API pricing competitiveness. Full = budget tiers available (<$1/MTok input). Partial = mid-tier ($1-5). None = premium-only ($5+). Considers cheapest capable model in lineup.
Full
Enterprise
4 full, 1 partial of 5
Enterprise Controls
SSO/SAML, admin dashboard, usage policies, content filtering controls, team management, and deployment options.
Full
Data Privacy & Retention
Data retention policies, zero-retention options, GDPR compliance, data processing agreements, and regional hosting.
Full
Compliance & Certifications
SOC2, ISO 27001, HIPAA BAA, FedRAMP, ISO 42001, and regulatory compliance certifications.
Full
Safety & Alignment
Constitutional AI, RLHF, responsible scaling policies, content safety, red teaming investment, and AI safety research.