Mercor vs Tortoise vs Outlier: AI evaluation platforms compared

The AI evaluation market has expanded beyond Mercor and Scale in 2026. Three platforms account for most expert paid evaluation work: Mercor, Tortoise, and Outlier (Scale AI brand). ## Mercor High vetting bar. Rates 30 to 100 USD/h for software and technical tracks. Long-form tasks with depth. Best for experienced specialists who value rate over volume. ## Tortoise Newer entrant focused on premium tracks (formal reasoning, advanced math, scientific evaluation). Smaller pool of work but high acceptance rate for genuinely scarce profiles. Rates 50 to 150 USD/h for premium tracks. ## Outlier (Scale AI) Larger volume, lower acceptance bar. Rates typically 18 to 45 USD/h. Steady weekly volume. Best for evaluators wanting predictable hours over rate. ## Side by side | Factor | Mercor | Tortoise | Outlier | |---|---|---|---| | Typical rate (dev) | 35-80 USD/h | 50-150 USD/h | 18-45 USD/h | | Acceptance bar | High | Very high (niche-dependent) | Low-medium | | Volume reliability | Bursty | Bursty | Steady | | Task complexity | Long-form | Premium-niche | Mixed | | Best for | Specialists | Scarce-domain experts | Volume seekers | ## Stacking Many evaluators run two or three platforms in parallel. Mercor and Tortoise for rate, Outlier for filling gaps. Exclusivity is rare; check before signing. ## What is changing in 2026 Premium domains (formal verification, advanced math, specific legal) command higher rates everywhere as AI labs push reasoning capabilities. Generic code-review tracks have softened. The gap between top and entry rate is widening.