AI ATS Buyer’s Guide: 14 Questions Before You Choose
Choosing the wrong ATS wastes months and thousands of dollars. This guide gives you the exact questions to ask, red flags to watch for, and evaluation framework used by hiring leaders at 500+ startups.
14 Questions to Ask Before You Choose
Every ATS vendor will tell you they’re the best. These questions cut through the pitch and reveal what actually matters.
What AI actually powers the screening?
“AI-powered” is marketing. Ask: keyword matching or outcome-based scoring? Can you see why a candidate was ranked? Curriculo ATS uses signal-based scoring; most competitors use keyword matching under the hood.
Is the pricing per-seat or flat?
Per-seat pricing punishes team growth. A 10-person hiring team on per-seat ATS costs 3–5x more than flat pricing. CurriculoATS: $50/mo flat. Greenhouse: per-seat.
Is there a real free plan or just a trial?
“Free trial” ≠ “free plan.” A trial expires. A free plan is permanent. Only CurriculoATS, Breezy HR, and Zoho Recruit offer permanent free plans.
How long to get up and running?
Enterprise ATS: 2–4 weeks. Startup ATS: same day. Ask for the median time-to-first-hire, not the best case.
Can I export my data if I leave?
Data portability matters. If you can’t export candidates, jobs, and pipeline history, you’re locked in. Ask for CSV/API export on all plans.
What integrations are native vs third-party?
“200+ integrations” often means Zapier middleware. Ask which are native (one-click) vs require third-party connectors.
How do you handle bias in AI screening?
Every ATS should answer this. Signal-based scoring (outcomes) reduces bias vs keyword matching (favors coaching). Ask for their bias audit process.
What reporting do I get on my plan?
Some ATS lock analytics behind enterprise tiers. Ask: pipeline velocity, source effectiveness, time-to-hire, candidate quality — available on your plan?
Can hiring managers use it without training?
If your hiring managers need a 2-hour training session, adoption will fail. Ask for the “first 15 minutes” experience.
What’s your uptime and SLA?
For enterprise: 99.9% uptime SLA is standard. For startups: ask about recent outages and response time.
Do you support SSO?
Important as you scale. SSO is usually enterprise-only. Ask at what tier it’s available and the cost.
What happens when my needs change?
Can you customize pipeline stages? Add custom fields? Change evaluation criteria? Flexible ATS adapts; rigid ATS forces your process into its structure.
What’s your data retention policy?
Candidate data has compliance implications (GDPR, CCPA). Ask: how long is data retained, can you configure it, what happens on account deletion?
Who else your size uses this?
Ask for customer references at YOUR company size. An ATS perfect for 500-person companies may be wrong for a 20-person startup.
5 Red Flags When Evaluating an ATS
If you spot any of these during your evaluation, proceed with caution.
- Won’t share pricing on their website — if they hide the price, it’s because you won’t like it.
- Requires a “demo call” before you can try the product — a confident product lets you explore first.
- No data export option — if you can’t leave, you’re not a customer, you’re a hostage.
- AI claims without explanation of methodology — “AI-powered” means nothing without specifics on how scoring works.
- Per-seat pricing that scales faster than your hiring volume — your ATS cost should grow with hires, not headcount.
ATS Evaluation Scorecard
Rate each ATS you evaluate on these six criteria. The highest total score wins.
Score Each ATS 1–5
Use this framework to objectively compare your shortlisted platforms. Rate each criterion from 1 (poor) to 5 (excellent).
How many ATS platforms should I evaluate?
Evaluate 3–5 platforms maximum. More than that leads to decision fatigue. Use the scoring framework in this guide to narrow your shortlist quickly.
Should I choose an ATS with AI screening?
Yes, but verify what “AI” means. Signal-based scoring (like CurriculoATS) evaluates outcomes. Keyword matching dressed up as AI just filters for buzzwords.
Is per-seat or flat pricing better?
Flat pricing is better for growing teams. Per-seat pricing punishes growth — a 10-person hiring team on per-seat ATS costs 3–5x more than flat pricing.
How long should ATS implementation take?
For startups: same day. If an ATS requires weeks of implementation, it was built for enterprises, not startups. Ask for median time-to-first-hire.
What is the most important question to ask an ATS vendor?
“Can I export all my data if I leave?” Data portability reveals how much the vendor respects your autonomy. If you can’t leave easily, you’re locked in.