Your matchExample
93%matchWhy you fitThis role calls for Content Policy and Quality Assurance — tell us what you know and we'll check the rest.
Gap to noteAlso lists Answer Keys — worth confirming before you apply.
Get roles like this, scored and matched, in your inbox.
Sign up free →Job Opening
Quality Analyst
Roblox · Gurugram, Haryana · Posted today
ic
3+ yrs expContent ModerationTrust & SafetyQuality AssuranceContent PolicyRoot-Cause AnalysisStatistical SamplingInter-Rater AgreementConfidence Intervals
Own the answer key and final calls on disputed cases, shaping quality for moderator training, vendor QA, and automated systems in gaming.
- Build and maintain the answer key. Use your policy and enforcement expertise to create correctly labeled image cases for moderator training, QA, and policy work. Add new cases as policies and content trends change.
- Make final calls on disputed decisions. Blind-audit sampled cases and resolve disagreements between moderators, vendor QA, and automated systems.
- Calibrate vendor QA teams. Measure vendor auditors’ accuracy against the answer key and lead calibration sessions to close gaps.
- Find root causes and trends. Tag every error using a standard error taxonomy, and analyze quality data to find patterns, bottlenecks, and ways to improve. Flag new risks early and run deep dives on the biggest problems.
- Recommend fixes. Write short briefs for weekly stakeholder reviews. Each brief should size the problem, describe its impact, and name the team best placed to fix it.
- Report on quality. Pull statistically valid samples and publish weekly quality reports with accuracy metrics and confidence intervals.
- Use outside quality signals. Include data from user appeals, escalations, partner feedback, and customer support to get a fuller picture of quality.
- Confirm that fixes worked. Audit affected queues again after each change to check that quality improved.
- 3+ years in quality assurance, content moderation, Trust & Safety, or a related operations role
- A strong understanding of content policy, plus sound judgment on close calls
- Experience building answer keys, test sets, or calibration materials
- Experience auditing and calibrating reviewers, including outsourced or vendor teams
- Working knowledge of sampling and basic statistics, including accuracy rates, inter-rater agreement, and confidence intervals
- Experience doing root-cause analysis and turning findings into practical recommendations
- Skill with spreadsheets for pulling and analyzing data
- Clear written and verbal communication, including writing short summaries for leadership
- Experience working with cross-functional partners such as Policy, Operations, Engineering, and vendors
Apply on Roblox's site →
This posting is sourced from Roblox's own career site — applying takes you there directly.
Get roles like this, scored and matched, in your inbox.
Sign up free →Related roles
This role centers on Content Policy, Quality Assurance, Answer Keys, and Calibration. There are 286 open roles at Roblox right now.
Want roles like this found for you?
Set your Focus once. Career Engine screens every new opening every week.
A scored, explained shortlist — not a keyword match — delivered weekly. Free for one profile.