AI Safety Practitioner - Expert Evaluator
Mercor
We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.
Responsibilities
Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
Provide structured feedback to improve model alignment and safety performance.
Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Required Qualifications
Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
Excellent written English, critical thinking, and analytical reasoning skills.
Ability to consistently evaluate nuanced and policy-sensitive scenarios.
Preferred Qualifications
Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
Familiarity with safety policies, content moderation, or evaluation rubric development.
Experience reviewing complex, high-risk, or ambiguous content.
Why Join?
Shape the safety and behaviour of frontier AI models used by millions worldwide.
Work on challenging, real-world safety evaluations across nuanced and high-impact domains.
Collaborate with leading AI researchers, engineers, and safety teams.
- ppWe are seeking experienced bAI Safety Practitioners /b to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve...Consigliato
- ...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated responses for safety, factual...ConsigliatoLavoro da remoto
- ppWe are seeking experienced bAI Safety Practitioners /b to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve...Consigliato
- pMercor is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex, policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured...Consigliato
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...ConsigliatoLavoro da remoto
- pMercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, collaborating with a leading AI lab. Work involves assessing AI-created music across genres in Italian and English. /ppKey duties include head-to-head comparisons,...Disponibilità immediataOrario flessibile
- ...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: AI Safety Red Teamer Type: Contract... ...hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber...Lavoro da remoto
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code...Lavoro da remoto
- ...relevance. This is a great opportunity for professionals with strong analytical skills and domain expertise to contribute to high-impact evaluation projects. /p h3Basic Qualifications /h3 ul liBachelor’s degree (minimum) /li liAt least 3+ years of professional experience in a...
- ...documents, ensuring quality, accuracy, and relevance. Ideal candidates have strong analytical skills, attention to detail, and the ability to follow structured guidelines. This role offers the opportunity to contribute to high-impact evaluation projects. #J-18808-Ljbffr
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and Word for...Lavoro da remoto
- A global technology company is seeking a Personalized Internet Ads Assessor for a part-time remote position. In this role, you will review online advertisements, providing feedback on their relevance and cultural context. The ideal candidate will have excellent communication...Part-timeRemoto
36 $/ora
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Music & Lyrics Expert - Italian Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Lavoro da remotoDisponibilità immediata36 h/sett.2.800 €/mese
...Pianificazione e il Monitoraggio delle Performance. Siamo anche esperti di Training, Counseling, Professional & Business Coaching; Evaluation, Talent e Performance Management; Diversity & Inclusion, Internal Communication; Brand Identity e Web Reputation; Employer...TemporaneoImpiego permanente- ...Transnet Decarbonisation Framework Loan and is searching for experts to support the core team during the implementation of this... ...: South Africa. Duration : Q3 2026. Non-Key Expert: Health & Safety Expert University degree in Engineering, Natural Sciences...
- pMercor cerca un Business Owner / Founder per una posizione in contratto, principalmente da remoto. Richiesta laurea e 2+ anni di esperienza, con forte padronanza di Excel, PowerPoint e Word. Il ruolo è orientato a gestione di progetti di valutazione documentale in contesti...Remoto
30.000 € - 35.000 €
...velivoli a pilotaggio remoto. Posizione supporto al processo di segnalazione, raccolta, analisi e monitoraggio degli eventi di Safety e delle eventuali azioni correttive e preventive; analisi degli eventi di Safety previa professionalizzazione quale...Impiego permanenteRemoto24 h/sett.- Ciodue S.p.A., azienda leader nel Settore Antincendio e Sicurezza sul Lavoro, seleziona: PROFESSIONISTI ANTINCENDIO abilitati per collaborazioni professionali nelle regioni LOMBARDIA, PIEMONTE, FRIULI, TRENTINO, VENETO, EMILIA ROMAGNA, TOSCANA, LAZIO, MARCHE. ...Libero professionistaContratto con partita IVA
- ComeUnited GmbH is seeking mystery shoppers to conduct field surveys across Italy. You will act as a brand customer to assess service quality via email, phone, or in person, providing objective feedback for automotive and other sectors. Applicants should be reliable...Orario flessibile
31.270 € - 40.150 €
...ambiente in cui ogni giorno è unico. IL TUO RUOLO Come Health & Safety Specialist sarai un elemento chiave nelle seguenti attività:... ...e di business delle aziende, che sfrutta la potenza dell’AI per offrire valore ai propri clienti. Immaginiamo il futuro delle...Impiego permanenteLavoro ibridoRemotoOrario flessibile1.200 - 1.600 €/mese
Orienta SpA. Agenzia per il Lavoro cerca neolaureati in tecniche della prevenzione da inserire nel reparto HSE o Formazione, con compiti di assistenza al project manager: predisporre documentazione, archiviazione e gestione dati, redigere reportistica. Si prevedono ...Tempo pienoSomministrazioneTempo determinato- ARX è una rete globale di specialisti nell'ambito dell'ingegneria, del design e dell'architettura. Il nostro team offre consulenze a 360°, si occupa della gestione dei progetti e di servizi tecnici nei seguenti ambiti: aeroporti, ponti e altre strutture, edifici-architettura...Impiego permanente
- ...Overview In this role you drive Environmental and Health & Safety due diligence and compliance work within our M&A-focused projects. You will collaborate with a cross-disciplinary team to assess risks, plan EHS strategies, and deliver ESG reviews for clients. You will...Lavoro ibridoRemotoOrario flessibile
28.000 € - 36.000 €
...Corporate Services as a broad area, with specific focus on Health Safety compliance and due diligence work in the MA sector with emphasis... ...of projects regarding mainly contaminated site management, expert services, permitting, due diligence, impact assessment, water treatment...Lavoro ibridoOrario flessibile4 giorni/sett.- Randstad Construction è la divisione di Randstad Italia specializzata nella Ricerca & Selezione di profili nel settore edile. Per Seli Overseas S.p.A. #WeBuild, società specializzata nella realizzazione di opere in sotterraneo e nello scavo meccanizzato di gallerie con...Vitto e alloggio
50.000 € - 57.000 €
ph3Job Description /h3pbTrevi Group /b è alla ricerca di un/una bHSE Specialist /b da inserire all'interno dei propri cantieri sul territorio nazionale, con l'obiettivo di garantire il rispetto dei più elevati standard in materia di Salute, Sicurezza e Ambiente (HSE) in...- Per importate azienda cliente, operante nel settore dell'impiantistica per le infrastrutture stradali, siamo alla ricerca della figura di un ASPP per la sede di Roma. La figura ricercata, coordinandosi con l'RSPP, al quale riporta, espleta tutti i compiti individuati...Impiego permanente
- pICR Impianti e Costruzioni SRL cerca un ASPP da impiegare in stretto rapporto con Responsabile del SPP, CSP/CSE. Garantirà l’applicazione delle procedure di prevenzione in cantiere e la conformità al D.Lgs. /pp81/08, supportando la gestione documentale, la valutazione ...
1.500 - 1.600 €/mese
Profilo Siamo alla ricerca per un'azienda che si occupa di manutenzione industriale, di un/a Tecnico della Prevenzione nell'ambiente e nei luoghi di lavoro e con sede di lavoro a Colleferro (RM) Si offre un contratto iniziale a tempo determinato in somministrazione...Stage/TirocinioSomministrazioneTempo determinato- Si ricerca un ASPP che operera a stretto contatto con il Responsabile del SPP, la Direzione Lavori e i Coordinatori della Sicurezza (CSP/CSE), assicurando la corretta applicazione delle procedure di prevenzione in cantiere e la conformità al D.Lgs. 81/08. Principali...

