Talent.com
Mercor
AI Safety Specialist - Evaluation ExpertMercor • Lisbon, Lisbon District, Portugal
AI Safety Specialist - Evaluation Expert

AI Safety Specialist - Evaluation Expert

Mercor • Lisbon, Lisbon District, Portugal
Há 20 horas
Tipo de trabalho
  • Quick Apply
Descrição do cargo

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
  • Familiarity with safety policies, content moderation, or evaluation rubric development.
  • Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Criar um alerta de emprego para esta pesquisa

AI Safety Specialist - Evaluation Expert • Lisbon, Lisbon District, Portugal

Empregos similares

Remote Actuarial Ai & Risk Analytics Expert

Weekday AI (YC W21)Lisbon, Portuguese Republic, PT

Weekday AI (YC W21) is looking for a Risk & Actuarial AI Expert to enhance decision-making across insurance and risk portfolios.This role requires a degree in Actuarial Science or related fields, a... Mostre mais

 • Divulgado

Remote Strategy Consultant For Ai Training & Evaluation

MindriftLisbon, Portuguese Republic, PT

Mindrift is launching a remote, project-based consultant role focused on translating real-world engagements into structured learning environments for advanced AI systems.You will design end-to-end ... Mostre mais

 • Divulgado

Remote Ai Data Pilot – Vibecode Specialist

MindriftLisbon, Portuguese Republic, PT

A forward-thinking tech company based in Portugal is seeking an AI Pilot to join the Tendem project.This freelance role involves managing data extraction workflows using tools like Apify and OpenRo... Mostre mais

 • Divulgado

Senior Threat Hunter & Dfir Specialist (Tier 3)

Logicalis GmbHLisbon, Portuguese Republic, PT

A Logicalis Portugal pretende reforçar a sua equipa com um/a SOC Threat Hunter & DFIR Specialist (Tier 3), responsável por liderar investigações avançadas, campanhas de threat hunting e resposta a ... Mostre mais

 • Divulgado

Ra Technician

Suanfarma, SACastanheira Do Ribatejo, Portuguese Republic, PT

Workplace:* Type of contract: Permanent* Date publish: 23/03/2026*.Vacancies: 1#### **Job description**At SF CDMO, we are looking for an individual eager to grow within our RA team in Castanheira d... Mostre mais

 • Divulgado

Ai Agent Evaluation Analyst (Freelance)

MindriftLisbon, Portuguese Republic, PT

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.This opportunity is only for candidates currently residing in the specified country.Your location may ... Mostre mais

 • Divulgado

Hungarian Trust & Safety Analyst In Lisbon

Cross Border TalentsLisbon, Portuguese Republic, PT

Hungarian Trust & Safety Analyst in Lisbon About the job Hungarian Trust & Safety Analyst in Lisbon Help Build a Safer Online Space — Join Our Team as an Trust & Safety Analyst!.Are you interested ... Mostre mais

 • Divulgado

Ai Prompt Evaluator - Czech Market (Relocation Support Available To Germany)

FH Collective AcademyLisbon, Portuguese Republic, PT

AI Prompt Evaluator - Czech Market (Relocation Support Available to Germany)! Responsibilities.Research, write & edit short prompts that are accurate, creative, and on-brand Create smooth conversat... Mostre mais

 • Divulgado

Ai Security & Genai Specialist — Secure, Scalable Ai

InnoTechLisbon, Portuguese Republic, PT

About Us Planck Technologies is a company specialized in Software Development, dedicated to shaping futures and creating value through innovative IT solutions.By expanding teams and offering a comp... Mostre mais

 • Divulgado

Lead Data Scientist - Fraud & Risk Analytics

RiskifiedLisbon, Portuguese Republic, PT

Riskified is looking for a Data Science Team Leader to lead and mentor a team of data scientists in Lisboa, Portugal.This role involves defining technical approaches for complex data projects and e... Mostre mais

 • Divulgado

Senior Vulnerability Researcher: Advanced Threat Detection

BitsightLisbon, Portuguese Republic, PT

A cyber risk management leader in Portugal is seeking a Vulnerability Researcher.In this role, you will research emerging threats, develop innovative vulnerability detection techniques, and provide... Mostre mais

 • Divulgado

Mechanical Engineer

agap2 IndústriaAlverca Do Ribatejo, Portuguese Republic, PT

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Join agap2 indústria – Together we are the driving force that moves the industry forward.At agap2 indú... Mostre mais

 • Divulgado

Digital Trust & Safety Specialist — Relocation

TELUS DigitalLisbon, Portuguese Republic, PT

TELUS Digital is seeking a Specialist in digital trust and security based in Portugal.The role involves reviewing user-generated backoffice information to ensure compliance with established guideli... Mostre mais

 • Divulgado

Remote Part-Time Ai Agent Evaluation Analyst

MindriftLisbon, Portuguese Republic, PT

An innovative AI company in Lisbon seeks part-time contributors for Quality Assurance roles focused on AI agents.Ideal applicants will have strong analytical thinking, attention to detail, and the ... Mostre mais

 • Divulgado

Technical Compliance Specialist

PlaysonLisbon, Portuguese Republic, PT

Technical Compliance Specialist at Playson Playson is a leading online gaming supplier with worldwide recognition, founded in 2012.We offer complete gaming solutions based on the latest technologie... Mostre mais

 • Divulgado

Hungarian Trust & Safety Analyst — Safer Online Spaces (Lisbon)

Cross Border TalentsLisbon, Portuguese Republic, PT

Cross Border Talents seeks a Trust & Safety Analyst in Lisbon to review user content and ensure compliance with policies and regulations, helping maintain a safer online space.You will apply object... Mostre mais

 • Divulgado

Risk & Actuarial Ai Expert

Weekday AI (YC W21)Lisbon, Portuguese Republic, PT

This role is for one of our clients.Compensation $100-$120 per hour (20 hours per week commitment).Location US, UK, Canada, France, Portugal (remote).Overview We are seeking a highly analytical and... Mostre mais

 • Divulgado

Senior Ai Engineer — Spatial Intelligence, Segmentation & 3d

Career Genie, IncLisbon, Portuguese Republic, PT

Help build foundational perception technology for a robotics platform designed for real-world impact across multiple industries.Work on deeply technical problems at the frontier of AI, computer vis... Mostre mais

 • Divulgado

Ai & Tech Strategy Analyst

McKinsey & Company, Inc.Lisbon, Portuguese Republic, PT

You will work on-site with clients, designing scalable solutions and modernizing technology infrastructures to deliver measurable impact.The role requires strong analytical abilities, teamwork, and... Mostre mais

 • Divulgado

French Payments Support Specialist – Lisbon Relocation

CbtalentsCarregado, Portuguese Republic, PT

A leading payment solutions provider in Lisbon seeks a French-Speaking Payment Solutions Support Specialist to join their team.The candidate will provide top-tier support for business clients regar... Mostre mais