Quality Analyst (Remote)

ullistrongRole /strong: Quality Analyst (Remote) /lilistrongLocation /strong: Remote (Work from Anywhere) /li /ulpbr / /ppstrongRole Overview: /strong /ppWe are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content. /ppbr / /ppstrongKey Responsibilities: /strong /pp• Evaluate the quality of personalized responses from an AI model using your own personal experiences as context. /pp• Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately. /pp• Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections. /pp• Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy. /pp• Provide detailed feedback on model behavior to improve personalization performance. /ppbr / /ppstrongRequired Skills Qualifications: /strong /pp• English proficiency with a high degree of competence in reading and writing. /pp• Experience in prompt engineering or designing test cases for AI models. /pp• Ability to analyze nuanced and ambiguous AI responses with analytical rigor. /pp• Familiarity with personalization concepts and evaluation metrics in AI systems. /pp• Attention to detail to identify subtle discrepancies in model outputs. /pp• Willingness to use your primary personal Google account and enable personal data sources for assessment. /pp• Full-time availability in your local time zone to support a global, 24-hour operations team. /ppbr / /ppstrongMore About the Opportunity: /strong /ppThis role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact. /ppbr / /ppstrongEqual Opportunity Employer: /strong /ppWe hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. /ppbr / /ppstrongApply Now! /strong /p