We are hiring for one of our clients, a global leader in the Technology, Information and Internet industry, seeking an AI Quality Analyst — English for a fully remote role open to candidates in the UAE, evaluating a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses.
About the Opportunity — AI Personalization Evaluation
Role Title: AI Quality Analyst — English
Work Format: Fully remote, work from anywhere
Core Focus: Evaluating AI personalization features for grounding, integration, and helpfulness
Key Skill Blend: Creative prompt design and analytical evaluation of AI-generated content
Team Structure: Supports a global, 24-hour operations team
Career Impact & Remote AI Evaluation Opportunity
Global Reach: Fully remote position open to qualified candidates across the UAE and beyond
High-Impact Work: Contribute to the development of advanced AI systems with measurable business impact
Analytical Focus: Assess nuanced, ambiguous AI responses with rigor and attention to detail
Career Growth: Build specialized expertise in AI evaluation and prompt engineering
 Position Overview
We are hiring for one of our clients, seeking an AI Quality Analyst — English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content.
Why This Role Matters:Â As Quality Analyst, you shape how AI models personalize responses using real-world context and data sources, design creative, multi-turn prompts that rigorously test model integration and accuracy, assess AI responses for grounding, relevance, and helpfulness with analytical precision, provide detailed feedback that directly improves model personalization performance, work fully remote with flexibility to support a global, 24-hour operations team, and contribute to advanced AI systems at a global leader in the Technology, Information and Internet industry.
Key Responsibilities
Personalization Evaluation
- Evaluate the quality of personalized responses from an AI model using your own personal experiences as context
- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections
Prompt Design & Testing
- Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately
- Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy
Feedback & Reporting
- Provide detailed feedback on model behavior to improve personalization performance
Qualifications & Requirements
Essential Skills
- English proficiency with a high degree of competence in reading and writing
- Experience in prompt engineering or designing test cases for AI models
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor
- Familiarity with personalization concepts and evaluation metrics in AI systems
- Attention to detail to identify subtle discrepancies in model outputs
- Willingness to use your primary personal Google account and enable personal data sources for assessment
- Full-time availability in your local time zone to support a global, 24-hour operations team
About the Opportunity
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact. All qualified candidates are welcome regardless of background, experience, or prior employment history, with applications reviewed solely on demonstrated technical ability and qualifications.
Career Excellence: Build specialized AI evaluation and prompt engineering expertise in a fully remote role supporting cutting-edge AI personalization technology.
 Who Should Apply?
- AI Quality Analysts:Â With strong English proficiency and analytical evaluation skills
- Prompt Engineers:Â Experienced designing test cases and multi-turn prompts for AI models
- AI Training & Evaluation Specialists:Â Familiar with personalization concepts and metrics
- Detail-Oriented Reviewers:Â Comfortable identifying subtle discrepancies in AI outputs
- Remote-First Tech Professionals:Â Seeking flexible, work-from-anywhere AI evaluation roles
Recently Opening Job👇
