We are hiring for one of our clients, seeking an AI Quality Analyst (Personalization) – Hindi to evaluate a new personalization feature for an advanced AI model, assessing how well it uses personal data to generate relevant, contextually appropriate responses.
About the Role — AI Personalization Evaluation
Core Scope: Evaluating an AI model’s ability to integrate personal data into relevant responses
Data Sources Analyzed: Past conversations, email, search, and video activity
Language Requirement: High proficiency in reading and writing Hindi
Work Format: Fully remote, supporting a global 24-hour operations team
Evaluation Focus: Grounding, integration, helpfulness, and user intent alignment
Career Impact & AI Evaluation Opportunity
Total Flexibility: Fully remote role, work from anywhere globally
Technical Ownership: Design and refine multi-turn prompts to test personalization capabilities
Cutting-Edge Exposure: Contribute to an AI system used by leading enterprises
Career Growth: Build specialized expertise in AI evaluation, grounding, and personalization testing
Position Overview
This role involves evaluating a new personalization feature for an advanced AI model, analyzing the model’s ability to integrate information from past conversations, email, search, and video activity to deliver accurate and contextually appropriate outputs. The role requires high proficiency in Hindi and strong analytical evaluation skills.
 Why This Role Matters: As AI Quality Analyst, you design and refine multi-turn prompts based on personal experiences to test the AI model’s personalization capabilities, evaluate the quality of AI-generated responses across dimensions such as grounding, integration, and helpfulness, identify instances of incorrect personalization, flawed inferences, or forced connections in model outputs, compare side-by-side model responses to detect subtle differences and assess consistency, provide detailed feedback on the model’s ability to align with user-specific context and intent, and contribute to the development of a cutting-edge AI system used by leading enterprises worldwide.
Key Responsibilities
Prompt Design & Testing
- Design and refine multi-turn prompts based on personal experiences to test personalization capabilities
Response Quality Evaluation
- Evaluate the quality of AI-generated responses across grounding, integration, and helpfulness
- Identify instances of incorrect personalization, flawed inferences, or forced connections
Comparative Analysis
- Compare side-by-side model responses to detect subtle differences and assess consistency
Feedback & Reporting
- Provide detailed feedback on the model’s ability to align with user-specific context and intent
 Qualifications & Requirements
Language Requirements
- Proficiency in Hindi with a high degree of competency in reading and writing
Essential Skills
- Experience in analytical evaluation of AI-generated content, particularly in personalization contexts
- Ability to design creative and contextually relevant prompts for testing AI models
- Strong attention to detail to assess nuanced and ambiguous AI responses
- Familiarity with concepts related to AI personalization, grounding, and user intent alignment
- Experience in multi-turn conversation analysis and response evaluation
- Comfort with data privacy considerations when handling personal user information
Additional Requirements
- Willingness to use a personal Google account with enabled data sources for genuine evaluation
- Ability to work full-time with flexibility to support a global, 24-hour operations team
 About the Opportunity
This role offers the chance to contribute to the development of a cutting-edge AI system used by leading enterprises, ensuring it delivers measurable impact through reliable personalization. The position is hired through a staffing partner on behalf of the end client, with applications reviewed solely on demonstrated technical ability and qualifications, regardless of background or prior employment history.
Career Excellence: Build specialized AI evaluation and personalization testing expertise, contributing directly to a cutting-edge AI system in a fully remote, Hindi-language specialist role.
Who Should Apply?
- Hindi-Fluent AI Evaluators:Â With strong reading and writing proficiency
- AI Content Analysts:Â Experienced evaluating AI-generated content for quality and accuracy
- Prompt Engineering Specialists:Â Comfortable designing creative, contextually relevant test prompts
- Detail-Oriented Reviewers:Â Skilled at assessing nuanced, ambiguous AI responses
- Remote-First Professionals:Â Comfortable supporting a global, 24-hour operations schedule
Recently Opening Job👇
