An Abu Dhabi airline and aviation technology organisation is urgently seeking a highly experienced Senior / Lead Generative & Agentic AI Tester (QA Automation Engineer) with a mandatory background in the airline, aviation, or travel domain. You will ensure the quality, reliability, accuracy, security, and performance of AI-powered solutions across the airline industry — with deep hands-on expertise in LLM testing, hallucination testing, prompt testing, AI agent testing, agentic AI workflows, Python, LangChain, LangGraph, RAG architectures, and responsible AI testing. Immediate joiners and candidates serving notice periods are strongly preferred.
About the Opportunity — Generative AI QA Engineer Abu Dhabi
Urgency: Immediate joiners preferred — candidates currently serving notice periods also considered; relocation from India or other countries genuinely welcomed
Domain Requirement: Airline, Aviation, Travel, or Transportation domain experience — MANDATORY for this role
AI Testing Scope: LLM evaluation, hallucination testing, prompt testing, bias/fairness, AI agent testing, agentic AI workflows, chatbots, copilots, RAG architectures
AI Frameworks: LangChain, LangGraph, CrewAI, AutoGen, LlamaIndex, Semantic Kernel — hands-on experience required
Cloud Platforms: Azure OpenAI, AWS AI, Google AI services, or equivalent platforms
Abu Dhabi Airline AI Market — Why This Role
Strategic Location: Abu Dhabi — home to major international airlines and aviation technology organisations where AI-powered solutions are being deployed at scale across reservations, customer service, crew management, and passenger experience
Specialist Demand: Senior AI Testers with hallucination testing, LLM evaluation, and airline domain expertise are among the rarest and most strategically valuable technology professionals in Abu Dhabi’s aviation AI sector
AI Quality Maturity: Airline AI systems operate in safety-critical, regulation-sensitive environments where responsible AI testing, bias assessment, and guardrail validation are genuinely mission-critical — not optional quality steps
Career Growth: Senior and Lead AI testing credentials in the airline domain — covering LLMs, agentic AI, and responsible AI frameworks — represent one of the most distinctive and high-value specialisms in global AI quality engineering
Why This Role Matters: As Senior Lead Generative AI Tester in Abu Dhabi’s airline technology sector, you are the quality authority for AI systems that millions of passengers and airline operations teams depend on — where LLM hallucinations, biased outputs, or security vulnerabilities are not academic edge cases but real operational and reputational risks for a major aviation organisation, apply the full depth of a specialist AI testing career — LLM evaluation, prompt optimization testing, hallucination detection, bias and fairness assessment, AI agent behavioral validation, agentic workflow testing, and responsible AI guardrail verification — in an airline domain environment where the consequences of AI quality failures are clearly visible and commercially significant, work at the intersection of two highly specialist career tracks — deep AI testing expertise and airline/aviation domain knowledge — a combination that is genuinely rare in the global AI engineering market and commands premium compensation and career recognition, use LangChain, LangGraph, CrewAI, AutoGen, LlamaIndex, and Azure OpenAI in an airline AI context where the production systems you validate are live, customer-facing, and directly affecting reservation, customer service, crew management, and passenger experience workflows, and build a senior AI testing career credential in Abu Dhabi’s aviation AI sector that is internationally recognized and highly transferable across global airlines, aviation technology companies, and AI quality engineering consultancies.
Key Responsibilities
AI Application Development & Test Strategy
- Develop and support AI applications using Python, Generative AI, and Large Language Models (LLMs) for airline industry use cases
- Design, execute, and automate comprehensive AI test strategies across the AI application lifecycle — from development through production deployment
- Define and track AI quality metrics, benchmarks, and acceptance criteria for LLM-powered and agentic AI solutions
- Identify, analyze, and resolve defects related to AI outputs, agentic workflows, and model behaviour across production airline AI systems
LLM Evaluation, Hallucination & Prompt Testing
- Conduct comprehensive LLM evaluation and validation — assessing accuracy, consistency, reliability, and safety across airline AI model outputs
- Perform hallucination testing to detect, characterize, and mitigate LLM output hallucinations in airline operations contexts
- Execute prompt testing and optimization — validating prompt engineering quality, robustness, and behavioral consistency across different input conditions
- Conduct bias and fairness assessments and guardrail validation to ensure responsible AI standards are met across airline customer-facing AI systems
AI Agent Testing & Agentic Workflow Validation
- Validate AI models, LLMs, AI agents, and agentic workflows for accuracy, consistency, reliability, and safety across the AI agent lifecycle
- Develop automated frameworks for testing AI agents, chatbots, copilots, and autonomous workflows using LangChain, LangGraph, CrewAI, AutoGen, LlamaIndex, or Semantic Kernel
- Perform functional, integration, regression, performance, security, and user acceptance testing for AI solutions in airline operations environments
- Create AI quality frameworks, test cases, evaluation datasets, and benchmarking methodologies for LLM and agentic AI systems
Airline Domain Collaboration & Production Readiness
- Collaborate with business stakeholders and development teams to ensure production-ready AI solutions for airline operations — reservations, customer service, crew management, and passenger experience
- Apply knowledge of airline operations, reservations, customer service, crew management, airport operations, or passenger experience to inform AI testing strategy
- Work with Azure OpenAI, AWS AI, Google AI, or equivalent cloud platform AI services across the airline AI testing programme
- Test RAG architectures, vector databases, and AI model integrations for accuracy, performance, and reliability in airline production environments
Qualifications & Requirements
Domain Requirement
- Experience in the Airline, Aviation, Travel, or Transportation domain — MANDATORY for this role; candidates without this experience will not be considered
- Knowledge of airline operations, reservations, customer service, crew management, airport operations, or passenger experience solutions is a strong advantage
Technical Requirements
- Strong experience in Python for AI application development and test automation (REQUIRED)
- Hands-on experience with LLMs, Generative AI, RAG architectures, vector databases, and AI models (REQUIRED)
- Experience with AI frameworks — LangChain, LangGraph, CrewAI, AutoGen, LlamaIndex, or Semantic Kernel (REQUIRED)
- Deep expertise in AI testing — LLM evaluation, hallucination testing, prompt testing, bias/fairness testing, AI agent testing, and responsible AI guardrail validation
- Experience with Azure OpenAI, AWS AI, Google AI services, or equivalent cloud AI platforms
Experience & Availability
- 8–9+ years of experience in QA automation, AI engineering, or LLM testing roles
- Immediate joiners or candidates currently serving notice periods — strongly preferred
- Candidates from outside UAE (including India) are welcome if genuinely interested and willing to relocate to Abu Dhabi
- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or related field preferred
- Certifications in AI, Machine Learning, Software Testing, or Cloud Technologies are an advantage
About This Generative AI QA Engineer Opportunity in Abu Dhabi
This Senior / Lead Generative & Agentic AI Tester role in Abu Dhabi is an urgent requirement for a specialist AI quality engineer who combines deep LLM testing expertise — hallucination testing, prompt optimization, AI agent validation, responsible AI frameworks — with mandatory airline or aviation domain knowledge. Working in Abu Dhabi’s active airline AI technology sector, you will deliver the testing rigour that ensures AI systems across reservations, customer service, crew management, and passenger experience are accurate, safe, and production-ready. Immediate availability is strongly preferred — this is a live programme requiring fast onboarding.
Career Excellence: Apply your LLM hallucination testing, AI agent validation, and airline domain expertise in Abu Dhabi — an urgent Senior/Lead Generative AI QA Tester opportunity for immediate or near-immediate joiners.
Who Should Apply?
- Senior LLM Testers & AI QA Engineers: With 8–9+ years of experience and deep expertise in LLM evaluation, hallucination testing, prompt testing, and agentic AI validation
- Airline Domain AI Engineers: With MANDATORY airline, aviation, or travel technology background — reservations, customer service, crew management, or passenger experience systems
- LangChain / LangGraph / AutoGen AI Framework Engineers: With hands-on testing and validation experience for AI agent and agentic workflow systems built on these frameworks
- Responsible AI & Bias Testing Specialists: With bias/fairness assessment, guardrail validation, and responsible AI testing experience for production LLM systems
- Immediate Joiners or Notice Period Candidates: UAE-based or international (including India) candidates willing to relocate to Abu Dhabi for an urgent live airline AI programme
Recently Opening Job👇
