Senior QA Engineer

Ireland
Permanent
Full-time

2 days ago

Job Description:EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world's leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect.We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit .EXL Digital is looking for an experienced Lead QA Engineer with experience with AI solutions to join the team. At EXL, we believe there is always a better way. We look deeper, we find it, and we make it happen. We created a culture founded on core values of innovation, collaboration, excellence, integrity, and respect.We are seeking a highly skilled Senior QA Engineer to define, implement, and automate comprehensive testing strategies for our AI-powered solutions, with a particular focus on Generative AI applications. This role requires expertise in traditional software testing combined with specialized knowledge of AI/ML testing methodologies, including the unique challenges of testing non-deterministic systems, model outputs, and AI agent behaviors.As Lead QA Engineer, you will …

Deign and implement comprehensive testing frameworks for Generative AI applications, LLM-based systems, and AI agent workflows
Develop automated testing strategies for AI model outputs including accuracy, relevance, bias detection, and safety validation
Execute manual and automated testing of platform UI components, user interfaces, and AI-powered conversational systems
Create and maintain comprehensive API test suites for REST/GraphQL endpoints, MCP servers, and AI service integrations
Design and execute end-to-end process flow testing for complex AI workflows, agent orchestration, and multi-system integrations
Build and maintain CI/CD testing pipelines with automated regression testing for both platform features and AI model behaviors
Establish quality metrics and testing protocols for AI guardrails, safety mechanisms, and ethical AI compliance
Perform load and performance testing for AI inference, model serving, real-time applications, and platform scalability
Develop testing strategies for AI model evaluation including A/B testing frameworks, model comparison, and deployment validation
Collaborate with engineering teams to establish quality gates, testing standards, and integrate QA into development workflows

Qualifications

7+ years of QA engineering experience with at least 2 years focused on AI/ML or complex platform applications
Expert knowledge of automated testing frameworks (Selenium, Playwright,etc) and CI/CD integration
Strong programming skills in Python and JavaScript/TypeScript for test automation and platform testing
Proven experience testing APIs (REST, GraphQL) using tools like Postman, REST Assured, and custom automation frameworks
Experience with Generative AI applications testing including LLMs, chatbots, AI agents, and prompt-based systems
Knowledge of AI/ML evaluation metrics and testing methodologies for non-deterministic systems and model outputs
Advanced experience with AWS and cloud-based application testing, including AI/ML services and infrastructure
Strong understanding of performance testing tools (JMeter, Locust, Artillery) for both traditional applications and AI workloads
Experience with manual testing methodologies including exploratory testing, usability testing, and cross-platform validation
Experience with agile methodologies and collaborative development practices in fast-paced environments
Bachelor's degree in Computer Science, Engineering, or related field with strong foundation in software testing principles

As part of a leading global analytics and digital solutions company, you can look forward to:

A competitive salary with a generous bonus, private healthcare, life assurance at 4 x your annual salary, income protection insurance, and a rewarding pension.
At EXL, we are committed to providing our employees with the tools and resources they need to succeed and excel in their careers. We offer a wide range of professional and personal development opportunities. We also support a range of learning initiatives that allow our employees to build on their existing skills and knowledge. From online courses to seminars and workshops, our employees have the opportunity to enhance their skills and stay up to date with the latest trends and technologies.
As an Equal Opportunity Employer, EXL is committed to diversity. Our company does not discriminate based on race, religion, colour, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, age, or disability status.
At EXL, we offer a flexible hybrid working model that allows employees to live a balanced, healthy lifestyle while strengthening our culture of collaboration.

To be considered for this role, you must already be eligible to work in the Republic of Ireland.Qualifications:Qualifications

7+ years of QA engineering experience with at least 2 years focused on AI/ML or complex platform applications
Expert knowledge of automated testing frameworks (Selenium, Playwright,etc) and CI/CD integration
Strong programming skills in Python and JavaScript/TypeScript for test automation and platform testing
Proven experience testing APIs (REST, GraphQL) using tools like Postman, REST Assured, and custom automation frameworks
Experience with Generative AI applications testing including LLMs, chatbots, AI agents, and prompt-based systems
Knowledge of AI/ML evaluation metrics and testing methodologies for non-deterministic systems and model outputs
Advanced experience with AWS and cloud-based application testing, including AI/ML services and infrastructure
Strong understanding of performance testing tools (JMeter, Locust, Artillery) for both traditional applications and AI workloads
Experience with manual testing methodologies including exploratory testing, usability testing, and cross-platform validation
Experience with agile methodologies and collaborative development practices in fast-paced environments
Bachelor's degree in Computer Science, Engineering, or related field with strong foundation in software testing principles

EXL Service

Apply Now