QA Engineer - AI Testing & Automation

About the Role

Test AI-driven healthcare products including LLMs, RAG systems, AI assistants, chatbots, and ML prediction features, validating outputs for accuracy, bias, and safety.

Responsibilities

• Validate AI outputs for accuracy, hallucination, bias, and safety
• Build and maintain automation scripts
• Perform functional, regression, integration, and end-to-end testing
• Create test datasets and evaluation rubrics
• Analyze logs and troubleshoot backend issues

Requirements

• Bachelor's degree in Computer Science or IT
• 3+ years hands-on testing experience
• 1 year AI/ML/chatbot testing preferred
• ISTQB or AI testing certification advantageous

Skills

`Selenium` · `Playwright` · `Cypress` · `REST Assured` · `PyTest` · `Java` · `Python` · `JavaScript` · `API testing` · `SQL` · `Vector databases` · `AI/ML testing`

How to apply

Or apply online: https://itpro.lk/job/14077/