QA Engineer - AI Testing and Automation

About the Role

Mid-level QA engineer specializing in AI and automation testing at HealthRecon Connect in Colombo, validating LLM outputs, RAG systems, and AI-powered features for healthcare applications. Requires 3+ years in QA with at least 1 year working with AI/ML products.

Responsibilities

• Test AI products including LLMs, RAG systems, chatbots, and ML features
• Validate AI outputs for accuracy, hallucination, bias, and safety
• Work with local LLM tools like Ollama and LM Studio
• Create test datasets and automation scripts
• Perform functional, regression, and end-to-end testing

Requirements

• Bachelor's degree in Computer Science or IT
• 3+ years hands-on QA testing experience
• 1+ year working with AI/ML products (preferred)
• Proficiency in automation frameworks (Selenium, Playwright, Cypress)
• Understanding of AI/ML/LLM concepts, RAG systems, and embeddings
• ISTQB or AI testing certification (preferred)

Skills

`Selenium` · `Playwright` · `Cypress` · `REST Assured` · `PyTest` · `Java` · `Python` · `JavaScript` · `API testing` · `SQL` · `LLM testing` · `RAG systems` · `Ollama` · `LM Studio` · `Vector databases`

How to apply

Or apply online: https://itpro.lk/job/14077/qa-engineer-ai-testing-automation-at-healthrecon-connect-llc/