QA Engineer – AI Testing & Automation

About the Role

QA Engineer at HealthRecon Connect to test AI-driven products including LLMs, RAG systems, and chatbots using automation frameworks and AI-specific evaluation methodologies.

Responsibilities

• Test AI-driven products including LLMs, RAG systems, chatbots, and ML features
• Validate AI outputs for accuracy, relevance, and safety
• Work with local LLM tools such as Ollama and LM Studio
• Create test datasets and evaluation rubrics
• Build automation scripts using various testing frameworks
• Perform functional, regression, integration, and end-to-end testing

Requirements

• Bachelor's degree in Computer Science or IT
• 3+ years hands-on QA experience
• 1 year AI/ML/LLM product testing preferred
• ISTQB or AI testing certification advantageous
• Strong communication skills

Skills

`Manual testing` · `Automation testing` · `Selenium` · `Playwright` · `Cypress` · `REST Assured` · `PyTest` · `Java` · `Python` · `JavaScript` · `API testing` · `SQL` · `AI/ML/LLM testing` · `RAG systems` · `Vector databases` · `Ollama` · `LM Studio`

How to apply

Or apply online: https://itpro.lk/job/14077/qa-engineer-ai-testing-automation-at-healthrecon-connect-llc/