About Us:
Chryselys is a Great Place to Work Certified, Pharma Analytics & Business consulting company that delivers data-driven insights leveraging AI-powered, cloud-native platforms to achieve high-impact transformations.
We specialize in digital technologies and advanced data science techniques that provide strategic and operational insights.
Who we are:
People - Our team of industry veterans, advisors and senior strategists have diverse backgrounds and have worked at top tier companies.
Quality - Our goal is to deliver the value of a big five consulting company without the big five cost.
Technology - Our solutions are Business centric built on cloud native technologies.
Job Title: Senior QA Engineer (GenAI Testing + AI Tools)
Experience:
4–6 Years
Location:
Hyderabad, India (Hybrid)
Role Overview
We are looking for a Senior QA Engineer with hands-on experience in testing modern applications powered by Generative AI. This role goes beyond traditional QA—you will leverage AI tools and frameworks to design intelligent, automated, and scalable testing strategies for React-based frontends and Python backend systems.
You will play a critical role in ensuring the reliability, accuracy, and performance of LLM-powered applications, including copilots, chat interfaces, and AI-driven workflows.
Key Responsibilities
- Design and implement test strategies for GenAI-powered applications (LLMs, RAG, agents)
- Build and maintain automated test suites for:
- React-based frontend applications
- Python-based backend APIs and services
- Use AI-powered testing tools to accelerate test creation, execution, and maintenance
- Validate LLM outputs for correctness, consistency, hallucination, and edge cases
- Develop evaluation frameworks for prompt quality, response relevance, and grounding
- Perform API testing, integration testing, and end-to-end testing
- Test data pipelines and workflows involving unstructured data
- Ensure performance, scalability, and reliability of applications
- Work closely with developers, ML engineers, and product teams
Required Skills
QA & Automation
- Strong experience in automation testing frameworks (Playwright, Cypress, Selenium)
- Experience testing REST APIs (Postman, Pytest, REST Assured)
- Solid understanding of functional, regression, and integration testing
GenAI Testing (Must Have)
- Experience testing LLM-based applications (chatbots, copilots, RAG systems)
- Understanding of:
- Prompt engineering validation
- Hallucination detection
- Response evaluation metrics (accuracy, relevance, grounding)
- Familiarity with tools like:
- Ragas
- TruLens
- PromptLayer / LangSmith (or similar)
Programming
- Proficiency in Python (for backend testing and automation)
- Experience testing Python-based services (FastAPI, Flask)
- Basic understanding of JavaScript/TypeScript for frontend testing
Frontend Testing
- Experience testing React applications
- Knowledge of UI/UX testing, DOM validation, and cross-browser testing
AWS (Good to Have)
- Familiarity with:
- S3
- Lambda
- API Gateway
- CloudWatch (for logs & monitoring)
- Understanding of testing in cloud-native environments
AI-Driven Testing Tools (Highly Preferred)
- Experience using AI tools for QA such as:
- Test case generation using LLMs
- Self-healing automation tools
- AI-based visual testing tools
- Exposure to tools like:
- Copilot for test writing
- AI-based test automation platforms (e.g., Testim, Functionize, Mabl)
Good to Have
- Experience with performance testing tools (k6, JMeter)
- Knowledge of CI/CD pipelines (GitHub Actions, Jenkins, etc.)
- Experience with microservices architecture
- Exposure to security testing for APIs and AI systems
- Domain experience in healthcare/pharma (bonus)
Why Join Us?
- Work on Advanced Analytical techniques using AI/ML in the Market Access functions for the pharmaceutical domain with industry-leading tools.
- Collaborate with Global and US teams to advance Market Access Contracting and Patient Analytics.
- Opportunity to drive AI/ML-based innovations in Market Access Analytics.
- Competitive salary, learning opportunities, and a dynamic work environment
Equal Employment Opportunity:
Chryselys is proud to be an Equal Employment Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Connect with Us: