Senior Test Automation Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role : Senior Test Automation Engineer
Experience Level : 3 to 6 Years
Work Location : Bengaluru/Mumbai/Trivandrum
Work From Office : Hybrid
 

Role & Responsibilities:

• Design and implement UI automation frameworks for React-based healthcare applications.
• Automate testing of digital avatar interactions and real-time visualizations
• Test ADA-compliant features and responsive design across devices
• Automate WebRTC audio/video streams and real-time communication testing
• Test software to ensure responsiveness and efficiency
• Test real-time database operations (Firestore, Cloud SQL)
• Validate session metadata, audit logs, and complex healthcare data structures
• Ensure HIPAA compliance, data encryption, and PII protection
• Perform SQL-based testing for healthcare data integration
• Execute complex healthcare workflow testing across multiple use cases
• Test multi-turn conversational flows and emergency scenario handling
• Validate edge cases, stress testing, and session recovery mechanisms
• Create comprehensive test scenarios for healthcare compliance
• Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion
• Build and maintain automated testing frameworks for agent workflows using Python
• Test for hallucinations, prompt injection, bias, PII leakage, and response safety
• Test end-to-end integration between UI, microservices, and AI agents
• Self-starter – proactive and extremely detail oriented
• Validate GCP infrastructure, CI/CD pipelines, and deployment automation
• Implement Automated CI/CD processes using Jenkins tools
• Perform security testing and telephony platform integrations
• Test observability systems and cloud-based microservice environments
• Work with observability tools (e.g., LangSmith, Trulens, logging pipelines) to analyze agent execution
• Design test strategy and estimates for automation
• Technology focused, agnostic to tools, adaptable to change in technology
• Suggest quality fixes and improvements
• Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic
• Contribute to the development of agent test harnesses and benchmarking pipelines
• Validate message integrity and orchestration between avatar UI, voice services, context managers, and LLM endpoints using REST/gRPC/WebSocket automation
• Implement contract and schema validation for API integrations
• Test event-driven architectures using Kafka/MQTT and ensure reliable message delivery
• Ensure continuous integration and safe model rollout through MLOps-aware CI/CD testing
• Implement model version checks and regression suite hooks in deployment pipelines
• Work with Docker, Helm, and GitHub Actions for containerized deployments

Required Skills:

Core Testing & Automation:

• 3+ years QA automation experience with Selenium WebDriver expertise
• Java/Python programming for automation frameworks
• API Testing proficiency (RestAssured, Postman, REST/GraphQL APIs)
• Event-driven automation (REST/gRPC/WebSocket, Kafka/MQTT testing)
• Contract & schema validation expertise
• Async workflow simulation and event bus testing (Kafka, NATS)
• API contract testing tools (Karate, Swagger mocks, pact testing)

Frontend & UI Testing:

• Strong JavaScript frameworks knowledge (React, Angular, Vue.js)
• Multimodal UI automation (Playwright/Cypress for avatar rendering, gestures, text sync)
• Visual regression testing tools (Applitools, Percy)
• WebDriver with video validation capabilities
• Speech & Audio testing (ASR/TTS accuracy, latency profiling, ffmpeg pipelines)
• Visual & Motion regression testing (OpenCV-based comparison, frame analysis)
• Accessibility testing tools (Axe-core, Lighthouse, screen reader validation)
• End-to-end conversation flow simulation with mock APIs

Cloud & Platform:

• GCP/AWS cloud platform experience and microservices testing
• Docker, Kubernetes containerization and orchestration
• Infrastructure testing and deployment validation
• Performance testing tools (JMeter, LoadRunner, k6, Locust, Gatling)
• CI/CD pipeline testing (Jenkins, GitHub Actions, Helm)
• MLOps-aware testing (model version checks, regression suite hooks)
• Observability & monitoring tools (OpenTelemetry, Grafana, ELK, Prometheus)
• Chaos testing and fault injection (Gremlin, synthetic fault testing)
• Database & caching validation (SQL/NoSQL automation, Redis, schema drift monitoring)

AI & Healthcare Specific:

• AI/ML testing and conversational AI validation
• Healthcare compliance knowledge (HIPAA, FHIR standards)
• Security testing for regulated environments
• Voice AI and speech recognition testing
• LLM endpoint testing and validation
• Avatar UI and multimodal interaction testing
• Context manager and conversation flow testing

Security & Compliance:

• Enterprise security standards (HIPAA, SOC2, GDPR) automation
• Security testing tools (OWASP ZAP, Burp Suite)
• JWT validation and authentication testing
• Policy-as-code implementation (OPA)
• Secret scanning and vulnerability assessment
• Error handling and circuit breaker validation

Good to have:

• Evaluate agent output using rubric-based, LLM-based, and scenario-based techniques
• LLM-specific testing including prompt testing
• Multi-turn conversation testing
• Shadow testing and anomaly monitoring experience
• Distributed load testing with Grafana integration
• Microservice contract chaining expertise
• Image diffing and automated snapshot testing
• Noise robustness testing for voice interaction