EVERSANA

AI Systems Quality Specialist

Overland Park, us Full-time On-site
Apply Now →
Job Description

The AI Systems Quality Specialist will design, build, and oversee the quality assurance framework for EVERSANA’s AI Agency Platform. This role ensures that every feature, integration, and AI-driven process operates reliably and compliantly. The QA Automation Lead will establish automated testing frameworks covering functional, regression, and compliance scenarios, manage integration test suites across connected systems (Google Cloud, Veeva, SFMC, Aprimo), and collaborate closely with DevOps, Product, and AI teams to uphold quality benchmarks. The ideal candidate combines deep QA automation experience with an understanding of regulated environments and AI-enabled software systems. ESSENTIAL DUTIES AND RESPONSIBILITIES: Our employees are tasked with delivering excellent business results through the efforts of their teams.  These results are achieved by: Automation Framework Design & Execution Design, implement, and maintain a comprehensive automation framework for functional, regression, and integration testing. Build automated test scripts for APIs, UI workflows, data pipelines, and AI agent interactions using tools such as PyTest or Selenium. Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, or Cloud Build) to support continuous delivery. Ensure test scripts cover both core platform functionality and partner integrations (Veeva Vault, Vertex AI, Snowflake). Standardize QA practices for cross-team use and document testing methodologies. Functional, Regression, and Compliance Testing Develop and execute test cases for new features, enhancements, and bug fixes. Conduct regression testing prior to each release to ensure platform stability. Define and perform compliance and validation testing to ensure platform adherence to HIPAA, GDPR, SOC 2, and MLR workflow standards. Work with the AI Validation and Compliance teams to evaluate AI output quality (accuracy, hallucination, tone, compliance alignment). Ensure traceability between business requirements, test cases, and validation results through detailed test documentation. Integration & System Reliability Testing Oversee integration testing for all platform connectors and data flows (Veeva Vault, Aprimo, SharePoint, SFMC, Google Vertex AI). Develop synthetic test environments and mock APIs to validate complex, multi-system workflows. Partner with Data Engineering to validate ETL pipelines and analytics dashboards for data accuracy. Track and report system reliability metrics (latency, failure rate, API response times). Defect Management & Continuous Improvement Identify, log, and prioritize defects using Jira, tracking issue resolution through sprints. Collaborate with Product and Engineering teams to verify bug fixes and perform root cause analysis for recurring issues. Lead post-release validation and QA retrospectives to improve process efficiency. Proactively identify automation opportunities to reduce manual testing effort and cycle time. Documentation & Audit Readiness Maintain test documentation, validation reports, and evidence logs for internal and external audits. Support compliance reviews by ensuring full traceability from requirement → test case → result → release. Create and maintain QA dashboards and reporting templates for leadership visibility.   Demonstrate a commitment to diversity, equity, and inclusion through continuous development, modeling inclusive behaviors, and proactively managing bias. All other duties as assigned    

Frequently Asked Questions

What does the AI Systems Quality Specialist role at EVERSANA involve?

The AI Systems Quality Specialist position at EVERSANA in Overland Park, us is a full-time role. The AI Systems Quality Specialist will design, build, and oversee the quality assurance framework for EVERSANA’s AI Agency Platform. This role ensures that every feature, integration, and AI-driven process operates reliably and compliantly. The QA Automation Lead will establish automated testing frameworks covering functional, regression, and compliance scenarios, manage integration test suites across connected systems (Google Cloud, Veeva, SFMC, Aprimo), and collaborate closely with DevOps, Product, and AI teams to uphold quality benchmarks. The ideal candidate combines deep QA automation experience with an understanding of regulated environments and AI-enabled software systems.

What skills are required for AI Systems Quality Specialist at EVERSANA?

Key skills for this role include: Google Cloud, Jenkins, CI/CD, Github Actions, RDS, Snowflake, Data Pipeline, ETL, IOS, Git.

What is the salary for AI Systems Quality Specialist at EVERSANA?

The salary for this position is not publicly listed. You can negotiate during the interview process. Check Glassdoor or Levels.fyi for estimates.

Is the AI Systems Quality Specialist position at EVERSANA remote or on-site?

This position is On-site. The role is based in Overland Park, us.

How do I apply for AI Systems Quality Specialist at EVERSANA?

You can apply for this position directly through the employer's careers page. Click the 'Apply Now' button on this page to be redirected to the original listing. Make sure your resume is ATS-optimized. Use SpotChange's free ATS test to check.

Similar Jobs

Explore More

Get Hired Faster with SpotChange

AI resume analysis, ATS testing, interview prep, salary insights and more.

Open SpotChange Dashboard

About This Role

AI Systems Quality Specialist at EVERSANA is a full-time ai & machine learning position in Overland Park, us. Key skills include Google Cloud, Jenkins, CI/CD, Github Actions, RDS, Snowflake, Data Pipeline, ETL. Education: Master's Degree preferred. Experience: 3+ years.

This role is classified as on-site and is suitable for mid level-level professionals. Ghost Score 15/100 (Probably Active) indicates this listing is probably active with recent employer engagement.

To apply, visit the official application page through the Apply Now button above. SpotChange Jobs provides AI-powered career tools including resume optimization, ATS testing, interview preparation, and salary negotiation assistance.