Full Time Remote Qa Engineer Jobs in Atlanta, GA

We're seeking an innovative QA Engineer to join our team. This role goes beyond traditional testing - you'll be at the forefront of using automation frameworks and AI-powered tools to ensure the quality, reliability, and performance of our AI solutions. You'll work closely with AI Integration engineers and software developers to build robust testing strategies that handle the unique challenges of AI systems, including model validation, data quality, and non-deterministic outputs.Key ResponsibilitiesTest Automation DevelopmentDesign, develop, and maintain automated test frameworks using Python and modern testing toolsBuild end-to-end test suites for APIs, data pipelines, and AI model/MCP endpointsImplement continuous testing practices integrated with CI/CD pipelinesCreate reusable test libraries and utilities to accelerate testing across projectsAI-Assisted TestingLeverage AI tools (like GitHub Copilot, ChatGPT, or dedicated test generation tools) to accelerate test case creation and code reviewsExplore and implement AI-powered testing solutions for test data generation, visual testing, and anomaly detectionExperiment with automated test scenario generation using LLMsUse AI tools for log analysis and defect pattern recognitionAI-Specific TestingDevelop testing strategies for LLMs including performance, accuracy, and bias detectionTest data quality, feature engineering pipelines, and model training workflowsValidate model output and monitor for model drift in productionCreate test datasets that cover edge cases and ensure model robustness Quality Strategy & CollaborationDefine and implement QA best practices and quality metrics for AI productsCollaborate with developers to identify testability requirements early in the development cyclePerform code reviews focused on test coverage and qualityDocument test strategies, test cases, and quality reportsPerformance & Security TestingConduct load and performance testing for AI inference endpointsIdentify bottlenecks in data processing and model serving infrastructureParticipate in security testing activities focusing on data privacy and model securityRequired QualificationsEducation & ExperienceBachelor's degree in Computer Science, Engineering, or related field3-5 years of experience in software quality assurance and test automationProven experience building and maintaining automation frameworks from scratchExperience testing cloud-based applications and APIsExperience testing machine learning models, agentic data flows and data-intensive applicationsTechnical SkillsStrong proficiency in Python for test automationHands-on experience with testing frameworks: pytest, unittest, Selenium, or similarExperience with API testing tools: Postman, REST Assured, or Python requestsKnowledge of CI/CD tools: GitLab CI, GitHub ActionsFamiliarity with version control systems (Git)Understanding of SQL and database testing (incl. Data Lake architectures)Experience with containerization (Docker) and orchestration toolsExperience with AI-powered testing tools or test generation platformsExperience with cloud platforms: AWS, Azure, or GCPUnderstanding of microservices architecture and distributed systemsExperience with workflow orchestration tools (Airflow, Temporal, Prefect, n8n)Experience mentoring junior QA engineersWhat You'll Work With:Languages: Python, SQL, JavaScript/TypeScript, YAML Data Tools: Airflow, dbt, Spark, Polars, pyArrow APIs & Integration: FastAPI, GraphQL, Kafka, Redis, Javascript/Typescript, WASM AI/ML: OpenAI API, Pydantic AI, Anthropic Claude, LangChain, vector databases, MCP protocol Cloud: AWS (Lambda, S3, RDS, Bedrock, SageMaker) or equivalent in GCP/Azure Infrastructure: Docker, Kubernetes, Terraform, GitHub ActionAs part of our commitment to quality and excellence, Medlytix will continue to maintain a safe and healthy environment for you by requiring all applicants to submit to a criminal history check and those tentatively selected for a position to submit to screening for illegal drug use prior to appointment for a job. In addition, applicants may be screened for ability to perform essential functions of some positions.