1

Great Expectations Jobs (NOW HIRING)

Lead Data QA

Philadelphia, PA

$130K/yr

Utilize Great Expectations for reusable validation suites integrated into CI/CD workflows. Embed automated schema validation, reconciliation logic, and drift detection into data pipeline operations.

Sr. Data Quality Engineer

Chicago, IL · On-site

$118K - $141K/yr

Exposure to Monte Carlo, Great Expectations, Deequ * Real-time validation in streaming pipelines * Regulatory reporting knowledge * Cloud/Databricks certifications Technical Skills * Databricks ...

Data Engineer

Suitland, MD

$123K - $148K/yr

Monitor data pipeline health, troubleshoot issues, and ensure data consistency using tools such as Amazon CloudWatch, Datadog, or Great Expectations. * Collaboration & Documentation : Work closely ...

$81K - $111K/yr

Lead the implementation and operationalization of GX Core (Great Expectations) or similar data validation solutions. * Develop reusable data quality rules using a Rule-as-Code approach. * Build ...

New

next page

Showing results 1-20

Great Expectations information

What are some common challenges faced by a Data Engineer working with Great Expectations for data validation?

Data Engineers implementing Great Expectations often encounter challenges such as integrating the tool seamlessly into existing data pipelines, managing and maintaining a growing suite of validation tests, and ensuring that validation results are communicated effectively to stakeholders. Additionally, keeping the expectations up-to-date as data schemas evolve can require close collaboration with data analysts and business users. However, overcoming these challenges leads to more reliable data and a stronger data quality culture within the team.

What is the difference between Great Expectations vs Data Analyst?

AspectGreat ExpectationsData Analyst
Required CredentialsPython, data validation, testing frameworksStatistics, data analysis, Excel, SQL
Work EnvironmentData engineering teams, data pipelinesBusiness units, reporting teams
Industry UsageData quality, data validationData interpretation, reporting

Great Expectations focuses on data validation and quality assurance within data pipelines, often used by data engineers. Data Analysts interpret data and generate reports, requiring skills in statistics and visualization. While both roles work with data, Great Expectations is more technical and validation-oriented, whereas Data Analysts focus on insights and business intelligence.

What are Great Expectations in the context of data engineering?

Great Expectations is an open-source Python-based data validation framework used to help data teams ensure data quality and reliability. It allows users to define, execute, and document data tests, known as 'expectations', which validate whether data meets specific criteria. Great Expectations integrates with various data sources and pipelines, providing automated documentation and clear visibility into data quality issues. It's widely used in data engineering and analytics workflows to prevent data-related errors and to build trust in data assets.
More about Great Expectations jobs
What cities are hiring for Great Expectations jobs? Cities with the most Great Expectations job openings:
What job categories do people searching Great Expectations jobs look for? The top searched job categories for Great Expectations jobs are:
Infographic showing various Great Expectations job openings in the United States as of July 2026, with employment types broken down into 1% As Needed, 81% Full Time, 15% Part Time, and 3% Contract. Highlights an 94% Physical, 2% Hybrid, and 4% Remote job distribution.
Staff MLOps Engineer - ML Platform

Staff MLOps Engineer - ML Platform

BrightAI

Palo Alto, CA • On-site

Full-time

Posted 4 days ago


Job description

Job Summary:
BrightAI is a high-growth Physical AI company transforming how infrastructure businesses interact with the physical world through intelligent automation. They are seeking a Staff MLOps Engineer to lead the build-out of their cloud-native ML developer platform and production pipelines, focusing on designing scalable data/model workflows and CI/CD for ML.
Responsibilities:
• Design, build, and operate our ML/AI development platform on AWS—including Amazon SageMaker AI (Studio/Notebooks, Training/Processing/Batch Transform, Real-Time & Async Inference, Pipelines, Feature Store) and supporting services.
• Establish golden-path project templates, base Docker images, and internal Python libraries to standardize experiments, data processing, training, and deployment workflows.
• Implement Infrastructure-as-Code (e.g., Terraform) and workflow orchestration (Step Functions, Airflow); optionally support EKS for training/inference.
• Build automated data pipelines with S3, Glue, EMR/Spark (PySpark), Athena/Redshift; add data quality (Great Expectations/Deequ) and lineage.
• Stand up experiment tracking and a model registry (SageMaker Experiments & Model Registry or MLflow); enforce versioning for data, code, and models.
• Implement CI/CD for ML (CodeBuild/CodePipeline or GitHub Actions): unit/integration tests, data contracts, model tests, canary/shadow deployments, and safe rollback.
• Ship real-time endpoints (SageMaker endpoints/FastAPI on Lambda/ECS/EKS) and batch jobs; set SLOs and autoscaling, and optimize for cost/performance.
• Build monitoring & observability for production models and services (drift, performance, bias with SageMaker Model Monitor; service telemetry with CloudWatch/Prometheus/Grafana).
• Enforce security & governance: least-privilege IAM, VPC isolation/PrivateLink, encryption, secret management.
• Partner with backend engineers to productionize notebooks and prototypes.
• Help integrate GenAI/Bedrock services where appropriate; support RAG pipelines with vector stores (OpenSearch) and evaluation harnesses.
Qualifications:
Required:
• B.S. or M.S. in Computer Science, Electrical/Computer Engineering, or related field; advanced degree a plus.
• 8+ years in software/ML engineering, including 4+ years in MLOps or in a similar role.
• Strong programming skills (proficient in Python), fluent with Docker and Terraform or AWS CDK.
• Hands-on with AWS: SageMaker, S3, IAM, CloudWatch, ECR, and ECS/EKS/Lambda.
• Built and operated CI/CD for ML (tests for code/data/models; automated deploys) and shipped real-time & batch ML workloads to production.
• Experience with experiment tracking & model registry (e.g., SageMaker Experiments/Model Registry or MLflow) and data versioning.
• Implemented monitoring & quality (SageMaker Model Monitor, EvidentlyAI, Great Expectations/Deequ) and created on-call/runbooks for model & service incidents.
• Solid grasp of security & compliance in cloud ML (IAM policy design, VPC/private networking, KMS encryption, secrets management, audit logging).
Preferred:
• Distributed training at scale (SageMaker Training, PyTorch DDP, Hugging Face on SageMaker).
• Data engineering at scale (e.g., Spark/EMR, Glue, Redshift).
• Observability stacks (e.g., Grafana), performance tuning, and capacity planning for ML services.
• LLMOps/RAG (Bedrock, vector databases, evals) as optional capabilities.
• Prior startup experience building ML platforms and products from the ground up.
Company:
BrightAI provides physical AI solutions for infrastructure and services. Founded in 2020, the company is headquartered in Palo Alto, USA, with a team of 51-200 employees. The company is currently Growth Stage.

BrightAI logo

About BrightAI

Sourced by ZipRecruiter

Industry

Software development

Company size

11 - 50 Employees

Headquarters location

San Francisco, CA, US

Year founded

2019