Remote Azure Data Engineer Jobs in Houston, TX (NOW HIRING)

Looking for local candidate

In office 4 days; work from home 1 day (option) 

JOB SUMMARY: The Senior Data Engineer / Data Architect is responsible for designing, building, and governing the enterprise data platform on Azure Databricks. This role owns both hands-on data engineering delivery and data architecture design, ensuring that enterprise data is reliable, scalable, secure, and ready to support analytics, reporting, and AI initiatives.

The position plays a critical role in transforming data from ERP, CRM, and other enterprise systems into trusted, reusable data products that enable business insights and future AI capabilities. The role operates with high ownership across the full lifecycle, from ingestion and transformation to data modeling, governance, and platform optimization, aligned with a modern Lakehouse architecture.

ESSENTIAL FUNCTIONS, ROLES AND RESPONSIBILITIES: Essential duties and responsibilities include the following:

1. Data Engineering & Pipeline Development
   1. Design and build end-to-end data pipelines (batch and near real-time) using Databricks and Spark
   2. Implement and maintain Bronze / Silver / Gold data architecture layers
   3. Ingest data from ERP, SaaS applications, APIs, and legacy systems into Lakehouse
   4. Optimize pipelines for performance, scalability, and cost efficiency
   5. Implement CI/CD pipelines using GitHub
2. Data Architecture & Modeling
   1. Define and maintain the enterprise data architecture and standards
   2. Design logical and physical data models across core business domains (finance, operations, field service)
   3. Establish consistent definitions for critical entities (customer, job, revenue, etc.)
   4. Ensure data structures support both analytics and AI/ML workloads
3. Data Governance, Security & Quality
   1. Implement and manage Unity Catalog–based governance (RBAC, lineage, auditability)
   2. Define and enforce data standards for naming, access control, and data quality
   3. Ensure compliance with security policies (e.g., sensitive HR and financial data protection)
   4. Establish monitoring, validation, and reconciliation processes to ensure data accuracy and reliability
4. Platform & Integration Design
   1. Define scalable patterns for:
      1. Data ingestion
      2. Transformation pipelines
      3. Data access (BI tools, APIs, AI models)
   2. Integrate Databricks with Azure services (ADLS, APIs, enterprise systems)
   3. Ensure platform reliability, observability, and operational excellence
5. AI & Advanced Analytics Enablement
   1. Prepare and structure data for AI/ML use cases and automation initiatives
   2. Partner with analytics and AI teams to deliver datasets supporting predictive models and AI-driven workflows
   3. Enable reusable datasets and feature-ready data pipelines
6. Collaboration & Leadership
   1. Partner with business stakeholders, application teams, and analytics teams to translate requirements into scalable solutions
   2. Provide technical leadership for data engineering best practices and architecture decisions
   3. Mentor junior engineers or contractors as the platform scales

EDUCATION, TRAINING, EXPERIENCE:

Experience

• 6–10+ years of experience in data engineering, data architecture, or enterprise data platforms
• Hands-on experience building and supporting data pipelines in cloud environments
• Experience working with enterprise systems (ERP, CRM, or similar)

Technical Skills

Strong expertise in:

• Azure Databricks / Apache Spark
• Python / PySpark
• SQL (advanced)

Experience with:

• Azure Data Lake Storage (ADLS)
• CI/CD with Github
• API and data integration patterns

Strong understanding of:

• Data modeling (dimensional and normalized)
• Data governance and security (RBAC, lineage)

Preferred Qualifications

• Experience with Delta Lake and Lakehouse architecture
• Exposure to ML/AI pipelines or data science workflows
• Experience in manufacturing, oil & gas, or ERP-heavy environments

CERTIFICATIONS, LICENSES, REGISTRATIONS:

• None required

JOB KNOWLEDGE, SKILLS, ABILITIES:

• Familiarity with modern programming languages and frameworks (C#, .NET, SQL, JavaScript).
• Experience with DevOps, CI/CD, and source control for ERP development.
• Knowledge of cloud-based ERP solutions and migration strategies.
• Strong background in data integration, ETL, and reporting tools (Power BI, SSRS, Tableau).

SUPERVISORY RESPONSIBILITIES: NONE

• Occasionally may be exposed to hazards such as loud noise, heavy equipment, temperature extremes, toxic or caustic chemicals; risk of electrical shock.
• The noise level in the work environment is usually moderate.

Disclaimer: This job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities required of the employee for this position. Duties, responsibilities, and activities may change at any time with or without notice.

Cactus Companies is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, veteran status, genetic information, or any other characteristic protected by law.

Safety is our top priority. All employees must comply with our comprehensive safety programs, participate in required safety training, and demonstrate commitment to our safety-first culture. This position may require working in potentially hazardous environments if you are traveling to a branch or plant location. Ensure that you follow all safety guidelines that are required when working in the field, branch or manufacturing facility.

This position generally operates in a professional office environment. The role routinely uses standard office equipment such as computers, phones, photocopiers, and filing cabinets. While performing the duties of this job, the employee is regularly required to:

• Sit for extended periods at a desk and work on a computer
• Use hands to finger, handle, or feel objects, tools, or controls
• Reach with hands and arms
• Talk and hear
• Occasionally lift and/or move up to 25 pounds
• Walk or stand periodically throughout the day
• Maintain sustained concentration on computer screens
• Work under deadlines with frequent interruptions

The noise level in the work environment is usually moderate. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Cactus Companies maintains a drug-free workplace and participates in E-Verify.