OR · On-site
... contract standards. Deliver a Modern Lakehouse (Data Lake / Delta Lake) * Build and manage a ... Hands-on experience with Databricks * Experience in operating CI/CD pipelines for data workflows ...
OR · On-site
... contract standards. Deliver a Modern Lakehouse (Data Lake / Delta Lake) * Build and manage a ... Hands-on experience with Databricks * Experience in operating CI/CD pipelines for data workflows ...
OR · On-site
... contract standards. Deliver a Modern Lakehouse (Data Lake / Delta Lake) * Build and manage a ... Hands-on experience with Databricks * Experience in operating CI/CD pipelines for data workflows ...
OR · On-site
... contract standards. Deliver a Modern Lakehouse (Data Lake / Delta Lake) * Build and manage a ... Hands-on experience with Databricks * Hands-on experienceutilizingmodern DevOps practices ...
OR · On-site
... contract standards. Deliver a Modern Lakehouse (Data Lake / Delta Lake) * Build and manage a ... Hands-on experience with Databricks * Hands-on experienceutilizingmodern DevOps practices ...
Defining platform-level contracts that allow teams to move independently without breaking shared ... GCP, Databricks internals) into a coherent and reliable developer experience. * Provide clear ...
Defining platform-level contracts that allow teams to move independently without breaking shared ... GCP, Databricks internals) into a coherent and reliable developer experience. * Provide clear ...
... contract team, and enabling our data engineering teams to move fast with confidence. You will be a ... Managing the cloud budget (Snowflake/BigQuery/Databricks costs) and predicting how much compute ...
... contract team, and enabling our data engineering teams to move fast with confidence. You will be a ... Managing the cloud budget (Snowflake/BigQuery/Databricks costs) and predicting how much compute ...
Azure, AWS, GCP, Cloud Foundry Engineering Practices: CI/CD, automated testing, code reviews ... Define API contracts, versioning strategy, and error taxonomy to enable predictable integrations ...
Azure, AWS, GCP, Cloud Foundry Engineering Practices: CI/CD, automated testing, code reviews ... Define API contracts, versioning strategy, and error taxonomy to enable predictable integrations ...
Azure, AWS, GCP, Cloud Foundry Engineering Practices: CI/CD, automated testing, code reviews ... Define API contracts, versioning strategy, and error taxonomy to enable predictable integrations ...
Azure, AWS, GCP, Cloud Foundry Engineering Practices: CI/CD, automated testing, code reviews ... Define API contracts, versioning strategy, and error taxonomy to enable predictable integrations ...
Azure, AWS, GCP, Cloud Foundry Engineering Practices: CI/CD, automated testing, code reviews ... Define API contracts, versioning strategy, and error taxonomy to enable predictable integrations ...
Azure, AWS, GCP, Cloud Foundry Engineering Practices: CI/CD, automated testing, code reviews ... Define API contracts, versioning strategy, and error taxonomy to enable predictable integrations ...
S. citizens are authorized to access information under this program/contract. Security Clearance ... Experience with Snowflake/Databricks data engineering. * Knowledge of Visualization platforms such ...
S. citizens are authorized to access information under this program/contract. Security Clearance ... Experience with Snowflake/Databricks data engineering. * Knowledge of Visualization platforms such ...
... Annual Contract Value (ACV) of $1M+, specifically within heavily regulated industries where ... You excel at "Value Engineering." You can translate complex technical capabilities into business ...
... Annual Contract Value (ACV) of $1M+, specifically within heavily regulated industries where ... You excel at "Value Engineering." You can translate complex technical capabilities into business ...
... complex contracts, terms, and agreements (e.g., reseller, data sharing, workflow integration ... Collaborate intensively with internal product, engineering, sales, and customer success teams to ...
| Aspect | Contract Databricks Developer | Data Engineer |
|---|---|---|
| Primary Focus | Developing and optimizing data pipelines using Databricks platform | Designing, building, and maintaining scalable data architectures |
| Skills & Certifications | Proficiency in Spark, SQL, Python, Databricks platform, and cloud services | Knowledge of ETL processes, SQL, Python, cloud platforms, and data modeling |
| Work Environment | Project-based, often remote, with a focus on Databricks environments | Varies from in-house teams to consulting, working on large-scale data systems |
While both roles require expertise in data processing and cloud platforms, a Contract Databricks Developer specializes in building data solutions specifically within the Databricks environment, whereas a Data Engineer has a broader scope in designing and managing overall data infrastructure across various tools and platforms.
Full-time
Medical, Dental, Vision, Life, Retirement
Posted 24 days ago
7.5
Based on 26 frontline employees who took The Breakroom Quiz
38th of 57 rated business consultants
Job Family:
Data Science & Analysis
Travel Required:
Clearance Required:
We are seeking aData Infrastructure Engineerto build andoperatethe data platform that powersAI/ML analytics modules. You will design and implement scalabledata ingestion pipelines, robustETL/ELT, and a moderndata lake / delta lake (lakehouse)onAWS.You'llalsoestablishamanaged metadata repositoryand governance layers (catalog, lineage, quality, access controls) and deliverautomated cloud provisioningplusCI/CD for data pipelinesto enable reliable, repeatable deployments across environments.
This role is ideal for an engineer who enjoys platform building, automation, and enabling advanced analytics through trusted, well-governed data.
What You Will Do:
Build &OperateData Pipelines (Batch + Streaming)
Design and implementbatch and streaming ingestionfrom APIs, relational databases, file drops, event streams, and external partners.
Build andoptimizeETL/ELT pipelinesto produce curated, analytics-ready datasets for reporting and ML consumption.
Implement incremental processing patterns, change data capture (CDC) approaches whereappropriate, and data contract standards.
Deliver a Modern Lakehouse (Data Lake / Delta Lake)
Build and manage a scalablelakehouseon AWS object storage (e.g., S3) using open table/file formats and delta/lakehouseconcepts (e.g., ACID tables, schema evolution, time travel patterns).
Optimizeperformance and cost through partitioning, compaction, lifecycle policies, and efficient compute/storage usage.
Establish environment standards for dev/test/prod and consistent promotion across stages.
Metadata, Governance, Lineage & Quality (Trust Layer)
Implement amanaged metadata repositoryfor dataset cataloging, ownership, glossary/definitions, tagging, and discoverability.
Enableend-to-end lineage(source transformations consumption) to support auditability and impact analysis.
Implementgovernance controls including policy-based access, data classification, retention, and secure data handling.
Build operational data quality checks (freshness, completeness, validity, anomaly detection) and publish SLAs/SLOs.
AWS Automation + CI/CD for Data Pipelines
Implementautomated cloud provisioning in AWSusing Infrastructure as Code (IaC) for consistent environments and secure-by-default baselines.
Build and enhanceCI/CD for data pipelines, including automated tests, validation gates, promotion workflows, and rollback strategies.
Improve observability with metrics/logs/alerts, dashboards, runbooks, and incident response readiness.
Cross-Team Collaboration & Documentation
Work closely with engineering, security, networking, and application teams to support mission needs and delivery timelines.
Maintain high-quality engineering documentation includingSOPs, system diagrams, and secure configuration baselines.
Summarize and present findings and recommendations-both written and verbal-to technical and non-technical stakeholders.
What You Will Need:
Bachelor's degree in Engineering, IT, Computer Science, or related field (or equivalent experience).
Zero(0) to Two(2) Years of experience.
Experience building production data pipelines and/or data platforms.
Knowledge in implementingdata ingestionandETL/ELTworkflows, including data modeling and transformation best practices.
Knowledge in building adata lake / delta lake (lakehouse)on AWS (or equivalent cloud) using object storage and modern table formats/patterns.
ProficiencyinSQLand one programming language commonly used for data engineering (Python preferred; Scala/Java acceptable).
Knowledge withmetadata management and governance: cataloging, lineage, ownership, access controls,classificationand policy enforcement.
Knowledge in implementingautomated AWS provisioningusingIaCandoperatingacross multiple environments.
Proven experience developing RAG applications
Solid security fundamentals: IAM/least privilege, encryption,secretsmanagement, secure SDLC practices.
Must be able to OBTAIN and MAINTAIN a Federal or DoD "PUBLIC TRUST"; candidates must obtain approved adjudication of their PUBLIC TRUST prior to onboarding with Guidehouse. Candidates with an ACTIVE PUBLIC TRUST or SUITABILITY are preferred.
What Would Be Nice To Have:
Hands-on experience with Databricks
Experience in operatingCI/CD pipelinesfor data workflows (testing, packaging, deployment automation, environment promotion).
Hands-on experienceutilizingmodern DevOps practices, including tools likeGit, Terraform, Jenkins, AWSCodePipeline, and Docker.
ExperienceutilizingAI-assisted coding tools(e.g.,GitHub Copilot, ChatGPT, Cursor, Kiro) to safely accelerate implementation whilemaintainingstrict code quality throughtesting, code reviews, and security practices.
Knowledge graph and Graph RAGexperience, including:
Graph modeling and ontology/taxonomy alignment
Entity resolution and relationship extraction
Hybrid retrieval approaches combining graph traversal with semantic/vector search to improve grounding and explainability
What We Offer:
Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.
Benefits include:
Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Parental Leave
401(k) Retirement Plan
Group Term Life and Travel Assistance
Voluntary Life and AD&D Insurance
Health Savings Account, Health Care & Dependent Care Flexible Spending Accounts
Transit and Parking Commuter Benefits
Short-Term & Long-Term Disability
Tuition Reimbursement, Personal Development, Certifications & Learning Opportunities
Employee Referral Program
Corporate Sponsored Events & Community Outreach
Care.com annual membership
Employee Assistance Program
Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)
Position may be eligible for a discretionary variable incentive bonus
About Guidehouse
Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.
Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.
If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at RecruitingAccommodation@guidehouse.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.
All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or guidehouse@myworkday.com. Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse. Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.
If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse's Ethics Hotline. If you want to check the validity of correspondence you have received, please contact recruiting@guidehouse.com. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant's dealings with unauthorized third parties.
Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.
Get the full story on Breakroom
Sourced by ZipRecruiter
Business management consulting
10,000+ Employees
Falls Church, VA, US
2005