Lead Data Engineer
Greenfield, IN · On-site
... contract/ FTE • 10-15 years 4+ years of experience in Azure Databricks with PySpark. 2+ years of ... Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform)
Lead Data Engineer
Greenfield, IN · On-site
... contract/ FTE • 10-15 years 4+ years of experience in Azure Databricks with PySpark. 2+ years of ... Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform)
... • Azure Databricks (SQL-based data engineering) • Teradata • SAP Datasphere (working ... Roles & Responsibilities Seeking a contract Technical Lead to deliver SAP S/4HANA data integration ...
New
... • Azure Databricks (SQL-based data engineering) • Teradata • SAP Datasphere (working ... Roles & Responsibilities Seeking a contract Technical Lead to deliver SAP S/4HANA data integration ...
New
Lead Platform Data Engineer
Carmel, IN · On-site
Architect cross-application data models and Data Contracts (OpenAPI/AsyncAPI) to standardize ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:
Lead Platform Data Engineer
Carmel, IN · On-site
Architect cross-application data models and Data Contracts (OpenAPI/AsyncAPI) to standardize ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:
Architect cross-application data models and Data Contracts (OpenAPI/AsyncAPI) to standardize ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:
Architect cross-application data models and Data Contracts (OpenAPI/AsyncAPI) to standardize ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:
Lead Platform Data Engineer
Carmel, IN · On-site
Architect cross-application data models and Data Contracts (OpenAPI/AsyncAPI) to standardize ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:
Lead Platform Data Engineer
Carmel, IN · On-site
Architect cross-application data models and Data Contracts (OpenAPI/AsyncAPI) to standardize ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:
Senior Manager Data Architecture
Columbus, IN · On-site
$62.50 - $83.75/hr
Join our Global Data Engineering, Architecture and Enablement team and help build the foundation ... Databricks. This role requires a blend of hands-on technical expertise, leadership skills, and the ...
Senior Manager Data Architecture
Columbus, IN · On-site
$62.50 - $83.75/hr
Join our Global Data Engineering, Architecture and Enablement team and help build the foundation ... Databricks. This role requires a blend of hands-on technical expertise, leadership skills, and the ...
Mentor engineers and cross-functional teams through coaching and knowledge sharing * Establish ... Hands-on experience with platforms such as AWS SageMaker, Azure ML, Vertex AI, Databricks, or ...
Mentor engineers and cross-functional teams through coaching and knowledge sharing * Establish ... Hands-on experience with platforms such as AWS SageMaker, Azure ML, Vertex AI, Databricks, or ...
Contract Databricks Developer information
What is a Contract Databricks Developer?
A Contract Databricks Developer is a data engineering professional hired on a temporary or project basis to develop, optimize, and maintain data pipelines and analytics solutions using the Databricks platform. They work with cloud data technologies, Spark, and big data frameworks to support organizations in managing large-scale data processing and analytics tasks. Their responsibilities often include building ETL workflows, collaborating with data scientists, and ensuring data quality and performance in data-driven projects.
What are some common challenges faced by Contract Databricks Developers when starting a new project?
As a Contract Databricks Developer joining a new project, you may encounter challenges such as quickly understanding the existing data architecture, adapting to the client's specific workflow, and ensuring seamless integration with their cloud infrastructure (often Azure or AWS). You’ll also need to align with established data governance and security protocols while collaborating with data engineers, analysts, and business stakeholders. Effective communication and proactive documentation are key to overcoming these hurdles and delivering value efficiently within the contract period.
What is the difference between Contract Databricks Developer vs Data Engineer?
| Aspect | Contract Databricks Developer | Data Engineer |
|---|---|---|
| Primary Focus | Developing and optimizing data pipelines using Databricks platform | Designing, building, and maintaining scalable data architectures |
| Skills & Certifications | Proficiency in Spark, SQL, Python, Databricks platform, and cloud services | Knowledge of ETL processes, SQL, Python, cloud platforms, and data modeling |
| Work Environment | Project-based, often remote, with a focus on Databricks environments | Varies from in-house teams to consulting, working on large-scale data systems |
While both roles require expertise in data processing and cloud platforms, a Contract Databricks Developer specializes in building data solutions specifically within the Databricks environment, whereas a Data Engineer has a broader scope in designing and managing overall data infrastructure across various tools and platforms.
What are the key skills and qualifications needed to thrive as a Contract Databricks Developer, and why are they important?
To excel as a Contract Databricks Developer, you need strong expertise in data engineering, big data analytics, and proficiency in programming languages like Python or Scala, typically backed by relevant experience or a degree in computer science. Familiarity with Databricks, Apache Spark, cloud platforms (such as Azure or AWS), and certifications like Databricks Certified Associate Developer are commonly required. Excellent problem-solving, adaptability, and communication skills help you collaborate with clients and teams to deliver tailored data solutions. These competencies are crucial for building scalable data pipelines and efficiently managing large datasets in dynamic project environments.
What are the most commonly searched types of Databricks Developer jobs in Indiana? The most popular types of Databricks Developer jobs in Indiana are:
What are popular job titles related to Contract Databricks Developer jobs in Indiana? For Contract Databricks Developer jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Contract Databricks Developer jobs in Indiana look for? The top searched job categories for Contract Databricks Developer jobs in Indiana are:
Job description
Job Title: Lead Data Engineer
Location: Greenfield, IN (Onsite)
Duration: Long term contract/ FTE
•10-15 years
4+ years of experience in Azure Databricks with PySpark.
2+ years of experience in Databricks workflow & Unity catalog.
3+ years of experience in ADF (Azure Data Factory).
3+ years of experience in ADLS Gen 2.
3+ years of experience in Azure SQL.
5+ years of experience in Azure Cloud platform.
2+ years of experience in Python programming & package builds.
Key technical skills :
Data management experience handling Analytics workload covering design, development, and maintainenance of lakehouse solutions sourcing data from platforms such as ERP sources, API sources, Relational stores, NoSQL and on-prem sources using Databricks/PySpark as distributed /big data management service,supporting batch and near-real-time ingestion, transformation, and processing.
Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs.Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning.Familiarity with Databricks runtime versions, cluster policies, libraries, and workspace management.
Skilled in governing and manage data access for Azure Data lakehouse with Unity Catalog. Experience in configuring data permissions, object lineage, and access policies with Unity Catalog.Understanding of integrating Unity Catalog with Azure AD, external metastores, and audit trails.
Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows.Ability to design modular, reusable workflows using tasks, triggers, and dependencies.Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers.
Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.
Strong experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2. Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization.
Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL.
Comprehensive experience working across the Azure ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads.Understanding of VNets, Private Endpoints, Key Vaults, Managed Identities, and Azure Monitor.Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform).
Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components.Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries.Ability to write unit tests using PyTest/unittest and integrate with CI/CD pipelines.
Lead solution design discussions, mentor junior engineers, and ensure adherence to coding guidelines, design patterns, and peer review processes.Able to prepare Design documents for development and guiding the team technically. Experience preparing technical design documents, HLD/LLDs, and architecture diagrams.Familiarity with code quality tools (e.g., SonarQube, pylint), and version control workflows (Git).
Demonstrates strong verbal and written communication, proactive stakeholder engagement, and a collaborative attitude in cross-functional teams.Ability to articulate technical concepts clearly to both technical and business audiences.Experience in working with product owners, QA, and business analysts to translate requirements into deliverables.
Communication Skills:
Communicate effectively with internal and customer stakeholders
Communication approach: verbal, emails and instant messages
Interpersonal Skills:
Strong interpersonal skills to build and maintain productive relationships with team members
Provide constructive feedback during code reviews and be open to receiving feedback on your own code.
Problem-Solving and Analytical Thinking:
Capability to troubleshoot and resolve issues efficiently.
Analytical mindset.
Task/ Work Updates
Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps.
Provides regular updates, proactive and due diligent to carry out responsibilities.
We are seeking a highly skilled Data Engineering specialist with above mentioned mentioned Primary Skills to join our dynamic team who are at the forefront of enabling enterprises in Healthcare sectors.
The ideal candidate should be passionate about working on Data Engineering on Azure cloud with strong focus on DevOps practices in building product for our customers.
Effectively Communicate and Collaborate with internal teams and customer to build code leveraging or building low level design documents aligning to standard coding principles and guidelines.
Good to have Azure Entra/AD skills and GitHub Actions.
Good to have orchestration experience using Airflow, Dagster, LogicApp.
Good to have expereince working on event-driven architectures using Kafka, Azure Event Hub.
Good to have exposure on Google Cloud Pub/Sub.
Good to have experience developing and maintaining Change Data Capture (CDC) solutions preferrably using Debezium.
Good to have hands-on experience on data migration projects specifically involving Azure Synapse and Databricks Lakehouse.
Good to have eperienced in managing cloud storage solutions on Azure Data Lake Storage . Experience with Google Cloud Storage will be an advantage.
Location: Greenfield, IN (Onsite)
Duration: Long term contract/ FTE
•10-15 years
4+ years of experience in Azure Databricks with PySpark.
2+ years of experience in Databricks workflow & Unity catalog.
3+ years of experience in ADF (Azure Data Factory).
3+ years of experience in ADLS Gen 2.
3+ years of experience in Azure SQL.
5+ years of experience in Azure Cloud platform.
2+ years of experience in Python programming & package builds.
Key technical skills :
Data management experience handling Analytics workload covering design, development, and maintainenance of lakehouse solutions sourcing data from platforms such as ERP sources, API sources, Relational stores, NoSQL and on-prem sources using Databricks/PySpark as distributed /big data management service,supporting batch and near-real-time ingestion, transformation, and processing.
Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs.Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning.Familiarity with Databricks runtime versions, cluster policies, libraries, and workspace management.
Skilled in governing and manage data access for Azure Data lakehouse with Unity Catalog. Experience in configuring data permissions, object lineage, and access policies with Unity Catalog.Understanding of integrating Unity Catalog with Azure AD, external metastores, and audit trails.
Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows.Ability to design modular, reusable workflows using tasks, triggers, and dependencies.Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers.
Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.
Strong experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2. Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization.
Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL.
Comprehensive experience working across the Azure ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads.Understanding of VNets, Private Endpoints, Key Vaults, Managed Identities, and Azure Monitor.Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform).
Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components.Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries.Ability to write unit tests using PyTest/unittest and integrate with CI/CD pipelines.
Lead solution design discussions, mentor junior engineers, and ensure adherence to coding guidelines, design patterns, and peer review processes.Able to prepare Design documents for development and guiding the team technically. Experience preparing technical design documents, HLD/LLDs, and architecture diagrams.Familiarity with code quality tools (e.g., SonarQube, pylint), and version control workflows (Git).
Demonstrates strong verbal and written communication, proactive stakeholder engagement, and a collaborative attitude in cross-functional teams.Ability to articulate technical concepts clearly to both technical and business audiences.Experience in working with product owners, QA, and business analysts to translate requirements into deliverables.
Communication Skills:
Communicate effectively with internal and customer stakeholders
Communication approach: verbal, emails and instant messages
Interpersonal Skills:
Strong interpersonal skills to build and maintain productive relationships with team members
Provide constructive feedback during code reviews and be open to receiving feedback on your own code.
Problem-Solving and Analytical Thinking:
Capability to troubleshoot and resolve issues efficiently.
Analytical mindset.
Task/ Work Updates
Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps.
Provides regular updates, proactive and due diligent to carry out responsibilities.
We are seeking a highly skilled Data Engineering specialist with above mentioned mentioned Primary Skills to join our dynamic team who are at the forefront of enabling enterprises in Healthcare sectors.
The ideal candidate should be passionate about working on Data Engineering on Azure cloud with strong focus on DevOps practices in building product for our customers.
Effectively Communicate and Collaborate with internal teams and customer to build code leveraging or building low level design documents aligning to standard coding principles and guidelines.
Good to have Azure Entra/AD skills and GitHub Actions.
Good to have orchestration experience using Airflow, Dagster, LogicApp.
Good to have expereince working on event-driven architectures using Kafka, Azure Event Hub.
Good to have exposure on Google Cloud Pub/Sub.
Good to have experience developing and maintaining Change Data Capture (CDC) solutions preferrably using Debezium.
Good to have hands-on experience on data migration projects specifically involving Azure Synapse and Databricks Lakehouse.
Good to have eperienced in managing cloud storage solutions on Azure Data Lake Storage . Experience with Google Cloud Storage will be an advantage.
About Exaways
Sourced by ZipRecruiter
Company size
11 - 50 Employees
Headquarters location
Santa Clara, CA, US
Year founded
2015