1

Azure Big Data Engineer Jobs in California (NOW HIRING)

Data Engineer

Los Angeles, CA · On-site +1

$123K - $148K/yr

Data Engineer Location: California - Remote Duration: 6+ Months Contract The Senior Data Engineer ... Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc. * Extensive experience in Big Data ...

Data Engineer

Bay Point, CA · On-site

$125K - $151K/yr

Experience with cloud platforms (Azure, AWS, or GCP), especially data services (e.g., S3, ADLS ... Strong understanding of data warehousing concepts, performance tuning, and big data processing ...

Job Role : Data Engineer

Fremont, CA · On-site

$125K - $151K/yr

Azure/AWS Cloud, Databricks, Azure HD Insights, ADF or similar • Advanced working SQL knowledge ... big data' data pipelines, architectures and data sets. • Strong analytic skills related to ...

Big Data Developer

Glendale, CA

$56.25 - $72.75/hr

Skill Big Data Developer Java Hadoop DaaS Java Hadoop / Hive / MapReduce / Pig / Sqoop / Flume SQL XML JSO Location Glendale, CA Total Experience 3 yrs. Max Salary Not Mentioned Employment Type ...

Data Engineer

San Jose, CA · On-site

$134K - $161K/yr

This role combines hands-on data engineering with cloud data architecture, focusing on scalable ... Azure Databricks, Azure Data Lake, and cloud-native data services. Experience with big data ...

Big Data

Sunnyvale, CA

$62.25 - $80.75/hr

Must have strong programming knowledge of Core Java or Scala - Objects & Classes, Data Types ... Must have experience working on Big Data Processing Frameworks and Tools - MapReduce, YARN, Hive ...

Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to join our technology innovation group focused on the rapid development of AI driven ...

Sr. Data Engineer

San Francisco, CA · On-site +1

$60 - $96/hr

Skills * 8+ years of experience in data engineering with a strong big data background. * Hands-on experience with Databricks and Azure Data Factory. * Experience with DevOps tools and practices ...

Big Data Developer

Los Angeles, CA

$57 - $74/hr

Company Description Intelliswift Software, Inc Big Data & Java experience is mandatory Experience in Big Data Tech stack - Mapr, Hive, PIG is mandatory Must have Data Management experience in large ...

Data Engineer

Aliso Viejo, CA · On-site

$50 - $55/hr

Big Data Technologies (Apache Spark, Hadoop Ecosystem, Kafka). * DevOps & CI/CD (Git, Jenkins/Azure DevOps). Education and Experience: * Bachelor's or Master's degree in Computer Science, Information ...

Data Engineer

Aliso Viejo, CA · On-site

$50 - $55/hr

Big Data Technologies (Apache Spark, Hadoop Ecosystem, Kafka). DevOps & CI/CD (Git, Jenkins/Azure DevOps). Education and Experience: Bachelor's or Master's degree in Computer Science, Information ...

Showing results 21-40

Azure Big Data Engineer information

What does an Azure Big data engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big data engineer?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure big data engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.
What job categories do people searching Azure Big Data Engineer jobs in California look for? The top searched job categories for Azure Big Data Engineer jobs in California are:
What cities in California are hiring for Azure Big Data Engineer jobs? Cities in California with the most Azure Big Data Engineer job openings:
Infographic showing various Azure Big Data Engineer job openings in California as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 12% Part Time, 2% Temporary, and 3% Contract. Highlights an 86% Physical, 4% Hybrid, and 10% Remote job distribution.

Data Engineer

Lorven Technologies

Los Angeles, CA • On-site, Remote

$123K - $148K/yr

Contractor

Re-posted 6 days ago


Job description

Job Title: Data Engineer
Location: California - Remote
Duration: 6+ Months Contract
Job Description:
The Senior Data Engineer is responsible for designing, building, and managing the data platform and tools to allow for the efficient processing and analysis of large data sets. Develops and maintains scalable data pipelines, ensures data quality, and deploys machine learning models to production. Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization. Builds real-time and batch pipelines to handle large volumes of data efficiently. Collaborates with cross-functional teams and translate business requirements into scalable data solutions.
Responsibilities:
  • Design, develop, and maintain real-time or batch data pipelines to process and analyze large volumes of data. Designs and develops programs and tools to support ingestion, curation, and provisioning of complex first party and third-party data to achieve analytics, reporting, and data science. Design and develop Advanced Data Products and Intelligent API's. Monitors the system performance by performing regular tests, troubleshoots, and integrates new features.
  • Lead in analysis of data and the design the data architecture to support BI, AI/ML and data products.
  • Designs and implements data platform architecture to meet organization analytical requirements. Ensures the solution designs address operational requirements such as scalability, maintainability, extensibility, flexibility, and integrity.
  • Provide technical leadership and mentorship to team members. Leads peer development and code reviews with focus on test driven development and Continuous Integration and Continuous Development (CICD).

Requirements:
  • Bachelor's degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field required.
  • Master's degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field preferred.
  • Minimum of eight (8) years of experience as a data engineer with full-stack capabilities
  • Minimum of ten (10) years of Experience in programming
  • Minimum of five (5) years in Cloud technologies like Azure, Aws or Google.
  • Strong SQL Knowledge
  • Experience in ML and ML Pipeline a plus
  • Experience in real-time integration, developing intelligent apps and data products.
  • Proficiency in Python and experience with CI/CD practices
  • Strong background in IAAS platforms and infrastructure
  • Hands-on experience with Databricks, Spark, Fabric, or similar technologies
  • Experience in Agile methodologies
  • Hands-on experience in the design and development of data pipelines and data products
  • Experience in developing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
  • Hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
  • Extensive experience in Big Data technologies such as Apache Spark and streaming technologies such as Kafka, EventHub, etc.
  • Extensive experience in designing data applications in a cloud environment.
  • Intermediate experience in RESTful APIs, messaging systems, and AWS or Microsoft Azure.
  • Extensive experience in Data Architecture and data modeling
  • Expert in data analysis and data quality frameworks.
  • Knowledgeable with BI tools such as Power BI and Tableau.
  • May occasionally work evenings and/or weekends.

Lorven technologies logo

About Lorven technologies

Sourced by ZipRecruiter

Lorven Technologies, headquartered in Plainsboro, New Jersey, United States, is a reputable company in the technology industry, specializing in providing effective IT solutions and consulting services. The company's official website, lorventech.com, offers comprehensive insights into its offerings which include but are not limited to software development, IT consulting, project management, and business analysis. Since its inception, Lorven Technologies has been committed to ensuring efficiency and reliability in delivering IT services to its global clientele, establishing itself as a trusted name in the industry.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

2001

Social media