ZipRecruiter

Log In

2

Remote Azure Databricks Jobs in Massachusetts (NOW HIRING)

Lorven Technologies

Data Engineer with AI - Remote

Boston, MA · On-site +1

$124K - $149K/yr

CI/CD (GitHub/GitLab/Azure DevOps), testing (pytest), and observability (logs/metrics). Nice to have * Databricks Delta Live Tables , Unity Catalog automation, Model Serving. * Orchestration (Airflow ...

Kemper

Data Scientist

Boston, MA · On-site +1

Exposure to cloud platforms such as AWS, Azure, Databricks, or similar environments. * Exposure to ... Remote options are available for non-local candidate. * The range for this position is $93,300 to ...

Ironside Group

Senior Database Engineer

Lexington, MA · On-site +1

$118K - $161K/yr

... and Databricks for data storage, processing, and analytics use cases * 3+ years of practical ... Experience working with Azure Synapse / Data Factory is a plus * Subject matter expertise in ...

Adidev Technologies Inc

ML/AI Engineers

Boston, MA · Remote

... such as AWS, Databricks, Azure, Google Cloud and OpenAI. Software engineering and/or Data ... Support, even from afar, with our remote assistance. Regular salary reviews? You betcha! Ready to ...

Gradient AI

Senior Data Scientist

Boston, MA · On-site +1

$140K/yr

This is a fully remote opportunity with hybrid available to those local to Boston. Gradient AI ... Familiarity with SQL, Relational databases, and cloud environments like AWS/Azure/Google/Databricks

All JobsAzure Databricks JobsRemote Azure Databricks JobsRemote Azure Databricks Jobs in Massachusetts

Remote Azure Databricks information

What is a remote Azure Databricks?

Remote Azure Databricks jobs are positions where professionals use Azure Databricks—a cloud-based analytics platform optimized for big data and machine learning—while working from a remote location. These roles typically involve tasks like building data pipelines, analyzing large datasets, developing and deploying machine learning models, and collaborating with teams virtually. Remote Azure Databricks professionals need strong skills in Spark, Python or Scala, and a good understanding of cloud computing. They often work as data engineers, data scientists, or analytics specialists, leveraging the platform’s capabilities to deliver data-driven insights for organizations.

What is the difference between Remote Azure Databricks vs Remote Data Engineer?

AspectRemote Azure DatabricksRemote Data Engineer
Required CredentialsAzure certifications, Spark/Databricks knowledgeData engineering certifications, SQL, cloud platform skills
Work EnvironmentCloud-based, collaborative platform for data analyticsData pipelines, database management, cloud environments
Industry UsageData analytics, AI, machine learning projectsData pipeline development, ETL processes

Remote Azure Databricks specialists focus on leveraging the Databricks platform for data analytics and machine learning, often working within cloud environments. Remote Data Engineers build and maintain data pipelines and infrastructure, frequently using cloud tools. While both roles require cloud and data skills, Azure Databricks roles are more centered on analytics and AI, whereas Data Engineers focus on data infrastructure and processing.

What skills and qualifications are needed to thrive as a remote Azure Databricks professional?

To thrive as a Remote Azure Databricks professional, you need strong expertise in data engineering, cloud computing, and proficiency in programming languages such as Python or Scala, typically supported by a relevant degree or certifications. Familiarity with Azure services, Databricks platform, Spark, and data pipeline orchestration tools is essential, often validated by Microsoft Azure or Databricks certifications. Excellent problem-solving, collaboration, and communication skills help you work effectively in distributed teams and convey complex technical concepts clearly. These skills and qualifications ensure robust data solutions, efficient remote teamwork, and the ability to leverage cloud analytics for business impact.

What are common challenges faced by remote Azure Databricks engineers, and how can they be managed?

Remote Azure Databricks engineers often encounter challenges related to collaboration and data security. Since Databricks projects typically involve large datasets and multiple stakeholders, coordinating work across time zones and ensuring secure data access can be complex. To manage these challenges, it's important to establish clear communication channels, use project management tools, and follow best practices in data governance. Regular team meetings and thorough documentation also help maintain alignment and ensure project success.
What are the most commonly searched types of Azure Databricks jobs in Massachusetts? The most popular types of Azure Databricks jobs in Massachusetts are:
What are popular job titles related to Remote Azure Databricks jobs in Massachusetts? For Remote Azure Databricks jobs in Massachusetts, the most frequently searched job titles are:
What job categories do people searching Remote Azure Databricks jobs in Massachusetts look for? The top searched job categories for Remote Azure Databricks jobs in Massachusetts are:
What cities in Massachusetts are hiring for Remote Azure Databricks jobs? Cities in Massachusetts with the most Remote Azure Databricks job openings:
Remote Azure Databricks jobs near you

Data Engineer with AI - Remote

Lorven Technologies

Boston, MA • On-site, Remote

$124K - $149K/yr

Full-time

Re-posted 8 days ago

Job description

I hope you are doing well,
Please share your updated profile if you are interested in the below role.
Our client seeks an Data Engineer + AI for a 12 Months project in Boston, MA. Below is the detailed requirement
Job Title: Data Engineer + AI
Work location : Boston, MA
Duration: 12 Months
Job Summary:
We're looking for a Senior Data Engineer to build and scale our lakehouse and AI data pipelines on Databricks. You'll design robust ETL/ELT, enable feature engineering for ML/LLM use cases, and drive best practices for reliability, performance, and cost.
What you'll do
  • Design, build, and maintain batch/streaming pipelines in Python + PySpark on Databricks (Delta Lake, Autoloader, Structured Streaming).
  • Implement data models (Bronze/Silver/Gold), optimize with partitioning, Z-ORDER, and indexing, and manage reliability (DLT/Jobs, monitoring, alerting).
  • Enable ML/AI: feature engineering, MLflow experiment tracking, model registries, and model/feature serving; support RAG pipelines (embeddings, vector stores).
  • Establish data quality checks (e.g., Great Expectations), lineage, and governance (Unity Catalog, RBAC).
  • Collaborate with Data Science/ML and Product to productionize models and AI workflows; champion CI/CD and IaC.
  • Troubleshoot performance and cost issues; mentor engineers and set coding standards.

Must-have qualifications
  • 6-10+ years in data engineering with a track record of production pipelines.
  • Expert in Python and PySpark (UDFs, Window functions, Spark SQL, Catalyst basics).
  • Deep hands-on Databricks: Delta Lake, Jobs/Workflows, Structured Streaming, SQL Warehouses; practical tuning and cost optimization.
  • Strong SQL and data modeling (dimensional, medallion, CDC).
  • ML/AI enablement experience: MLflow, feature stores, model deployment/monitoring; familiarity with LLM workflows (embeddings, vectorization, prompt/response logging).
  • Cloud proficiency on AWS/Azure/GCP (object storage, IAM, networking).
  • CI/CD (GitHub/GitLab/Azure DevOps), testing (pytest), and observability (logs/metrics).

Nice to have
  • Databricks Delta Live Tables, Unity Catalog automation, Model Serving.
  • Orchestration (Airflow/Databricks Workflows), messaging (Kafka/Kinesis/Event Hubs).
  • Data quality & lineage tools (Great Expectations, OpenLineage).
  • Vector DBs (FAISS, pgvector, Pinecone), RAG frameworks (LangChain/LlamaIndex).
  • IaC (Terraform), security/compliance (PII handling, data masking).
  • Experience interfacing with BI tools (Power BI, Tableau, Databricks SQL).
Lorven technologies logo

About Lorven technologies

Sourced by ZipRecruiter

Lorven Technologies, headquartered in Plainsboro, New Jersey, United States, is a reputable company in the technology industry, specializing in providing effective IT solutions and consulting services. The company's official website, lorventech.com, offers comprehensive insights into its offerings which include but are not limited to software development, IT consulting, project management, and business analysis. Since its inception, Lorven Technologies has been committed to ensuring efficiency and reliability in delivering IT services to its global clientele, establishing itself as a trusted name in the industry.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

2001

Social media

FacebookTwitter

View All Lorven technologies Jobs

Apply