ZipRecruiter

Log In

1

Independent Contractor Databricks Jobs in New York

SOFT Inc.

Azure Cloud Architect

Manhattan, NY · On-site

$71.75 - $91.25/hr

... Synapse, Databricks, Event Hubs etc.). Azure database services (Azure SQL DB, Managed Instance ... INDEPENDENT CONSULTANTS ONLY! NO THIRD PARTIES/NO SUB CONTRACTORS*

New

All JobsIndependent Contractor Databricks JobsIndependent Contractor Databricks Jobs in New York

Independent Contractor Databricks information

What skills and qualifications are needed to thrive as an independent contractor Databricks?

To thrive as an Independent Contractor Databricks, you need a solid background in data engineering, big data analytics, and proficiency with Apache Spark, typically supported by a degree in computer science or a related field. Familiarity with Databricks platform, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly beneficial. Strong problem-solving, communication, and self-management skills help you deliver solutions independently and collaborate effectively with clients. These skills are essential for delivering robust data solutions, meeting client expectations, and staying competitive in a rapidly evolving data landscape.

What is the difference between Independent Contractor Databricks vs Data Engineer?

AspectIndependent Contractor DatabricksData Engineer
CredentialsOften requires Databricks certifications, SQL, Python, cloud platform knowledgeRequires similar certifications, SQL, Python, cloud skills, sometimes specific to cloud providers
Work EnvironmentFreelance, project-based, remote or on-siteFull-time, corporate or tech company, hybrid or on-site
Employer & IndustryClients across industries, consulting firms, startupsTech companies, finance, healthcare, large enterprises

While both roles require data processing skills and cloud platform knowledge, Independent Contractor Databricks typically involves project-based freelance work with a focus on Databricks platform expertise. Data Engineers often work full-time within organizations, handling broader data pipeline responsibilities. The key difference lies in employment status and work setup.

What is an independent contractor Databricks?

Independent Contractor Databricks are professionals who work on a contract basis, rather than as full-time employees, to provide expertise using Databricks' unified analytics platform. They are typically hired by organizations to help with data engineering, machine learning, and big data analytics projects, leveraging Databricks' capabilities on Apache Spark. These contractors often bring specialized knowledge in cloud platforms, data pipelines, and advanced analytics, working independently or as part of project teams. Their flexible engagement allows companies to scale their data initiatives without committing to permanent hires.

What are common challenges faced by independent contractor Databricks professionals when onboarding with new clients?

Independent Contractor Databricks professionals often encounter challenges such as adapting to diverse data environments and integrating Databricks with existing infrastructure. Each client may have unique data governance policies, security requirements, and legacy systems, requiring contractors to quickly learn and align with these standards. Additionally, contractors must efficiently communicate with both technical and non-technical stakeholders to understand project goals and deliver value within tight timelines. Building rapport with in-house teams and demonstrating expertise early on can help overcome these onboarding hurdles.
What are the most commonly searched types of Databricks jobs in New York? The most popular types of Databricks jobs in New York are:
What are popular job titles related to Independent Contractor Databricks jobs in New York? For Independent Contractor Databricks jobs in New York, the most frequently searched job titles are:
What job categories do people searching Independent Contractor Databricks jobs in New York look for? The top searched job categories for Independent Contractor Databricks jobs in New York are:
What cities in New York are hiring for Independent Contractor Databricks jobs? Cities in New York with the most Independent Contractor Databricks job openings:
Independent Contractor Databricks jobs near you
Infographic showing various Independent Contractor Databricks job openings in New York as of August 2026, with employment types broken down into 100% Contract. Highlights an 100% In-person job distribution.

Cloud Data Architect - AWS / Databricks

SOFT Inc.

Manhattan, NY • On-site

$71.50 - $93.75/hr

Other

Posted 3 days ago

New

Job description

SOFT's client located in New York, NY ( Hybrid ) is looking for a Cloud Data Architect - AWS / Databricks for a long term contract assignment.

Qualifications:
8+ years of experience in data architecture, data engineering or database design and large-scale enterprise cloud data implementations in complex, highly regulated environments with Databricks platform. Deep understanding of modern data technology stacks, cloud data platforms (AWS preferred), and enterprise software solutions.
5+ years of experience in Tableau visualization preferred.
Demonstrated experience designing, architecting and supporting applications with a strong emphasis on scalability, security, availability and performance. Demonstrated knowledge of and leading adoption of industry best practices in the areas of DataOps and modern data stack tools, data governance, SQL and other query tools.
Demonstrated experience in cloud data architecture skills including designing, architecting and delivering modern cloud data platforms to ingest, process, store and expose data across the enterprise. Expert knowledge of data modeling techniques and tools, data lifecycle management and integration patterns to ensure that data flows are consistent, reliable and reusable across services and solutions. Experience with data storage technologies, partitioning strategies, caching, data access patterns, and robust security strategies enforcing privacy and regulatory requirements including designing standardized approaches for data classification, access control, encryption, retention and auditability. Knowledge of data lake houses, data warehousing concepts and data governance.
Outstanding communication and collaboration skills, including translating technical topics and risks into business teams. Ability to personalize communication to audience from technologists to executive leadership.
Extensive, in-depth experience implementing highly complex technology projects in a cross-functional matrix environment with demonstrated ability to drive consensus and deliver results. Examples of leading through influence and successfully resolving conflicting priorities are required.
Bachelor's degree in computer science or similar field with 8+ years of related work experience.
Responsibilities:
Architect scalable data processing frameworks leveraging Databricks platform for analytical workloads
Implement cost-optimization strategies balancing compute resources, storage tiering, and cluster configurations
Develop and maintain coding standards for PySpark/Python within Databricks notebooks ensuring maintainability and performance
Design and architect ETL/ELT pipelines supporting ingestion, transformation, and distribution of analytic datasets.
Design Databricks workspace architectures integrating Unity Catalog for centralized governance, AWS IAM for authentication, and cross-account data access patterns.
Design data quality frameworks and validation logic within processing workflows
Understanding of complex SQL queries and Spark transformations for data manipulation, aggregation, and analytical computations
Establish patterns for incremental processing, change data capture, and historical data management
Architect MLOps pipelines for model deployment and monitoring using AWS services, Domino Data Lab, and related platforms
Implement CI/CD workflows using GitLab for data pipeline deployment and version control
Establish infrastructure-as-code practices for environment consistency and disaster recovery
Establish data governance frameworks within centralized data lake environment
Design dimensional data models and semantic layers optimized for Tableau and BI consumption
Explore and implement generative AI capabilities
Partner with product owners, architects, data engineers, analysts, and application teams to translate requirements into technical architectures
Mentor team members on best practices for Spark optimization, data modeling, and cloud-native design patterns
Evaluate emerging technologies and platforms for potential adoption into the data ecosystem
Document architectural decisions, design patterns, and technical standards

Please refer to the Position ID when inquiring about a job posting or sending in your resume.

***INDEPENDENT CONSULTANTS ONLY! NO THIRD PARTIES/NO SUB CONTRACTORS***

Apply