Job Summary:
Scout Motors Inc. is dedicated to carrying forward the heritage of iconic American vehicles while embracing innovation. The Senior DataOps Engineer will play a crucial role in building a secure and scalable data platform that enables real-time insights and supports AI-enabled use cases across the organization.
Responsibilities:
โข Contribute to the design, implementation, automation, maintenance, and operational support of enterprise-scale cloud data platforms leveraging Databricks, AWS cloud services, and modern Infrastructure as Code (IaC) practices.
โข Lead the design, development, optimization, and operational management of enterprise-scale ETL/ELT pipelines within Databricks.
โข Build and maintain scalable batch and streaming data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
โข Configure, optimize, and manage Databricks clusters for performance, scalability, reliability, and cost efficiency.
โข Work closely with software development and systems teams to build Data Integration solutions.
โข Design and build Data models using tools such as Lucid, Talend, Erwin, MySQL workbench.
โข Define and enhance enterprise data model to reflect relationships and dependencies.
โข Review application data systems to ensure adherence to data governance policies.
โข Design and build ETL (Python), ELT(Python) infrastructure, automation, and solutions to transform data as required.
โข Design and Implement BI dashboards to visualize Trends and Forecasts.
โข Design and implement data infrastructure components, ensuring high availability, reliability, scalability, and performance.
โข Design, train and deploy ML models
โข Implement monitoring solutions to proactively identify and address potential issues.
โข Collaborate with security teams to ensure the data platform meets industry standards and compliance requirements.
โข Collaborate with cross-functional teams, including product managers, developers, and business partners to ensure robust and reliable systems.
Qualifications:
Required:
โข Bachelor's degree in computer science, information technology, or related field or equivalent work experience.
โข 7+ years of hands-on experience as DataOps Engineer in a manufacturing or automotive environment.
โข Experience with streaming and event-based architecture.
โข Experience implementing data lakehouse solutions using Databricks.
โข Experience with infrastructure as code (Terraform).
โข Proficient in building data pipelines using languages such as Python and SQL.
โข Experience with AWS based data services such as Glue, Kinesis, Firehose or other comparable services.
โข Experience with Structured, unstructured and time series databases.
โข Solid understanding of cloud data storage solutions such as RDS, DynamoDB, DocumentDB, Mongo, Cassandra, Influx.
โข Several years of experience working with cloud platforms such as AWS and Azure.
โข Proven ability to develop and deploy scalable ML models.
โข Hands-on experience in designing, training, and deploying ML models.
โข Strong ability to extract actionable insights using ML techniques.
โข Ability to leverage ML algorithms for forecasting trends and decision-making.
โข Excellent problem-solving and troubleshooting skills. When a problem occurs, you run towards it not away.
โข Effective communication and collaboration skills. You treat colleagues with respect. You have a desire for clean implementations but are also humble in discussing alternative solutions and options.
Company:
Scout is more than just a brand, itโs a legacy steeped in a culture of exploration, caretaking, and hard work. Founded in 2022, the company is headquartered in Washington, USA, with a team of 1001-5000 employees. The company is currently Late Stage.