Architect and implement scale batch and streaming pipelines for large-scale product telemetry with ... Feature engineering and feature stores * RAG-based systems and evaluation pipelines * Ensure data ...
Architect and implement scale batch and streaming pipelines for large-scale product telemetry with ... Feature engineering and feature stores * RAG-based systems and evaluation pipelines * Ensure data ...
AI Engineer - Hybrid
Toronto, ON · Hybrid
Engineer AI services that integrate with business workflows through APIs, event-driven architecture, batch pipelines, and enterprise applications. * Continuously improve solution quality, scalability ...
New
AI Engineer - Hybrid
Toronto, ON · Hybrid
Engineer AI services that integrate with business workflows through APIs, event-driven architecture, batch pipelines, and enterprise applications. * Continuously improve solution quality, scalability ...
New
Machine Learning Engineer (Detection, TOR)
Toronto, ON · On-site
$80 - $110/hr
Countless scams, deepfakes, and other social engineering attacks are surging across every digital ... Design, train, and deploy models for both batch and real-time inference that identify malicious or ...
Machine Learning Engineer (Detection, TOR)
Toronto, ON · On-site
$80 - $110/hr
Countless scams, deepfakes, and other social engineering attacks are surging across every digital ... Design, train, and deploy models for both batch and real-time inference that identify malicious or ...
The Data Engineer is a core member of the Connected Data team, responsible for building and ... Exposure to data ingestion patterns (batch and/or near real-time) is an asset. * Experience ...
The Data Engineer is a core member of the Connected Data team, responsible for building and ... Exposure to data ingestion patterns (batch and/or near real-time) is an asset. * Experience ...
Senior Software Engineer I, Reporting
Toronto, ON · On-site
CA$172K - CA$279K/yr
WHAT YOU'LL DO Our products rely on sophisticated real-time and batch processing of massive amounts ... We're looking for a Senior Fullstack Engineer to help us tackle significant engineering challenges ...
Senior Software Engineer I, Reporting
Toronto, ON · On-site
CA$172K - CA$279K/yr
WHAT YOU'LL DO Our products rely on sophisticated real-time and batch processing of massive amounts ... We're looking for a Senior Fullstack Engineer to help us tackle significant engineering challenges ...
Data Engineer
Toronto, ON · Hybrid
CA$90K - CA$125K/yr
Experience designing batch and real-time ingestion frameworks with real-time monitoring * Ability ... Familiarity with DevOps practices and CI/CD pipelines. Perks and Benefits * Comprehensive Health ...
Data Engineer
Toronto, ON · Hybrid
CA$90K - CA$125K/yr
Experience designing batch and real-time ingestion frameworks with real-time monitoring * Ability ... Familiarity with DevOps practices and CI/CD pipelines. Perks and Benefits * Comprehensive Health ...
Lead Test Engineer
Toronto, ON · On-site
As a Lead Software Engineer in Test, you will be designing test strategies for new features developed for our Batch Analytics Team. You will help drivethe testing effort as a member of a cross ...
Lead Test Engineer
Toronto, ON · On-site
As a Lead Software Engineer in Test, you will be designing test strategies for new features developed for our Batch Analytics Team. You will help drivethe testing effort as a member of a cross ...
Data Engineer
Toronto, ON · Hybrid
CA$90K - CA$125K/yr
Experience designing batch and real-time ingestion frameworks with real-time monitoring * Ability ... Familiarity with DevOps practices and CI/CD pipelines. Perks and Benefits * Comprehensive Health ...
Data Engineer
Toronto, ON · Hybrid
CA$90K - CA$125K/yr
Experience designing batch and real-time ingestion frameworks with real-time monitoring * Ability ... Familiarity with DevOps practices and CI/CD pipelines. Perks and Benefits * Comprehensive Health ...
Senior / Staff Software Engineer (Observability / SRE)
Toronto, ON · On-site +1
CA$148K - CA$249K/yr
Qualifications: - 5+ years software engineering or systems/performance engineering experience (BS ... GPU/xPU or Arm performance exposure. - Experience tuning stream processing, batch or ML platforms ...
Senior / Staff Software Engineer (Observability / SRE)
Toronto, ON · On-site +1
CA$148K - CA$249K/yr
Qualifications: - 5+ years software engineering or systems/performance engineering experience (BS ... GPU/xPU or Arm performance exposure. - Experience tuning stream processing, batch or ML platforms ...
Senior Data Engineer Job Location: Hybrid, Toronto, Ontario, Canada Job Type: T4 Contract ... Design, build, and scale modern data platforms capable of handling both real-time and batch ...
Quick apply
Senior Data Engineer Job Location: Hybrid, Toronto, Ontario, Canada Job Type: T4 Contract ... Design, build, and scale modern data platforms capable of handling both real-time and batch ...
Develop high-performance Spark applications for batch and real-time data processing. * Integrate ... Cloud & DevOps * Architect cloud-native data platforms across AWS, Azure, or Google Cloud Platform.
Develop high-performance Spark applications for batch and real-time data processing. * Integrate ... Cloud & DevOps * Architect cloud-native data platforms across AWS, Azure, or Google Cloud Platform.
Platform Engineering Manager
Toronto, ON · Hybrid
CA$140K - CA$160K/yr
You will coach engineers, set practical standards, and step into the hardest reliability ... Design and improve resilient system-to-system integrations across APIs, event streams, batch/file ...
Platform Engineering Manager
Toronto, ON · Hybrid
CA$140K - CA$160K/yr
You will coach engineers, set practical standards, and step into the hardest reliability ... Design and improve resilient system-to-system integrations across APIs, event streams, batch/file ...
Architect and implement scale batch and streaming pipelines for large-scale product telemetry with ... Feature engineering and feature stores * RAG-based systems and evaluation pipelines * Ensure data ...
Architect and implement scale batch and streaming pipelines for large-scale product telemetry with ... Feature engineering and feature stores * RAG-based systems and evaluation pipelines * Ensure data ...
Staff Software Engineer - Backend (Typescript / .Nodejs / AWS )
Toronto, ON · Hybrid
CA$121K - CA$159K/yr
We are looking for a Staff Software Engineer with deep experience designing and scaling large-scale ... Proven experience working with large datasets , distributed computing, and batch or stream ...
Staff Software Engineer - Backend (Typescript / .Nodejs / AWS )
Toronto, ON · Hybrid
CA$121K - CA$159K/yr
We are looking for a Staff Software Engineer with deep experience designing and scaling large-scale ... Proven experience working with large datasets , distributed computing, and batch or stream ...
Data Engineer
Toronto, ON · On-site
The Data Engineer works closely with analytics, operations, IT, data governance, and AI ... Design, build, and maintain batch, incremental, and filebased data pipelines to support analytics ...
Data Engineer
Toronto, ON · On-site
The Data Engineer works closely with analytics, operations, IT, data governance, and AI ... Design, build, and maintain batch, incremental, and filebased data pipelines to support analytics ...
Data Engineer
CA$90K - CA$150K/yr
The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... architectures, and batch/streaming patterns. * Build and maintain data stores and indexing ...
Data Engineer
CA$90K - CA$150K/yr
The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... architectures, and batch/streaming patterns. * Build and maintain data stores and indexing ...
Transformation Engineer - Software Development, AI & Quality Engineering Fitch Group is seeking a ... Strong knowledge of data systems , including ETL, batch/streaming pipelines, APIs, and ...
Transformation Engineer - Software Development, AI & Quality Engineering Fitch Group is seeking a ... Strong knowledge of data systems , including ETL, batch/streaming pipelines, APIs, and ...
Senior Data Engineer
Toronto, ON · Hybrid
CA$125K - CA$140K/yr
Build and optimize batch and near-real-time data pipelines in Azure using Azure Data Factory, Azure Databricks (PySpark), Azure Data Lake, and Azure SQL * Engineer curated, analytics-ready data ...
Senior Data Engineer
Toronto, ON · Hybrid
CA$125K - CA$140K/yr
Build and optimize batch and near-real-time data pipelines in Azure using Azure Data Factory, Azure Databricks (PySpark), Azure Data Lake, and Azure SQL * Engineer curated, analytics-ready data ...
Senior Platform Engineer
Toronto, ON · Hybrid
Lead the development and operation of Kubernetesbased runtime environments for batch and realtime ... Improve developer and enduser experience by delivering scalable platform capabilities and resolving ...
Senior Platform Engineer
Toronto, ON · Hybrid
Lead the development and operation of Kubernetesbased runtime environments for batch and realtime ... Improve developer and enduser experience by delivering scalable platform capabilities and resolving ...
Leads the design and implementation of Tangerine's standard AI pipelines-real-time, batch, and hybrid * Drives engineering excellence by promoting best practices in coding, platform architecture ...
Leads the design and implementation of Tangerine's standard AI pipelines-real-time, batch, and hybrid * Drives engineering excellence by promoting best practices in coding, platform architecture ...
Batch Engineer information
What is a batch engineer?
What are the key skills and qualifications needed to thrive as a batch engineer, and why are they important?
What are some common challenges a batch engineer may face when managing large-scale batch processing systems?
What is the difference between Batch Engineer vs Process Engineer?
| Aspect | Batch Engineer | Process Engineer |
|---|---|---|
| Credentials | Bachelor's in Chemical, Mechanical, or Industrial Engineering | Bachelor's in Chemical, Mechanical, or Industrial Engineering |
| Work Environment | Manufacturing plants, chemical facilities, pharmaceutical production | Manufacturing plants, chemical facilities, process optimization settings |
| Industry Usage | Food, pharmaceuticals, chemicals, manufacturing | Chemical, petrochemical, manufacturing, process industries |
| Primary Focus | Design, operation, and optimization of batch production processes | Design and improvement of continuous or batch processes for efficiency |
Both Batch Engineers and Process Engineers work in manufacturing and chemical industries, often sharing similar educational backgrounds. Batch Engineers focus on managing and optimizing batch production processes, while Process Engineers work on designing and improving overall manufacturing processes. Understanding these distinctions helps in choosing the right career path or job role.
What are popular job titles related to Batch Engineer jobs in Whitby, ON?
For Batch Engineer jobs in Whitby, ON, the most frequently searched job titles are:
What job categories do people searching Batch Engineer jobs in Whitby, ON look for?
The top searched job categories for Batch Engineer jobs in Whitby, ON are:

Full-time
Re-posted 13 days ago
Autodesk rating
9.1
Based on 8 frontline employees who took The Breakroom Quiz
25th of 245 rated software companies
Job description
Job Requisition ID #
Position Overview
At Autodesk, we do what no other company can: we help our customers design and make anything. The Experience Foundations team at Autodesk plays a critical role in designing the experiences that make that mission a reality, especially in this transformative moment where seamless digital experiences and AI-powered innovation will empower customers and teams to achieve meaningful outcomes faster.
The Principal Data Engineer will report to Director of Growth and Data Science in the Experience Foundations organization. This is a critical data science role for our agentic insights platform-we are evolving our data tools and platform to support AI-native experiences, enabling both humans and intelligent systems to better understand user behavior and business impact.
As a Principal Data Engineer, you will be driving the design of AI-ready data products that power analytics, machine learning, and emerging agentic experiences and insights and intelligence products.
This role requires a balance of deep technical expertise, architectural vision, and cross-functional leadership, influencing how data is structured, governed, and consumed across Autodesk.
ResponsibilitiesArchitect and implement scale batch and streaming pipelines for large-scale product telemetry with low-latency, high-throughput data access
that support LLMs and agentic workflows
optimized for:
Retrieval (e.g., embeddings, vector search)
Contextual data access
Real-time and iterative feedback loops
Partner with AI/ML teams to operationalize:
Feature engineering and feature stores
RAG-based systems and evaluation pipelines
Ensure data quality and observability meet the needs of AI-driven decision systems
Guide build vs. buy decisions for data tooling and platforms
Enable analysts and product teams with trusted, well-modeled datasets
Partner with stakeholders to translate product questions into measurable data signals
Improve instrumentation strategy to ensure high-quality behavioral data
Support self-service analytics and AI-assisted exploration
Collaborate across Product, Engineering, Data Science, Research and Design
Influence technical direction without direct authority
Drive alignment on data standards, governance, and best practices
Communicate complex technical concepts to both technical and non-technical audiences
10+ years of experience in data engineering, data platform engineering, distributed systems, or related technical roles, including ownership of large-scale production data systems
Strong hands-on experience with Python, Spark, PySpark, advanced SQL, and scripting
Experience with:
LLM ecosystems, embeddings, vector databases
Retrieval-augmented generation (RAG)
Agent frameworks or orchestration systems
Experience with streaming technologies (Kafka, Flink, Spark Streaming)
Knowledge of analytics engineering and semantic layer tools (dbt, metrics stores)
Experience with data governance, lineage, and cataloging systems
Exposure to product analytics and experimentation frameworks
Experience designing and operating reliable ETL/ELT pipelines across batch and streaming workloads, including orchestration, validation, backfills, incremental processing, and data quality checks
Experience with modern data platforms, including Iceberg, Hive, Snowflake, Redshift, Athena, or equivalent technologies
Hands-on experience with AWS services, including EMR, Glue, S3, IAM, Lambda, Step Functions, and related cloud-native infrastructure
Demonstrated ability to lead cross-functional technical initiatives, influence architecture, define engineering standards, and mentor engineers
Strong communication skills with technical and non-technical stakeholders.
Experience with product telemetry, clickstream data, behavioral analytics, or experimentation platforms
Experience with ingestion, orchestration, and transformation tools such as Airflow, dbt, Fivetran, or similar
Experience partnering with product, design, research, analytics, and ML teams to create data products that directly inform user experiences or power intelligent product capabilities
Experience supporting LLM, RAG, agentic AI, or internal intelligence workflows in production or enterprise environments
Track record of modernizing data infrastructure in environments with fragmented systems, evolving requirements, or limited standards
Learn More
About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk - it's at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you're an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency
Salary is one part of Autodesk's competitive compensation package. For Canada based roles, we expect a starting base salary between $120,000 and $176,000. Offers are based on the candidate's experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/global-belonging
In-Person Onboarding and Identity Verification
This role may require in-person onboarding and/or in-person ID verification.
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).
About Autodesk
Sourced by ZipRecruiter
Autodesk is changing how the world is designed and made. Our technology spans architecture, engineering, construction, product design, manufacturing, media, and entertainment, empowering innovators everywhere to solve challenges big and small. From greener buildings to smarter products to more mesmerizing blockbusters, Autodesk software helps our customers to design and make a better world for all. For more information visit autodesk.com or follow @autodesk.
Industry
Software development
Company size
10,000+ Employees
Headquarters location
San Rafael, CA, US
Year founded
1982