QUALIFICATIONS:
Education
ย ย A post-secondary engineering degree, diploma or equivalent in a quantitative field (Computer Science, Information system, Mathematic, Statistics, Machine Learning, Artificial intelligence, Engineering)
ย ย A Master's degree is considered beneficial.
Experience
ย ย Strong experience with the deployment, configuration, and operationalization of Databricks environments, including workspace architecture, cluster management, CI/CD integration, security, governance, and enterprise-scale administration.
ย ย Experienced in building and managing modern data pipelines and lakehouse architectures using Delta Lake, Delta Live Tables, Structured Streaming, Workflows, medallion architectures (Bronze/Silver/Gold), and real-time/batch ingestion frameworks.
ย ย Deep understanding of Databricks ecosystem components including Unity Catalog, data lineage, RBAC, monitoring/observability, cost optimization, ML/AI enablement, model serving, and secure enterprise data collaboration through Clean Rooms.ย
ย ย Proven experience integrating Databricks with enterprise cloud and industrial data ecosystems, including Kafka, SQL databases, APIs, IoT/OT platforms, and cloud environments such as Azure, AWS, and GCP.ย
ย ย Strong understanding of scalable data engineering, governance, multi-tenant architectures, and enterprise data platform strategies supporting analytics, AI, and operational intelligence initiatives.
ย ย Proficiency in programming languages like Python, R, or Java
ย ย Experience with data manipulation and analysis libraries (e.g., Pandas, NumPy)
ย ย Familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch, Scikit-learn)
ย ย Experience with databases (SQL, Influx)
ย ย Knowledge of data warehousing and ETL processes
ย ย Familiarity with tools like Hadoop, Spark, or Kafka
ย ย Experience with cloud services such as AWS, Google Cloud, or Azure
ย ย Understanding of software engineering principles and best practices
ย ย Experience with version control systems (e.g., Git)
ย ย Ability to design and implement efficient algorithms and solutions
ย ย Demonstrated experience in deploying machine learning models to production
ย ย Experience with data visualization tools and techniques
ย ย Strong analytical and communication skills
ย ย Ability to work collaboratively in a team environment
ย ย Ability to communicate effectively, both orally and in writing
ย ย A self-starter with the ability to work as part of a team in a fast paced environment with minimal supervision
ย ย In addition, the following is considered not necessary but beneficial:
o ย ย Experience with Agile development practices
o ย ย Understanding of automation mechanical, electrical and control systems
o ย ย Understanding of machine operation, maintenance, service and troubleshooting
o ย ย Understanding of Machine Vision systems and solutions
o ย ย Understanding of PLCs and PLC communication
o ย ย Exposure and understanding of business intelligence