Job Summary:
Cyient is a company focused on providing innovative solutions, and they are seeking a Senior Data Engineer to design and maintain scalable data pipelines. The role involves collaborating with various teams to deliver data solutions, ensuring data quality and compliance, and optimizing data for analytics and reporting.
Responsibilities:
โข Design, build, and maintain scalable batch and streaming data pipelines for ingesting and processing large datasets
โข Transform, model, and optimize data for analytics, reporting, and downstream applications
โข Implement data validation, monitoring, and security controls to ensure data quality, reliability, and compliance
โข Contribute to the design and evolution of the data platform with a focus on scalability, performance, and maintainability
โข Collaborate with BI, analytics, AI, and product teams to deliver data solutions aligned with business needs
โข Develop automated workflows and observability mechanisms to ensure pipeline reliability and system visibility
โข Create and maintain documentation for pipelines, data models, and platform components
โข Evaluate and improve tools, frameworks, and processes to enhance efficiency and maintainability
Qualifications:
Required:
โข Strong experience with Databricks, Apache Spark, and PySpark for large-scale data processing
โข Experience building and optimizing data pipelines at scale, including parallelization and performance tuning
โข Experience with near real-time or streaming data systems
โข Proficiency in Python and SQL for data engineering and transformation workflows
โข Experience with ETL/ELT processes and tools
โข Hands-on experience with cloud data platforms (Azure, AWS, or GCP)
โข Solid understanding of data modeling and dataset design for analytics and downstream applications
โข Experience tuning queries and optimizing compute performance
โข Knowledge of data governance, security, and compliance practices
โข Strong communication skills and ability to work cross-functionally
Preferred:
โข Experience with cloud platforms (Azure, AWS, or GCP)
โข Experience with vector databases and embedding-based systems
โข Experience with streaming frameworks and data quality tools
โข Familiarity with knowledge graphs and graph-based data modeling
โข Experience with CI/CD pipelines and deployment automation
โข Familiarity with BI tools and machine learning pipelines
Company:
Cyient is a digital engineering and technology company specializing in management consulting and engineering services. Founded in 1991, the company is headquartered in Hyderabad, IND, with a team of 10001+ employees. The company is currently Late Stage.