Fourth Yuga Tech

Position: Data Engineer
Location: SataClara, CA 5 Days Onsite (Mandatory)
Employment Type: Long-Term Contract

Key Responsibilities

• Develop and maintain scalable data pipelines using PySpark and SQL.
• Build data processing and transformation workflows.
• Process large datasets using distributed computing technologies.
• Write and optimize complex SQL queries.
• Ensure data quality, validation, and reliability.
• Troubleshoot and optimize data pipeline and Spark performance.
• Collaborate with data and engineering teams to deliver scalable solutions.

Required Skills

• Strong PySpark experience.
• Strong SQL skills.
• Hands-on Data Engineering experience.
• Experience building data processing and transformation pipelines.
• Strong understanding of databases, data structures, and data quality.
• Experience with distributed data processing.
• Experience with ETL/ELT and data pipeline development.