Data Engineer
Location
Hyderabad, India (Hybrid)
Employment Type
Full-Time
Experience
3โ7 Years
Salary
โน8 LPA โ โน18 LPA (Based on experience and skills)
Job Summary
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate should have experience working with large datasets, cloud platforms, ETL processes, and data warehousing solutions. You will collaborate with data analysts, data scientists, and software engineers to ensure reliable and efficient data processing.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines.
- Build and optimize data models and data warehouses.
- Integrate data from multiple sources into centralized repositories.
- Ensure data quality, consistency, and governance.
- Optimize SQL queries and improve data processing performance.
- Work with cloud-based data platforms and big data technologies.
- Monitor, troubleshoot, and resolve data pipeline issues.
- Collaborate with cross-functional teams to support business intelligence and analytics.
- Implement data security and compliance best practices.
- Document data architecture and technical processes.
Primary Skills
- Python
- SQL
- Apache Spark
- Apache Kafka
- ETL/ELT Development
- Data Warehousing
- Snowflake
- Apache Airflow
- Azure Data Factory (ADF)
- AWS Glue
- Databricks
- Git
Secondary Skills
- Hadoop Ecosystem
- Docker
- Kubernetes
- Terraform
- Power BI
- Tableau
- Linux
- CI/CD Pipelines
- REST APIs
- Data Governance
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3โ7 years of experience in Data Engineering.
- Strong programming skills in Python and SQL.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Hands-on experience with ETL tools and data pipelines.
- Strong understanding of relational and NoSQL databases.
- Knowledge of distributed data processing frameworks.
Preferred Qualifications
- Experience with Databricks or Snowflake.
- Cloud certifications (AWS, Azure, or GCP).
- Experience with streaming platforms like Kafka.
- Knowledge of DevOps and Infrastructure as Code.
Soft Skills
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration abilities.
- Ability to work in Agile environments.
- Good time management and organizational skills.
- Quick learner with a proactive attitude.
Benefits
- Competitive salary package
- Health insurance
- Performance bonus
- Flexible work environment
- Learning and certification support
- Paid leave and holidays
- Career growth opportunities
- Employee wellness programs