Job Summary:
HCLTech is seeking a Cloud Data Engineer to build and scale data-intensive applications. The role involves designing real-time and batch processing systems, managing diverse database environments, and ensuring robust data ingestion pipelines.
Responsibilities:
โข Build and optimize real-time data pipelines using Kafka and Kinesis.
โข Implement batch processing workflows using Spark and Scala.
โข Manage and optimize enterprise data stores across Microsoft SQL Server and PostgreSQL.
โข Develop high-performance backend services using Python and FastAPI to support data ingestion and retrieval.
โข Design systems for document ingestion and unstructured data processing.
Qualifications:
Required:
โข Build and optimize real-time data pipelines using Kafka and Kinesis.
โข Implement batch processing workflows using Spark and Scala.
โข Manage and optimize enterprise data stores across Microsoft SQL Server and PostgreSQL.
โข Develop high-performance backend services using Python and FastAPI to support data ingestion and retrieval.
โข Design systems for document ingestion and unstructured data processing.
โข Data Tools: Kafka, Kinesis, Spark, Scala.
โข Databases: MS SQL Server, PostgreSQL.
โข Programming: Python (FastAPI), with a strong preference for Scala.
โข Cloud: AWS data ecosystem (S3, RDS, Lambda).
Preferred:
โข Basic familiarity with Next.js/React to understand how data is consumed by the frontend.
Company:
HCLTech is a global IT company offering digital, engineering, and cloud solutions partnering with businesses for transformation. Founded in 1976, the company is headquartered in Noida, IND, with a team of 10001+ employees. The company is currently Late Stage.