Job Summary:
Diverse Lynx is a company focused on providing innovative solutions, and they are seeking a Sr. GCP Developer to enhance and manage data ingestion pipelines using Google Cloud Platform. The role involves optimizing GCP infrastructure, managing Airflow environments, and collaborating with DevOps teams to ensure efficient cloud operations.
Responsibilities:
• ix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
• Have Good Understanding of GCP Composer (Apache Airflow) environments.
• Manage Airflow DAGs and troubleshoot Airflow-related issues.
• Monitor and optimize Composer performance and scalability.
• Maintain GCP infrastructure including services like: Google Cloud Storage (GCS), BigQuery (BQ), Cloud Dataflow ( Apache Beam ), Cloud Dataproc, Cloud Functions, Cloud Run.
• Have Good Understanding of: IAM and service account permissions, Secret Manager.
• Monitor GCP usage and quotas, and proactively prevent quota-related issues.
• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
• DB design experience (with Excellent RDBS-PLSQL knowledge).
• Design Springboot APIs.
• Analyze, design, create Dockerfile.
• Knowledge on Angular ( Good to Have ).
• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
• Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
• Ensure security, compliance, and cost-efficiency across the cloud environment.
• Document system configurations, procedures, and best practices.
• Proficient in either Java or Python programming languages.
• Knowledge on DNS and SSO configuration setup.
Qualifications:
Required:
• Good Understanding of GCP Composer (Apache Airflow) environments
• Manage Airflow DAGs and troubleshoot Airflow-related issues
• Monitor and optimize Composer performance and scalability
• Maintain GCP infrastructure including services like: Google Cloud Storage (GCS), BigQuery (BQ), Cloud Dataflow (Apache Beam), Cloud Dataproc, Cloud Functions, Cloud Run
• Good Understanding of IAM and service account permissions
• Monitor GCP usage and quotas, and proactively prevent quota-related issues
• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging)
• DB design experience (with Excellent RDBS-PLSQL knowledge)
• Design Springboot APIs
• Analyze, design, create Dockerfile
• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources
• Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools
• Ensure security, compliance, and cost-efficiency across the cloud environment
• Document system configurations, procedures, and best practices
• Proficient in either Java or Python programming languages
Preferred:
• Knowledge on Angular (Good to Have)
• Knowledge on DNS and SSO configuration setup
Company:
Diverse Lynx is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable impact through staffing and contingent workforce solutions. Founded in 2002, the company is headquartered in Princeton, New Jersey, US, , with a team of 1001-5000 employees. The company is currently Late Stage.