Sr. Data Engineer - AWS Lambda & PostgreSQL

Sr. Data Engineer - AWS Lambda & PostgreSQL

InterSources

Columbus, OH • On-site

$107K - $128.50K/yr

Other

This job posting has expired and is no longer accepting applications. Check out similar jobs


Job description

Sr. Data Engineer – AWS Lambda & PostgreSQL

Location: Hempstead, NY or Basking Ridge, NJ or Columbus, OH or Dallas, TX Duration: 12 months MoI: Video Candidates local to these areas or someone who can relocate. Hybrid working model.

Role Overview: We are seeking a skilled Sr Data Engineer to design and implement scalable data pipelines using AWS Lambda that push structured and semi-structured data into a PostgreSQL data store. The role also requires experience in data modeling, Looker dashboard development, and strong SQL/database expertise to support reporting and analytics needs across the organization.

Key Responsibilities:

  • Design, develop, and deploy serverless data ingestion pipelines using AWS Lambda
  • Write and optimize Lambda functions to clean, transform, and push data into PostgreSQL
  • Develop and maintain scalable, efficient data models supporting analytical workloads
  • Create LookML models and build dashboards in Looker to enable self-service analytics
  • Maintain database integrity, indexing, and performance optimization
  • Collaborate with product, engineering, and analytics teams to understand data needs
  • Build robust error-handling, logging, and retry mechanisms for data pipelines
  • Ensure data governance, quality, and security best practices are followed

Required Skills:

  • Overall 10+ years of experience
  • 3–5 years of experience in Data Engineering or Backend Engineering roles
  • Strong experience with AWS Lambda and serverless data architecture
  • Proficient in Python or Node.js for writing Lambda functions
  • Solid experience with PostgreSQL – schema design, optimization, and advanced SQL
  • Proven expertise in data modeling for analytics and reporting
  • Hands-on experience with Looker (LookML, dashboards, data exploration)
  • Familiarity with AWS services like S3, CloudWatch, API Gateway, and IAM
  • Excellent debugging, problem-solving, and communication skills

Good to Have:

  • Experience integrating third-party APIs or webhooks into Lambda functions
  • Familiarity with data warehousing concepts (e.g., Snowflake, Redshift, or BigQuery)
  • Exposure to CI/CD for data pipelines using tools like GitLab or Jenkins
  • Understanding of modern data stack tools (Fivetran, dbt, Airflow, etc.)

InterSources logo

About InterSources

Sourced by ZipRecruiter

In 2007, Our journey began as pioneers in the realm of technology and security. Since then, InterSources Inc. has evolved into a trusted partner, leading the way in Cloud Security, Cybersecurity, PLG Consulting, Digital Transformation, and Professional Services. With a rich history of excellence and a forward-thinking approach, we continue to secure your digital future and drive innovation. Explore our legacy of success and discover the possibilities that lie ahead.

Company size

51 - 200 Employees

Headquarters location

Fremont, CA, US

Year founded

2007

Social media



Frequently asked questions

Q: What skills or qualities help someone succeed as a Data Software Engineer?

A: To succeed as a Data Software Engineer, key technical skills include proficiency in programming languages such as Python, Java, or C++, as well as expertise in data structures, algorithms, and software development methodologies like Agile. Additionally, strong soft skills like effective communication, problem-solving, and collaboration are crucial, as Data Software Engineers often work with cross-functional teams and stakeholders to design, develop, and deploy data-driven solutions. By combining technical expertise with strong soft skills, Data Software Engineers can effectively drive business outcomes, innovate, and adapt to the rapidly evolving landscape of data technology.

Q: What is the career path for a Data Software Engineer?

A: A Data Software Engineer's typical career progression involves starting as a Junior Software Engineer, where they focus on developing and maintaining data-driven software applications, and gradually advancing to roles such as Senior Software Engineer, Technical Lead, or Data Architect, where they oversee large-scale data systems and lead cross-functional teams. Key opportunities for skill development include learning programming languages like Python, SQL, and Java, as well as data science tools like Hadoop, Spark, and machine learning frameworks like TensorFlow and PyTorch. Long-term, Data Software Engineers may pursue leadership roles, such as Director of Engineering or Chief Technology Officer, or transition into related fields like data science, product management, or entrepreneurship.