Data Engineer SQL/Python/AWS/Snowflake

Data Engineer SQL/Python/AWS/Snowflake

Samprasoft

Raleigh, NC • On-site

$111.30K - $133.70K/yr

Other

This job posting has expired and is no longer accepting applications. Check out similar jobs


Job description

Cloud Data Engineer

If you have a passion for working with data using multiple emerging technologies on the cloud, this might be the right opportunity for you! The Cloud Data Engineer will be working as part of a core team building solutions for the data analytics platform for Asset Management. This will involve designing and developing solutions for a variety of data lake needs using Snowflake as the data store for structured/semi-structured data and AWS s3 for unstructured data. If you are a highly motivated and expert data engineer with a strong agile mindset, who’s looking for new challenges, we have an exciting opportunity for you to join our fast paced and highly collaborative group. This role will be involved in the full end-to-end process through planning, design, development, quality, and implementation of solutions. This position can be in Boston, Merrimack, Raleigh, and Westlake.

The Expertise and Skills You Bring:

  • Expertise in SQL, identifying patterns and trends in data, recommend and define data requirements, mastery in implementing data quality checks to ensure accuracy and completeness.
  • You enjoy learning new technologies, data analysis, identifying data patterns and trends and you can independently resolve technical challenges.
  • Experience in processing and exposing data using AWS technologies like ec2, s3, Lambda, API Gateway, Load Balancers, Auto scaling etc.
  • Expertise in building data ingestion tools using technologies like Python to extract data from Relational Databases/Web Scraping/External API’s
  • Experience in Snowflake or any MPP and columnar database on the Cloud.
  • Experience in CI/CD release automation and deployment (Jenkins, Concourse, CloudFormation etc.)
  • Experience and good understanding of databases (Oracle, Netezza) and ETL tools
  • Experience in scheduling tools like Autosys, Control-M, Airflow etc.
  • Excellent programming skills in SQL, PL/SQL, Python, shell etc.
  • Exposure to Big Data technologies (Hadoop, Spark, Hive, presto etc.)
  • Exposure to streaming services like Kafka will be an advantage
  • Good understanding of overall AWS security services like KMS, IAM, Security groups etc.



Frequently asked questions

Q: What skills or qualities help someone succeed as a Data Software Engineer?

A: To succeed as a Data Software Engineer, key technical skills include proficiency in programming languages such as Python, Java, or C++, as well as expertise in data structures, algorithms, and software development methodologies like Agile. Additionally, strong soft skills like effective communication, problem-solving, and collaboration are crucial, as Data Software Engineers often work with cross-functional teams and stakeholders to design, develop, and deploy data-driven solutions. By combining technical expertise with strong soft skills, Data Software Engineers can effectively drive business outcomes, innovate, and adapt to the rapidly evolving landscape of data technology.

Q: What is the career path for a Data Software Engineer?

A: A Data Software Engineer's typical career progression involves starting as a Junior Software Engineer, where they focus on developing and maintaining data-driven software applications, and gradually advancing to roles such as Senior Software Engineer, Technical Lead, or Data Architect, where they oversee large-scale data systems and lead cross-functional teams. Key opportunities for skill development include learning programming languages like Python, SQL, and Java, as well as data science tools like Hadoop, Spark, and machine learning frameworks like TensorFlow and PyTorch. Long-term, Data Software Engineers may pursue leadership roles, such as Director of Engineering or Chief Technology Officer, or transition into related fields like data science, product management, or entrepreneurship.