Data Engineer

Data Engineer

InterSources

Manhattan, NY • Hybrid

$126.40K - $151.70K/yr

Other

Posted 26 days ago


Job description

Role: Data Engineer
Location: Hybrid in Manhattan, NY or Winter Park, FL
Exp - 8+ years minimum
MoI: F2F (2-hour interview includes an assessment too)

Position Overview
As a Data Engineer at Client, you will develop a deep understanding of the company's diverse data landscape and collaborate closely with cross-functional teams to gather requirements and deliver data-driven solutions. You will be responsible for providing data services through reports, systems, and interface applications to support various business functions.
The ideal candidate has a strong background in data engineering, is proficient in mainstream database systems, and possesses solid development skills, including the ability to perform in-depth debugging and troubleshooting. A passion for solving complex data challenges and enabling data-driven decision-making is essential.
Key Responsibilities
  • Data Analysis and Reporting : Work with business analysts and stakeholders to understand their data needs and deliver data solutions. Requires a strong understanding of data processing and hands-on experience with tools such as SQL, Pandas, and Jupiter.
  • Data Service Platform Development : Identify recurring analytical and reporting needs and implement reusable solutions within the internal data service platform. Proficiency in Python, Django, and JavaScript is required, along with strong debugging skills.
  • Data Processing Pipelines : Design, build, and maintain reliable and scalable daily data pipelines. Experience with Apache Airflow or other ETL orchestration tools is essential.
  • External Data Interfaces : Develop and maintain data services for external systems based on internal datasets. Requires knowledge of RESTful APIs and message queue technologies such as IBM MQ or Apache Kafka.
  • Data Platform Infrastructure : Work with cloud-based infrastructure components, including EC2, Docker, RDS, Redshift, and S3 to support the data platform.
Qualifications
Must:
  • Bachelor's degree in Data Engineering, Computer Science, Information Technology, or a related field
  • Minimum of 3 years' experience in a data engineering role
  • Proficiency in Python and Pandas
  • Strong SQL skills
Preferred:
  • Experience with JavaScript and web debugging tools
  • Familiarity with Apache Airflow
  • Experience with Django
  • Experience with AWS and related cloud technologies
  • Fluent in Mandarin

InterSources logo

About InterSources

Sourced by ZipRecruiter

In 2007, Our journey began as pioneers in the realm of technology and security. Since then, InterSources Inc. has evolved into a trusted partner, leading the way in Cloud Security, Cybersecurity, PLG Consulting, Digital Transformation, and Professional Services. With a rich history of excellence and a forward-thinking approach, we continue to secure your digital future and drive innovation. Explore our legacy of success and discover the possibilities that lie ahead.

Company size

51 - 200 Employees

Headquarters location

Fremont, CA, US

Year founded

2007

Social media



Frequently asked questions

Q: What skills or qualities help someone succeed as a Data Software Engineer?

A: To succeed as a Data Software Engineer, key technical skills include proficiency in programming languages such as Python, Java, or C++, as well as expertise in data structures, algorithms, and software development methodologies like Agile. Additionally, strong soft skills like effective communication, problem-solving, and collaboration are crucial, as Data Software Engineers often work with cross-functional teams and stakeholders to design, develop, and deploy data-driven solutions. By combining technical expertise with strong soft skills, Data Software Engineers can effectively drive business outcomes, innovate, and adapt to the rapidly evolving landscape of data technology.

Q: What is the career path for a Data Software Engineer?

A: A Data Software Engineer's typical career progression involves starting as a Junior Software Engineer, where they focus on developing and maintaining data-driven software applications, and gradually advancing to roles such as Senior Software Engineer, Technical Lead, or Data Architect, where they oversee large-scale data systems and lead cross-functional teams. Key opportunities for skill development include learning programming languages like Python, SQL, and Java, as well as data science tools like Hadoop, Spark, and machine learning frameworks like TensorFlow and PyTorch. Long-term, Data Software Engineers may pursue leadership roles, such as Director of Engineering or Chief Technology Officer, or transition into related fields like data science, product management, or entrepreneurship.



InterSources job posting for a Data Engineer in Manhattan, NY with a salary of $126,400 to $151,700 Annually with a map of Manhattan location.