"Data Engineer"

"Data Engineer"

Navtech

Hartford, NY • Remote

$113K - $135.70K/yr

Other

This job posting has expired and is no longer accepting applications. Check out similar jobs


Job description

I have an opportunity for a "Data Engineer with GCP" - (100% Remote). and I am looking for a candidate who can join Immediately if you are interested, reply to me with your updated resume or if you could refer someone I would really appreciate it.
Position : Data Engineer with GCP
Location : Preferably Wellesley, MA, Hartford, CT, or NYC. Will Consider (Remote).
Duration: 12 months
Must Haves:
• 5+ Years of Experience
• Unix/Linux
• Pig (Hive good to have)
• Python (good to have)
• Scala
• CI/CD - GitLab
• GCP
Primary Responsibilities:
• Understand the business objectives and analyze, dissect system requirements and technical specifications
• Interpret data, analyze results using statistical techniques and provide ongoing reports
• Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality
• Explore the automation scope wherever possible
• Acquire data from primary or secondary data sources and maintain databases / data systems
• Identify, analyze, and interpret trends or patterns in complex data sets
• Display strong technical knowledge in product analysis and debugging
• Willingness to learn new technologies and adapt to product needs
• Work independently with little or no supervision
• Provide technical mentoring for team members, troubleshooting
• Understand design concepts and product architecture. Propose solutions for performance and security issues
• Identify Process Gaps and drive Initiatives to address process Gaps
• Partner with product owners and developers to identify areas for improved efficiencies
• Share and communicate ideas both verbally and in writing to staff, business sponsors, managers, and technical resources in clear concise language that is appropriate to the target audience
• Participate in communities of practice to share knowledge, learn, and innovate
• Research and implement tools that support delivery
• Assesses and interprets customer needs and requirements
• Solves moderately complex problems and/or conducts moderately complex analyses
• Analyzes and investigates
• Provides explanations and interpretations within area of expertise
• Query structured and unstructured data and perform exploratory data analysis for further advanced modeling
• Guide and implement Optimization techniques across projects
Required Qualifications:
• 5+ years of IT experience in architecture of Big Data Technologies and ETL and other automation techniques
• Good experience on Unix shell command and scripting
• Experience of writing SQL and Complex SQLs
• Good knowledge of databases and Big Data especially Hive, HBase and Spark
• Knowledge in Hadoop Architecture, HDFS commands, experience designing and optimizing queries against data in the HDFS environment.
• Experience with bash shell scripts, UNIX utilities, and UNIX commands
• Fair knowledge on the Having experience on Hadoop Applications like Spark, Scala, Hbase, Hive, PIG, Sqoop
• Knowledge on tools like Kibana and Splunk
• Knowledge on Kafka Streaming
• Knowledge on implementing Data Integrations projects from sourcing to auditing and implements controls for each stage of Integration
• Knowledge of large scale search applications and building high volume data pipelines
• Deeply analytical
• Good communication and presentation skills
• Problem solving skills with the ability to think laterally, and to think with a medium term and long term perspective.
Regards
Alex Keylor
NAVTECH INC
1600 Golf Road. Suite 1200, Rolling Meadows, IL 60008
Ph: (224) 348-1340 || Email: alex@navtechusa.com || www.navtechusa.co
E-Verified Company


Navtech logo

About Navtech

Sourced by ZipRecruiter

Industry

Civil engineering construction

Company size

11 - 50 Employees

Headquarters location

New Bloomfield, PA, US

Year founded

1996



Frequently asked questions

Q: What skills or qualities help someone succeed as a Data Software Engineer?

A: To succeed as a Data Software Engineer, key technical skills include proficiency in programming languages such as Python, Java, or C++, as well as expertise in data structures, algorithms, and software development methodologies like Agile. Additionally, strong soft skills like effective communication, problem-solving, and collaboration are crucial, as Data Software Engineers often work with cross-functional teams and stakeholders to design, develop, and deploy data-driven solutions. By combining technical expertise with strong soft skills, Data Software Engineers can effectively drive business outcomes, innovate, and adapt to the rapidly evolving landscape of data technology.

Q: What is the career path for a Data Software Engineer?

A: A Data Software Engineer's typical career progression involves starting as a Junior Software Engineer, where they focus on developing and maintaining data-driven software applications, and gradually advancing to roles such as Senior Software Engineer, Technical Lead, or Data Architect, where they oversee large-scale data systems and lead cross-functional teams. Key opportunities for skill development include learning programming languages like Python, SQL, and Java, as well as data science tools like Hadoop, Spark, and machine learning frameworks like TensorFlow and PyTorch. Long-term, Data Software Engineers may pursue leadership roles, such as Director of Engineering or Chief Technology Officer, or transition into related fields like data science, product management, or entrepreneurship.