Data Platform Engineer

$113K - $135.70K/yr

Full-time

Posted 22 hours ago


Job description

Position: Data Platform Engineer
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools. The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law



Frequently asked questions

Q: What skills or qualities help someone succeed as a Data Software Engineer?

A: To succeed as a Data Software Engineer, key technical skills include proficiency in programming languages such as Python, Java, or C++, as well as expertise in data structures, algorithms, and software development methodologies like Agile. Additionally, strong soft skills like effective communication, problem-solving, and collaboration are crucial, as Data Software Engineers often work with cross-functional teams and stakeholders to design, develop, and deploy data-driven solutions. By combining technical expertise with strong soft skills, Data Software Engineers can effectively drive business outcomes, innovate, and adapt to the rapidly evolving landscape of data technology.

Q: What is the career path for a Data Software Engineer?

A: A Data Software Engineer's typical career progression involves starting as a Junior Software Engineer, where they focus on developing and maintaining data-driven software applications, and gradually advancing to roles such as Senior Software Engineer, Technical Lead, or Data Architect, where they oversee large-scale data systems and lead cross-functional teams. Key opportunities for skill development include learning programming languages like Python, SQL, and Java, as well as data science tools like Hadoop, Spark, and machine learning frameworks like TensorFlow and PyTorch. Long-term, Data Software Engineers may pursue leadership roles, such as Director of Engineering or Chief Technology Officer, or transition into related fields like data science, product management, or entrepreneurship.



Avani Technology Solutions, Inc. job posting for a Data Platform Engineer in Rochester, NY with a salary of $113,000 to $135,700 Annually with a map of Rochester location.