Freelance Streaming Data Engineer Jobs in Michigan

Specific Responsibilities of this Position:

As a Data Engineer, you will build industrialized data assets and data pipelines in support of Business Intelligence and Advance Analytic objectives. The Data Engineer handles leading and delivering new and innovative data driven solutions that are elegant and professional. You will work closely with our forward-thinking Data Scientists, BI developers, System Architects, and Data Architects to deliver value to our vision for the future. Our team focuses on writing maintainable tests and code that meet the customer’s need and scale without rework. Our engineers and architects work in highly collaborative environments across many disciplines (user experience, database, streaming technology, custom rules engines, and ai/ml and most web technologies). We work on innovative technologies – understanding and inventing modern designs and integration patterns along the way. Our Data Engineers must –
• You will assemble large, complex data sets that meet functional / non-functional business requirements.
• You will identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Lead and deliver exceptional data driven solutions across many different languages, tools, and technology.
• Develop a culture which takes challenging and complex ideas and turns them into production solutions.
• Have a broad, enterprise-wide view of business and varying degrees of appreciating for strategy, process, capabilities, enablers, and governance.
• Be able to critically apply themselves to solving problems in an interconnected and integrated environment.
• Think strategically about adopting innovative technologies that are beyond the horizon and deliver on sound solution design.
• Create high-level models that can be leveraged in future analysis to extend and mature the business architecture.
• Working towards continuously raising our standards of engineering excellence in quality, efficiency, and developing repeatable designs.
• Performing hands-on development, leading code reviews and testing, creating automation tools, and creating proofs of concepts
• Ability to work along with operations team during any production issues related to platform.
• Best practices like agile methodologies, design thinking and continuous deployment that will allow you to innovate fast.
• Deliver solutions across Big Data applications to support business strategies and deliver business value.
• Build tool / automation to make deployment and monitoring production environment more repeatable.
• Build strong relationships with Business & Technology Partners and provide leadership, direction, best practices, and coaching to technology development teams.
• Owning all Technical aspects of development and for assigned applications.
• Driving continuous improvement in applications, through use of consistent development practices and tools, and through ongoing design and code refactoring
• Collaborating with stakeholders through ongoing product and platform releases, to solve existing needs, identify exciting opportunities, and predict future challenges.
• Working closely with product managers and architects to prioritize and manage features, technical requirements, known defects, and issues.
• Managing and appropriately escalating delivery impediments, risks, issues, and changes tied to the product development initiatives.
• Data Integration – Design and develop new source system integrations from a variety of formats including files, database extracts and APIs.
• Data Pipelines – Design and develop highly scalable Data Pipelines that incorporate complex transformations and efficient code.
• Data Delivery – Design and develop solutions for delivering data that meets SLAs

Job Description:

Summary:
The main function of a Software Engineer is to design, develop, implement, test, and maintain business and computer applications software or specialized utility programs including mainframe and client/server applications, and major enhancement of existing systems
Job Responsibilities:
• Fine-tune and improve a variety of sophisticated software implementation projects
• Gather and analyze system requirements, document specifications, and develop software solutions to meet client needs and data
• Analyze and review enhancement requests and specifications
• Implement system software and customize to client requirements
• Prepare the detailed software specifications and test plans
• Code new programs to client’s specifications and create test data for testing
• Modify existing programs to new standards and conduct unit testing of developed programs
• Create migration packages for system testing, user testing, and implementation
• Provide quality assurance reviews
• Perform post-implementation validation of software and resolve any bugs found during testing
Qualifications:
• Bachelor's degree in a technical field such as computer science, computer engineering or related field required
• 5-7 years experience required
• A solid foundation in computer science, with strong competencies in data structures, algorithms, and software design
• large systems software design and development experience
• Experience performing in-depth troubleshooting and unit testing with both new and legacy production systems
• experience in programming and experience with problem diagnosis and resolution

Additional Skills (Indicate if preferred or required):

Expert in multiple tools and technologies including Azure and Databricks
Scala, Spark, Python, SQL, .NET, REST API, Angular
SQL Server, PostgreSQL, SQL Server Integration Services (SSIS), Complex ETL with massive data, PowerB