Scala/ Spark Developer

Scala/ Spark Developer

InterSources

New York, NY • On-site

$58 - $75.25/hr

Other

Posted 22 days ago


Job description

Title: Scala/ Spark Developer Duration: Long term

Location: Broadway, NY – 3 days onsite

Mandatory Skills: Big Data, Scala, Spark, Core Java

Experience: As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data processing application. Key Responsibilities:

  • Develop and maintain data processing applications using Spark and Scala.
  • Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
  • Implement test-driven deployment practices to enhance the reliability of application.
  • Deploy artifacts from lower to higher environment ensuring smooth transition
  • Troubleshoot and debug Spark performance issues to ensure optimal data processing.
  • Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time
  • Provide essential support for production batches, addressing issues and providing fix to meet critical business needs Skills/Competencies:
  • Strong knowledge of Scala programming language
  • Excellent problem-solving and analytical skills.
  • Proficiency in Spark, including the development and optimization of Spark applications.
  • Ability to troubleshoot and debug performance issues in Spark.
  • Understanding of design patterns and data structure for efficient data processing
  • Familiarity with database concepts and SQL * Java and Snowflake (Good to have).
  • Experience with test-driven deployment practices (Good to have).
  • Familiarity with Python (Good to have).
  • Knowledge of Databricks (Good to have).
  • Understanding of DevOps practices (Good to have).
About Us:
InterSources Inc, a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services, etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a Google Cloud partner company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.

InterSources logo

About InterSources

Sourced by ZipRecruiter

In 2007, Our journey began as pioneers in the realm of technology and security. Since then, InterSources Inc. has evolved into a trusted partner, leading the way in Cloud Security, Cybersecurity, PLG Consulting, Digital Transformation, and Professional Services. With a rich history of excellence and a forward-thinking approach, we continue to secure your digital future and drive innovation. Explore our legacy of success and discover the possibilities that lie ahead.

Company size

51 - 200 Employees

Headquarters location

Fremont, CA, US

Year founded

2007

Social media



Frequently asked questions

Q: What skills or qualities help someone succeed as a Big Data Developer?

A: To succeed as a Big Data Developer, key technical skills include proficiency in programming languages such as Python, Java, and SQL, as well as expertise in data processing frameworks like Hadoop, Spark, and NoSQL databases. Additionally, soft skills like strong problem-solving abilities, effective communication, and collaboration are crucial for working with cross-functional teams and stakeholders to design, implement, and maintain large-scale data systems. By combining these technical and soft skills, Big Data Developers can drive business insights, optimize operations, and contribute to the growth and success of their organizations.

Q: What is the career path for a Big Data Developer?

A: A Big Data Developer's career path typically begins as a Junior Big Data Developer, where they focus on implementing data processing and storage solutions using tools like Hadoop, Spark, and NoSQL databases. As they gain experience, they progress to mid-level roles such as Big Data Engineer or Data Architect, where they design and develop large-scale data systems, and then to senior roles like Lead Big Data Engineer or Director of Data Engineering, where they oversee teams and drive strategic data initiatives. Throughout their career, Big Data Developers can develop skills in areas like cloud computing, machine learning, and data visualization, and may also transition into related roles like Data Scientist or IT Manager.



InterSources job posting for a Scala/ Spark Developer in New York, NY with a salary of $58 to $75 Hourly with a map of New York location.