About Photon
Sourced by ZipRecruiter
Company size
1 - 10 Employees
Headquarters location
Cambridge, MA, US
Year founded
1984
$72.25 - $92.75/hr
Other
Medical, Dental, Vision, Retirement, PTO
This job posting has expired and is no longer accepting applications. Check out similar jobs
Job description
Job Description
Key Responsibilities:
- Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics.
- Develop, test, and deploy data processing applications using Apache Spark and Scala.
- Optimize and tune Spark applications for better performance on large-scale data sets.
- Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
- Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
- Design and implement high-performance data processing and analytics solutions.
- Ensure data integrity, accuracy, and security across all processing tasks.
- Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
- Implement version control and CI/CD pipelines for Spark applications.
Required Skills & Experience:
- Minimum 15+ years of experience in application development.
- Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
- Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
- Ability to troubleshoot and optimize Spark and Cloudera platform performance.
- Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).
Compensation, Benefits and Duration
Minimum Compensation: USD 62,000Maximum Compensation: USD 217,000Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.This position is not available for independent contractorsNo applications will be considered if received more than 120 days after the date of this post
Job Info- Job Identification 21711
- Job Category Dev & Run Ops
- Posting Date 02/11/2025, 06:08 PM
- Locations United States
photoninc.com
Most Popular Jobs Similar to Data Architect
senior data architect
sr data architect
it data architect
enterprise data architect
data solution architect
data architect modeler
data solutions architect
etl data architect
lead data architect
data analytics architect
Other Helpful Pages Related To Architect - Data Engineering - Irving
Remote Data Architect Salaries
Remote Data Architect Career Research
Frequently asked questions
Q: What skills or qualities help someone succeed as a Data Architect?
A: To succeed as a Data Architect, key technical skills include proficiency in data modeling, database design, and data warehousing, as well as expertise in data management tools such as ETL (Extract, Transform, Load) software and data governance platforms. Additionally, strong analytical and problem-solving skills, along with the ability to communicate complex technical concepts to non-technical stakeholders, are essential soft skills for this role. By combining these technical and soft skills, Data Architects can effectively design and implement data systems that support business growth and drive informed decision-making.
Q: What is the career path for a Data Architect?
A: A Data Architect's typical career progression involves starting as a Junior Data Architect or Data Analyst, where they develop foundational skills in data modeling, database design, and data warehousing. As they gain experience, they move into mid-level roles such as Senior Data Architect or Data Governance Lead, where they oversee data strategy, architecture, and compliance. Ultimately, senior Data Architects can transition into leadership positions like Chief Data Officer or Director of Data Engineering, where they drive organizational data vision and strategy.\n\nKey opportunities for skill development and professional growth in this role include learning cloud-based data platforms, advanced data modeling techniques, and data governance frameworks, as well as staying up-to-date with emerging technologies like artificial intelligence and machine learning. \n\nLong-term career prospects for Data Architects may include transitioning into leadership roles, pursuing specialized roles like Data Scientist or Business Analyst, or exploring adjacent fields like IT Consulting or Business Intelligence.