Job Summary:
MDAEdge is a leader in AI and data innovation, empowering organizations to drive growth and efficiency through cutting-edge technology. They are seeking a highly skilled AI Data Engineer with hands-on experience in Langchain, AWS, and SQL to design, develop, and maintain scalable data pipelines and manage large-scale datasets.
Responsibilities:
โข Design, develop, and manage efficient data pipelines for large datasets, with a focus on scalability and performance.
โข Leverage Langchain to automate workflows, enhance AI models, and streamline data-driven processes.
โข Build and scale cloud data environments using AWS services such as S3, EC2, Lambda, Redshift, and more.
โข Write advanced SQL queries for data extraction, transformation, and analysis. Ensure database performance and integrity.
โข Partner with Data Scientists, AI Engineers, and cross-functional teams to ensure data readiness for machine learning and analytics use cases.
โข Monitor and maintain data quality, implement error-handling procedures, and ensure adherence to privacy and compliance standards.
โข Continuously improve and fine-tune data pipelines and queries for better performance and scalability.
โข Create and maintain thorough documentation of data architecture, workflows, and processes for knowledge sharing and collaboration.
Qualifications:
Required:
โข 3+ years as a Data Engineer, with a focus on AI or machine learning pipelines
โข Proven experience using Langchain to develop AI workflows and automation
โข Strong experience with large-scale data and distributed systems
โข Proficiency in SQL and hands-on experience with both relational (e.g., PostgreSQL, MySQL, SQL Server) and NoSQL databases
โข Deep familiarity with AWS services such as S3, EC2, Lambda, Redshift, and RDS
โข Proficient in Python
โข Solid understanding of database design, data modeling, and query optimization
โข Familiar with data warehousing concepts and tools
โข Experience with data pipeline orchestration tools like Apache Airflow (or similar)
โข Strong knowledge of AI/ML data workflows, including preprocessing and feature engineering
โข Bachelor's or Master's degree in Computer Science, Data Engineering, Artificial Intelligence, or a related field
โข Excellent analytical and problem-solving abilities
โข Strong communication skills, especially in explaining complex concepts to non-technical audiences
โข Ability to manage multiple priorities in a fast-paced environment
โข Collaborative and team-oriented work ethic
Preferred:
โข Experience with Apache Spark, Kafka, or other big data tools
โข Familiarity with Docker and Kubernetes for deploying scalable data solutions
โข Knowledge of AI-specific workflows, such as data preparation for natural language processing (NLP), computer vision, or other AI domains
Company:
The world doesn't have a talent shortage. It has a talent alignment problem. MDA Edge exists to fix that. Founded in , the company is headquartered in Sheridan, WY, US, , with a team of 51-200 employees. The company is currently Growth Stage.