Title: Senior/Lead Data Engineer with AI
Location: 100% remote
Contract length - 1+ year
Required start date: ASAP
Recruitment process: Coding test - Technical Interview - Manager Interview - Client Interview
Description:
- We are in search of a Senior Data Engineer who is adept in SQL, Python, and Spark, and ideally with an experience in AI-related tasks and API integrations for chatbot development/integration.
- SQL Expertise: Essential for complex query handling and database manipulation.
- Python Proficiency: Required for automation, data processing, AWS Bedrock API integration, and chatbot development workflows using Boto3 SDK
- Spark Familiarity: Needed for large-scale data processing.
Requirements:
- A solid background in database engineering and software development.
- Experience with AI Agents Design and Integration
- Demonstrated ability with Python and Spark within data-intensive environments
- Experience with cloud services, particularly integrating foundation models through Bedrock runtime APIs
- Understanding of prompt engineering, system messages, and model parameter tuning for optimal AI responses
- Eager to learn and apply new technologies in data visualization, automation, AI.