Data Engineer Airflow Jobs in Pilot Point, TX (NOW HIRING)

Data Engineer

Full Time - Office Hybrid - Plano, TX Location

Position Overview: 

We are seeking a highly skilled Senior Data Engineer to join our team; In this role, you will design, develop, and maintain robust and scalable SQL Server databases in Azure. The ideal candidate will have deep expertise in T-SQL, Azure SQL Database, performance tuning, and data integration, with a strong understanding of cloud-based data architecture and DevOps practices.  Additionally, you will need to design, build, and maintain scalable data pipelines and infrastructure to support mission-critical runtime applications, including data ingest, consumption, and ETL. You will collaborate with cross-functional teams to ensure data availability, reliability, and performance, driving insights that power critical business operations.

Essential Responsibilities:

• Expertise in T-SQL: Design, develop, and optimize complex T-SQL queries, stored procedures, views, and functions.
• Data Pipeline Development: Design, develop, and optimize robust, scalable, and fault-tolerant data pipelines to process structured and unstructured data at scale.
• Performance Optimization: Optimize data systems for performance, cost-efficiency, and scalability, ensuring low-latency access to data for analytics and applications.
• Diagnostics: Troubleshoot database performance and availability issues.
• Compliance: Ensure data security, integrity, and compliance with organizational and regulatory standards.
• Collaboration: Partner with software engineers, project managers, and other stakeholders to understand data needs and deliver solutions that enable low-latency, high availability, eventually consistent consumption patterns.
• Data Quality: Implement data validation, monitoring, and governance frameworks to ensure data accuracy, consistency, and compliance with privacy and security standards.
• Tooling and Automation: Leverage modern tools and frameworks (e.g., Apache Spark, Kafka, Airflow, or equivalent) to automate data workflows and improve operational efficiency.
• Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of innovation and continuous improvement.

Preferred Qualifications & Skills:

• Experience: 5+ years of experience in data engineering or a related field, with a proven track record of building large-scale data systems.
• Bachelor's in Computer Science, Information Systems, or related field.
• Technical Skills:
  • Strong proficiency in T-SQL and query optimization.
  • Experience with Azure Data Factory, Logic Apps, and Azure Functions.
  • Familiarity with DevOps practices and tools (e.g., Azure DevOps, Git).
  • Expertise in SQL and experience with relational and NoSQL databases (e.g., MSSQL Server, PostgreSQL, MongoDB, Cassandra).
  • Strong experience with big data technologies (e.g., Hadoop, Spark, Flink) and cloud platforms (e.g., AWS, GCP, Azure).
  • Familiarity with data orchestration tools (e.g., Airflow, Dagster) and data modeling techniques.
  • Knowledge of data streaming technologies (e.g., Kafka, Azure Event Hubs) and real-time processing.
• Problem-Solving: Strong analytical and problem-solving skills, with the ability to tackle complex data challenges and deliver efficient solutions.
• Collaboration: Excellent communication and teamwork skills, with experience working in cross-functional environments.

Preferred Qualifications

• Experience with machine learning pipelines or MLOps frameworks.
• Microsoft Certified: Azure Data Engineer Associate or similar certification.
• Experience with tableau, Power BI, Synapse Analytics, or Databricks.
• Knowledge of Python or C# for data-related scripting.
• Experience in Agile/Scrum environments.
• Familiarity with data governance, compliance, and privacy regulations (e.g., SOC, NIST, GDPR, CCPA).
• Contributions to open-source data projects or relevant certifications.

Working Conditions:

Work is primarily sedentary: must be able to sit for extended periods of time and use a computer, keyboard, and mouse, frequently.

Please note that this Job Description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job.  Duties, responsibilities, and activities may change at any time with or without notice.

For more information on WIS, visit our website at www.wisusa.com

WIS is an Equal Opportunity Employer,

committed to a diverse and inclusive work environment.