Lead Data Engineer
Gravity IT Resources
To Apply for this Job Click Here
Job Title: Lead Azure Data Engineer
Location: Deerfield Beach, FL
Type: Contract
Position Overview:
The Lead Azure Data Engineer will be responsible for designing, developing, and maintaining data solutions using Microsoft Azure services. This role involves leading a team of data engineers, ensuring data architecture aligns with business needs, and driving the implementation of data engineering best practices. The ideal candidate will possess strong technical skills in SQL and Azure data services and have experience with Azure Synapse, Azure SQL, SQL Server Management Studio, and Azure Data Factory.
Key Responsibilities:
- Leadership & Team Management: Lead a team of data engineers, providing guidance, mentorship, and support to ensure successful project delivery.
- Data Architecture Design: Develop and implement scalable data architectures and solutions that meet business requirements and enhance data processing capabilities.
- Data Integration & ETL: Design and implement ETL processes using Azure Data Factory to integrate data from various sources and ensure data quality and consistency.
- Database Management: Manage and optimize Azure SQL databases and SQL Server instances to ensure high performance and reliability.
- Advanced Analytics: Utilize Azure Synapse to build and manage data warehousing solutions, enabling advanced analytics and reporting capabilities.
- Collaboration: Work closely with stakeholders, including data scientists, analysts, and business units, to understand their data needs and deliver actionable insights.
- Best Practices: Establish and enforce best practices for data engineering, including data governance, security, and compliance.
- Continuous Improvement: Stay up-to-date with the latest Azure technologies and industry trends, and recommend improvements to enhance data engineering processes and tools.
Technical Skills Required:
- SQL: Proficient in writing complex SQL queries and optimizing performance.
- Azure Synapse: Experience with data warehousing and analytics solutions using Azure Synapse Analytics.
- Azure SQL: Strong knowledge of Azure SQL databases, including setup, configuration, and optimization.
- SQL Server Management Studio (SSMS): Experience with SSMS for database management and query development.
- Azure Data Factory: Expertise in designing and managing ETL pipelines using Azure Data Factory.
Preferred Skills:
- Databricks: Experience with Apache Spark and Databricks for big data processing and analytics.
- Informatica: Knowledge of Informatica data integration tools for data extraction, transformation, and loading.
- Azure DevOps: Familiarity with Azure DevOps for CI/CD pipelines, version control, and project management.
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- 5+ years of experience in data engineering, with a focus on Azure technologies.
- Proven track record of leading data engineering projects and teams.
- Strong analytical and problem-solving skills with attention to detail.
- Excellent communication skills and the ability to work effectively with cross-functional teams.