Full-Time Engineering Lead Analyst

Lead Data Engineer

As a Lead Data Engineer, your role is to spearhead the data engineering teams and elevate the team to the next level! You will be responsible for laying out the architecture of the new project as well as selecting the tech stack associated with it.

You will plan out the development cycles deploying AGILE if possible and create the foundations for good data stewardship with our new data products!You will also set up a solid code framework that needs to be built to purpose yet have enough flexibility to adapt to new business use cases.

Responsibilities

• Lead the design, development, and maintenance of scalable data platforms using Azure Fabric, integrating multiple data sources.
• Migrate legacy data infrastructure from Azure Synapse to Azure Fabric while ensuring performance, security, and scalability.
• Build and optimize data systems, pipelines, and analytical tools, leveraging a bronze-silver-gold architecture.
• Develop and configure Databricks notebooks and pipelines for ingestion of data from both on-premise and cloud environments, following native Databricks standards.
• Collaborate with stakeholders to translate business needs into robust data solutions, and effectively communicate technical progress, risks, and recommendations.
• Implement strong data governance and access control mechanisms to ensure data quality, security, and compliance.
• Lead and mentor junior team members, fostering technical growth and professional development.
• Conduct advanced data analysis to support decision-making and reporting needs.
• Apply QA testing practices within data workflows, particularly in healthcare environments
• Drive initiatives in Data Discovery, Data Lineage, and Data Quality across the organization.

Requirements

• Bachelor’s degree in Computer Science, Data Science, Mathematics, Information Technology, or a related field.
• 5+ years of experience as a Data Engineer or similar role, with hands-on involvement in end-to-end project execution.
• Proven experience in Azure data technologies, particularly Azure Synapse, Azure Data Factory (ADF), or Azure Fabric.
• Proficiency in developing and managing Databricks notebooks and implementing data engineering frameworks.
• Strong command of Python, with deep understanding of at least one object-oriented library.
• Advanced SQL skills and solid knowledge of relational databases and SQL-based data warehouses.
• Experience building large-scale batch and real-time data pipelines.
• Skilled in integrating and managing data from multiple sources, including data quality checks and cleanups.
• Solid understanding of data modeling, data mining, and data segmentation techniques.
• Familiarity with Data Governance principles and practices.
• Experience working with Azure Cloud, CI/CD pipelines, and Agile methodologies.
• Strong ability to work independently and a desire to lead and mentor junior Data Engineers.

What is the last date for applying to the job?

Which countries are accepted for this remote job?