Full-Time Engineering Sr Analyst

We are seeking a seasoned Senior Data Engineer proficient in Python, SQL, and Azure, with hands-on Databricks experience. You will construct and maintain scalable data pipelines supporting analytics, data science, and business intelligence efforts.

Responsibilities:

• Migrate legacy data infrastructure, ensuring performance, security, and scalability.
• Build and optimize data systems, pipelines, and analytical tools, utilizing a bronze-silver-gold architecture.
• Develop and configure Databricks notebooks and pipelines for data ingestion from on-premise and cloud environments, adhering to native Databricks standards.
• Collaborate with stakeholders to transform business needs into robust data solutions, communicating technical progress, risks, and recommendations.
• Implement robust data governance and access control mechanisms for data quality, security, and compliance.
• Conduct advanced data analysis to support decision-making and reporting.
• Apply QA testing practices within data workflows, particularly in healthcare environments.
• Drive Data Discovery, Data Lineage, and Data Quality initiatives.

Requirements:

• 3+ years experience in data engineering, with at least 2 years using Azure or Databricks.
• Experience with Azure Cloud, CI/CD pipelines, and Agile methodologies.
• Proficiency in developing and managing Databricks notebooks, implementing data engineering frameworks.
• Strong Python programming skills for data processing and automation.
• Advanced SQL proficiency for querying and transforming large datasets.
• Understanding of data modeling, warehousing, and performance optimization.
• Proven experience in data cataloging and inventorying large datasets. (Pyspark experience is a plus).

What is the last date for applying to the job?

Which countries are accepted for this remote job?