Full-Time Big Data Engineer - Azure

Big Data Engineer (Azure Databricks)

Work with the Business Analytics & Insights (BAI) team, collaborating with cross-functional teams to deliver data solutions in Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

1. Lead technical planning for data migration (ingestion, transformation, storage, access control) within Azure Data Factory and Azure Data Lake.
2. Design & implement scalable, efficient data pipelines using Azure Databricks for smooth data movement from various sources.
3. Develop reusable frameworks for large dataset ingestion.
4. Ensure data quality & integrity by implementing robust validation & cleansing mechanisms.
5. Work with event-based/streaming technologies for real-time data ingestion & processing.
6. Provide technical support during and after migration.
7. Stay updated with cloud computing, data engineering, and analytics technologies, recommending best practices for data lake solutions.

• Minimum Requirements:
• 3+ years IT experience
• 4+ years Azure Databricks experience
• Proficiency in Data Modeling and Source System Analysis
• Strong PySpark and SQL knowledge
• Experience with Azure components (Data Factory, Data Lake, SQL Data Warehouse, Azure SQL)
• Python experience for data engineering
• Data profiling, cataloging, & mapping for data flow design
• Familiarity with data visualization/exploration tools

• Soft Skills:
• Strong problem-solving skills, translating business needs into data solutions
• Excellent communication skills for technical & non-technical stakeholders
• Strong team player with excellent interpersonal skills
• Ability to deliver high-quality results within deadlines

What is the last date for applying to the job?

Which countries are accepted for this remote job?