Contractor Lead Data Engineer – Remote Job

We are seeking a highly skilled Lead Data Engineer with expertise in PySpark, SQL, Python, Azure Data Factory, Synapse, Databricks and Fabric. The ideal candidate will have a proven track record of designing, building, and maintaining scalable data pipelines.

• Design and develop scalable data pipelines using PySpark.
• Write efficient SQL and Python code to transform, cleanse, and optimize large datasets.
• Collaborate with machine learning engineers, product managers, and developers.
• Implement and maintain robust ETL processes.
• Ensure data quality, integrity, and reliability.
• Participate in code reviews, troubleshooting, and performance tuning.
• Work independently and proactively to identify and resolve data-related issues.
• Contribute to Azure-based data solutions.
• Support cloud migration initiatives and DevOps practices.
• Provide guidance to junior team members.

Experience Requirements:

• 8+ years of experience working with cross-functional teams.
• 3+ years of experience developing and managing data pipelines using PySpark.
• 3 to 5 years of experience with Azure-native services.
• Strong programming skills in Python and SQL.
• Solid experience doing ETL processes and data modeling.

Must-Have Skills:

• Advanced written and spoken English (B2, C1, or C2).
• Proven leadership experience.

Nice to Haves:

• Databricks certification
• Knowledge of DevOps and CI/CD pipelines

Location: Central or South America (nearshore position)

Contract Type: Independent contractor

Project Duration: Initially 6 months, with extension possibility.

Working Hours: Full-time, Monday to Friday (8:00 AM to 5:00 PM PST).

Equipment: Contractor is responsible for providing their own laptop.

Start Date: ASAP

What is the last date for applying to the job?

Which countries are accepted for this remote job?