Contractor Lead Data Engineer - Remote

We are seeking a Lead Data Engineer with expertise in PySpark, SQL, and Python. The ideal candidate has experience in designing, building, and maintaining scalable data pipelines.

Key Responsibilities:

• Design and develop scalable data pipelines using PySpark.
• Write efficient SQL and Python code to transform, cleanse, and optimize large datasets.
• Collaborate with machine learning engineers, product managers, and developers to understand data requirements.
• Implement and maintain robust ETL processes.
• Ensure data quality and integrity.
• Participate in code reviews, troubleshooting, and performance tuning.
• Work independently and proactively to resolve data issues.
• Contribute to Azure-based data solutions (if applicable).
• Support cloud migration initiatives and DevOps practices.
• Provide guidance and mentor junior team members.

Requirements:

• 8+ years overall experience with cross-functional teams.
• 3+ years hands-on experience developing and managing data pipelines with PySpark.
• Strong programming skills in Python and SQL.
• Deep understanding of ETL processes and data warehousing.
• Self-driven, resourceful, and comfortable in dynamic environments.
• Advanced written and spoken English (B2, C1, or C2).
• Proven leadership experience.
• Located in Central or South America (nearshore).
• Mandatory Requirements:
• 3+ years experience with PySpark/Python, ETL, and data warehousing
• Proven leadership experience
• Advanced English proficiency (B2 - C2)

Nice to haves:

• Databricks certification
• Azure-native service experience (ADLS, ADF, Synapse)
• Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Services, and Cosmos DB familiarity
• SAP HANA understanding
• Power BI experience
• DevOps, CI/CD pipelines, and cloud migration knowledge

Additional details:

• Contract type: Independent Contractor (no PTO, tax deductions, or insurance)
• Location: 100% remote in Central or South America
• Contract duration: Initially 6 months, possible extension
• Time zone: PST (U.S.) 8:00 AM - 5:00 PM, Monday - Friday
• Equipment: Contractor-provided laptop/PC
• Start date: ASAP
• Payment methods: International bank transfer, PayPal, Wise, Payoneer, etc.
• Process Steps: Video interview, Technical interview, CV review, and client interviews

What is the last date for applying to the job?

Which countries are accepted for this remote job?