Full-Time Senior DevOps Engineer

• Pipeline Reliability: Maintain and monitor production data pipelines. Troubleshoot and resolve operational issues. Implement logging, alerting, and metrics.
• CI/CD and Automation: Design and manage CI/CD workflows in GitHub. Enforce consistent branching, testing, and release practices. Automate build, test, and deployment workflows.
• Infrastructure Management: Coordinate with CloudOps to manage cloud infrastructure. Maintain reproducible environments and ensure secure, efficient use of resources. Implement infrastructure and operational automation.
• Release Ops Support: Support Release Operations by integrating QA/QC validation into CI/CD processes. Partner with ReleaseOps to validate release candidates. Maintain operational runbooks and documentation.

• 4+ years of experience in Data Engineering, DevOps, or related roles.
• Hands-on experience operating distributed pipelines built with Airflow, Spark, and Python or Scala.
• Strong knowledge of GitHub workflows, CI/CD automation, and multi-environment deployments.
• Familiarity with data platforms that use SparkSQL, Iceberg, Parquet, and object storage (S3 or Azure Blob).
• Solid understanding of monitoring, alerting, and release automation.

• Experience with LakeFS for feed version management.
• Familiarity with Sedona, Shapely, or other spatial libraries.
• Understanding of data QA/QC processes and release operations workflows.

What is the last date for applying to the job?

Which countries are accepted for this remote job?