Full-Time Databricks Solutions Architect

As a Databricks Solutions Architect at [DI] you will work on a variety of impactful customer technical projects, including designing and building scalable reference architectures and productionalising customer use cases within Capital Markets.

What you will be doing:

• Define end-to-end data architectures, ensuring best practices for data governance, access control, and cost optimisation using Unity Catalog and Delta Lake.
• Optimise query performance, storage and compute efficiency for various workloads.
• Develop and deploy ETL/ELT pipelines, enabling real-time and batch data processing.
• Implement best practices for data ingestion and transformation in financial market data environments.
• Guide strategic customers in adopting Databricks Lakehouse as a unified data platform for structured and unstructured market data.
• Enhance and grow your knowledge among subject matter experts in our learning and development ecosystem.

Skills and Experience:

• Proficient in data engineering, data platforms and analytics
• Deep experience with Python, SQL and/or Scala
• Knowledge of two or more common Cloud ecosystems (Azure, AWS, GCP) with expertise in at least one.
• Deep experience with distributed computing with Apache Spark
• Working knowledge CI/CD for production deployments
• Working knowledge of MLOps
• Familiarity with designing and deploying performant end-to-end data architectures
• Experience with technical project delivery, managing scope and timelines
• Able to communicate complex technical concepts to business stakeholders
• Adaptable to evolving technologies and projects
• At least one Databricks Certification, Data or ML Engineering

What is the last date for applying to the job?

Which countries are accepted for this remote job?