Full-Time Azure DevOps Engineer

Job Description

For one of our clients we are looking for a DevOps Specialist (Azure/Kubernetes/Airflow).

Job details:

• 3+ months project duration
• Full-time involvment
• full remote from anywhere in Europe

Project description: The goal of the project is to migrate batched scheduled tasks from the old Secure Runtime Environment (SRE) to the new Future Modelling Platform (FMP / Azure / K8S). A set of models is part of the end-of-day process. These are hosted in the Secure Runtime Environment (SRE) and subject to a schedule organizing the execution run-time. The SRE models are reinforced by a toolset enabling modern software development via continuous integration (CI). The code is versioned using Subversion (SVN), managed, and built on a TeamCity server. By the Future Modeling Platform (FMP), a new runtime environment was established being a natural citizen of the cloud resp. Azure. This platform hosted on a Kubernetes cluster is technology-independent through Docker containers and naturally reinforced by DevOps including GIT repositories.

Tasks:

• Gaining an understanding of the model and where it is hosted in SRE, TeamCity, and SVN by interviewing the current solution owner in the Quant Method (QM)
• Initiation of the creation of a new corresponding DevOps project and FMP model
• Request and configure an Azure KeyVault
• Transfer the code from SVN to GIT repo in the corresponding DevOps project, and adjust the repo setup accordingly
• Transfer of the build, test, and deployment pipelines from TeamCity to DevOps
• Presentation of the results, and achievements so far to client for a sign-off before further use
• From the code base removal of the SRE interface and establish an application runner; this includes an analysis of the IO and programming in Java and Scala based on own professional expertise
• Refactor/code the configuration to be picked up from environment variables resp. from Azure key vault
• Modification of the deployment pipelines by targeting Docker and deploy to client’s Docker registry
• Establish in Airflow a DirectedAcylicGraph (DAG) file for FMP model configuration in the UserAcceptanceTest (UAT) environment
• Testing of the full solution stack based on own professional experience and expertise, in particular, the two use cases:
  • A machine calls the models
  • A human calls the models
• Presentation of the results achieved so far to client for a sign-off before further use
• Promotion of the solution to the production environment (PRD)
• Request to decommission the model running in SRE, toggle TeamCity pipelines to inactive
• Tracking of the daily production to monitor a smooth passage and that PRD stability is kept based on own professional experience and expertise

Qualifications

Required Skills and Experience:

• Proven expertise in Azure, Kubernetes, and Airflow.
• Strong background in DevOps practices and tools, including GIT and Azure DevOps.
• Experience with containerization technologies like Docker.
• Proficiency in programming with Java and Scala.
• Familiarity with both SVN and TeamCity, with a demonstrated ability to transition to modern CI/CD tools.
• Excellent problem-solving skills and the ability to work independently or as part of a team.
• Strong communication skills to effectively interact with team members and present to stakeholders.