Contractor Python/ETL Developer

V-Soft Consulting is currently hiring for a Python/ETL Developer (100% remote) for our premier client.

Knowledge, Skills and Abilities

• Technologies: Talend, Terraform, Python, Shell Scripting, Docker, AWS: EC2, S3

WHAT YOULL DO:
Job Responsibilities:

• The stack is very heavy ETL, maintaining orchestrator's jobs, and supported Redshift data warehouse infrastructure.
• Involves working with but not limited to: Talend (Talend Studio, Talend Remote Engine, Talend Management Console), Terraform, Python, Shell scripting, Docker, AWS services like EC2, S3.
• Custom built solutions involving Talend.
• Mainly traditional Redshift clusters.
• The infrastructure consists of multiple aspects of Talend (Talend Remote Engine, Talend Management Console, Talend Studio), EC2 instances used to run Talend, Redshift and various repositories (Python and Terraform) for adding new sources and to manage and support the infrastructure.
• Majority of it is building the Redshift data warehouse.
• Building and maintaining ETL pipelines. Also monitoring daily jobs and address the failures if any. Also work on optimizing the performance of Redshift infrastructure using Terraform.
• Job include designing and building the ETL pipeline vs. maintaining existing ones.
• It includes managing the security aspects and fulfilling requests that come in from Cloud Engineering team.
• Maintaining Talend infrastructure.
• Also includes working with Terraform to maintain all the aspects of the Redshift cluster infrastructure using terraform templates.