Full-Time Data Engineer Senior GCP

Job Summary:

As a Data Engineer Senior GCP, you will design, develop, and maintain massive data processing solutions using Big Data technologies and GCP tools within the DF Supply team.

Key Responsibilities:

• Develop and maintain data pipelines using GCP.
• Analyze data pipeline performance and implement continuous improvement strategies.
• Design and implement complex data pipelines using Apache Kafka and Avro.
• Utilize BigQuery and BigTable for data storage and analysis.
• Develop data solutions using Scala or Java.
• Employ Hadoop, Spark, and Apache Kafka for distributed data processing.
• Maintain expertise in NoSQL databases and search engines like Elastic Search.
• Utilize CI/CD tools for automated deployment and integration.
• Work with deployment and orchestration tools like Jenkins, GitLab, Kubernetes, Docker, and Ansible.
• Create and manage application containers using Docker.
• Produce high-quality deliverables and reports.
• Evaluate code and solutions for continuous improvement.

Requirements:

• Education: Bachelor's or Master's degree in Computer Science or related field, or equivalent experience.
• Experience: More than 7 years of experience with GCP.
• Skills: Expertise in GCP, BigQuery, BigTable, Scala or Java, Hadoop, Spark, Apache Kafka, Avro, and NoSQL databases.
• Experience with CI/CD tools, containerization tools, and search engines like ElasticSearch is a plus.
• Experience in retail or large distribution is an added advantage.

What is the last date for applying to the job?

Which countries are accepted for this remote job?