Full-Time Big Data Engineer

Job Title: Big Data Engineer

Requirements

• BS degree in computer science, computer engineering or equivalent
• 5–6 years of experience delivering enterprise software solutions
• Proficient in Spark, Scala, Python, AWS Cloud technologies
• 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
• Flair for data, schema, data model, how to bring efficiency in big data related life cycle
• Technical requirements and can translate them into technical implementations
• Experience with Agile Development methodologies
• Experience with data ingestion and transformation
• Solid understanding of secure application development methodologies
• Experience with Airflow and Python
• Understanding of automated QA needs related to Big data
• Object-oriented design and experience approaching a problem from different angles, analyzing the pros and cons of different solutions
• Experience communicating updates and resolutions to customers and other partners

Responsibilities

• Use your software engineering skills, including Java, Spark, Python, Scala, to Analyze different, complex systems and collaboratively design new products and services
• Integrate new data sources and tools
• Implement scalable and reliable distributed data replication strategies
• Mentor and provide direction in architecture and design to onsite/offshore developers
• Collaborate with other teams to design and deploy data tools that support both operations and product use cases
• Perform analysis of large data sets using components from the Hadoop ecosystem
• Manage product features from the development, testing through to production deployment
• Evaluate big data technologies and prototype solutions to improve our data processing architecture

As a Big Data Engineer, you will be reporting to the Director, Software Development

Bachelor's degree required

Proficiency in CI/CD tools (Jenkins, GitLab, etc.)

What is the last date for applying to the job?

Which countries are accepted for this remote job?