Full-Time Big Data Engineer

Job Requirements

• BS degree in computer science, computer engineering or equivalent
• 5 – 6 years of experience delivering enterprise software solutions
• Proficient in Spark, Scala, Python, AWS Cloud technologies
• 3+ years of experience across multiple Hadoop / Spark technologies (Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala)
• Flair for data, schema, data model, bringing efficiency in big data lifecycle
• Quickly understand technical and business requirements, translate them into technical implementations
• Experience with Agile Development methodologies
• Experience with data ingestion and transformation
• Solid understanding of secure application development methodologies
• Experience with Airflow and Python preferred
• Understanding of automated QA needs related to Big data
• Strong object-oriented design and analysis skills
• Excellent written and verbal communication skills

Responsibilities

• Utilize software engineering skills (Java, Spark, Python, Scala) to analyze disparate, complex systems; collaboratively design new products/services
• Integrate new data sources and tools
• Implement scalable, reliable distributed data replication strategies
• Mentor and provide direction in architecture/design to onsite/offshore developers
• Collaborate with teams to design, develop, deploy data tools supporting operations and product use cases
• Perform analysis of large data sets using Hadoop ecosystem components
• Own product features from development, testing to production deployment
• Evaluate big data technologies; prototype solutions to improve data processing architecture
• Automate everything

What is the last date for applying to the job?

Which countries are accepted for this remote job?