Full-Time Senior Big Data Engineer

Requirements:

• Total experience: 10+ years.
• Big data engineer experience: Excellent knowledge and experience.
• Strong working experience: Architecture and development in Spark, Scala, AWS (EMR, EC2, Lambda, Glue, S3), SQL Server/NoSQL.
• Hands-on experience: Hadoop, Spark, Scala, SQL, Kafka.
• Expertise in: AWS, Snowflake, procedures in Snowflake orchestrated through Airflow, hence working knowledge on Python and Airflow.
• Experience with: Building and maintaining cloud systems.
• Familiarity with: Data modeling, data warehousing, building distributed systems.
• Expertise in Spanner: High-availability, scalable database solutions.
• Knowledge of: Data governance and security practices in cloud-based environments.
• Problem-solving mindset: Tackle complex data engineering challenges.
• Strong communication & teamwork skills: Mentor and collaborate effectively.
• Bachelor's or Master's degree: Computer Science, Information Technology, or related field.

Responsibilities:

• Writing and reviewing high-quality code.
• Understanding client business use cases: Convert them into technical designs that meet requirements.
• Mapping decisions to requirements: Translate for developers.
• Identifying solutions: Narrow down best options for client requirements.
• Defining guidelines & benchmarks: NFR considerations during project implementation.
• Writing & reviewing design documents: Overall architecture, framework, high-level application design for developers.
• Reviewing architecture & design: Extensibility, scalability, security, design patterns, user experience, NFRs, best practices.
• Developing & designing solutions: Functional and non-functional requirements; defining technologies, patterns, and frameworks.
• Understanding technology integration: Applying learnings to projects.
• Resolving issues: Exhaustive systematic analysis of root causes, justification of decisions.
• Carrying out Proof of Concepts (POCs): Ensuring suggested design/technologies meet requirements.

What is the last date for applying to the job?

Which countries are accepted for this remote job?