Full-Time Staff Data Engineer

Requirements:

• 7+ years of experience
• Hands-on experience with Databricks on any cloud platform (Azure, AWS, or GCP)
• Strong proficiency in Python, Scala, or SQL for data processing and scripting
• Solid understanding of Big Data concepts, distributed computing, and data lake house architecture
• Design, develop, and optimize scalable ETL/ELT pipelines using Databricks
• Experience with data pipeline orchestration tools (e.g., Airflow, Azure Data Factory)
• Ensure data quality, performance tuning, and pipeline monitoring in production environments
• Provide technical leadership and contribute to architecture decisions for data platforms
• Deep knowledge of cloud services and storage (Azure Data Lake, AWS S3, GCP Cloud Storage, etc.)
• Strong debugging, performance optimization, and problem-solving skills
• Good communication and customer handling skills
• Bachelor's or Master's degree in computer science, Information Technology, or a related field

Responsibilities:

• Writing and reviewing high-quality code
• Understanding client business use cases and technical requirements, and converting them into technical designs
• Mapping decisions with requirements and translating them for developers
• Identifying and selecting the best solutions for client requirements
• Defining guidelines and benchmarks for non-functional requirements (NFRs) during project implementation
• Writing and reviewing design documents explaining application architecture, framework, and high-level design
• Reviewing architecture and design for extensibility, scalability, security, design patterns, user experience, NFRs, etc., ensuring best practices
• Developing and designing overall solutions for defined functional and non-functional requirements
• Defining technologies, patterns, and frameworks for solution implementation
• Understanding and applying technology integration scenarios
• Resolving issues through root cause analysis and justification of decisions
• Conducting Proof of Concepts (POCs) to validate design and technology choices

What is the last date for applying to the job?

Which countries are accepted for this remote job?