Full-Time Staff Data Engineer

We are seeking a Staff Data Engineer to build the next generation of data pipelines and applications using emerging technologies like generative AI and large language models.

This role requires expertise in designing data integration frameworks and pipelines, and the ability to be hands-on when needed.

Responsibilities include:

• Design, build, and scale data pipelines across various source systems.
• Implement appropriate design patterns, optimizing performance, cost, security, and scale.
• Collaborate with cross-functional teams to understand data requirements and develop integration strategies.
• Become a subject matter expert in data engineering technologies.
• Coach and guide others in building scalable pipelines.
• Develop automated tests and documentation.
• Partner with data scientists, business analysts, and machine learning engineers.
• Deploy to cloud-based platforms and troubleshoot issues.
• Use tools for code & test generation.
• 8+ years of experience in a data engineering role, with a focus on leading teams.
• Some knowledge of GenAI technologies (LLMs, vector databases, AI pipelines) and Langchain.
• Understanding of Agile methodologies, REST APIs, and vectorized embeddings.
• Direct experience with data modeling, ETL/ELT development, cloud development, and data warehousing.
• Knowledge of cloud technologies (AWS, Azure, GCP).
• Experience building data pipelines using Python/SQL.
• Bachelor's degree in a relevant field (Computer Science, Data Science, etc.).

Desired Characteristics:

• Familiarity with integrating LLMs and AI-generated content.
• Proven adaptability, strong problem-solving skills, and a quick learning curve.
• Effective communication and collaboration skills.
• Ability to translate business needs into technical requirements.
• Experience with Snowflake, Amazon Web Services.
• Understanding of big data technology stacks (Hive / Spark).
• Experience moving on-prem technologies to the cloud.
• Strong understanding of Agile principles.
• Experience dealing with ambiguity and making quality decisions in a fast-paced environment.

What is the last date for applying to the job?

Which countries are accepted for this remote job?