Full-Time Sr. Staff Data Engineer

The Data Management and BI Team is seeking a Sr. Staff Data Engineer to join our team.

We build data pipelines to land, profile, and store multiple internal & external datasets. We also build applications that surface this data to support business partners’ strategic decision-making.

We're an AWS shop using open-source technologies including Scala, Python, Pandas, Spark, Hive, and Postgres, as well as BI tools like Tableau and MicroStrategy. We work in an agile environment.

Responsibilities:

• Designs, builds, and oversees the deployment and operation of technology architecture, solutions and software.
• Contributor to the overall Data Product roadmap by working with business partners.
• Develops technical tools and programming leveraging AI/ML and big-data techniques.
• Leverage prototyping methodologies to propose and design business solutions.
• Creates and establishes design standards for software, systems, and applications development.
• Reviews business and product requirements for data operations.
• Design, develop, and maintain CI/CD pipelines using GitHub Actions.
• Implement and manage serverless solutions (e.g., AWS Lambda).
• Implement infrastructure as code (IaC) using tools like Terraform.
• Work with development teams to set up automated testing frameworks.
• Understand relational data modeling and non-relational systems.
• Experience with technologies like Singlestore, MySQL, Redshift, Athena, MSSQL Server, Oracle is desired.
• Decent understanding of the digital media ad sales business.
• Educate business partners on architecture and solutions.
• Assist in analyzing business requirements, data sources, and transformation requirements.
• Writing documentation and architecture diagrams.

Basic Requirements:

• Strong Computer Science background
• 10+ Years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL, and Data Warehouse methodologies and technologies.
• 5+ years experience with AWS technologies.
• Strong experience using Python and Pandas in an AWS Lambda framework is highly desired.
• Experience using EMR and/or DataBricks or the ability to read EMR code.
• Proven experience in designing and managing CI/CD pipelines, specifically using GitHub Actions.
• Demonstrated experience with Python, APIs, Spark, and Scala.
• Experience with advanced SQL, Linux, MicroStrategy, Tableau, and Pandas.
• Strong problem-solving skills.
• Strong oral and written communication skills.
• Bachelor's degree in Engineering, Computer Science, or related field with 10+ years of relevant experience.

Desired Characteristics:

• 1+ years in Digital Media Publisher Industry
• Understanding of various digital platforms.
• Understanding of how to manage code in the Enterprise Git repository.
• Ability to design optimized and performant reports.
• Ability to read external API documentation and write pipelines to extract data.
• Ability to write and stand up internal API endpoints.

Additional Requirements:

• Fully Remote Position
• Company sponsored benefits

What is the last date for applying to the job?

Which countries are accepted for this remote job?