Full-Time Sr Data Engineer (Scala/Spark)

As the Senior Data Engineer for the Data & Analytics team, you will build data pipelines to land, profile, and store multiple internal & external datasets, and build applications that surface this data to support business partners’ strategic decision making for analytics solutions in the media industry.

We work in a very agile environment. Product specifications are flexible and often change rapidly.

We seek individuals comfortable with ambiguity and execution.

While the key focus is backend engineering, the ability to architect in a cyber-compliant way will be considered.

Contribute to the overall Data Product roadmap by working closely with business partners to understand their challenges and develop analytical tools.

Leverage prototyping methodologies to propose and design creative solutions.

Exploit a broad toolset of technologies (AWS tech stack, data lake, Python, Spark, Scala, Iceberg, EMR Serverless, SNS, SQS, AWS Lambda, Step Functions, Event Triggers).

Educate business partners on architecture, capabilities, best practices, and solutions.

Assist in analyzing business requirements, source systems, understanding data sources, transformation requirements, data mapping, data model, and metadata for reporting solutions.

Write easily understood documentation and architecture diagrams, and keep them up-to-date as code and frameworks change.

Requirements

Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 5+ years of relevant experience.

• 1+ year experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL and Data Warehouse methodologies and technologies.
• Demonstrated experience as an engineering lead in implementing scalable, distributed, and highly available systems using cloud technologies, specifically AWS.
• Experience in any combination of SQL, AWS EMR/Lambda, Iceberg, Linux, Python, Web technologies, APIs, Spark, Scala.
• 2+ years’ experience with AWS tech stack.
• Experience using serverless technologies is highly desirable.
• Basic understanding of relational data modeling and ability to articulate reasons for non-relational systems in architecture.
• Experience with Python and Pandas in an AWS Lambda framework is a nice to have.

Desired Characteristics

• Experience in Media industry with various linear & digital platforms (Operative One, Google Ad Manager, Freewheel, WO Traffic etc).
• Experience with Snowflake (or Redshift, SingleStore, Athena, MSSQL Server, Oracle).
• Decent understanding of media ad sales business and ad serving technologies with experience working with ad serving transactional data logs.
• Experience in any BI tool (MicroStrategy preferred, but not required).
• Strong analytical focus, results-oriented, execution-driven, with strong problem-solving skills.
• Ability and desire to work in a cross-functional team environment with people from diverse backgrounds.
• Self-driven/self-initiator, resourceful to achieve goals independently and in teams.
• Promotes open information flow for all stakeholders.
• Committed and solution-focused, with the ability to perform under pressure and meet deadlines.

Additional Requirements

Fully Remote position.

Eligible for company-sponsored benefits (medical, dental, vision insurance, 401(k), paid leave, tuition reimbursement, discounts/perks).

Salary range: $115,000 - $145,000.

Ongoing applications accepted.

External candidates may be required to attend an in-person interview.

What is the last date for applying to the job?

Which countries are accepted for this remote job?