Full-Time Lead Data Engineer
Wiser Solutions is hiring a remote Full-Time Lead Data Engineer. The career level for this job opening is Manager and is accepting Vadodara, India based applicants remotely. Read complete job description before applying.
Wiser Solutions
Job Title
Posted
Career Level
Career Level
Locations Accepted
Share
Job Details
When looking to buy a product, finding one with desired characteristics at a reasonable price is difficult. Finding a product that is out of stock is also frustrating. Retailers often lack visibility to improve the shopping experience.
We aim to provide seamless shopping experiences by enhancing visibility for brands and retailers. Our goal is an elegant, cost-effective solution.
We collect, categorize, and analyze structured and semi-structured data from various sources (e.g., millions of products from hundreds of websites, data from thousands of stores). We help customers gain a competitive edge by discovering patterns in the data, leveraging online and in-store insights.
Responsibilities:
- Collaborate with product and engineering leaders to define data solutions supporting customer practices.
- Design, develop, and enhance data pipeline services and architecture to implement solutions.
- Mentor junior team members and share expertise with others.
- Ensure high quality standards for data management.
- Own projects from idea to production delivery.
- Contribute new ideas and innovations.
Technologies Used:
- Languages: SQL, Python
- Infrastructure: AWS, Docker, Kubernetes, Apache Airflow, Apache Spark, Apache Kafka, Terraform
- Databases: Snowflake, Trino/Starburst, Redshift, MongoDB, Postgres, MySQL
- Others: Tableau
Requirements:
- Bachelor's/Master's in Computer Science or related field
- 10+ years of professional software engineering experience
- Strong proficiency in SQL and Python
- Proficiency with Spark, Flink, and Airflow
- Experience with RDMS/NoSQL/Big Data solutions
- Understanding of streaming solutions (Kafka, Pulsar, etc.)
- Hands-on experience with Docker, Kubernetes, Terraform, and Helm
- Knowledge of ETL/ELT and OLTP/OLAP concepts
- Understanding of columnar/row-oriented data structures
- Knowledge of Apache Iceberg, or other open table formats
- Proven ability to transform data
- Understanding of AWS, Linux, and infrastructure concepts
- Ability to diagnose and address data abnormalities
- Experience building data warehouses with conformed dimensional models
- Experience with data lakes or leveraging data lake solutions
- Experience with business intelligence solutions (Tableau)
- Understanding of ML/AI pipelines (e.g., Langchain, LlamaIndex)
- Familiarity with Domain Driven Design and Microservice Architecture
- Passion for data, analytics, or machine learning
- Supervisory responsibilities including mentorship, organizing, leading agile ceremonies