Full-Time Sr. Data Engineer - Azure (Remote)

Role Summary: In this role, you’ll help design and develop technical solutions using cloud and automation technologies. Expertise with Microsoft Azure, scripting languages, and networking is essential. Experience with client-facing interactions will help define and execute innovation strategy. You'll work with the Business Development team on solutioning and proposals. Strong knowledge of core data engineering areas is needed, with expertise in at least 3 of these: Cloud architecture (Azure), Data warehousing, Data architecture, Data ETL techniques, Python programming, Back-end architecture, and Web application design. Understanding unstructured data (geospatial data, JSON, documents) and machine learning is beneficial.

Responsibilities:

1. Design, develop, and optimize scalable data pipelines and ETL processes for large datasets from diverse sources.
2. Manage and optimize Azure SQL Server databases for high performance and availability.
3. Collaborate with Data Scientists, Analysts, and Developers to understand needs and deliver solutions.
4. Develop and maintain efficient Python scripts for data transformation.
5. Create insightful data visualizations using Plotly for business intelligence.
6. Monitor and troubleshoot data pipeline issues for data quality and system reliability.
7. Identify and implement performance improvements in back-end ETL processes.
8. Enhance data and query performance to support interactive filtering.
9. Adhere to data governance, security, and privacy policies.
10. Stay updated on industry trends, tools, and best practices.
11. Contribute to project and functional area strategies.
12. Deep knowledge of Azure architecture for storage and application hosting.
13. Develop standards for scalable solutions to data storage and access challenges.
14. Assist client delivery teams with design and development based on requirements.
15. Create proposal solutioning and technical documentation, including white papers.

Qualifications:

• 5+ years of experience in data engineering or a related field.
• Bachelor's or Master's degree in a relevant field.
• Proficiency in designing and managing Azure SQL Server databases.
• Strong understanding of data warehouse design.
• Extensive experience building data pipelines and ETL processes.
• Advanced Python programming skills (pandas, NumPy, APIs).
• Azure certifications or demonstrable experience.
• Familiarity with cloud platforms (particularly Microsoft Azure).
• Strong problem-solving and collaborative skills.
• Excellent written and verbal communication skills.
• Authorization to work in the US and US residency.

Preferred Qualifications:

• Experience with other visualization tools (Tableau, Power BI)
• Containerization and orchestration experience (Docker, Kubernetes)
• Big data framework knowledge (Apache Spark, Databricks)
• Experience with CI/CD pipelines and Git.
• Familiarity with GIS Systems and geospatial data.

What is the last date for applying to the job?

Which countries are accepted for this remote job?