Azure Data Engineer - East Flanders
Posted 1 day 7 hours ago by Vivid Resourcing
Azure Data Engineer (IoT & Cloud Data Streams) - East Flanders
We are looking for a Data Engineer to support the implementation of an emissions monitoring platform for a public sector organization in Belgium.
This project involves building IoT-enabled data streams in Azure, allowing for real-time remote sensing of vehicle emissions on public roads. The initiative will enable data-driven decision-making and targeted policies to improve air quality.
Beyond the initial project, additional work will involve migrating on-premise data infrastructure to the cloud, requiring expertise in ETL pipelines, data architecture, and cloud data processing.
Responsibilities:
- Design and implement data ingestion pipelines from various OLTP sources.
- Develop and optimize ETL processes in the Azure data platform.
- Build real-time and batch data streams for IoT emissions monitoring.
- Ensure data quality, security, and compliance with regulatory requirements.
- Design and implement scalable data models to support analytics and reporting.
- Provide data models for integration with Power BI and other reporting tools.
- Collaborate with cloud architects and DevOps teams to streamline data migration from on-premise systems to Azure.
- Monitor and troubleshoot data pipelines, ensuring performance and reliability.
Profile:
- 3+ years of experience as a Data Engineer.
- Strong knowledge of Azure Synapse, Azure Data Factory, and Databricks.
- Proficiency in Python for data processing and automation.
- Dutch Speaking
Additional Details:
SENIORITY: Medior/Senior
START DATE: Immediate
DURATION: End of September- Extended for other projects.
CONTRACT: Freelance
LOCATION: Aalst - 1 day on site per week
HOURS PER WEEK: 40
LANGUAGES: Dutch