Azure Data Engineers· EUR 450-550 per day (Outside IR35) · 6 month Contract · Fully Remote · Europe
Coltech Global is currently partnered with one of Europe's largest FinTech businesses working on a high-profile Azure data program.
We are currently looking for multiple Azure Data Engineers to join on a 6-month fully remote freelance project, with good chance of extending after the initial 6 months.
Responsibilities
- Develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory, Azure Databricks, or other relevant tools.
- Design and optimize data storage and retrieval systems, leveraging Azure data services such as Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB.
- Collaborate with cross-functional teams, including data scientists, business analysts, and developers, to understand data requirements and provide technical expertise in data solution design and implementation.
- Ensure data quality, integrity, and security across all stages of data processing, implementing appropriate data validation, encryption, and access controls.
- Monitor and troubleshoot data pipelines and data workflows, proactively identifying and resolving any performance issues or bottlenecks to ensure optimal data processing and availability.
Requirements
- Vast experience working with Azure Databricks Platforms
- Azure Data Lake experience
- Must have previously worked on Big Data Platforms
- Kubernetes
- Strong hands-on experience with Azure
- Have previously worked with CI/CD Pipelines
