Data Engineer
Data Engineer
Utrecht
Netherlands
Contract
Data Engineering and Streaming
1
For one of my clients, a leading tendering and bidding platform, I am seeking a skilled Data Engineer with expertise in Python, SQL, Spark, and AWS technologies (S3, Glue, SQS), among others.
The current data landscape includes multiple formats and models, resulting in inconsistencies. Your primary responsibilities will include building and improving the existing data platform, as well as performing comprehensive data mapping to transform data from one format to another. The goal is to create a simple and understandable data mapping process that can be easily used across the organization.
Key Responsibilities:
- Develop, maintain, and optimize scalable data pipelines and architectures for batch and real-time data processing.
- Perform complex data mapping to transform and harmonize data from multiple sources and formats into a unified model.
- Collaborate with cross-functional teams to understand business needs and ensure data quality and consistency across the platform.
- Ensure the data mapping and transformation processes are easy to comprehend and usable by stakeholders across the organization.
- Maintain and improve the current data platform to ensure its robustness, scalability, and performance.
- Optimize workflows and data architectures to enhance overall system efficiency.
Requirements:
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related fields.
- 3+ years of experience in data engineering, building and maintaining data pipelines and infrastructures.
- Strong proficiency in Python, SQL, and Spark.
- Hands-on experience with AWS services, including but not limited to S3, Glue, and SQS.
- Experience with ETL processes and familiarity with data transformation and mapping.
- Solid understanding of data modeling concepts and techniques.
- Ability to write clean, efficient, and well-documented code.
- Familiarity with CI/CD pipelines and version control.
- Experience working with large datasets and optimizing complex workflows.
Darwin Recruitment is acting as an Employment Business in relation to this vacancy.
Florian Rebel
Submit Your CV
Similar Jobs
1
ContractProduct Owner Azure Data Platform
Technology
Data Engineering and Streaming
For one of my global logistics client I’m looking Freelance Product Owner who has experience with developing a Azure Data platform. You will be See more…... See more…
to €104/year
Amsterdam
Netherlands
1
PermanentApache Flink Engineer
Technology
Data Engineering and Streaming
We are seeking a highly skilled Apache Flink Engineer to join our team here at Evoura and contribute to the development and optimization of See more…... See more…
to £120,000/year
Amsterdam
Netherlands
PermanentSenior Data Management Consultant
Technology
Data Engineering and Streaming
Data Governance Consultant (Dutch) NB: For this opportunity, we only consider candidates who are already located in The Netherlands and can speak Dutch fluently. See more…... See more…
to €95,000/year
Utrecht
Netherlands
Salary Benchmarks and
Market Insights
Are you looking for a new role? Would you like to compare your current salary
against the market rate?
Maybe you're looking to grow your team and need help planning and setting
hiring budgets.
Our interactive market update, split by industry, has all the information you need; from salary
benchmarks, gender split and average tenure to 'time to hire' and fastest-growing skills.