Data Engineer (m/f/d), Madrid
Empresa
BASF
Provincia
Madrid
Ciudad
Madrid
Tipo de Contrato
Tiempo Completo
Descripción
Data Engineer (m/f/d)
ABOUT US
At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASFs position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.
JOIN THE TEAM
We are currently seeking a talented Data Engineer to join our team at BASFs Agricultural Solutions department Digital Factory.
RESPONSIBILITIES
- Assist in the design and development of scalable and efficient cloud-based data pipelines using Databricks and Azure Data Factory.
- Support the integration of real-time streaming solutions with Event Hubs and Kafka for data ingestion and processing.
- Help optimize data storage and transformation using Azure Data Lake Storage Gen2 (ADLS Gen2).
- Write clean and efficient code in Python and PySpark to process and analyze datasets.
- Collaborate with cross-functional teams to gather data requirements and implement solutions that align with business goals
- Monitor and troubleshoot cloud-based data platforms and pipelines, contributing to performance improvements
- Ensure adherence to data quality, governance, and security standards across data solutions.
REQUIREMENTS
- Basic knowledge of Databricks and Azure Data Factory for building data pipelines and workflows.
- Familiarity with Event Hubs and Kafka for real-time data streaming and messaging.
- Understanding of Azure Data Lake Storage Gen2 (ADLS Gen2) for data management and storage optimization
- Proficiency in programming with Python and PySpark for data engineering tasks.
- Awareness of data integration, transformation, and optimization best practices in cloud environments.
- Experience or coursework in large-scale data processing and real-time streaming architectures is a plus.
- Familiarity with Azure cloud services and related tools is advantageous
- Strong analytical and problem-solving skills with a focus on performance and scalability.
NICE TO HAVE
- Relevant coursework or certifications in Azure data engineering, cloud platforms, or related technologies.
- Exposure to CI/CD pipelines for cloud data solutions is a plus
- Basic knowledge of machine learning concepts and integration within data pipelines (optional).
BENEFITS
- Responsibility from day one in a challenging work environment and on-the-job training as part of a committed team.
- Adequate compensation according to your qualifications and experience A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holidays per year
- Another 5 days (readjustments days) and 2 days (cultural days)
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided
At BASF, the chemistry is right.
Because we are counting on innovative solutions, on sustainable actions, and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.
Contact
Do you have any questions about the application process or the position? Please reach out to Elena Perez Tornos (elena.a.perez basf.com)
A unique total offer: you BASF
At BASF you get more than just compensation. Our total offer includes a wide range of elements you need to be your best in every stage of your life. Thats what we call you BASF. Click here to learn more.
A unique total offer: you BASF
At BASF you get more than just compensation. Our total offer includes a wide range of elements you need to be your best in every stage of your life. Thats what we call you BASF. Click here to learn more.
Discover the world of BASF and develop data solutions for the Chemistry 4.0 era - for a sustainable future. Help drive the digital transformation of the chemical industry by harnessing the potential of the latest data science technologies and data sources.
About BASF
Find out what BASF has to offer as an employer and why you should join our team.
Your application
Here you find anything you need to know about your application and the application process.
Contact us
You have questions about your application or on how to apply in Europe? The BASF Talent Acquisition Europe team is glad to assist you.
Please note that we do not return paper applications including folders. Please submit copies only and no original documents.
Databricks, Azure Data Factory
ABOUT US
At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASFs position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.
JOIN THE TEAM
We are currently seeking a talented Data Engineer to join our team at BASFs Agricultural Solutions department Digital Factory.
RESPONSIBILITIES
- Assist in the design and development of scalable and efficient cloud-based data pipelines using Databricks and Azure Data Factory.
- Support the integration of real-time streaming solutions with Event Hubs and Kafka for data ingestion and processing.
- Help optimize data storage and transformation using Azure Data Lake Storage Gen2 (ADLS Gen2).
- Write clean and efficient code in Python and PySpark to process and analyze datasets.
- Collaborate with cross-functional teams to gather data requirements and implement solutions that align with business goals
- Monitor and troubleshoot cloud-based data platforms and pipelines, contributing to performance improvements
- Ensure adherence to data quality, governance, and security standards across data solutions.
REQUIREMENTS
- Basic knowledge of Databricks and Azure Data Factory for building data pipelines and workflows.
- Familiarity with Event Hubs and Kafka for real-time data streaming and messaging.
- Understanding of Azure Data Lake Storage Gen2 (ADLS Gen2) for data management and storage optimization
- Proficiency in programming with Python and PySpark for data engineering tasks.
- Awareness of data integration, transformation, and optimization best practices in cloud environments.
- Experience or coursework in large-scale data processing and real-time streaming architectures is a plus.
- Familiarity with Azure cloud services and related tools is advantageous
- Strong analytical and problem-solving skills with a focus on performance and scalability.
NICE TO HAVE
- Relevant coursework or certifications in Azure data engineering, cloud platforms, or related technologies.
- Exposure to CI/CD pipelines for cloud data solutions is a plus
- Basic knowledge of machine learning concepts and integration within data pipelines (optional).
BENEFITS
- Responsibility from day one in a challenging work environment and on-the-job training as part of a committed team.
- Adequate compensation according to your qualifications and experience A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holidays per year
- Another 5 days (readjustments days) and 2 days (cultural days)
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided
At BASF, the chemistry is right.
Because we are counting on innovative solutions, on sustainable actions, and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.
Contact
Do you have any questions about the application process or the position? Please reach out to Elena Perez Tornos (elena.a.perez basf.com)
A unique total offer: you BASF
At BASF you get more than just compensation. Our total offer includes a wide range of elements you need to be your best in every stage of your life. Thats what we call you BASF. Click here to learn more.
A unique total offer: you BASF
At BASF you get more than just compensation. Our total offer includes a wide range of elements you need to be your best in every stage of your life. Thats what we call you BASF. Click here to learn more.
Discover the world of BASF and develop data solutions for the Chemistry 4.0 era - for a sustainable future. Help drive the digital transformation of the chemical industry by harnessing the potential of the latest data science technologies and data sources.
About BASF
Find out what BASF has to offer as an employer and why you should join our team.
Your application
Here you find anything you need to know about your application and the application process.
Contact us
You have questions about your application or on how to apply in Europe? The BASF Talent Acquisition Europe team is glad to assist you.
Please note that we do not return paper applications including folders. Please submit copies only and no original documents.
Databricks, Azure Data Factory