Data Engineer, Madrid
Empresa
BASF
Provincia
Madrid
Ciudad
Madrid
Tipo de Contrato
Tiempo Completo
Descripción
Data Engineer
ABOUT US
At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASFs position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.
JOIN THE TEAM
The Analytics AI Implementation Services product team assists its internal business partners with their digital projects so that they become operational and can realize business value out of them.
You will a Data engineer in a project-based team that is responsible for designing, building, and maintaining data pipelines and systems that enable the organization to extract business value from its data
RESPONSIBILITIES
- Design scalable data pipelines for optimal data extraction, transformation, and loading from a wide variety of data sources using big data computation frameworks and Azure PaaS components.
- Architect and implement data layers to the development of compound AI systems with patterns like RAG
- Data modelling and architecture
- Ensure data quality and consistency in the resulting data products.
- Develop and optimize existing processes and queries to extract, manipulate, and analyse data from various sources.
- Provide technical support and guidance to business partners on data engineering.
- Stay updated with the latest trends and best practices in data engineering.
QUALIFICATIONS
- Bachelors degree or Masters in computer science, Information Systems, or a related field.
- 2-4 years of experience in data engineering tasks such as data modelling, creating, and implementing data pipelines and ETL processes. Experience with cloud computing platforms such as AWS and Azure (preferably) and Big Data architectures.
- Relational, Object-Oriented, NoSQL Database Management Systems Delta Lake storage framework
- Python
- Apache Spark and Kafka, Databricks platform
- Big Data/Big compute architecture and technologies
- MicroservicesKnowledge of software development practices: Agile (Scrum, Kanban), Medallion Architecture, CI/CD, DevOps, DataOps, IaC.
BENEFITS
- A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holiday days per year
- 5 additional days (readjustment)
- 2 cultural days
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided
At BASF, the chemistry is right.
Because we are counting on innovative solutions, on sustainable actions, and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.
ETL, Python, Spark, Kafka
ABOUT US
At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASFs position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.
JOIN THE TEAM
The Analytics AI Implementation Services product team assists its internal business partners with their digital projects so that they become operational and can realize business value out of them.
You will a Data engineer in a project-based team that is responsible for designing, building, and maintaining data pipelines and systems that enable the organization to extract business value from its data
RESPONSIBILITIES
- Design scalable data pipelines for optimal data extraction, transformation, and loading from a wide variety of data sources using big data computation frameworks and Azure PaaS components.
- Architect and implement data layers to the development of compound AI systems with patterns like RAG
- Data modelling and architecture
- Ensure data quality and consistency in the resulting data products.
- Develop and optimize existing processes and queries to extract, manipulate, and analyse data from various sources.
- Provide technical support and guidance to business partners on data engineering.
- Stay updated with the latest trends and best practices in data engineering.
QUALIFICATIONS
- Bachelors degree or Masters in computer science, Information Systems, or a related field.
- 2-4 years of experience in data engineering tasks such as data modelling, creating, and implementing data pipelines and ETL processes. Experience with cloud computing platforms such as AWS and Azure (preferably) and Big Data architectures.
- Relational, Object-Oriented, NoSQL Database Management Systems Delta Lake storage framework
- Python
- Apache Spark and Kafka, Databricks platform
- Big Data/Big compute architecture and technologies
- MicroservicesKnowledge of software development practices: Agile (Scrum, Kanban), Medallion Architecture, CI/CD, DevOps, DataOps, IaC.
BENEFITS
- A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holiday days per year
- 5 additional days (readjustment)
- 2 cultural days
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided
At BASF, the chemistry is right.
Because we are counting on innovative solutions, on sustainable actions, and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.
ETL, Python, Spark, Kafka