Big Data Engineer
Łopuszańska 95, 02-457 Warszawa, Poland
Full-time
Legal Entity: Robert Bosch Sp. z o.o.
Company Description
At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people’s lives. Our promise to our associates is rock-solid: we grow together, we enjoy our work, and we inspire each other.
Job Description
Tasks:
- Being responsible for developing data pipelines in the Big Data technology stack using Python (PySpark, Hadoop/HDFS, Kafka).
- Implementing the connection to new source systems (e.g. Kafka, relational databases, REST API based services or file based data sources).
- Ensuring that your implemented artefacts are covered with automated tests and are integrated in our CI/CD pipeline.
- Supporting your development lead in the definition of the development roadmap and the breakdown of it to user stories.
- Supporting the implementation of a generic ETL framework using Python including test automatisation.
Qualifications
Profile:
- Experience in Python and respective packages/frameworks in the area of Data Engineering (PySpark, PyTest).
- Experience in the Hadoop ecosystem as a developer (Spark, HDFS, Hive/Impala, Kafka).
- Experience in common interfaces to data sources and data formats (Kafka, REST API, relational databases, file shares, JSON, Protocol Buffers, Parquet, JSON).
- Familiar with using CI/CD toolchains (GIT, Jenkins).
- Familiar with the usage of relational databases and usage of SQL.
- Feeling responsible for deliverables during the phases of build & run in a DevOps team.
- Being proactive, supportive and open for new approaches.
- Bringing in your own ideas for technical and organizational enhancements.
Additional Information
Benefits:
- Contract of employment and a competitive salary (together with annual bonus).
- Flexible working hours with home office after the pandemic as well.
- Complex environment of working, professional support and possibility to share knowledge and best practices.
- On-going development opportunities in a multinational environment.
- Broad access to professional trainings, conferences and webinars.
- Private medical care and life insurance.
- Sport pass, co-financing lunches, language courses.
- Number of benefits for families (for instance summer camps for kids).
- Referral Bonus Program.
- Non working days on the 24th and 31st of December.
Prosimy powołaj się na portal Mamo Pracuj składając aplikację
W Boschu możesz być sobą. Rozwiązania takie jak elastyczny czas pracy, półkolonie dla dzieci pracowników czy home office pozwolą Ci znaleźć równowagę między karierą a życiem osobistym, niezależnie od tego, jakie wyzwania przed Tobą stoją. U nas work-life balance idzie...