BIG DATA ENGINEER
Milan, IT, 20145
The Big Data Engineer will work withing the Advanced Analytics Solution, whose mission is to develop and operate end-to-end automation, analytics, and AI assets to improve the Company processes and business results. The Big Data Engineer will work in close collaboration with other resources from analytics, IT, and Architecture teams to develop, industrialize, and operate data pipelines, analytics/AI models and automation software for production. She/he will also be responsible to collaborate with IT department to manage the analytics environments used by the team in the current cloud-based architecture. The Big Data Engineer will support technology scouting and the definition of solutions and standards for Data & Analytics within the Company, being part of cross-functional working groups both at local and international level.
KEY RESPONSIBILITIES
- Develop, optimize, and re-engineer data pipelines and analytics models;
- Support team members in managing the cloud-based analytics infrastructure in coordination with the IT department;
- Design and develop the activities needed to operate and monitor projects in production;
- Deliver automation and analytics artifacts in line with project plans;
- Support the scouting of new technologies, techniques and software in the Data & Analytics space;
- Participate in cross-functional working groups to represent the needs of the Advanced Analytics team and contribute to target solution definition;
KEY REQUIREMENTS/SKILLS/EXPERIENCE
- Previous experience (e.g. 1-2 years) in Engineering, contributing to the development and operations of analytics/ AI assets in large-data contexts;
- Master’s degree in Computer Science or Computer Engineering. PhD or post-graduate courses in related fields (e.g. HPC, BDE, DS) is a plus;
- Excellent knowledge of Python, PySpark, SQL, scripting, orchestration tools (Luigi, Airflow), as well as of software engineering;
- Good knowledge of relational and non-relational DBs and good understanding of ETL, CDC, and data streaming tools and techniques;
- Knowledge and experience of Microsoft Azure or AWS ecosystem
- Good knowledge of analytics and Big Data architectures (Kafka, Hadoop, Databricks, …), and of web and cloud technologies (Docker, Kubernetees, …).
- Fluent in Italian and English (both written and spoken)
- Team spirit, self-motivation, and a proactive result-driven working style
- Strong ability to work under pressure and sharply meet deadlines, self-organizing work
- Strong analysis, problem-solving, and communication skills
- Knowledge of statistics and data science topics, MLOps techniques, network communication protocols and project management will be considered as a plus
We at Allianz believe in a diverse and inclusive workforce and are proud to be an equal opportunity employer. We encourage you to bring your whole self to work, no matter where you are from, what you look like, who you love or what you believe in. We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.
Join us. Let's care for tomorrow.
Both genders may apply in accordance with the L. 903/77 (s.m.i).[GV(S1]