What I Do
Resume
Education
Pet B1
University of CambridgeCambridge ESOL Entry Level Certificate in ESOL International: link.
Certifications
Membership ID: rRczsH
To see the certification click here
To see the certification click here
To see the certification here
Job Experience
Big Data Engineer
![google cloud logo](assets/images/agile.png)
Big Data Engineer Consultant
Italian Insurance Company
Agile Lab ConsultantMain Topics:
- Data modeling and data partitioning in a Cloudera Platform ecosystem.
- Development of Spark job using Scala for Ingestion and processing realtime or batch data.
- Development of NiFi pipeline to orchestrate jobs.
Big Data Engineer
Vt Solutions & ConsultingWorking on various internal and external (as a consultant) projects in Big Data field.
Italian Energy Company
Vt Solutions & Consulting ConsultantBig Data Engineer for an important Italian energy company. Main topics:
- Development of Apache Spark batch jobs using Scala for ingestion and processing of Avro file landed in HDFS.
- Design and development of Data Quality Spark Processing Jobs for reports based on Hive and Impala.
- Data preparation, data modeling and data partitioning.
- Highly focused on transformation and analysis phase of the data for reporting phase.
Italian Telephone Company
Vt Solutions & Consulting ConsultantBig Data Analyst on Italian telecommunication Project. The main task was to write some guideline documents about the main approaches and best practices in a Big Data platform and its reference environment. The two documents were mostly on Big Data development and architecture with particular attention on the following points:
- Software component structure and code documentation.
- Git integration Strategy (with particular focus on branching models like Git-Flow and GitHub-Flow, code and environment promotion).
- Data Lake principles (data ingestion, data preparation, data exporting, testing).
- Lambda architecture, data modeling, data preparation, partitioning.
- Analysis for migration of Cloudera Ecosystem to Google Cloud Platform.
German TV Company
Vt Solutions & Consulting ConsultantImportant project for German telecommunications company. Main Topics:
- Data modeling and data partitioning in a Google Cloud Platform ecosystem using Big Query.
- Development of Dataflow job using Scala for Ingestion and processing realtime data (Avro) ingested by Kafka with Dataflow.
- Development of Airflow DAGs using Python to perform ETL operations on data for DWH.
- DWH implementation
Contact With Me
Giovanni Brunetti
Big Data and Software EngineerIf you need do not hesitate to contact me!
Email: gb1609@outlook.com