Hi, I’m Giovanni Brunetti a Big Data Engineer.

View CV gb1609@outlook.com
Portrait of Giovanni Brunetti

I’m a computer scientist based in Italy focused on working in the Big Data context.
I love writing code and solving problems with it! I have been a Big Data Engineer since 2020 across multiple domains: energy, telecommunications and insurance. In my spare time, I love to read or play video games. However, the thing I love the most is being surrounded by nature!

What I Do

Main stack

  • Spark
  • Scala
  • Python
  • SQL
  • dbt
  • Databricks
  • Delta Lake
  • Cloudera
  • Hive
  • NiFi
  • GCP
  • BigQuery
  • AWS
  • Airflow
  • Kafka

  • Developer

    Experience across several languages and project contexts. Whatever the code to write, I don't hold back. You can find some of my projects and my personal works on my GitHub page.

  • Big Data

    Experience in Big Data contexts of different kinds, both in the cloud and on-premises. Participation in all typical data phases: ingestion, modeling, ETL and analysis.

  • Team Work

    Ability to work in a team, knowledge of collaboration tools such as Git, Jira, Confluence and the Scrum methodology.

  • Design

    Ability to create software and organize the necessary structure. Organize the work and divide it.

Work and Educational Experience

Resume

Job Experience

Big Data Engineer

AgileLab

Big Data Engineer Consultant

Insurance Company
Agile Lab Consultant

Main topics:

  • Data ingestion, processing, and modeling on Cloudera and Databricks data platforms.
  • Development of Spark jobs for batch and real-time data processing.
  • Design and implementation of ETL/ELT pipelines and data workflows.
  • Data modeling, schema design, and partitioning for large-scale datasets.
  • Optimization and troubleshooting of Databricks, Delta Lake, and SQL workloads.
  • Participation in platform migration and modernization initiatives, from Cloudera to Databricks.

Big Data Engineer

VT Solutions & Consulting

Working on various internal and external (as a consultant) projects in the Big Data field.

Energy Company
VT Solutions & Consulting Consultant

Big Data Engineer for an important energy company. Main topics:

  • Development of Apache Spark batch jobs using Scala for ingestion and processing of Avro files landed in HDFS.
  • Design and development of Data Quality Spark Processing Jobs for reports based on Hive and Impala.
  • Data preparation, data modeling and data partitioning.
  • Strong focus on the transformation and analysis of data for reporting.
Telecommunication Company
VT Solutions & Consulting Consultant

Big Data Analyst on an Italian telecommunications project. The main task was to write some guideline documents about the main approaches and best practices in a Big Data platform and its reference environment. The two documents were mostly on Big Data development and architecture with particular attention to the following points:

  • Software component structure and code documentation.
  • Git integration Strategy (with particular focus on branching models like Git-Flow and GitHub-Flow, code and environment promotion).
  • Data Lake principles (data ingestion, data preparation, data exporting, testing).
  • Lambda architecture, data modeling, data preparation, partitioning.
  • Analysis for migration of Cloudera Ecosystem to Google Cloud Platform.
Telecommunication Company
VT Solutions & Consulting Consultant

Important project for a German telecommunications company. Main topics:

  • Data modeling and data partitioning in a Google Cloud Platform ecosystem using BigQuery.
  • Development of Dataflow jobs in Scala for ingestion and processing of real-time data (Avro) ingested from Kafka.
  • Development of Airflow DAGs using Python to perform ETL operations on data for DWH.
  • DWH implementation
l

Education and certifications

Education

  • Bachelor Degree in Computer Science
    University of Calabria

    Basics of programming, object-oriented programming, and the fundamental concepts of analysis, statistics and physics. Fundamentals of databases and software engineering.

  • Master Degree in Computer Science
    University of Calabria

    Key concepts regarding theoretical Computer Science, software engineering, machine learning, artificial intelligence, big data, data analytics, data warehouse etc.

  • PET B1
    University of Cambridge

    Cambridge ESOL Entry Level Certificate in ESOL International: link.

Certifications

  • GCP Professional Data Engineer
    Google Cloud

    Membership ID: rRczsH
    To see the certification click here

  • Astronomer Certification DAG Authoring for Apache Airflow
    Astronomer

    To see the certification click here

  • Astronomer Certification for Apache Airflow Fundamentals
    Astronomer

    To see the certification here

Contact

gb1609@outlook.com

Feel free to reach out by email.

Giovanni Brunetti Big Data and Software Engineer