Hello, I'm Diego Gomes Senior Cloud Architect & Data Platform Engineer

Designing and operating large-scale cloud infrastructure on AWS, GCP, and Azure. Specialized in Kubernetes/EKS, Terraform, and Zero Trust Security. Building data platforms with Kafka, Airflow, and Spark at banking scale.

Get In Touch View GitHub

data_pipeline.py

from pyspark.sql import SparkSession
import pandas as pd

def process_fraud_data():
    # Real-time fraud detection
    spark = SparkSession.builder \
        .appName("FraudDetection") \
        .getOrCreate()
    
    return spark.sql("""
        SELECT transaction_id, risk_score
        FROM transactions 
        WHERE risk_score > 0.8
    """)

About Me

I'm a Senior Cloud Architect and Data Platform DevOps Engineer with 8+ years designing and operating large-scale cloud infrastructure. Currently at TCS/Itaú Bank, where I architect AWS environments at banking scale — delivering 99.9%+ availability and preventing R$5M+ in annual fraud losses through real-time detection platforms.

My expertise spans the full cloud stack: multi-cloud strategy (AWS + GCP + Azure), Infrastructure as Code with Terraform, Kubernetes/EKS with zero-trust security, and data platform engineering with Kafka, Airflow, NiFi, and Spark. I bridge DevSecOps pipelines with FinOps discipline — delivering ~40% cloud cost reductions without sacrificing reliability.

I hold an MBA in Cloud Architecture (FullCycle, 2025) and a Bachelor's in Internet Systems (UTFPR), complemented by postgraduate studies in Applied Artificial Intelligence (UFPR) and Data Engineering (PUC Minas), both in progress. Also a founder: I've run PyCoorp since 2017, delivering consulting and programming education.

Fluent in English and Portuguese, with advanced Spanish and intermediate Italian. Open to 100% remote opportunities — currently based in Brazil, available for roles in Portugal and Europe.

8+ Years Cloud Experience

40% Cloud Cost Reduction Delivered

5 Academic Degrees & Specializations

Professional Experience

Senior Cloud Architect / Data Platform DevOps Engineer

TCS / Itaú Bank December 2022 – Present

Designed and operated large-scale AWS environments (EKS, EC2, S3, IAM, VPC, Lambda, RDS) following the Well-Architected Framework across multiple AZs. Led multi-cloud strategy (AWS + GCP) to eliminate vendor lock-in. Built full VPC architecture with public/private subnets, ALB/NLB, Route 53, NAT Gateways, and hybrid connectivity via AWS Direct Connect. Authored reusable Terraform modules cutting provisioning time by 70%. Implemented Zero Trust security: VPC segmentation, PrivateLink, WAF, GuardDuty, IAM least-privilege, HashiCorp Vault, LGPD-aligned audit logging, and Active Directory + AWS SSO. Managed EKS clusters with RBAC, Helm, Cluster Autoscaler, and KEDA — sustaining Black Friday-level traffic spikes. Delivered ~40% cloud cost reduction through right-sizing, Reserved Instances, Savings Plans, and Spot Instances. Built DevSecOps pipelines (GitLab CI / Jenkins) with SAST gates (Fortify, Checkmarx). Supported data platform workloads with Kafka, Airflow, NiFi, Dremio, and Hive. Developed real-time fraud detection services in Java Spring and Python.

AWS EKS Terraform Kubernetes Helm Apache Kafka Apache Airflow Apache NiFi HashiCorp Vault GitLab CI Jenkins Fortify Checkmarx Splunk Python Java Spring

Cloud Engineer / Solutions Architect

NT Consult December 2021 – December 2022

Designed scalable, multi-AZ SaaS architectures on AWS (EC2, S3, Lambda, RDS, Redshift) with ALB and Route 53 failover routing. Provisioned all infrastructure via Terraform modules and CloudFormation stacks across dev, staging, and production. Built serverless data workflows with AWS Lambda (Python/Java) and CI/CD pipelines with Jenkins and CodeDeploy, reducing deployment lead time by 60%. Developed Java (Spring Boot) microservices and Python REST APIs on containerized AWS environments; built ETL pipelines on Redshift with Apache Spark.

AWS Terraform CloudFormation Apache Spark AWS Lambda Jenkins Spring Boot Python Docker

API Developer / Cloud & Data Support

Medway October 2020 – October 2022

Deployed and managed cloud applications on GCP App Engine. Developed REST APIs (Python, Django) for Content and Student Management platforms. Created PySpark scripts for data transformation and aggregation supporting analytics workloads. Participated in system and database performance analysis and orchestration of batch data processes within Scrum teams.

Python Django PySpark GCP App Engine PostgreSQL Scrum

FullStack Developer

Bedin January 2018 – December 2019

Managed internal infrastructure and provided local/remote support. Administered HFSQL databases and maintained a CakePHP + MySQL application. Developed internal web applications and BI solutions using Python and Django, including cash management, financial flow, and sales tracking systems.

Python Django CakePHP MySQL HFSQL

Python Developer (Django)

Visionnaire January 2018 – December 2018

Backend development using Django and PostgreSQL for an aviation market product. Deployed and managed the application on GCP App Engine.

Django Python PostgreSQL GCP App Engine

Founder / Cloud Consultant

PyCoorp August 2017 – Present

Cloud consulting, online systems development, and programming education. Combines technical delivery with entrepreneurial initiatives — advising clients on cloud architecture, building custom software, and running programming courses.

Cloud Consulting Python Django Software Development

Featured Projects

Functional Front-End Layout

Modern responsive front-end layout with advanced CSS Grid and Flexbox techniques, featuring dark theme and smooth animations.

HTML5 CSS3 JavaScript Responsive Design

NYC Taxi Data Analysis

Big data analysis of NYC taxi trips using PySpark and machine learning for pattern recognition and predictive modeling.

PySpark Python Pandas Jupyter

Eventex - Event Platform

Django-based event registration platform with payment integration, user management, and real-time notifications.

Django Python PostgreSQL Heroku

Bee Behavior Analysis

Data science project analyzing bee behavior patterns using Python, statistical analysis, and machine learning algorithms.

Python Pandas Scikit-learn Matplotlib

Real-time Fraud Detection

Advanced fraud detection system processing millions of transactions daily using machine learning and real-time analytics.

PySpark Kafka AWS Machine Learning

Cloud Data Pipeline

Scalable data pipeline architecture on AWS with Databricks, processing terabytes of data for business intelligence.

AWS Databricks Terraform Apache Spark

Technical Skills

Programming Languages

Python Java Go Bash SQL

Cloud Platforms

AWS EKS AWS EC2 / S3 / IAM AWS Lambda / RDS AWS VPC / Route 53 AWS Direct Connect AWS Redshift / Athena AWS WAF / GuardDuty GCP GKE / BigQuery GCP Cloud Run / App Engine Azure AKS / Azure AD

IaC & Automation

Terraform Ansible CloudFormation Helm Docker Kubernetes Cluster Autoscaler KEDA

Security & Compliance

Zero Trust IAM / RBAC HashiCorp Vault AWS Organizations / SCPs Active Directory / SSO Fortify / Checkmarx LGPD Compliance

CI/CD & DevSecOps

GitLab CI Jenkins GitHub Actions ArgoCD AWS CodeDeploy Nexus SAST Pipelines

Data Platform

Apache Kafka Apache Spark / PySpark Apache Airflow Apache NiFi Dremio Hive ETL / ELT Data Governance

Observability & FinOps

Splunk Prometheus Grafana CloudWatch Cost Explorer Reserved Instances Savings Plans Spot Instances

Databases & Back-End

PostgreSQL MySQL Snowflake BigQuery Oracle Django / Flask Spring Boot Microservices