About Experience Skills 
Education Certifications
Blog Contact

Senior Data Engineer · Bengaluru, India

Vijay Ashley
Rodrigues

I build data platforms and pipelines that turn complex data into reliable, scalable systems.

Explore my work View Résumé / CV
GitHub ↗ LinkedIn ↗ XING ↗ HackerRank ↗
Vijay Ashley Rodrigues
Databricks
Data Platforms
AI × Data

About me

I'm Vijay Ashley Rodrigues, a Senior Data Engineer with over 7.7 years of experience in data engineering and technology.

I build and modernize data systems, from scalable data pipelines and cloud platforms to Spark-based processing, data quality and analytics. My current work involves technologies such as Databricks, PySpark, Azure, Snowflake, dbt, Python and SQL.

I'm also interested in how AI can be applied to data and engineering workflows, and I spend time building and experimenting with my own software and AI projects.

Experience

2021 — Present

Chubb

Senior Data Engineer

I work on modernizing data systems using dbt, Databricks, PySpark, Delta Lake and Snowflake. My work includes building reusable dbt solutions, improving data validation and optimizing data pipelines to make development and data processing more efficient.

2020 — 2021

Proziod Analytics Pvt Ltd

Data Engineer

I worked on data analysis and automation, using Python and Excel to streamline data preparation, validation and quality-checking workflows for utility auction analysis.

2019 — 2020

TEKsystems

Technical Recruiter

Skills & tools

Programming & Query Languages:

Python · SQL · PySpark · Spark SQL

Data Engineering & Processing:

Apache Spark · Delta Lake · dbt · ETL/ELT · Data Pipelines · Data Transformation · Data Integration

Cloud & Data Platforms:

Azure Databricks · Azure Data Lake Storage (ADLS) · Azure Synapse Analytics · Azure Data Factory (ADF) · Snowflake · Unity Catalog · Hive Metastore

Data Modeling, Governance & Quality:

Data Modeling · Dimensional Modeling · Data Quality · Data Migration · dbt Testing · Data Validation & Reconciliation Frameworks · Data Governance · Access Control

Orchestration, DevOps & Collaboration:

Databricks Jobs & Workflows · Apache Airflow · Git · GitHub · JIRA · Agile/Scrum

Performance Optimization:

Spark Performance Tuning · SQL Optimization · Medallion Architecture

AI, LLM & Analytics:

Snowflake Cortex Analyst · LLM Analytics · Prompt Engineering · Natural Language-to-SQL · Semantic Modeling · AI-Assisted Development (Claude Code)

BI & Analytics Platforms:

Qlik Sense · Streamlit

Projects

STREAMING / 01
Kafka
Spark
Postgres
Personal build01

Real-Time POS Transactions Monitoring

Kafka streaming, PySpark processing, PostgreSQL storage and live Streamlit monitoring.

KafkaPySparkPostgreSQLStreamlit
GENAI / 02
ABCDE
AI + data02

dbt Model Analyzer with GPT + Lineage

A Streamlit tool for model summaries, lineage graphs, column usage and environment comparison.

dbtGPTStreamlitLineage
CLOUD / 03
ON-PREM
→
AZURE SQL
migration / assessment / execution / optimization
Engineering project03

SQL Server → Azure SQL Migration

End-to-end migration work using Azure Migrate and supporting services.

AzureAzure MigrateSQL ServerAzure SQL
COMPUTER VISION / 04
⌘
Object Detection Azure AI Vision / tracking
Engineering project04

Azure AI Vision — Object Detection & Tracking

Object detection and tracking using Azure AI Vision for computer vision workflows.

Azure AIComputer VisionObject DetectionTracking
See everything on GitHub ↗

Articles & Insights

Ideas, lessons, and things I'm learning along the way.

Visit DEV.to Visit Medium.com

Education

2025–2026

Master of Data Science

Deakin University

2024–2025

Post Graduate Program in AI & Machine Learning

Texas McCombs School of Business

2016–2018

MBA — Marketing & HR

SDM College of Business Management

2013–2016

BCA & (Bachelor of Computer Applications)

St. Aloysius College

Connect with me.

LinkedIn GitHub Xing HackerRank Gmail
Résumé / CV
Native Mangaluru, Karnataka, India
Current Work Location Bengaluru, Karnataka, India
Nationality Indian
Languages Spoken English · Hindi · Kannada · Konkani · Tulu
Email rodriguesvijay92@gmail.com
Phone +91 93535 79475
Open to Relocation India & Internationally