Skip to content
View debashisdash1999's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report debashisdash1999

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
debashisdash1999/README.md

Typing SVG


Email LinkedIn GitHub


Microsoft Azure Snowflake Certified Microsoft GenAI


👨‍💻 About Me

Data Engineer with 3+ years of production experience — currently working at the intersection of enterprise Azure data engineering and utility-scale analytics at TPWODL.

As a Lead Engineer at TP Western Odisha Distribution Limited (a joint venture of Tata Power and the Government of Odisha), I work on enterprise-grade data and analytics solutions that support power distribution operations across multiple Tata Power discom entities. My primary focus right now is SAP BW to Azure data modernization — migrating legacy SAP reporting infrastructure onto a modern Azure stack using ADF, Databricks, and Spark, while building Power BI solutions on top for business reporting.

Before TPWODL, I spent two years at Infosys as part of a production Snowflake data engineering team for Mercedes-Benz USA & Canada — building Bronze-Silver-Gold ELT pipelines, automating ingestion with Snowpipe, and implementing CDC using Streams and Tasks. I also worked independently at Troy Consultancy owning the internal BI function end-to-end with Power BI and SQL Server.

I hold a Snowflake Data Engineering Professional Certificate, a Microsoft Azure Essentials Professional Certificate, and a Microsoft Career Essentials in Generative AI certificate.


🏢 Current Lead Engineer, IT — TPWODL (Tata Power + Govt. of Odisha JV)
☁️ Daily Stack Azure Databricks · ADF · Apache Spark · Power BI · Oracle SQL · IBM Db2 · SAP BW
🎯 Focus Area SAP BW → Azure Modernization · Enterprise Analytics · Data Integration
🏅 Certifications Microsoft Azure Essentials · Snowflake DE Professional · Microsoft GenAI
🧱 Foundation Snowflake · ELT Pipelines · Medallion Architecture · Dimensional Modeling
📍 Location Bhubaneswar, Odisha, India

💼 Work Experience

🔵 TP Western Odisha Distribution Limited — Tata Power

Lead Engineer, IT (Data Engineering & Analytics) Jun 2026 – Present | Bhubaneswar, Odisha

TPWODL is a joint venture between the Government of Odisha and Tata Power, responsible for electricity distribution across Western Odisha. The IT data team supports analytics and reporting across all Tata Power distribution companies — CODL, WODL, NODL, SODL, DDL (Delhi), and MDL (Mumbai).

  • Working on SAP BW to Azure data modernization — migrating legacy SAP BW-based reporting infrastructure to a modern Azure data platform using Azure Data Factory, Azure Databricks, and Apache Spark
  • Building and maintaining enterprise data integration and transformation pipelines connecting Oracle SQL, IBM Db2, and SAP BW source systems into the Azure ecosystem
  • Developing Power BI dashboards and enterprise reports for business operations, analytics, and regulatory reporting across Tata Power discom entities
  • Collaborating with cross-functional business and IT teams to map data flows, gather reporting requirements, and translate them into scalable data solutions
  • Supporting data validation, quality checks, and reconciliation across source and target systems to ensure data integrity throughout the modernization process
  • Contributing to analytics solutions across multiple distribution companies under the Tata Power umbrella, with MDL (Mumbai) as a key reporting responsibility area

Stack: Azure Data Factory · Azure Databricks · Apache Spark · Power BI · Oracle SQL · IBM Db2 · SAP BW · PySpark · Spark SQL


🟠 Troy Consultancy — Odisha

Consultant (Internal BI & Data) Jul 2024 – Jun 2025

  • Designed and developed Power BI dashboards from scratch based on business requirements, improving reporting efficiency by ~30% and enabling faster decision-making across departments
  • Built data integration workflows connecting Excel, SQL Server, and web sources into Power BI for real-time operational reporting
  • Managed and maintained the employee database in SQL Server, developing queries and stored procedures for HR analytics and performance tracking
  • Optimized existing reports and queries for performance, achieving up to 25% faster load times and reducing dashboard refresh cycles

Stack: Power BI · SQL Server · DAX · Power Query · Excel


🔵 Infosys Ltd — Hyderabad, Telangana

Systems Engineer (Client: Mercedes-Benz USA & Canada) May 2021 – Jan 2023

  • Part of a production Snowflake Data Engineering team supporting Mercedes-Benz USA & Canada's analytical data platform, working across the full SDLC — from requirement analysis and dimensional modeling through pipeline development, testing, and monitoring
  • Used Azure Data Factory to orchestrate batch pipelines processing customer transactions (credit, debit, vehicle financing) across multiple dealership showrooms into Snowflake
  • Ingested and processed structured and semi-structured data (CSV, JSON, Parquet) from ADLS and AWS S3 into multi-layered Snowflake tables (Bronze → Silver → Gold)
  • Implemented Snowpipe for automated ingestion of customer interaction logs, profile updates, and vehicle service records — reducing manual processing by ~40%
  • Built Streams and Tasks for incremental data loads and CDC automation across multi-layered tables, cutting manual refresh work by ~50%
  • Monitored and optimized warehouse performance and query execution using Snowflake Account Usage views, achieving ~20% reduction in compute costs
  • Applied data validation and quality checks at ingestion and transformation stages to ensure consistency and reliability of analytical datasets
  • Used Time Travel for debugging, data recovery, and reviewing historical changes during incidents

Stack: Snowflake · Azure Data Factory · Snowpipe · Streams & Tasks · CDC · ADLS · AWS S3 · SQL · Python


🛠️ Tech Stack

☁️ Current Stack — Azure & Enterprise Data

Azure Data Factory Azure Databricks Apache Spark PySpark Azure Data Lake Power BI Oracle SQL IBM Db2 SAP BW

❄️ Previous Stack — Snowflake & ELT

Snowflake Snowpipe Streams & Tasks Cortex Code Cortex Analyst Semantic Layer YAML SQL Server AWS S3

🐍 Programming & Data Processing

Python Pandas Spark SQL DAX

🔧 Architecture & Engineering Concepts

Medallion Architecture Star Schema SCD Type 2 CDC ELT Pipelines Data Warehousing Dimensional Modeling Data Modernization


🚀 Featured Projects

🏆 End-to-End Data Engineering


End-to-end Snowflake data platform with AI-assisted development and natural language querying.

Built a Medallion Architecture (Bronze → Silver → Gold) pipeline processing 13+ source files into an analytical Star Schema with SCD Type 2 historical tracking across 80K+ records. Used Cortex Code for AI-assisted SQL and pipeline development, and built a Cortex Analyst semantic model (YAML) enabling business users to query 86K+ sales records in plain English — no SQL required.

Snowflake Cortex Code Cortex Analyst Semantic Layer SCD Type 2 Medallion Star Schema


Enterprise-style data warehouse on SQL Server with full Bronze → Silver → Gold implementation.

Integrated CRM and ERP source data, built stored procedure-based ETL logic, modeled a star schema Sales Data Mart with dim_customers, dim_products, and fact_sales, and implemented full data quality checks across layers.

SQL Server Stored Procedures Star Schema Medallion


Production-style Snowflake pipeline modeled on a food delivery platform.

Covers initial and delta loads, CDC using Streams, SCD Type 2 dimensions, a star schema fact table at order-item granularity, data governance with Tags and Masking Policies, and full automation via Stored Procedures and Tasks.

Snowflake Streams CDC Tasks SCD Type 2 Governance


Enterprise-scale retail analytics for a 5M+ customer ecommerce company across 15 countries.

Built on Snowflake with ADLS as external stage, ingesting CSV, JSON, and Parquet. Implements Bronze → Silver → Gold layers, CDC with Streams, data quality pipelines, and Gold layer views for sales performance, customer segmentation, and product analytics.

Snowflake ADLS CDC Streams Parquet JSON CSV Medallion


⚡ Snowflake Concept Projects

Project Focus
Snowflake Streams & CDC INSERT / UPDATE / DELETE change tracking using Streams with AWS S3
Snowflake Snowpipe — Automated Ingestion End-to-end Snowpipe setup, configuration, and event-based triggering
Snowflake Semi-Structured Data Handling Querying nested JSON using VARIANT and FLATTEN

🗄️ SQL Projects

Project Focus
SQL Data Cleaning Nulls, duplicates, standardization, type corrections on real-world sales data
MLB Analysis Window functions, aggregations, and performance insights on MLB data
Restaurant Order Analysis Menu and order data analysis for pricing trends and spending patterns

🐍 Python / Pandas

Project Focus
Airbnb Dataset Cleaning Missing values, outliers, type conversions, column normalization
Amazon Dataset Cleaning Product data preprocessing structured for analytics or ML pipelines

📊 Power BI

Project Focus
HR Data Analytics Report Headcount, attrition, departmental performance, and workforce KPIs
Personality Survey Report Trait distributions and behavioral patterns from survey data

🏅 Certifications & Courses

Name Issuer Year
Azure Essentials Professional Certificate Microsoft & LinkedIn 2026
Data Engineering Professional Certificate Snowflake & LinkedIn 2026
Career Essentials in Generative AI Microsoft & LinkedIn 2026
Power BI — Business Intelligence Udemy 2025
SQL for Data Analysis — Advanced SQL Udemy 2025


"Turning raw data into decisions — one pipeline at a time."


Profile Views

Popular repositories Loading

  1. snowflake_pacific_retail_end_to_end_project snowflake_pacific_retail_end_to_end_project Public

    End-to-end Snowflake Data Engineering project demonstrating real-time ingestion, CDC with Streams, automated Tasks, data quality pipelines, and Gold layer analytics for enterprise-scale retail anal…

    PLpgSQL 1

  2. snowflake_swiggy_end_to_end_data_pipeline_project snowflake_swiggy_end_to_end_data_pipeline_project Public

    2nd project on Data engineering containing End to end data pipeline.

    PLpgSQL 1

  3. debashisdash1999 debashisdash1999 Public

    Greetings and welcome to my profile.

    1

  4. end_to_end_sql_data_warehouse_prjct end_to_end_sql_data_warehouse_prjct Public

    End-to-end data engineering project using Microsoft SQL Server. Implements a layered data warehouse (Bronze, Silver, Gold) with SQL-based ETL, data cleaning, and star schema modeling from CRM and E…

    TSQL 1

  5. Snowflake-End-to-End-Data-Pipeline-with-Cortex-AI-Dynamic-Tables-Star-Schema-Modeling Snowflake-End-to-End-Data-Pipeline-with-Cortex-AI-Dynamic-Tables-Star-Schema-Modeling Public

    Production-style Snowflake data pipeline implementing Medallion Architecture (Bronze–Silver–Gold), incremental processing using Dynamic Tables, SCD Type 2 dimensions, and a semantic layer enabling …

    1

  6. sql_retail_sale_project sql_retail_sale_project Public

    Retail Sales Analysis Project This repository hosts a PostgreSQL project analyzing retail sales data with a retail_sales table. It features SQL queries for data cleaning, exploration, and insights …