I'm a Python data engineer. People hand me data that is blocked behind a bot wall or scattered across pages that fight back, and I hand back a clean dataset on a schedule. Sometimes a small app to go with it. Most of what follows is live. Click a link and the thing actually runs.
| Project | What it does | Live | Code |
|---|---|---|---|
| credit-risk-system | scikit-learn risk model behind a JWT API, Dockerized | crs.shaily.dev | repo |
| shelf-bookstore | React and FastAPI store with real Stripe checkout | shelf.shaily.dev | repo |
| news-sentiment-intelligence | RSS ingest, multi-model sentiment, forecasting | news.shaily.dev | repo |
| interactive-banking-analytics | natural-language query, SHAP-explained ensemble | ibad.shaily.dev | repo |
| hotel-reviews-analysis | NLP and segmentation on ~515,738 reviews | hotel-reviews-analysis.shaily.dev | repo |
| dmqf | data-migration quality gate with anomaly detection | dmqf.shaily.dev | repo |
| deepl-translation-poc | bring-your-own-key DeepL service | translate.shaily.dev | repo |
| virtual-card-auth-demo | card-authorization pipeline on synthetic data | cardauth.shaily.dev/docs | repo |
There's also an eye-tracking demo at eyetracker.shaily.dev. Everything in one place, with a command palette, lives at portfolio.shaily.dev.
About
Python data engineer, Top Rated on Upwork. The hard part of my job is getting a scraper through Cloudflare or Incapsula or a CAPTCHA wall without getting rate-limited into the ground. After that it's cleanup and fuzzy-matching, then a schedule, then loading it wherever you need it.
Day to day that means Python, FastAPI, Flask, React, PostgreSQL, Redis, Playwright, Selenium, RapidFuzz, Docker, and scikit-learn.
I scope tight. If a site isn't worth scraping I'll say so on the first call, not after billing you for it. You get a small sample before you commit to the full run.
Tools
- Editor: nano for quick edits. Cursor when a session runs long.
- Shell: zsh, tmux, ripgrep, fzf, jq. I live in a terminal.
- AI: boilerplate only, and I read every line. It doesn't pick the architecture.
- Infra: Docker and nginx on a self-hosted box. I wrote the port allocator so every app gets a stable port instead of fighting over them.
Certifications
- AWS Certified Data Engineer, Associate: verify on Credly
- AWS Certified Cloud Practitioner: verify on Credly
- Microsoft Azure Fundamentals (AZ-900)
- ITIL v3 Foundation
Contact
- Email: shailysharmawork@gmail.com
- LinkedIn: linkedin.com/in/shailysharma873
- GitHub: github.com/SHAILY24
- Jersey City, NJ. Top Rated on Upwork.