// available for work

Abhishek Batra
Data & AI/ML Dev _

pipelines · models · design · plan

Apache Spark dbt Airflow Google Cloud Data Warehousing Transformers Big Data
Projects Blog →
GitHub LinkedIn YouTube

Tech Stack

Python SQL Spark Kafka dbt Airflow Google Cloud Agentic AI LLM Docker AWS

Latest Blogs

all posts →
Data Engineering

Understanding OLTP Systems - Backbone of Transactional World & Robust Consistency

Online Transaction Processing (OLTP) systems - designed for fast, interactive read and write database operations

Jul 2026 · 8 min
strong-consistency durable
data engineering

Building for the Future: The Three Pillars of Data-Intensive Applications

Reliability, Scalability, and Maintainability

Jun 2026 · 8 min
distributed computing data intensinve
mlops

Orchestrating ML Workflows with Airflow + MLflow

End-to-end ML pipeline orchestration combining Airflow DAGs with MLflow tracking.

May 2026 · 6 min
airflow mlflow

Projects

⚡

StreamIQ — Realtime Analytics

End-to-end pipeline ingesting 1M+ events/day using Kafka, Spark Streaming, and Delta Lake.

Kafka Spark Delta Lake Grafana
GitHub →
🧠

DocMind — RAG Q&A System

LLM-powered document assistant using vector embeddings and retrieval augmented generation.

LangChain FAISS FastAPI HuggingFace
GitHub →
🔁

DataVault — dbt Warehouse

Modular data warehouse transformation layer with CI/CD, lineage, and automated testing.

dbt Snowflake GitHub Actions
GitHub →
📈

PriceSignal — Forecasting Engine

Time series ML model for commodity price prediction, deployed on AWS SageMaker.

Prophet XGBoost SageMaker
GitHub →

YouTube Videos

channel →

OLTP Systems - Undertanding the backbone of low latency reads & writes

23 views· 46 min

dbt Tutorial for Data Engineers

31K views· 35 min

Build a Data Pipeline from Scratch

42K views· 28 min