// available for work

Abhishek Batra
Data + Agentic AI _

pipelines · models · design · plan

Apache Spark dbt Airflow Google Cloud Data Warehousing Transformers Big Data

Tech Stack

Python SQL Spark Kafka dbt Airflow Google Cloud Agentic AI LLM Docker AWS

Latest Blogs

all posts →
Data Engineering

BigQuery Data Sharing: Mastering Authorized Views and Datasets

Control Data access using Auth Views

Sep 2026 · 8 min
BigQuery GCP
Data Engineering

Scaling to Higher Loads: The Essentials of Distributed Data and Replication

Scaling is the only opton when your client wants to cater to fater requests processing with minimal lag

Aug 2026 · 8 min
distributed_data SQL
Data Engineering

Understanding OLTP Systems - Backbone of Transactional World & Robust Consistency

Online Transaction Processing (OLTP) systems - designed for fast, interactive read and write database operations

Jul 2026 · 8 min
strong-consistency durable

Projects

⚡

StreamIQ — Realtime Analytics

End-to-end pipeline ingesting 1M+ events/day using Kafka, Spark Streaming, and Delta Lake.

Kafka Spark Delta Lake Grafana
🧠

DocMind — RAG Q&A System

LLM-powered document assistant using vector embeddings and retrieval augmented generation.

LangChain FAISS FastAPI HuggingFace
🔁

DataVault — dbt Warehouse

Modular data warehouse transformation layer with CI/CD, lineage, and automated testing.

dbt Snowflake GitHub Actions
📈

PriceSignal — Forecasting Engine

Time series ML model for commodity price prediction, deployed on AWS SageMaker.

Prophet XGBoost SageMaker

YouTube Videos

channel →

BigQuery Data Ingestion

143 views· 16 min

AI On BigQuery

23 views· 10 min

Understanding Replication Algorithms

42K views· 28 min