Full Stack Data Engineer
Full stack Data Engineer building intelligent Data Platform and Products
SQL Server, Azure Synapse, DynamoDB, PostgreSQL, BigQuery, MongoDB, Cosmos DB and cloud-native database solutions. Expertise in data modeling, query optimization and database architecture across relational and NoSQL systems. Database Migration from On-Premise to Cloud. SQL to NoSQL.
Building scalable ETL/ELT pipelines with Apache Spark, Kafka, Airflow and dbt. Data warehousing, lakehouse architecture with Delta Lake, and cloud platforms on AWS, Azure and GCP. Infrastructure as Code with Terraform and Docker. Medallion Architecture, Data Vault. Re-Architecture from Data Lake to Lakehouse. Implemented New Lakehouse using Data Mesh.
End-to-end ML systems from feature engineering to production deployment. Deep learning with TensorFlow and PyTorch, NLP, MLOps, and Generative AI including LLMs, RAG pipelines, prompt engineering and AI-powered applications with LangChain.
Technologies and tools I work with daily