Navan Tirupathi

Retrieval Augmented Generation(RAG) Deep Dive into Best Practices & Architectures -Series 1 Retrieval-Augmented Generation (RAG) has moved far beyond the experimental phase. It is now the standard for bringing domain-specific, fresh, and private data to Large Language Models. But as we move to production, the question shifts from “How do I build a RAG app?” to “How do I optimize it for accuracy and scale?” I have covered a definitive guide on RAG best practices from different references....

This book by Steven Bartlett is an excellent read that covers essential tips for both personal and professional life. I recently came across it as an audiobook (better late than never) and was so impressed by the content that I also purchased a physical copy to add to my ‘Hall of Fame.’ The book is structured around four pillars: Self, Story, Philosophy, and Team. Here are my favorite takeaways from the book:...

In the journey to modernize your data landscape, you’ve likely come across the term “Data Mesh -” numerous times. There’s a wealth of articles, books, references, and a thriving community dedicated to this topic. In this blog post, we’ll delve into what Data Mesh really entails, explore its complexities, and determine if it’s the right architectural approach for your organization. If you prefer a more comprehensive resource on the concept, you can skip ahead and access DataMesh-Architecture, which provides in-depth information....

dbt (Data Build Tool) is fast gaining traction in the modern data platform architecture. Its primary function? To enable analysts and engineers to more efficiently transform data within their data warehouse. The DBT universe comprises two main variants: DBT Core: This open-source framework is dedicated to data transformation and is available at no cost. DBT Cloud: A managed service that offers Git-integrated code editing, job orchestration, and data quality controls, all built on the robust engine of DBT Core....

29/8/2023 Their is a common misconception that AWS Egress cost to internet is expensive( and it is) but did you know cross-region is not cheap either I have based this calculation based on AWS Sydney region as base region (Aug 29th 2023) via the cost calculator - for data transfer charges https://calculator.aws/#/estimate Region Transfer to Data Amount Cost Estimate per Month AWS Sydney region Internet First 100 GB FREE AWS Sydney region Internet 1 TB 132 USD AWS Sydney region AWS Melbourne Region 1 TB 102 USD AWS Sydney region Other Region 1 TB 120....