Apache Iceberg-Considerations

Apache Iceberg — Solution Considerations Apache Iceberg is been buzzing for a while this post is to deep dive on what that means and its solution considerations What is it? Its a table format to store and interact with the Data From user perspective who are familiar in SQLs it is a way to answer the question of what data is in this table? , its not the data that’s going to be in some database, but stored in a file that reside in a data lake (like s3) and then users can interact with that table with SQL....

August 16, 2023 · 8 min · 1495 words · Me

Integrating LLM

Evaluation and Testing LLM Outputs This is one of series of articles on different solution considerations for integrating into LLMs. Question How can we evaluate and test the Large Language model outputs This is critical question among enterprises for integrating LLMs into production Their is no single answer here. Integrating to LLMs has been widespread already , their are lots of showcases, demo tutorials etc. However not many stories on integrating output response from LLMs directly into actions or to end users, especially when your business is at stake....

July 15, 2023 · 1 min · 154 words · Me