Pondhouse Data Blog
Advanced RAG: Improving Retrieval-Augmented Generation with Hypothetical Document Embeddings (HyDE)
HyDE has an LLM write a fake answer document and searches with its embedding instead of the query's. How it works, plus a LlamaIndex example.
GenAI: Technological Masterpiece or Ecological Disaster?
GenAI's energy use is growing fast. The IEA and de Vries numbers, plus the techniques that cut it: TPUs, MoE, distillation, MoD, layer pruning and BitNet.
11 Proven Strategies to Reduce Large Language Model (LLM) Costs
Eleven ways to cut LLM costs, from shorter prompts and semantic caching to quantization, distillation, RAG and chat summaries, plus which one to try first.
How to boost your database performance with OpenAIs new v3 embeddings
OpenAI's v3 embeddings can be shortened thanks to Matryoshka training. Adaptive retrieval uses that for faster vector search: 580 QPS at 99% accuracy.
Introduction to Retrieval Augmented Generators (RAG): Enhancing Virtual Assistants with Domain-Specific Knowledge
How RAG works step by step: ingestion, chunking, embeddings, vector search and the LLM answer, and why it is easier to update than a fine-tuned model.
Advanced RAG: Increase RAG Quality with ColBERT Reranker and llamaindex
Add a ColBERT reranker to a LlamaIndex RAG pipeline: why semantic search ranks the wrong chunks first, and the Python code to rerank them before the LLM call.
Advanced RAG: Recursive Retrieval with llamaindex
Recursive retrieval in LlamaIndex links PDF tables to pandas query engines, so RAG can answer questions from table data. Step-by-step Python example.
vLLM with HTTPS: Self-Host an LLM Behind a Caddy Reverse Proxy
Serve an open-source LLM with vLLM's OpenAI-compatible Docker image and put Caddy in front as a reverse proxy for automatic HTTPS with Let's Encrypt.
RAG Evaluation with Ragas: How to Measure RAG Pipeline Quality
Evaluate a RAG pipeline with Ragas: generate a test set from your documents, then score faithfulness, answer relevancy, context recall and context precision.
Integrating enterprise knowledge with LLMs
Fine-tuning, training your own model or RAG: how each way of adding company knowledge to an LLM works, its pros and cons, and why RAG usually wins.
Showing 51 to 60 of 60 results









