All Documents
3,528 documents available
ADR: Preserve Original Memories During Chunking
Decides to keep original memory content unchanged during chunking, storing summaries and chunks as separate linked memories.
Chunking & Embeddings
Documents a chunk preview API and embedding pipeline for building a GPT chat knowledge base with FAISS indices.
Text Chunking - Anton (ChromaDB)
Summarises a talk on text chunking for RAG, covering heuristic vs semantic approaches, evaluation metrics, and practical advice.
Text Chunking - Anton (ChromaDB)
Summarises a technical session on text chunking strategies for RAG, covering heuristic and semantic approaches, evaluation metrics, and practical advice.
Check overall status
Guides an AI agent to analyze uncommitted git changes, split them into logical chunks, and create focused commits matching repository conventions.
/tmp/example-workspace/WORKSPACE.bazel:13:13
Explains Bazel's WORKSPACE chunking behavior where dependency resolution depends on load statement boundaries.
Step 7: Action Chunking
Replaces single-action prediction with a sequence of actions (chunk) to capture temporal structure, with configurable execution modes.
Document_Processing_Chunking
Describes a pluggable document processing architecture with a base class, registry, and two concrete processors for text and complex formats.
ADR-0006: Paragraph-Boundary Chunking
Splits documents into chunks at paragraph boundaries for embedding and retrieval, with configurable token limits and overlap.
20. Text Flushing and Chunking (Current Behavior)
Documents the message flushing and chunking pipeline for streaming model output to Discord, including buffer triggers, semantic protection, and humanizer ordering.
THIS EXAMPLE IS STALE. NEEDS REVAMP!
Walks through building a text chunking application with DeepDive using categorical factors and three inference rules.
Long Context Chunking
Splits long documents into overlapping chunks and averages their embeddings to avoid context limit errors.
Efficient Content Retrieval
Documents a 20x performance improvement over PostgreSQL's built-in ts_headline by precomputing TSVECTOR and word arrays and using setweight/ts_filter.
ChonkyDB One-Shot Retrieval Target
Proposes a new ChonkyDB endpoint that returns final structured records in one request, eliminating separate hydration roundtrips for Twinr's low-latency retrieval.
Search and Retrieval
Documents a 6-stage RAG search pipeline with hybrid retrieval, reranking, Chain of Thought reasoning, and source attribution.
notes_on_chunking
Distills chunking best practices from a RAG transcript, covering strategy types, evaluation metrics, and data inspection.
开放领域问答中的密集段落检索
Explains dense passage retrieval for open-domain QA and provides a code template using Simple Transformers to train a DPR model.
prompt-context-retrieval
title: Just-in-Time Context Retrieval
Papers
Lists 100+ papers on deep learning for image retrieval and hashing, each with links and brief metadata.
Chapter 3. Storage and Retrieval
Summarizes key storage engine concepts from a book chapter, covering hash indexes, LSM-trees, B-trees, OLTP/OLAP, and column-oriented storage.
Stable Chunking
Explains a coordination-free chunking strategy for causal graphs using hash hardness, with diagrams and Rust struct.
Static Hosting Performance
Explores performance bottlenecks in GitHub zip retrieval and evaluates caching strategies for edge-hosted static sites.
TileMap Chunk Manager
Divides a large tilemap into fixed-size chunks, loading and rendering only those visible to reduce memory and draw calls by over 99%.
curl-content-retrieval
Fetches a specific URL with curl to verify web resource availability and content for subdomain takeover validation.