Back to CHUNKING.md
Automation & Efficiency
CHUNKING.md · 5 documents
CHUNKING.md
Build a PDF Search System with Mistral OCR and Weaviate DB
Builds a pipeline to upload PDFs, extract text with Mistral OCR, embed chunks via Cohere, store in Weaviate, and expose a search webhook.
airageval
0
1
nusquamaCHUNKING.md
How to recursively split text by characters
Demonstrates LangChain's RecursiveCharacterTextSplitter for splitting text by a prioritized list of separators until chunks fit a size limit.
airag
0
3
varun2430CHUNKING.md
File Chunking Configuration
Configures file chunking thresholds and timeout settings to prevent timeouts when reviewing large files with an AI code reviewer.
aillm
0
3
jordanhubbardCHUNKING.md
Enable chunking with 8 chunks (the default threshold of 8192 tokens)
Describes an optimization that overlaps matrix multiplication with all-reduce communication in RowParallelLinear layers on Intel Gaudi hardware.
aillm
0
1
vllm-projectCHUNKING.md
Property chunking
Defines a YAML schema and configuration pattern for splitting large property lists into smaller API requests and merging results back into complete records.
0
2
airbytehq