benbrandt/text-splitter

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

语言：Rust · GitHub 星标：642 · Fork：33

在 GitHub 上查看原仓库