Skip to content

0.0.7
Compare
Choose a tag to compare
@ZachNagengast ZachNagengast released this 05 Jul 16:42
· 21 commits to main since this release
0.0.7
5f5b00a
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Adds RecursiveCharacterSplitter

Contributed by: @LexiestLeszek
PR: #14

Found the description on LangChain website and created my implementation, seems to be working. It will split documents recursively by different characters - starting with "\n\n", then "\n", then " ". This is nice because it will try to keep all the semantically relevant content in the same place for as long as possible.

Orig from langchain: https://js.langchain.com/docs/modules/indexes/text_splitters/examples/recursive_character

Contributors

LexiestLeszek
Assets 2
Loading