whz/lightrag-comments
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7 Commits 1 Branch 0 Tags 194 KiB
master
Commit Graph

1 Commits

Author SHA1 Message Date
many2many
e339bfab07 [ADD]根据中文标点符号进行trunk. 
可将chunking_by_token_size的实现改为： return chunking_by_chinese_splitter(content, overlap_token_size, max_token_size, tiktoken_model)
 2024-11-17 12:31:50 +08:00