logo
Sign In

Diligent LLM

function

LLMs usually demonstrate poor performance when the context window is largely occupied. This pipe is designed to handle long context by splitting the context into multiple chunks, and then concatenating the results.

grapeot
@grapeot
·
2 years ago
398
1
2.3K
Updated 2 years ago
Created Nov 29, 2024
yage_long_context.py
Python · 230 lines
"""
title: Dilligent LLM
description: LLMs usually demonstrate poor performance when the context window is largely occupied. This pipe is designed to handle long context by splitting the context into multiple chunks, and then concatenating the results.
authors: yage
author_url: https://github.com/grapoet/
funding_url: https://github.com/open-webui
version: 0.0.2
required_open_webui_version: 0.3.17
required: openai, tiktoken
license: MIT
"""

LLMs usually demonstrate poor performance when the context window is largely occupied. This pipe is designed to handle long context by splitting the context into multiple chunks, and then concatenating the results.

0