SlidingWindow

@PublicPreviewAPI
public final class SlidingWindow


Configures the sliding window context compression mechanism.

The context window will be truncated by keeping only a suffix of it.

Summary

Public fields

final Integer

The session reduction target, i.e., how many tokens we should keep.

Public constructors

SlidingWindow(Integer targetTokens)

Public fields

targetTokens

public final Integer targetTokens

The session reduction target, i.e., how many tokens we should keep.

Public constructors

SlidingWindow

public SlidingWindow(Integer targetTokens)