Documentation

openai.internal._chat_apply_cache_delimiter

(internal) Put a `${cache(args)}` on the wire: `prompt_cache_breakpoint: args` on the LAST part lowered so far (see ChatExtraPart). Nothing is sent when no part precedes the delimiter in its message, or when `args` is null (a `${cache()}` with no default, which `ai.wire.prompt_parts` removes). A second delimiter with no part in between replaces the first.

Reference version

Signature

function openai.internal._chat_apply_cache_delimiter(
delimiter: ai.CacheDelimiter
) -> void throws never

(internal) Put a ${cache(args)} on the wire: prompt_cache_breakpoint: args on the LAST part lowered so far (see ChatExtraPart). Nothing is sent when no part precedes the delimiter in its message, or when args is null (a ${cache()} with no default, which ai.wire.prompt_parts removes). A second delimiter with no part in between replaces the first.

Source:<builtin>/openai/ns_internal/chat.bamlbytes 28438–28975