Roy Williams 46fb917e02 Implement Anthropic prompt caching (#16274) ...

Release Notes:

- Adds support for Prompt Caching in Anthropic. For models that support
it this can dramatically lower cost while improving performance.

2024-08-15 22:21:06 -05:00

..

src

Implement Anthropic prompt caching (#16274)

2024-08-15 22:21:06 -05:00

Cargo.toml

Surface upstream rate limits from Anthropic (#16118)

2024-08-12 11:59:24 -04:00

LICENSE-AGPL

Check license generation for every PR to avoid license-less crate additions (#10033)

2024-04-01 12:16:16 +03:00