Allow Anthropic custom models to override temperature (#18160)

Release Notes:

- Allow Anthropic custom models to override "temperature"

This also centralized the defaulting of "temperature" to be inside of
each model's `into_x` call instead of being sprinkled around the code.
This commit is contained in:
Roy Williams
2024-09-20 14:59:12 -06:00
committed by GitHub
parent 7d62fda5a3
commit 5905fbb9ac
12 changed files with 54 additions and 17 deletions
+2
View File
@@ -99,6 +99,7 @@ impl AnthropicSettingsContent {
tool_override,
cache_configuration,
max_output_tokens,
default_temperature,
} => Some(provider::anthropic::AvailableModel {
name,
display_name,
@@ -112,6 +113,7 @@ impl AnthropicSettingsContent {
},
),
max_output_tokens,
default_temperature,
}),
_ => None,
})