Skip to content

Commit e8db2b4

Browse files
docs(evaluator): note that temperature and system prompt are fixed
1 parent 465ea3c commit e8db2b4

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎apps/docs/content/docs/workflows/blocks/evaluator.mdx‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ The range guides the model, but Sim does not clamp every returned score to it. V
3535

3636
**Content** is the text to score, usually `<agent.content>`. Structured data is formatted as text. Images and audio are not scored directly.
3737

38-
**Model** defaults to `claude-sonnet-5-5`. Select a supported model and evaluate its scores on representative content. **Temperature** and **System Prompt** are available in advanced fields. Sim Cloud supplies credentials for supported hosted models; other models and self-hosted deployments can require your own credentials.
38+
**Model** defaults to `claude-sonnet-5-5`. Select a supported model and evaluate its scores on representative content. Temperature and the system prompt aren't configurable: scoring runs at temperature 0.1, and the system prompt is generated from your metrics. Put scoring guidance in the metric descriptions or the content. Sim Cloud supplies credentials for supported hosted models; other models and self-hosted deployments can require your own credentials.
3939

4040
### Fallback models
4141

0 commit comments

Comments
 (0)