mirror of
https://github.com/alibaba/higress.git
synced 2026-05-06 11:27:30 +08:00
54 lines
2.1 KiB
Markdown
54 lines
2.1 KiB
Markdown
---
|
|
title: AI Prompt Template
|
|
keywords: [ AI Gateway, AI Prompt Template ]
|
|
description: AI Prompt Template Configuration Reference
|
|
---
|
|
## Function Description
|
|
AI prompt templates are used to quickly build similar types of AI requests.
|
|
|
|
## Execution Properties
|
|
Plugin Execution Phase: `Default Phase`
|
|
Plugin Execution Priority: `500`
|
|
|
|
## Configuration Description
|
|
| Name | Data Type | Required | Default Value | Description |
|
|
|-----------------|-------------------|----------|---------------|-----------------------------------|
|
|
| `templates` | array of object | Required | - | Template settings |
|
|
|
|
Template object configuration description:
|
|
| Name | Data Type | Required | Default Value | Description |
|
|
|-----------------------|-------------------|----------|---------------|-----------------------------------|
|
|
| `name` | string | Required | - | Template name |
|
|
| `template.model` | string | Required | - | Model name |
|
|
| `template.messages` | array of object | Required | - | Input for large model |
|
|
|
|
Message object configuration description:
|
|
| Name | Data Type | Required | Default Value | Description |
|
|
|----------------|-------------------|----------|---------------|-----------------------------------|
|
|
| `role` | string | Required | - | Role |
|
|
| `content` | string | Required | - | Message |
|
|
|
|
Configuration example:
|
|
```yaml
|
|
templates:
|
|
- name: "developer-chat"
|
|
template:
|
|
model: gpt-3.5-turbo
|
|
messages:
|
|
- role: system
|
|
content: "You are a {{program}} expert, in {{language}} programming language."
|
|
- role: user
|
|
content: "Write me a {{program}} program."
|
|
```
|
|
|
|
Example request body using the above configuration:
|
|
```json
|
|
{
|
|
"template": "developer-chat",
|
|
"properties": {
|
|
"program": "quick sort",
|
|
"language": "python"
|
|
}
|
|
}
|
|
```
|