higress/plugins/wasm-go/extensions/ai-prompt-template

title, keywords, description

title	keywords	description
AI Prompt Template	AI Gateway AI Prompt Template	AI Prompt Template Configuration Reference

Function Description

AI prompt templates are used to quickly build similar types of AI requests.

Execution Properties

Plugin Execution Phase: Default Phase
Plugin Execution Priority: 500

Configuration Description

Name	Data Type	Required	Default Value	Description
templates	array of object	Required	-	Template settings

Template object configuration description:

Name	Data Type	Required	Default Value	Description
name	string	Required	-	Template name
template.model	string	Required	-	Model name
template.messages	array of object	Required	-	Input for large model

Message object configuration description:

Name	Data Type	Required	Default Value	Description
role	string	Required	-	Role
content	string	Required	-	Message

Configuration example:

templates:
- name: "developer-chat"
  template:
    model: gpt-3.5-turbo
    messages:
    - role: system
      content: "You are a {{program}} expert, in {{language}} programming language."
    - role: user
      content: "Write me a {{program}} program."

Example request body using the above configuration:

{
  "template": "developer-chat",
  "properties": {
    "program": "quick sort",
    "language": "python"
  }
}