feat: New level

This commit is contained in:
2026-05-09 22:34:02 +03:00
parent a08829eba1
commit 1f044d3371
11 changed files with 303 additions and 7 deletions
+13
View File
@@ -81,6 +81,9 @@ The root `config.toml` is an example configuration file. At minimum, you should
- `level3_output_blocked_response_text`
- `level4_input_blocked_response_text`
- `level4_output_blocked_response_text`
- `level5_input_blocked_response_text`
- `level5_output_blocked_response_text`
- `level5_exchange_blocked_response_text`
- `password_words`
Example launch command without `make`:
@@ -107,6 +110,7 @@ The level logic is built compositionally:
- Level 2: `SimpleAgent + CheckOutput`
- Level 3: `SimpleAgent + CheckInput + CheckOutput`
- Level 4: `AgentAstro + CheckInput + CheckOutput`
- Level 5: `AgentAstro + CheckInput + CheckOutput + CheckRequestResponsePair`
### Frontend
@@ -269,6 +273,15 @@ If the number of already processed requests is greater than or equal to `game.ha
- Input and output filter messages are configured separately through
`level4_input_blocked_response_text` and `level4_output_blocked_response_text`
#### Level 5
- Same behavior as Level 4
- Adds a final LLM filter that evaluates the full request/response pair together
- The pair filter can block interactions where the user prompt and agent reply are only dangerous in combination
- The messages for input, output, and pair blocking are configured separately through
`level5_input_blocked_response_text`, `level5_output_blocked_response_text`, and
`level5_exchange_blocked_response_text`
### Logging
The backend logs: