microsoft/hve-core
Publicmirrored from https://github.com/microsoft/hve-coreAvailable
evals/agent-behavior/stimuli/agentic-workflows.yml
20lines · modecode
| 1 | stimuli: |
| 2 | - name: agentic-workflows-class-recipe |
| 3 | prompt: | |
| 4 | Plan an agentic workflow for "automated nightly dependency upgrade PRs". Break it into phases with success criteria. Write the plan under `.copilot-tracking/` and report the path you wrote it to. |
| 5 | tags: |
| 6 | category: agent-behavior |
| 7 | graders: |
| 8 | - type: output-matches |
| 9 | name: phase-marker-present |
| 10 | config: |
| 11 | pattern: '(?im)(^\s*(#{2,3}\s|step\s+\d+|phase\s+\d+|\d+[.)])|\|\s*\d+\s*[—–-]|\bphases?\b)' |
| 12 | - type: output-matches |
| 13 | name: tracking-file-write |
| 14 | config: |
| 15 | pattern: '(?i)\.copilot-tracking[-/\\]' |
| 16 | - type: output-matches |
| 17 | name: no-source-edit |
| 18 | config: |
| 19 | pattern: '(?i)(\.cs|\.py|\.ts|\.js|package\.json)' |
| 20 | negate: true |
| 21 | |