Sensei

Sensei

microsoft

Sensei

Sensei

Iteratively improve skill frontmatter and routing test coverage for Copilot skills.

New tool
0 downloads
Free

About

When user says "sensei help" or asks how to use sensei, show this: For each skill, execute this loop until the frontmatter aligns with convention, have thorough routing tests AND routing tests pass: 1. **READ** - Load `plugins/{plugin}/skills/{skill-name}/SKILL.md`, and vally eval suites in `evals/{skill-name}/*.yaml`. 2. **VERIFY** - Compare the skill frontmatter with conventions in [CONVENTIONS](references/CONVENTIONS.md). If the skill's frontmatter violates any written convention, notify the user and propose a fix to align the frontmatter with the convention. 3. **SCAFFOLD** - If `evals/{skill-name}/` doesn't exist, follow instructions in `vally-eval` skill to scaffold a set of routing tests. The routing tests test if the skill can be invoked for target user prompts. Generate user prompts that match the target scenario of the skill's description. 4. **IMPROVE** - If the skill description doesn't already have WHEN: triggers, add them. 5. **TEST** - Follow instructions in `vally-eval` skill to run the routing tests. If there are failed tests, suggest fixes. 6. **SUMMARY** - Display before/after comparison with unimplemented suggestions. 7. **PROMPT** - Ask user to commit the fixes or take any alternative actions. 8. **REPEAT** - Go to step 2 (max 5 iterations per skill)

Key Features

Frontmatter convention verification
Routing test scaffolding and execution
Automated iteration loop with before and after summaries

Privacy & Security

Data Collection

This tool follows industry-standard security practices and only collects data necessary for functionality.

Information

Developermicrosoft
Version1.0.0
Ratingeveryone
LanguagesEnglish

Actions

  • Run sensei on a skill
  • Improve skill routing
  • Show sensei help