validation-coordinator
π―Skillfrom matteocervelli/llms
validation-coordinator skill from matteocervelli/llms
Part of
matteocervelli/llms(33 items)
Installation
git clone https://github.com/matteocervelli/llms.gitpython -m src.tools.doc_fetcher fetch --provider anthropicpython -m src.tools.skill_builder create --name my-skill --template basicpython -m src.tools.command_builder create --name my-commandpython -m src.tools.agent_builder create --name my-agentSkill Details
Auto-activates when coordinating sequential validation specialists with
Purpose
The validation-coordinator skill provides structured methods for managing sequential validation specialist invocation, tracking validation workflow progress, and ensuring all quality gates are satisfied before deployment. It handles specialist dependencies, failure tracking, and overall validation status reporting.
When to Use
This skill auto-activates when you:
- Coordinate sequential validation specialists (5-6 specialists)
- Manage validation workflow across test writing, test execution, quality checks, and security scans
- Track validation progress and status
- Ensure specialist dependencies are satisfied (e.g., tests written before execution)
- Monitor validation failures and re-validation cycles
- Generate comprehensive validation status reports
- Prepare validation results for deployment phase
Provided Capabilities
1. Sequential Specialist Invocation
- Specialist Ordering: Invoke specialists in correct sequence with dependencies
- Prerequisite Validation: Ensure each specialist's inputs are ready before invocation
- Invocation Tracking: Log each specialist invocation with timestamp
- Status Monitoring: Track specialist status (pending, in-progress, completed, failed)
2. Validation Workflow Management
- Phase Tracking: Monitor validation phases (test writing, test execution, quality, security)
- Dependency Resolution: Ensure specialists run in order (unit tests β integration tests β test execution)
- Workflow Visualization: Provide clear view of validation progress
- Completion Detection: Identify when all validations complete
3. Failure Tracking
- Failure Logging: Record all validation failures with details
- Iteration Tracking: Count re-validation attempts per specialist
- Failure Analysis: Identify patterns in validation failures
- Escalation Detection: Flag specialists exceeding max iterations
4. Overall Validation Status
- Aggregate Status: Compute overall validation status (in-progress, passed, failed)
- Quality Gate Tracking: Monitor each quality gate (tests, coverage, quality, security)
- Pass/Fail Reporting: Report which validations passed/failed
- Readiness Assessment: Determine if feature is ready for deployment
5. Validation Documentation
- Status Reports: Generate validation status snapshots
- Progress Logs: Maintain detailed validation history
- Summary Generation: Create concise validation summaries
- Metrics Collection: Track validation time, iterations, and success rates
Usage Guide
Step 1: Initialize Validation Workflow
Load implementation artifacts and initialize validation state:
```bash
# Load PRP to understand what was implemented
/docs/implementation/prp/feature-{issue-number}-prp.md
# Identify implementation files
[Files listed in PRP or passed by orchestrator]
```
Initialization:
```markdown
Validation Workflow Initialized
Issue: #{issue-number}
Feature: [Feature Name]
Technology Stack: [Python, TypeScript, Swift, etc.]
Frontend: [Yes/No - determines if E2E specialist needed]
Validation Phases:
- Test Writing (Unit + Integration)
- Test Execution (Test Runner)
- Code Quality (Linting, Typing, Formatting)
- Security (Security Scan, OWASP)
- E2E & Accessibility (Frontend only)
Specialist Status:
- [ ] Unit Test Specialist: Pending
- [ ] Integration Test Specialist: Pending
- [ ] Test Runner Specialist: Pending
- [ ] Code Quality Specialist: Pending
- [ ] Security Specialist: Pending
- [ ] E2E & Accessibility Specialist: [Pending/N/A]
Overall Status: Pending
```
Step 2: Invoke Specialists Sequentially
Use validation-workflow.md for detailed specialist invocation procedures.
Sequential Invocation Pattern:
```markdown
FOR EACH specialist IN validation_sequence:
1. Check Prerequisites:
- Are required inputs ready?
- Did previous specialists complete successfully?
2. Update Status:
- Mark specialist as "In Progress"
- Log invocation timestamp
3. Invoke Specialist:
- Call specialist with required inputs
- Pass context (PRP, implementation files, previous outputs)
4. Wait for Completion:
- Monitor specialist progress
- Capture specialist output
5. Check Specialist Result:
- IF specialist passes:
a. Mark specialist as "Completed"
b. Log success with timestamp
c. Proceed to next specialist
- IF specialist fails:
a. Mark specialist as "Failed (iteration X)"
b. Log failure details
c. Trigger recursive communication (handled by recursive-communicator skill)
d. Wait for main agent to fix
e. Re-invoke specialist (increment iteration)
f. Repeat until success OR max iterations (5)
6. Update Overall Status:
- Recalculate validation progress
- Update quality gate checklist
```
Specialist Dependencies:
```markdown
Dependency Chain
Unit Test Specialist
β (requires unit tests written)
Integration Test Specialist
β (requires integration tests written)
Test Runner Specialist
β (requires all tests pass + coverage β₯80%)
Code Quality Specialist
β (requires quality checks pass)
Security Specialist
β (requires security scan pass)
E2E & Accessibility Specialist (Frontend only)
β (requires E2E tests pass + WCAG compliant)
Deployment Ready
```
Step 3: Track Validation Progress
Use validation-checklist.md for comprehensive quality gate tracking.
Validation Checklist:
```markdown
Validation Progress
Phase 1: Test Writing
- [β ] Unit tests written (Specialist: unit-test-specialist, Iteration: 1/1)
- [β ] Integration tests written (Specialist: integration-test-specialist, Iteration: 1/1)
Phase 2: Test Execution
- [β οΈ] All tests pass (Specialist: test-runner-specialist, Iteration: 2/5, Status: Failed)
- Failure: 3 unit tests failing in test_feature_47.py
- Action: Recursive communication triggered, awaiting main agent fix
- [ ] Code coverage β₯80% (Pending test success)
Phase 3: Code Quality
- [ ] Linting pass (Pending: awaiting test success)
- [ ] Type checking pass (Pending: awaiting test success)
- [ ] Formatting compliant (Pending: awaiting test success)
Phase 4: Security
- [ ] Security scan clean (Pending: awaiting quality pass)
- [ ] OWASP Top 10 compliant (Pending: awaiting quality pass)
Phase 5: E2E & Accessibility [FRONTEND ONLY]
- [N/A] E2E tests pass (Backend feature - specialist not invoked)
- [N/A] WCAG 2.1 AA compliant (Backend feature - specialist not invoked)
Overall Status: In Progress (Phase 2, Iteration 2)
Blocking Issue: Test failures in unit tests
Next Action: Awaiting main agent fix β re-run tests
```
Progress Metrics:
```markdown
Validation Metrics
Specialists Completed: 2/5 (40%)
Specialists In Progress: 1/5 (Test Runner - Iteration 2)
Specialists Pending: 2/5 (Code Quality, Security)
Total Iterations: 3 (Unit Test: 1, Integration Test: 1, Test Runner: 1 initial + 1 retry)
Elapsed Time: 00:15:32
Estimated Remaining: ~00:10:00 (based on remaining specialists)
```
Step 4: Monitor Quality Gates
Track each quality gate individually:
Quality Gate Tracking:
```markdown
Quality Gate Status
| Gate | Status | Details | Iterations | Last Updated |
|------|--------|---------|------------|--------------|
| Unit Tests Written | β PASS | 45 tests created | 1 | 2025-10-29 14:23:15 |
| Integration Tests Written | β PASS | 12 tests created | 1 | 2025-10-29 14:28:42 |
| All Tests Pass | β οΈ FAIL | 3 failures remaining | 2 | 2025-10-29 14:35:18 |
| Coverage β₯80% | βΈοΈ PENDING | Awaiting test pass | - | - |
| Linting | βΈοΈ PENDING | Awaiting test pass | - | - |
| Type Checking | βΈοΈ PENDING | Awaiting test pass | - | - |
| Formatting | βΈοΈ PENDING | Awaiting test pass | - | - |
| Security Scan | βΈοΈ PENDING | Awaiting quality pass | - | - |
| OWASP Compliance | βΈοΈ PENDING | Awaiting quality pass | - | - |
Gates Passed: 2/9 (22%)
Gates Failed: 1/9 (11%)
Gates Pending: 6/9 (67%)
```
Step 5: Handle Specialist Failures
When specialist fails, coordinate with recursive-communicator:
Failure Handling:
```markdown
Specialist Failure: test-runner-specialist (Iteration 2/5)
Failures Detected:
- test_validation_coordinator.py::test_sequential_invocation - AssertionError
- test_validation_coordinator.py::test_failure_tracking - KeyError
- test_validation_coordinator.py::test_workflow_completion - AttributeError
Failure Analysis:
- Pattern: All failures in validation-coordinator tests
- Root Cause: Implementation logic errors in specialist invocation
- Impact: Blocks validation workflow progression
Action Taken:
- Logged failure details
- Triggered recursive-communicator skill
- Formatted failure report for main agent
- Awaiting main agent fix
Re-validation Plan:
- Main agent fixes implementation logic
- Main agent signals completion
- Re-invoke test-runner-specialist (Iteration 3/5)
- If pass: Proceed to code quality
- If fail: Repeat (max 5 iterations total)
Status: Awaiting Fix
```
Step 6: Generate Validation Status Reports
Create status snapshots for orchestrator and main agent:
Status Report Format:
```markdown
Validation Status Report
Generated: 2025-10-29 14:40:22
Issue: #47 - Validation Orchestrator Agent
Overall Status: β οΈ IN PROGRESS
Summary
Validation in progress. Unit and integration tests written successfully. Test execution encountered 3 failures (iteration 2/5). Recursive communication with main agent active for fixes.
Specialist Status
| Specialist | Status | Iteration | Result |
|------------|--------|-----------|--------|
| Unit Test Specialist | β Completed | 1/1 | 45 unit tests created |
| Integration Test Specialist | β Completed | 1/1 | 12 integration tests created |
| Test Runner Specialist | β οΈ In Progress | 2/5 | 3 test failures |
| Code Quality Specialist | βΈοΈ Pending | - | Awaiting test pass |
| Security Specialist | βΈοΈ Pending | - | Awaiting quality pass |
| E2E Specialist | N/A | - | Backend only |
Quality Gates
- β Unit tests written (45 tests)
- β Integration tests written (12 tests)
- β οΈ All tests pass (3 failures)
- βΈοΈ Coverage β₯80% (pending)
- βΈοΈ Code quality (pending)
- βΈοΈ Security scan (pending)
Current Blocking Issue
Test Failures (3):
- test_validation_coordinator.py::test_sequential_invocation
- test_validation_coordinator.py::test_failure_tracking
- test_validation_coordinator.py::test_workflow_completion
Action: Recursive communication with main agent for fixes
Progress
- Specialists Completed: 2/5 (40%)
- Validation Time: 00:15:32
- Estimated Remaining: ~00:15:00 (including fix time)
Next Steps
- Await main agent fixes for test failures
- Re-run test-runner-specialist (iteration 3/5)
- If pass: Proceed to code-quality-specialist
- Continue sequential validation workflow
```
Step 7: Detect Validation Completion
Identify when all validations pass:
Completion Detection:
```markdown
Validation Complete Check
All Specialists Complete?
- [β ] Unit Test Specialist: Completed
- [β ] Integration Test Specialist: Completed
- [β ] Test Runner Specialist: Completed (iteration 3)
- [β ] Code Quality Specialist: Completed (iteration 1)
- [β ] Security Specialist: Completed (iteration 2)
- [N/A] E2E Specialist: Not applicable (backend only)
All Quality Gates Passed?
- [β ] Unit tests written: 45 tests
- [β ] Integration tests written: 12 tests
- [β ] All tests pass: 57/57
- [β ] Coverage β₯80%: 87.3%
- [β ] Linting: No errors
- [β ] Type checking: No errors
- [β ] Formatting: Compliant
- [β ] Security scan: Clean
- [β ] OWASP Top 10: Compliant
Result: β ALL VALIDATIONS PASSED
Total Validation Time: 00:42:15
Total Iterations: 6 (across all specialists)
Ready for Phase 6: Deployment
```
Step 8: Generate Final Validation Summary
Create comprehensive summary for validation report:
Final Summary Format:
```markdown
Validation Summary: Feature #47
Overall Status: β ALL VALIDATIONS PASSED
Execution Summary
- Total Specialists Invoked: 5 (E2E not needed - backend only)
- Total Iterations: 6
- Unit Test Specialist: 1
- Integration Test Specialist: 1
- Test Runner Specialist: 3 (2 re-runs after fixes)
- Code Quality Specialist: 1
- Security Specialist: 2 (1 re-run after fix)
- Total Validation Time: 00:42:15
- Recursive Fix Cycles: 2 (test failures, security vulnerability)
Quality Gates Achieved
- β 45 unit tests written and passing
- β 12 integration tests written and passing
- β 87.3% code coverage (target: β₯80%)
- β Zero linting errors
- β Zero type errors
- β Code formatting compliant
- β Zero security vulnerabilities
- β OWASP Top 10 compliant
Validation Documentation
- Test Report: /docs/implementation/tests/feature-47-tests.md
- Quality Report: /docs/implementation/quality/feature-47-quality.md
- Security Report: /docs/implementation/security/feature-47-security.md
Issues Resolved
- Test Failures (Iteration 2-3): 3 unit test failures resolved via main agent fix
- Security Vulnerability (Iteration 1-2): Input validation issue resolved via main agent fix
Validation Complete: 2025-10-29 15:18:33
Deployment Readiness: β READY
```
Best Practices
1. Strict Sequential Execution
- Always invoke specialists in correct order
- Never skip prerequisite checks
- Ensure dependencies are satisfied before invocation
2. Comprehensive Status Tracking
- Log every specialist invocation with timestamp
- Track iterations for each specialist
- Maintain detailed failure history
- Update status after every specialist completion
3. Clear Progress Visualization
- Provide real-time validation progress
- Show which phase is active
- Highlight blocking issues
- Estimate remaining time
4. Proactive Failure Management
- Detect failures immediately
- Trigger recursive communication promptly
- Track iteration counts
- Escalate after max iterations (5)
5. Quality Gate Enforcement
- Do not proceed to next specialist if current fails
- Ensure all quality gates pass before completion
- Validate final status before reporting to orchestrator
6. Detailed Documentation
- Maintain validation history
- Document all failures and resolutions
- Generate comprehensive final summary
- Provide traceability for validation decisions
Resources
validation-workflow.md
Comprehensive guide for validation workflow management including:
- Specialist invocation procedures
- Dependency resolution logic
- Sequential execution patterns
- Failure handling workflows
- Status tracking mechanisms
validation-checklist.md
Quality gate checklist including:
- Test writing checkpoints
- Test execution requirements
- Code quality standards
- Security compliance criteria
- E2E and accessibility standards
- Deployment readiness criteria
Example Usage
Input (Validation Initialization)
```markdown
Issue: #47
PRP: /docs/implementation/prp/feature-47-prp.md
Implementation Files:
- .claude/agents/validation-orchestrator.md
- .claude/skills/validation-coordinator/
- .claude/skills/recursive-communicator/
Technology Stack: Markdown (Agent/Skill configs)
Frontend: No (backend agent/skill configuration)
```
Output (Validation Progress)
```markdown
Validation Workflow: Feature #47
Status: In Progress (Phase 2: Test Execution)
Specialist Status
- β Unit Test Specialist: Completed (1/1) - 45 tests created
- β Integration Test Specialist: Completed (1/1) - 12 tests created
- β οΈ Test Runner Specialist: In Progress (2/5) - 3 failures, recursive communication active
- βΈοΈ Code Quality Specialist: Pending
- βΈοΈ Security Specialist: Pending
- N/A E2E Specialist: Not applicable (backend only)
Quality Gates
- β Unit tests written
- β Integration tests written
- β οΈ All tests pass (3 failures)
- βΈοΈ Coverage β₯80%
- βΈοΈ Code quality
- βΈοΈ Security scan
Current Issue: Test failures - recursive communication with main agent for fixes
Progress: 2/5 specialists completed (40%)
Time Elapsed: 00:15:32
```
Integration
This skill is used by:
- validation-orchestrator agent during Phase 5: Validation
- Activates automatically when orchestrator coordinates validation specialists
- Works in conjunction with recursive-communicator skill for failure handling
- Provides validation status for main orchestrator and deployment phase
---
Version: 2.0.0
Auto-Activation: Yes (when coordinating validation workflow)
Phase: 5 (Validation)
Created: 2025-10-29
More from this repository10
Tests permission configurations for Claude Code skill interactions.
Generates comprehensive pytest-based unit tests for Python code, automatically creating test files with fixtures, mocking, and parametrization.
dependency-analyzer skill from matteocervelli/llms
api-test-generator skill from matteocervelli/llms
analysis skill from matteocervelli/llms
unit-test-writer skill from matteocervelli/llms
implementation skill from matteocervelli/llms
design-synthesizer skill from matteocervelli/llms
doc-fetcher skill from matteocervelli/llms
coverage-analyzer skill from matteocervelli/llms