aitbc/.windsurf/workflows/archive/test-openclaw-agents.md

description, title, version

description	title	version
hermes agent functionality and coordination testing module	hermes Agent Testing Module	1.0

hermes Agent Testing Module

This module covers hermes agent functionality testing, multi-agent coordination, session management, and agent workflow validation.

Current Active Skill Mapping

This archived workflow maps to these active split skill files:

• hermes-agent-testing-skill.md — agent communication validation and performance testing
• hermes-agent-communicator.md — agent message handling and responses
• hermes-session-manager.md — session creation and context management
• hermes-coordination-orchestrator.md — multi-agent workflow coordination
• hermes-performance-optimizer.md — agent performance tuning and optimization

Prerequisites

Required Setup

• Working directory: /opt/aitbc
• hermes 2026.3.24+ installed
• hermes gateway running
• Basic Testing Module completed

Environment Setup

cd /opt/aitbc
source venv/bin/activate
hermes --version
hermes gateway status

1. hermes Agent Basic Testing

Agent Registration and Status

# Check hermes gateway status
hermes gateway status

# List available agents
hermes agent list

# Check agent capabilities
hermes agent --agent GenesisAgent --session-id test --message "Status check" --thinking low

Expected Results

• Gateway should be running and responsive
• Agent list should show available agents
• Agent should respond to basic messages

Troubleshooting Agent Issues

# Restart hermes gateway
sudo systemctl restart hermes-gateway

# Check gateway logs
sudo journalctl -u hermes-gateway -f

# Verify agent configuration
hermes config show

2. Single Agent Testing

Genesis Agent Testing

# Test Genesis Agent with different thinking levels
SESSION_ID="genesis-test-$(date +%s)"

echo "Testing Genesis Agent with minimal thinking..."
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - minimal thinking" --thinking minimal

echo "Testing Genesis Agent with low thinking..."
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - low thinking" --thinking low

echo "Testing Genesis Agent with medium thinking..."
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - medium thinking" --thinking medium

echo "Testing Genesis Agent with high thinking..."
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - high thinking" --thinking high

Follower Agent Testing

# Test Follower Agent
SESSION_ID="follower-test-$(date +%s)"

echo "Testing Follower Agent..."
hermes agent --agent FollowerAgent --session-id $SESSION_ID --message "Test follower agent response" --thinking low

# Test follower agent coordination
hermes agent --agent FollowerAgent --session-id $SESSION_ID --message "Coordinate with genesis node" --thinking medium

Coordinator Agent Testing

# Test Coordinator Agent
SESSION_ID="coordinator-test-$(date +%s)"

echo "Testing Coordinator Agent..."
hermes agent --agent CoordinatorAgent --session-id $SESSION_ID --message "Test coordination capabilities" --thinking high

# Test multi-agent coordination
hermes agent --agent CoordinatorAgent --session-id $SESSION_ID --message "Coordinate multi-agent workflow" --thinking high

3. Multi-Agent Coordination Testing

Cross-Agent Communication

# Test cross-agent communication
SESSION_ID="cross-agent-$(date +%s)"

# Genesis agent initiates
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Initiating cross-agent coordination test" --thinking high

# Follower agent responds
hermes agent --agent FollowerAgent --session-id $SESSION_ID --message "Responding to genesis agent coordination" --thinking medium

# Coordinator agent orchestrates
hermes agent --agent CoordinatorAgent --session-id $SESSION_ID --message "Orchestrating multi-agent coordination" --thinking high

Session Management Testing

# Test session persistence
SESSION_ID="session-test-$(date +%s)"

# Multiple messages in same session
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "First message in session" --thinking low
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Second message in session" --thinking low
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Third message in session" --thinking low

# Test session with different agents
hermes agent --agent FollowerAgent --session-id $SESSION_ID --message "Follower response in same session" --thinking medium

4. Advanced Agent Capabilities Testing

AI Workflow Orchestration Testing

# Test AI workflow orchestration
SESSION_ID="ai-workflow-$(date +%s)"

# Genesis agent designs complex AI pipeline
hermes agent --agent GenesisAgent --session-id $SESSION_ID \
    --message "Design complex AI pipeline for medical diagnosis with parallel processing and error handling" \
    --thinking high

# Follower agent participates in pipeline
hermes agent --agent FollowerAgent --session-id $SESSION_ID \
    --message "Participate in complex AI pipeline execution with resource monitoring" \
    --thinking medium

# Coordinator agent orchestrates workflow
hermes agent --agent CoordinatorAgent --session-id $SESSION_ID \
    --message "Orchestrate complex AI pipeline execution across multiple agents" \
    --thinking high

Multi-Modal AI Processing Testing

# Test multi-modal AI coordination
SESSION_ID="multimodal-$(date +%s)"

# Genesis agent designs multi-modal system
hermes agent --agent GenesisAgent --session-id $SESSION_ID \
    --message "Design multi-modal AI system for customer feedback analysis with cross-modal attention" \
    --thinking high

# Follower agent handles specific modality
hermes agent --agent FollowerAgent --session-id $SESSION_ID \
    --message "Handle text analysis modality in multi-modal AI system" \
    --thinking medium

Resource Optimization Testing

# Test resource optimization coordination
SESSION_ID="resource-opt-$(date +%s)"

# Genesis agent optimizes resources
hermes agent --agent GenesisAgent --session-id $SESSION_ID \
    --message "Optimize GPU resource allocation for AI service provider with demand forecasting" \
    --thinking high

# Follower agent monitors resources
hermes agent --agent FollowerAgent --session-id $SESSION_ID \
    --message "Monitor resource utilization and report optimization opportunities" \
    --thinking medium

5. Agent Performance Testing

Response Time Testing

# Test agent response times
SESSION_ID="perf-test-$(date +%s)"

echo "Testing agent response times..."

# Measure Genesis Agent response time
start_time=$(date +%s.%N)
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Quick response test" --thinking low
end_time=$(date +%s.%N)
genesis_time=$(echo "$end_time - $start_time" | bc)
echo "Genesis Agent response time: ${genesis_time}s"

# Measure Follower Agent response time
start_time=$(date +%s.%N)
hermes agent --agent FollowerAgent --session-id $SESSION_ID --message "Quick response test" --thinking low
end_time=$(date +%s.%N)
follower_time=$(echo "$end_time - $start_time" | bc)
echo "Follower Agent response time: ${follower_time}s"

Concurrent Session Testing

# Test multiple concurrent sessions
echo "Testing concurrent sessions..."

# Create multiple concurrent sessions
for i in {1..5}; do
    SESSION_ID="concurrent-$i-$(date +%s)"
    hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Concurrent test $i" --thinking low &
done

# Wait for all to complete
wait
echo "Concurrent session tests completed"

6. Agent Communication Testing

Message Format Testing

# Test different message formats
SESSION_ID="format-test-$(date +%s)"

# Test short message
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Short" --thinking low

# Test medium message
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "This is a medium length message to test agent processing capabilities" --thinking low

# Test long message
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "This is a longer message that tests the agent's ability to process more complex requests and provide detailed responses. It should demonstrate the agent's capability to handle substantial input and generate comprehensive output." --thinking medium

Special Character Testing

# Test special characters and formatting
SESSION_ID="special-test-$(date +%s)"

# Test special characters
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Test special chars: !@#$%^&*()_+-=[]{}|;':\",./<>?" --thinking low

# Test code blocks
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Test code: \`print('Hello World')\` and \`\`\`python\ndef hello():\n    print('Hello')\`\`\`" --thinking low

7. Agent Error Handling Testing

Invalid Agent Testing

# Test invalid agent names
echo "Testing invalid agent handling..."
hermes agent --agent InvalidAgent --session-id test --message "Test message" --thinking low 2>/dev/null && echo "ERROR: Invalid agent accepted" || echo "✅ Invalid agent properly rejected"

Invalid Session Testing

# Test session handling
echo "Testing session handling..."
hermes agent --agent GenesisAgent --session-id "" --message "Test message" --thinking low 2>/dev/null && echo "ERROR: Empty session accepted" || echo "✅ Empty session properly rejected"

8. Agent Integration Testing

AI Operations Integration

# Test agent integration with AI operations
SESSION_ID="ai-integration-$(date +%s)"

# Agent submits AI job
hermes agent --agent GenesisAgent --session-id $SESSION_ID \
    --message "Submit AI job for text generation: Generate a short story about AI" \
    --thinking high

# Check if AI job was submitted
./aitbc-cli ai-ops --action status --job-id latest

Blockchain Integration

# Test agent integration with blockchain
SESSION_ID="blockchain-integration-$(date +%s)"

# Agent checks blockchain status
hermes agent --agent GenesisAgent --session-id $SESSION_ID \
    --message "Check blockchain status and report current height and network conditions" \
    --thinking medium

Resource Management Integration

# Test agent integration with resource management
SESSION_ID="resource-integration-$(date +%s)"

# Agent monitors resources
hermes agent --agent FollowerAgent --session-id $SESSION_ID \
    --message "Monitor system resources and report CPU, memory, and GPU utilization" \
    --thinking medium

9. Automated Agent Testing Script

Comprehensive Agent Test Suite

#!/bin/bash
# automated_agent_tests.sh

echo "=== hermes Agent Tests ==="

# Test gateway status
echo "Testing hermes gateway..."
hermes gateway status || exit 1

# Test basic agent functionality
echo "Testing basic agent functionality..."
SESSION_ID="auto-test-$(date +%s)"
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Automated test message" --thinking low || exit 1

# Test multi-agent coordination
echo "Testing multi-agent coordination..."
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Initiate coordination test" --thinking low || exit 1
hermes agent --agent FollowerAgent --session-id $SESSION_ID --message "Respond to coordination test" --thinking low || exit 1

# Test session management
echo "Testing session management..."
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Session test message 1" --thinking low || exit 1
hermes agent --agent GenesisAgent --session-id $SESSION_ID --message "Session test message 2" --thinking low || exit 1

echo "✅ All agent tests passed!"

10. Troubleshooting Guide

Common Agent Issues

Gateway Not Running

# Problem: hermes gateway not responding
# Solution: Start gateway service
sudo systemctl start hermes-gateway
sudo systemctl status hermes-gateway

Agent Not Responding

# Problem: Agent not responding to messages
# Solution: Check agent configuration and restart
hermes agent list
sudo systemctl restart hermes-gateway

Session Issues

# Problem: Session not persisting
# Solution: Check session storage
hermes config show
hermes gateway status

Performance Issues

# Problem: Slow agent response times
# Solution: Check system resources
free -h
df -h
ps aux | grep hermes

11. Success Criteria

Pass/Fail Criteria

• ✅ hermes gateway running and responsive
• ✅ All agents respond to basic messages
• ✅ Multi-agent coordination working
• ✅ Session management functioning
• ✅ Advanced AI capabilities operational
• ✅ Integration with AI operations working
• ✅ Error handling functioning correctly

Performance Benchmarks

• Gateway response time: <1 second
• Agent response time: <5 seconds
• Session creation: <1 second
• Multi-agent coordination: <10 seconds
• Advanced AI operations: <30 seconds

---

Dependencies: Basic Testing Module
Next Module: AI Operations Testing or Advanced AI Testing