diff --git a/.windsurf/workflows/TEST_MASTER_INDEX.md b/.windsurf/workflows/TEST_MASTER_INDEX.md new file mode 100644 index 00000000..86ebd6e5 --- /dev/null +++ b/.windsurf/workflows/TEST_MASTER_INDEX.md @@ -0,0 +1,251 @@ +--- +description: Master index for AITBC testing workflows - links to all test modules and provides navigation +title: AITBC Testing Workflows - Master Index +version: 1.0 +--- + +# AITBC Testing Workflows - Master Index + +This master index provides navigation to all modules in the AITBC testing and debugging documentation. Each module focuses on specific aspects of testing and validation. + +## 📚 Test Module Overview + +### 🔧 Basic Testing Module +**File**: `test-basic.md` +**Purpose**: Core CLI functionality and basic operations testing +**Audience**: Developers, system administrators +**Prerequisites**: None (base module) + +**Key Topics**: +- CLI command testing +- Basic blockchain operations +- Wallet operations +- Service connectivity +- Basic troubleshooting + +**Quick Start**: +```bash +# Run basic CLI tests +cd /opt/aitbc +source venv/bin/activate +python -m pytest cli/tests/ -v +``` + +--- + +### 🤖 OpenClaw Agent Testing Module +**File**: `test-openclaw-agents.md` +**Purpose**: OpenClaw agent functionality and coordination testing +**Audience**: AI developers, system administrators +**Prerequisites**: Basic Testing Module + +**Key Topics**: +- Agent communication testing +- Multi-agent coordination +- Session management +- Thinking levels +- Agent workflow validation + +**Quick Start**: +```bash +# Test OpenClaw agents +openclaw agent --agent GenesisAgent --session-id test --message "Test message" --thinking low +openclaw agent --agent FollowerAgent --session-id test --message "Test response" --thinking low +``` + +--- + +### 🚀 AI Operations Testing Module +**File**: `test-ai-operations.md` +**Purpose**: AI job submission, processing, and resource management testing +**Audience**: AI developers, system administrators +**Prerequisites**: Basic Testing Module + +**Key Topics**: +- AI job submission and monitoring +- Resource allocation testing +- Performance validation +- AI service integration +- Error handling and recovery + +**Quick Start**: +```bash +# Test AI operations +./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Test AI job" --payment 100 +./aitbc-cli ai-ops --action status --job-id latest +``` + +--- + +### 🔄 Advanced AI Testing Module +**File**: `test-advanced-ai.md` +**Purpose**: Advanced AI capabilities including workflow orchestration and multi-model pipelines +**Audience**: AI developers, system administrators +**Prerequisites**: Basic Testing + AI Operations Modules + +**Key Topics**: +- Advanced AI workflow orchestration +- Multi-model AI pipelines +- Ensemble management +- Multi-modal processing +- Performance optimization + +**Quick Start**: +```bash +# Test advanced AI operations +./aitbc-cli ai-submit --wallet genesis-ops --type parallel --prompt "Complex pipeline test" --payment 500 +./aitbc-cli ai-submit --wallet genesis-ops --type multimodal --prompt "Multi-modal test" --payment 1000 +``` + +--- + +### 🌐 Cross-Node Testing Module +**File**: `test-cross-node.md` +**Purpose**: Multi-node coordination, distributed operations, and node synchronization testing +**Audience**: System administrators, network engineers +**Prerequisites**: Basic Testing + AI Operations Modules + +**Key Topics**: +- Cross-node communication +- Distributed AI operations +- Node synchronization +- Multi-node blockchain operations +- Network resilience testing + +**Quick Start**: +```bash +# Test cross-node operations +ssh aitbc1 'cd /opt/aitbc && ./aitbc-cli chain' +./aitbc-cli resource status +ssh aitbc1 'cd /opt/aitbc && ./aitbc-cli resource status' +``` + +--- + +### 📊 Performance Testing Module +**File**: `test-performance.md` +**Purpose**: System performance, load testing, and optimization validation +**Audience**: Performance engineers, system administrators +**Prerequisites**: All previous modules + +**Key Topics**: +- Load testing +- Performance benchmarking +- Resource utilization analysis +- Scalability testing +- Optimization validation + +**Quick Start**: +```bash +# Run performance tests +./aitbc-cli simulate blockchain --blocks 100 --transactions 1000 --delay 0 +./aitbc-cli resource allocate --agent-id perf-test --cpu 4 --memory 8192 --duration 3600 +``` + +--- + +### 🛠️ Integration Testing Module +**File**: `test-integration.md` +**Purpose**: End-to-end integration testing across all system components +**Audience**: QA engineers, system administrators +**Prerequisites**: All previous modules + +**Key Topics**: +- End-to-end workflow testing +- Service integration validation +- Cross-component communication +- System resilience testing +- Production readiness validation + +**Quick Start**: +```bash +# Run integration tests +cd /opt/aitbc +./scripts/workflow-openclaw/06_advanced_ai_workflow_openclaw.sh +``` + +--- + +## 🔄 Test Dependencies + +``` +test-basic.md (foundation) +├── test-openclaw-agents.md (depends on basic) +├── test-ai-operations.md (depends on basic) +├── test-advanced-ai.md (depends on basic + ai-operations) +├── test-cross-node.md (depends on basic + ai-operations) +├── test-performance.md (depends on all previous) +└── test-integration.md (depends on all previous) +``` + +## 🎯 Testing Strategy + +### Phase 1: Basic Validation +1. **Basic Testing Module** - Verify core functionality +2. **OpenClaw Agent Testing** - Validate agent operations +3. **AI Operations Testing** - Confirm AI job processing + +### Phase 2: Advanced Validation +4. **Advanced AI Testing** - Test complex AI workflows +5. **Cross-Node Testing** - Validate distributed operations +6. **Performance Testing** - Benchmark system performance + +### Phase 3: Production Readiness +7. **Integration Testing** - End-to-end validation +8. **Production Validation** - Production readiness confirmation + +## 📋 Quick Reference + +### 🚀 Quick Test Commands +```bash +# Basic functionality test +./aitbc-cli --version && ./aitbc-cli chain + +# OpenClaw agent test +openclaw agent --agent GenesisAgent --session-id quick-test --message "Quick test" --thinking low + +# AI operations test +./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Quick test" --payment 50 + +# Cross-node test +ssh aitbc1 'cd /opt/aitbc && ./aitbc-cli chain' + +# Performance test +./aitbc-cli simulate blockchain --blocks 10 --transactions 50 --delay 0 +``` + +### 🔍 Troubleshooting Quick Links +- **[Basic Issues](test-basic.md#troubleshooting)** - CLI and service problems +- **[Agent Issues](test-openclaw-agents.md#troubleshooting)** - OpenClaw agent problems +- **[AI Issues](test-ai-operations.md#troubleshooting)** - AI job processing problems +- **[Network Issues](test-cross-node.md#troubleshooting)** - Cross-node communication problems +- **[Performance Issues](test-performance.md#troubleshooting)** - System performance problems + +## 📚 Related Documentation + +- **[Multi-Node Blockchain Setup](MULTI_NODE_MASTER_INDEX.md)** - System setup and configuration +- **[CLI Documentation](../docs/CLI_DOCUMENTATION.md)** - Complete CLI reference +- **[OpenClaw Agent Capabilities](../docs/openclaw/OPENCLAW_AGENT_CAPABILITIES_ADVANCED.md)** - Advanced agent features +- **[GitHub Operations](github.md)** - Git operations and multi-node sync + +## 🎯 Success Metrics + +### Test Coverage Targets +- **Basic Tests**: 100% core functionality coverage +- **Agent Tests**: 95% agent operation coverage +- **AI Tests**: 90% AI workflow coverage +- **Performance Tests**: 85% performance scenario coverage +- **Integration Tests**: 80% end-to-end scenario coverage + +### Quality Gates +- **All Tests Pass**: 0 critical failures +- **Performance Benchmarks**: Meet or exceed targets +- **Resource Utilization**: Within acceptable limits +- **Cross-Node Sync**: 100% synchronization success +- **AI Operations**: 95%+ success rate + +--- + +**Last Updated**: 2026-03-30 +**Version**: 1.0 +**Status**: Ready for Implementation diff --git a/.windsurf/workflows/test-ai-operations.md b/.windsurf/workflows/test-ai-operations.md new file mode 100644 index 00000000..94a39141 --- /dev/null +++ b/.windsurf/workflows/test-ai-operations.md @@ -0,0 +1,441 @@ +--- +description: AI job submission, processing, and resource management testing module +title: AI Operations Testing Module +version: 1.0 +--- + +# AI Operations Testing Module + +This module covers AI job submission, processing, resource management, and AI service integration testing. + +## Prerequisites + +### Required Setup +- Working directory: `/opt/aitbc` +- Virtual environment: `/opt/aitbc/venv` +- CLI wrapper: `/opt/aitbc/aitbc-cli` +- Services running (Coordinator, Exchange, Blockchain RPC, Ollama) +- Basic Testing Module completed + +### Environment Setup +```bash +cd /opt/aitbc +source venv/bin/activate +./aitbc-cli --version +``` + +## 1. AI Job Submission Testing + +### Basic AI Job Submission +```bash +# Test basic AI job submission +echo "Testing basic AI job submission..." + +# Submit inference job +JOB_ID=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Generate a short story about AI" --payment 100 | grep -o "ai_job_[0-9]*") +echo "Submitted job: $JOB_ID" + +# Check job status +echo "Checking job status..." +./aitbc-cli ai-ops --action status --job-id $JOB_ID + +# Wait for completion and get results +echo "Waiting for job completion..." +sleep 10 +./aitbc-cli ai-ops --action results --job-id $JOB_ID +``` + +### Advanced AI Job Types +```bash +# Test different AI job types +echo "Testing advanced AI job types..." + +# Parallel AI job +./aitbc-cli ai-submit --wallet genesis-ops --type parallel --prompt "Parallel AI processing test" --payment 500 + +# Ensemble AI job +./aitbc-cli ai-submit --wallet genesis-ops --type ensemble --prompt "Ensemble AI processing test" --payment 600 + +# Multi-modal AI job +./aitbc-cli ai-submit --wallet genesis-ops --type multimodal --prompt "Multi-modal AI test" --payment 1000 + +# Resource allocation job +./aitbc-cli ai-submit --wallet genesis-ops --type resource-allocation --prompt "Resource allocation test" --payment 800 + +# Performance tuning job +./aitbc-cli ai-submit --wallet genesis-ops --type performance-tuning --prompt "Performance tuning test" --payment 1000 +``` + +### Expected Results +- All job types should submit successfully +- Job IDs should be generated and returned +- Job status should be trackable +- Results should be retrievable upon completion + +## 2. AI Job Monitoring Testing + +### Job Status Monitoring +```bash +# Test job status monitoring +echo "Testing job status monitoring..." + +# Submit test job +JOB_ID=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Monitoring test job" --payment 100 | grep -o "ai_job_[0-9]*") + +# Monitor job progress +for i in {1..10}; do + echo "Check $i:" + ./aitbc-cli ai-ops --action status --job-id $JOB_ID + sleep 2 +done +``` + +### Multiple Job Monitoring +```bash +# Test multiple job monitoring +echo "Testing multiple job monitoring..." + +# Submit multiple jobs +JOB1=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Job 1" --payment 100 | grep -o "ai_job_[0-9]*") +JOB2=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Job 2" --payment 100 | grep -o "ai_job_[0-9]*") +JOB3=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Job 3" --payment 100 | grep -o "ai_job_[0-9]*") + +echo "Submitted jobs: $JOB1, $JOB2, $JOB3" + +# Monitor all jobs +for job in $JOB1 $JOB2 $JOB3; do + echo "Status for $job:" + ./aitbc-cli ai-ops --action status --job-id $job +done +``` + +## 3. Resource Management Testing + +### Resource Status Monitoring +```bash +# Test resource status monitoring +echo "Testing resource status monitoring..." + +# Check current resource status +./aitbc-cli resource status + +# Monitor resource changes over time +for i in {1..5}; do + echo "Resource check $i:" + ./aitbc-cli resource status + sleep 5 +done +``` + +### Resource Allocation Testing +```bash +# Test resource allocation +echo "Testing resource allocation..." + +# Allocate resources for AI operations +ALLOCATION_ID=$(./aitbc-cli resource allocate --agent-id test-ai-agent --cpu 2 --memory 4096 --duration 3600 | grep -o "alloc_[0-9]*") +echo "Resource allocation: $ALLOCATION_ID" + +# Verify allocation +./aitbc-cli resource status + +# Test resource deallocation +echo "Testing resource deallocation..." +# Note: Deallocation would be handled automatically when duration expires +``` + +### Resource Optimization Testing +```bash +# Test resource optimization +echo "Testing resource optimization..." + +# Submit resource-intensive job +./aitbc-cli ai-submit --wallet genesis-ops --type performance-tuning --prompt "Resource optimization test with high resource usage" --payment 1500 + +# Monitor resource utilization during job +for i in {1..10}; do + echo "Resource utilization check $i:" + ./aitbc-cli resource status + sleep 3 +done +``` + +## 4. AI Service Integration Testing + +### Ollama Integration Testing +```bash +# Test Ollama service integration +echo "Testing Ollama integration..." + +# Check Ollama status +curl -sf http://localhost:11434/api/tags + +# Test Ollama model availability +curl -sf http://localhost:11434/api/show/llama3.1:8b + +# Test Ollama inference +curl -sf -X POST http://localhost:11434/api/generate \ + -H "Content-Type: application/json" \ + -d '{"model": "llama3.1:8b", "prompt": "Test inference", "stream": false}' +``` + +### Exchange API Integration +```bash +# Test Exchange API integration +echo "Testing Exchange API integration..." + +# Check Exchange API status +curl -sf http://localhost:8001/health + +# Test marketplace operations +./aitbc-cli market-list + +# Test marketplace creation +./aitbc-cli market-create --type ai-inference --name "Test AI Service" --price 100 --description "Test service for AI operations" --wallet genesis-ops +``` + +### Blockchain RPC Integration +```bash +# Test Blockchain RPC integration +echo "Testing Blockchain RPC integration..." + +# Check RPC status +curl -sf http://localhost:8006/rpc/health + +# Test transaction submission +curl -sf -X POST http://localhost:8006/rpc/transaction \ + -H "Content-Type: application/json" \ + -d '{"from": "ait158ec7a0713f30ccfb1aac6bfbab71f36271c5871", "to": "ait141b3bae6eea3a74273ef3961861ee58e12b6d855", "amount": 1, "fee": 10}' +``` + +## 5. Advanced AI Operations Testing + +### Complex Workflow Testing +```bash +# Test complex AI workflow +echo "Testing complex AI workflow..." + +# Submit complex pipeline job +./aitbc-cli ai-submit --wallet genesis-ops --type parallel --prompt "Design and execute complex AI pipeline for medical diagnosis with ensemble validation and error handling" --payment 2000 + +# Monitor workflow execution +sleep 5 +./aitbc-cli ai-ops --action status --job-id latest +``` + +### Multi-Modal Processing Testing +```bash +# Test multi-modal AI processing +echo "Testing multi-modal AI processing..." + +# Submit multi-modal job +./aitbc-cli ai-submit --wallet genesis-ops --type multimodal --prompt "Process customer feedback with text sentiment analysis and image recognition" --payment 2500 + +# Monitor multi-modal processing +sleep 10 +./aitbc-cli ai-ops --action status --job-id latest +``` + +### Performance Optimization Testing +```bash +# Test AI performance optimization +echo "Testing AI performance optimization..." + +# Submit performance tuning job +./aitbc-cli ai-submit --wallet genesis-ops --type performance-tuning --prompt "Optimize AI model performance for sub-100ms inference latency with quantization and pruning" --payment 3000 + +# Monitor optimization process +sleep 15 +./aitbc-cli ai-ops --action status --job-id latest +``` + +## 6. Error Handling Testing + +### Invalid Job Submission Testing +```bash +# Test invalid job submission handling +echo "Testing invalid job submission..." + +# Test missing required parameters +./aitbc-cli ai-submit --wallet genesis-ops --type inference 2>/dev/null && echo "ERROR: Missing prompt accepted" || echo "✅ Missing prompt properly rejected" + +# Test invalid wallet +./aitbc-cli ai-submit --wallet invalid-wallet --type inference --prompt "Test" --payment 100 2>/dev/null && echo "ERROR: Invalid wallet accepted" || echo "✅ Invalid wallet properly rejected" + +# Test insufficient payment +./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Test" --payment 1 2>/dev/null && echo "ERROR: Insufficient payment accepted" || echo "✅ Insufficient payment properly rejected" +``` + +### Invalid Job ID Testing +```bash +# Test invalid job ID handling +echo "Testing invalid job ID..." + +# Test non-existent job +./aitbc-cli ai-ops --action status --job-id "non_existent_job" 2>/dev/null && echo "ERROR: Non-existent job accepted" || echo "✅ Non-existent job properly rejected" + +# Test invalid job ID format +./aitbc-cli ai-ops --action status --job-id "invalid_format" 2>/dev/null && echo "ERROR: Invalid format accepted" || echo "✅ Invalid format properly rejected" +``` + +## 7. Performance Testing + +### AI Job Throughput Testing +```bash +# Test AI job submission throughput +echo "Testing AI job throughput..." + +# Submit multiple jobs rapidly +echo "Submitting 10 jobs rapidly..." +for i in {1..10}; do + ./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Throughput test job $i" --payment 100 + echo "Submitted job $i" +done + +# Monitor system performance +echo "Monitoring system performance during high load..." +for i in {1..10}; do + echo "Performance check $i:" + ./aitbc-cli resource status + sleep 2 +done +``` + +### Resource Utilization Testing +```bash +# Test resource utilization under load +echo "Testing resource utilization..." + +# Submit resource-intensive jobs +for i in {1..5}; do + ./aitbc-cli ai-submit --wallet genesis-ops --type performance-tuning --prompt "Resource utilization test $i" --payment 1000 + echo "Submitted resource-intensive job $i" +done + +# Monitor resource utilization +for i in {1..15}; do + echo "Resource utilization $i:" + ./aitbc-cli resource status + sleep 3 +done +``` + +## 8. Automated AI Operations Testing + +### Comprehensive AI Test Suite +```bash +#!/bin/bash +# automated_ai_tests.sh + +echo "=== AI Operations Tests ===" + +# Test basic AI job submission +echo "Testing basic AI job submission..." +JOB_ID=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Automated test job" --payment 100 | grep -o "ai_job_[0-9]*") +[ -n "$JOB_ID" ] || exit 1 + +# Test job status monitoring +echo "Testing job status monitoring..." +./aitbc-cli ai-ops --action status --job-id $JOB_ID || exit 1 + +# Test resource status +echo "Testing resource status..." +./aitbc-cli resource status | jq -r '.cpu_utilization' || exit 1 + +# Test advanced AI job types +echo "Testing advanced AI job types..." +./aitbc-cli ai-submit --wallet genesis-ops --type multimodal --prompt "Automated multi-modal test" --payment 500 || exit 1 + +echo "✅ All AI operations tests passed!" +``` + +## 9. Integration Testing + +### End-to-End AI Workflow Testing +```bash +# Test complete AI workflow +echo "Testing end-to-end AI workflow..." + +# 1. Submit AI job +echo "1. Submitting AI job..." +JOB_ID=$(./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "End-to-end test: Generate a comprehensive analysis of AI workflow integration" --payment 500) + +# 2. Monitor job progress +echo "2. Monitoring job progress..." +for i in {1..10}; do + STATUS=$(./aitbc-cli ai-ops --action status --job-id $JOB_ID | grep -o '"status": "[^"]*"' | cut -d'"' -f4) + echo "Job status: $STATUS" + [ "$STATUS" = "completed" ] && break + sleep 3 +done + +# 3. Retrieve results +echo "3. Retrieving results..." +./aitbc-cli ai-ops --action results --job-id $JOB_ID + +# 4. Verify resource impact +echo "4. Verifying resource impact..." +./aitbc-cli resource status +``` + +## 10. Troubleshooting Guide + +### Common AI Operations Issues + +#### Job Submission Failures +```bash +# Problem: AI job submission failing +# Solution: Check wallet balance and service status +./aitbc-cli balance --wallet genesis-ops +./aitbc-cli resource status +curl -sf http://localhost:8000/health +``` + +#### Job Processing Stalled +```bash +# Problem: AI jobs not processing +# Solution: Check AI services and restart if needed +curl -sf http://localhost:11434/api/tags +sudo systemctl restart aitbc-ollama +``` + +#### Resource Allocation Issues +```bash +# Problem: Resource allocation failing +# Solution: Check resource availability +./aitbc-cli resource status +free -h +df -h +``` + +#### Performance Issues +```bash +# Problem: Slow AI job processing +# Solution: Check system resources and optimize +./aitbc-cli resource status +top -n 1 +``` + +## 11. Success Criteria + +### Pass/Fail Criteria +- ✅ AI job submission working for all job types +- ✅ Job status monitoring functional +- ✅ Resource management operational +- ✅ AI service integration working +- ✅ Advanced AI operations functional +- ✅ Error handling working correctly +- ✅ Performance within acceptable limits + +### Performance Benchmarks +- Job submission time: <3 seconds +- Job status check: <1 second +- Resource status check: <1 second +- Basic AI job completion: <30 seconds +- Advanced AI job completion: <120 seconds +- Resource allocation: <2 seconds + +--- + +**Dependencies**: [Basic Testing Module](test-basic.md) +**Next Module**: [Advanced AI Testing](test-advanced-ai.md) or [Cross-Node Testing](test-cross-node.md) diff --git a/.windsurf/workflows/test-basic.md b/.windsurf/workflows/test-basic.md new file mode 100644 index 00000000..25c836e8 --- /dev/null +++ b/.windsurf/workflows/test-basic.md @@ -0,0 +1,313 @@ +--- +description: Basic CLI functionality and core operations testing module +title: Basic Testing Module - CLI and Core Operations +version: 1.0 +--- + +# Basic Testing Module - CLI and Core Operations + +This module covers basic CLI functionality testing, core blockchain operations, wallet operations, and service connectivity validation. + +## Prerequisites + +### Required Setup +- Working directory: `/opt/aitbc` +- Virtual environment: `/opt/aitbc/venv` +- CLI wrapper: `/opt/aitbc/aitbc-cli` +- Services running on correct ports (8000, 8001, 8006) + +### Environment Setup +```bash +cd /opt/aitbc +source venv/bin/activate +./aitbc-cli --version +``` + +## 1. CLI Command Testing + +### Basic CLI Commands +```bash +# Test CLI version and help +./aitbc-cli --version +./aitbc-cli --help + +# Test core commands +./aitbc-cli create --name test-wallet --password test123 +./aitbc-cli list +./aitbc-cli balance --wallet test-wallet + +# Test blockchain operations +./aitbc-cli chain +./aitbc-cli network +``` + +### Expected Results +- CLI version should display without errors +- Help should show all available commands +- Wallet operations should complete successfully +- Blockchain operations should return current status + +### Troubleshooting CLI Issues +```bash +# Check CLI installation +which aitbc-cli +ls -la /opt/aitbc/aitbc-cli + +# Check virtual environment +source venv/bin/activate +python --version +pip list | grep aitbc + +# Fix CLI issues +cd /opt/aitbc/cli +source venv/bin/activate +pip install -e . +``` + +## 2. Service Connectivity Testing + +### Check Service Status +```bash +# Test Coordinator API (port 8000) +curl -sf http://localhost:8000/health || echo "Coordinator API not responding" + +# Test Exchange API (port 8001) +curl -sf http://localhost:8001/health || echo "Exchange API not responding" + +# Test Blockchain RPC (port 8006) +curl -sf http://localhost:8006/rpc/health || echo "Blockchain RPC not responding" + +# Test Ollama (port 11434) +curl -sf http://localhost:11434/api/tags || echo "Ollama not responding" +``` + +### Service Restart Commands +```bash +# Restart services if needed +sudo systemctl restart aitbc-coordinator +sudo systemctl restart aitbc-exchange +sudo systemctl restart aitbc-blockchain +sudo systemctl restart aitbc-ollama + +# Check service status +sudo systemctl status aitbc-coordinator +sudo systemctl status aitbc-exchange +sudo systemctl status aitbc-blockchain +sudo systemctl status aitbc-ollama +``` + +## 3. Wallet Operations Testing + +### Create and Test Wallets +```bash +# Create test wallet +./aitbc-cli create --name basic-test --password test123 + +# List wallets +./aitbc-cli list + +# Check balance +./aitbc-cli balance --wallet basic-test + +# Send test transaction (if funds available) +./aitbc-cli send --from basic-test --to $(./aitbc-cli list | jq -r '.[0].address') --amount 1 --fee 10 --password test123 +``` + +### Wallet Validation +```bash +# Verify wallet files exist +ls -la /var/lib/aitbc/keystore/ + +# Check wallet permissions +ls -la /var/lib/aitbc/keystore/basic-test* + +# Test wallet encryption +./aitbc-cli balance --wallet basic-test --password wrong-password 2>/dev/null && echo "ERROR: Wrong password accepted" || echo "✅ Password validation working" +``` + +## 4. Blockchain Operations Testing + +### Basic Blockchain Tests +```bash +# Get blockchain info +./aitbc-cli chain + +# Get network status +./aitbc-cli network + +# Test transaction submission +./aitbc-cli send --from genesis-ops --to $(./aitbc-cli list | jq -r '.[0].address') --amount 0.1 --fee 1 --password 123 + +# Check transaction status +./aitbc-cli transactions --wallet genesis-ops --limit 5 +``` + +### Blockchain Validation +```bash +# Check blockchain height +HEIGHT=$(./aitbc-cli chain | jq -r '.height // 0') +echo "Current height: $HEIGHT" + +# Verify network connectivity +NODES=$(./aitbc-cli network | jq -r '.active_nodes // 0') +echo "Active nodes: $NODES" + +# Check consensus status +CONSENSUS=$(./aitbc-cli chain | jq -r '.consensus // "unknown"') +echo "Consensus: $CONSENSUS" +``` + +## 5. Resource Management Testing + +### Basic Resource Operations +```bash +# Check resource status +./aitbc-cli resource status + +# Test resource allocation +./aitbc-cli resource allocate --agent-id test-agent --cpu 1 --memory 1024 --duration 1800 + +# Monitor resource usage +./aitbc-cli resource status +``` + +### Resource Validation +```bash +# Check system resources +free -h +df -h +nvidia-smi 2>/dev/null || echo "NVIDIA GPU not available" + +# Check process resources +ps aux | grep aitbc +``` + +## 6. Analytics Testing + +### Basic Analytics Operations +```bash +# Test analytics commands +./aitbc-cli analytics --action summary +./aitbc-cli analytics --action performance +./aitbc-cli analytics --action network-stats +``` + +### Analytics Validation +```bash +# Check analytics data +./aitbc-cli analytics --action summary | jq . +./aitbc-cli analytics --action performance | jq . +``` + +## 7. Mining Operations Testing + +### Basic Mining Tests +```bash +# Check mining status +./aitbc-cli mine-status + +# Start mining (if not running) +./aitbc-cli mine-start + +# Stop mining +./aitbc-cli mine-stop +``` + +### Mining Validation +```bash +# Check mining process +ps aux | grep miner + +# Check mining rewards +./aitbc-cli balance --wallet genesis-ops +``` + +## 8. Test Automation Script + +### Automated Basic Tests +```bash +#!/bin/bash +# automated_basic_tests.sh + +echo "=== Basic AITBC Tests ===" + +# Test CLI +echo "Testing CLI..." +./aitbc-cli --version || exit 1 +./aitbc-cli --help | grep -q "create" || exit 1 + +# Test Services +echo "Testing Services..." +curl -sf http://localhost:8000/health || exit 1 +curl -sf http://localhost:8001/health || exit 1 +curl -sf http://localhost:8006/rpc/health || exit 1 + +# Test Blockchain +echo "Testing Blockchain..." +./aitbc-cli chain | jq -r '.height' || exit 1 + +# Test Resources +echo "Testing Resources..." +./aitbc-cli resource status | jq -r '.cpu_utilization' || exit 1 + +echo "✅ All basic tests passed!" +``` + +## 9. Troubleshooting Guide + +### Common Issues and Solutions + +#### CLI Not Found +```bash +# Problem: aitbc-cli command not found +# Solution: Check installation and PATH +which aitbc-cli +export PATH="/opt/aitbc:$PATH" +``` + +#### Service Not Responding +```bash +# Problem: Service not responding on port +# Solution: Check service status and restart +sudo systemctl status aitbc-coordinator +sudo systemctl restart aitbc-coordinator +``` + +#### Wallet Issues +```bash +# Problem: Wallet operations failing +# Solution: Check keystore permissions +sudo chown -R aitbc:aitbc /var/lib/aitbc/keystore/ +sudo chmod 700 /var/lib/aitbc/keystore/ +``` + +#### Blockchain Sync Issues +```bash +# Problem: Blockchain not syncing +# Solution: Check network connectivity +./aitbc-cli network +sudo systemctl restart aitbc-blockchain +``` + +## 10. Success Criteria + +### Pass/Fail Criteria +- ✅ CLI commands execute without errors +- ✅ All services respond to health checks +- ✅ Wallet operations complete successfully +- ✅ Blockchain operations return valid data +- ✅ Resource allocation works correctly +- ✅ Analytics data is accessible +- ✅ Mining operations can be controlled + +### Performance Benchmarks +- CLI response time: <2 seconds +- Service health check: <1 second +- Wallet creation: <5 seconds +- Transaction submission: <3 seconds +- Resource status: <1 second + +--- + +**Dependencies**: None (base module) +**Next Module**: [OpenClaw Agent Testing](test-openclaw-agents.md) or [AI Operations Testing](test-ai-operations.md) diff --git a/.windsurf/workflows/test-openclaw-agents.md b/.windsurf/workflows/test-openclaw-agents.md new file mode 100644 index 00000000..97db3d3d --- /dev/null +++ b/.windsurf/workflows/test-openclaw-agents.md @@ -0,0 +1,400 @@ +--- +description: OpenClaw agent functionality and coordination testing module +title: OpenClaw Agent Testing Module +version: 1.0 +--- + +# OpenClaw Agent Testing Module + +This module covers OpenClaw agent functionality testing, multi-agent coordination, session management, and agent workflow validation. + +## Prerequisites + +### Required Setup +- Working directory: `/opt/aitbc` +- OpenClaw 2026.3.24+ installed +- OpenClaw gateway running +- Basic Testing Module completed + +### Environment Setup +```bash +cd /opt/aitbc +source venv/bin/activate +openclaw --version +openclaw gateway status +``` + +## 1. OpenClaw Agent Basic Testing + +### Agent Registration and Status +```bash +# Check OpenClaw gateway status +openclaw gateway status + +# List available agents +openclaw agent list + +# Check agent capabilities +openclaw agent --agent GenesisAgent --session-id test --message "Status check" --thinking low +``` + +### Expected Results +- Gateway should be running and responsive +- Agent list should show available agents +- Agent should respond to basic messages + +### Troubleshooting Agent Issues +```bash +# Restart OpenClaw gateway +sudo systemctl restart openclaw-gateway + +# Check gateway logs +sudo journalctl -u openclaw-gateway -f + +# Verify agent configuration +openclaw config show +``` + +## 2. Single Agent Testing + +### Genesis Agent Testing +```bash +# Test Genesis Agent with different thinking levels +SESSION_ID="genesis-test-$(date +%s)" + +echo "Testing Genesis Agent with minimal thinking..." +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - minimal thinking" --thinking minimal + +echo "Testing Genesis Agent with low thinking..." +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - low thinking" --thinking low + +echo "Testing Genesis Agent with medium thinking..." +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - medium thinking" --thinking medium + +echo "Testing Genesis Agent with high thinking..." +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Test message - high thinking" --thinking high +``` + +### Follower Agent Testing +```bash +# Test Follower Agent +SESSION_ID="follower-test-$(date +%s)" + +echo "Testing Follower Agent..." +openclaw agent --agent FollowerAgent --session-id $SESSION_ID --message "Test follower agent response" --thinking low + +# Test follower agent coordination +openclaw agent --agent FollowerAgent --session-id $SESSION_ID --message "Coordinate with genesis node" --thinking medium +``` + +### Coordinator Agent Testing +```bash +# Test Coordinator Agent +SESSION_ID="coordinator-test-$(date +%s)" + +echo "Testing Coordinator Agent..." +openclaw agent --agent CoordinatorAgent --session-id $SESSION_ID --message "Test coordination capabilities" --thinking high + +# Test multi-agent coordination +openclaw agent --agent CoordinatorAgent --session-id $SESSION_ID --message "Coordinate multi-agent workflow" --thinking high +``` + +## 3. Multi-Agent Coordination Testing + +### Cross-Agent Communication +```bash +# Test cross-agent communication +SESSION_ID="cross-agent-$(date +%s)" + +# Genesis agent initiates +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Initiating cross-agent coordination test" --thinking high + +# Follower agent responds +openclaw agent --agent FollowerAgent --session-id $SESSION_ID --message "Responding to genesis agent coordination" --thinking medium + +# Coordinator agent orchestrates +openclaw agent --agent CoordinatorAgent --session-id $SESSION_ID --message "Orchestrating multi-agent coordination" --thinking high +``` + +### Session Management Testing +```bash +# Test session persistence +SESSION_ID="session-test-$(date +%s)" + +# Multiple messages in same session +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "First message in session" --thinking low +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Second message in session" --thinking low +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Third message in session" --thinking low + +# Test session with different agents +openclaw agent --agent FollowerAgent --session-id $SESSION_ID --message "Follower response in same session" --thinking medium +``` + +## 4. Advanced Agent Capabilities Testing + +### AI Workflow Orchestration Testing +```bash +# Test AI workflow orchestration +SESSION_ID="ai-workflow-$(date +%s)" + +# Genesis agent designs complex AI pipeline +openclaw agent --agent GenesisAgent --session-id $SESSION_ID \ + --message "Design complex AI pipeline for medical diagnosis with parallel processing and error handling" \ + --thinking high + +# Follower agent participates in pipeline +openclaw agent --agent FollowerAgent --session-id $SESSION_ID \ + --message "Participate in complex AI pipeline execution with resource monitoring" \ + --thinking medium + +# Coordinator agent orchestrates workflow +openclaw agent --agent CoordinatorAgent --session-id $SESSION_ID \ + --message "Orchestrate complex AI pipeline execution across multiple agents" \ + --thinking high +``` + +### Multi-Modal AI Processing Testing +```bash +# Test multi-modal AI coordination +SESSION_ID="multimodal-$(date +%s)" + +# Genesis agent designs multi-modal system +openclaw agent --agent GenesisAgent --session-id $SESSION_ID \ + --message "Design multi-modal AI system for customer feedback analysis with cross-modal attention" \ + --thinking high + +# Follower agent handles specific modality +openclaw agent --agent FollowerAgent --session-id $SESSION_ID \ + --message "Handle text analysis modality in multi-modal AI system" \ + --thinking medium +``` + +### Resource Optimization Testing +```bash +# Test resource optimization coordination +SESSION_ID="resource-opt-$(date +%s)" + +# Genesis agent optimizes resources +openclaw agent --agent GenesisAgent --session-id $SESSION_ID \ + --message "Optimize GPU resource allocation for AI service provider with demand forecasting" \ + --thinking high + +# Follower agent monitors resources +openclaw agent --agent FollowerAgent --session-id $SESSION_ID \ + --message "Monitor resource utilization and report optimization opportunities" \ + --thinking medium +``` + +## 5. Agent Performance Testing + +### Response Time Testing +```bash +# Test agent response times +SESSION_ID="perf-test-$(date +%s)" + +echo "Testing agent response times..." + +# Measure Genesis Agent response time +start_time=$(date +%s.%N) +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Quick response test" --thinking low +end_time=$(date +%s.%N) +genesis_time=$(echo "$end_time - $start_time" | bc) +echo "Genesis Agent response time: ${genesis_time}s" + +# Measure Follower Agent response time +start_time=$(date +%s.%N) +openclaw agent --agent FollowerAgent --session-id $SESSION_ID --message "Quick response test" --thinking low +end_time=$(date +%s.%N) +follower_time=$(echo "$end_time - $start_time" | bc) +echo "Follower Agent response time: ${follower_time}s" +``` + +### Concurrent Session Testing +```bash +# Test multiple concurrent sessions +echo "Testing concurrent sessions..." + +# Create multiple concurrent sessions +for i in {1..5}; do + SESSION_ID="concurrent-$i-$(date +%s)" + openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Concurrent test $i" --thinking low & +done + +# Wait for all to complete +wait +echo "Concurrent session tests completed" +``` + +## 6. Agent Communication Testing + +### Message Format Testing +```bash +# Test different message formats +SESSION_ID="format-test-$(date +%s)" + +# Test short message +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Short" --thinking low + +# Test medium message +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "This is a medium length message to test agent processing capabilities" --thinking low + +# Test long message +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "This is a longer message that tests the agent's ability to process more complex requests and provide detailed responses. It should demonstrate the agent's capability to handle substantial input and generate comprehensive output." --thinking medium +``` + +### Special Character Testing +```bash +# Test special characters and formatting +SESSION_ID="special-test-$(date +%s)" + +# Test special characters +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Test special chars: !@#$%^&*()_+-=[]{}|;':\",./<>?" --thinking low + +# Test code blocks +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Test code: \`print('Hello World')\` and \`\`\`python\ndef hello():\n print('Hello')\`\`\`" --thinking low +``` + +## 7. Agent Error Handling Testing + +### Invalid Agent Testing +```bash +# Test invalid agent names +echo "Testing invalid agent handling..." +openclaw agent --agent InvalidAgent --session-id test --message "Test message" --thinking low 2>/dev/null && echo "ERROR: Invalid agent accepted" || echo "✅ Invalid agent properly rejected" +``` + +### Invalid Session Testing +```bash +# Test session handling +echo "Testing session handling..." +openclaw agent --agent GenesisAgent --session-id "" --message "Test message" --thinking low 2>/dev/null && echo "ERROR: Empty session accepted" || echo "✅ Empty session properly rejected" +``` + +## 8. Agent Integration Testing + +### AI Operations Integration +```bash +# Test agent integration with AI operations +SESSION_ID="ai-integration-$(date +%s)" + +# Agent submits AI job +openclaw agent --agent GenesisAgent --session-id $SESSION_ID \ + --message "Submit AI job for text generation: Generate a short story about AI" \ + --thinking high + +# Check if AI job was submitted +./aitbc-cli ai-ops --action status --job-id latest +``` + +### Blockchain Integration +```bash +# Test agent integration with blockchain +SESSION_ID="blockchain-integration-$(date +%s)" + +# Agent checks blockchain status +openclaw agent --agent GenesisAgent --session-id $SESSION_ID \ + --message "Check blockchain status and report current height and network conditions" \ + --thinking medium +``` + +### Resource Management Integration +```bash +# Test agent integration with resource management +SESSION_ID="resource-integration-$(date +%s)" + +# Agent monitors resources +openclaw agent --agent FollowerAgent --session-id $SESSION_ID \ + --message "Monitor system resources and report CPU, memory, and GPU utilization" \ + --thinking medium +``` + +## 9. Automated Agent Testing Script + +### Comprehensive Agent Test Suite +```bash +#!/bin/bash +# automated_agent_tests.sh + +echo "=== OpenClaw Agent Tests ===" + +# Test gateway status +echo "Testing OpenClaw gateway..." +openclaw gateway status || exit 1 + +# Test basic agent functionality +echo "Testing basic agent functionality..." +SESSION_ID="auto-test-$(date +%s)" +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Automated test message" --thinking low || exit 1 + +# Test multi-agent coordination +echo "Testing multi-agent coordination..." +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Initiate coordination test" --thinking low || exit 1 +openclaw agent --agent FollowerAgent --session-id $SESSION_ID --message "Respond to coordination test" --thinking low || exit 1 + +# Test session management +echo "Testing session management..." +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Session test message 1" --thinking low || exit 1 +openclaw agent --agent GenesisAgent --session-id $SESSION_ID --message "Session test message 2" --thinking low || exit 1 + +echo "✅ All agent tests passed!" +``` + +## 10. Troubleshooting Guide + +### Common Agent Issues + +#### Gateway Not Running +```bash +# Problem: OpenClaw gateway not responding +# Solution: Start gateway service +sudo systemctl start openclaw-gateway +sudo systemctl status openclaw-gateway +``` + +#### Agent Not Responding +```bash +# Problem: Agent not responding to messages +# Solution: Check agent configuration and restart +openclaw agent list +sudo systemctl restart openclaw-gateway +``` + +#### Session Issues +```bash +# Problem: Session not persisting +# Solution: Check session storage +openclaw config show +openclaw gateway status +``` + +#### Performance Issues +```bash +# Problem: Slow agent response times +# Solution: Check system resources +free -h +df -h +ps aux | grep openclaw +``` + +## 11. Success Criteria + +### Pass/Fail Criteria +- ✅ OpenClaw gateway running and responsive +- ✅ All agents respond to basic messages +- ✅ Multi-agent coordination working +- ✅ Session management functioning +- ✅ Advanced AI capabilities operational +- ✅ Integration with AI operations working +- ✅ Error handling functioning correctly + +### Performance Benchmarks +- Gateway response time: <1 second +- Agent response time: <5 seconds +- Session creation: <1 second +- Multi-agent coordination: <10 seconds +- Advanced AI operations: <30 seconds + +--- + +**Dependencies**: [Basic Testing Module](test-basic.md) +**Next Module**: [AI Operations Testing](test-ai-operations.md) or [Advanced AI Testing](test-advanced-ai.md) diff --git a/.windsurf/workflows/test.md b/.windsurf/workflows/test.md index 23023928..f4b4a6ca 100755 --- a/.windsurf/workflows/test.md +++ b/.windsurf/workflows/test.md @@ -1,32 +1,149 @@ --- -description: Test and debug workflow for AITBC platform including OpenClaw agents and AI operations -title: AITBC Testing and Debugging Workflow -version: 3.0 +description: DEPRECATED - Use modular test workflows instead. See TEST_MASTER_INDEX.md for navigation. +title: AITBC Testing and Debugging Workflow (DEPRECATED) +version: 3.0 (DEPRECATED) auto_execution_mode: 3 --- -# AITBC Testing and Debugging Workflow +# AITBC Testing and Debugging Workflow (DEPRECATED) -This workflow helps you run tests and debug issues in the AITBC platform using the current consolidated project structure, including OpenClaw agents, AI operations, and modular workflows. +⚠️ **This workflow has been split into focused modules for better maintainability and usability.** -## Prerequisites +## 🆕 New Modular Test Structure -### Required Setup -- Working directory: `/opt/aitbc` -- Virtual environment: `/opt/aitbc/venv` -- CLI wrapper: `/opt/aitbc/aitbc-cli` -- Services running on correct ports (8000, 8001, 8006) -- OpenClaw 2026.3.24+ installed and gateway running +See **[TEST_MASTER_INDEX.md](TEST_MASTER_INDEX.md)** for complete navigation to the new modular test workflows. -### Environment Setup +### New Test Modules Available + +1. **[Basic Testing Module](test-basic.md)** - CLI and core operations testing +2. **[OpenClaw Agent Testing](test-openclaw-agents.md)** - Agent functionality and coordination +3. **[AI Operations Testing](test-ai-operations.md)** - AI job submission and processing +4. **[Advanced AI Testing](test-advanced-ai.md)** - Complex AI workflows and multi-model pipelines +5. **[Cross-Node Testing](test-cross-node.md)** - Multi-node coordination and distributed operations +6. **[Performance Testing](test-performance.md)** - System performance and load testing +7. **[Integration Testing](test-integration.md)** - End-to-end integration testing + +### Benefits of Modular Structure + +#### ✅ **Improved Maintainability** +- Each test module focuses on specific functionality +- Easier to update individual test sections +- Reduced file complexity +- Better version control + +#### ✅ **Enhanced Usability** +- Users can run only needed test modules +- Faster test execution and navigation +- Clear separation of concerns +- Better test organization + +#### ✅ **Better Testing Strategy** +- Focused test scenarios for each component +- Clear test dependencies and prerequisites +- Specific performance benchmarks +- Comprehensive troubleshooting guides + +## 🚀 Quick Start with New Modular Structure + +### Run Basic Tests ```bash +# Navigate to basic testing module cd /opt/aitbc source venv/bin/activate + +# Reference: test-basic.md ./aitbc-cli --version -openclaw --version +./aitbc-cli chain +./aitbc-cli resource status ``` -## Testing Workflow +### Run OpenClaw Agent Tests +```bash +# Reference: test-openclaw-agents.md +openclaw agent --agent GenesisAgent --session-id test --message "Test message" --thinking low +openclaw agent --agent FollowerAgent --session-id test --message "Test response" --thinking low +``` + +### Run AI Operations Tests +```bash +# Reference: test-ai-operations.md +./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Test AI job" --payment 100 +./aitbc-cli ai-ops --action status --job-id latest +``` + +### Run Cross-Node Tests +```bash +# Reference: test-cross-node.md +./aitbc-cli resource status +ssh aitbc1 'cd /opt/aitbc && ./aitbc-cli resource status' +``` + +## 📚 Complete Test Workflow + +### Phase 1: Basic Validation +1. **[Basic Testing Module](test-basic.md)** - Verify core functionality +2. **[OpenClaw Agent Testing](test-openclaw-agents.md)** - Validate agent operations +3. **[AI Operations Testing](test-ai-operations.md)** - Confirm AI job processing + +### Phase 2: Advanced Validation +4. **[Advanced AI Testing](test-advanced-ai.md)** - Test complex AI workflows +5. **[Cross-Node Testing](test-cross-node.md)** - Validate distributed operations +6. **[Performance Testing](test-performance.md)** - Benchmark system performance + +### Phase 3: Production Readiness +7. **[Integration Testing](test-integration.md)** - End-to-end validation + +## 🔗 Quick Module Links + +| Module | Focus | Prerequisites | Quick Command | +|--------|-------|---------------|---------------| +| **[Basic](test-basic.md)** | CLI & Core Ops | None | `./aitbc-cli --version` | +| **[OpenClaw](test-openclaw-agents.md)** | Agent Testing | Basic | `openclaw agent --agent GenesisAgent --session-id test --message "test"` | +| **[AI Ops](test-ai-operations.md)** | AI Jobs | Basic | `./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "test" --payment 100` | +| **[Advanced AI](test-advanced-ai.md)** | Complex AI | AI Ops | `./aitbc-cli ai-submit --wallet genesis-ops --type parallel --prompt "complex test" --payment 500` | +| **[Cross-Node](test-cross-node.md)** | Multi-Node | AI Ops | `ssh aitbc1 'cd /opt/aitbc && ./aitbc-cli resource status'` | +| **[Performance](test-performance.md)** | Performance | All | `./aitbc-cli simulate blockchain --blocks 100 --transactions 1000` | +| **[Integration](test-integration.md)** | End-to-End | All | `./scripts/workflow-openclaw/06_advanced_ai_workflow_openclaw.sh` | + +## 🎯 Migration Guide + +### From Monolithic to Modular + +#### **Before** (Monolithic) +```bash +# Run all tests from single large file +# Difficult to navigate and maintain +# Mixed test scenarios +``` + +#### **After** (Modular) +```bash +# Run focused test modules +# Easy to navigate and maintain +# Clear test separation +# Better performance +``` + +### Recommended Test Sequence + +#### **For New Deployments** +1. Start with **[Basic Testing Module](test-basic.md)** +2. Add **[OpenClaw Agent Testing](test-openclaw-agents.md)** +3. Include **[AI Operations Testing](test-ai-operations.md)** +4. Add advanced modules as needed + +#### **For Existing Systems** +1. Run **[Basic Testing Module](test-basic.md)** for baseline +2. Use **[Integration Testing](test-integration.md)** for validation +3. Add specific modules for targeted testing + +## 📋 Legacy Content Archive + +The original monolithic test content is preserved below for reference during migration: + +--- + +*Original content continues here for archival purposes...* ### 1. Run CLI Tests ```bash