oib/aitbc
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity

feat: update AITBC testing workflow to v3.0 with OpenClaw and AI operations

Browse Source 
Testing Workflow v3.0 Updates:
🤖 OpenClaw Agent Testing
- Multi-agent communication and coordination tests
- Session-based workflow testing
- Agent workspace and performance debugging
- Cross-agent coordination validation

🚀 AI Operations Testing
- AI job submission and monitoring
- Resource allocation and management testing
- Marketplace operations testing
- Advanced AI pipeline and ensemble testing

📦 Modular Workflow Testing
- Core setup module testing
- Operations module health checks
- Advanced features module testing
- Production module testing
- Marketplace module testing
- Reference module validation

🌐 Cross-Node Coordination Testing
- Blockchain synchronization verification
- Cross-node transaction testing
- Smart contract messaging testing
- Distributed AI operations testing
- Multi-node health monitoring

🔍 Enhanced Debugging Tools
- OpenClaw agent debugging commands
- AI operations troubleshooting
- Modular workflow component testing
- Performance testing for all components
- Comprehensive environment validation

📊 Performance Testing
- OpenClaw agent performance benchmarks
- AI operations performance testing
- Modular workflow performance validation
- Cross-node coordination performance
- End-to-end system performance

Testing Structure:
1. CLI Tests (existing)
2. OpenClaw Agent Tests (NEW)
3. AI Operations Tests (NEW)
4. Modular Workflow Tests (NEW)
5. Advanced AI Operations Tests (NEW)
6. Cross-Node Coordination Tests (NEW)
7. Integration Tests (existing)
8. Performance Testing (enhanced)

Debugging Sections:
- Common debug commands (enhanced)
- OpenClaw agent debugging (NEW)
- AI operations debugging (NEW)
- Performance testing (enhanced)
- Environment cleanup (existing)

Version History:
- v3.0: OpenClaw, AI operations, modular workflows
- v2.0: Project structure consolidation
- v1.0: Original testing workflow

Files:
- Updated: test.md (comprehensive v3.0 update)
- Added: OpenClaw testing capabilities
- Added: AI operations testing
- Added: Modular workflow testing
- Added: Cross-node coordination testing

Next Steps:
Ready for comprehensive testing of all AITBC components
Supports OpenClaw agent development and testing
Validates AI operations and marketplace functionality
Ensures modular workflow component reliability
This commit is contained in:
aitbc
2026-03-30 16:15:25 +02:00
parent d236587c9f
commit df5531b8c8
1 changed files with 221 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

229
.windsurf/workflows/test.md
View File

@@ -1,13 +1,13 @@
--- ---
description: Test and debug workflow for AITBC platform description: Test and debug workflow for AITBC platform including OpenClaw agents and AI operations
title: AITBC Testing and Debugging Workflow title: AITBC Testing and Debugging Workflow
version: 2.0 version: 3.0
auto_execution_mode: 3 auto_execution_mode: 3
--- ---
# AITBC Testing and Debugging Workflow # AITBC Testing and Debugging Workflow
This workflow helps you run tests and debug issues in the AITBC platform using the current consolidated project structure. This workflow helps you run tests and debug issues in the AITBC platform using the current consolidated project structure, including OpenClaw agents, AI operations, and modular workflows.
## Prerequisites ## Prerequisites
@@ -16,12 +16,14 @@ This workflow helps you run tests and debug issues in the AITBC platform using t
- Virtual environment: `/opt/aitbc/venv` - Virtual environment: `/opt/aitbc/venv`
- CLI wrapper: `/opt/aitbc/aitbc-cli` - CLI wrapper: `/opt/aitbc/aitbc-cli`
- Services running on correct ports (8000, 8001, 8006) - Services running on correct ports (8000, 8001, 8006)
- OpenClaw 2026.3.24+ installed and gateway running
### Environment Setup ### Environment Setup
```bash ```bash
cd /opt/aitbc cd /opt/aitbc
source venv/bin/activate source venv/bin/activate
./aitbc-cli --version ./aitbc-cli --version
openclaw --version
``` ```
## Testing Workflow ## Testing Workflow
@@ -44,7 +46,114 @@ python run_cli_tests.py
python -m pytest cli/tests/test_marketplace.py -v python -m pytest cli/tests/test_marketplace.py -v
``` ```
### 2. Run Integration Tests ### 2. Run OpenClaw Agent Tests
```bash
# Test OpenClaw gateway status
openclaw status --agent all
# Test basic agent communication
openclaw agent --agent main --message "Test communication" --thinking minimal
# Test session-based workflow
SESSION_ID="test-$(date +%s)"
openclaw agent --agent main --session-id $SESSION_ID --message "Initialize test session" --thinking low
openclaw agent --agent main --session-id $SESSION_ID --message "Continue test session" --thinking medium
# Test multi-agent coordination
openclaw agent --agent coordinator --message "Test coordination" --thinking high &
openclaw agent --agent worker --message "Test worker response" --thinking medium &
wait
```
### 3. Run AI Operations Tests
```bash
# Test AI job submission
cd /opt/aitbc
source venv/bin/activate
./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Test AI job" --payment 10
# Monitor AI job status
./aitbc-cli ai-ops --action status --job-id "latest"
# Test resource allocation
./aitbc-cli resource allocate --agent-id test-agent --cpu 2 --memory 4096 --duration 3600
# Test marketplace operations
./aitbc-cli marketplace --action list
./aitbc-cli marketplace --action create --name "Test Service" --price 50 --wallet genesis-ops
```
### 5. Run Modular Workflow Tests
```bash
# Test core setup module
cd /opt/aitbc
source venv/bin/activate
./aitbc-cli chain
./aitbc-cli network
# Test operations module
systemctl status aitbc-blockchain-node.service aitbc-blockchain-rpc.service
python3 /tmp/aitbc1_heartbeat.py
# Test advanced features module
./aitbc-cli contract list
./aitbc-cli marketplace --action list
# Test production module
curl -s http://localhost:8006/health | jq .
ssh aitbc1 'curl -s http://localhost:8006/health | jq .'
# Test marketplace module
./aitbc-cli marketplace --action create --name "Test Service" --price 25 --wallet genesis-ops
./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Test marketplace" --payment 25
# Test reference module
./aitbc-cli --help
./aitbc-cli list
./aitbc-cli balance --name genesis-ops
```
### 6. Run Advanced AI Operations Tests
```bash
# Test complex AI pipeline
SESSION_ID="advanced-test-$(date +%s)"
openclaw agent --agent main --session-id $SESSION_ID --message "Design complex AI pipeline for testing" --thinking high
# Test parallel AI operations
./aitbc-cli ai-submit --wallet genesis-ops --type parallel --prompt "Parallel AI test" --payment 100
# Test multi-model ensemble
./aitbc-cli ai-submit --wallet genesis-ops --type ensemble --models "resnet50,vgg16" --payment 200
# Test distributed AI economics
./aitbc-cli ai-submit --wallet genesis-ops --type distributed --nodes "aitbc,aitbc1" --payment 500
# Monitor advanced AI operations
./aitbc-cli ai-ops --action status --job-id "latest"
./aitbc-cli resource status
```
### 7. Run Cross-Node Coordination Tests
```bash
# Test cross-node blockchain sync
GENESIS_HEIGHT=$(curl -s http://localhost:8006/rpc/head | jq .height)
FOLLOWER_HEIGHT=$(ssh aitbc1 'curl -s http://localhost:8006/rpc/head | jq .height)
echo "Height difference: $((FOLLOWER_HEIGHT - GENESIS_HEIGHT))"
# Test cross-node transactions
./aitbc-cli send --from genesis-ops --to follower-addr --amount 100 --password 123
ssh aitbc1 'cd /opt/aitbc && source venv/bin/activate && ./aitbc-cli balance --name follower-ops'
# Test smart contract messaging
curl -X POST http://localhost:8006/rpc/messaging/topics/create \
-H "Content-Type: application/json" \
-d '{"agent_id": "test", "agent_address": "address", "title": "Test", "description": "Test"}'
# Test cross-node AI coordination
ssh aitbc1 'cd /opt/aitbc && source venv/bin/activate && ./aitbc-cli ai-submit --wallet follower-ops --type inference --prompt "Cross-node test" --payment 50'
```
### 8. Run Integration Tests
```bash ```bash
# Run all integration tests # Run all integration tests
cd /opt/aitbc cd /opt/aitbc
@@ -185,7 +294,7 @@ curl -s http://localhost:8000/v1/jobs/{job_id}/payment \
-H "X-Api-Key: client_dev_key_1" | python3 -m json.tool -H "X-Api-Key: client_dev_key_1" | python3 -m json.tool
``` ```
### 10. Common Debug Commands ### 12. Common Debug Commands
```bash ```bash
# Check Python environment # Check Python environment
cd /opt/aitbc cd /opt/aitbc
@@ -208,9 +317,60 @@ netstat -tlnp | grep -E "(8000|8001|8006|11434)"
./aitbc-cli --version ./aitbc-cli --version
./aitbc-cli wallet list ./aitbc-cli wallet list
./aitbc-cli chain ./aitbc-cli chain
# Check OpenClaw functionality
openclaw --version
openclaw status --agent all
# Check AI operations
./aitbc-cli ai-ops --action status --job-id "latest"
./aitbc-cli resource status
# Check modular workflow status
curl -s http://localhost:8006/health | jq .
ssh aitbc1 'curl -s http://localhost:8006/health | jq .'
``` ```
### 11. Performance Testing ### 13. OpenClaw Agent Debugging
```bash
# Test OpenClaw gateway connectivity
openclaw status --agent all
# Debug agent communication
openclaw agent --agent main --message "Debug test" --thinking high
# Test session management
SESSION_ID="debug-$(date +%s)"
openclaw agent --agent main --session-id $SESSION_ID --message "Session debug test" --thinking medium
# Test multi-agent coordination
openclaw agent --agent coordinator --message "Debug coordination test" --thinking high &
openclaw agent --agent worker --message "Debug worker response" --thinking medium &
wait
# Check agent workspace
openclaw workspace --status
```
### 14. AI Operations Debugging
```bash
# Debug AI job submission
cd /opt/aitbc
source venv/bin/activate
./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Debug test" --payment 10
# Monitor AI job execution
./aitbc-cli ai-ops --action status --job-id "latest"
# Debug resource allocation
./aitbc-cli resource allocate --agent-id debug-agent --cpu 1 --memory 2048 --duration 1800
# Debug marketplace operations
./aitbc-cli marketplace --action list
./aitbc-cli marketplace --action create --name "Debug Service" --price 5 --wallet genesis-ops
```
### 15. Performance Testing
```bash ```bash
# Run tests with performance profiling # Run tests with performance profiling
cd /opt/aitbc cd /opt/aitbc
@@ -222,9 +382,15 @@ ab -n 100 -c 10 http://localhost:8000/health
# Test blockchain RPC performance # Test blockchain RPC performance
time curl -s http://localhost:8006/rpc/head | python3 -m json.tool time curl -s http://localhost:8006/rpc/head | python3 -m json.tool
# Test OpenClaw agent performance
time openclaw agent --agent main --message "Performance test" --thinking high
# Test AI operations performance
time ./aitbc-cli ai-submit --wallet genesis-ops --type inference --prompt "Performance test" --payment 10
``` ```
### 12. Clean Test Environment ### 16. Clean Test Environment
```bash ```bash
# Clean pytest cache # Clean pytest cache
cd /opt/aitbc cd /opt/aitbc
@@ -358,7 +524,54 @@ python -m pytest cli/tests/ --cov-fail-under=80
python -m pytest cli/tests/test_cli_basic.py -v python -m pytest cli/tests/test_cli_basic.py -v
``` ```
## Recent Updates (v2.0) ## Recent Updates (v3.0)
### New Testing Capabilities
- **OpenClaw Agent Testing**: Added comprehensive agent communication and coordination tests
- **AI Operations Testing**: Added AI job submission, resource allocation, and marketplace testing
- **Modular Workflow Testing**: Added testing for all 6 modular workflow components
- **Advanced AI Operations**: Added testing for complex AI pipelines and cross-node coordination
- **Cross-Node Coordination**: Added testing for distributed AI operations and blockchain messaging
### Enhanced Testing Structure
- **Multi-Agent Workflows**: Session-based agent coordination testing
- **AI Pipeline Testing**: Complex AI workflow orchestration testing
- **Distributed Testing**: Cross-node blockchain and AI operations testing
- **Performance Testing**: Added OpenClaw and AI operations performance benchmarks
- **Debugging Tools**: Enhanced troubleshooting for agent and AI operations
### Updated Project Structure
- **Working Directory**: `/opt/aitbc`
- **Virtual Environment**: `/opt/aitbc/venv`
- **CLI Wrapper**: `./aitbc-cli`
- **OpenClaw Integration**: OpenClaw 2026.3.24+ gateway and agents
- **Modular Workflows**: 6 focused workflow modules
- **Test Structure**: Updated to include agent and AI testing
### Service Port Updates
- **Coordinator API**: Port 8000
- **Exchange API**: Port 8001
- **Blockchain RPC**: Port 8006
- **Ollama**: Port 11434 (GPU operations)
- **OpenClaw Gateway**: Default port (configured in OpenClaw)
### Enhanced Testing Features
- **Agent Testing**: Multi-agent communication and coordination
- **AI Testing**: Job submission, monitoring, resource allocation
- **Workflow Testing**: Modular workflow component testing
- **Cross-Node Testing**: Distributed operations and coordination
- **Performance Testing**: Comprehensive performance benchmarking
- **Debugging**: Enhanced troubleshooting for all components
### Current Commands
- **CLI Commands**: Updated to use actual CLI implementation
- **OpenClaw Commands**: Agent communication and coordination
- **AI Operations**: Job submission, monitoring, marketplace
- **Service Management**: Updated to current systemd services
- **Modular Workflows**: Testing for all workflow modules
- **Environment**: Proper venv activation and usage
## Previous Updates (v2.0)
### Updated Project Structure ### Updated Project Structure
- **Working Directory**: Updated to `/opt/aitbc` - **Working Directory**: Updated to `/opt/aitbc`