docs: update CLI test results and checklist with advanced marketplace and payment testing
This commit is contained in:
@@ -139,29 +139,29 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
- [ ] `client batch-submit` — Submit multiple jobs from CSV/JSON file
|
- [ ] `client batch-submit` — Submit multiple jobs from CSV/JSON file
|
||||||
- [ ] `client blocks` — List recent blocks
|
- [ ] `client blocks` — List recent blocks
|
||||||
- [ ] `client cancel` — Cancel a job
|
- [ ] `client cancel` — Cancel a job
|
||||||
- [ ] `client history` — Show job history with filtering options
|
- [x] `client history` — Show job history with filtering options
|
||||||
- [ ] `client pay` — Create a payment for a job
|
- [x] `client pay` — Create a payment for a job
|
||||||
- [ ] `client payment-receipt` — Get payment receipt with verification
|
- [ ] `client payment-receipt` — Get payment receipt with verification
|
||||||
- [ ] `client payment-status` — Get payment status for a job
|
- [x] `client payment-status` — Get payment status for a job
|
||||||
- [ ] `client receipts` — List job receipts
|
- [x] `client receipts` — List job receipts
|
||||||
- [ ] `client refund` — Request a refund for a payment
|
- [ ] `client refund` — Request a refund for a payment
|
||||||
- [ ] `client result` — Retrieve the result of a completed job
|
- [x] `client result` — Retrieve the result of a completed job
|
||||||
- [ ] `client status` — Check job status
|
- [x] `client status` — Check job status
|
||||||
- [ ] `client submit` — Submit a job to the coordinator
|
- [x] `client submit` — Submit a job to the coordinator
|
||||||
- [ ] `client template` — Manage job templates for repeated tasks
|
- [ ] `client template` — Manage job templates for repeated tasks
|
||||||
|
|
||||||
### **wallet** — Wallet and Transaction Management
|
### **wallet** — Wallet and Transaction Management
|
||||||
- [ ] `wallet address` — Show wallet address
|
- [x] `wallet address` — Show wallet address
|
||||||
- [ ] `wallet backup` — Backup a wallet
|
- [ ] `wallet backup` — Backup a wallet
|
||||||
- [ ] `wallet balance` — Check wallet balance
|
- [x] `wallet balance` — Check wallet balance
|
||||||
- [ ] `wallet create` — Create a new wallet
|
- [x] `wallet create` — Create a new wallet
|
||||||
- [ ] `wallet delete` — Delete a wallet
|
- [ ] `wallet delete` — Delete a wallet
|
||||||
- [ ] `wallet earn` — Add earnings from completed job
|
- [ ] `wallet earn` — Add earnings from completed job
|
||||||
- [ ] `wallet history` — Show transaction history
|
- [ ] `wallet history` — Show transaction history
|
||||||
- [ ] `wallet info` — Show current wallet information
|
- [ ] `wallet info` — Show current wallet information
|
||||||
- [ ] `wallet liquidity-stake` — Stake tokens into a liquidity pool
|
- [ ] `wallet liquidity-stake` — Stake tokens into a liquidity pool
|
||||||
- [ ] `wallet liquidity-unstake` — Withdraw from liquidity pool with rewards
|
- [ ] `wallet liquidity-unstake` — Withdraw from liquidity pool with rewards
|
||||||
- [ ] `wallet list` — List all wallets
|
- [x] `wallet list` — List all wallets
|
||||||
- [ ] `wallet multisig-challenge` — Create cryptographic challenge for multisig
|
- [ ] `wallet multisig-challenge` — Create cryptographic challenge for multisig
|
||||||
- [ ] `wallet multisig-create` — Create a multi-signature wallet
|
- [ ] `wallet multisig-create` — Create a multi-signature wallet
|
||||||
- [ ] `wallet multisig-propose` — Propose a multisig transaction
|
- [ ] `wallet multisig-propose` — Propose a multisig transaction
|
||||||
@@ -186,10 +186,10 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
- [ ] `marketplace agents` — OpenClaw agent marketplace operations
|
- [ ] `marketplace agents` — OpenClaw agent marketplace operations
|
||||||
- [ ] `marketplace bid` — Marketplace bid operations
|
- [ ] `marketplace bid` — Marketplace bid operations
|
||||||
- [ ] `marketplace governance` — OpenClaw agent governance operations
|
- [ ] `marketplace governance` — OpenClaw agent governance operations
|
||||||
- [ ] `marketplace gpu` — GPU marketplace operations
|
- [x] `marketplace gpu` — GPU marketplace operations
|
||||||
- [ ] `marketplace offers` — Marketplace offers operations
|
- [x] `marketplace offers` — Marketplace offers operations
|
||||||
- [ ] `marketplace orders` — List marketplace orders
|
- [x] `marketplace orders` — List marketplace orders
|
||||||
- [ ] `marketplace pricing` — Get pricing information for GPU model
|
- [x] `marketplace pricing` — Get pricing information for GPU model
|
||||||
- [ ] `marketplace review` — Add a review for a GPU
|
- [ ] `marketplace review` — Add a review for a GPU
|
||||||
- [ ] `marketplace reviews` — Get GPU reviews
|
- [ ] `marketplace reviews` — Get GPU reviews
|
||||||
- [ ] `marketplace test` — OpenClaw marketplace testing operations
|
- [ ] `marketplace test` — OpenClaw marketplace testing operations
|
||||||
@@ -268,7 +268,7 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
## 🔧 System & Configuration Commands
|
## 🔧 System & Configuration Commands
|
||||||
|
|
||||||
### **config** — CLI Configuration Management
|
### **config** — CLI Configuration Management
|
||||||
- [ ] `config edit` — Open configuration file in editor
|
- [x] `config edit` — Open configuration file in editor
|
||||||
- [ ] `config environments` — List available environments
|
- [ ] `config environments` — List available environments
|
||||||
- [ ] `config export` — Export configuration
|
- [ ] `config export` — Export configuration
|
||||||
- [ ] `config get-secret` — Get a decrypted configuration value
|
- [ ] `config get-secret` — Get a decrypted configuration value
|
||||||
@@ -276,16 +276,16 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
- [ ] `config path` — Show configuration file path
|
- [ ] `config path` — Show configuration file path
|
||||||
- [ ] `config profiles` — Manage configuration profiles
|
- [ ] `config profiles` — Manage configuration profiles
|
||||||
- [ ] `config reset` — Reset configuration to defaults
|
- [ ] `config reset` — Reset configuration to defaults
|
||||||
- [ ] `config set` — Set configuration value
|
- [x] `config set` — Set configuration value
|
||||||
- [ ] `config set-secret` — Set an encrypted configuration value
|
- [ ] `config set-secret` — Set an encrypted configuration value
|
||||||
- [ ] `config show` — Show current configuration
|
- [x] `config show` — Show current configuration
|
||||||
- [ ] `config validate` — Validate configuration
|
- [ ] `config validate` — Validate configuration
|
||||||
|
|
||||||
### **monitor** — Monitoring, Metrics, and Alerting
|
### **monitor** — Monitoring, Metrics, and Alerting
|
||||||
- [ ] `monitor alerts` — Configure monitoring alerts
|
- [ ] `monitor alerts` — Configure monitoring alerts
|
||||||
- [ ] `monitor campaign-stats` — Campaign performance metrics (TVL, participants, rewards)
|
- [ ] `monitor campaign-stats` — Campaign performance metrics (TVL, participants, rewards)
|
||||||
- [ ] `monitor campaigns` — List active incentive campaigns
|
- [ ] `monitor campaigns` — List active incentive campaigns
|
||||||
- [ ] `monitor dashboard` — Real-time system dashboard
|
- [x] `monitor dashboard` — Real-time system dashboard (partially working, 404 on coordinator)
|
||||||
- [ ] `monitor history` — Historical data analysis
|
- [ ] `monitor history` — Historical data analysis
|
||||||
- [ ] `monitor metrics` — Collect and display system metrics
|
- [ ] `monitor metrics` — Collect and display system metrics
|
||||||
- [ ] `monitor webhooks` — Manage webhook notifications
|
- [ ] `monitor webhooks` — Manage webhook notifications
|
||||||
@@ -294,7 +294,7 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
- [ ] `node add` — Add a new node to configuration
|
- [ ] `node add` — Add a new node to configuration
|
||||||
- [ ] `node chains` — List chains hosted on all nodes
|
- [ ] `node chains` — List chains hosted on all nodes
|
||||||
- [ ] `node info` — Get detailed node information
|
- [ ] `node info` — Get detailed node information
|
||||||
- [ ] `node list` — List all configured nodes
|
- [x] `node list` — List all configured nodes
|
||||||
- [ ] `node monitor` — Monitor node activity
|
- [ ] `node monitor` — Monitor node activity
|
||||||
- [ ] `node remove` — Remove a node from configuration
|
- [ ] `node remove` — Remove a node from configuration
|
||||||
- [ ] `node test` — Test connectivity to a node
|
- [ ] `node test` — Test connectivity to a node
|
||||||
@@ -304,18 +304,18 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
## 🧪 Testing & Development Commands
|
## 🧪 Testing & Development Commands
|
||||||
|
|
||||||
### **test** — Testing and Debugging Commands for AITBC CLI
|
### **test** — Testing and Debugging Commands for AITBC CLI
|
||||||
- [ ] `test api` — Test API connectivity
|
- [x] `test api` — Test API connectivity
|
||||||
- [ ] `test blockchain` — Test blockchain functionality
|
- [ ] `test blockchain` — Test blockchain functionality
|
||||||
- [ ] `test diagnostics` — Run comprehensive diagnostics
|
- [x] `test diagnostics` — Run comprehensive diagnostics (100% pass)
|
||||||
- [ ] `test environment` — Test CLI environment and configuration
|
- [ ] `test environment` — Test CLI environment and configuration
|
||||||
- [ ] `test integration` — Run integration tests
|
- [ ] `test integration` — Run integration tests
|
||||||
- [ ] `test job` — Test job submission and management
|
- [ ] `test job` — Test job submission and management
|
||||||
- [ ] `test marketplace` — Test marketplace functionality
|
- [ ] `test marketplace` — Test marketplace functionality
|
||||||
- [ ] `test mock` — Generate mock data for testing
|
- [x] `test mock` — Generate mock data for testing
|
||||||
- [ ] `test wallet` — Test wallet functionality
|
- [ ] `test wallet` — Test wallet functionality
|
||||||
|
|
||||||
### **simulate** — Simulations and Test User Management
|
### **simulate** — Simulations and Test User Management
|
||||||
- [ ] `simulate init` — Initialize test economy
|
- [x] `simulate init` — Initialize test economy
|
||||||
- [ ] `simulate load-test` — Run load test
|
- [ ] `simulate load-test` — Run load test
|
||||||
- [ ] `simulate results` — Show simulation results
|
- [ ] `simulate results` — Show simulation results
|
||||||
- [ ] `simulate scenario` — Run predefined scenario
|
- [ ] `simulate scenario` — Run predefined scenario
|
||||||
@@ -324,7 +324,7 @@ This checklist provides a comprehensive reference for all AITBC CLI commands, or
|
|||||||
|
|
||||||
### **plugin** — CLI Plugin Management
|
### **plugin** — CLI Plugin Management
|
||||||
- [ ] `plugin install` — Install a plugin from a Python file
|
- [ ] `plugin install` — Install a plugin from a Python file
|
||||||
- [ ] `plugin list` — List installed plugins
|
- [x] `plugin list` — List installed plugins
|
||||||
- [ ] `plugin toggle` — Enable or disable a plugin
|
- [ ] `plugin toggle` — Enable or disable a plugin
|
||||||
- [ ] `plugin uninstall` — Uninstall a plugin
|
- [ ] `plugin uninstall` — Uninstall a plugin
|
||||||
|
|
||||||
|
|||||||
@@ -15,9 +15,13 @@
|
|||||||
| Wallet Operations | ✅ WORKING | ✅ WORKING | ✅ WORKING | **PASS** |
|
| Wallet Operations | ✅ WORKING | ✅ WORKING | ✅ WORKING | **PASS** |
|
||||||
| Miner Registration | ✅ WORKING | N/A (No GPU) | N/A (No GPU) | **PASS** |
|
| Miner Registration | ✅ WORKING | N/A (No GPU) | N/A (No GPU) | **PASS** |
|
||||||
| Marketplace GPU List | ✅ WORKING | ✅ WORKING | ✅ WORKING | **PASS** |
|
| Marketplace GPU List | ✅ WORKING | ✅ WORKING | ✅ WORKING | **PASS** |
|
||||||
|
| Marketplace Pricing/Orders| N/A | N/A | ✅ WORKING | **PASS** |
|
||||||
| Job Submission | ❌ FAILED | N/A | ✅ WORKING | **PARTIAL** |
|
| Job Submission | ❌ FAILED | N/A | ✅ WORKING | **PARTIAL** |
|
||||||
| Client Result | N/A | N/A | ✅ WORKING | **PASS** |
|
| Client Result/Status | N/A | N/A | ✅ WORKING | **PASS** |
|
||||||
|
| Client Payment Flow | N/A | N/A | ✅ WORKING | **PASS** |
|
||||||
| mine-ollama Feature | ✅ WORKING | N/A (No GPU) | N/A (No GPU) | **PASS** |
|
| mine-ollama Feature | ✅ WORKING | N/A (No GPU) | N/A (No GPU) | **PASS** |
|
||||||
|
| System & Nodes | N/A | N/A | ✅ WORKING | **PASS** |
|
||||||
|
| Testing & Simulation | ✅ WORKING | ✅ WORKING | ✅ WORKING | **PASS** |
|
||||||
|
|
||||||
## Topology Note: GPU Distribution
|
## Topology Note: GPU Distribution
|
||||||
* **at1 (localhost)**: The physical host machine equipped with the NVIDIA RTX 4090 GPU and Ollama installation. This is the **only node** that should register as a miner and execute `mine-ollama`.
|
* **at1 (localhost)**: The physical host machine equipped with the NVIDIA RTX 4090 GPU and Ollama installation. This is the **only node** that should register as a miner and execute `mine-ollama`.
|
||||||
@@ -34,40 +38,50 @@
|
|||||||
- **Status**: FULLY FUNCTIONAL
|
- **Status**: FULLY FUNCTIONAL
|
||||||
|
|
||||||
#### 2. Configuration Management
|
#### 2. Configuration Management
|
||||||
- **Command**: `aitbc config show`
|
- **Command**: `aitbc config show`, `aitbc config set`
|
||||||
- **Result**: ✅ Shows configuration on all servers
|
- **Result**: ✅ Shows and sets configuration on all servers
|
||||||
- **Notes**: Configured with proper `/api` endpoints and API keys.
|
- **Notes**: Configured with proper `/api` endpoints and API keys.
|
||||||
|
|
||||||
#### 3. Wallet Operations
|
#### 3. Wallet Operations
|
||||||
- **Commands**: `aitbc wallet balance`, `aitbc wallet create`
|
- **Commands**: `aitbc wallet balance`, `aitbc wallet create`, `aitbc wallet list`
|
||||||
- **Result**: ✅ Creates wallets with encryption on all servers
|
- **Result**: ✅ Creates wallets with encryption on all servers, lists available wallets
|
||||||
- **Notes**: Local balance only (blockchain not accessible)
|
- **Notes**: Local balance only (blockchain not accessible)
|
||||||
|
|
||||||
#### 4. Marketplace GPU List
|
#### 4. Marketplace Operations
|
||||||
- **Command**: `aitbc marketplace gpu list`
|
- **Command**: `aitbc marketplace gpu list`, `aitbc marketplace orders`, `aitbc marketplace pricing`
|
||||||
- **Result**: ✅ Working on all servers
|
- **Result**: ✅ Working on all servers. Dynamic pricing correctly processes capabilities JSON and calculates market averages.
|
||||||
- **Data**: Shows 3 GPUs (RTX 4090) with various statuses. (Previously failed on aitbc due to missing `/api` in URL).
|
- **Fixes Applied**: Resolved SQLModel `.exec()` vs `.execute().scalars()` attribute errors and string matching logic for pricing queries.
|
||||||
|
|
||||||
#### 5. Job Submission (aitbc1 only)
|
#### 5. Job Submission (aitbc1 only)
|
||||||
- **Command**: `aitbc client submit --type inference --prompt "test" --model "test-model"`
|
- **Command**: `aitbc client submit --type inference --prompt "test" --model "test-model"`
|
||||||
- **Result**: ✅ Successfully submits job on aitbc1
|
- **Result**: ✅ Successfully submits job on aitbc1
|
||||||
- **Job ID**: 7a767b1f742c4763bf7b22b1d79bfe7e
|
- **Job ID**: 7a767b1f742c4763bf7b22b1d79bfe7e
|
||||||
|
|
||||||
#### 6. Client Result Retrieval
|
#### 6. Client Operations
|
||||||
- **Command**: `aitbc client result <job-id>`
|
- **Command**: `aitbc client result`, `aitbc client status`, `aitbc client history`, `aitbc client receipts`
|
||||||
- **Result**: ✅ Returns job status
|
- **Result**: ✅ Returns job status, history, and receipts lists correctly.
|
||||||
|
- **Fixes Applied**: Resolved FastApi routing issues that were blocking `/jobs/{job_id}/receipt` endpoints.
|
||||||
|
|
||||||
#### 7. mine-ollama Feature
|
#### 7. Payment Flow
|
||||||
|
- **Command**: `aitbc client pay`, `aitbc client payment-status`
|
||||||
|
- **Result**: ✅ Successfully creates AITBC token escrows and tracks payment status
|
||||||
|
- **Fixes Applied**: Resolved SQLModel `UnmappedInstanceError` and syntax errors in the payment escrow tracking logic.
|
||||||
|
|
||||||
|
#### 8. mine-ollama Feature
|
||||||
- **Command**: `aitbc miner mine-ollama --jobs 1 --miner-id "test" --model "gemma3:1b"`
|
- **Command**: `aitbc miner mine-ollama --jobs 1 --miner-id "test" --model "gemma3:1b"`
|
||||||
- **Result**: ✅ Detects available models correctly
|
- **Result**: ✅ Detects available models correctly
|
||||||
- **Available Models**: lauchacarro/qwen2.5-translator:latest, gemma3:1b
|
- **Available Models**: lauchacarro/qwen2.5-translator:latest, gemma3:1b
|
||||||
- **Note**: Only applicable to at1 (localhost) due to GPU requirement.
|
- **Note**: Only applicable to at1 (localhost) due to GPU requirement.
|
||||||
|
|
||||||
#### 8. Miner Registration
|
#### 9. Miner Registration
|
||||||
- **Command**: `aitbc miner register`
|
- **Command**: `aitbc miner register`
|
||||||
- **Result**: ✅ Working on at1 (localhost)
|
- **Result**: ✅ Working on at1 (localhost)
|
||||||
- **Notes**: Only applicable to at1 (localhost) which has the physical GPU. Previously failed with 401 on aitbc1 and 405 on aitbc, but this is expected as containers do not have GPU access.
|
- **Notes**: Only applicable to at1 (localhost) which has the physical GPU. Previously failed with 401 on aitbc1 and 405 on aitbc, but this is expected as containers do not have GPU access.
|
||||||
|
|
||||||
|
#### 10. Testing & System Commands
|
||||||
|
- **Command**: `aitbc test diagnostics`, `aitbc test api`, `aitbc node list`, `aitbc simulate init`
|
||||||
|
- **Result**: ✅ Successfully runs full testing suite (100% pass rate on API, environment, wallet, and marketplace components). Successfully generated simulation test economy and genesis wallet.
|
||||||
|
|
||||||
### ❌ **FAILING COMMANDS**
|
### ❌ **FAILING COMMANDS**
|
||||||
|
|
||||||
#### 1. Blockchain Connectivity
|
#### 1. Blockchain Connectivity
|
||||||
@@ -88,10 +102,11 @@
|
|||||||
1. **CLI Installation**: All servers have working CLI v0.1.0
|
1. **CLI Installation**: All servers have working CLI v0.1.0
|
||||||
2. **Configuration System**: Working across all environments
|
2. **Configuration System**: Working across all environments
|
||||||
3. **Wallet Management**: Encryption and creation working
|
3. **Wallet Management**: Encryption and creation working
|
||||||
4. **Marketplace Access**: GPU listing fully functional across all environments
|
4. **Marketplace Access**: GPU listing and pricing logic fully functional across all environments
|
||||||
5. **Job Pipeline**: Submit → Status → Result flow working on aitbc1 (client container)
|
5. **Job Pipeline**: Submit → Status → Result → Receipts flow working on aitbc1
|
||||||
6. **New Features**: mine-ollama integration working on at1 (GPU host)
|
6. **Payment System**: Escrow generation and status tracking working
|
||||||
7. **Miner Registration**: Successfully authenticates with miner keys on at1
|
7. **New Features**: mine-ollama integration working on at1 (GPU host)
|
||||||
|
8. **Testing Capabilities**: Built-in diagnostics pass with 100% success rate
|
||||||
|
|
||||||
### ⚠️ **Topology & Configuration Notes**
|
### ⚠️ **Topology & Configuration Notes**
|
||||||
1. **Hardware Distribution**:
|
1. **Hardware Distribution**:
|
||||||
@@ -101,8 +116,8 @@
|
|||||||
3. **API Keys**: Miner commands require miner API keys, client commands require client API keys.
|
3. **API Keys**: Miner commands require miner API keys, client commands require client API keys.
|
||||||
|
|
||||||
### 🎯 **Success Rate**
|
### 🎯 **Success Rate**
|
||||||
- **Overall Success**: 8/9 command categories working (88%)
|
- **Overall Success**: 12/13 command categories working (92%)
|
||||||
- **Critical Path**: ✅ Job submission → marketplace → result flow working
|
- **Critical Path**: ✅ Job submission → marketplace → payment → result flow working
|
||||||
- **Hardware Alignment**: ✅ Commands are executed on correct hardware nodes
|
- **Hardware Alignment**: ✅ Commands are executed on correct hardware nodes
|
||||||
|
|
||||||
## Recommendations
|
## Recommendations
|
||||||
|
|||||||
Reference in New Issue
Block a user