Some checks failed
API Endpoint Tests / test-api-endpoints (push) Successful in 11s
CLI Tests / test-cli (push) Failing after 7s
Documentation Validation / validate-docs (push) Successful in 8s
Documentation Validation / validate-policies-strict (push) Successful in 3s
Integration Tests / test-service-integration (push) Successful in 38s
Python Tests / test-python (push) Successful in 11s
Security Scanning / security-scan (push) Successful in 29s
Multi-Node Blockchain Health Monitoring / health-check (push) Successful in 1s
CLI Blockchain Features: - Added block operations: import, export, import-chain, blocks-range - Added messaging system commands (deploy, state, topics, create-topic, messages, post, vote, search, reputation, moderate) - Added network force-sync operation - Replaced marketplace handlers with actual RPC calls - Replaced AI handlers with actual RPC calls - Added account operations (account get) - Added transaction query operations - Added mempool query operations - Created keystore_auth.py for authentication - Removed extended features interception - All handlers use keystore credentials for authenticated endpoints Pool Hub Enhancements: - Added SLA monitoring and capacity tables - Added billing integration service - Added SLA collector service - Added SLA router endpoints - Updated pool hub models and settings - Added integration tests for billing and SLA - Updated documentation with SLA monitoring guide
2.7 KiB
2.7 KiB
Pool Hub
Purpose & Scope
Matchmaking gateway between coordinator job requests and available miners. See docs/bootstrap/pool_hub.md for architectural guidance.
Development Setup
- Create a Python virtual environment under
apps/pool-hub/.venv. - Install FastAPI, Redis (optional), and PostgreSQL client dependencies once requirements are defined.
- Implement routers and registry as described in the bootstrap document.
SLA Monitoring and Billing Integration
Pool-Hub now includes comprehensive SLA monitoring and billing integration with coordinator-api:
SLA Metrics
- Miner Uptime: Tracks miner availability based on heartbeat intervals
- Response Time: Monitors average response time from match results
- Job Completion Rate: Tracks successful vs failed job outcomes
- Capacity Availability: Monitors overall pool capacity utilization
SLA Thresholds
Default thresholds (configurable in settings):
- Uptime: 95%
- Response Time: 1000ms
- Completion Rate: 90%
- Capacity Availability: 80%
Billing Integration
Pool-Hub integrates with coordinator-api's billing system to:
- Record usage data (gpu_hours, api_calls, compute_hours)
- Sync miner usage to tenant billing
- Generate invoices via coordinator-api
- Track billing metrics and costs
API Endpoints
SLA and billing endpoints are available under /sla/:
GET /sla/metrics/{miner_id}- Get SLA metrics for a minerGET /sla/metrics- Get SLA metrics across all minersGET /sla/violations- Get SLA violationsPOST /sla/metrics/collect- Trigger SLA metrics collectionGET /sla/capacity/snapshots- Get capacity planning snapshotsGET /sla/capacity/forecast- Get capacity forecastGET /sla/capacity/recommendations- Get scaling recommendationsGET /sla/billing/usage- Get billing usage dataPOST /sla/billing/sync- Trigger billing sync with coordinator-api
Configuration
Add to .env:
# Coordinator-API Billing Integration
COORDINATOR_BILLING_URL=http://localhost:8011
COORDINATOR_API_KEY=your_api_key_here
# SLA Configuration
SLA_UPTIME_THRESHOLD=95.0
SLA_RESPONSE_TIME_THRESHOLD=1000.0
SLA_COMPLETION_RATE_THRESHOLD=90.0
SLA_CAPACITY_THRESHOLD=80.0
# Capacity Planning
CAPACITY_FORECAST_HOURS=168
CAPACITY_ALERT_THRESHOLD_PCT=80.0
# Billing Sync
BILLING_SYNC_INTERVAL_HOURS=1
# SLA Collection
SLA_COLLECTION_INTERVAL_SECONDS=300
Database Migration
Run the database migration to add SLA and capacity tables:
cd apps/pool-hub
alembic upgrade head
Testing
Run tests for SLA and billing integration:
cd apps/pool-hub
pytest tests/test_sla_collector.py
pytest tests/test_billing_integration.py
pytest tests/test_sla_endpoints.py
pytest tests/test_integration_coordinator.py