chore: remove outdated documentation and reference files
Some checks failed
AITBC CI/CD Pipeline / lint-and-test (3.11) (push) Has been cancelled
AITBC CI/CD Pipeline / lint-and-test (3.12) (push) Has been cancelled
AITBC CI/CD Pipeline / lint-and-test (3.13) (push) Has been cancelled
AITBC CI/CD Pipeline / test-cli (push) Has been cancelled
AITBC CI/CD Pipeline / test-services (push) Has been cancelled
AITBC CI/CD Pipeline / test-production-services (push) Has been cancelled
AITBC CI/CD Pipeline / security-scan (push) Has been cancelled
AITBC CI/CD Pipeline / build (push) Has been cancelled
AITBC CI/CD Pipeline / deploy-staging (push) Has been cancelled
AITBC CI/CD Pipeline / deploy-production (push) Has been cancelled
AITBC CI/CD Pipeline / performance-test (push) Has been cancelled
AITBC CI/CD Pipeline / docs (push) Has been cancelled
AITBC CI/CD Pipeline / release (push) Has been cancelled
AITBC CI/CD Pipeline / notify (push) Has been cancelled
Security Scanning / Bandit Security Scan (apps/coordinator-api/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (cli/aitbc_cli) (push) Has been cancelled
Security Scanning / Bandit Security Scan (packages/py/aitbc-core/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (packages/py/aitbc-crypto/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (packages/py/aitbc-sdk/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (tests) (push) Has been cancelled
Security Scanning / CodeQL Security Analysis (javascript) (push) Has been cancelled
Security Scanning / CodeQL Security Analysis (python) (push) Has been cancelled
Security Scanning / Dependency Security Scan (push) Has been cancelled
Security Scanning / Container Security Scan (push) Has been cancelled
Security Scanning / OSSF Scorecard (push) Has been cancelled
Security Scanning / Security Summary Report (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-cli-level1 (3.11) (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-cli-level1 (3.12) (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-cli-level1 (3.13) (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-summary (push) Has been cancelled
Some checks failed
AITBC CI/CD Pipeline / lint-and-test (3.11) (push) Has been cancelled
AITBC CI/CD Pipeline / lint-and-test (3.12) (push) Has been cancelled
AITBC CI/CD Pipeline / lint-and-test (3.13) (push) Has been cancelled
AITBC CI/CD Pipeline / test-cli (push) Has been cancelled
AITBC CI/CD Pipeline / test-services (push) Has been cancelled
AITBC CI/CD Pipeline / test-production-services (push) Has been cancelled
AITBC CI/CD Pipeline / security-scan (push) Has been cancelled
AITBC CI/CD Pipeline / build (push) Has been cancelled
AITBC CI/CD Pipeline / deploy-staging (push) Has been cancelled
AITBC CI/CD Pipeline / deploy-production (push) Has been cancelled
AITBC CI/CD Pipeline / performance-test (push) Has been cancelled
AITBC CI/CD Pipeline / docs (push) Has been cancelled
AITBC CI/CD Pipeline / release (push) Has been cancelled
AITBC CI/CD Pipeline / notify (push) Has been cancelled
Security Scanning / Bandit Security Scan (apps/coordinator-api/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (cli/aitbc_cli) (push) Has been cancelled
Security Scanning / Bandit Security Scan (packages/py/aitbc-core/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (packages/py/aitbc-crypto/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (packages/py/aitbc-sdk/src) (push) Has been cancelled
Security Scanning / Bandit Security Scan (tests) (push) Has been cancelled
Security Scanning / CodeQL Security Analysis (javascript) (push) Has been cancelled
Security Scanning / CodeQL Security Analysis (python) (push) Has been cancelled
Security Scanning / Dependency Security Scan (push) Has been cancelled
Security Scanning / Container Security Scan (push) Has been cancelled
Security Scanning / OSSF Scorecard (push) Has been cancelled
Security Scanning / Security Summary Report (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-cli-level1 (3.11) (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-cli-level1 (3.12) (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-cli-level1 (3.13) (push) Has been cancelled
AITBC CLI Level 1 Commands Test / test-summary (push) Has been cancelled
- Remove debugging service documentation (DEBUgging_SERVICES.md) - Remove development logs policy and quick reference guides - Remove E2E test creation summary - Remove gift certificate example file - Remove GitHub pull summary documentation
This commit is contained in:
@@ -2,7 +2,7 @@
|
||||
|
||||
This document describes the current organization and status of files and folders in the repository.
|
||||
|
||||
Last updated: 2026-03-06
|
||||
Last updated: 2026-03-25
|
||||
|
||||
---
|
||||
|
||||
@@ -21,7 +21,18 @@ Last updated: 2026-03-06
|
||||
| `apps/coordinator-api/tests/test_gpu_marketplace.py` | ✅ Active | 22 GPU marketplace tests (Feb 2026) |
|
||||
| `apps/coordinator-api/tests/test_billing.py` | ✅ Active | 21 billing/usage-tracking tests (Feb 2026) |
|
||||
| `apps/coordinator-api/tests/conftest.py` | ✅ Active | App namespace isolation for coordinator tests |
|
||||
| `tests/cli/test_cli_integration.py` | ✅ Active | 24 CLI → live coordinator integration tests (Feb 2026) |
|
||||
| `tests/` | ✅ Active | Test suites (reorganized Mar 2026) |
|
||||
| `tests/cli/` | ✅ Active | CLI tests (28 files, organized Mar 2026) |
|
||||
| `tests/integration/` | ✅ Active | Integration tests (28 files, organized Mar 2026) |
|
||||
| `tests/security/` | ✅ Active | Security tests (5 files, organized Mar 2026) |
|
||||
| `tests/explorer/` | ✅ Active | Explorer tests (2 files, organized Mar 2026) |
|
||||
| `tests/websocket/` | ✅ Active | WebSocket tests (2 files, organized Mar 2026) |
|
||||
| `tests/testing/` | ✅ Active | Performance/testing utilities (25 files, organized Mar 2026) |
|
||||
| `tests/unit/` | ✅ Active | Unit tests (9 files, organized Mar 2026) |
|
||||
| `tests/e2e/` | ✅ Active | End-to-end tests (26 files, organized Mar 2026) |
|
||||
| `tests/docs/` | ✅ Active | Test documentation (5 files, organized Mar 2026) |
|
||||
| `tests/conftest.py` | ✅ Active | Test configuration (root level) |
|
||||
| `tests/test_runner.py` | ✅ Active | Test runner (root level) |
|
||||
|
||||
### Scripts (`scripts/`)
|
||||
|
||||
@@ -29,12 +40,16 @@ Last updated: 2026-03-06
|
||||
|------|--------|-------|
|
||||
| `scripts/aitbc-cli.sh` | ✅ Active | Main CLI tool, heavily used |
|
||||
| `scripts/dev/gpu/gpu_miner_host.py` | ✅ Active | Production GPU miner, standardized (Mar 2026) |
|
||||
| `scripts/deploy/` | ✅ Active | Deployment scripts (35 files) |
|
||||
| `scripts/deploy/deploy-multimodal-services.sh` | ✅ Active | Environment-aware multimodal deployment (Mar 2026) |
|
||||
| `scripts/verify-codebase-update.sh` | ✅ Active | Automated codebase verification (Mar 2026) |
|
||||
| `scripts/service/` | ✅ Active | Service management |
|
||||
| `scripts/dev_services.sh` | ✅ Active | Local development |
|
||||
| `scripts/testing/` | ✅ Active | Test scripts (moved from root, 13 files) |
|
||||
| `scripts/services/` | ✅ Active | Service files (5 FastAPI services, moved Mar 2026) |
|
||||
| `scripts/deployment/` | ✅ Active | Deployment scripts (35 files, organized Mar 2026) |
|
||||
| `scripts/testing/` | ✅ Active | Test scripts (20 files, organized Mar 2026) |
|
||||
| `scripts/monitoring/` | ✅ Active | Monitoring scripts (3 files, organized Mar 2026) |
|
||||
| `scripts/development/` | ✅ Active | Development scripts (6 files, organized Mar 2026) |
|
||||
| `scripts/utils/` | ✅ Active | Utility scripts (40 files, organized Mar 2026) |
|
||||
| `scripts/manage-services.sh` | ✅ Active | Main service management script (updated Mar 2026) |
|
||||
| `scripts/README.md` | ✅ Active | Scripts documentation |
|
||||
| `scripts/deploy/` | ✅ Active | Legacy deployment scripts (27 files) |
|
||||
| `scripts/gpu/` | ✅ Active | GPU service scripts (9 files, moved to services/) |
|
||||
|
||||
### Infrastructure (`infra/`, `systemd/`)
|
||||
|
||||
@@ -65,7 +80,10 @@ Last updated: 2026-03-06
|
||||
|
||||
| Path | Status | Notes |
|
||||
|------|--------|-------|
|
||||
| `docs/1_project/` | ✅ Active | Project management docs (restructured) |
|
||||
| `docs/1_project/` | ✅ Active | Project management docs (updated Mar 2026) |
|
||||
| `docs/1_project/aitbc.md` | ✅ Active | Secondary server deployment guide (updated Mar 2026) |
|
||||
| `docs/1_project/aitbc1.md` | ✅ Active | Primary server deployment guide (updated Mar 2026) |
|
||||
| `docs/1_project/3_infrastructure.md` | ✅ Active | Infrastructure documentation (updated Mar 2026) |
|
||||
| `docs/infrastructure/` | ✅ Active | Infrastructure documentation (Mar 2026) |
|
||||
| `docs/infrastructure/codebase-update-summary.md` | ✅ Active | Comprehensive standardization summary (Mar 2026) |
|
||||
| `docs/DOCS_WORKFLOW_COMPLETION_SUMMARY.md` | ✅ Active | Documentation updates completion (Mar 2026) |
|
||||
@@ -259,11 +277,26 @@ These empty folders are intentional scaffolding for planned future work per the
|
||||
- **Workflows documented** for repeatable processes
|
||||
- **File organization prevention** system implemented
|
||||
|
||||
### ✅ CLI Development Environment Optimization (March 6, 2026)
|
||||
- **CLI development tools** moved from `cli-dev` to `dev/cli`
|
||||
- **Centralized development** environment in unified `/dev/` structure
|
||||
- **Improved project organization** with reduced root-level clutter
|
||||
- **Backup system** implemented with proper git exclusion
|
||||
### ✅ Complete Scripts and Tests Organization (March 25, 2026)
|
||||
- **Scripts organized** by purpose into 6 categories (services, deployment, testing, monitoring, development, utils)
|
||||
- **Test files organized** by function into 9 categories (cli, integration, security, explorer, websocket, testing, unit, e2e, docs)
|
||||
- **Service scripts** moved to dedicated `scripts/services/` folder
|
||||
- **Documentation updated** to reflect new file locations
|
||||
- **No codebase rewrites** needed - all paths already properly configured
|
||||
|
||||
### ✅ Server Architecture Updates (March 25, 2026)
|
||||
- **aitbc1** established as primary server (https://aitbc1.bubuit.net) with reverse proxy role
|
||||
- **aitbc** established as secondary server (https://aitbc.bubuit.net) with application services
|
||||
- **SSH access** simplified to `ssh aitbc` and `ssh aitbc1` (root login, no sudo needed)
|
||||
- **Deployment guides** updated to reflect new primary/secondary architecture
|
||||
- **Infrastructure documentation** updated for two-server setup
|
||||
|
||||
### ✅ Documentation Standardization (March 25, 2026)
|
||||
- **All sudo references** removed from systemctl commands (root access)
|
||||
- **SSH references** updated to use new server names
|
||||
- **Service paths** updated in documentation to reflect new organization
|
||||
- **12 documentation files** updated across the codebase
|
||||
- **Consistent command patterns** applied throughout
|
||||
|
||||
### ✅ Explorer Architecture Simplification (March 6, 2026)
|
||||
- **TypeScript explorer** merged into Python blockchain-explorer
|
||||
@@ -319,12 +352,30 @@ aitbc/
|
||||
│ ├── py/aitbc-sdk/ # Python SDK
|
||||
│ └── solidity/aitbc-token/# ERC-20 token contract
|
||||
├── plugins/ # ✅ Keep (ollama)
|
||||
├── scripts/ # ✅ Keep - organized by purpose
|
||||
│ ├── deploy/ # ✅ Deployment scripts (35 files)
|
||||
│ ├── dev/ # ✅ Development scripts
|
||||
│ └── testing/ # ✅ Test scripts
|
||||
├── scripts/ # ✅ Scripts organized by purpose (Mar 2026)
|
||||
│ ├── services/ # ✅ Service files (5 FastAPI services)
|
||||
│ ├── deployment/ # ✅ Deployment scripts (35 files)
|
||||
│ ├── testing/ # ✅ Test scripts (20 files)
|
||||
│ ├── monitoring/ # ✅ Monitoring scripts (3 files)
|
||||
│ ├── development/ # ✅ Development scripts (6 files)
|
||||
│ ├── utils/ # ✅ Utility scripts (40 files)
|
||||
│ ├── deploy/ # ✅ Legacy deployment scripts (27 files)
|
||||
│ ├── gpu/ # ✅ GPU service scripts (9 files)
|
||||
│ ├── manage-services.sh # ✅ Main service management script
|
||||
│ └── README.md # ✅ Scripts documentation
|
||||
├── systemd/ # ✅ Systemd service units (19+ files)
|
||||
├── tests/ # ✅ Test suites
|
||||
├── tests/ # ✅ Test suites organized by function (Mar 2026)
|
||||
│ ├── cli/ # ✅ CLI tests (28 files)
|
||||
│ ├── integration/ # ✅ Integration tests (28 files)
|
||||
│ ├── security/ # ✅ Security tests (5 files)
|
||||
│ ├── explorer/ # ✅ Explorer tests (2 files)
|
||||
│ ├── websocket/ # ✅ WebSocket tests (2 files)
|
||||
│ ├── testing/ # ✅ Performance/testing utilities (25 files)
|
||||
│ ├── unit/ # ✅ Unit tests (9 files)
|
||||
│ ├── e2e/ # ✅ End-to-end tests (26 files)
|
||||
│ ├── docs/ # ✅ Test documentation (5 files)
|
||||
│ ├── conftest.py # ✅ Test configuration
|
||||
│ └── test_runner.py # ✅ Test runner
|
||||
├── website/ # ✅ Public website and HTML docs
|
||||
├── dev-utils/ # ✅ Development utilities (legacy)
|
||||
├── data/ # ✅ Runtime data (gitignored)
|
||||
@@ -335,12 +386,14 @@ aitbc/
|
||||
This structure represents the current clean state of the AITBC repository with all essential components organized for optimal development and deployment workflows. The March 2026 standardization effort has resulted in:
|
||||
|
||||
- **100% service standardization** across all systemd services
|
||||
- **Improved file organization** with proper dev/ structure
|
||||
- **Complete scripts and tests organization** by purpose and function
|
||||
- **Updated server architecture** with primary/secondary server setup
|
||||
- **Enhanced documentation** with comprehensive infrastructure guides
|
||||
- **Automated verification tools** for maintaining standards
|
||||
- **Production-ready infrastructure** with all services operational
|
||||
- **Optimized CLI development** with centralized dev/cli environment
|
||||
- **Agent-first architecture** with simplified explorer service
|
||||
- **Comprehensive backup system** with proper git exclusion
|
||||
- **Standardized SSH access** with root privileges and no sudo requirements
|
||||
|
||||
**Note**: Redundant `apps/logs/` directory removed - central `logs/` directory at root level is used for all logging. Redundant `assets/` directory removed - Firefox extension assets are properly organized in `extensions/aitbc-wallet-firefox/`. CLI development environment moved from `cli-dev` to `dev/cli` for better organization. Explorer TypeScript source merged into Python service and backed up.
|
||||
|
||||
@@ -110,6 +110,26 @@ This roadmap aggregates high-priority tasks derived from the bootstrap specifica
|
||||
- ✅ Performance validation against deployment report targets
|
||||
- ✅ Complete documentation and usage guides
|
||||
|
||||
## Stage 28 — Project File Organization & Documentation Updates [COMPLETED: 2026-03-25]
|
||||
|
||||
- **Root Directory Cleanup**
|
||||
- ✅ Move 60+ loose files from root to proper subdirectories
|
||||
- ✅ Organize development scripts into `dev/review/`, `dev/fixes/`, `scripts/testing/`
|
||||
- ✅ Organize configuration files into `config/genesis/`, `config/networks/`, `config/templates/`
|
||||
- ✅ Move documentation to `docs/development/`, `docs/deployment/`, `docs/project/`
|
||||
- ✅ Organize temporary files into `temp/backups/`, `temp/patches/`, `logs/qa/`
|
||||
|
||||
- **File Organization Workflow**
|
||||
- ✅ Create `/organize-project-files` workflow for systematic file management
|
||||
- ✅ Implement dependency analysis to prevent codebreak from file moves
|
||||
- ✅ Establish categorization rules for different file types
|
||||
- ✅ Verify essential root files remain (configuration, documentation, system files)
|
||||
|
||||
- **Documentation Updates**
|
||||
- ✅ Update project completion status in `docs/1_project/5_done.md`
|
||||
- ✅ Reflect file organization milestone in roadmap documentation
|
||||
- ✅ Ensure all documentation references point to correct file locations
|
||||
|
||||
## Current Status: Agent-First Transformation Complete
|
||||
|
||||
**Milestone Achievement**: Successfully transformed AITBC to agent-first architecture with comprehensive CLI tools, enhanced services deployment, and complete end-to-end testing framework. All 22 commands from README are fully implemented with complete test coverage and documentation.
|
||||
|
||||
@@ -4,21 +4,21 @@
|
||||
|
||||
## Overview
|
||||
|
||||
Two-tier architecture: **incus host (at1)** runs the reverse proxy with SSL termination, forwarding all `aitbc.bubuit.net` traffic to the **aitbc container** which runs nginx + all services. **Updated for port logic 8000+ implementation with unified numbering scheme and production-ready codebase.**
|
||||
Two-tier architecture: **aitbc1 primary server** (https://aitbc1.bubuit.net) and **aitbc secondary server** (https://aitbc.bubuit.net) with **aitbc1 as reverse proxy** forwarding all traffic to aitbc container services. **Updated for port logic 8000+ implementation with unified numbering scheme and production-ready codebase.**
|
||||
|
||||
```
|
||||
Internet → aitbc.bubuit.net (HTTPS :443)
|
||||
Internet → aitbc1.bubuit.net (HTTPS :443) → aitbc.bubuit.net
|
||||
│
|
||||
▼
|
||||
┌──────────────────────────────────────────────┐
|
||||
│ Incus Host (at1 / localhost) │
|
||||
│ aitbc1 Primary Server (Reverse Proxy) │
|
||||
│ Nginx reverse proxy (:443 SSL → :80) │
|
||||
│ Config: /etc/nginx/sites-available/ │
|
||||
│ aitbc-proxy.conf │
|
||||
│ │
|
||||
│ ┌────────────────────────────────────────┐ │
|
||||
│ │ Container: aitbc (10.1.223.1) │ │
|
||||
│ │ Access: ssh aitbc-cascade │ │
|
||||
│ │ Container: aitbc (aitbc server) │ │
|
||||
│ │ Access: ssh aitbc │ │
|
||||
│ │ OS: Debian 13 Trixie │ │
|
||||
│ │ Node.js: 24+ │ │
|
||||
│ │ Python: 3.13.5+ │ │
|
||||
@@ -170,8 +170,8 @@ On at1, `/opt/aitbc` uses individual symlinks to the Windsurf project directorie
|
||||
sc-status aitbc-blockchain-node.service aitbc-blockchain-rpc.service aitbc-gpu-miner.service aitbc-mock-coordinator.service
|
||||
|
||||
# Start services
|
||||
sudo systemctl start aitbc-mock-coordinator.service
|
||||
sudo systemctl start aitbc-blockchain-node.service
|
||||
systemctl start aitbc-mock-coordinator.service
|
||||
systemctl start aitbc-blockchain-node.service
|
||||
|
||||
# Check logs
|
||||
journalctl -u aitbc-mock-coordinator --no-pager -n 20
|
||||
@@ -260,7 +260,7 @@ server {
|
||||
|
||||
### Access
|
||||
```bash
|
||||
ssh aitbc-cascade # Direct SSH to container
|
||||
ssh aitbc # Direct SSH to aitbc server
|
||||
```
|
||||
|
||||
**GPU Access**: No GPU passthrough. All GPU workloads must run on **at1** (Windsurf development host), not inside incus containers.
|
||||
@@ -378,16 +378,26 @@ All Python services in the AITBC container run on **Python 3.13.5** with isolate
|
||||
# Note: Standardized /opt/aitbc structure for all services
|
||||
```
|
||||
|
||||
**Verification Commands:**
|
||||
**Minimum Default Verification Commands:**
|
||||
```bash
|
||||
ssh aitbc-cascade "python3 --version" # Should show Python 3.13.5
|
||||
ssh aitbc-cascade "node --version" # Should show v24.14.x
|
||||
ssh aitbc-cascade "npm --version" # Should show compatible version
|
||||
ssh aitbc-cascade "ls -la /opt/*/.venv/bin/python" # Check venv symlinks
|
||||
ssh aitbc-cascade "curl -s http://127.0.0.1:8000/v1/health" # Coordinator API health
|
||||
# From aitbc1 primary server
|
||||
ssh aitbc "python3 --version" # Should show Python 3.13.5
|
||||
ssh aitbc "node --version" # Should show v24.14.x
|
||||
ssh aitbc "npm --version" # Should show compatible version
|
||||
ssh aitbc "ls -la /opt/*/.venv/bin/python" # Check venv symlinks
|
||||
ssh aitbc "curl -s http://127.0.0.1:8000/v1/health" # Coordinator API health
|
||||
curl -s https://aitbc.bubuit.net/api/v1/health # External API access
|
||||
```
|
||||
|
||||
**SSH Access:**
|
||||
```bash
|
||||
# From aitbc1 to aitbc (secondary server)
|
||||
ssh aitbc
|
||||
|
||||
# From aitbc to aitbc1 (primary server)
|
||||
ssh aitbc1
|
||||
```
|
||||
|
||||
### Nginx Routes (container)
|
||||
|
||||
Config: `/etc/nginx/sites-enabled/aitbc`
|
||||
@@ -549,25 +559,25 @@ curl http://aitbc.keisanki.net/rpc/head # Node 3 RPC (port 8003)
|
||||
### Deploying to Container
|
||||
```bash
|
||||
# Push website files
|
||||
scp -r website/* aitbc-cascade:/var/www/aitbc.bubuit.net/
|
||||
scp -r website/* aitbc:/var/www/aitbc.bubuit.net/
|
||||
|
||||
# Push app updates (blockchain-explorer serves its own interface)
|
||||
# No separate deployment needed - blockchain-explorer handles both API and UI
|
||||
|
||||
# Restart a service
|
||||
ssh aitbc-cascade "systemctl restart coordinator-api"
|
||||
ssh aitbc "systemctl restart coordinator-api"
|
||||
```
|
||||
|
||||
## Health Checks
|
||||
|
||||
```bash
|
||||
# From at1 (via container)
|
||||
ssh aitbc-cascade "curl -s http://localhost:8000/v1/health"
|
||||
ssh aitbc-cascade "curl -s http://localhost:8003/rpc/head | jq .height"
|
||||
# From aitbc1 (via aitbc server)
|
||||
ssh aitbc "curl -s http://localhost:8000/v1/health"
|
||||
ssh aitbc "curl -s http://localhost:8003/rpc/head | jq .height"
|
||||
|
||||
# Test enhanced services
|
||||
ssh aitbc-cascade "curl -s http://localhost:8010/health" # Multimodal GPU (CPU-only)
|
||||
ssh aitbc-cascade "curl -s http://localhost:8017/health" # Geographic Load Balancer
|
||||
ssh aitbc "curl -s http://localhost:8010/health" # Multimodal GPU (CPU-only)
|
||||
ssh aitbc "curl -s http://localhost:8017/health" # Geographic Load Balancer
|
||||
|
||||
# From internet (Python 3.13.5 upgraded services)
|
||||
curl -s https://aitbc.bubuit.net/health
|
||||
@@ -582,25 +592,25 @@ curl -s https://aitbc.bubuit.net/api/loadbalancer/health
|
||||
ssh ns3-root "curl -s http://192.168.100.10:8003/rpc/head | jq .height"
|
||||
|
||||
# Python version verification
|
||||
ssh aitbc-cascade "python3 --version" # Python 3.13.5
|
||||
ssh aitbc "python3 --version" # Python 3.13.5
|
||||
```
|
||||
|
||||
## Monitoring and Logging
|
||||
|
||||
```bash
|
||||
# Container systemd logs
|
||||
ssh aitbc-cascade "journalctl -u aitbc-coordinator-api --no-pager -n 20"
|
||||
ssh aitbc-cascade "journalctl -u aitbc-blockchain-node --no-pager -n 20"
|
||||
ssh aitbc "journalctl -u aitbc-coordinator-api --no-pager -n 20"
|
||||
ssh aitbc "journalctl -u aitbc-blockchain-node --no-pager -n 20"
|
||||
|
||||
# Enhanced services logs
|
||||
ssh aitbc-cascade "journalctl -u aitbc-multimodal-gpu --no-pager -n 20"
|
||||
ssh aitbc-cascade "journalctl -u aitbc-loadbalancer-geo --no-pager -n 20"
|
||||
ssh aitbc "journalctl -u aitbc-multimodal-gpu --no-pager -n 20"
|
||||
ssh aitbc "journalctl -u aitbc-loadbalancer-geo --no-pager -n 20"
|
||||
|
||||
# Container nginx logs
|
||||
ssh aitbc-cascade "tail -20 /var/log/nginx/aitbc.bubuit.net.error.log"
|
||||
ssh aitbc "tail -20 /var/log/nginx/aitbc.bubuit.net.error.log"
|
||||
|
||||
# Host nginx logs
|
||||
sudo tail -20 /var/log/nginx/error.log
|
||||
tail -20 /var/log/nginx/error.log
|
||||
```
|
||||
|
||||
## Security
|
||||
@@ -645,21 +655,19 @@ PORT=8010-8017 # Enhanced services port range
|
||||
|
||||
### Container Access & Port Logic (Updated March 6, 2026)
|
||||
|
||||
#### **SSH-Based Container Access**
|
||||
#### **SSH-Based Server Access**
|
||||
```bash
|
||||
# Access aitbc container
|
||||
ssh aitbc-cascade
|
||||
# Access aitbc server
|
||||
ssh aitbc
|
||||
|
||||
# Access aitbc1 container
|
||||
# Access aitbc1 server (from incus host only)
|
||||
ssh aitbc1-cascade
|
||||
|
||||
# Check services in containers
|
||||
ssh aitbc-cascade 'systemctl list-units | grep aitbc-'
|
||||
ssh aitbc1-cascade 'systemctl list-units | grep aitbc-'
|
||||
# Check services in servers
|
||||
ssh aitbc 'systemctl list-units | grep aitbc-'
|
||||
|
||||
# Debug specific services
|
||||
ssh aitbc-cascade 'systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-wallet'
|
||||
ssh aitbc 'systemctl status aitbc-coordinator-api'
|
||||
```
|
||||
|
||||
#### **Port Distribution Strategy - NEW STANDARD**
|
||||
@@ -731,28 +739,22 @@ ssh aitbc1-cascade 'systemctl status aitbc-wallet'
|
||||
|
||||
# Check port usage
|
||||
netstat -tlnp | grep -E ":(800[0-5]|801[0-7]|802[0-9])"
|
||||
ssh aitbc-cascade 'netstat -tlnp | grep -E ":(800[0-5]|801[0-7]|802[0-9])"
|
||||
ssh aitbc1-cascade 'netstat -tlnp | grep -E ":(800[0-5]|801[0-7]|802[0-9])"
|
||||
ssh aitbc 'netstat -tlnp | grep -E ":(800[0-5]|801[0-7]|802[0-9])'
|
||||
|
||||
# Service Management Commands:
|
||||
# Primary services:
|
||||
systemctl status aitbc-blockchain-node.service # localhost
|
||||
systemctl status aitbc-blockchain-rpc.service # localhost (port 8006)
|
||||
systemctl status aitbc-wallet.service # localhost (port 8002)
|
||||
ssh aitbc-cascade 'systemctl status aitbc-blockchain-node.service' # aitbc container
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-blockchain-node.service' # aitbc1 container
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-node.service' # aitbc server
|
||||
|
||||
# Wallet services:
|
||||
ssh aitbc-cascade 'systemctl status aitbc-wallet.service' # port 8002
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-wallet.service' # port 8002
|
||||
ssh aitbc 'systemctl status aitbc-wallet.service' # port 8002
|
||||
|
||||
# RPC services:
|
||||
ssh aitbc-cascade 'systemctl status aitbc-blockchain-rpc.service' # port 8006
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-blockchain-rpc.service' # port 8006
|
||||
ssh aitbc-cascade 'systemctl status aitbc-blockchain-rpc-dev.service' # port 8026
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-blockchain-rpc-dev.service' # port 8026
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-rpc.service' # port 8006
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-rpc-dev.service' # port 8026
|
||||
|
||||
# Development services:
|
||||
ssh aitbc-cascade 'systemctl status aitbc-blockchain-node-dev.service'
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-blockchain-node-dev.service'
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-node-dev.service'
|
||||
```
|
||||
|
||||
@@ -549,6 +549,16 @@ This document tracks components that have been successfully deployed and are ope
|
||||
- Updated `docs/files.md` with new structure
|
||||
- Fixed systemd service path for GPU miner
|
||||
|
||||
- ✅ **Project File Organization** - Completed March 25, 2026
|
||||
- **Root Directory Cleanup**: Moved 60+ loose files to proper subdirectories
|
||||
- **Development Scripts**: Organized into `dev/review/`, `dev/fixes/`, `scripts/testing/`
|
||||
- **Configuration Files**: Genesis configs to `config/genesis/`, network configs to `config/networks/`
|
||||
- **Documentation**: Moved to `docs/development/`, `docs/deployment/`, `docs/project/`
|
||||
- **Temporary Files**: Organized into `temp/backups/`, `temp/patches/`, `logs/qa/`
|
||||
- **Essential Root Files**: Only configuration, documentation, and system files remain
|
||||
- **Dependency Analysis**: Verified no codebreak from file moves
|
||||
- **Workflow Creation**: Established `/organize-project-files` workflow for future maintenance
|
||||
|
||||
## Recent Updates (2026-02-12)
|
||||
|
||||
### Persistent GPU Marketplace ✅
|
||||
|
||||
@@ -2,9 +2,9 @@
|
||||
|
||||
## Overview
|
||||
|
||||
This guide provides comprehensive deployment instructions for the **aitbc server** (primary container), including infrastructure requirements, service configurations, and troubleshooting procedures. **Updated March 7, 2026: Unified port logic deployed, codebase committed to git, enhanced services operational.**
|
||||
This guide provides comprehensive deployment instructions for the **aitbc server** (secondary development server), including infrastructure requirements, service configurations, and troubleshooting procedures. **Updated March 25, 2026: Updated architecture with aitbc1 as primary server and aitbc as secondary server.**
|
||||
|
||||
**Note**: This documentation is specific to the aitbc server. For aitbc1 server documentation, see [aitbc1.md](./aitbc1.md).
|
||||
**Note**: This documentation is specific to the aitbc secondary server. For aitbc1 primary server documentation, see [aitbc1.md](./aitbc1.md).
|
||||
|
||||
## System Requirements
|
||||
|
||||
@@ -57,38 +57,38 @@ This guide provides comprehensive deployment instructions for the **aitbc server
|
||||
|
||||
### **Container Access & SSH Management (Updated March 6, 2026)**
|
||||
|
||||
#### **SSH-Based Container Access**
|
||||
#### **SSH-Based Server Access**
|
||||
```bash
|
||||
# Access aitbc server (primary container)
|
||||
ssh aitbc-cascade
|
||||
# Access aitbc secondary server
|
||||
ssh aitbc
|
||||
|
||||
# Check aitbc server status
|
||||
ssh aitbc-cascade 'systemctl status'
|
||||
ssh aitbc 'systemctl status'
|
||||
|
||||
# List AITBC services on aitbc server
|
||||
ssh aitbc-cascade 'systemctl list-units | grep aitbc-'
|
||||
ssh aitbc 'systemctl list-units | grep aitbc-'
|
||||
```
|
||||
|
||||
#### **Service Management via SSH**
|
||||
```bash
|
||||
# Start/stop services on aitbc server
|
||||
ssh aitbc-cascade 'sudo systemctl start aitbc-coordinator-api'
|
||||
ssh aitbc-cascade 'sudo systemctl stop aitbc-wallet'
|
||||
ssh aitbc 'systemctl start aitbc-coordinator-api'
|
||||
ssh aitbc 'systemctl stop aitbc-wallet'
|
||||
|
||||
# Check service logs on aitbc server
|
||||
ssh aitbc-cascade 'sudo journalctl -f -u aitbc-coordinator-api'
|
||||
ssh aitbc 'journalctl -f -u aitbc-coordinator-api'
|
||||
|
||||
# Debug service issues on aitbc server
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-wallet'
|
||||
ssh aitbc 'systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc 'systemctl status aitbc-wallet'
|
||||
|
||||
# Check blockchain services on aitbc server
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-blockchain-node'
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-blockchain-rpc'
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-node'
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-rpc'
|
||||
|
||||
# Check development services on aitbc server
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-blockchain-node-dev'
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-blockchain-rpc-dev'
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-node-dev'
|
||||
ssh aitbc 'systemctl status aitbc-blockchain-rpc-dev'
|
||||
```
|
||||
|
||||
#### **Port Distribution Strategy (Updated March 7, 2026)**
|
||||
@@ -173,21 +173,21 @@ AITBC Platform Architecture (Updated March 7, 2026)
|
||||
#### 1.1 System Preparation
|
||||
```bash
|
||||
# Update system packages
|
||||
sudo apt update && sudo apt upgrade -y
|
||||
apt update && apt upgrade -y
|
||||
|
||||
# Install required packages
|
||||
sudo apt install -y python3.13 python3.13-venv python3-pip nodejs npm nginx sqlite3
|
||||
apt install -y python3.13 python3.13-venv python3-pip nodejs npm nginx sqlite3
|
||||
|
||||
# Create aitbc user
|
||||
sudo useradd -m -s /bin/bash aitbc
|
||||
sudo usermod -aG sudo aitbc
|
||||
useradd -m -s /bin/bash aitbc
|
||||
usermod -aG sudo aitbc
|
||||
```
|
||||
|
||||
#### 1.2 Directory Structure
|
||||
```bash
|
||||
# Create AITBC directory structure (standardized)
|
||||
sudo mkdir -p /opt/aitbc/{apps,config,logs,scripts,backups}
|
||||
sudo chown -R aitbc:aitbc /opt/aitbc
|
||||
mkdir -p /opt/aitbc/{apps,config,logs,scripts,backups}
|
||||
chown -R aitbc:aitbc /opt/aitbc
|
||||
```
|
||||
|
||||
#### 1.3 Code Deployment
|
||||
@@ -200,8 +200,8 @@ git clone https://github.com/oib/AITBC.git .
|
||||
# scp -r /path/to/aitbc/* aitbc@target:/opt/aitbc/
|
||||
|
||||
# Set permissions (standardized)
|
||||
sudo chown -R aitbc:aitbc /opt/aitbc
|
||||
sudo chmod -R 755 /opt/aitbc
|
||||
chown -R aitbc:aitbc /opt/aitbc
|
||||
chmod -R 755 /opt/aitbc
|
||||
```
|
||||
|
||||
### **Phase 2: Service Configuration**
|
||||
@@ -245,26 +245,26 @@ chown aitbc:aitbc .env
|
||||
#### 2.3 Systemd Service Installation
|
||||
```bash
|
||||
# Copy service files (updated for new port logic)
|
||||
sudo cp -r /opt/aitbc/systemd/* /etc/systemd/system/
|
||||
sudo systemctl daemon-reload
|
||||
cp -r /opt/aitbc/systemd/* /etc/systemd/system/
|
||||
systemctl daemon-reload
|
||||
|
||||
# Enable core services
|
||||
sudo systemctl enable aitbc-coordinator-api.service
|
||||
sudo systemctl enable aitbc-exchange-api.service
|
||||
sudo systemctl enable aitbc-blockchain-node.service
|
||||
sudo systemctl enable aitbc-blockchain-rpc.service
|
||||
sudo systemctl enable aitbc-blockchain-service.service
|
||||
sudo systemctl enable aitbc-network-service.service
|
||||
sudo systemctl enable aitbc-explorer.service
|
||||
systemctl enable aitbc-coordinator-api.service
|
||||
systemctl enable aitbc-exchange-api.service
|
||||
systemctl enable aitbc-blockchain-node.service
|
||||
systemctl enable aitbc-blockchain-rpc.service
|
||||
systemctl enable aitbc-blockchain-service.service
|
||||
systemctl enable aitbc-network-service.service
|
||||
systemctl enable aitbc-explorer.service
|
||||
|
||||
# Enable enhanced services (CPU-only mode)
|
||||
sudo systemctl enable aitbc-multimodal-gpu.service
|
||||
sudo systemctl enable aitbc-multimodal.service
|
||||
sudo systemctl enable aitbc-modality-optimization.service
|
||||
sudo systemctl enable aitbc-adaptive-learning.service
|
||||
sudo systemctl enable aitbc-marketplace-enhanced.service
|
||||
sudo systemctl enable aitbc-openclaw-enhanced.service
|
||||
sudo systemctl enable aitbc-loadbalancer-geo.service
|
||||
systemctl enable aitbc-multimodal-gpu.service
|
||||
systemctl enable aitbc-multimodal.service
|
||||
systemctl enable aitbc-modality-optimization.service
|
||||
systemctl enable aitbc-adaptive-learning.service
|
||||
systemctl enable aitbc-marketplace-enhanced.service
|
||||
systemctl enable aitbc-openclaw-enhanced.service
|
||||
systemctl enable aitbc-loadbalancer-geo.service
|
||||
```
|
||||
|
||||
### **Phase 3: Service Deployment**
|
||||
@@ -272,43 +272,43 @@ sudo systemctl enable aitbc-loadbalancer-geo.service
|
||||
#### 3.1 Core Services Startup
|
||||
```bash
|
||||
# Start core services in order
|
||||
sudo systemctl start aitbc-coordinator-api.service
|
||||
systemctl start aitbc-coordinator-api.service
|
||||
sleep 3
|
||||
sudo systemctl start aitbc-exchange-api.service
|
||||
systemctl start aitbc-exchange-api.service
|
||||
sleep 3
|
||||
sudo systemctl start aitbc-blockchain-node.service
|
||||
systemctl start aitbc-blockchain-node.service
|
||||
sleep 3
|
||||
sudo systemctl start aitbc-blockchain-rpc.service
|
||||
systemctl start aitbc-blockchain-rpc.service
|
||||
sleep 3
|
||||
sudo systemctl start aitbc-blockchain-service.service
|
||||
systemctl start aitbc-blockchain-service.service
|
||||
sleep 3
|
||||
sudo systemctl start aitbc-network-service.service
|
||||
systemctl start aitbc-network-service.service
|
||||
sleep 3
|
||||
sudo systemctl start aitbc-explorer.service
|
||||
systemctl start aitbc-explorer.service
|
||||
```
|
||||
|
||||
#### 3.2 Enhanced Services Startup
|
||||
```bash
|
||||
# Start enhanced services (CPU-only mode)
|
||||
sudo systemctl start aitbc-multimodal-gpu.service
|
||||
systemctl start aitbc-multimodal-gpu.service
|
||||
sleep 2
|
||||
sudo systemctl start aitbc-multimodal.service
|
||||
systemctl start aitbc-multimodal.service
|
||||
sleep 2
|
||||
sudo systemctl start aitbc-modality-optimization.service
|
||||
systemctl start aitbc-modality-optimization.service
|
||||
sleep 2
|
||||
sudo systemctl start aitbc-adaptive-learning.service
|
||||
systemctl start aitbc-adaptive-learning.service
|
||||
sleep 2
|
||||
sudo systemctl start aitbc-marketplace-enhanced.service
|
||||
systemctl start aitbc-marketplace-enhanced.service
|
||||
sleep 2
|
||||
sudo systemctl start aitbc-openclaw-enhanced.service
|
||||
systemctl start aitbc-openclaw-enhanced.service
|
||||
sleep 2
|
||||
sudo systemctl start aitbc-loadbalancer-geo.service
|
||||
systemctl start aitbc-loadbalancer-geo.service
|
||||
```
|
||||
|
||||
#### 3.3 Service Verification
|
||||
```bash
|
||||
# Check service status
|
||||
sudo systemctl list-units --type=service --state=running | grep aitbc
|
||||
systemctl list-units --type=service --state=running | grep aitbc
|
||||
|
||||
# Test core endpoints
|
||||
curl -X GET "http://localhost:8000/health" # Coordinator API
|
||||
@@ -352,13 +352,13 @@ PRAGMA temp_store = MEMORY;
|
||||
EOF
|
||||
|
||||
# System limits
|
||||
echo "aitbc soft nofile 65536" | sudo tee -a /etc/security/limits.conf
|
||||
echo "aitbc hard nofile 65536" | sudo tee -a /etc/security/limits.conf
|
||||
echo "aitbc soft nofile 65536" | tee -a /etc/security/limits.conf
|
||||
echo "aitbc hard nofile 65536" | tee -a /etc/security/limits.conf
|
||||
|
||||
# Network optimization
|
||||
echo "net.core.somaxconn = 1024" | sudo tee -a /etc/sysctl.conf
|
||||
echo "net.ipv4.tcp_max_syn_backlog = 1024" | sudo tee -a /etc/sysctl.conf
|
||||
sudo sysctl -p
|
||||
echo "net.core.somaxconn = 1024" | tee -a /etc/sysctl.conf
|
||||
echo "net.ipv4.tcp_max_syn_backlog = 1024" | tee -a /etc/sysctl.conf
|
||||
sysctl -p
|
||||
```
|
||||
|
||||
#### 4.3 Monitoring Setup
|
||||
@@ -417,7 +417,7 @@ chown aitbc:aitbc /opt/aitbc/scripts/monitor-services.sh
|
||||
#### Service Not Starting
|
||||
```bash
|
||||
# Check service logs
|
||||
sudo journalctl -u aitbc-coordinator-api.service -n 50
|
||||
journalctl -u aitbc-coordinator-api.service -n 50
|
||||
|
||||
# Check Python environment (must be 3.13+)
|
||||
cd /opt/aitbc/apps/coordinator-api
|
||||
@@ -443,14 +443,14 @@ mv /opt/aitbc/apps/coordinator-api/aitbc_coordinator.db /opt/aitbc/apps/coordina
|
||||
#### Port Conflicts (New Port Logic)
|
||||
```bash
|
||||
# Check port usage (new port logic)
|
||||
sudo netstat -tlnp | grep -E ":(8000|8001|8003|8010|8011|8012|8013|8014|8015|8016|8017)"
|
||||
netstat -tlnp | grep -E ":(8000|8001|8003|8010|8011|8012|8013|8014|8015|8016|8017)"
|
||||
|
||||
# Kill conflicting processes
|
||||
sudo fuser -k 8000/tcp # Core services
|
||||
sudo fuser -k 8010/tcp # Enhanced services
|
||||
fuser -k 8000/tcp # Core services
|
||||
fuser -k 8010/tcp # Enhanced services
|
||||
|
||||
# Restart services
|
||||
sudo systemctl restart aitbc-coordinator-api.service
|
||||
systemctl restart aitbc-coordinator-api.service
|
||||
```
|
||||
|
||||
#### Container Access Issues
|
||||
@@ -460,16 +460,16 @@ curl -s http://localhost:8017/health # Should work
|
||||
curl -s http://10.1.223.1:8017/health # Should work from containers
|
||||
|
||||
# Check service binding
|
||||
sudo netstat -tlnp | grep :8017 # Should show 0.0.0.0:8017
|
||||
netstat -tlnp | grep :8017 # Should show 0.0.0.0:8017
|
||||
```
|
||||
|
||||
#### Permission Issues
|
||||
```bash
|
||||
# Fix file ownership (standardized)
|
||||
sudo chown -R aitbc:aitbc /opt/aitbc
|
||||
chown -R aitbc:aitbc /opt/aitbc
|
||||
|
||||
# Fix file permissions
|
||||
sudo chmod -R 755 /opt/aitbc
|
||||
chmod -R 755 /opt/aitbc
|
||||
chmod 600 /opt/aitbc/apps/coordinator-api/.env
|
||||
```
|
||||
|
||||
|
||||
@@ -2,32 +2,33 @@
|
||||
|
||||
## Overview
|
||||
|
||||
This document contains specific deployment notes and considerations for deploying the AITBC platform on the **aitbc1 server** (secondary container). These notes complement the general deployment guide with server-specific configurations and troubleshooting. **Updated for optimized CPU-only deployment with enhanced services disabled.**
|
||||
This document contains specific deployment notes and considerations for deploying the AITBC platform on the **aitbc1 server** (primary development server). These notes complement the general deployment guide with server-specific configurations and troubleshooting. **Updated March 25, 2026: Updated architecture with aitbc1 as primary server and aitbc as secondary server.**
|
||||
|
||||
**Note**: This documentation is specific to the aitbc1 server. For aitbc server documentation, see [aitbc.md](./aitbc.md).
|
||||
**Note**: This documentation is specific to the aitbc1 primary server. For aitbc secondary server documentation, see [aitbc.md](./aitbc.md).
|
||||
|
||||
## Server Specifications
|
||||
|
||||
### **aitbc1 Server Details**
|
||||
- **Hostname**: aitbc1 (container)
|
||||
- **IP Address**: 10.1.223.40 (container IP)
|
||||
- **Operating System**: Debian 13 Trixie (secondary development environment)
|
||||
- **Access Method**: SSH via aitbc1-cascade proxy
|
||||
### **aitbc1 Primary Server Details**
|
||||
- **Hostname**: aitbc1 (primary development server)
|
||||
- **IP Address**: 10.1.223.40 (server IP)
|
||||
- **Operating System**: Debian 13 Trixie (primary development environment)
|
||||
- **Access Method**: SSH via aitbc1-cascade proxy (from incus host only)
|
||||
- **Reverse Proxy Role**: Primary reverse proxy for aitbc.bubuit.net
|
||||
- **GPU Access**: None (CPU-only mode)
|
||||
- **Miner Service**: Not needed
|
||||
- **Enhanced Services**: Mixed status (some enabled, some failing)
|
||||
- **Web Root**: `/var/www/html/`
|
||||
- **Nginx Configuration**: Two-tier setup with SSL termination
|
||||
- **Nginx Configuration**: Primary reverse proxy with SSL termination
|
||||
- **Container Support**: Incus containers with 0.0.0.0 binding for container access
|
||||
- **Project Document Root**: `/opt/aitbc` (standardized across all AITBC containers)
|
||||
|
||||
### **Network Architecture (Updated March 7, 2026)**
|
||||
### **Network Architecture (Updated March 25, 2026)**
|
||||
```
|
||||
Internet → aitbc1-cascade (Proxy) → aitbc1 (Container)
|
||||
SSH Access Application Server
|
||||
Port 22/443 Port 8000-8001 (Core Services)
|
||||
Port 8005-8006 Blockchain Services (AT1 Standard)
|
||||
Port 8025-8026 Development Services
|
||||
Internet → aitbc1.bubuit.net (Primary Server) → aitbc.bubuit.net (Secondary Server)
|
||||
HTTPS :443 (SSL Termination) Application Services
|
||||
Port 22/443 Port 8000-8001 (Core Services)
|
||||
Port 8005-8006 Blockchain Services (AT1 Standard)
|
||||
Port 8025-8026 Development Services
|
||||
```
|
||||
|
||||
**Note**: Now compliant with AT1 standard port assignments
|
||||
@@ -36,37 +37,40 @@ Internet → aitbc1-cascade (Proxy) → aitbc1 (Container)
|
||||
|
||||
#### **Primary Access Methods**
|
||||
```bash
|
||||
# Access aitbc1 server (secondary container)
|
||||
# Access aitbc1 primary server (from incus host only)
|
||||
ssh aitbc1-cascade
|
||||
|
||||
# Check aitbc1 server connectivity
|
||||
ssh aitbc1-cascade 'echo "Container accessible"'
|
||||
# From aitbc secondary server to aitbc1 primary
|
||||
ssh aitbc1
|
||||
|
||||
# Check aitbc1 primary server connectivity
|
||||
ssh aitbc1-cascade 'echo "Primary server accessible"'
|
||||
```
|
||||
|
||||
#### **Service Management via SSH**
|
||||
```bash
|
||||
# List all AITBC services on aitbc1 server
|
||||
ssh aitbc1-cascade 'systemctl list-units | grep aitbc-'
|
||||
# List all AITBC services on aitbc1 primary server
|
||||
ssh aitbc1 'systemctl list-units | grep aitbc-'
|
||||
|
||||
# Check specific service status on aitbc1 server
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc1-cascade 'systemctl status aitbc-wallet'
|
||||
# Check specific service status on aitbc1 primary server
|
||||
ssh aitbc1 'systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc1 'systemctl status aitbc-wallet'
|
||||
|
||||
# Start/stop services on aitbc1 server
|
||||
ssh aitbc1-cascade 'sudo systemctl start aitbc-coordinator-api'
|
||||
ssh aitbc1-cascade 'sudo systemctl stop aitbc-wallet'
|
||||
# Start/stop services on aitbc1 primary server
|
||||
ssh aitbc1 'systemctl start aitbc-coordinator-api'
|
||||
ssh aitbc1 'systemctl stop aitbc-wallet'
|
||||
|
||||
# View service logs on aitbc1 server
|
||||
ssh aitbc1-cascade 'sudo journalctl -f -u aitbc-coordinator-api'
|
||||
ssh aitbc1-cascade 'sudo journalctl -f -u aitbc-blockchain-node'
|
||||
# View service logs on aitbc1 primary server
|
||||
ssh aitbc1 'journalctl -f -u aitbc-coordinator-api'
|
||||
ssh aitbc1 'journalctl -f -u aitbc-blockchain-node'
|
||||
|
||||
# Check blockchain services on aitbc1 server
|
||||
ssh aitbc1-cascade 'sudo systemctl status aitbc-blockchain-node'
|
||||
ssh aitbc1-cascade 'sudo systemctl status aitbc-blockchain-rpc'
|
||||
# Check blockchain services on aitbc1 primary server
|
||||
ssh aitbc1 'systemctl status aitbc-blockchain-node'
|
||||
ssh aitbc1 'systemctl status aitbc-blockchain-rpc'
|
||||
|
||||
# Check development services on aitbc1 server
|
||||
ssh aitbc1-cascade 'sudo systemctl status aitbc-blockchain-node-dev'
|
||||
ssh aitbc1-cascade 'sudo systemctl status aitbc-blockchain-rpc-dev'
|
||||
# Check development services on aitbc1 primary server
|
||||
ssh aitbc1 'systemctl status aitbc-blockchain-node-dev'
|
||||
ssh aitbc1 'systemctl status aitbc-blockchain-rpc-dev'
|
||||
```
|
||||
|
||||
#### **Port Distribution & Conflict Resolution (Updated March 6, 2026)**
|
||||
@@ -108,26 +112,26 @@ ssh aitbc1-cascade 'sudo systemctl status aitbc-blockchain-rpc-dev'
|
||||
#### **Debug Container Service Issues**
|
||||
```bash
|
||||
# Debug coordinator API port conflict
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc-cascade 'sudo journalctl -u aitbc-coordinator-api -n 20'
|
||||
ssh aitbc 'systemctl status aitbc-coordinator-api'
|
||||
ssh aitbc 'journalctl -u aitbc-coordinator-api -n 20'
|
||||
|
||||
# Debug wallet service issues
|
||||
ssh aitbc-cascade 'sudo systemctl status aitbc-wallet'
|
||||
ssh aitbc-cascade 'sudo journalctl -u aitbc-wallet -n 20'
|
||||
ssh aitbc 'systemctl status aitbc-wallet'
|
||||
ssh aitbc 'journalctl -u aitbc-wallet -n 20'
|
||||
|
||||
# Check port usage in containers
|
||||
ssh aitbc-cascade 'sudo netstat -tlnp | grep :800'
|
||||
ssh aitbc1-cascade 'sudo netstat -tlnp | grep :800'
|
||||
# Check port usage in servers
|
||||
ssh aitbc 'netstat -tlnp | grep :800'
|
||||
ssh aitbc1 'netstat -tlnp | grep :800'
|
||||
|
||||
# Test service endpoints
|
||||
ssh aitbc-cascade 'curl -s http://localhost:8001/health'
|
||||
ssh aitbc1-cascade 'curl -s http://localhost:8002/health'
|
||||
ssh aitbc 'curl -s http://localhost:8001/health'
|
||||
ssh aitbc1 'curl -s http://localhost:8002/health'
|
||||
```
|
||||
|
||||
## Pre-Deployment Checklist
|
||||
|
||||
### **✅ Server Preparation**
|
||||
- [ ] SSH access confirmed via aitbc-cascade
|
||||
- [ ] SSH access confirmed via aitbc (from aitbc1) and aitbc1-cascade (from incus host)
|
||||
- [ ] System packages updated
|
||||
- [ ] aitbc user created with sudo access
|
||||
- [ ] Directory structure created
|
||||
@@ -136,13 +140,15 @@ ssh aitbc1-cascade 'curl -s http://localhost:8002/health'
|
||||
- [ ] Container networking configured
|
||||
- [ ] GPU access confirmed as not available
|
||||
- [ ] Miner service requirements confirmed as not needed
|
||||
- [ ] Reverse proxy role confirmed as primary
|
||||
|
||||
### **✅ Network Configuration**
|
||||
- [ ] Port forwarding configured on aitbc-cascade
|
||||
- [ ] SSL certificates installed on proxy
|
||||
- [ ] DNS records configured
|
||||
- [ ] Port forwarding configured on aitbc1 primary server
|
||||
- [ ] SSL certificates installed on primary server
|
||||
- [ ] DNS records configured for aitbc1.bubuit.net and aitbc.bubuit.net
|
||||
- [ ] Load balancer rules set
|
||||
- [ ] Container access configured (0.0.0.0 binding)
|
||||
- [ ] Bidirectional SSH access configured (aitbc ↔ aitbc1)
|
||||
|
||||
### **✅ Storage Requirements**
|
||||
- [ ] Minimum 50GB free space available
|
||||
@@ -271,27 +277,27 @@ sudo systemctl edit aitbc-coordinator-api.service
|
||||
|
||||
### **🔥 Issue 5: Nginx Proxy Configuration**
|
||||
|
||||
**Problem**: Requests not properly forwarded from aitbc-cascade to aitbc
|
||||
**Problem**: Requests not properly forwarded from aitbc1 primary server to aitbc secondary server
|
||||
|
||||
**Solution**:
|
||||
```bash
|
||||
# On aitbc-cascade, check proxy configuration
|
||||
# On aitbc1 primary server, check proxy configuration
|
||||
cat /etc/nginx/sites-available/aitbc-proxy.conf
|
||||
|
||||
# Ensure upstream configuration includes aitbc
|
||||
# Ensure upstream configuration includes aitbc secondary server
|
||||
upstream aitbc_backend {
|
||||
server 10.1.223.1:8000; # Coordinator API
|
||||
server 10.1.223.1:8001; # Exchange API
|
||||
server 10.1.223.1:8003; # Blockchain RPC
|
||||
server 10.1.223.1:8000; # Coordinator API (aitbc secondary)
|
||||
server 10.1.223.1:8001; # Exchange API (aitbc secondary)
|
||||
server 10.1.223.1:8003; # Blockchain RPC (aitbc secondary)
|
||||
# Add enhanced services ports
|
||||
server 10.1.223.1:8010; # Multimodal GPU
|
||||
server 10.1.223.1:8011; # GPU Multimodal
|
||||
server 10.1.223.1:8012; # Modality Optimization
|
||||
server 10.1.223.1:8013; # Adaptive Learning
|
||||
server 10.1.223.1:8014; # Marketplace Enhanced
|
||||
server 10.1.223.1:8015; # OpenClaw Enhanced
|
||||
server 10.1.223.1:8016; # Web UI
|
||||
server 10.1.223.1:8017; # Geographic Load Balancer
|
||||
server 10.1.223.1:8010; # Multimodal GPU (aitbc secondary)
|
||||
server 10.1.223.1:8011; # GPU Multimodal (aitbc secondary)
|
||||
server 10.1.223.1:8012; # Modality Optimization (aitbc secondary)
|
||||
server 10.1.223.1:8013; # Adaptive Learning (aitbc secondary)
|
||||
server 10.1.223.1:8014; # Marketplace Enhanced (aitbc secondary)
|
||||
server 10.1.223.1:8015; # OpenClaw Enhanced (aitbc secondary)
|
||||
server 10.1.223.1:8016; # Web UI (aitbc secondary)
|
||||
server 10.1.223.1:8017; # Geographic Load Balancer (aitbc secondary)
|
||||
}
|
||||
|
||||
# Reload nginx configuration
|
||||
@@ -300,17 +306,18 @@ sudo nginx -t && sudo systemctl reload nginx
|
||||
|
||||
### **🔥 Issue 6: SSL Certificate Issues**
|
||||
|
||||
**Problem**: SSL certificates not properly configured for aitbc domain
|
||||
**Problem**: SSL certificates not properly configured for aitbc domains
|
||||
|
||||
**Solution**:
|
||||
```bash
|
||||
# On aitbc-cascade, check certificate status
|
||||
# On aitbc1 primary server, check certificate status
|
||||
sudo certbot certificates
|
||||
|
||||
# Renew or obtain certificate
|
||||
sudo certbot --nginx -d aitbc.bubuit.net
|
||||
# Renew or obtain certificate for both domains
|
||||
sudo certbot --nginx -d aitbc1.bubuit.net -d aitbc.bubuit.net
|
||||
|
||||
# Test SSL configuration
|
||||
curl -I https://aitbc1.bubuit.net
|
||||
curl -I https://aitbc.bubuit.net
|
||||
```
|
||||
|
||||
@@ -527,14 +534,17 @@ sudo systemctl restart aitbc-coordinator-api.service
|
||||
|
||||
### **Issue: Network Connectivity**
|
||||
```bash
|
||||
# Test local connectivity
|
||||
# Test local connectivity on aitbc secondary server
|
||||
curl -X GET "http://localhost:8000/v1/health"
|
||||
|
||||
# Test external connectivity via proxy
|
||||
# Test external connectivity via aitbc1 primary server
|
||||
curl -X GET "http://aitbc.bubuit.net/health"
|
||||
|
||||
# Check proxy configuration
|
||||
ssh aitbc-cascade "cat /etc/nginx/sites-available/aitbc-proxy.conf"
|
||||
# Test primary server direct access
|
||||
curl -X GET "http://aitbc1.bubuit.net/health"
|
||||
|
||||
# Check proxy configuration on aitbc1 primary server
|
||||
ssh aitbc1 "cat /etc/nginx/sites-available/aitbc-proxy.conf"
|
||||
```
|
||||
|
||||
### **Issue: Container Access Problems**
|
||||
@@ -675,36 +685,36 @@ sudo systemctl restart aitbc-*.service
|
||||
|
||||
---
|
||||
|
||||
**Server**: aitbc1 (Container)
|
||||
**Server**: aitbc1 (Primary Development Server)
|
||||
**Environment**: Production
|
||||
**IP Address**: 10.1.223.40 (container)
|
||||
**IP Address**: 10.1.223.40 (primary server)
|
||||
**GPU Access**: None (CPU-only mode)
|
||||
**Miner Service**: Not needed
|
||||
**Enhanced Services**: Mixed status (some enabled, some failing)
|
||||
**Last Updated**: 2026-03-07
|
||||
**Last Updated**: 2026-03-25
|
||||
**Maintainer**: AITBC Operations Team
|
||||
**Status**: ✅ PRODUCTION READY (mixed enhanced services)
|
||||
**Status**: ✅ PRODUCTION READY (primary reverse proxy)
|
||||
**Platform Health**: 85% functional
|
||||
**External Access**: 100% working
|
||||
**CLI Functionality**: 70% working (container)
|
||||
**Multi-Site**: 1 of 3 sites operational
|
||||
**CLI Functionality**: 70% working (primary server)
|
||||
**Multi-Site**: 1 of 2 sites operational
|
||||
|
||||
## Multi-Site Deployment Status
|
||||
|
||||
### ✅ **aitbc1 Container Status**
|
||||
### ✅ **aitbc1 Primary Server Status**
|
||||
- **Services Running**: 8 services active (mixed enhanced services)
|
||||
- **External Access**: 100% functional
|
||||
- **CLI Installation**: Complete and working
|
||||
- **Performance**: Excellent
|
||||
- **Stability**: 95% (some enhanced services failing)
|
||||
- **Reverse Proxy**: Primary proxy for aitbc.bubuit.net
|
||||
|
||||
### 📊 **Multi-Site Architecture**
|
||||
- **at1 (localhost)**: 8 services running
|
||||
- **aitbc (container)**: 9 services running ✅
|
||||
- **aitbc1 (container)**: 8 services running ⚠️
|
||||
- **Total Services**: 25 across 3 sites
|
||||
- **aitbc1 (primary server)**: 8 services running
|
||||
- **aitbc (secondary server)**: 9 services running ✅
|
||||
- **Total Services**: 17 across 2 sites
|
||||
|
||||
### 🛠️ **CLI Status in aitbc1 Container**
|
||||
### 🛠️ **CLI Status in aitbc1 Primary Server**
|
||||
- **CLI Version**: v0.1.0 installed
|
||||
- **Wallet Management**: 100% working
|
||||
- **Configuration**: 100% working
|
||||
@@ -712,9 +722,10 @@ sudo systemctl restart aitbc-*.service
|
||||
- **Marketplace**: Network errors (known limitation)
|
||||
|
||||
### 🌐 **External Access Configuration**
|
||||
- **Primary URL**: https://aitbc.bubuit.net/
|
||||
- **Primary URL**: https://aitbc1.bubuit.net/ (primary server)
|
||||
- **Secondary URL**: https://aitbc.bubuit.net/ (secondary server)
|
||||
- **API Health**: https://aitbc.bubuit.net/api/health
|
||||
- **SSL Certificate**: Valid and working
|
||||
- **SSL Certificate**: Valid and working for both domains
|
||||
- **Performance**: <50ms response times
|
||||
- **Uptime**: 100%
|
||||
|
||||
@@ -745,7 +756,8 @@ Additional Services:
|
||||
```
|
||||
|
||||
### 🔧 **Maintenance Notes**
|
||||
- **Container Access**: SSH via aitbc-cascade
|
||||
- **Primary Server Access**: SSH via aitbc1-cascade (from incus host) or aitbc1 (from aitbc)
|
||||
- **Secondary Server Access**: SSH via aitbc (from aitbc1)
|
||||
- **Service Management**: systemctl commands
|
||||
- **Log Location**: /opt/aitbc/logs/
|
||||
- **Backup Location**: /opt/aitbc/backups/
|
||||
|
||||
Reference in New Issue
Block a user