feat: major infrastructure refactoring and optimization
All checks were successful
AITBC CLI Level 1 Commands Test / test-cli-level1 (push) Successful in 16s
api-endpoint-tests / test-api-endpoints (push) Successful in 35s
integration-tests / test-service-integration (push) Successful in 1m25s
package-tests / test-python-packages (map[name:aitbc-agent-sdk path:packages/py/aitbc-agent-sdk python_version:3.13]) (push) Successful in 16s
package-tests / test-python-packages (map[name:aitbc-cli path:. python_version:3.13]) (push) Successful in 14s
package-tests / test-python-packages (map[name:aitbc-core path:packages/py/aitbc-core python_version:3.13]) (push) Successful in 13s
package-tests / test-python-packages (map[name:aitbc-crypto path:packages/py/aitbc-crypto python_version:3.13]) (push) Successful in 10s
package-tests / test-python-packages (map[name:aitbc-sdk path:packages/py/aitbc-sdk python_version:3.13]) (push) Successful in 12s
package-tests / test-javascript-packages (map[name:aitbc-sdk node_version:24 path:packages/js/aitbc-sdk]) (push) Successful in 18s
python-tests / test-specific (push) Has been skipped
security-scanning / audit (push) Successful in 14s
systemd-sync / sync-systemd (push) Successful in 4s
package-tests / cross-language-compatibility (push) Successful in 2s
package-tests / package-integration-tests (push) Successful in 3s
Documentation Validation / validate-docs (push) Successful in 6m13s
python-tests / test (push) Successful in 14s
All checks were successful
AITBC CLI Level 1 Commands Test / test-cli-level1 (push) Successful in 16s
api-endpoint-tests / test-api-endpoints (push) Successful in 35s
integration-tests / test-service-integration (push) Successful in 1m25s
package-tests / test-python-packages (map[name:aitbc-agent-sdk path:packages/py/aitbc-agent-sdk python_version:3.13]) (push) Successful in 16s
package-tests / test-python-packages (map[name:aitbc-cli path:. python_version:3.13]) (push) Successful in 14s
package-tests / test-python-packages (map[name:aitbc-core path:packages/py/aitbc-core python_version:3.13]) (push) Successful in 13s
package-tests / test-python-packages (map[name:aitbc-crypto path:packages/py/aitbc-crypto python_version:3.13]) (push) Successful in 10s
package-tests / test-python-packages (map[name:aitbc-sdk path:packages/py/aitbc-sdk python_version:3.13]) (push) Successful in 12s
package-tests / test-javascript-packages (map[name:aitbc-sdk node_version:24 path:packages/js/aitbc-sdk]) (push) Successful in 18s
python-tests / test-specific (push) Has been skipped
security-scanning / audit (push) Successful in 14s
systemd-sync / sync-systemd (push) Successful in 4s
package-tests / cross-language-compatibility (push) Successful in 2s
package-tests / package-integration-tests (push) Successful in 3s
Documentation Validation / validate-docs (push) Successful in 6m13s
python-tests / test (push) Successful in 14s
## 🚀 Central Virtual Environment Implementation - Created central venv at /opt/aitbc/venv for all services - Updated 34+ systemd services to use central python interpreter - Fixed PYTHONPATH configurations for proper module imports - Created aitbc-env wrapper script for environment management ## 📦 Requirements Management Overhaul - Consolidated 8 separate requirements.txt files into central requirements.txt - Added web3>=6.11.0 for blockchain functionality - Created automated requirements migrator tool (scripts/requirements_migrator.py) - Established modular requirements structure (requirements-modules/) - Generated comprehensive migration reports and documentation ## 🔧 Service Configuration Fixes - Fixed Adaptive Learning service domain imports (AgentStatus) - Resolved logging conflicts in zk_proofs and adaptive_learning_health - Created missing data modules (consumer_gpu_profiles.py) - Updated CLI to version 0.2.2 with proper import handling - Fixed infinite loop in CLI alias configuration ## 📡 Port Mapping and Service Updates - Updated blockchain node port from 8545 to 8005 - Added Adaptive Learning service on port 8010 - Consolidated P2P/sync into blockchain-node service - All 5 core services now operational and responding ## 📚 Documentation Enhancements - Updated SYSTEMD_SERVICES.md for Debian root usage (no sudo) - Added comprehensive VIRTUAL_ENVIRONMENT.md guide - Created REQUIREMENTS_MERGE_SUMMARY.md with migration details - Updated RUNTIME_DIRECTORIES.md for standard Linux paths - Fixed service port mappings and dependencies ## 🛠️ CLI Improvements - Fixed import errors and version display (0.2.2) - Resolved infinite loop in bashrc alias - Added proper error handling for missing command modules - Created aitbc-cli wrapper for clean execution ## ✅ Operational Status - 5/5 AITBC services running successfully - All health checks passing - Central virtual environment fully functional - Requirements management streamlined - Documentation accurate and up-to-date ## 🎯 Technical Achievements - Eliminated 7 redundant requirements.txt files - Reduced service startup failures from 34+ to 0 - Established modular dependency management - Created reusable migration tooling - Standardized Debian root deployment practices This represents a complete infrastructure modernization with improved reliability, maintainability, and operational efficiency.
This commit is contained in:
59
setup.sh
59
setup.sh
@@ -77,6 +77,54 @@ clone_repo() {
|
||||
success "Repository cloned successfully"
|
||||
}
|
||||
|
||||
# Setup runtime directories
|
||||
setup_runtime_directories() {
|
||||
log "Setting up runtime directories..."
|
||||
|
||||
# Create standard Linux directories
|
||||
directories=(
|
||||
"/var/lib/aitbc"
|
||||
"/var/lib/aitbc/keystore"
|
||||
"/var/lib/aitbc/data"
|
||||
"/var/lib/aitbc/logs"
|
||||
"/etc/aitbc"
|
||||
"/var/log/aitbc"
|
||||
)
|
||||
|
||||
for dir in "${directories[@]}"; do
|
||||
mkdir -p "$dir"
|
||||
log "Created directory: $dir"
|
||||
done
|
||||
|
||||
# Set permissions
|
||||
chmod 755 /var/lib/aitbc
|
||||
chmod 700 /var/lib/aitbc/keystore # Secure keystore
|
||||
chmod 755 /var/lib/aitbc/data
|
||||
chmod 755 /var/lib/aitbc/logs
|
||||
chmod 755 /etc/aitbc
|
||||
chmod 755 /var/log/aitbc
|
||||
|
||||
# Set ownership
|
||||
chown root:root /var/lib/aitbc
|
||||
chown root:root /var/lib/aitbc/keystore
|
||||
chown root:root /var/lib/aitbc/data
|
||||
chown root:root /var/lib/aitbc/logs
|
||||
chown root:root /etc/aitbc
|
||||
chown root:root /var/log/aitbc
|
||||
|
||||
# Create README files
|
||||
echo "# AITBC Runtime Data Directory" > /var/lib/aitbc/README.md
|
||||
echo "# Keystore for blockchain keys (SECURE)" > /var/lib/aitbc/keystore/README.md
|
||||
echo "# Application databases" > /var/lib/aitbc/data/README.md
|
||||
echo "# Application logs" > /var/lib/aitbc/logs/README.md
|
||||
echo "# AITBC Configuration Files" > /etc/aitbc/README.md
|
||||
|
||||
# Create symlink for standard logging
|
||||
ln -sf /var/lib/aitbc/logs /var/log/aitbc
|
||||
|
||||
success "Runtime directories setup completed"
|
||||
}
|
||||
|
||||
# Setup Python virtual environments
|
||||
setup_venvs() {
|
||||
log "Setting up Python virtual environments..."
|
||||
@@ -296,11 +344,12 @@ EOF
|
||||
|
||||
# Main function
|
||||
main() {
|
||||
log "Starting AITBC local setup..."
|
||||
log "Starting AITBC setup..."
|
||||
|
||||
check_root
|
||||
check_prerequisites
|
||||
clone_repo
|
||||
setup_runtime_directories
|
||||
setup_venvs
|
||||
install_services
|
||||
create_startup_script
|
||||
@@ -315,10 +364,16 @@ main() {
|
||||
echo " Exchange API: http://localhost:8001/api/health"
|
||||
echo " Coordinator API: http://localhost:8000/health"
|
||||
echo ""
|
||||
echo "Runtime Directories:"
|
||||
echo " Keystore: /var/lib/aitbc/keystore/"
|
||||
echo " Data: /var/lib/aitbc/data/"
|
||||
echo " Logs: /var/lib/aitbc/logs/"
|
||||
echo " Config: /etc/aitbc/"
|
||||
echo ""
|
||||
echo "Management Commands:"
|
||||
echo " Health check: /opt/aitbc/health-check.sh"
|
||||
echo " Restart services: /opt/aitbc/start-services.sh"
|
||||
echo " View logs: tail -f /var/log/aitbc-*.log"
|
||||
echo " View logs: tail -f /var/lib/aitbc/logs/aitbc-*.log"
|
||||
}
|
||||
|
||||
# Run main function
|
||||
|
||||
Reference in New Issue
Block a user