swactor/examples/pipeline-parallel-inference/profiles/vastai.env
Zachery Aaron Shores-Chmielewski 89e9b5b587 feat(distribution): add vastai telemetry layer and synth
New diagnostics::vastai (record/sampler/shipper/logs) + vastai-synth crate for
reproducible synthetic fleet telemetry. Dashboard live_collector unifies collector +
fleet SSE UI; pp example adds vastai_mon, profiles, docker base image, scripts.


Signed-off-by: Zachery Aaron Shores-Chmielewski <zacheryasc@gmail.com>
2026-05-29 12:55:10 +04:00

18 lines
653 B
Bash

# WAN run on leased vast.ai GPUs. Copy to profiles/local.env and fill in the
# relay URL + image; keep that copy untracked.
#
# PP_PROFILE=profiles/local.env cargo run --bin pp-smoke-run -- \
# --vastai --api-key "$VASTAI_API_KEY"
#
# All nodes home onto one operator-controlled relay so they can hole-punch /
# fall back to relaying across the public internet.
# Required for WAN: the relay every container connects through. PLACEHOLDER —
# replace with your swactor-iroh-relay endpoint in profiles/local.env.
SWACTOR_IROH_RELAY_URL=https://relay.example.com
NUM_STAGES=2
PP_IMAGE=swactor-pp-gpu:latest
PP_GPU=RTX 3060
MODEL=
MAX_TOKENS=64