32 lines
2.8 KiB
Text
32 lines
2.8 KiB
Text
|
/usr/local/lib/python3.13/site-packages/torch/_subclasses/functional_tensor.py:283: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:84.)
|
||
|
|
cpu = _conversion_method_template(device=torch.device("cpu"))
|
||
|
|
[ 0.15s] exec node=1 exit=0 0.142s | Warning: Permanently added 'worker-1' (ED25519) to the list of known hosts.
|
||
|
|
[ 0.15s] exec node=0 exit=0 0.144s | Warning: Permanently added 'worker-0' (ED25519) to the list of known hosts.
|
||
|
|
[ 0.30s] push node=1 job_module.py 1.4KB 0.146s
|
||
|
|
[ 0.30s] push node=0 job_module.py 1.4KB 0.146s
|
||
|
|
[ 0.30s] ──── round 0 start (2 workers) ────────────────────
|
||
|
|
[ 0.45s] push node=0 params.pt 399.7KB 0.145s
|
||
|
|
[ 0.45s] push node=1 params.pt 399.7KB 0.146s
|
||
|
|
[ 9.86s] exec node=1 exit=0 9.416s | cpu = _conversion_method_template(device=torch.device("cpu"))
|
||
|
|
[ 9.87s] exec node=0 exit=0 9.419s | cpu = _conversion_method_template(device=torch.device("cpu"))
|
||
|
|
[ 10.04s] pull node=0 weights.pt 399.7KB 0.174s
|
||
|
|
[ 10.21s] pull node=1 weights.pt 399.7KB 0.165s
|
||
|
|
[ 10.21s] agg 2 workers |W|=8.72 Δ=0.3177 0.002s
|
||
|
|
[ 10.21s] ──── round 0 end (2/2 survived, 9.91s) ────────────
|
||
|
|
2026-02-05 15:59:23,615 INFO sched.scheduler: Round 0: 2/2 workers
|
||
|
|
|
||
|
|
▓ push █ train ▒ pull ● agg ✗ dead ░ wait
|
||
|
|
|
||
|
|
round 0 [2/2] 9.91s
|
||
|
|
scheduler ▓▓░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░▒▒●
|
||
|
|
worker 0 █████████████████████████████████████████████████████████▒▒─
|
||
|
|
worker 1 ██████████████████████████████████████████████████████████▒▒
|
||
|
|
|
||
|
|
|
||
|
|
Round Workers Params↑ Weights↓ Train(max) Agg Total Δ norm
|
||
|
|
────────────────────────────────────────────────────────────────────────────
|
||
|
|
0 2/2 799.4KB 799.4KB 9.42 0.002 9.91 0.3177
|
||
|
|
────────────────────────────────────────────────────────────────────────────
|
||
|
|
total 799.4KB 799.4KB 9.91
|
||
|
|
Report: /app/reports/report.html
|