This package is intended to be copied to a remote machine and run directly.
workspace/vllm/: runnable code snapshot (hacked vLLM + tream + SpecForge code)workspace/vllm/tream/lvm-llama2-7b/: base modelworkspace/vllm/tream/data/streaming-lvm-dataset/: datasetsworkspace/vllm/SpecForge/output/lvm_eagle3_lora_v1/epoch_0_step_3475/: draft checkpointtools/no_docker/: environment setup filestools/launch_ab48_8gpu.sh: 8-GPU launchertools/run_ab48_spec_static_8gpu.sh: one-click single experimenttools/run_ab48_ablation_4modes_8gpu.sh: one-click 4-mode ablationtar -xzf openbox_full_*.tar.gz
cd openbox_full_*
# one-click: AB48 static spec, 8-GPU
bash tools/run_ab48_spec_static_8gpu.sh
bash tools/run_ab48_ablation_4modes_8gpu.sh
Defaults:
conda, env name treamEgo4d0,1,2,3,4,5,6,78Python
85.2%
Cuda
6.6%
C++
3.9%
Shell
3.0%
This package is intended to be copied to a remote machine and run directly.
workspace/vllm/: runnable code snapshot (hacked vLLM + tream + SpecForge code)workspace/vllm/tream/lvm-llama2-7b/: base modelworkspace/vllm/tream/data/streaming-lvm-dataset/: datasetsworkspace/vllm/SpecForge/output/lvm_eagle3_lora_v1/epoch_0_step_3475/: draft checkpointtools/no_docker/: environment setup filestools/launch_ab48_8gpu.sh: 8-GPU launchertools/run_ab48_spec_static_8gpu.sh: one-click single experimenttools/run_ab48_ablation_4modes_8gpu.sh: one-click 4-mode ablationtar -xzf openbox_full_*.tar.gz
cd openbox_full_*
# one-click: AB48 static spec, 8-GPU
bash tools/run_ab48_spec_static_8gpu.sh
bash tools/run_ab48_ablation_4modes_8gpu.sh
Defaults:
conda, env name treamEgo4d0,1,2,3,4,5,6,78Python
85.2%
Cuda
6.6%
C++
3.9%
Shell
3.0%