quangkmhd/AIP491_G5_SU26_1DOD

Python

0

4 commits

updated Jul 8, 2026

See the code

README

1DOD — One-Dimensional Object Detection for Streaming Text Segmentation

Vietnamese adaptation of 1DOD for meeting dialogue text segmentation.

Model: Qualcomm-AI-Research/BamiBERT — a RoBERTa-based Vietnamese language model with 2048-token context window. Trained on Vietnamese translated AMC (AliMeeting4MUG) data.

Finetuned checkpoint: bamibert-1dod-vi-v1/ (A=60.58, B=45.74)

Results on Vietnamese AMC (AliMeeting4MUG)

MetricPaper (PoNet, Chinese)Ours (BamiBERT, Vietnamese)
A ↑ (Alignment Index)59.7160.58
B ↑ (Boundary Similarity)48.4745.74
S ↑ (Segmentation Similarity)—98.40
1 − Pk ↑62.1557.28
1 − WD ↑61.1857.17
miou—63.51
wiou—64.27

Metric Definitions (from the paper)

MetricDescription
AAlignment Index. Based on paragraph matching using Jaccard Index. Length-independent, primary metric.
BBoundary Similarity. Edit-distance-based penalty for boundary errors.
SSegmentation Similarity. Structural overlap between predicted and ground-truth segments.
1 − PkComplement of Pk (Beeferman). Measures probability of incorrect boundary classification.
1 − WDComplement of WindowDiff. Similar to Pk but stricter on near-miss errors.
miou / wiouMean / Weighted IoU between predicted and ground-truth paragraph segments.

Key Findings

  • A = 60.58 surpasses paper (59.71) despite using a different language (Vietnamese vs Chinese) and backbone (BamiBERT vs PoNet).
  • B = 45.74 still lags behind paper (48.47) by ~2.7 pp — boundary precision remains the main weakness.
  • S = 98.40 indicates near-perfect structural segmentation at the paragraph level.
  • Smooth L1 loss (vs standard L1) and tail processing (t_stop=31, t_min=23) drove significant improvements.

Hyperparameters (matching the paper)

ParamValue
BackboneQualcomm-AI-Research/BamiBERT
OptimizerAdamW
Learning rate5e-5
Batch size2
Epochs3
Window size100
Tail: t_stop31
Tail: t_min23
λ_SL1 (Smooth L1)10.0
λ_IoU0.5
λ_Dice0.5
Focal: α / γ0.75 / 2
Max length2048

File Structure

1dod_vi/              # Vietnamese 1DOD (BamiBERT)
├── train_vi.py
├── models_vi.py
├── verify_vi.py
├── translate_vi.py
├── 1d_iou.py
├── similarityMetrics.py
└── helpers.py

1dod_cn/              # Original Chinese 1DOD (PoNet)
├── train.py
├── models.py
├── 1d_iou.py
├── similarityMetrics.py
├── helpers.py
└── generate_report.py

Training (Vietnamese)

cd 1dod_vi
python train_vi.py --mode train \
  --model_dir Qualcomm-AI-Research/BamiBERT \
  --data_dir ./Alimeeting4MUG \
  --lr 5e-5 --batch_size 2 --window_size 100 --epochs 3

Evaluation

python train_vi.py --mode test \
  --load_dir ./model_save_vi/{best_checkpoint} \
  --data_dir ./Alimeeting4MUG --window_size 100

quangkmhd/AIP491_G5_SU26_1DOD

Python

0

4 commits

updated Jul 8, 2026

See the code

README

1DOD — One-Dimensional Object Detection for Streaming Text Segmentation

Vietnamese adaptation of 1DOD for meeting dialogue text segmentation.

Model: Qualcomm-AI-Research/BamiBERT — a RoBERTa-based Vietnamese language model with 2048-token context window. Trained on Vietnamese translated AMC (AliMeeting4MUG) data.

Finetuned checkpoint: bamibert-1dod-vi-v1/ (A=60.58, B=45.74)

Results on Vietnamese AMC (AliMeeting4MUG)

MetricPaper (PoNet, Chinese)Ours (BamiBERT, Vietnamese)
A ↑ (Alignment Index)59.7160.58
B ↑ (Boundary Similarity)48.4745.74
S ↑ (Segmentation Similarity)—98.40
1 − Pk ↑62.1557.28
1 − WD ↑61.1857.17
miou—63.51
wiou—64.27

Metric Definitions (from the paper)

MetricDescription
AAlignment Index. Based on paragraph matching using Jaccard Index. Length-independent, primary metric.
BBoundary Similarity. Edit-distance-based penalty for boundary errors.
SSegmentation Similarity. Structural overlap between predicted and ground-truth segments.
1 − PkComplement of Pk (Beeferman). Measures probability of incorrect boundary classification.
1 − WDComplement of WindowDiff. Similar to Pk but stricter on near-miss errors.
miou / wiouMean / Weighted IoU between predicted and ground-truth paragraph segments.

Key Findings

  • A = 60.58 surpasses paper (59.71) despite using a different language (Vietnamese vs Chinese) and backbone (BamiBERT vs PoNet).
  • B = 45.74 still lags behind paper (48.47) by ~2.7 pp — boundary precision remains the main weakness.
  • S = 98.40 indicates near-perfect structural segmentation at the paragraph level.
  • Smooth L1 loss (vs standard L1) and tail processing (t_stop=31, t_min=23) drove significant improvements.

Hyperparameters (matching the paper)

ParamValue
BackboneQualcomm-AI-Research/BamiBERT
OptimizerAdamW
Learning rate5e-5
Batch size2
Epochs3
Window size100
Tail: t_stop31
Tail: t_min23
λ_SL1 (Smooth L1)10.0
λ_IoU0.5
λ_Dice0.5
Focal: α / γ0.75 / 2
Max length2048

File Structure

1dod_vi/              # Vietnamese 1DOD (BamiBERT)
├── train_vi.py
├── models_vi.py
├── verify_vi.py
├── translate_vi.py
├── 1d_iou.py
├── similarityMetrics.py
└── helpers.py

1dod_cn/              # Original Chinese 1DOD (PoNet)
├── train.py
├── models.py
├── 1d_iou.py
├── similarityMetrics.py
├── helpers.py
└── generate_report.py

Training (Vietnamese)

cd 1dod_vi
python train_vi.py --mode train \
  --model_dir Qualcomm-AI-Research/BamiBERT \
  --data_dir ./Alimeeting4MUG \
  --lr 5e-5 --batch_size 2 --window_size 100 --epochs 3

Evaluation

python train_vi.py --mode test \
  --load_dir ./model_save_vi/{best_checkpoint} \
  --data_dir ./Alimeeting4MUG --window_size 100