Vietnamese adaptation of 1DOD for meeting dialogue text segmentation.
Model: Qualcomm-AI-Research/BamiBERT — a RoBERTa-based Vietnamese language model with 2048-token context window. Trained on Vietnamese translated AMC (AliMeeting4MUG) data.
Finetuned checkpoint: bamibert-1dod-vi-v1/ (A=60.58, B=45.74)
| Metric | Paper (PoNet, Chinese) | Ours (BamiBERT, Vietnamese) |
|---|---|---|
| A ↑ (Alignment Index) | 59.71 | 60.58 |
| B ↑ (Boundary Similarity) | 48.47 | 45.74 |
| S ↑ (Segmentation Similarity) | — | 98.40 |
| 1 − Pk ↑ | 62.15 | 57.28 |
| 1 − WD ↑ | 61.18 | 57.17 |
| miou | — | 63.51 |
| wiou | — | 64.27 |
| Metric | Description |
|---|---|
| A | Alignment Index. Based on paragraph matching using Jaccard Index. Length-independent, primary metric. |
| B | Boundary Similarity. Edit-distance-based penalty for boundary errors. |
| S | Segmentation Similarity. Structural overlap between predicted and ground-truth segments. |
| 1 − Pk | Complement of Pk (Beeferman). Measures probability of incorrect boundary classification. |
| 1 − WD | Complement of WindowDiff. Similar to Pk but stricter on near-miss errors. |
| miou / wiou | Mean / Weighted IoU between predicted and ground-truth paragraph segments. |
t_stop=31, t_min=23) drove significant improvements.| Param | Value |
|---|---|
| Backbone | Qualcomm-AI-Research/BamiBERT |
| Optimizer | AdamW |
| Learning rate | 5e-5 |
| Batch size | 2 |
| Epochs | 3 |
| Window size | 100 |
| Tail: t_stop | 31 |
| Tail: t_min | 23 |
| λ_SL1 (Smooth L1) | 10.0 |
| λ_IoU | 0.5 |
| λ_Dice | 0.5 |
| Focal: α / γ | 0.75 / 2 |
| Max length | 2048 |
1dod_vi/ # Vietnamese 1DOD (BamiBERT)
├── train_vi.py
├── models_vi.py
├── verify_vi.py
├── translate_vi.py
├── 1d_iou.py
├── similarityMetrics.py
└── helpers.py
1dod_cn/ # Original Chinese 1DOD (PoNet)
├── train.py
├── models.py
├── 1d_iou.py
├── similarityMetrics.py
├── helpers.py
└── generate_report.py
cd 1dod_vi
python train_vi.py --mode train \
--model_dir Qualcomm-AI-Research/BamiBERT \
--data_dir ./Alimeeting4MUG \
--lr 5e-5 --batch_size 2 --window_size 100 --epochs 3
python train_vi.py --mode test \
--load_dir ./model_save_vi/{best_checkpoint} \
--data_dir ./Alimeeting4MUG --window_size 100
Vietnamese adaptation of 1DOD for meeting dialogue text segmentation.
Model: Qualcomm-AI-Research/BamiBERT — a RoBERTa-based Vietnamese language model with 2048-token context window. Trained on Vietnamese translated AMC (AliMeeting4MUG) data.
Finetuned checkpoint: bamibert-1dod-vi-v1/ (A=60.58, B=45.74)
| Metric | Paper (PoNet, Chinese) | Ours (BamiBERT, Vietnamese) |
|---|---|---|
| A ↑ (Alignment Index) | 59.71 | 60.58 |
| B ↑ (Boundary Similarity) | 48.47 | 45.74 |
| S ↑ (Segmentation Similarity) | — | 98.40 |
| 1 − Pk ↑ | 62.15 | 57.28 |
| 1 − WD ↑ | 61.18 | 57.17 |
| miou | — | 63.51 |
| wiou | — | 64.27 |
| Metric | Description |
|---|---|
| A | Alignment Index. Based on paragraph matching using Jaccard Index. Length-independent, primary metric. |
| B | Boundary Similarity. Edit-distance-based penalty for boundary errors. |
| S | Segmentation Similarity. Structural overlap between predicted and ground-truth segments. |
| 1 − Pk | Complement of Pk (Beeferman). Measures probability of incorrect boundary classification. |
| 1 − WD | Complement of WindowDiff. Similar to Pk but stricter on near-miss errors. |
| miou / wiou | Mean / Weighted IoU between predicted and ground-truth paragraph segments. |
t_stop=31, t_min=23) drove significant improvements.| Param | Value |
|---|---|
| Backbone | Qualcomm-AI-Research/BamiBERT |
| Optimizer | AdamW |
| Learning rate | 5e-5 |
| Batch size | 2 |
| Epochs | 3 |
| Window size | 100 |
| Tail: t_stop | 31 |
| Tail: t_min | 23 |
| λ_SL1 (Smooth L1) | 10.0 |
| λ_IoU | 0.5 |
| λ_Dice | 0.5 |
| Focal: α / γ | 0.75 / 2 |
| Max length | 2048 |
1dod_vi/ # Vietnamese 1DOD (BamiBERT)
├── train_vi.py
├── models_vi.py
├── verify_vi.py
├── translate_vi.py
├── 1d_iou.py
├── similarityMetrics.py
└── helpers.py
1dod_cn/ # Original Chinese 1DOD (PoNet)
├── train.py
├── models.py
├── 1d_iou.py
├── similarityMetrics.py
├── helpers.py
└── generate_report.py
cd 1dod_vi
python train_vi.py --mode train \
--model_dir Qualcomm-AI-Research/BamiBERT \
--data_dir ./Alimeeting4MUG \
--lr 5e-5 --batch_size 2 --window_size 100 --epochs 3
python train_vi.py --mode test \
--load_dir ./model_save_vi/{best_checkpoint} \
--data_dir ./Alimeeting4MUG --window_size 100