dronefreak/exdark-rfdetr-small

Model

RF-DETR Small Finetuned on ExDark

0

5 commits

2 linked in READMEs

updated Oct 1, 2026

See the code

README

RF-DETR Small Finetuned on ExDark

Fine-tuned RF-DETR Small object detector on the ExDark benchmark dataset, trained and evaluated as part of DetectionBench -- a framework for reproducibly benchmarking modern object detectors with identical training recipes and evaluation metrics across multiple real-world datasets.

ExDark Detection Demo


Task Framework Base Model
mAP@50 mAP@50:95 Params
License Source

Usage

Install Dependencies

pip install rfdetr huggingface_hub

Load Model from Hugging Face

from huggingface_hub import hf_hub_download
import rfdetr

weights = hf_hub_download(
    repo_id="dronefreak/exdark-rfdetr-small",
    filename="checkpoint_best_total.pth"
)

model = rfdetr.RFDETRSmall(pretrain_weights=weights)

Run Inference

detections = model.predict("image.jpg", threshold=0.25)

Performance

Evaluated on the ExDark test split, using DetectionBench's standard evaluation pipeline (detectionbench-evaluate).

MetricScore (%)
mAP@5088.98
mAP@50-9561.67
Precision83.07
Recall81.89
F1 Score82.47
Parameters32.1M
FLOPsN/A (not published upstream)

ExDark Model Zoo

Every model DetectionBench has trained and evaluated on ExDark so far, for full transparency -- see DetectionBench for the smaller, curated comparison set used on the project README.

ModelmAP@50mAP@50-95PrecisionRecall
RF-DETR Small88.9861.6783.0781.89
RF-DETR Medium88.6462.5586.679.46
RF-DETR Nano85.2758.0185.1874.67
YOLO26l77.5150.8880.7170.72
YOLO26m76.5450.0282.2968.83
YOLOv8x75.448.3981.5365.86
YOLOv8l75.2648.4881.4467.58
YOLOv8m74.6948.0578.469.17
YOLO11x74.4148.9881.8767.05
YOLOv9m74.1747.3876.2767.94
YOLO26s74.048.3279.1165.59
YOLO11l73.4447.5678.5767.09
YOLO11s73.3546.877.9366.38
YOLO11m73.1747.1674.8367.23
YOLOv8s73.0145.8578.2665.13
YOLO26n72.746.2781.062.67
YOLOv8n71.2944.7878.2562.76
YOLO11n70.3644.7276.1861.15

Per-Class Performance

ClassmAP@50mAP@50-95
Bicycle86.9359.86
Boat90.8553.93
Bottle83.8955.29
Bus92.7373.55
Car91.0663.48
Cat93.367.46
Chair84.558.98
Cup87.6759.94
Dog92.9669.4
Motorbike92.0765.0
People88.9355.46
Table82.9157.74

This model was evaluated with Supervision's detection metrics, which report mAP/Precision/Recall directly but don't produce a confusion-matrix plot the way Ultralytics' validator does.


Dataset

This model was trained on ExDark. For the full dataset description, provenance, license, and citation, see the dataset card:

https://huggingface.co/datasets/dronefreak/ExDark

Classes

  • Bicycle
  • Boat
  • Bottle
  • Bus
  • Car
  • Cat
  • Chair
  • Cup
  • Dog
  • Motorbike
  • People
  • Table

Training Configuration

SettingValue
DatasetExDark
FrameworkRF-DETR
Training ToolkitDetectionBench
Epochs (configured max)500
Epochs (actually trained)104
Early Stopping Patience100
Batch Size11
Resolution512
Optimizeradamw
Learning Rate0.0001
Seed42

Repository Contents

checkpoint_best_total.pth
metrics.csv
config.json
exdark_rfdetr-small_showcase.jpg
README.md


Training Framework

This model was trained using DetectionBench, an open-source framework for benchmarking object detectors across multiple real-world datasets with a common pipeline.

Features include:

  • A dataset-adapter registry for converting real-world datasets into a canonical format
  • Identical training/evaluation recipes across model families (Ultralytics YOLO/RT-DETR, RF-DETR)
  • Hardware profiling (latency, FPS, VRAM, parameters, FLOPs)
  • One-command reproducibility via versioned Hydra configs

If you find this model useful, please consider starring the repository.


Known Limitations

  • Severe class imbalance: People accounts for roughly 46% of all annotated boxes while Bus is the rarest class, so per-class accuracy on rare classes is measured on very few test examples and should be read with wide uncertainty.
  • Small dataset overall (7,344 images, 734 in the test split, across 12 classes) -- limited training signal for several classes independent of the imbalance above.
  • Two-hop provenance: this dataset was converted to YOLO format by a third-party Roboflow export before reaching DetectionBench, not sourced directly from the original per-class-folder release; images are pre-resized to 640x640 by that export.
  • The original authors separately request non-commercial use of this dataset (beyond the BSD-3-Clause license text itself) -- this applies to any model trained on it, not only the raw images.

Citation

If you use this model in your research, please consider citing the dataset and the model architecture:

@article{Exdark,
  title = {Getting to Know Low-light Images with The Exclusively Dark Dataset},
  author = {Loh, Yuen Peng and Chan, Chee Seng},
  journal = {Computer Vision and Image Understanding},
  volume = {178},
  pages = {30-42},
  year = {2019},
  doi = {https://doi.org/10.1016/j.cviu.2018.10.010}
}
@inproceedings{robinson2026rfdetr,
  title     = {RF-DETR: Real-Time Detection Transformer},
  author    = {Robinson, Isaac and Robicheaux, Peter and Popov, Matvei and Ramanan, Deva and Peri, Neehar},
  booktitle = {International Conference on Learning Representations (ICLR)},
  year      = {2026},
  url       = {https://arxiv.org/abs/2511.09554}
}

@article{oquab2023dinov2,
  title={DINOv2: Learning Robust Visual Features without Supervision},
  author={Oquab, Maxime and Darcet, Timoth{\'e}e and Moutakanni, Theo and Vo, Huy and Szafraniec, Marc and Khalidov, Vasil and Fernandez, Pierre and Haziza, Daniel and Massa, Francisco and El-Nouby, Alaaeldin and others},
  journal={arXiv preprint arXiv:2304.07193},
  year={2023}
}
computer-vision
dark-images
detectionbench
low-light
model-index
night-images
object-detection
pytorch
rfdetr
robustness

dronefreak/exdark-rfdetr-small

Model

RF-DETR Small Finetuned on ExDark

0

5 commits

2 linked in READMEs

updated Oct 1, 2026

See the code

README

RF-DETR Small Finetuned on ExDark

Fine-tuned RF-DETR Small object detector on the ExDark benchmark dataset, trained and evaluated as part of DetectionBench -- a framework for reproducibly benchmarking modern object detectors with identical training recipes and evaluation metrics across multiple real-world datasets.

ExDark Detection Demo


Task Framework Base Model
mAP@50 mAP@50:95 Params
License Source

Usage

Install Dependencies

pip install rfdetr huggingface_hub

Load Model from Hugging Face

from huggingface_hub import hf_hub_download
import rfdetr

weights = hf_hub_download(
    repo_id="dronefreak/exdark-rfdetr-small",
    filename="checkpoint_best_total.pth"
)

model = rfdetr.RFDETRSmall(pretrain_weights=weights)

Run Inference

detections = model.predict("image.jpg", threshold=0.25)

Performance

Evaluated on the ExDark test split, using DetectionBench's standard evaluation pipeline (detectionbench-evaluate).

MetricScore (%)
mAP@5088.98
mAP@50-9561.67
Precision83.07
Recall81.89
F1 Score82.47
Parameters32.1M
FLOPsN/A (not published upstream)

ExDark Model Zoo

Every model DetectionBench has trained and evaluated on ExDark so far, for full transparency -- see DetectionBench for the smaller, curated comparison set used on the project README.

ModelmAP@50mAP@50-95PrecisionRecall
RF-DETR Small88.9861.6783.0781.89
RF-DETR Medium88.6462.5586.679.46
RF-DETR Nano85.2758.0185.1874.67
YOLO26l77.5150.8880.7170.72
YOLO26m76.5450.0282.2968.83
YOLOv8x75.448.3981.5365.86
YOLOv8l75.2648.4881.4467.58
YOLOv8m74.6948.0578.469.17
YOLO11x74.4148.9881.8767.05
YOLOv9m74.1747.3876.2767.94
YOLO26s74.048.3279.1165.59
YOLO11l73.4447.5678.5767.09
YOLO11s73.3546.877.9366.38
YOLO11m73.1747.1674.8367.23
YOLOv8s73.0145.8578.2665.13
YOLO26n72.746.2781.062.67
YOLOv8n71.2944.7878.2562.76
YOLO11n70.3644.7276.1861.15

Per-Class Performance

ClassmAP@50mAP@50-95
Bicycle86.9359.86
Boat90.8553.93
Bottle83.8955.29
Bus92.7373.55
Car91.0663.48
Cat93.367.46
Chair84.558.98
Cup87.6759.94
Dog92.9669.4
Motorbike92.0765.0
People88.9355.46
Table82.9157.74

This model was evaluated with Supervision's detection metrics, which report mAP/Precision/Recall directly but don't produce a confusion-matrix plot the way Ultralytics' validator does.


Dataset

This model was trained on ExDark. For the full dataset description, provenance, license, and citation, see the dataset card:

https://huggingface.co/datasets/dronefreak/ExDark

Classes

  • Bicycle
  • Boat
  • Bottle
  • Bus
  • Car
  • Cat
  • Chair
  • Cup
  • Dog
  • Motorbike
  • People
  • Table

Training Configuration

SettingValue
DatasetExDark
FrameworkRF-DETR
Training ToolkitDetectionBench
Epochs (configured max)500
Epochs (actually trained)104
Early Stopping Patience100
Batch Size11
Resolution512
Optimizeradamw
Learning Rate0.0001
Seed42

Repository Contents

checkpoint_best_total.pth
metrics.csv
config.json
exdark_rfdetr-small_showcase.jpg
README.md


Training Framework

This model was trained using DetectionBench, an open-source framework for benchmarking object detectors across multiple real-world datasets with a common pipeline.

Features include:

  • A dataset-adapter registry for converting real-world datasets into a canonical format
  • Identical training/evaluation recipes across model families (Ultralytics YOLO/RT-DETR, RF-DETR)
  • Hardware profiling (latency, FPS, VRAM, parameters, FLOPs)
  • One-command reproducibility via versioned Hydra configs

If you find this model useful, please consider starring the repository.


Known Limitations

  • Severe class imbalance: People accounts for roughly 46% of all annotated boxes while Bus is the rarest class, so per-class accuracy on rare classes is measured on very few test examples and should be read with wide uncertainty.
  • Small dataset overall (7,344 images, 734 in the test split, across 12 classes) -- limited training signal for several classes independent of the imbalance above.
  • Two-hop provenance: this dataset was converted to YOLO format by a third-party Roboflow export before reaching DetectionBench, not sourced directly from the original per-class-folder release; images are pre-resized to 640x640 by that export.
  • The original authors separately request non-commercial use of this dataset (beyond the BSD-3-Clause license text itself) -- this applies to any model trained on it, not only the raw images.

Citation

If you use this model in your research, please consider citing the dataset and the model architecture:

@article{Exdark,
  title = {Getting to Know Low-light Images with The Exclusively Dark Dataset},
  author = {Loh, Yuen Peng and Chan, Chee Seng},
  journal = {Computer Vision and Image Understanding},
  volume = {178},
  pages = {30-42},
  year = {2019},
  doi = {https://doi.org/10.1016/j.cviu.2018.10.010}
}
@inproceedings{robinson2026rfdetr,
  title     = {RF-DETR: Real-Time Detection Transformer},
  author    = {Robinson, Isaac and Robicheaux, Peter and Popov, Matvei and Ramanan, Deva and Peri, Neehar},
  booktitle = {International Conference on Learning Representations (ICLR)},
  year      = {2026},
  url       = {https://arxiv.org/abs/2511.09554}
}

@article{oquab2023dinov2,
  title={DINOv2: Learning Robust Visual Features without Supervision},
  author={Oquab, Maxime and Darcet, Timoth{\'e}e and Moutakanni, Theo and Vo, Huy and Szafraniec, Marc and Khalidov, Vasil and Fernandez, Pierre and Haziza, Daniel and Massa, Francisco and El-Nouby, Alaaeldin and others},
  journal={arXiv preprint arXiv:2304.07193},
  year={2023}
}
computer-vision
dark-images
detectionbench
low-light
model-index
night-images
object-detection
pytorch
rfdetr
robustness