apple/coreml-depth-anything-small

Model

39

stars

19

commits

3

linked in READMEs

Jun 13, 2024

updated

coreml
depth-estimation

README

Depth Anything Core ML Models

Depth Anything model was introduced in the paper Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data by Lihe Yang et al. and first released in this repository.

Model description

Depth Anything leverages the DPT architecture with a DINOv2 backbone.

The model is trained on ~62 million images, obtaining state-of-the-art results for both relative and absolute depth estimation.

drawing

Depth Anything overview. Taken from the original paper.

Evaluation - Variants

VariantParametersSize (MB)Weight precisionAct. precisionabs-rel errorabs-rel reference
small-original (PyTorch)24.8M99.2Float32Float32
DepthAnythingSmallF3224.8M99.0Float32Float320.0073small-original
DepthAnythingSmallF1624.8M45.8Float16Float160.0077small-original

Evaluation - Inference time

The following results use the small-float16 variant.

DeviceOSInference time (ms)Dominant compute unit
iPhone 12 Pro Max18.031.10Neural Engine
iPhone 15 Pro Max17.433.90Neural Engine
MacBook Pro (M1 Max)15.032.80Neural Engine
MacBook Pro (M3 Max)15.024.58Neural Engine

Download

Install huggingface-cli

brew install huggingface-cli

To download one of the .mlpackage folders to the models directory:

huggingface-cli download \
  --local-dir models --local-dir-use-symlinks False \
  apple/coreml-depth-anything-small \
  --include "DepthAnythingSmallF16.mlpackage/*"

To download everything, skip the --include argument.

Integrate in Swift apps

The huggingface/coreml-examples repository contains sample Swift code for coreml-depth-anything-small and other models. See the instructions there to build the demo app, which shows how to use the model in your own Swift apps.

Contributors

pcuenq

16 commits

reach-vb

3 commits

apple/coreml-depth-anything-small

Model

39

stars

19

commits

3

linked in READMEs

Jun 13, 2024

updated

coreml
depth-estimation

README

Depth Anything Core ML Models

Depth Anything model was introduced in the paper Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data by Lihe Yang et al. and first released in this repository.

Model description

Depth Anything leverages the DPT architecture with a DINOv2 backbone.

The model is trained on ~62 million images, obtaining state-of-the-art results for both relative and absolute depth estimation.

drawing

Depth Anything overview. Taken from the original paper.

Evaluation - Variants

VariantParametersSize (MB)Weight precisionAct. precisionabs-rel errorabs-rel reference
small-original (PyTorch)24.8M99.2Float32Float32
DepthAnythingSmallF3224.8M99.0Float32Float320.0073small-original
DepthAnythingSmallF1624.8M45.8Float16Float160.0077small-original

Evaluation - Inference time

The following results use the small-float16 variant.

DeviceOSInference time (ms)Dominant compute unit
iPhone 12 Pro Max18.031.10Neural Engine
iPhone 15 Pro Max17.433.90Neural Engine
MacBook Pro (M1 Max)15.032.80Neural Engine
MacBook Pro (M3 Max)15.024.58Neural Engine

Download

Install huggingface-cli

brew install huggingface-cli

To download one of the .mlpackage folders to the models directory:

huggingface-cli download \
  --local-dir models --local-dir-use-symlinks False \
  apple/coreml-depth-anything-small \
  --include "DepthAnythingSmallF16.mlpackage/*"

To download everything, skip the --include argument.

Integrate in Swift apps

The huggingface/coreml-examples repository contains sample Swift code for coreml-depth-anything-small and other models. See the instructions there to build the demo app, which shows how to use the model in your own Swift apps.

Contributors

pcuenq

16 commits

reach-vb

3 commits