Shadowgraph
About
Sign in

chuhac/BiomedCLIP-vit-bert-hf

Model

8

stars

5

commits

6

repos using this model

2

linked in READMEs

May 31, 2024

updated

clip
custom_code
feature-extraction
pytorch
safetensors
transformers
zero-shot-classification

README

Huggingface-friendly BiomedCLIP

  1. pure torch and huggingface-based implementation of the original microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224
  2. rename the checkpoint state key names.

Usage

from transformers import AutoModel, AutoProcessor

model = AutoModel.from_pretrained("chuhac/BiomedCLIP-vit-bert-hf", trust_remote_code=True)
processor = AutoProcessor.from_pretrained("chuhac/BiomedCLIP-vit-bert-hf", trust_remote_code=True)

Contributors

chuhac

4 commits

SFconvertbot

1 commits

Similar repos

redlessone/DermLIP_ViT-B-16

Model

9

shared topics

redlessone/DermLIP_PanDerm-base-w-PubMed-256

Model

13

shared topics

microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224

Model

425

microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext

Model

335

microsoft/BiomedVLP-BioViL-T

Model

51

TahaKoleilat/BiomedCoOp

Model

1

GoodBaiBai88/M3D-CLIP

Model

16

microsoft/BiomedVLP-CXR-BERT-specialized

Model

39

Used in code

vutl/MedCLIP-SAMv2

0

3 files

HealthX-Lab/MedCLIP-SAMv2

[MedIA 2025] Official implementation of MedCLIP-SAMv2

179

2 files

xiexing0916/ARRA

(AAAI 2026 Oral) Unleashing the Potential of Large Language Models for Text-to-Image Generation…

12

2 files

mazurowski-lab/Foundation-based-reg

This is an official repo for the paper of "Are Vision Foundation Models Ready for Out-of-the-Box…

37

1 file

isjinghao/OralAgent

19

1 file

MSIIP/Med-2E3

[BIBM2025] Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model

9

1 file

Linked in READMEs

xiexing0916/ARRA

(AAAI 2026 Oral) Unleashing the Potential of Large Language Models for Text-to-Image Generation…

12

README badge

HKU-HealthAI/ARRA

Code for AAAI 2026 Oral Paper | Unleashing the Potential of Large Language Models for Text-to-Image…

7

README badge

chuhac/BiomedCLIP-vit-bert-hf

Model

8

stars

5

commits

6

repos using this model

2

linked in READMEs

May 31, 2024

updated

clip
custom_code
feature-extraction
pytorch
safetensors
transformers
zero-shot-classification

README

Huggingface-friendly BiomedCLIP

  1. pure torch and huggingface-based implementation of the original microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224
  2. rename the checkpoint state key names.

Usage

from transformers import AutoModel, AutoProcessor

model = AutoModel.from_pretrained("chuhac/BiomedCLIP-vit-bert-hf", trust_remote_code=True)
processor = AutoProcessor.from_pretrained("chuhac/BiomedCLIP-vit-bert-hf", trust_remote_code=True)

Similar repos

redlessone/DermLIP_ViT-B-16

Model

9

shared topics

redlessone/DermLIP_PanDerm-base-w-PubMed-256

Model

13

shared topics

microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224

Model

425

microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext

Model

335

microsoft/BiomedVLP-BioViL-T

Model

51

TahaKoleilat/BiomedCoOp

Model

1

GoodBaiBai88/M3D-CLIP

Model

16

microsoft/BiomedVLP-CXR-BERT-specialized

Model

39

Used in code

vutl/MedCLIP-SAMv2

0

3 files

HealthX-Lab/MedCLIP-SAMv2

[MedIA 2025] Official implementation of MedCLIP-SAMv2

179

2 files

xiexing0916/ARRA

(AAAI 2026 Oral) Unleashing the Potential of Large Language Models for Text-to-Image Generation…

12

2 files

mazurowski-lab/Foundation-based-reg

This is an official repo for the paper of "Are Vision Foundation Models Ready for Out-of-the-Box…

37

1 file

isjinghao/OralAgent

19

1 file

MSIIP/Med-2E3

[BIBM2025] Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model

9

1 file

Linked in READMEs

xiexing0916/ARRA

(AAAI 2026 Oral) Unleashing the Potential of Large Language Models for Text-to-Image Generation…

12

README badge

HKU-HealthAI/ARRA

Code for AAAI 2026 Oral Paper | Unleashing the Potential of Large Language Models for Text-to-Image…

7

README badge

Contributors

chuhac

4 commits

SFconvertbot

1 commits