Qdrant/bge-base-en-v1.5-onnx-Q

Model

Quantized ONNX port of BAAI/bge-base-en-v1.5 for text classification and similarity searches.

1

12 commits

2 linked in READMEs

updated Sep 12, 2024

See the code
bert
endpoints_compatible
feature-extraction
onnx
sentence-similarity
text-embeddings-inference
transformers

README

Quantized ONNX port of BAAI/bge-base-en-v1.5 for text classification and similarity searches.

Usage

Here's an example of performing inference using the model with FastEmbed.

from fastembed import TextEmbedding

documents = [
    "You should stay, study and sprint.",
    "History can only prepare us to be surprised yet again.",
]

model = TextEmbedding(model_name="BAAI/bge-base-en-v1.5")
embeddings = list(model.embed(documents))

# [
#     array([
#         0.00611658, 0.00068912, -0.0203846, ..., -0.01751488, -0.01174267,
#         0.01463472
#     ],
#           dtype=float32),
#     array([
#         0.00173448, -0.00329958, 0.01557874, ..., -0.01473586, 0.0281806,
#         -0.00448205
#     ],
#           dtype=float32)
# ]

Contributors

nirantk

9 commits

Anush008

1 commits

cfahlgren1

1 commits

generall93

1 commits

Qdrant/bge-base-en-v1.5-onnx-Q

Model

Quantized ONNX port of BAAI/bge-base-en-v1.5 for text classification and similarity searches.

1

12 commits

2 linked in READMEs

updated Sep 12, 2024

See the code
bert
endpoints_compatible
feature-extraction
onnx
sentence-similarity
text-embeddings-inference
transformers

README

Quantized ONNX port of BAAI/bge-base-en-v1.5 for text classification and similarity searches.

Usage

Here's an example of performing inference using the model with FastEmbed.

from fastembed import TextEmbedding

documents = [
    "You should stay, study and sprint.",
    "History can only prepare us to be surprised yet again.",
]

model = TextEmbedding(model_name="BAAI/bge-base-en-v1.5")
embeddings = list(model.embed(documents))

# [
#     array([
#         0.00611658, 0.00068912, -0.0203846, ..., -0.01751488, -0.01174267,
#         0.01463472
#     ],
#           dtype=float32),
#     array([
#         0.00173448, -0.00329958, 0.01557874, ..., -0.01473586, 0.0281806,
#         -0.00448205
#     ],
#           dtype=float32)
# ]

Contributors

nirantk

9 commits

Anush008

1 commits

cfahlgren1

1 commits

generall93

1 commits