mistralai/Mistral-7B-v0.1

Model

4,154

stars

37

commits

36

repos using this model

18

linked in READMEs

Jul 24, 2025

updated

eval-results

mistral

mistral-common

pretrained

pytorch

safetensors

text-generation

text-generation-inference

transformers

README

Model Card for Mistral-7B-v0.1

The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters. Mistral-7B-v0.1 outperforms Llama 2 13B on all benchmarks we tested.

For full details of this model please read our paper and release blog post.

Model Architecture

Mistral-7B-v0.1 is a transformer model, with the following architecture choices:

Grouped-Query Attention
Sliding-Window Attention
Byte-fallback BPE tokenizer

Troubleshooting

If you see the following error:

KeyError: 'mistral'

Or:

NotImplementedError: Cannot copy out of meta tensor; no data!

Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.

Notice

Mistral 7B is a pretrained base model and therefore does not have any moderation mechanisms.

The Mistral AI Team

Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.

Contributors

10 commits

4 commits

4 commits

3 commits

Similar repos

mistral-community/Mistral-7B-v0.2

228

mistralai/Mistral-7B-Instruct-v0.1

1,850

mistralai/Mistral-7B-Instruct-v0.2

3,207

TheBloke/Mistral-7B-v0.1-GGUF

279

scb10x/typhoon-7b

108

mistralai/Mistral-Nemo-Base-2407

352

mistralai/Mistral-Nemo-Instruct-2407

1,700

mistralai/Mistral-Large-Instruct-2407

865

Used in code

PrimeIntellect-ai/prime-diloco

prime is a framework for efficient, globally distributed training of AI models over the internet.

855

ezelikman/quiet-star

Code for Quiet-STaR

739

ngruver/llmtime

833

PrimeIntellect-ai/OpenDiloco

OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

591

jondurbin/bagel

A bagel, with everything.

326

em-llm/EM-LLM-model

285

QuixiAI/laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'

240

basetenlabs/truss-examples

Examples of models deployable with Truss

230

JD-P/minihf

MiniHF is an inference, human preference data collection, and fine-tuning tool for local language…

183

genlm/llamppl

Probabilistic programming with large language models

178

meetrais/LLM-Fine-Tuning

162

jjziets/vasttools

My swiftsknife for vast.ai service

160

architsharma97/dpo-rlaif

100

Mamba413/AdaDetectGPT

[NeurIPS 2025] AdaDetectGPT: Adaptive Detection of LLM-Generated Text with Statistical Guarantees

69

skywalker023/fantom

👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine…

63

yixiaoer/mistral-v0.2-jax

JAX implementation of the Mistral 7b v0.2 model

35

finos-labs/Open-Financial-LLMs-Leaderboard

35

ahb-sjsu/turboquant-pro

Consumer-aware compression for embedding indexes and LLM KV caches — compress by the metric the…

25

cong-zeng/DALD

11

gauravbatule/AirCELA

3

Linked in READMEs

hpcaitech/Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

29,772

oumi-ai/oumi

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

9,383

jquesnelle/yarn

YaRN: Efficient Context Window Extension of Large Language Models

1,787

NVIDIA-NeMo/Automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

927

AtomicBot-ai/atomic-llama-cpp-turboquant

llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6…

394

databricks/databricks-ml-examples

369

ictnlp/TruthX

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in…

145

jphme/EM_German

Repository for the EM German Model

112

daniel-furman/sft-demos

🤖 language modeling sft demos

79

akjindal53244/Arithmo-Mistral-7B

Small and Efficient Mathematical Reasoning LLMs

73

akjindal53244/Arithmo

Small and Efficient Mathematical Reasoning LLMs

73

HimariO/llama.cpp.qwen2.5vl

Port of Facebook's LLaMA model in C/C++

66

AMAAI-Lab/SonicVerse

SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning

54

EvilFreelancer/saiga-custom

Bunch of notebooks for pre-training custom Saiga-like LLM

12

mzhaoshuai/RefAlign

RL with Similarity-based Rewards for Versatile Language Model Alignment.

8

poolsideai/llama.cpp

LLM inference in C/C++

6

alainnothere/llama.cpp

LLM inference in C/C++

1

wendadawen/llama.cpp

LLM inference in C/C++

0

mistralai/Mistral-7B-v0.1

Model

4,154

stars

37

commits

36

repos using this model

18

linked in READMEs

Jul 24, 2025

updated

eval-results

mistral

mistral-common

pretrained

pytorch

safetensors

text-generation

text-generation-inference

transformers

README

Model Card for Mistral-7B-v0.1

The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters. Mistral-7B-v0.1 outperforms Llama 2 13B on all benchmarks we tested.

For full details of this model please read our paper and release blog post.

Model Architecture

Mistral-7B-v0.1 is a transformer model, with the following architecture choices:

Grouped-Query Attention
Sliding-Window Attention
Byte-fallback BPE tokenizer

Troubleshooting

If you see the following error:

KeyError: 'mistral'

Or:

NotImplementedError: Cannot copy out of meta tensor; no data!

Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.

Notice

Mistral 7B is a pretrained base model and therefore does not have any moderation mechanisms.

The Mistral AI Team

Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.

Similar repos

mistral-community/Mistral-7B-v0.2

228

mistralai/Mistral-7B-Instruct-v0.1

1,850

mistralai/Mistral-7B-Instruct-v0.2

3,207

TheBloke/Mistral-7B-v0.1-GGUF

279

scb10x/typhoon-7b

108

mistralai/Mistral-Nemo-Base-2407

352

mistralai/Mistral-Nemo-Instruct-2407

1,700

mistralai/Mistral-Large-Instruct-2407

865

Used in code

PrimeIntellect-ai/prime-diloco

prime is a framework for efficient, globally distributed training of AI models over the internet.

855

ezelikman/quiet-star

Code for Quiet-STaR

739

ngruver/llmtime

833

PrimeIntellect-ai/OpenDiloco

OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

591

jondurbin/bagel

A bagel, with everything.

326

em-llm/EM-LLM-model

285

QuixiAI/laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'

240

basetenlabs/truss-examples

Examples of models deployable with Truss

230

JD-P/minihf

MiniHF is an inference, human preference data collection, and fine-tuning tool for local language…

183

genlm/llamppl

Probabilistic programming with large language models

178

meetrais/LLM-Fine-Tuning

162

jjziets/vasttools

My swiftsknife for vast.ai service

160

architsharma97/dpo-rlaif

100

Mamba413/AdaDetectGPT

[NeurIPS 2025] AdaDetectGPT: Adaptive Detection of LLM-Generated Text with Statistical Guarantees

69

skywalker023/fantom

👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine…

63

yixiaoer/mistral-v0.2-jax

JAX implementation of the Mistral 7b v0.2 model

35

finos-labs/Open-Financial-LLMs-Leaderboard

35

ahb-sjsu/turboquant-pro

Consumer-aware compression for embedding indexes and LLM KV caches — compress by the metric the…

25

cong-zeng/DALD

11

gauravbatule/AirCELA

3

Linked in READMEs

hpcaitech/Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

29,772

oumi-ai/oumi

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

9,383

jquesnelle/yarn

YaRN: Efficient Context Window Extension of Large Language Models

1,787

NVIDIA-NeMo/Automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

927

AtomicBot-ai/atomic-llama-cpp-turboquant

llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6…

394

databricks/databricks-ml-examples

369

ictnlp/TruthX

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in…

145

jphme/EM_German

Repository for the EM German Model

112

daniel-furman/sft-demos

🤖 language modeling sft demos

79

akjindal53244/Arithmo-Mistral-7B

Small and Efficient Mathematical Reasoning LLMs

73

akjindal53244/Arithmo

Small and Efficient Mathematical Reasoning LLMs

73

HimariO/llama.cpp.qwen2.5vl

Port of Facebook's LLaMA model in C/C++

66

AMAAI-Lab/SonicVerse

SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning

54

EvilFreelancer/saiga-custom

Bunch of notebooks for pre-training custom Saiga-like LLM

12

mzhaoshuai/RefAlign

RL with Similarity-based Rewards for Versatile Language Model Alignment.

8

poolsideai/llama.cpp

LLM inference in C/C++

6

alainnothere/llama.cpp

LLM inference in C/C++

1

wendadawen/llama.cpp

LLM inference in C/C++

0

Contributors

10 commits

4 commits

4 commits

3 commits