YuanLabAI/Yuan3.0-Flash-4bit

Model

19

stars

16

commits

1

linked in READMEs

Apr 7, 2026

updated

compressed-tensors
custom_code
safetensors
yuanvl
Browse cluster: Yuan Large Language Models β†’

README

Yuan 3.0 Multimodal Foundation Model


GitHub ModelScope Twitter Follow arXiv

Latest Updates πŸŽ‰πŸŽ‰

  • [2025-12-30] Released Yuan 3.0-40B Multimodal Large Language Model, a high-performance model for enterprise-grade application scenarios: Yuan3.0 Flash

1. Introduction

Yuan 3.0 Flash, developed by the YuanLab.ai team, is a 40B parameter multimodal foundation model that employs a Mixture of Experts (MoE) architecture, activating only approximately 3.7B parameters per inference. Through innovative reinforcement learning training methods (RAPO), it significantly reduces inference token consumption while improving reasoning accuracy, exploring the innovative path of "less computation, higher intelligence" for large language models. We have also released the technical report for the Yuan3.0 model, where you can find more detailed technical information and evaluation results.

Fig.1: Yuan3.0 Multimodal Large Language Model Architecture

Core Features

  • πŸš€ Efficient Inference: Reduces inference token consumption by up to 75%, significantly lowering costs
  • 🎯 Enterprise-Grade Optimization: Deeply optimized for enterprise scenarios such as RAG, document understanding, and table analysis
  • 🎨 Multimodal Support: Supports text, image, table, document and other multimodal inputs
  • πŸ“š Long Context: Supports 128K context length, achieving 100% accuracy in "Needle in a Haystack" tests
  • ⚑ Ready-to-Use Intelligence: Default inference mode meets the needs of most enterprise scenarios

2. Performance

Yuan 3.0 Flash outperforms GPT-5.1 in enterprise-grade RAG, multimodal retrieval, table understanding, summary generation and other tasks. With 40B parameters, it achieves the reasoning accuracy of 235B/671B models while reducing token consumption by 50%-75%, providing enterprises with high-performance, low-cost large language model solutions.

Fig.1: Yuan3.0 Multimodal Large Language Model Architecture

3. Core Technology

RAPO Reinforcement Learning Algorithm

The innovative Reflection-aware Adaptive Policy Optimization (RAPO) algorithm, through the Reflection Inhibition Reward Mechanism (RIRM):

  • βœ… Identifies the key point where the correct answer is first obtained
  • 🎯 Suppresses subsequent redundant reasoning behavior
  • πŸ“‰ Improves accuracy while reducing inference token count by approximately 75%
Training MethodAIME 2024 AccuracyAvg Output LengthMATH-500 AccuracyAvg Output Length
Yuan3.0 Flash (40B) SFT31.45%13,656 tokens83.20%3,362 tokens
RL+DAPO length-penalty46.35%13,781 tokens89.06%3,974 tokens
RL+RIRM47.92%7,505 tokens89.47%1,777 tokens

4. Model Download

We provide download links for multiple model formats:

ModelParametersPrecisionSequence LengthModel FormatDownload Link
Yuan3.0 Flash40B16bit128KHuggingFaceModelScope | HuggingFace | WiseModel
Yuan3.0 Flash 4bit40B4bit128KHuggingFaceModelScope | HuggingFace | WiseModel

5. Evaluation Results

5.1 Text-based RAG Evaluation: ChatRAG πŸ†

Yuan 3.0 Flash leads DeepSeek-V3, DeepSeek-R1 and other large language models in average accuracy across 10 evaluation tasks in the industry-standard RAG benchmark ChatRAG.

Model Average Accuracy Comparison

ModelsAvg AllD2DQuACQReCCCoQADoQACFQASQATCQAHDialINSCIT
DeepSeek-V350.4731.5928.8649.3176.9826.1183.4982.1346.6947.4332.08
DeepSeek-V3.2349.6734.3028.0949.9777.2929.4672.8579.4844.6447.9932.64
OpenAI GPT-4o50.5432.7626.5649.3076.1128.7881.8581.1449.7541.2926.69
OpenAI GPT-o344.0623.0520.8240.4269.4218.5667.7586.7145.8541.2926.69
DeepSeek-R139.4221.4622.2342.4162.5324.6881.4882.0630.7437.9728.68
OpenAI GPT-5.146.1028.2423.1645.4368.8420.8873.0581.3244.7045.3929.95
Yuan3.0 Flash64.4749.8253.7957.0890.9359.9974.4087.5266.3168.4536.40

β€’ Long Context Tests (D2D, QuAC, QReCC)
β€’ Wikipedia Retrieval Tests (TCQA, INSCIT)
β€’ Short Text & Structured Context Tests (CoQA, DoQA, CFQA, SQA, HDial)


5.2 Multimodal RAG Evaluation: Docmatix πŸ†

Yuan3.0 Flash leads Claude3.5, OpenAI GPT-4o, o3 and other models in the multimodal RAG benchmark Docmatix, with accuracy performance only second to GPT-5.1.

Model Average Accuracy Comparison

ModelsAvg.
Qwen2.5-VL-72B-Instruct59.75
InternVL3-78B42.99
Claude3.5-Sonnet42.55
OpenAI GPT-4o56.79
OpenAI GPT-o345.57
OpenAI GPT-4V60.10
OpenAI GPT-5.148.52
Yuan3.0 Flash65.07

Docmatix - Evaluates the model's ability to retrieve information, correlate, and accurately answer questions across text, tables, images and other multimodal content in multi-page complex documents.


5.3 Multimodal Complex Table Content Analysis Evaluation: MMTab πŸ†

Multimodal table understanding is an important application scenario in enterprise office automation. Yuan3.0 Flash achieves leading average accuracy on 15 evaluation tasks in the industry-standard multimodal complex table understanding benchmark MMTab, surpassing OpenAI's GPT-5.1.

Model Average Accuracy Comparison

ModelsAvg.TABMWPWTQWTQHiTabTAT-QAFeTaQAUTabFactInfoTabsHiTab_T2TRotowireWikiBIOTSD_RowTSD_ColTCETCLMCDRCE
Zhipu GLM-4.5V52.0088.2177.4251.5262.695.2589.4479.485.174.482.6947.4089.7052.7450.8443.4750.7782.79
OpenAI GPT-4V29.9060.5048.0027.5032.5011.0445.5065.602.984.231.9419.0038.0014.3627.913.5048.5257.14
OpenAI GPT-5.155.1564.9560.7777.7761.378.7052.8164.3044.1617.8111.9596.6062.1086.4344.6672.4653.5857.20
Yuan3.0 Flash58.2995.0968.2369.8069.1728.4287.3283.5013.3014.7417.2646.6082.8056.7756.9865.2062.0773.67

5.4 Text Summarization Generation Evaluation: SummEval πŸ†

Summarization generation is a core requirement for historical information compression in intelligent agent applications. Yuan 3.0 achieves leading average accuracy in the industry-standard summarization generation benchmark SummEval across three major capabilities: lexical overlap, semantic similarity, and factual consistency, surpassing the DeepSeek-V3 large language model.

Model Average Accuracy Comparison

ModelsAvg.Lexical Overlap
ROUGE-1
Lexical Overlap
ROUGE-2
Semantic Similarity
BERTScore
Factual Consistency
SummaC
DeepSeek-V359.2825.509.2086.3068.20
DeepSeek-V3.251.3633.3011.9285.6141.76
Gemini-2.0-Flash45.3524.808.7085.7029.50
Claude-3.5-Sonnet45.4324.108.3085.2030.70
OpenAI GPT-4o46.5325.008.9085.9032.50
OpenAI GPT-5.149.4427.4810.1684.6340.50
Yuan3.0 Flash59.3151.3228.3289.9945.34

Contributors

Yuan-lab

15 commits

RO
root

1 commits

YuanLabAI/Yuan3.0-Flash-4bit

Model

19

stars

16

commits

1

linked in READMEs

Apr 7, 2026

updated

compressed-tensors
custom_code
safetensors
yuanvl
Browse cluster: Yuan Large Language Models β†’

README

Yuan 3.0 Multimodal Foundation Model


GitHub ModelScope Twitter Follow arXiv

Latest Updates πŸŽ‰πŸŽ‰

  • [2025-12-30] Released Yuan 3.0-40B Multimodal Large Language Model, a high-performance model for enterprise-grade application scenarios: Yuan3.0 Flash

1. Introduction

Yuan 3.0 Flash, developed by the YuanLab.ai team, is a 40B parameter multimodal foundation model that employs a Mixture of Experts (MoE) architecture, activating only approximately 3.7B parameters per inference. Through innovative reinforcement learning training methods (RAPO), it significantly reduces inference token consumption while improving reasoning accuracy, exploring the innovative path of "less computation, higher intelligence" for large language models. We have also released the technical report for the Yuan3.0 model, where you can find more detailed technical information and evaluation results.

Fig.1: Yuan3.0 Multimodal Large Language Model Architecture

Core Features

  • πŸš€ Efficient Inference: Reduces inference token consumption by up to 75%, significantly lowering costs
  • 🎯 Enterprise-Grade Optimization: Deeply optimized for enterprise scenarios such as RAG, document understanding, and table analysis
  • 🎨 Multimodal Support: Supports text, image, table, document and other multimodal inputs
  • πŸ“š Long Context: Supports 128K context length, achieving 100% accuracy in "Needle in a Haystack" tests
  • ⚑ Ready-to-Use Intelligence: Default inference mode meets the needs of most enterprise scenarios

2. Performance

Yuan 3.0 Flash outperforms GPT-5.1 in enterprise-grade RAG, multimodal retrieval, table understanding, summary generation and other tasks. With 40B parameters, it achieves the reasoning accuracy of 235B/671B models while reducing token consumption by 50%-75%, providing enterprises with high-performance, low-cost large language model solutions.

Fig.1: Yuan3.0 Multimodal Large Language Model Architecture

3. Core Technology

RAPO Reinforcement Learning Algorithm

The innovative Reflection-aware Adaptive Policy Optimization (RAPO) algorithm, through the Reflection Inhibition Reward Mechanism (RIRM):

  • βœ… Identifies the key point where the correct answer is first obtained
  • 🎯 Suppresses subsequent redundant reasoning behavior
  • πŸ“‰ Improves accuracy while reducing inference token count by approximately 75%
Training MethodAIME 2024 AccuracyAvg Output LengthMATH-500 AccuracyAvg Output Length
Yuan3.0 Flash (40B) SFT31.45%13,656 tokens83.20%3,362 tokens
RL+DAPO length-penalty46.35%13,781 tokens89.06%3,974 tokens
RL+RIRM47.92%7,505 tokens89.47%1,777 tokens

4. Model Download

We provide download links for multiple model formats:

ModelParametersPrecisionSequence LengthModel FormatDownload Link
Yuan3.0 Flash40B16bit128KHuggingFaceModelScope | HuggingFace | WiseModel
Yuan3.0 Flash 4bit40B4bit128KHuggingFaceModelScope | HuggingFace | WiseModel

5. Evaluation Results

5.1 Text-based RAG Evaluation: ChatRAG πŸ†

Yuan 3.0 Flash leads DeepSeek-V3, DeepSeek-R1 and other large language models in average accuracy across 10 evaluation tasks in the industry-standard RAG benchmark ChatRAG.

Model Average Accuracy Comparison

ModelsAvg AllD2DQuACQReCCCoQADoQACFQASQATCQAHDialINSCIT
DeepSeek-V350.4731.5928.8649.3176.9826.1183.4982.1346.6947.4332.08
DeepSeek-V3.2349.6734.3028.0949.9777.2929.4672.8579.4844.6447.9932.64
OpenAI GPT-4o50.5432.7626.5649.3076.1128.7881.8581.1449.7541.2926.69
OpenAI GPT-o344.0623.0520.8240.4269.4218.5667.7586.7145.8541.2926.69
DeepSeek-R139.4221.4622.2342.4162.5324.6881.4882.0630.7437.9728.68
OpenAI GPT-5.146.1028.2423.1645.4368.8420.8873.0581.3244.7045.3929.95
Yuan3.0 Flash64.4749.8253.7957.0890.9359.9974.4087.5266.3168.4536.40

β€’ Long Context Tests (D2D, QuAC, QReCC)
β€’ Wikipedia Retrieval Tests (TCQA, INSCIT)
β€’ Short Text & Structured Context Tests (CoQA, DoQA, CFQA, SQA, HDial)


5.2 Multimodal RAG Evaluation: Docmatix πŸ†

Yuan3.0 Flash leads Claude3.5, OpenAI GPT-4o, o3 and other models in the multimodal RAG benchmark Docmatix, with accuracy performance only second to GPT-5.1.

Model Average Accuracy Comparison

ModelsAvg.
Qwen2.5-VL-72B-Instruct59.75
InternVL3-78B42.99
Claude3.5-Sonnet42.55
OpenAI GPT-4o56.79
OpenAI GPT-o345.57
OpenAI GPT-4V60.10
OpenAI GPT-5.148.52
Yuan3.0 Flash65.07

Docmatix - Evaluates the model's ability to retrieve information, correlate, and accurately answer questions across text, tables, images and other multimodal content in multi-page complex documents.


5.3 Multimodal Complex Table Content Analysis Evaluation: MMTab πŸ†

Multimodal table understanding is an important application scenario in enterprise office automation. Yuan3.0 Flash achieves leading average accuracy on 15 evaluation tasks in the industry-standard multimodal complex table understanding benchmark MMTab, surpassing OpenAI's GPT-5.1.

Model Average Accuracy Comparison

ModelsAvg.TABMWPWTQWTQHiTabTAT-QAFeTaQAUTabFactInfoTabsHiTab_T2TRotowireWikiBIOTSD_RowTSD_ColTCETCLMCDRCE
Zhipu GLM-4.5V52.0088.2177.4251.5262.695.2589.4479.485.174.482.6947.4089.7052.7450.8443.4750.7782.79
OpenAI GPT-4V29.9060.5048.0027.5032.5011.0445.5065.602.984.231.9419.0038.0014.3627.913.5048.5257.14
OpenAI GPT-5.155.1564.9560.7777.7761.378.7052.8164.3044.1617.8111.9596.6062.1086.4344.6672.4653.5857.20
Yuan3.0 Flash58.2995.0968.2369.8069.1728.4287.3283.5013.3014.7417.2646.6082.8056.7756.9865.2062.0773.67

5.4 Text Summarization Generation Evaluation: SummEval πŸ†

Summarization generation is a core requirement for historical information compression in intelligent agent applications. Yuan 3.0 achieves leading average accuracy in the industry-standard summarization generation benchmark SummEval across three major capabilities: lexical overlap, semantic similarity, and factual consistency, surpassing the DeepSeek-V3 large language model.

Model Average Accuracy Comparison

ModelsAvg.Lexical Overlap
ROUGE-1
Lexical Overlap
ROUGE-2
Semantic Similarity
BERTScore
Factual Consistency
SummaC
DeepSeek-V359.2825.509.2086.3068.20
DeepSeek-V3.251.3633.3011.9285.6141.76
Gemini-2.0-Flash45.3524.808.7085.7029.50
Claude-3.5-Sonnet45.4324.108.3085.2030.70
OpenAI GPT-4o46.5325.008.9085.9032.50
OpenAI GPT-5.149.4427.4810.1684.6340.50
Yuan3.0 Flash59.3151.3228.3289.9945.34

Contributors

Yuan-lab

15 commits

RO
root

1 commits