Cartinoe5930/Llama2_init_Mistral

Model

stars

commits

linked in READMEs

Jan 19, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

README

Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

🏆 HuggingFace Open LLM Leaderboard

Model	ARC	HellaSwag	MMLU	TruthfulQA	Winogrande	GSM8K	Average
Llama2_init_Mistral	60.07	83.3	64.09	42.15	78.37	37.91	60.98

Contributors

Cartinoe5930

10 commits

Similar repos

uukuguy/speechless-mistral-six-in-one-7b

Model

mistralai/Mistral-7B-v0.1

Model

4,154

Cartinoe5930/SOLAR-DUS-implement

Model

chargoddard/llama-2-34b-uncode

Model

upstage/SOLAR-10.7B-v1.0

Model

322

uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b

Model

uukuguy/speechless-mistral-moloras-7b

Model

nyanko7/LLaMA-7B

Model

214

Linked in READMEs

gauss5930/iDUS

An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS)…

README badge

Cartinoe5930/Llama2_init_Mistral

Model

stars

commits

linked in READMEs

Jan 19, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

README

Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS