wwewtech/russian-it-community-lora

Model

1

stars

72

commits

1

repos using this model

1

linked in READMEs

Sep 8, 2026

updated

lora
peft
qlora
russian
russian-nlp
safetensors
sft
text-generation

README

🦁 Russian IT Community LoRA Model Zoo

58 pre-trained adapters (55 domain adapters + 3 flagship 7B–8B QLoRA), fine-tuned on the RICC corpus (2.91M messages, 171.5k curated SFT dialogues) for Russian-language IT discourse: backend, DevOps, AI/ML, infrastructure.

Catalog regenerated from the Hub file tree on 2026-09-02. Source of truth: the siblings listing of this repository.

⚡ Quick Start: 3-Line Inference

import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Qwen/Qwen2.5-1.5B-Instruct"  # any base model from the catalog
adapter_id = "wwewtech/russian-it-community-lora"
subfolder = "qwen2.5_1.5b_instruct"  # choose from the catalog below

tokenizer = AutoTokenizer.from_pretrained(model_id)
base_model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
model = PeftModel.from_pretrained(base_model, adapter_id, subfolder=subfolder)

inputs = tokenizer("<|user|>\nКак настроить репликацию PostgreSQL?\n<|assistant|>\n", return_tensors="pt").to(
    model.device
)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

📚 Full Catalog (58 Adapters)

#Adapter SubfolderBase ModelHub Link
01bloom_1b7bigscience/bloom-1b7bloom_1b7/
02bloom_560mbigscience/bloom-560mbloom_560m/
03codegen_350m_multiSalesforce/codegen-350M-multicodegen_350m_multi/
04deepseek_coder_1.3b_instructdeepseek-ai/deepseek-coder-1.3b-instructdeepseek_coder_1.3b_instruct/
05deepseek_r1_distill_qwen_1.5bdeepseek-ai/DeepSeek-R1-Distill-Qwen-1.5Bdeepseek_r1_distill_qwen_1.5b/
06falcon3_1b_instructtiiuae/Falcon3-1B-Instructfalcon3_1b_instruct/
07falcon3_3b_instructtiiuae/Falcon3-3B-Instructfalcon3_3b_instruct/
08gemma_2_2b_itunsloth/gemma-2-2b-itgemma_2_2b_it/
09gpt2_largeopenai-community/gpt2-largegpt2_large/
10gpt2_mediumopenai-community/gpt2-mediumgpt2_medium/
11granite_3b_code_instructibm-granite/granite-3b-code-instructgranite_3b_code_instruct/
12heavyweight_deepseek_r1_7bunsloth/DeepSeek-R1-Distill-Qwen-7B-bnb-4bitheavyweight_deepseek_r1_7b/
13heavyweight_llama3.1_8bunsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bitheavyweight_llama3.1_8b/
14heavyweight_qwen2.5_coder_7bunsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bitheavyweight_qwen2.5_coder_7b/
15llama_3.2_1b_instructunsloth/Llama-3.2-1B-Instructllama_3.2_1b_instruct/
16llama_3.2_3b_instructunsloth/Llama-3.2-3B-Instructllama_3.2_3b_instruct/
17minicpm_2b_dpoopenbmb/MiniCPM-2B-dpo-bf16minicpm_2b_dpo/
18opt_1.3bfacebook/opt-1.3bopt_1.3b/
19opt_125mfacebook/opt-125mopt_125m/
20opt_2.7bfacebook/opt-2.7bopt_2.7b/
21opt_350mfacebook/opt-350mopt_350m/
22phi_1_5microsoft/phi-1_5phi_1_5/
23phi_2microsoft/phi-2phi_2/
24phi_3.5_mini_instructmicrosoft/Phi-3.5-mini-instructphi_3.5_mini_instruct/
25phi_3_mini_4k_instructmicrosoft/Phi-3-mini-4k-instructphi_3_mini_4k_instruct/
26pythia_1.4bEleutherAI/pythia-1.4b-dedupedpythia_1.4b/
27pythia_2.8bEleutherAI/pythia-2.8b-dedupedpythia_2.8b/
28pythia_410mEleutherAI/pythia-410m-dedupedpythia_410m/
29pythia_70mEleutherAI/pythia-70m-dedupedpythia_70m/
30qwen1.5_0.5b_chatQwen/Qwen1.5-0.5B-Chatqwen1.5_0.5b_chat/
31qwen1.5_1.8b_chatQwen/Qwen1.5-1.8B-Chatqwen1.5_1.8b_chat/
32qwen2.5_0.5b_instructQwen/Qwen2.5-0.5B-Instructqwen2.5_0.5b_instruct/
33qwen2.5_1.5b_instructQwen/Qwen2.5-1.5B-Instructqwen2.5_1.5b_instruct/
34qwen2.5_3b_instructQwen/Qwen2.5-3B-Instructqwen2.5_3b_instruct/
35qwen2.5_coder_0.5b_instructQwen/Qwen2.5-Coder-0.5B-Instructqwen2.5_coder_0.5b_instruct/
36qwen2.5_coder_1.5b_instructQwen/Qwen2.5-Coder-1.5B-Instructqwen2.5_coder_1.5b_instruct/
37qwen2.5_coder_3b_instructQwen/Qwen2.5-Coder-3B-Instructqwen2.5_coder_3b_instruct/
38qwen2.5_math_1.5b_instructQwen/Qwen2.5-Math-1.5B-Instructqwen2.5_math_1.5b_instruct/
39qwen2_0.5b_instructQwen/Qwen2-0.5B-Instructqwen2_0.5b_instruct/
40qwen2_1.5b_instructQwen/Qwen2-1.5B-Instructqwen2_1.5b_instruct/
41rugpt3_largeai-forever/rugpt3large_based_on_gpt2rugpt3_large/
42rugpt3_mediumai-forever/rugpt3medium_based_on_gpt2rugpt3_medium/
43rugpt3_smallai-forever/rugpt3small_based_on_gpt2rugpt3_small/
44russian_it_loraQwen/Qwen2.5-0.5B-Instructrussian_it_lora/
45sber_mgptai-forever/mGPTsber_mgpt/
46smollm2_1.7b_instructHuggingFaceTB/SmolLM2-1.7B-Instructsmollm2_1.7b_instruct/
47smollm2_135m_instructHuggingFaceTB/SmolLM2-135M-Instructsmollm2_135m_instruct/
48smollm2_360m_instructHuggingFaceTB/SmolLM2-360M-Instructsmollm2_360m_instruct/
49smollm_1.7b_instructHuggingFaceTB/SmolLM-1.7B-Instructsmollm_1.7b_instruct/
50smollm_135m_instructHuggingFaceTB/SmolLM-135M-Instructsmollm_135m_instruct/
51smollm_360m_instructHuggingFaceTB/SmolLM-360M-Instructsmollm_360m_instruct/
52stablelm_2_1_6b_chatstabilityai/stablelm-2-1_6b-chatstablelm_2_1_6b_chat/
53stablelm_2_zephyr_1_6bstabilityai/stablelm-2-zephyr-1_6bstablelm_2_zephyr_1_6b/
54tiny_starcoder_pybigcode/tiny_starcoder_pytiny_starcoder_py/
55tinyllama_1.1b_chatTinyLlama/TinyLlama-1.1B-Chat-v1.0tinyllama_1.1b_chat/
56vikhr_llama_3.2_1bVikhrmodels/Vikhr-Llama-3.2-1B-instructvikhr_llama_3.2_1b/
57vikhr_qwen_2.5_0.5bVikhrmodels/Vikhr-Qwen-2.5-0.5B-Instructvikhr_qwen_2.5_0.5b/
58vikhr_qwen_2.5_1.5bVikhrmodels/Vikhr-Qwen-2.5-1.5B-Instructvikhr_qwen_2.5_1.5b/

🥇 Flagship QLoRA Models (7B–8B)

Full-precision copies also live under models/: models/heavyweight_qwen2.5_coder_7b, models/heavyweight_deepseek_r1_7b, models/heavyweight_llama3.1_8b.

📓 Training Data & Evaluation Status

  • Training corpus: RICC SFT Dialogues (171,520 multi-turn dialogues).
  • Training regime: Published adapters are domain-adaptation pilot checkpoints (50–100 training steps on sampled domain batches) demonstrating PEFT compatibility and consumer-GPU deployment (RTX 3060 12GB). They are not multi-epoch checkpoints over the entire corpus.
  • Academic benchmark numbers (HumanEval / RuMMLU / PPL) published earlier are withdrawn pending re-evaluation: the harness had answer-parsing and column-mapping defects that produced implausible values (see repo commit history). Enterprise scenario scores are rubric-based heuristics, not capability measurements.

Contributors

wwewtech

72 commits

wwewtech/russian-it-community-lora

Model

1

stars

72

commits

1

repos using this model

1

linked in READMEs

Sep 8, 2026

updated

lora
peft
qlora
russian
russian-nlp
safetensors
sft
text-generation

README

🦁 Russian IT Community LoRA Model Zoo

58 pre-trained adapters (55 domain adapters + 3 flagship 7B–8B QLoRA), fine-tuned on the RICC corpus (2.91M messages, 171.5k curated SFT dialogues) for Russian-language IT discourse: backend, DevOps, AI/ML, infrastructure.

Catalog regenerated from the Hub file tree on 2026-09-02. Source of truth: the siblings listing of this repository.

⚡ Quick Start: 3-Line Inference

import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Qwen/Qwen2.5-1.5B-Instruct"  # any base model from the catalog
adapter_id = "wwewtech/russian-it-community-lora"
subfolder = "qwen2.5_1.5b_instruct"  # choose from the catalog below

tokenizer = AutoTokenizer.from_pretrained(model_id)
base_model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
model = PeftModel.from_pretrained(base_model, adapter_id, subfolder=subfolder)

inputs = tokenizer("<|user|>\nКак настроить репликацию PostgreSQL?\n<|assistant|>\n", return_tensors="pt").to(
    model.device
)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

📚 Full Catalog (58 Adapters)

#Adapter SubfolderBase ModelHub Link
01bloom_1b7bigscience/bloom-1b7bloom_1b7/
02bloom_560mbigscience/bloom-560mbloom_560m/
03codegen_350m_multiSalesforce/codegen-350M-multicodegen_350m_multi/
04deepseek_coder_1.3b_instructdeepseek-ai/deepseek-coder-1.3b-instructdeepseek_coder_1.3b_instruct/
05deepseek_r1_distill_qwen_1.5bdeepseek-ai/DeepSeek-R1-Distill-Qwen-1.5Bdeepseek_r1_distill_qwen_1.5b/
06falcon3_1b_instructtiiuae/Falcon3-1B-Instructfalcon3_1b_instruct/
07falcon3_3b_instructtiiuae/Falcon3-3B-Instructfalcon3_3b_instruct/
08gemma_2_2b_itunsloth/gemma-2-2b-itgemma_2_2b_it/
09gpt2_largeopenai-community/gpt2-largegpt2_large/
10gpt2_mediumopenai-community/gpt2-mediumgpt2_medium/
11granite_3b_code_instructibm-granite/granite-3b-code-instructgranite_3b_code_instruct/
12heavyweight_deepseek_r1_7bunsloth/DeepSeek-R1-Distill-Qwen-7B-bnb-4bitheavyweight_deepseek_r1_7b/
13heavyweight_llama3.1_8bunsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bitheavyweight_llama3.1_8b/
14heavyweight_qwen2.5_coder_7bunsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bitheavyweight_qwen2.5_coder_7b/
15llama_3.2_1b_instructunsloth/Llama-3.2-1B-Instructllama_3.2_1b_instruct/
16llama_3.2_3b_instructunsloth/Llama-3.2-3B-Instructllama_3.2_3b_instruct/
17minicpm_2b_dpoopenbmb/MiniCPM-2B-dpo-bf16minicpm_2b_dpo/
18opt_1.3bfacebook/opt-1.3bopt_1.3b/
19opt_125mfacebook/opt-125mopt_125m/
20opt_2.7bfacebook/opt-2.7bopt_2.7b/
21opt_350mfacebook/opt-350mopt_350m/
22phi_1_5microsoft/phi-1_5phi_1_5/
23phi_2microsoft/phi-2phi_2/
24phi_3.5_mini_instructmicrosoft/Phi-3.5-mini-instructphi_3.5_mini_instruct/
25phi_3_mini_4k_instructmicrosoft/Phi-3-mini-4k-instructphi_3_mini_4k_instruct/
26pythia_1.4bEleutherAI/pythia-1.4b-dedupedpythia_1.4b/
27pythia_2.8bEleutherAI/pythia-2.8b-dedupedpythia_2.8b/
28pythia_410mEleutherAI/pythia-410m-dedupedpythia_410m/
29pythia_70mEleutherAI/pythia-70m-dedupedpythia_70m/
30qwen1.5_0.5b_chatQwen/Qwen1.5-0.5B-Chatqwen1.5_0.5b_chat/
31qwen1.5_1.8b_chatQwen/Qwen1.5-1.8B-Chatqwen1.5_1.8b_chat/
32qwen2.5_0.5b_instructQwen/Qwen2.5-0.5B-Instructqwen2.5_0.5b_instruct/
33qwen2.5_1.5b_instructQwen/Qwen2.5-1.5B-Instructqwen2.5_1.5b_instruct/
34qwen2.5_3b_instructQwen/Qwen2.5-3B-Instructqwen2.5_3b_instruct/
35qwen2.5_coder_0.5b_instructQwen/Qwen2.5-Coder-0.5B-Instructqwen2.5_coder_0.5b_instruct/
36qwen2.5_coder_1.5b_instructQwen/Qwen2.5-Coder-1.5B-Instructqwen2.5_coder_1.5b_instruct/
37qwen2.5_coder_3b_instructQwen/Qwen2.5-Coder-3B-Instructqwen2.5_coder_3b_instruct/
38qwen2.5_math_1.5b_instructQwen/Qwen2.5-Math-1.5B-Instructqwen2.5_math_1.5b_instruct/
39qwen2_0.5b_instructQwen/Qwen2-0.5B-Instructqwen2_0.5b_instruct/
40qwen2_1.5b_instructQwen/Qwen2-1.5B-Instructqwen2_1.5b_instruct/
41rugpt3_largeai-forever/rugpt3large_based_on_gpt2rugpt3_large/
42rugpt3_mediumai-forever/rugpt3medium_based_on_gpt2rugpt3_medium/
43rugpt3_smallai-forever/rugpt3small_based_on_gpt2rugpt3_small/
44russian_it_loraQwen/Qwen2.5-0.5B-Instructrussian_it_lora/
45sber_mgptai-forever/mGPTsber_mgpt/
46smollm2_1.7b_instructHuggingFaceTB/SmolLM2-1.7B-Instructsmollm2_1.7b_instruct/
47smollm2_135m_instructHuggingFaceTB/SmolLM2-135M-Instructsmollm2_135m_instruct/
48smollm2_360m_instructHuggingFaceTB/SmolLM2-360M-Instructsmollm2_360m_instruct/
49smollm_1.7b_instructHuggingFaceTB/SmolLM-1.7B-Instructsmollm_1.7b_instruct/
50smollm_135m_instructHuggingFaceTB/SmolLM-135M-Instructsmollm_135m_instruct/
51smollm_360m_instructHuggingFaceTB/SmolLM-360M-Instructsmollm_360m_instruct/
52stablelm_2_1_6b_chatstabilityai/stablelm-2-1_6b-chatstablelm_2_1_6b_chat/
53stablelm_2_zephyr_1_6bstabilityai/stablelm-2-zephyr-1_6bstablelm_2_zephyr_1_6b/
54tiny_starcoder_pybigcode/tiny_starcoder_pytiny_starcoder_py/
55tinyllama_1.1b_chatTinyLlama/TinyLlama-1.1B-Chat-v1.0tinyllama_1.1b_chat/
56vikhr_llama_3.2_1bVikhrmodels/Vikhr-Llama-3.2-1B-instructvikhr_llama_3.2_1b/
57vikhr_qwen_2.5_0.5bVikhrmodels/Vikhr-Qwen-2.5-0.5B-Instructvikhr_qwen_2.5_0.5b/
58vikhr_qwen_2.5_1.5bVikhrmodels/Vikhr-Qwen-2.5-1.5B-Instructvikhr_qwen_2.5_1.5b/

🥇 Flagship QLoRA Models (7B–8B)

Full-precision copies also live under models/: models/heavyweight_qwen2.5_coder_7b, models/heavyweight_deepseek_r1_7b, models/heavyweight_llama3.1_8b.

📓 Training Data & Evaluation Status

  • Training corpus: RICC SFT Dialogues (171,520 multi-turn dialogues).
  • Training regime: Published adapters are domain-adaptation pilot checkpoints (50–100 training steps on sampled domain batches) demonstrating PEFT compatibility and consumer-GPU deployment (RTX 3060 12GB). They are not multi-epoch checkpoints over the entire corpus.
  • Academic benchmark numbers (HumanEval / RuMMLU / PPL) published earlier are withdrawn pending re-evaluation: the harness had answer-parsing and column-mapping defects that produced implausible values (see repo commit history). Enterprise scenario scores are rubric-based heuristics, not capability measurements.

Contributors

wwewtech

72 commits