nogibjj/Reddit_Classifier_Final_Project

Jupyter Notebook

13 commits

updated Dec 13, 2022

See the code

README

Get Reddit data

Data pulled in notebook reddit_data/reddit_new.ipynb

Verify GPU works

Run pytorch training test: python utils/quickstart_pytorch.py
Run pytorch CUDA test: python utils/verify_cuda_pytorch.py
Run tensorflow training test: python utils/quickstart_tf2.py
Run nvidia monitoring test: nvidia-smi -l 1

Finetune text classifier model and upload to Hugging Face

In terminal, run huggingface-cli login
Run python fine_tune_berft.py to finetune the model on Reddit data
Run rename_labels.py to change the output labels of the classifier
Check out the fine-tuned model here Spaces APP

Similar repos

nogibjj/hugging-face-cli-with-codespaces

Repo that allows me to build AI tools on top of Hugging Face

same org

kirill-yatsy/LMSYS

LMSYS - Chatbot Arena Human Preference Predictions

AventixQ/fine-tuning

LLM-bot-ai/Finetune

mnbucher/text-cls-llms

Code for "Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models…

SaveFnk/ITAaLU_project

Project for a NLP university course

digitalepidemiologylab/covid-twitter-bert

Pretrained BERT model for analysing COVID-19 Twitter data

184

abathu/Final-Year-Project