tinyllamas-clay

A basic script for running an ensemble of TinyLlamas on MLX to annotate an Argilla Dataset

Getting started with tinyllamas-clay

You can use https://github.com/stevengans/ollama-clay as a starting point and fill-in and customize the sections required. You will need to create an Argilla dataset and also download TinyLlama weights, see the dependencies for more details:

Dependencies:

• TinyLlama weights: link to weights
• Argilla dataset: link to repo
• pip install requirements.txt

Once the above steps are complete you can run python tinyllamascanjudge.py and/or python tinyllamascanredteam.py. (You can also adjust the number of TinyLlamas to run)