erj2231/ai-projects

fast, lightweight and accurate custom optimizer for deep learning

Python

0

32 commits

updated Sep 26, 2026

See the code

See what people are saying

SourceMessageScoreDate

Tauon: A new optimizer outperforming Muon on GPT-Mini (lower loss, ~8.5% faster step time) [P] (r/MachineLearning)

Hey r/MachineLearning! I’ve been working on a new optimizer called **Tauon** (turns out there is already "teon" but well if you have better idea, - i will gladly accept it! Anyway the core idea of optimizer is about polynomials and orthogonalization just like muon, the whole difference is that i…

0

Sep 27, 2026

README

ai-projects

repository with projects i think

well this is my first commitment - so the thing is I started to learn ml half a year ago and i learned insturments like matplotlib, seaborn (i do understand tho that it is the same visualizer - the same with plotly), numpy, scikit-learn and max what i was able to make was basic ai face detector (using external model) on tensorflow in pycharm. but overall my knowledge was lacking and superficial - thats why i burned out and now with new vigor going to continue my ml journey - well this is 11.11.2025 and im going to start to write my kinda diary in github, kaggle (https://www.kaggle.com/erjanomarov). yeah kinda that.

chebyshev-filter
chebyshev-nodes
dct2
deep-learning
machine-learning
muon
neural-network
newton-schulz
numpy
optimization
optimizer
polynomials
python
pytorch
qr-factorization

Contributors

erj2231

32 commits

erj2231/ai-projects

fast, lightweight and accurate custom optimizer for deep learning

Python

0

32 commits

updated Sep 26, 2026

See the code

See what people are saying

SourceMessageScoreDate

Tauon: A new optimizer outperforming Muon on GPT-Mini (lower loss, ~8.5% faster step time) [P] (r/MachineLearning)

Hey r/MachineLearning! I’ve been working on a new optimizer called **Tauon** (turns out there is already "teon" but well if you have better idea, - i will gladly accept it! Anyway the core idea of optimizer is about polynomials and orthogonalization just like muon, the whole difference is that i…

0

Sep 27, 2026

README

ai-projects

repository with projects i think

well this is my first commitment - so the thing is I started to learn ml half a year ago and i learned insturments like matplotlib, seaborn (i do understand tho that it is the same visualizer - the same with plotly), numpy, scikit-learn and max what i was able to make was basic ai face detector (using external model) on tensorflow in pycharm. but overall my knowledge was lacking and superficial - thats why i burned out and now with new vigor going to continue my ml journey - well this is 11.11.2025 and im going to start to write my kinda diary in github, kaggle (https://www.kaggle.com/erjanomarov). yeah kinda that.

chebyshev-filter
chebyshev-nodes
dct2
deep-learning
machine-learning
muon
neural-network
newton-schulz
numpy
optimization
optimizer
polynomials
python
pytorch
qr-factorization

Contributors

erj2231

32 commits

Languages

Python

100.0%