Netmind-AI

Latest News

• [2023/01] Netmind websited online

Table of Contents

• Why Netmind-AI
• Features
• Netmind-AI with Pytorch
  • BERT
  • ResNet
• Netmind-AI with Tensorflow
  • BERT
  • ResNet
• Netmind-AI with Hivemind
  • BERT
  • ResNet
• Parallel Training Demo
  • Language Model
  • ResNet
• Installation
  • Download From Source

Why Netmind-AI

(back to top)

Features

Netmind-AI provides centralized and decentralized training framework for you. We aim to support you to write your distributed deep learning models just like how you write your model on your laptop. We provide user-friendly tools to kickstart distributed training and inference in a few lines.

• Centralized distributed traning

  • Data Parallelism
  • Model Parallelism
  • 1D, 2D, 2.5D, 3D Tensor Parallelism (coming soon)

• Decentralized distributed traning

  • Hivemind 1, 2

• Friendly Usage

  • Codelab example that easy to deploy or modified.

(back to top)

Parallel Training Demo

Language Model

https://github.com/protagolabs/Netmind-examples/tree/main/pytorch/language-modeling/local

ResNet

https://github.com/protagolabs/Netmind-examples/tree/main/pytorch/resnet/local

Installation

Download From Source

The version of Netmind-AI will be in line with the main branch of the repository. Feel free to raise an issue if you encounter any problem. :)

pip install git+https://github.com/protagolabs/NetMind-Mixin-Runtime

Please notice that this library was built for linux with python3.8. It can not be used on other platform or with other python version. Also, you should set PLATFORM environment variable before run "netmind" version training code. For example

export PLATFORM=pytorch && Netmind-examples/pytorch/language-modeling/netmind/trainer_Huggince/run_lm.sh
export PLATFORM=tensorflow && Netmind-examples/tensorflow/netmind/language-modeling/multi_run_0.sh
export PLATFORM=hivemind && Netmind-examples/hivemind/language-modeling/netmind/trainer_Huggince/run_trainer0.sh

Developing based on more Netmind-AI examples

git clone https://github.com/protagolabs/Netmind-examples.git
cd Netmind-examples

# install Netmind-AI with Pytorch
cd pytorch
pip install -r requirements.txt


# install Netmind-AI with Tensorflow
# Please check the ReadMe.md in "tensorflow" subdir



# install Netmind-AI with Hivemind
cd hivemind
pip install -r requirements.txt

(back to top)