⚡Hivemind⚡ — Python Library for Decentralized Neural Network Training
2 min readSep 2, 2020
Hivemind is a library for decentralized training of large neural networks (the Decentralized Mixture of Experts (DMoE)). The library functionality provides distributed training of models on the user equipment. At the moment, the library is at the pre-alpha stage.