[D] How does distributed proof of work computing handle the coordination needs of neural network training?

About this article

[D] Ive been trying to understand the technical setup of a project called Qubic. It claims to use distributed proof of work computing for neural network training. I want to know if the idea holds together technically.The main issue with distributed training is coordination. Training large neural networks needs frequent sharing of gradient updates across nodes. This process is sensitive to delays and works far better with fast connections inside a data center than over the internet on separate...