here for paper

• Author: Ali Munir (Michigan State University)

• Congestion Control, Transport, Data Center

又称为：Message Passing Interface 消息传递函数库

Build your Code for Data Parallelism

所以最小的模型需要one master worker and one ps

大的模型可以是one master worker, many ps and many workers

ᕙ(`▿´)ᕗ Congratulations ~ Daisy has passed the Qualify Examination on Chapter I ~

here for paper

• Author: Liang Luo (University of Washington Microsoft Research)

• Distributed Machine Learning, Parameter Server

here for paper

• Author: Guanhua Wang

• Distributed Machine Learning, Ring Allreduce, broadcast

here for paper

• Author: Jinkun Geng,Li Dan

• Distributed Machine Learning, Parameter Server, Ring Allreduce, Mesh-based Synchronization(MS)

This is all i learned from the web Distributed Tensorflow

Accelerate Distributed Learning all about

RDMA, ps-lite, Distribute training, Parameter Server and Ring All-reduce

• presenter Jingrong Chen
• time: 17th.08.2018

Pre-requisite:

my two github user.name is miqianmimi & miqianmimi7
my two github user.email is miqainmimi@outlook.com & miqianmimi7@outlook.com

First: generate two keys and four documents.

1
2

ssh-keygen -t rsa -C "miqainmimi@outlook.com"  
ssh-keygen -t rsa -C "miqianmimi7@outlook.com"