聯邦學習
FATE (Federated AI Technology Enabler) 是微衆銀行AI部門發起的開源項目，為聯邦學習生态系統提供了可靠的安全計算架構。FATE項目使用多方安全計算 (MPC) 以及同态加密 (HE) 技術建構底層安全計算協定，以此支援不同種類的機器學習的安全計算，包括邏輯回歸、基于樹的算法、深度學習和遷移學習等。
FATE官方網站：fate.fedai.org/
FATE文檔：fate.readthedocs.io/
安裝docker
curl -fsSL https://get.docker.com | bash -s docker --mirror aliyun 下載下傳所需鏡像
docker pull federatedai/standalone_fate:1.7.1.1 下載下傳太慢，可以選着下載下傳tar包
root@hello:~# wget https://webank-ai-1251170195.cos.ap-guangzhou.myqcloud.com/fate/1.7.1.1/release/standalone_fate_docker_image_1.7.1.1_release.tar;
root@hello:~# docker load < standalone_fate_docker_image_1.7.1.1_release.tar
613be09ab3c0: Loading layer [==================================================>] 211.1MB/211.1MB
0b0618c6ced8: Loading layer [==================================================>] 34.05MB/34.05MB
7da7d3716181: Loading layer [==================================================>] 20.99kB/20.99kB
a317a6aa16e0: Loading layer [==================================================>] 2.148MB/2.148MB
87365bb20418: Loading layer [==================================================>] 257.8MB/257.8MB
1ff796d14e4f: Loading layer [==================================================>] 162.3MB/162.3MB
5ddd6cd3032d: Loading layer [==================================================>] 16.38kB/16.38kB
72dc59b41d26: Loading layer [==================================================>] 18.94kB/18.94kB
51c3351a5d26: Loading layer [==================================================>] 12.26MB/12.26MB
258e35d02c08: Loading layer [==================================================>] 3.072kB/3.072kB
68512ba32441: Loading layer [==================================================>] 8.704kB/8.704kB
7617803436ad: Loading layer [==================================================>] 3.072kB/3.072kB
b08fdc026a0d: Loading layer [==================================================>] 129.3MB/129.3MB
93ac7e91dd87: Loading layer [==================================================>] 3.287GB/3.287GB
c3e03cea7b5f: Loading layer [==================================================>] 4.608kB/4.608kB
5f70bf18a086: Loading layer [==================================================>] 1.024kB/1.024kB
fe63005b3b70: Loading layer [==================================================>] 488.2MB/488.2MB
b6e2974d86f7: Loading layer [==================================================>] 3.584kB/3.584kB
0f41365d9b69: Loading layer [==================================================>] 3.072kB/3.072kB
22a68c3cca2b: Loading layer [==================================================>] 3.584kB/3.584kB
fd05ae943ab9: Loading layer [==================================================>] 4.096kB/4.096kB
14bbbe13f9fa: Loading layer [==================================================>] 5.632kB/5.632kB
6db147c8b695: Loading layer [==================================================>] 2.848MB/2.848MB
e8875a58bc61: Loading layer [==================================================>] 6.144kB/6.144kB
582394b0287a: Loading layer [==================================================>] 1.154MB/1.154MB
7808bf03bd20: Loading layer [==================================================>] 397.8MB/397.8MB
d144a9e78472: Loading layer [==================================================>] 5.632kB/5.632kB
fff9aed1cf2f: Loading layer [==================================================>] 6.144kB/6.144kB
de747ddfdffa: Loading layer [==================================================>] 5.632kB/5.632kB
bc9989f84045: Loading layer [==================================================>] 5.632kB/5.632kB
Loaded image: federatedai/standalone_fate:1.7.1.1
root@hello:~# docker images | grep federatedai/standalone_fate
federatedai/standalone_fate 1.7.1.1 6911b15a71bd 4 weeks ago 4.92GB 啟動容器，并進入
root@hello:~# docker run -d --name standalone_fate -p 8080:8080 federatedai/standalone_fate:1.7.1.1
50e95fda254a383a243576e43859d9ac91d9f8f5a8f84654dfdf99c7d47a8ccc
root@hello:~#
root@hello:~#
root@hello:~#
root@hello:~# docker ps -a | grep standalone_fate
50e95fda254a federatedai/standalone_fate:1.7.1.1 "docker-entrypoint.sh" 22 seconds ago Up 19 seconds 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp standalone_fate
root@hello:~#
root@hello:~#
root@hello:~#
root@hello:~#
root@hello:~#
root@hello:~# docker exec -it $(docker ps -aqf "name=standalone_fate") bash
(app-root) bash-4.2#
(app-root) bash-4.2#
(app-root) bash-4.2# 在容器内進行Toy測試
(app-root) bash-4.2# flow test toy -gid 10000 -hid 10000
toy test job 202202270654137342340 is waiting
toy test job 202202270654137342340 is waiting
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is running
toy test job 202202270654137342340 is success
[INFO] [2022-02-27 06:54:18,706] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:96]: begin to init parameters of secure add example guest
[INFO] [2022-02-27 06:54:18,707] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:100]: begin to make guest data
[INFO] [2022-02-27 06:54:18,742] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:103]: split data into two random parts
[INFO] [2022-02-27 06:54:18,864] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:106]: share one random part data to host
[INFO] [2022-02-27 06:54:18,911] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:109]: get share of one random part data from host
[INFO] [2022-02-27 06:54:19,014] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:112]: begin to get sum of guest and host
[INFO] [2022-02-27 06:54:19,041] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:115]: receive host sum from guest
[INFO] [2022-02-27 06:54:19,048] [202202270654137342340] [229:139661668419392] - [secure_add_guest.run] [line:122]: success to calculate secure_sum, it is 2000.0000000000005
(app-root) bash-4.2# 如果成功，螢幕顯示類似下方的語句:
success to calculate secure_sum, it is 2000.0 單元測試
(app-root) bash-4.2# fate_test unittest federatedml --yes
testsuite namespace: 20220227065434
start to run test /data/projects/fate/fate/python/federatedml/feature/test/feature_imputation_test.py
.
----------------------------------------------------------------------
Ran 1 test in 0.000s
OK
---略----
start to run test /data/projects/fate/fate/python/federatedml/nn/hetero_nn/test/random_number_generator_test.py
using engines: {'computing': 'STANDALONE', 'federation': 'STANDALONE', 'storage': 'STANDALONE', 'federated_mode': 'SINGLE'}
create manager session cc68ee02-979a-11ec-b5d1-0242ac110002
try to save session record for manager cc68ee02-979a-11ec-b5d1-0242ac110002, computing STANDALONE test_random_number0.9860114704767727
save session record for manager cc68ee02-979a-11ec-b5d1-0242ac110002, computing STANDALONE test_random_number0.9860114704767727 successfully
tensor's partition is 10
.using engines: {'computing': 'STANDALONE', 'federation': 'STANDALONE', 'storage': 'STANDALONE', 'federated_mode': 'SINGLE'}
create manager session cd50530a-979a-11ec-b5d1-0242ac110002
try to save session record for manager cd50530a-979a-11ec-b5d1-0242ac110002, computing STANDALONE test_random_number0.6220879309193029
save session record for manager cd50530a-979a-11ec-b5d1-0242ac110002, computing STANDALONE test_random_number0.6220879309193029 successfully
.
----------------------------------------------------------------------
Ran 2 tests in 1.583s
OK
there are 0 failed test 如果成功，螢幕顯示類似下方的語句:
there are 0 failed test 頁面通路
http://192.168.1.78:8080/#/login
user:admin
pass:admin 