7. Solo多机多节点部署

7. Solo多机多节点部署#

7.1. 准备工作#

所有的节点分离部署, 每台主机上有一个节点, 节点的分布如下表:

名称	IP	Hostname	组织机构
orderer	192.168.247.129	orderer.itcast.com	Orderer
peer0	192.168.247.141	peer0.orggo.com	OrgGo
peer1	192.168.247.142	peer1.orggo.com	OrgGo
peer0	192.168.247.131	peer0.orgcpp.com	OrgCpp
peer1	192.168.247.145	peer1.orgcpp.com	OrgCpp

下面的操作在任意一台主机上做都可以, 下面的例子中, 生成证书和创始块、通道文件操作是在 Orderer节点对应的主机上进行的。

7.1.1 准备工作 - 创建工作目录#

1
# N台主机需要创建一个名字相同的工作目录, 该工作目录名字自己定, 切记名字一定要相同
2
# 192.168.247.129
3
$ mkdir ~/testwork
4
# 192.168.247.141
5
$ mkdir ~/testwork
6
# 192.168.247.131
7
$ mkdir ~/testwork
8
# 192.168.247.142
9
$ mkdir ~/testwork
10
# 192.168.247.145
11
$ mkdir ~/testwork

7.1.2 生成组织节点和用户证书#

编写配置文件

1
# crypto-config.yaml -> 名字可以改, 一般起名为crypto-config.yaml
2

3
OrdererOrgs:
4
  # ---------------------------------------------------------------------------
5
  # Orderer
6
  # ---------------------------------------------------------------------------
7
  - Name: Orderer
8
    Domain: test.com
9
    Specs:
10
      - Hostname: orderer
11

12
PeerOrgs:
13
  # ---------------------------------------------------------------------------
14
  # Org1
15
  # ---------------------------------------------------------------------------
16
  - Name: OrgGo
17
    Domain: orggo.test.com
18
    EnableNodeOUs: false
19
    Template:
20
      Count: 2
21
    Users:
22
      Count: 1
23
  # ---------------------------------------------------------------------------
24
  # Org2: See "Org1" for full specification
25
  # ---------------------------------------------------------------------------
26
  - Name: OrgCpp
27
    Domain: orgcpp.test.com
28
    EnableNodeOUs: false
29
    Template:
30
      Count: 2
31
    Users:
32
      Count: 1

使用cryptogen生成证书

1
$ cryptogen generate --config=crypto-config.yaml

7.1.3 生成通道文件和创始块文件#

编写配置文件, 名字为 configtx.yaml, 该名字不能改, 是固定的.

1
# configtx.yaml -> 名字不能变
2
---
3
################################################################################
4
#
5
#   Section: Organizations
6
#
7
################################################################################
8
Organizations:
9
    - &OrdererOrg
10
        Name: OrdererOrg
11
        ID: OrdererMSP
12
        MSPDir: ./crypto-config/ordererOrganizations/test.com/msp
13

14
    - &OrgGo
15
        Name: OrgGoMSP
16
        ID: OrgGoMSP
17
        MSPDir: ./crypto-config/peerOrganizations/orggo.test.com/msp
18
        AnchorPeers:
19
            - Host: peer0.orggo.test.com
20
              Port: 7051
21

22
    - &OrgCpp
23
        Name: OrgCppMSP
24
        ID: OrgCppMSP
25
        MSPDir: ./crypto-config/peerOrganizations/orgcpp.test.com/msp
26
        AnchorPeers:
27
            - Host: peer0.orgcpp.test.com
28
              Port: 7051
29

30
################################################################################
31
#
32
#   SECTION: Capabilities
33
#
34
################################################################################
35
Capabilities:
36
    Global: &ChannelCapabilities
37
        V1_1: true
38
    Orderer: &OrdererCapabilities
39
        V1_1: true
40
    Application: &ApplicationCapabilities
41
        V1_2: true
42

43
################################################################################
44
#
45
#   SECTION: Application
46
#
47
################################################################################
48
Application: &ApplicationDefaults
49
    Organizations:
50

51
################################################################################
52
#
53
#   SECTION: Orderer
54
#
55
################################################################################
56
Orderer: &OrdererDefaults
57
    # Available types are "solo" and "kafka"
58
    OrdererType: solo
59
    Addresses:
60
        - orderer.test.com:7050
61
    BatchTimeout: 2s
62
    BatchSize:
63
        MaxMessageCount: 10
64
        AbsoluteMaxBytes: 99 MB
65
        PreferredMaxBytes: 512 KB
66
    Kafka:
67
        Brokers:
68
            - 127.0.0.1:9092
69
    Organizations:
70

71
################################################################################
72
#
73
#   Profile
74
#
75
################################################################################
76
Profiles:
77
    TwoOrgsOrdererGenesis:
78
        Capabilities:
79
            <<: *ChannelCapabilities
80
        Orderer:
81
            <<: *OrdererDefaults
82
            Organizations:
83
                - *OrdererOrg
84
            Capabilities:
85
                <<: *OrdererCapabilities
86
        Consortiums:
87
            SampleConsortium:
88
                Organizations:
89
                    - *OrgGo
90
                    - *OrgCpp
91
    TwoOrgsChannel:
92
        Consortium: SampleConsortium
93
        Application:
94
            <<: *ApplicationDefaults
95
            Organizations:
96
                - *OrgGo
97
                - *OrgCpp
98
            Capabilities:
99
                <<: *ApplicationCapabilities

通过命令configtxgen生成创始块和通道文件

1
# 我们先创建一个目录 channel-artifacts 存储生成的文件, 目的是为了和后边的配置文件模板的配置项保持一致
2
$ mkdir channel-artifacts
3
# 生成通道文件
4
$ configtxgen -profile TwoOrgsOrdererGenesis -outputBlock ./channel-artifacts/genesis.block
5
# 生成创始块文件
6
$ configtxgen -profile TwoOrgsChannel -outputCreateChannelTx ./channel-artifacts/channel.tx -channelID testchannel

7.2 部署 orderer 排序节点#

7.2.1 编写配置文件#

编写启动orderer节点容器使用的配置文件 - docker-compose.yaml

1
version: '2'
2

3
services:
4

5
  orderer.test.com:
6
    container_name: orderer.test.com
7
    image: hyperledger/fabric-orderer:latest
8
    environment:
9
      - CORE_VM_DOCKER_HOSTCONFIG_NETWORKMODE=testwork_default
10
      - ORDERER_GENERAL_LOGLEVEL=INFO
11
      - ORDERER_GENERAL_LISTENADDRESS=0.0.0.0
12
      - ORDERER_GENERAL_LISTENPORT=7050
13
      - ORDERER_GENERAL_GENESISMETHOD=file
14
      - ORDERER_GENERAL_GENESISFILE=/var/hyperledger/orderer/orderer.genesis.block
15
      - ORDERER_GENERAL_LOCALMSPID=OrdererMSP
16
      - ORDERER_GENERAL_LOCALMSPDIR=/var/hyperledger/orderer/msp
17
      # enabled TLS
18
      - ORDERER_GENERAL_TLS_ENABLED=true
19
      - ORDERER_GENERAL_TLS_PRIVATEKEY=/var/hyperledger/orderer/tls/server.key
20
      - ORDERER_GENERAL_TLS_CERTIFICATE=/var/hyperledger/orderer/tls/server.crt
21
      - ORDERER_GENERAL_TLS_ROOTCAS=[/var/hyperledger/orderer/tls/ca.crt]
22
    working_dir: /opt/gopath/src/github.com/hyperledger/fabric
23
    command: orderer
24
    volumes:
25
    - ./channel-artifacts/genesis.block:/var/hyperledger/orderer/orderer.genesis.block
26
    - ./crypto-config/ordererOrganizations/test.com/orderers/orderer.test.com/msp:/var/hyperledger/orderer/msp
27
    - ./crypto-config/ordererOrganizations/test.com/orderers/orderer.test.com/tls/:/var/hyperledger/orderer/tls
28
    networks:
29
        default:
30
          aliases:
31
            - testwork
32
    ports:
33
      - 7050:7050

注意的细节:

环境变量CORE_VM_DOCKER_HOSTCONFIG_NETWORKMODE=testwork_default的名字是当前目录名_default

7.2.2 启动orderer容器#

通过上面编写好的docker-compose配置文件就可以启动orderer容器了

1
$ docker-compose up -d
2
Creating network "testwork_default" with the default driver
3
Creating orderer.test.com ... done
4
# 检测是否启动成功
5
$ docker-compose  ps
6
      Name         Command   State           Ports
7
-----------------------------------------------------------
8
orderer.test.com   orderer   Up      0.0.0.0:7050->7050/tcp

7.3 部署 peer0.orggo 节点#

7.3.1 准备工作#

切换到peer0.orggo主机 - 192.168.247.141
进入到工作目录中:
Terminal window
```
1
$ cd ~/testwork
```

拷贝文件

将orderer节点所在宿主机上生成的crypto-config和channel-artifacts目录拷贝到当前testwork目录中。

我们可以通过scp命令实现远程拷贝, 从orderer节点宿主机拷贝到当前peer0.orggo节点.

orderer节点宿主机IP: 192.168.247.129, 登录用户名: itcast

1
# 通过scp命令远程拷贝
2
# -r : 表示要拷贝的是目录, 执行递归操作
3
#   itcast@192.168.247.129: 从192.168.247.129上拷贝数据, 登录用户名为itcast
4
#   /home/itcast/testwork/channel-artifacts: 要拷贝192.168.247.129上itcast用户的哪个目录
5
#   ./ : 远程目录拷贝到本地的什么地方
6
$ scp -r itcast@192.168.247.129:/home/itcast/testwork/channel-artifacts  ./
7
$ scp -r itcast@192.168.247.129:/home/itcast/testwork/crypto-config  ./
8
# 查看拷贝结果
9
$ tree ./ -L 1
10
.
11
├── channel-artifacts
12
└── crypto-config

7.3.2 编写配置文件#

编写启动 peer0-orggo节点的配置文件 - docker-compose.yaml

1
version: '2'
2

3
services:
4
  peer0.orggo.test.com:
5
    container_name: peer0.orggo.test.com
6
    image: hyperledger/fabric-peer:latest
7
    environment:
8
      - CORE_VM_ENDPOINT=unix:///host/var/run/docker.sock
9
      - CORE_VM_DOCKER_HOSTCONFIG_NETWORKMODE=testwork_default
10
      - CORE_LOGGING_LEVEL=INFO
11
      #- CORE_LOGGING_LEVEL=DEBUG
12
      - CORE_PEER_GOSSIP_USELEADERELECTION=true
13
      - CORE_PEER_GOSSIP_ORGLEADER=false
14
      - CORE_PEER_PROFILE_ENABLED=true
15
      - CORE_PEER_LOCALMSPID=OrgGoMSP
16
      - CORE_PEER_ID=peer0.orggo.test.com
17
      - CORE_PEER_ADDRESS=peer0.orggo.test.com:7051
18
      - CORE_PEER_GOSSIP_BOOTSTRAP=peer0.orggo.test.com:7051
19
      - CORE_PEER_GOSSIP_EXTERNALENDPOINT=peer0.orggo.test.com:7051
20
      # TLS
21
      - CORE_PEER_TLS_ENABLED=true
22
      - CORE_PEER_TLS_CERT_FILE=/etc/hyperledger/fabric/tls/server.crt
23
      - CORE_PEER_TLS_KEY_FILE=/etc/hyperledger/fabric/tls/server.key
24
      - CORE_PEER_TLS_ROOTCERT_FILE=/etc/hyperledger/fabric/tls/ca.crt
25
    volumes:
26
      - /var/run/:/host/var/run/
27
      - ./crypto-config/peerOrganizations/orggo.test.com/peers/peer0.orggo.test.com/msp:/etc/hyperledger/fabric/msp
28
      - ./crypto-config/peerOrganizations/orggo.test.com/peers/peer0.orggo.test.com/tls:/etc/hyperledger/fabric/tls
29
    working_dir: /opt/gopath/src/github.com/hyperledger/fabric/peer
30
    command: peer node start
31
    networks:
32
      default:
33
        aliases:
34
          - testwork
35
    ports:
36
      - 7051:7051
37
      - 7053:7053
38
    extra_hosts:  # 声明域名和IP的对应关系
39
      - "orderer.test.com:192.168.247.129"
40
      - "peer0.orgcpp.test.com:192.168.247.131"
41

42
  cli:
43
    container_name: cli
44
    image: hyperledger/fabric-tools:latest
45
    tty: true
46
    stdin_open: true
47
    environment:
48
      - GOPATH=/opt/gopath
49
      - CORE_VM_ENDPOINT=unix:///host/var/run/docker.sock
50
      #- CORE_LOGGING_LEVEL=DEBUG
51
      - CORE_LOGGING_LEVEL=INFO
52
      - CORE_PEER_ID=cli
53
      - CORE_PEER_ADDRESS=peer0.orggo.test.com:7051
54
      - CORE_PEER_LOCALMSPID=OrgGoMSP
55
      - CORE_PEER_TLS_ENABLED=true
56
      - CORE_PEER_TLS_CERT_FILE=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orggo.test.com/peers/peer0.orggo.test.com/tls/server.crt
57
      - CORE_PEER_TLS_KEY_FILE=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orggo.test.com/peers/peer0.orggo.test.com/tls/server.key
58
      - CORE_PEER_TLS_ROOTCERT_FILE=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orggo.test.com/peers/peer0.orggo.test.com/tls/ca.crt
59
      - CORE_PEER_MSPCONFIGPATH=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orggo.test.com/users/Admin@orggo.test.com/msp
60
    working_dir: /opt/gopath/src/github.com/hyperledger/fabric/peer
61
    command: /bin/bash
62
    volumes:
63
        - /var/run/:/host/var/run/
64
        - ./chaincode/:/opt/gopath/src/github.com/chaincode
65
        - ./crypto-config:/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/
66
        - ./channel-artifacts:/opt/gopath/src/github.com/hyperledger/fabric/peer/channel-artifacts
67
    depends_on:   # 启动顺序
68
      - peer0.orggo.test.com
69

70
    networks:
71
        default:
72
          aliases:
73
            - testwork
74
    extra_hosts:
75
      - "orderer.test.com:192.168.247.129"
76
      - "peer0.orggo.test.com:192.168.247.141"
77
      - "peer0.orgcpp.test.com:192.168.247.131"

7.3.3 启动容器#

启动容器

1
$ docker-compose up -d
2
Creating network "testwork_default" with the default driver
3
Creating peer0.orgGo.test.com ... done
4
Creating cli                  ... done
5
# 查看启动状态
6
$ docker-compose ps
7
        Name               Command       State                       Ports
8
-----------------------------------------------------------------------------------------------
9
cli                    /bin/bash         Up
10
peer0.orgGo.test.com   peer node start   Up      0.0.0.0:7051->7051/tcp, 0.0.0.0:7053->7053/tcp

7.3.4 对peer0.orggo节点的操作#

进入到客户端容器中
Terminal window
```
1
$ docker exec -it cli bash
```

创建通道

1
$ peer channel create -o orderer.test.com:7050 -c testchannel -f ./channel-artifacts/channel.tx --tls true --cafile /opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/ordererOrganizations/test.com/msp/tlscacerts/tlsca.test.com-cert.pem
2
$ ls
3
channel-artifacts  crypto  `testchannel.block`  --> 生成的通道块文件

将当前节点加入到通道中
Terminal window
```
1
$ peer channel join -b testchannel.block
```

安装链码

1
$ peer chaincode install -n testcc -v 1.0 -l golang -p github.com/chaincode

初始化链码

1
$ peer chaincode instantiate -o orderer.test.com:7050 --tls true --cafile /opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/ordererOrganizations/test.com/msp/tlscacerts/tlsca.test.com-cert.pem -C testchannel -n testcc -v 1.0 -l golang -c '{"Args":["init","a","100","b","200"]}' -P "AND ('OrgGoMSP.member', 'OrgCppMSP.member')"

查询

1
$ peer chaincode query -C testchannel -n testcc -c '{"Args":["query","a"]}'
2
$ peer chaincode query -C testchannel -n testcc -c '{"Args":["query","b"]}'

将生成的通道文件 testchannel.block 从cli容器拷贝到宿主机

1
# 从客户端容器退出到宿主机
2
$ exit
3
# 拷贝操作要在宿主机中进行
4
$ docker cp cli:/opt/gopath/src/github.com/hyperledger/fabric/peer/testchannel.block ./

7.4 部署 peer0.orgcpp 节点#

7.4.1 准备工作#

切换到peer0.orgcpp主机 - 192.168.247.131
进入到工作目录
Terminal window
```
1
$ cd ~/testwork
```

远程拷贝文件

1
# 从主机192.168.247.141的zoro用户下拷贝目录crypto-config到当前目录下
2
$ scp -r zoro@192.168.247.141:/home/zoro/testwork/crypto-config  ./
3
# 链码拷贝
4
$ scp -r zoro@192.168.247.141:/home/zoro/testwork/chaincode  ./
5
# 从主机192.168.247.141的zoro用户下拷贝文件testchannel.block到当前目录下
6
$ scp zoro@192.168.247.141:/home/zoro/testwork/testchannel.block  ./
7
# 查看结果
8
$ tree ./ -L 1
9
./
10
├── chaincode
11
├── crypto-config
12
└── testchannel.block

为了方便操作可以将通道块文件放入到客户端容器挂载的目录中
Terminal window
```
1
# 创建目录
2
$ mkdir channel-artifacts
3
# 移动
4
$ mv testchannel.block channel-artifacts/
```

7.4.2 编写配置文件#

编写启动peer0.orgcpp节点的配置文件 docker-compose.yaml

1
version: '2'
2
services:
3
    peer0.orgcpp.test.com:
4
      container_name: peer0.orgcpp.test.com
5
      image: hyperledger/fabric-peer:latest
6
      environment:
7
        - CORE_VM_ENDPOINT=unix:///host/var/run/docker.sock
8
        - CORE_VM_DOCKER_HOSTCONFIG_NETWORKMODE=testwork_default
9
        - CORE_LOGGING_LEVEL=INFO
10
        #- CORE_LOGGING_LEVEL=DEBUG
11
        - CORE_PEER_GOSSIP_USELEADERELECTION=true
12
        - CORE_PEER_GOSSIP_ORGLEADER=false
13
        - CORE_PEER_PROFILE_ENABLED=true
14
        - CORE_PEER_LOCALMSPID=OrgCppMSP
15
        - CORE_PEER_ID=peer0.orgcpp.test.com
16
        - CORE_PEER_ADDRESS=peer0.orgcpp.test.com:7051
17
        - CORE_PEER_GOSSIP_BOOTSTRAP=peer0.orgcpp.test.com:7051
18
        - CORE_PEER_GOSSIP_EXTERNALENDPOINT=peer0.orgcpp.test.com:7051
19
        # TLS
20
        - CORE_PEER_TLS_ENABLED=true
21
        - CORE_PEER_TLS_CERT_FILE=/etc/hyperledger/fabric/tls/server.crt
22
        - CORE_PEER_TLS_KEY_FILE=/etc/hyperledger/fabric/tls/server.key
23
        - CORE_PEER_TLS_ROOTCERT_FILE=/etc/hyperledger/fabric/tls/ca.crt
24
      volumes:
25
        - /var/run/:/host/var/run/
26
        - ./crypto-config/peerOrganizations/orgcpp.test.com/peers/peer0.orgcpp.test.com/msp:/etc/hyperledger/fabric/msp
27
        - ./crypto-config/peerOrganizations/orgcpp.test.com/peers/peer0.orgcpp.test.com/tls:/etc/hyperledger/fabric/tls
28
      working_dir: /opt/gopath/src/github.com/hyperledger/fabric/peer
29
      command: peer node start
30
      networks:
31
        default:
32
          aliases:
33
            - testwork
34
      ports:
35
        - 7051:7051
36
        - 7053:7053
37
      extra_hosts:  # 声明域名和IP的对应关系
38
        - "orderer.test.com:192.168.247.129"
39
        - "peer0.orggo.test.com:192.168.247.141"
40

41
    cli:
42
      container_name: cli
43
      image: hyperledger/fabric-tools:latest
44
      tty: true
45
      stdin_open: true
46
      environment:
47
        - GOPATH=/opt/gopath
48
        - CORE_VM_ENDPOINT=unix:///host/var/run/docker.sock
49
        #- CORE_LOGGING_LEVEL=DEBUG
50
        - CORE_LOGGING_LEVEL=INFO
51
        - CORE_PEER_ID=cli
52
        - CORE_PEER_ADDRESS=peer0.orgcpp.test.com:7051
53
        - CORE_PEER_LOCALMSPID=OrgCppMSP
54
        - CORE_PEER_TLS_ENABLED=true
55
        - CORE_PEER_TLS_CERT_FILE=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orgcpp.test.com/peers/peer0.orgcpp.test.com/tls/server.crt
56
        - CORE_PEER_TLS_KEY_FILE=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orgcpp.test.com/peers/peer0.orgcpp.test.com/tls/server.key
57
        - CORE_PEER_TLS_ROOTCERT_FILE=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orgcpp.test.com/peers/peer0.orgcpp.test.com/tls/ca.crt
58
        - CORE_PEER_MSPCONFIGPATH=/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/peerOrganizations/orgcpp.test.com/users/Admin@orgcpp.test.com/msp
59
      working_dir: /opt/gopath/src/github.com/hyperledger/fabric/peer
60
      command: /bin/bash
61
      volumes:
62
          - /var/run/:/host/var/run/
63
          - ./chaincode/:/opt/gopath/src/github.com/chaincode
64
          - ./crypto-config:/opt/gopath/src/github.com/hyperledger/fabric/peer/crypto/
65
          - ./channel-artifacts:/opt/gopath/src/github.com/hyperledger/fabric/peer/channel-artifacts
66
      depends_on:   # 启动顺序
67
        - peer0.orgcpp.test.com
68

69
      networks:
70
          default:
71
            aliases:
72
              - testwork
73
      extra_hosts:
74
        - "orderer.test.com:192.168.247.129"
75
        - "peer0.orggo.test.com:192.168.247.141"
76
        - "peer0.orgcpp.test.com:192.168.247.131"

注意: 该配置文件中已经将映射删掉了

7.4.3 启动当前节点#

启动客户端容器

1
$ docker-compose up -d
2
Creating network "testwork_default" with the default driver
3
Creating peer0.orgcpp.test.com ... done
4
Creating cli                   ... done
5
# 查看启动情况
6
$ docker-compose ps
7
        Name                Command       State                       Ports
8
------------------------------------------------------------------------------------------------
9
cli                     /bin/bash         Up
10
peer0.orgcpp.test.com   peer node start   Up      0.0.0.0:7051->7051/tcp, 0.0.0.0:7053->7053/tcp

7.4.4 对peer0.orgcpp节点的操作#

进入到操作该节点的客户端中
Terminal window
```
1
$ docker exec -it cli bash
```

加入到通道中

1
$ peer channel join -b ./channel-artifacts/testchannel.block