WO2012126352A1

WO2012126352A1 - Method, device and system for transmitting messages on pcie bus

Info

Publication number: WO2012126352A1
Application number: PCT/CN2012/072608
Authority: WO
Inventors: 孟健; 王雨晨; 刘利锋
Original assignee: 成都市华为赛门铁克科技有限公司
Priority date: 2011-03-23
Filing date: 2012-03-20
Publication date: 2012-09-27
Also published as: CN102694717A; CN102694717B

Abstract

Provided are a method, device and system for transmitting messages on a PCIE bus. The method includes: a protocol message preset by a start-end device processes a preset protocol message and obtains a preset protocol message; after obtaining the ID of the PCIE device of a target-end device, carries the preset protocol message in a PCIE protocol message, and sends the PCIE protocol message to the target-end device via a PCIE bus, so that the target-end device parses the preset protocol message from the PCIE protocol message and then executes a corresponding operation according to an instruction in the preset protocol message; the start-end device, the target-end device and the third party device are interconnected via the PCIE bus. The solution provided in the embodiments of the present invention has high bandwidth for data transmission, quick processing speed, good universality and low cost.

Description

Method, device and system for transmitting messages on PCIE bus This application claims to be filed on March 23, 2011 with the Chinese Patent Office, application number 201110070778.6, and the invention name is "Method, device and system for transmitting messages on PCIE bus" The priority of the Chinese Patent Application, the entire contents of which is incorporated herein by reference. Technical field

The embodiments of the present invention relate to the field of communications technologies, and in particular, to a method, device, and system for transmitting a message on a Peripheral Component Interconnect Express (PCIE) bus. Background technique

PCIE is the latest bus and interface standard. This new standard will completely replace the current Peripheral Component Interconnection (PCI) standard and the Accelerated Graphics Port (AGP), which will eventually achieve the unification of the bus standard. The main advantage of PCIE is the high data transfer rate. The current highest 16X 2.0 version can reach 16GB/S, and there is considerable potential for development. As a board-level interactive protocol, PCIE performs communication between applications, CPUs, and PCIE devices (such as NICs, SCSI HBAs, FC-HBAs, etc.). At the same time, it can also be used as a system-level interactive protocol.

The Fibre Channel (FC) protocol is commonly used to communicate between servers and storage devices on a storage area network. Fibre Channel is based on FC-based link control and physical layer protocols. The main features of Fibre Channel are hot-swappable. High-speed bandwidth, remote connection, large number of connected devices, etc. Generally, the medium used for the service is fiber-optic cable and copper cable. However, FC equipment is expensive, but the fiber-optic channel using copper-axis cable has the same problem as copper medium. Such as short transmission distance (30 meters, depending on the specific cable) and susceptible to electromagnetic interference (EMI), and the current 8Gb/s rate of Fibre Channel is beginning to be compared with the maximum rate of PCIE. A big gap can't get a better data transfer rate. Summary of the invention

The embodiment of the invention provides a method, a device and a system for transmitting a message on a PCIE bus, so as to directly transmit a preset protocol message on a PCIE bus;

The method for transmitting a message on an external component high-speed interconnect PCIE bus according to an embodiment of the present invention includes:

The initiating device obtains a preset protocol packet.

After the PCIE device ID of the target device is obtained, the preset protocol packet is carried in the PCIE protocol packet, and the PCIE protocol packet is sent to the target through the PCIE bus. And the end device, after the target end device parses the preset protocol packet from the PCIE protocol packet, and performs a corresponding operation according to the instruction of the preset protocol packet, where the start end The device and the target device are interconnected by a third party device through a PCIE bus.

The device for transmitting a message on an external component high-speed interconnect PCIE bus according to an embodiment of the present invention includes:

The encapsulating module is configured to encapsulate a protocol packet preset by the Fibre Channel to obtain a preset protocol packet.

The transceiver module is configured to carry the preset protocol packet in the PCIE protocol packet, and send the PCIE protocol packet to the target device through the PCIE bus, so that the target device parses the PCIE protocol packet. After the preset protocol packet, the corresponding operation is performed according to the instruction of the preset protocol packet; the parsing module is configured to parse the preset protocol packet from the PCIE protocol packet;

The execution module is configured to perform an operation according to the instruction of the preset protocol message.

The method, the device and the system for transmitting a message on the PCIE bus provided by the embodiment of the present invention enable the storage system using the FC protocol to be interconnected through the PCIE bus, so that any device connected to each other through the PCIE bus can pass the pre-preparation The protocol packets are configured to perform mutual operations, and can utilize the existing functional advantages and management tools of the FC protocol, and have high data transmission bandwidth and fast processing speed, and can be used in a multi-host cluster computing system with full PCIE connection, computing nodes and The storage node is interconnected based on the FC protocol. DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flowchart of a method for transmitting a message on a PCIE bus according to an embodiment of the present invention; FIG. 2 is a flowchart of a method for transmitting a message on a PCIE bus according to an embodiment of the present invention; A schematic structural diagram of an apparatus for transmitting a message on a PCIE bus provided by an embodiment;

4 is a schematic structural diagram of an apparatus for transmitting a message on a PCIE bus according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a system for transmitting a message on a PCIE bus according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic structural diagram of a start device according to an embodiment of the present invention;

Figure Ί is a schematic structural diagram of a third-party device provided by an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a target device according to an embodiment of the present invention. The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. The embodiments are a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

1 is a flowchart of a method for transmitting a message on a PCIE bus according to an embodiment of the present invention. The method is applied to a network consisting of devices connected to each other through a PCIE bus, where the device includes a start device and a target device. And third party equipment. The method encapsulates the packets of some predetermined protocols that are exchanged between the devices in the CPIE protocol packet, and transmits the packets through the PCIE bus. Thereby increasing the data transmission bandwidth and processing speed. The method of transmitting a message on the PCIE bus provided by the embodiment of the present invention will be described below by taking the registration process or the process of establishing a virtual link as an example. It should be noted that the solution is also applicable to other scenarios.

As shown in Figure 1, the method includes:

Step 101: The initiating device acquires the packet of the first preset protocol.

The embodiment of the present invention may carry preset protocol packets in the foregoing according to specific service types.

In the processing layer protocol of the PCIE protocol, the TLP packet obtains the FC-TLP protocol, wherein the FC-TLP protocol packet is in the FC-TLP frame format, and the preset protocol packet is the FC protocol packet;

That is, the initiating device encapsulates the packet of the first preset protocol in the TLP payload portion of the PCIE packet.

Step 102: After acquiring the PCIE device ID of the target device, the initiating device carries the packet of the first preset protocol in a PCIE protocol packet, and sends the PCIE protocol packet through the PCIE bus. And the target device is configured to perform the corresponding operation according to the instruction of the preset protocol packet, after the target end device parses the preset protocol packet from the PCIE protocol packet, where The start device and the target device are interconnected by a third party device through a PCIE bus.

The third-party device in this embodiment may be a specific network management device in the link. The preset protocol packet in this embodiment is an FC protocol packet or an FCoPIP protocol. Specifically, in this embodiment, the first preset protocol refers to an FC-TLP, and the second preset protocol refers to FCoPIP;

The "carrying" in this embodiment is also referred to as "encapsulation" in the field, and actually refers to an approach of mapping FCoPIP protocol packets or FC protocol packets into a form conforming to PCIE protocol packets.

The preset protocol packet can be carried in the Transaction Layer Protocol (TLP) packet of the PCIE. The format of the PCIE protocol packet provided by the embodiment of the present invention is as shown in Table 1 in the specific location of the protocol packet. Table 1

The definition of each field is as follows:

The frame start identifier indicates the beginning of a data frame;

DLLP header, used for link management functions, including physical layer flow control, the main responsibility is to ensure reliable and correct transmission of data packets and ensure the integrity of data packets;

TLP header, for processing transactions such as read and write requests of upper-layer applications;

The TLP packet is the Ethernet-TLP packet described in the embodiment of the present invention;

ECRC, which refers to the end-to-end Cyclic Redundancy Check (CRC), where CRC is the most commonly used error check code in the field of data communication;

LCRC, which refers to the CRC of the data link layer, is based on the sequence identifier (ID, IDentity) and the CRC field of all bytes of the TLP;

The end of frame indicator indicates the end of a data frame.

For details of the components in the above PCIE data packet, refer to the PCIE protocol, which is not described here. Specifically, in order for the head end device to communicate directly with the target end device, it is necessary to establish a Fibre Channel virtual link before the start end device and the target end device. during this process:

The initiating device carries the registration information server request information of the first preset protocol in the PCIE protocol packet, and sends the information to the third-party device through the PCIE bus, and receives the first pre-received in the PCIE protocol packet returned by the third-party device. a third request response information of the protocol, where the third request response information carries a PCIE device ID of the target device;

The initiating device carries the port registration request information of the first preset protocol in a PCIE protocol packet according to the PCIE device ID of the target device that is obtained from the third request response information, and sends the information through the PCIE bus. Giving the target device, and receiving the fourth request response information of the first preset protocol carried in the PCIE protocol packet returned by the target device, thereby establishing the target device Fibre Channel virtual link between. Before the process of establishing a Fibre Channel virtual link between the initiating device and the target device shown in Figure 1, the registration process in the PCIE network can also be performed as follows: The registration process of the initiating device is as follows:

The initiating device carries the device discovery request of the second preset protocol in the PCIE protocol packet, and sends the packet through the PCIE bus, and receives the first preset of the second preset protocol that is returned by the third-party device and is carried in the PCIE protocol packet. Requesting response information, where the first request response information carries a PCIE device ID of a third-party device;

The initiating device carries the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and sends the information to the third-party device through the PCIE bus, where the virtual link instance is sent. The request information carries the PCIE device ID of the initiating device; and receives the second request response information of the second preset protocol that is carried in the PCIE protocol packet returned by the third device, thereby registering the initiating device in the third party device. .

Similarly, the target device can also adopt a similar registration process, as follows:

The target device carries the device discovery request of the second preset protocol in the PCIE protocol packet, and sends the packet through the PCIE bus, and receives the first preset of the second preset protocol that is carried in the PCIE protocol packet corresponding to the third-party device. Requesting response information, where the first request response information carries a PCIE device ID of a third-party device;

The target device carries the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and sends the information to the third-party device through the PCIE bus, where the virtual link instance is sent. The request information carries the PCIE device ID of the target device; and receives the second request response information of the second preset protocol that is carried in the PCIE protocol packet returned by the third device, thereby registering the target device in the third party device. .

The packet carrying the second preset protocol is carried in the PCIE packet, and is specifically:

And the FCoPIP-TLP protocol packet is an FCoPIP-TLP frame format, where the preset protocol packet is carried in the processing layer protocol TLP packet of the PCIE protocol packet, where the FCoPIP-TLP protocol packet is an FCoPIP-TLP frame format, where The preset protocol is FCoPIP (FC over PCIE initialization protocol) Protocol message. That is, the device discovery request of the FCoPIP-TLP packet is encapsulated in the TLP payload part of the PCIE packet, or the virtual link instantiation request information of the FCoPIP-TLP packet is encapsulated in the PCIE packet. TLP load section.

It should be noted that, in addition to the scenario shown in FIG. 1 , there are various situations in which the initiating device encapsulates the preset protocol packet and carries it in the PCIE protocol packet, for example, a computer application or a CPU. If you want to read or write a device through the PCIE bus, the read and write requests are converted to FC read and write commands and encapsulated, and then carried in the PCIE protocol packets. Alternatively, when a device connected to the computer through the PCIE bus receives a request message sent by the computer through the PCIE bus, and the device needs to return a request response message, the device converts the request response message into the protocol report of the embodiment of the present invention. The packet is encapsulated and then carried in the PCIE protocol packet.

The method for transmitting a message on the PCIE bus provided by the embodiment of the present invention enables any device connected to each other through the PCIE bus to perform mutual operation through preset protocol messages, and the data transmission bandwidth is high and processed. Fast, can be used in a multi-host cluster computing system with full PCIE connectivity. The compute nodes and storage nodes are interconnected based on the FC protocol. 2 is a flowchart of a method for encapsulating a preset protocol packet in the embodiment of the present invention. In this embodiment, before the PCIE device ID of the target device is obtained, the preset protocol is carried. In the PCIE protocol text:

First, in step 1010, the initiating device, and/or the target device sends a device discovery request, to obtain a PCIE device ID of the third device, for example, the device discovery request is an FCoPIP-TLP packet, and the device discovery request corresponds to the FCoPIP. The values of some fields that can be included in the Encapsulated FCoPIP operation section of the TLP 4 are shown in Table 1.

Table 1

PCIE Device ID

The FC WWN MAX Size and the like, wherein the FCoPIP Protocol Code is 000 lh indicates that the device finds that when the Subcode is Olh, the service type Operation is Discovery Solicitation, and the service content Contents of Operation includes the PCIE Device ID, and the FC global unique name (world) Information such as wide name, WWN, and MAX Size; when the subcode is 02h, the service type is Discovery Advertisement, and the content of the service content is the Priority. Optionally, the service content also includes the PCIE Device ID. , FC WWN, MAX Size, etc. The MAX size indicates the size of the packet that the initiating device can receive. The priority indicates the priority of the third-party device. There may be multiple third-party devices on the PCIE link. In this case, there are multiple third-party devices. The first request response message is returned, and the priority in the first request response information may be used as a reference, so that the third party device with higher priority identifier in the first request response information is preferably used.

Specifically, the initiating device needs to send the device discovery request information in the PCIE link, where the device discovery request information carries the Fibre Channel protocol parameters required for communication between the initiating device and the target device. The device discovery request information may be sent by broadcast or multicast on the PCIE link, and the first request response information returned by the third-party device may be received.

Step 1011: The initiating device, and/or the target device receives the first request response information returned by the third device, where the first request response information carries the PCIE device ID of the third device. . It should be noted that, in this embodiment, the first request response information may be the foregoing Discovery Solicitation, indicating a device discovery request;

Certainly, the embodiment of the present invention may obtain the PCIE device ID of the third-party device by using other methods. For example, in the FCoPIP-TLP protocol packet, the field that encapsulates the Subcode is 02h indicates the Discovery Advertisement. Publish your own PCIE device ID to other devices on the PCIE link.

It should be noted that, in the foregoing step 1010, when the originating device or the target device sends the device discovery request information, and the third party device sends the first request response information in step 1011, Sent as follows:

The device discovery request information or the first request response information in the FCoPIP-TLP packet format is encapsulated in the TLP payload part of the PCIE packet, and then the encapsulated PCIE packet is sent to the peer device.

Step 1012: The start device, and/or the target device obtains the PCIE device ID of the third device, and sends the virtual link instantiation request information to the third device according to the PCIE device ID of the third device, and/or receives The second request response information returned by the third-party device on the PCIE link.

The virtual link instantiation request information may be a virtual link instantiation request, for example, the FCoPIP-TLP protocol carrying the FLOGI message may be carried in the TLP packet of the PCIE protocol packet;

The above virtual link instantiation request information is also referred to as virtual link initialization request information.

The second request response information may be a Virtual Link Instantiation Reply, indicating that the second request response information is a virtual link instantiation response, for example, the FCoPIP-TLP protocol packet carrying the FLOGI response message may be carried in the PCIE protocol report. In the TLP package;

In this embodiment, the virtual link instantiation request information is sent to the third-party device according to the PCIE device ID of the third-party device, and the second request response information returned by the third-party device on the PCIE link is received, which may include:

The initiating device runs the query query command in the device, and can query the device ID of the device. After the PCIE device ID of the initiating device is queried, the PCIE device ID of the initiating device is carried in the virtual link instantiation request. In the information, in the embodiment, the PCIE device ID of the initiating device is carried in the FCoPIP-TLP protocol packet, and the virtual link instantiation request information is sent to the third-party device, and the PCIE link is received. The second request response information returned by the three-way device;

A person skilled in the art may understand that, in this embodiment, after the target device queries the PCIE device ID of the third-party device, the virtual link instance is sent to the third-party device according to the PCIE device ID of the third-party device. Information and receiving second request response information returned by the third party device on the PCIE link;

The PCIE device ID of the target device is encapsulated in the FCoPIP-TLP protocol packet, and the virtual link instantiation request information is sent to the third-party device, and the third-party device on the PCIE link is received. The second request response information returned.

It should be noted that, when the initial device or the target device sends the virtual link instantiation request information and the third party device sends the second request response information in step 1012, the method is as follows:

The virtual link instantiation request information or the second request response information in the FCoPIP-TLP packet format is encapsulated in the TLP payload part of the PCIE packet, and then the encapsulated PCIE packet is sent to the peer device. .

In this embodiment, the virtual link instantiation request information is a protocol packet in the FCoPIP-TLP frame format, which is used to implement initialization of the link and the device, and the FCoPIP-TLP corresponding to the virtual link instantiation request information is Encapsulated FCoPIP. The values of some fields that can be included in the operation section are shown in Table 2:

Table 2

The FCoPIP Protocol Code is 0002h, and the link and the device are instantiated. When the Subcode is Olh, the service type is the virtual link instantiation request, and the service content Contents of Operation includes the FC FLOGI message and the start end. The PCIE device ID of the device; the Subcode is 02h, indicating that the service type is a Virtual Link Instantiation Reply, that is, the response of the virtual link instance request information, that is, the second request response information according to the embodiment of the present invention, the service content Contents of The Operation includes an FC FLOGI response message. For example, the FC FLOGI response message may specifically be response information for structural registration information such as a Fabric login.

Step 1013: After the third-party device returns the second request response information, the device (the originating device, and/or the target device) that sends the virtual link instantiation request information is assigned a Fibre Channel port ID, and is in a third party. The assigned Fibre Channel port ID is recorded in the device. Specifically, if the device that sends the virtual link instantiation request information is the start device, the Fibre Channel port ID allocated to the start device is recorded, and optionally, the fiber of the start device is also recorded. Other information such as channel protocol parameters. If the device that sends the virtual link instantiation request information is a target device, record the Fibre Channel port ID assigned to the target device.

Optionally, other information such as a Fibre Channel protocol parameter of the target device may also be recorded. The Fibre Channel port ID is an address identifier uniquely associated with the device determined in the routing configuration. In the above steps 1010 to 1013, when the two parties exchange messages, the format of the FCoPIP-TLP message corresponding to each request information or response information is as shown in Table 3.

The format of the FCoPIP-TLP protocol packet provided by the embodiment of the present invention is shown in Table 3.

10 Table 3

The Type field indicates the type of the data frame of the preset protocol packet. For example, the FCoPIP_T YPE indicates that the protocol packet is a protocol packet in the FCoPIP-TLP frame format. Version indicates the version, and Reserved indicates the reservation. The Encapsulated FC Frame (n words) indicates the specific content of the encapsulation. When the type of the FCoPIP_TYPE is 15 Type=FCoPIP_TYPE, the protocol packet type of the preset is the FCoPIP-TLP protocol packet.

The specific fields and fields of the Encapsulated FCoPIP operation part of the FCoPIP-TLP protocol packet provided in the embodiment of the present invention are as shown in Table 3.1, and the FCoPIP Protocol Code, for example, can be referred to. As shown in Table 2, if the value is 20 0002h, it means that the link and device are instantiated; Contents of Operation can be FC FLOGI message and PCIE Device ID in Table 2.

Form 3.1 Byte 0 1 2 3

0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7

0 FCoPIP Protocol Code Reserved Subcode

1 Contents Length Reserved

2

12 Contents of Operation

16

N Step 1014: The initiating device sends the registration name server request information to the third-party device to obtain the PCIE device ID of the target device.

Specifically, the initiating device sends a registration name server request to the third-party device to query the PCIE device ID of the target device, where the registration name server request carries the world wide name (WWN) of the target device.

The initiating device receives the third request response information (registered name server response) corresponding to the third party device, where the third request response information carries the PCIE device ID of the target device. The PCIE device ID of each of the head device and the target device stored in the third-party device is obtained. Please refer to Table 2.

The above-mentioned registration name server request and the third request response information are FC-TLP packets, which are encapsulated in the TLP payload part of the PCIE packet, and then the encapsulated PCIE packet is sent to the peer device.

Step 1015: The initiating device sends the port registration request information to the target device by using the obtained PCIE device ID of the target device, for example, may send the PLOGI information, and after receiving the fourth request response information returned by the target device, The start device and the target device complete the establishment of the Fibre Channel virtual link and communicate data through the Fibre Channel virtual link. The fourth request response information may also be regarded as a setup completion response information of the Fibre Channel virtual link. The port registration request information is specifically an FC-TLP protocol packet.

It should be noted that, in the foregoing step 1014, the initiating device sends a registration name server request to the third party device, and the third party device correspondingly returns the third request response information, and the step 4 is gathered from 1015. When the start device sends the port registration request information to the target device and the target device returns the fourth request response information, the device sends the following information:

Encapsulating the registration name server request, the third request response information, the port registration request information, or the fourth request response information in the FC-TLP packet format in a TLP payload portion in the PCIE packet; and sending the PCIE packet Give the peer device.

As shown in Table 4, the definition of each field in an FC-TLP protocol packet format: Table 4

The Type field indicates the type of the encapsulated data frame, and the FCoP_TYPE indicates that the protocol packet is the protocol of the FC-TLP frame format. Version indicates the version, and Reserved indicates the reservation.

Encapsulated FC Frame (n words) indicates the specific content of the package.

Optionally, the foregoing step 1010 1010, the start device and the target device end complete the establishment process of the Fibre Channel virtual link between the start device and the target device, and thereafter, the Fibre Channel virtual link may also be On the road, send link maintenance information, specifically:

In the above step, after the initiating device receives the fourth request response information returned by the target device, the initiating device and/or the target device determines that the link maintenance information may be sent when the link maintenance period arrives. The link maintenance information includes the PCIe device ID and Fibre Channel port ID of the initiator device and the target device.

It should be noted that, similar to the discovery request information and the virtual link instantiation request information in steps 1010 to 1012, the link maintenance information is also in the FCoPIP-TLP packet format and is sent by: The link maintenance information of the FCoPIP-TLP packet format is encapsulated in the TLP payload part of the PCIE packet, and then the encapsulated PCIE packet is sent to the peer device.

The specific examples are as follows: Table 5 is the value of some fields that can be included in the Encapsulated FCoPIP operation part of the FCoPIP-TLP packet sent by the initiating device and the target device. For the arrangement of each field, please refer to Table 3.1, which will not be repeated here.

table 5

In the embodiment of the present invention, the start device and the target device can send link maintenance information on the PCIE link, so that other devices on the PCIE link can learn the survival status of the start device and the target device. .

In this embodiment, for example, the FCoPIP Protocol Code in the FCoPIP-TLP packet format is 0003h, where, as shown in the above table, when the Subcode is Olh, the service type is Keep Alive; the service content carries the FC. The N_Port ID and the PCIE Device ID; wherein, when the Subcode is 02h, the service type is Clear Virtual Links, and the service content carries the FC N_Port ID, the PCIE Device ID, and the FC WWN; the link maintenance information is the encapsulated information. The FCoPIP is carried in the processing layer protocol TLP packet of the PCIE protocol packet.

The Keep Alive is used to indicate that the originating device or the target device that sends the Keep Alive message is still alive; Clear virtual links is used by the third-party device to detect whether the originating device or the target device does not exist on the PCIE link. For example, if the device fails, or the device function is turned off, the device is powered off, etc. If the third-party device determines that the originating device or the target device does not exist, notify the other device that establishes the communication link with the link. Exist, request # put resources, reclaim the Fibre Channel port ID assigned to the originating device and/or the target device.

FIG. 3 is a schematic structural diagram of an apparatus for transmitting a message on a PCIE bus according to an embodiment of the present invention. The apparatus is a specific execution body of the foregoing method, and therefore the content in the method embodiment is referenced. The manner of the present invention is incorporated into the embodiment of the device, and is not described herein.

As shown in Figure 3, the device includes:

The encapsulating module 201 is configured to obtain a preset protocol packet.

The transceiver module 202 is configured to carry the preset protocol packet in a PCIE protocol packet, and send the PCIE protocol packet to the target end device by using a PCIE bus, so that the target end device is from the After the preset protocol packet is parsed in the PCIE protocol packet, the corresponding operation is performed according to the instruction of the preset protocol packet;

The parsing module 203 is configured to parse the preset protocol packet from the received PCIE protocol packet, and the executing module 204 is configured to perform a corresponding operation according to the preset protocol packet instruction.

The encapsulating module 201 is specifically configured to carry the preset protocol packet in a processing layer protocol TLP packet of the PCIE protocol packet.

The device for transmitting a packet on the PCIE bus provided by the embodiment of the present invention carries the preset protocol packet in the PCIE protocol packet, and carries the PCIE protocol packet with the preset protocol packet through the PCIE bus. The device transmits to the target device, and realizes the transmission of the preset protocol message on the PCIE bus, so that any device connected to each other through the PCIE bus can perform mutual operation through the preset protocol message, and the data is transmitted. High bandwidth and fast processing speed. It can be used in a multi-host cluster computing system with full PCIE connection. The compute nodes and storage nodes are interconnected based on the FC protocol.

FIG. 4 is a schematic structural diagram of an apparatus for transmitting a message on a PCIE bus according to an embodiment of the present invention:

The encapsulating module 201 includes: a first encapsulating unit 2011, configured to acquire a preset protocol packet when sending the device discovery request information to the third-party device;

The embodiment of the present invention may encapsulate the preset protocol packet in the processing layer protocol TLP packet of the PCIE protocol according to a specific service type, and obtain an FC-TLP protocol text; or The protocol packet is encapsulated in the processing layer protocol TLP packet of the PCIE protocol packet, and the FCoPIP-TLP protocol packet is obtained.

The transceiver module 202 is configured to acquire a PCIE device ID of the target device, and encapsulate the PCIE device ID of the target device in a preset protocol packet, and carry the preset protocol packet in the PCIE. In the protocol packet, the PCIE protocol packet is sent to the target through the PCIE bus. And the end device, after the target end device parses the preset protocol packet from the PCIE protocol packet, and performs a corresponding operation according to the instruction of the preset protocol packet;

When the device discovery request information is sent, the transceiver module 202 is specifically configured to send the device discovery request information to the third-party device, and receive the first request response information returned by the third-party device, where the first request response is carried. There is a PCIE device ID of the third party device.

The third-party device in this embodiment may be a specific network management device in the link. In this embodiment, the sending and receiving module 202 sends the device discovery request information to the third-party device, and may send the device discovery request information to the third-party device through the target device.

When the preset protocol packet is a virtual link instantiation request, the first encapsulating unit 2011 is further configured to: when the transceiver module 202 sends a virtual link instantiation request to a third-party device, The PCIE device ID of the start device is encapsulated in the FCoPIP protocol packet, and the FCoPIP protocol packet is carried in the PCIE protocol packet to obtain the FCoPIP-TLP protocol packet.

The transceiver module 202 is configured to send a virtual link instantiation request to the third-party device, where the request information may be a Virtual Link Instantiation Request;

The sending and receiving module 202 sends a virtual link instantiation request to the third-party device, and the third-party device can send the third-party device to the third-party device, and also needs to send the third-party device to the third-party device. The transceiver module 202 receives the PCIE link. The second request response information returned by the third-party device, where the second request response information may be a virtual link instantiation reply, indicating a virtual link instantiation response, where the second request response information carries the start device and the target The respective Fibre Channel protocol parameters of the end devices and the Fibre Channel port ID assigned to the originating device by the third party device and the Fibre Channel port ID of the target device.

Further, if the preset protocol packet is a registration name server (PLOGI NS ) request, the encapsulating module 201 may further include:

The second encapsulating unit 2012 is configured to process the preset protocol packet when the registration name server request information is sent to the third-party device, and encapsulate the Fibre Channel protocol parameter and the Fibre Channel port ID of the third-party device in the FC protocol report. The FC protocol packet is carried in the PCIE protocol packet to obtain the FC-TLP protocol text. The transceiver module 202 is further configured to send the registration name server request to the third-party device, and receive the third request response information returned by the third-party device. The registration name server request information is an FC-TLP protocol packet, and the Fibre Channel port ID is an address identifier uniquely corresponding to the device determined in the routing configuration. The third request response information carries the PCIE device ID of the target device.

If the port registration request information is sent to the target device, the second encapsulation unit 2012 is further configured to process the preset protocol packet, encapsulate the PCIE device ID of the target device in the FC protocol packet, and configure the FC protocol. The packet is carried in the PCIE protocol packet to obtain the FC-TLP protocol packet. The transceiver module 202 is configured to send the port registration request information to the target device, and receive the fourth request response returned from the target device. Information to establish a Fibre Channel virtual link from the originating device to the target device.

The device further includes:

The configuration module 401 is configured to configure a respective Fibre Channel port ID for the start device and the target device, and carry the Fibre Channel port ID in the first request response information, in response to the received preset protocol message. Return to the originating device and the target device;

The recording module 402 is configured to record the allocated Fibre Channel port ID and the PCIE device ID, and the Fibre Channel protocol parameters, where the recorded Fibre Channel protocol parameters include the Fibre Channel port ID of the initiating device and the target device. Fibre Channel port ID, and Fibre Channel protocol parameters for each of the initiator and destination devices. The Fibre Channel port ID is an address identifier uniquely corresponding to the device determined in the routing configuration.

The device for transmitting a message on the PCIE bus provided by the embodiment of the present invention interconnects the storage system using the FC protocol through the PCIE bus, so that any device connected to each other through the PCIE bus can report through a preset protocol. The mutual operation of the text can utilize the existing functional advantages and management tools of the FC protocol, and the data transmission has high bandwidth and fast processing speed, and can be used in a multi-host cluster computing system with full PCIE connection, and the computing node and the storage node are based on the FC. The protocol implements interconnection. FIG. 5 is a schematic structural diagram of a system for transmitting a message on a PCIE bus according to an embodiment of the present invention, as shown in FIG. 5, The system includes:

The start device 20, the target device 30, and the third party device 40, wherein the start device 20, the target device 30, and the third party device 40 are connected and perform data interaction through the PCIE bus.

FIG. 6 is a schematic structural diagram of a start device according to an embodiment of the present invention, where the start device 20 includes:

The first sending unit 601 is configured to carry the registration name server request information of the first preset protocol in the PCIE protocol packet, and send the information to the third-party device through the PCIE bus;

The first receiving unit 602 is configured to receive, by the third device, the third request response information of the first preset protocol that is carried in the PCIE protocol packet, where the third request response information carries the PCIE device ID of the target device;

The first sending unit 601 is further configured to: carry the port registration request information of the first preset protocol in a PCIE protocol packet according to the PCIE device ID of the target device that is obtained from the third request response information, And sent to the target device through the PCIE bus;

The first receiving unit 602 is further configured to receive fourth request response information of the first preset protocol that is carried in the PCIE protocol packet returned by the target device, thereby establishing a Fibre Channel virtual link.

Optionally, the initiating device 20 further includes:

The second sending unit 603 is configured to: after the first sending unit 601 carries the registration name server request information of the first preset protocol in the PCIE protocol message, and sends the second preset to the third-party device through the PCIE bus, The device discovery request of the protocol is carried in the PCIE protocol packet and sent through the PCIE bus.

The second receiving unit 604 is configured to receive, by the third device, the first request response information of the second preset protocol that is carried in the PCIE protocol packet, where the first request response information carries the PCIE of the third-party device. Device ID;

The second sending unit 603 is further configured to carry the virtual link instantiation information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and send the information to the third-party device through the PCIE bus. The virtual link instantiation request information carries a PCIE device ID of the initiating device;

The second receiving unit 604 is further configured to receive, by the third-party device, the carried in the PCIE protocol packet The second request response information of the second preset protocol is configured to register the originating device in the third party device.

Optionally, the first sending unit 601 is further configured to periodically carry the link maintenance information of the second preset protocol in the PCIE protocol packet on the Fibre Channel virtual link, and send the information to the peer device. Figure Ί is a schematic structural diagram of a third-party device provided by an embodiment of the present invention, and the third-party device 40 includes:

The third receiving unit 701 is configured to receive, by the initiating device, the registration name server request information of the first preset protocol that is carried in the PCIE protocol packet;

The third sending unit 702 is configured to carry the third request information of the first preset protocol in the PCIE protocol message, and send the message to the initiating device through the PCIE bus, where the third request response information carries the target The PCIE device ID of the end device.

Optionally, the third party device 40 further includes:

The fourth receiving unit 703 is configured to receive a device discovery request that is sent by the initiating device or the target device to the second preset protocol that is carried in the PCIE protocol packet;

The fourth sending unit 704 is configured to carry the first request response information of the second preset protocol in the PCIE protocol, and send the information to the originating device or the target device through the PCIE bus.

FIG. 8 is a schematic structural diagram of a target device according to an embodiment of the present invention, where the target device 30 includes:

The fifth receiving unit 801 is configured to receive, by the initiating device, port registration request information of the first preset protocol that is carried in the PCIE protocol packet;

The fifth sending unit 802 is configured to carry the fourth request response information of the first preset protocol in the PCIE protocol, and send the information to the initiating device through the PCIE bus, thereby establishing a Fibre Channel virtual link.

Optionally, the target device 30 further includes:

The sixth sending unit 803 is configured to: before the fifth receiving unit receives the port registration request information, carry the device discovery request of the second preset protocol in the PCIE protocol packet, and send the message through the PCIE bus; The sixth receiving unit 804 is configured to receive, by the third device, the first request response information of the second preset protocol that is carried in the PCIE protocol packet, where the first request response information carries the PCIE of the third-party device. Device ID;

The sixth sending unit 803 is further configured to: carry the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and send the information to the third-party device through the PCIE bus, The virtual link instantiation request information carries a PCIE device ID of the target device;

The sixth receiving unit 804 is further configured to receive the second request response information of the second preset protocol that is carried in the PCIE protocol packet returned by the third-party device, so as to register the target device in the third-party device.

It should be noted that the start device 20 and the target device 30 may be computers and related external devices, such as computers, servers, storage arrays, etc. in the prior art, but are not limited to computers and related external devices. In the above, other specific devices connected through the PCIE bus can be the originating device 20 or the target device 30.

The embodiment of the invention can be used in a multi-host cluster computing system with full PCI-E connection, and the computing node and the storage node implement virtualization of the storage network based on the FC protocol.

The embodiment of the present invention provides a system for transmitting a message on a PCIE bus, by carrying a preset protocol packet in a PCIE protocol packet, and encapsulating a PCIE protocol with a preset protocol packet through the PCIE bus. The message is transmitted to the target device, and the preset protocol message is transmitted on the PCIE bus, so that any device connected to each other through the PCIE bus can perform mutual operation through the preset protocol message, and the data The transmission bandwidth is high and the processing speed is fast, which improves the transmission speed of the packet and lowers the cost of the device. At the same time, by transmitting the preset protocol packet on the PCIE bus, the two peer devices connected through the PCIE bus are enabled. Between each other, preset protocol messages can be used to perform mutual operations without defining various proprietary protocols for mutual operation, and the versatility is good.

In addition, the memory device of the present scheme, because the PCIE bus inherits the principle of the PCI bus, but abandons the parallel shared bus, adopts the popular point-to-point serial connection in the industry, and each device has its own dedicated connection, and does not need to The entire bus requests bandwidth, and can increase the data transmission rate to a very high frequency, reaching the high bandwidth that PCI cannot provide, that is, all devices can pass Connecting through PCIE simplifies unnecessary troubles in the design of the motherboard.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

It should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: The technical solutions described in the foregoing embodiments are modified, or some of the technical features are equivalently replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

Rights request

A method for transmitting a message on a high-speed interconnect PCIE bus of an external component, comprising:

The initiating device carries the port registration request information of the first preset protocol in a PCIE protocol packet according to the PCIE device ID of the target device that is obtained from the third request response information, and sends the information through the PCIE bus. And the fourth request response information of the first preset protocol carried in the PCIE protocol packet returned by the target device is received, thereby establishing a Fibre Channel virtual link with the target device, where The start device, the target device, and the third device are interconnected by a PCIE bus.

2. The method of claim 1 wherein the first preset protocol is an FC-TLP.

The method of claim 2, wherein the requesting the registration information of the first preset protocol is carried in a PCIE protocol message, including:

Encapsulating the registration name server request information of the FC-TLP protocol in the TLP payload part of the PCIE message;

The port registration request information of the first preset protocol is carried in the PCIE protocol, and includes:

The port registration request information of the FC-TLP protocol is encapsulated in the TLP payload portion of the PCIE text.

The method of claim 1, wherein the requesting server information of the first preset protocol is carried in a PCIE protocol message, and is sent to the third party device through the PCIE bus, and further includes :

The initiating device carries the device discovery request of the second preset protocol in the PCIE protocol packet, and sends the packet to the PCIE protocol packet. a first request response information of the second preset protocol, where the first request response information carries a PCIE device ID of the third-party device;

The initiating device carries the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and sends the information to the third-party device through the PCIE bus, where the virtual link instance is sent. The request information carries the PCIE device ID of the initiating device; and receives the second request response information of the second preset protocol that is carried in the PCIE protocol packet and returned by the third device.

The method according to claim 1, wherein before the acquiring, by the initiating device, the packet of the first preset protocol, the method further includes:

The method of claim 5, wherein after the establishing the Fibre Channel virtual link, the method further includes:

The start device and/or the target device periodically carry the link maintenance information of the second preset protocol in the PCIE protocol packet on the Fibre Channel virtual link, and send the information to the peer device.

The method according to any one of claims 4 to 6, wherein the second preset protocol is FCoPIP-TLP.

The method of claim 7, wherein the initiating device carries the device discovery request of the second preset protocol in the PCIE protocol packet, including:

Encapsulating the device discovery request of the FCoPIP-TLP packet in a TLP payload part of the PCIE packet; The carrying the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet includes:

Encapsulating the virtual link instantiation request information of the FCoPIP-TLP packet in a TLP payload part of the PCIE packet;

The carrying the link maintenance information of the second preset protocol in the PCIE protocol packet includes: encapsulating the link maintenance information of the FCoPIP-TLP packet in a TLP payload part of the PCIE packet.

9. A start-end device, comprising:

The first sending unit is configured to carry the registration name server request information of the first preset protocol in the PCIE protocol packet, and send the information to the third-party device through the PCIE bus;

The first receiving unit is configured to receive the third request response information of the first preset protocol that is carried in the PCIE protocol packet, and the third request response information carries the PCIE device ID of the target device.

The first sending unit is further configured to: carry the port registration request information of the first preset protocol in a PCIE protocol packet, according to the PCIE device ID of the target device, obtained from the third request response information, and Send to the target device through the PCIE bus;

The first receiving unit is further configured to receive the fourth request response information of the first preset protocol that is carried in the PCIE protocol packet returned by the target device, thereby establishing a Fibre Channel virtual link.

The device according to claim 9, further comprising:

a second sending unit, configured to: after the first sending unit carries the registration name server request information of the first preset protocol in the PCIE protocol message, and sends the information to the third party device through the PCIE bus, The device discovery request is carried in the PCIE protocol and is sent through the PCIE bus.

The second receiving unit is configured to receive the first request response information of the second preset protocol that is carried in the PCIE protocol packet that is returned by the third-party device, where the first request response information carries the PCIE device of the third-party device ID;

The second sending unit is further configured to: carry the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and send the information through the PCIE bus Sending to the third-party device, the virtual link instantiation request information carries the PCIE device ID of the initiating device;

The second receiving unit is further configured to receive the second request response information of the second preset protocol that is carried in the PCIE protocol packet returned by the third-party device, so as to register the initiating device in the third-party device.

The device according to claim 10, wherein the first sending unit is further configured to periodically carry the link maintenance information of the second preset protocol on the Fibre Channel virtual link.

The PCIE protocol packet is sent to the peer device.

12. A third-party device, comprising:

a third receiving unit, configured to receive, by the originating device, the registration name server request information of the first preset protocol carried in the PCIE protocol packet;

a third sending unit, configured to carry the third request information of the first preset protocol in the PCIE protocol packet, and send the information to the initiating device through the PCIE bus, where the third request response information carries the target end The PCIE device ID of the device.

13. The device according to claim 12, further comprising:

a fourth receiving unit, configured to receive a device discovery request of a second preset protocol that is sent by the originating device or the target device and is carried in the PCIE protocol packet;

The fourth sending unit is configured to carry the first request response information of the second preset protocol in the PCIE protocol message, and send the information to the start device or the target device through the PCIE bus.

14. A target device, comprising:

a fifth receiving unit, configured to receive port registration request information of the first preset protocol that is sent by the initiating device and is carried in the PCIE protocol packet;

The fifth sending unit is configured to carry the fourth request response information of the first preset protocol in the PCIE protocol packet, and send the information to the initiating device through the PCIE bus, thereby establishing a Fibre Channel virtual link.

The device according to claim 14, further comprising:

a sixth sending unit, configured to: before the fifth receiving unit receives the port registration request information, carry the device discovery request of the second preset protocol in the PCIE protocol packet, and send the message through the PCIE bus; The sixth receiving unit is configured to receive, by the third device, the first request response information of the second preset protocol that is carried in the PCIE protocol packet, where the first request response information carries the PCIE device of the third-party device ID;

The sixth sending unit is further configured to: carry the virtual link instantiation request information of the second preset protocol in the PCIE protocol packet according to the PCIE device ID of the third-party device, and send the information to the third-party device through the PCIE bus. The virtual link instantiation request information carries the PCIE device ID of the target device;

The sixth receiving unit is further configured to receive the second request response information of the second preset protocol that is carried in the PCIE protocol packet returned by the third-party device, so as to register the target device in the third-party device.

16. A method for transmitting a message on a PCIE bus, the method comprising:

Obtain a preset protocol packet;

After the PCIE device ID of the target device is obtained, the preset protocol packet is carried in the PCIE protocol packet, and the PCIE protocol packet is sent to the target through the PCIE bus. And the end device, after the target end device parses the preset protocol packet from the PCIE protocol packet, and performs a corresponding operation according to the instruction of the preset protocol packet, where the start end Devices, target devices, and third-party devices are interconnected by a PCIE bus.

The method according to claim 16, wherein the carrying the preset protocol packet in the PCIE protocol includes:

The preset protocol packet is carried in the TLP packet of the processing layer protocol of the PCIE protocol packet, and the FC-TLP protocol packet is obtained, where the preset protocol 4 is the FC protocol.

Or, the preset protocol packet is carried in the TLP packet of the processing layer protocol of the PCIE protocol packet, and the FCoPIP-TLP protocol packet is obtained, wherein the preset protocol packet is an FCoPIP protocol packet.

The method of claim 17, wherein, before the obtaining the PCIE device ID of the target device, the presetting the protocol packet in the PCIE protocol message includes: The device discovery request information is sent to obtain a PCIE device ID of the third-party device, where the device discovery request information includes a Fibre Channel protocol parameter of the initiating device and a Fibre Channel protocol parameter of the target device, where the device discovery request Information for the FCoPIP-TLP Association The discussion is written.

19. The method of claim 18, wherein

Sending the device discovery request information, obtaining the PCIE device ID of the third-party device, including: sending the device discovery request information to the third-party device by means of broadcast or multicast, and receiving the first request response information returned by the third-party device, the first request The response information includes the third-party device PCIE device ID, or the third-party device actively announces the PCIE device ID of the third-party device on the PCIE link.

The method according to any one of claims 16-17, wherein the presetting the protocol text is carried in the PCIE protocol, and further includes:

The initiating device sends the registration name server request information to the third-party device to obtain the PCIE device ID of the target device, and receives the third request response information returned by the target device, where the registration name server request information is an FC-TLP protocol message, The registration name server request information carries the Fibre Channel port ID of the target device and the Fibre Channel protocol parameter of the target device, and the third request response information carries the PCIE device ID of the target device.