US8331381B2 - Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network - Google Patents

Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network Download PDF

Info

Publication number
US8331381B2
US8331381B2 US11/949,823 US94982307A US8331381B2 US 8331381 B2 US8331381 B2 US 8331381B2 US 94982307 A US94982307 A US 94982307A US 8331381 B2 US8331381 B2 US 8331381B2
Authority
US
United States
Prior art keywords
ethernet
infiniband
lid
devices
iboe
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US11/949,823
Other versions
US20090141728A1 (en
Inventor
Aaron C. Brown
Jimmy R. Hill
Gregory F. Pfister
Renato J. Recio
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Priority to US11/949,823 priority Critical patent/US8331381B2/en
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION reassignment INTERNATIONAL BUSINESS MACHINES CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PFISTER, GREGORY F., RECIO, RENATO J., BROWN, AARON C., HILL, JIMMY R.
Publication of US20090141728A1 publication Critical patent/US20090141728A1/en
Application granted granted Critical
Publication of US8331381B2 publication Critical patent/US8331381B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/02—Topology update or discovery
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/66—Layer 2 routing, e.g. in Ethernet based MAN's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/02—Standardisation; Integration
    • H04L41/022—Multivendor or multi-standard integration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/40—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using virtualisation of network functions or resources, e.g. SDN or NFV entities

Definitions

  • the present invention relates in general to computer servers and in particular to computer networking protocols. Still more particularly, the present invention relates to an improved method and system for providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network.
  • InfiniBand is a switched fabric computer network communications link that includes connections between multiple processor nodes and high performance Input/Output (I/O) nodes. InfiniBand provides a point-to-point bidirectional serial link between processors and high performance peripheral devices (e.g., data storage units).
  • a subnet manager is typically responsible for discovering networked components and assigning local identifiers (LIDs) to each component.
  • the subnet manager sends source-routed packets referred to as fabric management packets (FMPs) to discover components in the InfiniBand network.
  • Each FMP includes a hop field that defines the target of the FMP. For example, if the hop field is a zero value, then the currently active component is the target. However if the hop field is a non-zero value, then the subnet manager decrements the hop field and uses the next port number in a port number array to select the outbound port of a network switch.
  • Ethernet is a family of frame-based computer networking technologies that operates at multiple signaling rates. Ethernet is typically used in Local Area Networks (LANs).
  • the Ethernet protocol which is also referred to as the Institute of Electrical and Electronics Engineers (IEEE) 802.3 standard, defines wiring and signaling standards for physical LAN layers, including a means of network access at the Media Access Control (MAC) sub layer and a common address format.
  • Ethernet stations communicate by sending small blocks of data, referred to as data packets, between nodes and/or infrastructure devices (e.g., hubs, switches, and routers) over various types of copper twisted pair wiring and/or fiber optic cable. Each Ethernet station includes a single 48-bit MAC address that may be used to specify the destination or source of a data packet.
  • Ethernet and InfiniBand are network protocols simultaneously, such as Ethernet and InfiniBand.
  • Ethernet protocol does not support FMPs, which are used by subnet managers to discover InfiniBand components.
  • FMPs which are used by subnet managers to discover InfiniBand components.
  • the lack of support for FMPs in Ethernet networks can thus be problematic in converged InfiniBand over Ethernet networks.
  • IBOE InfiniBand over Ethernet
  • the subnet manager sends fabric management packets (FMPs) to discover the InfiniBand network and assigns physical local identifiers (LIDs) to the InfiniBand devices.
  • FMPs fabric management packets
  • LIDs physical local identifiers
  • the subnet manager sends FMPs to discover the Ethernet network.
  • the subnet manager adds the Ethernet Media Access Control (MAC) addresses of any responding devices to an LID routing table and assigns LIDs to the Ethernet devices.
  • the subnet manager configures one or more virtual Host Channel Adapters (HCAs) corresponding to the one or more Ethernet MAC addresses in the LID routing table.
  • HCAs Host Channel Adapters
  • FIG. 1A depicts a high level block diagram of an exemplary network, according to an embodiment of the present invention
  • FIG. 1B depicts a high level block diagram of an alternate configuration of the exemplary network of FIG. 1A , according to another embodiment of the present invention
  • FIG. 2 illustrates an exemplary InfiniBand Local Identifier (LID) routing table, according to an embodiment of the present invention
  • FIG. 3 is a high level logical flowchart of an exemplary method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network, according to an embodiment of the invention.
  • the present invention provides a method, system, and computer program product for providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network.
  • network 100 includes InfiniBand fabric 102 , Ethernet fabric 104 , subnet manager 110 , and InfiniBand over Ethernet (IBOE) gateway 115 .
  • IBOE gateway 115 which is connected to both InfiniBand fabric 102 (via I/O Interface 135 ) and Ethernet fabric 104 , sends and receives InfiniBand data packets over Ethernet fabric 104 .
  • InfiniBand fabric 102 includes InfiniBand switch 105 and multiple host channel adapters (HCAs) 107 A and 107 B, which are coupled to InfiniBand switch 105 , and Subnet Manager 110 , which can reside above one or more InfiniBand HCAs, such as HCA 107 A.
  • Ethernet fabric 104 includes a first Ethernet device 117 A that is coupled directly to IBOE gateway 115 and a second Ethernet device 117 B that is coupled to Ethernet switch 140 . Ethernet switch 140 is in turn coupled to IBOE gateway 115 .
  • Ethernet devices 117 A and 117 B are defined by unique Ethernet Media Access Control (MAC) addresses, and Ethernet devices 117 A and 117 B may include virtual InfiniBand HCAs that enables subnet manager 110 to provide visibility of Ethernet devices 117 A and 117 B, as illustrated in FIG. 3 , which is described below.
  • MAC Media Access Control
  • IBOE gateway 115 includes processor unit 120 , memory 125 , and Input/Output (I/O) interface 135 .
  • I/O interface 135 is coupled to processor unit 120 .
  • Memory 125 which is also coupled to processor unit 120 , includes routing utility 127 and local identifier (LID) routing table 130 .
  • LID routing table 130 includes network address information corresponding to one or more virtual InfiniBand LIDs, real (i.e., physical) InfiniBand LIDs, and Ethernet MAC addresses.
  • An exemplary LID routing table 130 is illustrated in FIG. 2 , which is described below. Routing utility 127 performs the functions illustrated in FIG. 3 , which is described below.
  • subnet manager 110 is connected to the InfiniBand fabric 102 through one or more InfiniBand HCAs.
  • Subnet manager 110 discovers (i.e., locates and identifies) one or more devices in InfiniBand fabric 102 (e.g., HCAs 107 A and 107 B) by sending Fabric Management Packets (FMPs) to InfiniBand fabric 102 .
  • FMPs Fabric Management Packets
  • IBoE gateway fabric management packets are used by subnet manager 110 to discover and configure IBoE gateway 115 .
  • the IB encapsulated IBoE Discover Virtual HCA Ethernet multicast management packet is sent to the I/O interface 135 LID and the routing utility extracts the Ethernet multicast packet and sends the IBoE Discover Virtual HCA Ethernet multicast packet on the Ethernet fabric as described in FIG. 3 .
  • the IB encapsulated IBoE Virtual HCA Response management response packet is sent from all Virtual HCAs residing on the Ethernet fabric to the I/O interface 135 and the I/O interface 135 encapsulates this packet as an IB encapsulated IBoE Discover Virtual HCA Ethernet response management packet, which is sent to subnet manager 110 as described in FIG. 3 .
  • the IB Set routing table packet is sent from subnet manager 110 to the I/O interface 135 and contains the routing table described in FIG. 2 . Additional management packets can be used to only add elements to the routing table, to query the routing table or clear the routing table.
  • Routing utility 127 uses LID routing table 130 in IBOE gateway 115 to store the routing table described in FIG. 2 , which contains a list of the Virtual HCAs resident in Ethernet fabric 104 .
  • Subnet manager 110 assigns a LID to each Virtual HCA that responds IBoE Discover Virtual HCA Ethernet multicast packet with a IB encapsulated IBoE Virtual HCA Response management response packet.
  • Ethernet fabric 104 Ethernet device 117 A receives the IBoE Discover Virtual HCA Ethernet multicast packet and respond with a IB encapsulated IBoE Virtual HCA Response management response packet containing its MAC Address.
  • Ethernet devices 117 B receives the IBoE Discover Virtual HCA Ethernet multicast packet and respond with a IB encapsulated IBoE Virtual HCA Response management response packet containing its MAC Address.
  • IBOE gateway 115 appears as a single switch with a large port count from the perspective of subnet manager 110 , regardless of whether devices are directly coupled to IBOE gateway 115 (e.g., Ethernet device 117 A) or connected to IBOE gateway through an Ethernet network or Ethernet switch (e.g., Ethernet device 117 B). Therefore, all Ethernet devices that are virtually visible to subnet manager 110 via IBOE gateway 115 appear as if the Ethernet devices are directly coupled to IBOE gateway 115 , and subnet manager 110 may thus assign LIDs to the Ethernet devices within LID routing table 130 .
  • Ethernet fabric 104 may include an Ethernet network with one or more Ethernet switches.
  • Ethernet fabric 104 may use Ethernet links that have been enhanced to support convergence with cluster and storage traffic, such as a Convergence Enhanced Ethernet (CEE).
  • CEE Convergence Enhanced Ethernet
  • InfiniBand fabric 102 may include an InfiniBand network with additional switches and HCAs.
  • subnet manager 110 is attached through the I/O Interface 135 and subnet manager 110 is connected to the InfiniBand fabric through I/O Interface 135 .
  • subnet manager 110 may instead be connected to the InfiniBand fabric through InfiniBand switch 105 .
  • Subnet manager 110 discovers (i.e., locates and identifies) one or more devices in InfiniBand fabric 102 (e.g., HCAs 107 A and 107 B) by sending Fabric Management Packets (FMPs) to InfiniBand fabric 102 as described in the InfiniBand Volume 1 Specification.
  • FMPs Fabric Management Packets
  • LID routing table 130 ( FIG. 1A ) includes multiple rows 200 .
  • LID routing table includes M Ethernet Media Access Control (MAC) addresses 205 that correspond to the addresses of Ethernet devices (e.g., Ethernet device 117 A) or computers within Ethernet fabric 104 , where M is a positive integer.
  • MAC Media Access Control
  • LID routing table 130 also includes N InfiniBand LIDs 210 that correspond to HCAs (e.g., HCA 107 A) or computers within InfiniBand fabric 102 , where N is a positive integer.
  • LID routing table 130 also includes X IBOE port numbers 215 that correspond to ports of IBOE gateway 115 that devices are coupled to for communication purposes, where X is a positive integer.
  • LID routing table 130 thus includes M Ethernet MAC addresses 205 matched to N InfiniBand LIDs 210 and X IBOE port numbers 215 .
  • LID routing table 130 also includes multiple LID mapping bits 220 .
  • Virtual HCAs i.e., HCAs attached through an Ethernet fabric
  • Physical HCAs i.e., HCAs attached directly to an IB fabric
  • Ethernet device 117 B within Ethernet fabric 104 is LID mapped
  • entry (i.e., row) within LID routing table 130 that corresponds to the device includes a virtual InfiniBand LID 210 , a corresponding IBOE port number 215 and a LID Mapped MAC Address.
  • a LID Mapped MAC Address is one where the upper 24 bits of the MAC Address are the OUI-24 number assigned to IB LID Mapped MAC addresses, the next 8 bits are zeros and the last 16 bits are the subnet manager 110 assigned LIDs.
  • the entry within LID routing table 130 includes the Ethernet MAC address 205 that the virtual HCA MAC Address used in the IBoE Virtual HCA Response management response packet, as well as a virtual InfiniBand LID 210 and IBOE port number 215 .
  • Ethernet Address 205 may include a placeholder value (e.g., zero) if an Ethernet device is LID mapped.
  • table 130 contains only one type of MAC addresses.
  • LIDs 210 may refer to physical HCAs (i.e., HCAs attached directly to the InfiniBand fabric) or virtual HCAs (i.e., HCAs attached to an Ethernet fabric). Both types of HCAs use LIDs assigned by Subnet Manager 110 . However, virtual HCAs encapsulate IB packets within an Ethernet packet using the MAC mapping mechanism described in the IBoE Discover Virtual HCA Ethernet multicast packet sent by subnet manager 110 .
  • FIG. 3 there is illustrated a high level logical flowchart of an exemplary method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network, according to an embodiment of the invention.
  • the process begins at block 300 .
  • subnet manager 110 ( FIGS. 1A-1B ) determines whether or not a link on a switch port of IBOE gateway 115 ( FIGS. 1A-1B ) corresponds to an Ethernet link (i.e., whether or not a port corresponds to one or more Ethernet devices).
  • subnet manager 110 sends FMPs to one or more HCAs, switches, and/or other InfiniBand devices in InfiniBand fabric 102 to discover the devices, and subnet manager 110 assigns physical InfiniBand LIDs 210 to the discovered InfiniBand channel adapters, as depicted in block 310 .
  • the process subsequently terminates at block 345 .
  • subnet manager 110 sends one or more IBoE Discover Virtual HCA Ethernet multicast packet, which is received by each node, computer, and/or Ethernet device in Ethernet fabric 104 that contains a virtual HCA, as depicted in block 315 .
  • Subnet manager 110 initializes a temporary response timer by clearing a counter variable and starting the response timer (i.e., periodically incrementing the counter variable), as shown in block 320 .
  • Subnet manager 110 adds Ethernet MAC addresses 205 ( FIG. 2 ) that correspond to one or more incoming responses received from the nodes in Ethernet fabric 104 to LID routing table 130 , as depicted in block 325 .
  • subnet manager 110 determines whether or not the response timer has expired (i.e., whether the counter has reached a pre-defined expiration value). If the response timer has not expired, the process returns to block 325 . Once the response timer has expired, subnet manager 110 may assign unused (i.e., open) InfiniBand LIDs 210 ( FIG. 2 ) to Ethernet MAC addresses 205 in LID routing table 130 , as shown in block 335 . Subnet manager 110 may configure virtual InfiniBand HCAs for one or more nodes (e.g., Ethernet device 117 A) within LID routing table 130 , as depicted in block 340 , and the process terminates at block 345 .
  • nodes e.g., Ethernet device 117 A
  • the present invention thus provides a method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network.
  • IBOE gateway 115 provides subnet manager 110 with a virtual view of Ethernet fabric 104 , thereby enabling subnet manager 110 to send IBoE FMPs and assign LIDs to Ethernet devices that do not otherwise support FMPs. If a port of IBOE gateway 115 corresponds to one or more InfiniBand devices, subnet manager 110 sends FMPs to discover InfiniBand fabric 102 and assigns physical LIDs to the InfiniBand devices. If a port of IBOE gateway 115 corresponds to one or more Ethernet devices, subnet manager 110 sends FMPs to discover Ethernet fabric 104 .
  • Subnet manager 110 adds the Ethernet MAC addresses of any responding devices to LID routing table 130 and assigns LIDs to the Ethernet devices. Subnet manager 110 configures one or more virtual HCAs corresponding to the one or more Ethernet MAC addresses in LID routing table 130 .

Abstract

A method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet (IBOE) network. If a port of an IBOE gateway corresponds to one or more InfiniBand devices, the subnet manager sends fabric management packets (FMPs) to discover the InfiniBand network and assigns physical local identifiers (LIDs) to the InfiniBand devices. If a port of the IBOE gateway corresponds to one or more Ethernet devices, the subnet manager sends FMPs to discover the Ethernet network. The subnet manager adds the Ethernet Media Access Control (MAC) addresses of any responding devices to an LID routing table and assigns LIDs to the Ethernet devices. The subnet manager configures one or more virtual Host Channel Adapters (HCAs) corresponding to the one or more Ethernet MAC addresses in the LID routing table.

Description

BACKGROUND OF THE INVENTION
1. Technical Field
The present invention relates in general to computer servers and in particular to computer networking protocols. Still more particularly, the present invention relates to an improved method and system for providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network.
2. Description of the Related Art
InfiniBand is a switched fabric computer network communications link that includes connections between multiple processor nodes and high performance Input/Output (I/O) nodes. InfiniBand provides a point-to-point bidirectional serial link between processors and high performance peripheral devices (e.g., data storage units). In an InfiniBand network, a subnet manager is typically responsible for discovering networked components and assigning local identifiers (LIDs) to each component. The subnet manager sends source-routed packets referred to as fabric management packets (FMPs) to discover components in the InfiniBand network. Each FMP includes a hop field that defines the target of the FMP. For example, if the hop field is a zero value, then the currently active component is the target. However if the hop field is a non-zero value, then the subnet manager decrements the hop field and uses the next port number in a port number array to select the outbound port of a network switch.
Ethernet is a family of frame-based computer networking technologies that operates at multiple signaling rates. Ethernet is typically used in Local Area Networks (LANs). The Ethernet protocol, which is also referred to as the Institute of Electrical and Electronics Engineers (IEEE) 802.3 standard, defines wiring and signaling standards for physical LAN layers, including a means of network access at the Media Access Control (MAC) sub layer and a common address format. Ethernet stations communicate by sending small blocks of data, referred to as data packets, between nodes and/or infrastructure devices (e.g., hubs, switches, and routers) over various types of copper twisted pair wiring and/or fiber optic cable. Each Ethernet station includes a single 48-bit MAC address that may be used to specify the destination or source of a data packet.
Conventional heterogeneous server and storage networks support multiple network protocols simultaneously, such as Ethernet and InfiniBand. As the number of protocols supported by a heterogeneous network increases, so does the complexity of the network infrastructure. Specifically, the Ethernet protocol does not support FMPs, which are used by subnet managers to discover InfiniBand components. The lack of support for FMPs in Ethernet networks can thus be problematic in converged InfiniBand over Ethernet networks.
SUMMARY OF AN EMBODIMENT
Disclosed are a method, system, and computer program product for providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet (IBOE) network. If a port of an IBOE gateway corresponds to one or more InfiniBand devices, the subnet manager sends fabric management packets (FMPs) to discover the InfiniBand network and assigns physical local identifiers (LIDs) to the InfiniBand devices. If a port of the IBOE gateway corresponds to one or more Ethernet devices, the subnet manager sends FMPs to discover the Ethernet network. The subnet manager adds the Ethernet Media Access Control (MAC) addresses of any responding devices to an LID routing table and assigns LIDs to the Ethernet devices. The subnet manager configures one or more virtual Host Channel Adapters (HCAs) corresponding to the one or more Ethernet MAC addresses in the LID routing table.
The above as well as additional objectives, features, and advantages of the present invention will become apparent in the following detailed written description.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention itself, as well as a preferred mode of use, further objects, and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
FIG. 1A depicts a high level block diagram of an exemplary network, according to an embodiment of the present invention;
FIG. 1B depicts a high level block diagram of an alternate configuration of the exemplary network of FIG. 1A, according to another embodiment of the present invention;
FIG. 2 illustrates an exemplary InfiniBand Local Identifier (LID) routing table, according to an embodiment of the present invention; and
FIG. 3 is a high level logical flowchart of an exemplary method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network, according to an embodiment of the invention.
 DETAILED DESCRIPTION OF AN ILLUSTRATIVE EMBODIMENT
The present invention provides a method, system, and computer program product for providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network.
With reference now to FIG. 1A, there is depicted a high level block diagram of an exemplary network, according to an embodiment of the present invention. As shown, network 100 includes InfiniBand fabric 102, Ethernet fabric 104, subnet manager 110, and InfiniBand over Ethernet (IBOE) gateway 115. IBOE gateway 115, which is connected to both InfiniBand fabric 102 (via I/O Interface 135) and Ethernet fabric 104, sends and receives InfiniBand data packets over Ethernet fabric 104. InfiniBand fabric 102 includes InfiniBand switch 105 and multiple host channel adapters (HCAs) 107A and 107B, which are coupled to InfiniBand switch 105, and Subnet Manager 110, which can reside above one or more InfiniBand HCAs, such as HCA 107A. Similarly, Ethernet fabric 104 includes a first Ethernet device 117A that is coupled directly to IBOE gateway 115 and a second Ethernet device 117B that is coupled to Ethernet switch 140. Ethernet switch 140 is in turn coupled to IBOE gateway 115. Ethernet devices 117A and 117B are defined by unique Ethernet Media Access Control (MAC) addresses, and Ethernet devices 117A and 117B may include virtual InfiniBand HCAs that enables subnet manager 110 to provide visibility of Ethernet devices 117A and 117B, as illustrated in FIG. 3, which is described below.
In one embodiment, IBOE gateway 115 includes processor unit 120, memory 125, and Input/Output (I/O) interface 135. I/O interface 135 is coupled to processor unit 120. Memory 125, which is also coupled to processor unit 120, includes routing utility 127 and local identifier (LID) routing table 130. LID routing table 130 includes network address information corresponding to one or more virtual InfiniBand LIDs, real (i.e., physical) InfiniBand LIDs, and Ethernet MAC addresses. An exemplary LID routing table 130 is illustrated in FIG. 2, which is described below. Routing utility 127 performs the functions illustrated in FIG. 3, which is described below.
According to the illustrative embodiment, subnet manager 110 is connected to the InfiniBand fabric 102 through one or more InfiniBand HCAs. Subnet manager 110 discovers (i.e., locates and identifies) one or more devices in InfiniBand fabric 102 (e.g., HCAs 107A and 107B) by sending Fabric Management Packets (FMPs) to InfiniBand fabric 102. Three InfiniBand over Ethernet (IBoE) gateway fabric management packets (FMPs) are used by subnet manager 110 to discover and configure IBoE gateway 115. The IB encapsulated IBoE Discover Virtual HCA Ethernet multicast management packet is sent to the I/O interface 135 LID and the routing utility extracts the Ethernet multicast packet and sends the IBoE Discover Virtual HCA Ethernet multicast packet on the Ethernet fabric as described in FIG. 3. The IB encapsulated IBoE Virtual HCA Response management response packet is sent from all Virtual HCAs residing on the Ethernet fabric to the I/O interface 135 and the I/O interface 135 encapsulates this packet as an IB encapsulated IBoE Discover Virtual HCA Ethernet response management packet, which is sent to subnet manager 110 as described in FIG. 3. The IB Set routing table packet is sent from subnet manager 110 to the I/O interface 135 and contains the routing table described in FIG. 2. Additional management packets can be used to only add elements to the routing table, to query the routing table or clear the routing table.
Routing utility 127 uses LID routing table 130 in IBOE gateway 115 to store the routing table described in FIG. 2, which contains a list of the Virtual HCAs resident in Ethernet fabric 104. Subnet manager 110 assigns a LID to each Virtual HCA that responds IBoE Discover Virtual HCA Ethernet multicast packet with a IB encapsulated IBoE Virtual HCA Response management response packet. In Ethernet fabric 104, Ethernet device 117A receives the IBoE Discover Virtual HCA Ethernet multicast packet and respond with a IB encapsulated IBoE Virtual HCA Response management response packet containing its MAC Address. Similarly, Ethernet devices 117B receives the IBoE Discover Virtual HCA Ethernet multicast packet and respond with a IB encapsulated IBoE Virtual HCA Response management response packet containing its MAC Address.
When subnet manager 110 issues FMPs to devices on the other side of IBOE gateway 115 with respect to subnet manager 110, IBOE gateway 115 appears as a single switch with a large port count from the perspective of subnet manager 110, regardless of whether devices are directly coupled to IBOE gateway 115 (e.g., Ethernet device 117A) or connected to IBOE gateway through an Ethernet network or Ethernet switch (e.g., Ethernet device 117B). Therefore, all Ethernet devices that are virtually visible to subnet manager 110 via IBOE gateway 115 appear as if the Ethernet devices are directly coupled to IBOE gateway 115, and subnet manager 110 may thus assign LIDs to the Ethernet devices within LID routing table 130.
In an alternate embodiment, Ethernet fabric 104 may include an Ethernet network with one or more Ethernet switches. In another alternate embodiment, Ethernet fabric 104 may use Ethernet links that have been enhanced to support convergence with cluster and storage traffic, such as a Convergence Enhanced Ethernet (CEE). Similarly, InfiniBand fabric 102 may include an InfiniBand network with additional switches and HCAs.
With reference now to FIG. 1B, there is depicted a high level block diagram of an alternate configuration of network 100, according to another embodiment of the present invention. According to the embodiment of FIG. 1B, subnet manager 110 is attached through the I/O Interface 135 and subnet manager 110 is connected to the InfiniBand fabric through I/O Interface 135. In another embodiment, subnet manager 110 may instead be connected to the InfiniBand fabric through InfiniBand switch 105. Subnet manager 110 discovers (i.e., locates and identifies) one or more devices in InfiniBand fabric 102 (e.g., HCAs 107A and 107B) by sending Fabric Management Packets (FMPs) to InfiniBand fabric 102 as described in the InfiniBand Volume 1 Specification.
Within the descriptions of the figures, similar elements are provided similar names and reference numerals as those of the previous figure(s). Where a later figure utilizes the element in a different context or with different functionality, the element is provided a different leading numeral representative of the figure number (e.g., 1xx for FIG. 1 and 2xx for FIG. 2). The specific numerals assigned to the elements are provided solely to aid in the description and not meant to imply any limitations (structural or functional) on the invention.
With reference now to FIG. 2, there is depicted an exemplary InfiniBand LID routing table, according to an embodiment of the present invention. As shown, LID routing table 130 (FIG. 1A) includes multiple rows 200. LID routing table includes M Ethernet Media Access Control (MAC) addresses 205 that correspond to the addresses of Ethernet devices (e.g., Ethernet device 117A) or computers within Ethernet fabric 104, where M is a positive integer. Similarly, LID routing table 130 also includes N InfiniBand LIDs 210 that correspond to HCAs (e.g., HCA 107A) or computers within InfiniBand fabric 102, where N is a positive integer. LID routing table 130 also includes X IBOE port numbers 215 that correspond to ports of IBOE gateway 115 that devices are coupled to for communication purposes, where X is a positive integer. LID routing table 130 thus includes M Ethernet MAC addresses 205 matched to N InfiniBand LIDs 210 and X IBOE port numbers 215. LID routing table 130 also includes multiple LID mapping bits 220. Virtual HCAs (i.e., HCAs attached through an Ethernet fabric) contain a MAC address in table 130. Physical HCAs (i.e., HCAs attached directly to an IB fabric) contain a zero in place of the MAC address in table 130.
If an Ethernet device (e.g., Ethernet device 117B) within Ethernet fabric 104 is LID mapped, then the entry (i.e., row) within LID routing table 130 that corresponds to the device includes a virtual InfiniBand LID 210, a corresponding IBOE port number 215 and a LID Mapped MAC Address. A LID Mapped MAC Address is one where the upper 24 bits of the MAC Address are the OUI-24 number assigned to IB LID Mapped MAC addresses, the next 8 bits are zeros and the last 16 bits are the subnet manager 110 assigned LIDs.
If an Ethernet device (e.g., Ethernet device 117A) within Ethernet fabric 104 is not LID mapped, the entry within LID routing table 130 includes the Ethernet MAC address 205 that the virtual HCA MAC Address used in the IBoE Virtual HCA Response management response packet, as well as a virtual InfiniBand LID 210 and IBOE port number 215.
In an alternate embodiment, for an Ethernet device (e.g., Ethernet device 117B) within Ethernet fabric 104 is LID mapped, the Ethernet Address 205 may include a placeholder value (e.g., zero) if an Ethernet device is LID mapped. In another embodiment, table 130 contains only one type of MAC addresses.
In one embodiment, LIDs 210 may refer to physical HCAs (i.e., HCAs attached directly to the InfiniBand fabric) or virtual HCAs (i.e., HCAs attached to an Ethernet fabric). Both types of HCAs use LIDs assigned by Subnet Manager 110. However, virtual HCAs encapsulate IB packets within an Ethernet packet using the MAC mapping mechanism described in the IBoE Discover Virtual HCA Ethernet multicast packet sent by subnet manager 110.
Turning now to FIG. 3, there is illustrated a high level logical flowchart of an exemplary method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network, according to an embodiment of the invention. The process begins at block 300. At block 305, subnet manager 110 (FIGS. 1A-1B) determines whether or not a link on a switch port of IBOE gateway 115 (FIGS. 1A-1B) corresponds to an Ethernet link (i.e., whether or not a port corresponds to one or more Ethernet devices). If a switch port link of IBOE gateway 115 does not correspond to an Ethernet link (i.e., the port corresponds to one or more InfiniBand devices), subnet manager 110 sends FMPs to one or more HCAs, switches, and/or other InfiniBand devices in InfiniBand fabric 102 to discover the devices, and subnet manager 110 assigns physical InfiniBand LIDs 210 to the discovered InfiniBand channel adapters, as depicted in block 310. The process subsequently terminates at block 345.
If a switch port link of IBOE gateway 115 corresponds to an Ethernet link (i.e., the port corresponds to one or more Ethernet devices), subnet manager 110 sends one or more IBoE Discover Virtual HCA Ethernet multicast packet, which is received by each node, computer, and/or Ethernet device in Ethernet fabric 104 that contains a virtual HCA, as depicted in block 315. Subnet manager 110 initializes a temporary response timer by clearing a counter variable and starting the response timer (i.e., periodically incrementing the counter variable), as shown in block 320. Subnet manager 110 adds Ethernet MAC addresses 205 (FIG. 2) that correspond to one or more incoming responses received from the nodes in Ethernet fabric 104 to LID routing table 130, as depicted in block 325.
At block 330, subnet manager 110 determines whether or not the response timer has expired (i.e., whether the counter has reached a pre-defined expiration value). If the response timer has not expired, the process returns to block 325. Once the response timer has expired, subnet manager 110 may assign unused (i.e., open) InfiniBand LIDs 210 (FIG. 2) to Ethernet MAC addresses 205 in LID routing table 130, as shown in block 335. Subnet manager 110 may configure virtual InfiniBand HCAs for one or more nodes (e.g., Ethernet device 117A) within LID routing table 130, as depicted in block 340, and the process terminates at block 345.
The present invention thus provides a method of providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network. IBOE gateway 115 provides subnet manager 110 with a virtual view of Ethernet fabric 104, thereby enabling subnet manager 110 to send IBoE FMPs and assign LIDs to Ethernet devices that do not otherwise support FMPs. If a port of IBOE gateway 115 corresponds to one or more InfiniBand devices, subnet manager 110 sends FMPs to discover InfiniBand fabric 102 and assigns physical LIDs to the InfiniBand devices. If a port of IBOE gateway 115 corresponds to one or more Ethernet devices, subnet manager 110 sends FMPs to discover Ethernet fabric 104. Subnet manager 110 adds the Ethernet MAC addresses of any responding devices to LID routing table 130 and assigns LIDs to the Ethernet devices. Subnet manager 110 configures one or more virtual HCAs corresponding to the one or more Ethernet MAC addresses in LID routing table 130.
It is understood that the use herein of specific names are for example only and not meant to imply any limitations on the invention. The invention may thus be implemented with different nomenclature/terminology and associated functionality utilized to describe the above devices/utility, etc., without limitation.
In the flow chart (FIG. 3) above, while the process steps are described and illustrated in a particular sequence, use of a specific sequence of steps is not meant to imply any limitations on the invention. Changes may be made with regards to the sequence of steps without departing from the spirit or scope of the present invention. Use of a particular sequence is therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.
While an illustrative embodiment of the present invention has been described in the context of a fully functional computer network with installed software, those skilled in the art will appreciate that the software aspects of an illustrative embodiment of the present invention are capable of being distributed as a program product in a variety of forms, and that an illustrative embodiment of the present invention applies equally regardless of the particular type of media used to actually carry out the distribution. Examples of the types of media include recordable type media such as thumb drives, floppy disks, hard drives, CD ROMs, DVDs, and transmission type media such as digital and analog communication links.
While the invention has been particularly shown and described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention.

Claims (20)

1. In a computer network, a method comprising:
a subnet manager coupled to an InfiniBand over Ethernet (IBOE) gateway in a network determining if a port of said IBOE gateway corresponds to one of one or more InfiniBand devices in an InfiniBand network or one or more Ethernet devices in an Ethernet network;
in response to a determination that the port of said IBOE gateway corresponds to one or more InfiniBand devices in an InfiniBand network:
sending one or more fabric management packets (FMPs) to said one or more InfiniBand devices to discover said InfiniBand network; and
assigning physical local identifiers (LIDs) to said one or more InfiniBand devices; and
in response to a determination that the port of said IBOE gateway corresponds to one or more Ethernet devices in an Ethernet network:
sending one or more FMPs to said one or more Ethernet devices to discover said Ethernet network;
receiving a response from one or more responding Ethernet devices of said one or more Ethernet devices, wherein said response is an InfiniBand encapsulated IBOE Virtual Host Channel Adapters (HCA) response management packet from a virtual HCA that contains an Ethernet Media Access Control (MAC) address of the virtual HCA;
adding one or more Ethernet MAC addresses of said one or more responding Ethernet devices to a LID routing table, wherein the LID routing table includes:
one or more Ethernet MAC addresses that correspond to said one or more Ethernet devices;
one or more InfiniBand LIDs that correspond to one or more physical HCAs, wherein physical HCAs in the LID routing table contain a zero in place of the MAC address;
one or more IBOE port numbers that correspond to ports of the IBOE gateway that one or more devices are coupled to;
one or more Ethernet MAC addresses matched to InfiniBand LIDs and IBOE port numbers; and
one or more LID mapping bits;
wherein virtual HCAs in the LID routing table contain a MAC address;
assigning one or more LIDs to said one or more Ethernet devices; and
configuring one or more virtual HCAs corresponding to said one or more Ethernet MAC addresses in said LID routing table.
2. The method of claim 1, wherein the IBOE gateway has a first port connected to said one or more InfiniBand devices in said InfiniBand network and a second port connected to said one or more Ethernet devices in said Ethernet network.
3. The method of claim 1 further comprising, in response to said sending one or more FMPs to said one or more Ethernet devices to discover said Ethernet network, initializing a temporary response timer by clearing a counter variable and starting the temporary response timer.
4. The method of claim 3 further comprising:
determining if said response timer has expired; and
in response to determining the response timer has expired, assigning one or more unused LIDs in said LID routing table to one or more Ethernet MAC addresses of one or more non-responding Ethernet devices of said one or more Ethernet devices.
5. The method of claim 1, wherein an entry corresponding to an Ethernet device that is LID mapped within the LID routing table includes a virtual InfiniBand LID, a corresponding IBOE port number, and a LID mapped MAC Address, wherein the LID Mapped MAC Address has a first set of bits containing the MAC Address assigned to InfiniBand LID mapped MAC addresses, a second set of bits that identify a subnet manager assigned LID, and one or more zero bits.
6. The method of claim 1, wherein an entry corresponding to an Ethernet device that is LID mapped within the LID routing table includes a placeholder value in place of an Ethernet MAC address.
7. The method of claim 1, wherein an entry corresponding to an Ethernet device that is not LID mapped within the LID routing table includes an Ethernet MAC address used in the IBOE Virtual HCA response management packet, a virtual InfiniBand LID, and an IBOE port number.
8. A computer network comprising:
an InfiniBand network;
an Ethernet network;
a subnet manager coupled to at least said InfiniBand network, wherein said subnet manager:
determines if a port of an InfiniBand over Ethernet (IBOE) gateway corresponds to one of one or more InfiniBand devices in said InfiniBand network or one or more Ethernet devices in said Ethernet network;
in response to a determination that the port of said IBOE gateway corresponds to one or more InfiniBand devices in said InfiniBand network:
sends one or more fabric management packets (FMPs) to said one or more InfiniBand devices to discover said InfiniBand network; and
assigns physical local identifiers (LIDs) to said one or more InfiniBand devices; and
in response to a determination that the port of said IBOE gateway corresponds to one or more Ethernet devices in said Ethernet network:
sends one or more FMPs to said one or more Ethernet devices to discover said Ethernet network;
receives a response from one or more responding Ethernet devices of said one or more Ethernet devices, wherein said response is an InfiniBand encapsulated IBOE Virtual HCA response management packet from a virtual HCA that contains an Ethernet Media Access Control (MAC) address of the virtual HCA;
adds one or more Ethernet MAC addresses of said one or more responding Ethernet devices to a LID routing table, wherein the LID routing table includes:
one or more Ethernet MAC addresses that correspond to said one or more Ethernet devices;
one or more InfiniBand LIDs that correspond to one or more physical HCAs, wherein physical HCAs in the LID routing table contain a zero in place of the MAC address;
one or more IBOE port numbers that correspond to ports of the IBOE gateway that one or more devices are coupled to;
one or more Ethernet MAC addresses matched to InfiniBand LIDs and IBOE port numbers; and
one or more LID mapping bits;
wherein virtual HCAs in the LID routing table contain a MAC address;
assigns one or more LIDs to said one or more Ethernet devices; and
configures one or more virtual HCAs corresponding to said one or more Ethernet MAC addresses in said LID routing table;
wherein said IBOE gateway includes said LID routing table.
9. The computer network of claim 8, wherein the IBOE gateway has a first port connected to said one or more InfiniBand devices in said InfiniBand network and a second port connected to said one or more Ethernet devices in said Ethernet network.
10. The computer network of claim 8, the subnet manager further: in response to said sending one or more FMPs to said one or more Ethernet devices to discover said Ethernet network, initializes a temporary response timer by clearing a counter variable and starting the temporary response timer.
11. The computer network of claim 10, the subnet manager further:
determines if said response timer has expired; and
in response to determining the response timer has expired, assigns one or more unused LIDs in said LID routing table to one or more Ethernet MAC addresses of one or more non-responding Ethernet devices of said one or more Ethernet devices.
12. The computer network of claim 8, wherein an entry corresponding to an Ethernet device that is LID mapped within the LID routing table includes a virtual InfiniBand LID, a corresponding IBOE port number, and a LID mapped MAC Address, wherein the LID Mapped MAC Address has a first set of bits containing the MAC Address assigned to InfiniBand LID mapped MAC addresses, a second set of bits that identify a subnet manager assigned LID, and one or more zero bits.
13. The computer network of claim 8, wherein an entry corresponding to an Ethernet device that is LID mapped within the LID routing table includes a placeholder value in place of an Ethernet MAC address.
14. The computer network of claim 8, wherein an entry corresponding to an Ethernet device that is not LID mapped within the LID routing table includes an Ethernet MAC address used in the IBOE Virtual HCA response management packet, a virtual InfiniBand LID, and an IBOE port number.
15. A computer program product comprising:
a recordable type computer storage device; and
program code on said recordable type computer storage device that when executed provides the functions of:
determining if a port of an InfiniBand over Ethernet (IBOE) gateway corresponds to one of one or more InfiniBand devices in an InfiniBand network or one or more Ethernet devices in an Ethernet network;
in response to a determination that the port of said IBOE gateway corresponds to one or more InfiniBand devices in an InfiniBand network:
sending one or more fabric management packets (FMPs) to said one or more InfiniBand devices to discover said InfiniBand network; and
assigning physical local identifiers (LIDs) to said one or more InfiniBand devices; and
in response to a determination that the port of said IBOE gateway corresponds to one or more Ethernet devices in an Ethernet network:
sending one or more FMPs to said one or more Ethernet devices to discover said Ethernet network;
receiving a response from one or more responding Ethernet devices of said one or more Ethernet devices, wherein said response is an InfiniBand encapsulated IBOE Virtual HCA response management packet from a virtual HCA that contains an Ethernet Media Access Control (MAC) address of the virtual HCA;
adding one or more Ethernet MAC addresses of said one or more responding Ethernet devices to a LID routing table wherein the LID routing table includes:
one or more Ethernet MAC addresses that correspond to said one or more Ethernet devices;
one or more InfiniBand LIDs that correspond to one or more physical HCAs, wherein physical HCAs in the LID routing table contain a zero in place of the MAC address;
one or more IBOE port numbers that correspond to ports of the IBOE gateway that one or more devices are coupled to;
one or more Ethernet MAC addresses matched to InfiniBand LIDs and IBOE port numbers; and
one or more LID mapping bits;
wherein virtual HCAs in the LID routing table contain a MAC address;
assigning one or more LIDs to said one or more Ethernet devices; and
configuring one or more virtual HCAs corresponding to said one or more Ethernet MAC addresses in said LID routing table;
wherein said code for sending one or more FMPs to said one or more Ethernet devices to discover said Ethernet network discovers said Ethernet device in said Ethernet network and further comprises code for said IBOE gateway sending said one or more FMPs on behalf of a subnet manager coupled to said InfiniBand network to said one or more Ethernet devices in said Ethernet network.
16. The computer program product of claim 15, wherein the IBOE gateway has a first port connected to said one or more InfiniBand devices in said InfiniBand network and a second port connected to said one or more Ethernet devices in said Ethernet network.
17. The computer program product of claim 15, wherein said program code on said computer storage device, when executed, further provides the functions of: in response to said sending one or more FMPs to said one or more Ethernet devices to discover said Ethernet network, initializing a temporary response timer by clearing a counter variable and starting the temporary response timer.
18. The computer program product of claim 17, wherein said program code on said computer storage device, when executed, further provides the functions of:
determining if said response timer has expired; and
in response to determining the response timer has expired, assigning one or more unused LIDs in said LID routing table to one or more Ethernet MAC addresses of one or more non-responding Ethernet devices of said one or more Ethernet devices.
19. The computer program product of claim 15, wherein an entry corresponding to an Ethernet device that is LID mapped within the LID routing table includes a virtual InfiniBand LID, a corresponding IBOE port number, and a LID mapped MAC Address, wherein the LID Mapped MAC Address has a first set of bits containing the MAC Address assigned to InfiniBand LID mapped MAC addresses, a second set of bits that identify a subnet manager assigned LID, and one or more zero bits.
20. The computer program product of claim 15, wherein:
an entry corresponding to an Ethernet device that is LID mapped within the LID routing table includes a placeholder value in place of an Ethernet MAC address; and
an entry corresponding to an Ethernet device that is not LID mapped within the LID routing table includes an Ethernet MAC address used in the IBOE Virtual HCA response management packet, a virtual InfiniBand LID, and an IBOE port number.
US11/949,823 2007-12-04 2007-12-04 Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network Expired - Fee Related US8331381B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/949,823 US8331381B2 (en) 2007-12-04 2007-12-04 Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11/949,823 US8331381B2 (en) 2007-12-04 2007-12-04 Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network

Publications (2)

Publication Number Publication Date
US20090141728A1 US20090141728A1 (en) 2009-06-04
US8331381B2 true US8331381B2 (en) 2012-12-11

Family

ID=40675639

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/949,823 Expired - Fee Related US8331381B2 (en) 2007-12-04 2007-12-04 Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network

Country Status (1)

Country Link
US (1) US8331381B2 (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120069730A1 (en) * 2010-09-17 2012-03-22 Oracle International Corporation System and method for supporting management network interface card port failover in a middleware machine environment
US20120311682A1 (en) * 2011-06-03 2012-12-06 Oracle International Corporation System and method for providing restrictions on the location of peer subnet manager (sm) instances in an infiniband (ib) network
US20130254321A1 (en) * 2012-03-26 2013-09-26 Oracle International Corporation System and method for supporting live migration of virtual machines in a virtualization environment
US8743890B2 (en) 2011-06-03 2014-06-03 Oracle International Corporation System and method for supporting sub-subnet in an infiniband (IB) network
US9262155B2 (en) 2012-06-04 2016-02-16 Oracle International Corporation System and method for supporting in-band/side-band firmware upgrade of input/output (I/O) devices in a middleware machine environment
US20160072817A1 (en) * 2014-09-09 2016-03-10 Oracle International Corporation System and method for providing for secure network communication in a multi-tenant environment
US9401963B2 (en) 2012-06-04 2016-07-26 Oracle International Corporation System and method for supporting reliable connection (RC) based subnet administrator (SA) access in an engineered system for middleware and application execution
US9529878B2 (en) 2012-05-10 2016-12-27 Oracle International Corporation System and method for supporting subnet manager (SM) master negotiation in a network environment
US9577928B2 (en) 2013-08-27 2017-02-21 Oracle International Corporation System and method for supporting data service addressing in an engineered system for middleware and application execution
US20170214571A1 (en) * 2016-01-27 2017-07-27 Oracle International Corporation System and method for supporting node role attributes in a high performance computing environment
US9990221B2 (en) 2013-03-15 2018-06-05 Oracle International Corporation System and method for providing an infiniband SR-IOV vSwitch architecture for a high performance cloud computing environment
US10440152B2 (en) * 2016-01-27 2019-10-08 Oracle International Corporation System and method of initiating virtual machine configuration on a subordinate node from a privileged node in a high-performance computing environment
US10972375B2 (en) 2016-01-27 2021-04-06 Oracle International Corporation System and method of reserving a specific queue pair number for proprietary management traffic in a high-performance computing environment
US11018947B2 (en) 2016-01-27 2021-05-25 Oracle International Corporation System and method for supporting on-demand setup of local host channel adapter port partition membership in a high-performance computing environment
US11271870B2 (en) 2016-01-27 2022-03-08 Oracle International Corporation System and method for supporting scalable bit map based P_Key table in a high performance computing environment
US11695691B2 (en) * 2016-03-04 2023-07-04 Oracle International Corporation System and method for supporting dual-port virtual router in a high performance computing environment

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9813283B2 (en) 2005-08-09 2017-11-07 Oracle International Corporation Efficient data transfer between servers and remote peripherals
EP2192721A1 (en) * 2008-11-28 2010-06-02 Thomson Licensing A method of operating a network subnet manager
US9973446B2 (en) 2009-08-20 2018-05-15 Oracle International Corporation Remote shared server peripherals over an Ethernet network for resource virtualization
CN101958910B (en) * 2010-10-18 2013-05-22 清华大学 Integrated identification network personal communication mobile management method based on double-proxy
CN102098228B (en) * 2011-03-04 2012-09-05 清华大学 Integrated management system for mobility of identification network and method thereof
US8743878B2 (en) * 2011-08-30 2014-06-03 International Business Machines Corporation Path resolve in symmetric infiniband networks
US9264382B2 (en) * 2012-05-11 2016-02-16 Oracle International Corporation System and method for routing traffic between distinct infiniband subnets based on fat-tree routing
US9083550B2 (en) * 2012-10-29 2015-07-14 Oracle International Corporation Network virtualization over infiniband
CN103581171B (en) * 2013-09-03 2016-12-07 华为数字技术（苏州）有限公司 A kind of file transmitting method and device
FR3028371B1 (en) * 2014-11-06 2016-11-18 Bull Sas METHOD FOR MONITORING AND CONTROLLING DEPORTS OF A CLUSTER USING AN INFINIBAND-TYPE COMMUNICATION NETWORK AND COMPUTER PROGRAM USING SAID METHOD
US10616118B2 (en) 2016-01-28 2020-04-07 Oracle International Corporation System and method for supporting aggressive credit waiting in a high performance computing environment
US10355972B2 (en) 2016-01-28 2019-07-16 Oracle International Corporation System and method for supporting flexible P_Key mapping in a high performance computing environment
US10659340B2 (en) 2016-01-28 2020-05-19 Oracle International Corporation System and method for supporting VM migration between subnets in a high performance computing environment
US10630816B2 (en) 2016-01-28 2020-04-21 Oracle International Corporation System and method for supporting shared multicast local identifiers (MILD) ranges in a high performance computing environment
US10666611B2 (en) 2016-01-28 2020-05-26 Oracle International Corporation System and method for supporting multiple concurrent SL to VL mappings in a high performance computing environment
US10536334B2 (en) 2016-01-28 2020-01-14 Oracle International Corporation System and method for supporting subnet number aliasing in a high performance computing environment
US10333894B2 (en) 2016-01-28 2019-06-25 Oracle International Corporation System and method for supporting flexible forwarding domain boundaries in a high performance computing environment
US10348847B2 (en) 2016-01-28 2019-07-09 Oracle International Corporation System and method for supporting proxy based multicast forwarding in a high performance computing environment
US10348649B2 (en) 2016-01-28 2019-07-09 Oracle International Corporation System and method for supporting partitioned switch forwarding tables in a high performance computing environment
US10581711B2 (en) 2016-01-28 2020-03-03 Oracle International Corporation System and method for policing network traffic flows using a ternary content addressable memory in a high performance computing environment
US10992538B2 (en) * 2017-08-31 2021-04-27 Oracle International Corporation System and method for using InfiniBand routing algorithms for ethernet fabrics in a high performance computing environment
US11411860B2 (en) 2017-08-31 2022-08-09 Oracle International Corporation System and method for on-demand unicast forwarding in a high performance computing environment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020156888A1 (en) * 2001-04-23 2002-10-24 Lee Man-Ho L. Method and apparatus for detecting and reporting configuration errors in a multi-component switching fabric
US20030084219A1 (en) * 2001-10-26 2003-05-01 Maxxan Systems, Inc. System, apparatus and method for address forwarding for a computer network
US20040213220A1 (en) * 2000-12-28 2004-10-28 Davis Arlin R. Method and device for LAN emulation over infiniband fabrics
US20090141734A1 (en) * 2007-12-04 2009-06-04 Brown Aaron C Method and system for a converged infiniband over ethernet network

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040213220A1 (en) * 2000-12-28 2004-10-28 Davis Arlin R. Method and device for LAN emulation over infiniband fabrics
US20020156888A1 (en) * 2001-04-23 2002-10-24 Lee Man-Ho L. Method and apparatus for detecting and reporting configuration errors in a multi-component switching fabric
US20030084219A1 (en) * 2001-10-26 2003-05-01 Maxxan Systems, Inc. System, apparatus and method for address forwarding for a computer network
US20090141734A1 (en) * 2007-12-04 2009-06-04 Brown Aaron C Method and system for a converged infiniband over ethernet network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"On the InfiniBand Subnet Discovery Process-IEEE Cluster'03 " to Bermudez et al. *
On the InfiniBand Subnet Discovery Process-IEEE Cluster'03 to Bermudez et al. *

Cited By (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8842518B2 (en) * 2010-09-17 2014-09-23 Oracle International Corporation System and method for supporting management network interface card port failover in a middleware machine environment
US9455898B2 (en) 2010-09-17 2016-09-27 Oracle International Corporation System and method for facilitating protection against run-away subnet manager instances in a middleware machine environment
US10630570B2 (en) 2010-09-17 2020-04-21 Oracle International Corporation System and method for supporting well defined subnet topology in a middleware machine environment
US9614746B2 (en) 2010-09-17 2017-04-04 Oracle International Corporation System and method for providing ethernet over network virtual hub scalability in a middleware machine environment
US9906429B2 (en) 2010-09-17 2018-02-27 Oracle International Corporation Performing partial subnet initialization in a middleware machine environment
US20120069730A1 (en) * 2010-09-17 2012-03-22 Oracle International Corporation System and method for supporting management network interface card port failover in a middleware machine environment
US9219718B2 (en) 2011-06-03 2015-12-22 Oracle International Corporation System and method for supporting sub-subnet in an infiniband (IB) network
US8886783B2 (en) 2011-06-03 2014-11-11 Oracle International Corporation System and method for providing secure subnet management agent (SMA) based fencing in an infiniband (IB) network
US8743890B2 (en) 2011-06-03 2014-06-03 Oracle International Corporation System and method for supporting sub-subnet in an infiniband (IB) network
US9240981B2 (en) 2011-06-03 2016-01-19 Oracle International Corporation System and method for authenticating identity of discovered component in an infiniband (IB) network
US9935848B2 (en) 2011-06-03 2018-04-03 Oracle International Corporation System and method for supporting subnet manager (SM) level robust handling of unkown management key in an infiniband (IB) network
US9270650B2 (en) 2011-06-03 2016-02-23 Oracle International Corporation System and method for providing secure subnet management agent (SMA) in an infiniband (IB) network
US9930018B2 (en) 2011-06-03 2018-03-27 Oracle International Corporation System and method for providing source ID spoof protection in an infiniband (IB) network
US8713649B2 (en) * 2011-06-03 2014-04-29 Oracle International Corporation System and method for providing restrictions on the location of peer subnet manager (SM) instances in an infiniband (IB) network
US9900293B2 (en) 2011-06-03 2018-02-20 Oracle International Corporation System and method for supporting automatic disabling of degraded links in an infiniband (IB) network
US10063544B2 (en) 2011-06-03 2018-08-28 Oracle International Corporation System and method for supporting consistent handling of internal ID spaces for different partitions in an infiniband (IB) network
US20120311682A1 (en) * 2011-06-03 2012-12-06 Oracle International Corporation System and method for providing restrictions on the location of peer subnet manager (sm) instances in an infiniband (ib) network
US9450885B2 (en) * 2012-03-26 2016-09-20 Oracle International Corporation System and method for supporting live migration of virtual machines in a virtualization environment
US20130254321A1 (en) * 2012-03-26 2013-09-26 Oracle International Corporation System and method for supporting live migration of virtual machines in a virtualization environment
US9397954B2 (en) 2012-03-26 2016-07-19 Oracle International Corporation System and method for supporting live migration of virtual machines in an infiniband network
US9893977B2 (en) 2012-03-26 2018-02-13 Oracle International Corporation System and method for supporting live migration of virtual machines in a virtualization environment
US9432304B2 (en) * 2012-03-26 2016-08-30 Oracle International Corporation System and method for supporting live migration of virtual machines based on an extended host channel adaptor (HCA) model
US20130254404A1 (en) * 2012-03-26 2013-09-26 Oracle International Corporation System and method for supporting live migration of virtual machines based on an extended host channel adaptor (hca) model
US9690835B2 (en) 2012-05-10 2017-06-27 Oracle International Corporation System and method for providing a transactional command line interface (CLI) in a network environment
US9690836B2 (en) 2012-05-10 2017-06-27 Oracle International Corporation System and method for supporting state synchronization in a network environment
US9594818B2 (en) 2012-05-10 2017-03-14 Oracle International Corporation System and method for supporting dry-run mode in a network environment
US9529878B2 (en) 2012-05-10 2016-12-27 Oracle International Corporation System and method for supporting subnet manager (SM) master negotiation in a network environment
US9563682B2 (en) 2012-05-10 2017-02-07 Oracle International Corporation System and method for supporting configuration daemon (CD) in a network environment
US9852199B2 (en) 2012-05-10 2017-12-26 Oracle International Corporation System and method for supporting persistent secure management key (M—Key) in a network environment
US9401963B2 (en) 2012-06-04 2016-07-26 Oracle International Corporation System and method for supporting reliable connection (RC) based subnet administrator (SA) access in an engineered system for middleware and application execution
US9665719B2 (en) 2012-06-04 2017-05-30 Oracle International Corporation System and method for supporting host-based firmware upgrade of input/output (I/O) devices in a middleware machine environment
US9262155B2 (en) 2012-06-04 2016-02-16 Oracle International Corporation System and method for supporting in-band/side-band firmware upgrade of input/output (I/O) devices in a middleware machine environment
US9584605B2 (en) 2012-06-04 2017-02-28 Oracle International Corporation System and method for preventing denial of service (DOS) attack on subnet administrator (SA) access in an engineered system for middleware and application execution
US9990221B2 (en) 2013-03-15 2018-06-05 Oracle International Corporation System and method for providing an infiniband SR-IOV vSwitch architecture for a high performance cloud computing environment
US9843512B2 (en) 2013-08-27 2017-12-12 Oracle International Corporation System and method for controlling a data flow in an engineered system for middleware and application execution
US9577928B2 (en) 2013-08-27 2017-02-21 Oracle International Corporation System and method for supporting data service addressing in an engineered system for middleware and application execution
US9973425B2 (en) 2013-08-27 2018-05-15 Oracle International Corporation System and method for providing a data service in an engineered system for middleware and application execution
US9723008B2 (en) * 2014-09-09 2017-08-01 Oracle International Corporation System and method for providing an integrated firewall for secure network communication in a multi-tenant environment
US20160072817A1 (en) * 2014-09-09 2016-03-10 Oracle International Corporation System and method for providing for secure network communication in a multi-tenant environment
US20160072816A1 (en) * 2014-09-09 2016-03-10 Oracle International Corporation System and method for providing an integrated firewall for secure network communication in a multi-tenant environment
US9888010B2 (en) * 2014-09-09 2018-02-06 Oracle International Corporation System and method for providing an integrated firewall for secure network communication in a multi-tenant environment
US9723009B2 (en) * 2014-09-09 2017-08-01 Oracle International Corporation System and method for providing for secure network communication in a multi-tenant environment
US11132216B2 (en) 2015-03-06 2021-09-28 Oracle International Corporation System and method for providing an InfiniBand SR-IOV vSwitch architecture for a high performance cloud computing environment
US11740922B2 (en) 2015-03-06 2023-08-29 Oracle International Corporation System and method for providing an InfiniBand SR-IOV vSwitch architecture for a high performance cloud computing environment
US10440152B2 (en) * 2016-01-27 2019-10-08 Oracle International Corporation System and method of initiating virtual machine configuration on a subordinate node from a privileged node in a high-performance computing environment
US10972375B2 (en) 2016-01-27 2021-04-06 Oracle International Corporation System and method of reserving a specific queue pair number for proprietary management traffic in a high-performance computing environment
US20200007468A1 (en) * 2016-01-27 2020-01-02 Oracle International Corporation System and method for supporting node role attributes in a high performance computing environment
US10560318B2 (en) 2016-01-27 2020-02-11 Oracle International Corporation System and method for correlating fabric-level group membership with subnet-level partition membership in a high-performance computing environment
US10594547B2 (en) 2016-01-27 2020-03-17 Oracle International Corporation System and method for application of virtual host channel adapter configuration policies in a high-performance computing environment
US10594627B2 (en) 2016-01-27 2020-03-17 Oracle International Corporation System and method for supporting scalable representation of switch port status in a high performance computing environment
US10419362B2 (en) * 2016-01-27 2019-09-17 Oracle International Corporation System and method for supporting node role attributes in a high performance computing environment
US10693809B2 (en) 2016-01-27 2020-06-23 Oracle International Corporation System and method for representing PMA attributes as SMA attributes in a high performance computing environment
US10756961B2 (en) 2016-01-27 2020-08-25 Oracle International Corporation System and method of assigning admin partition membership based on switch connectivity in a high-performance computing environment
US10771324B2 (en) 2016-01-27 2020-09-08 Oracle International Corporation System and method for using virtual machine fabric profiles to reduce virtual machine downtime during migration in a high-performance computing environment
US10841244B2 (en) 2016-01-27 2020-11-17 Oracle International Corporation System and method for supporting a scalable representation of link stability and availability in a high performance computing environment
US10868776B2 (en) 2016-01-27 2020-12-15 Oracle International Corporation System and method for providing an InfiniBand network device having a vendor-specific attribute that contains a signature of the vendor in a high-performance computing environment
US10965619B2 (en) * 2016-01-27 2021-03-30 Oracle International Corporation System and method for supporting node role attributes in a high performance computing environment
US10469621B2 (en) 2016-01-27 2019-11-05 Oracle International Corporation System and method of host-side configuration of a host channel adapter (HCA) in a high-performance computing environment
US11012293B2 (en) 2016-01-27 2021-05-18 Oracle International Corporation System and method for defining virtual machine fabric profiles of virtual machines in a high-performance computing environment
US11018947B2 (en) 2016-01-27 2021-05-25 Oracle International Corporation System and method for supporting on-demand setup of local host channel adapter port partition membership in a high-performance computing environment
US11082365B2 (en) 2016-01-27 2021-08-03 Oracle International Corporation System and method for supporting scalable representation of switch port status in a high performance computing environment
US11128524B2 (en) 2016-01-27 2021-09-21 Oracle International Corporation System and method of host-side configuration of a host channel adapter (HCA) in a high-performance computing environment
US10313272B2 (en) 2016-01-27 2019-06-04 Oracle International Corporation System and method for providing an infiniband network device having a vendor-specific attribute that contains a signature of the vendor in a high-performance computing environment
US11252023B2 (en) 2016-01-27 2022-02-15 Oracle International Corporation System and method for application of virtual host channel adapter configuration policies in a high-performance computing environment
US11271870B2 (en) 2016-01-27 2022-03-08 Oracle International Corporation System and method for supporting scalable bit map based P_Key table in a high performance computing environment
US11381520B2 (en) 2016-01-27 2022-07-05 Oracle International Corporation System and method for supporting node role attributes in a high performance computing environment
US11451434B2 (en) 2016-01-27 2022-09-20 Oracle International Corporation System and method for correlating fabric-level group membership with subnet-level partition membership in a high-performance computing environment
US11805008B2 (en) 2016-01-27 2023-10-31 Oracle International Corporation System and method for supporting on-demand setup of local host channel adapter port partition membership in a high-performance computing environment
US11716292B2 (en) 2016-01-27 2023-08-01 Oracle International Corporation System and method for supporting scalable representation of switch port status in a high performance computing environment
US20170214571A1 (en) * 2016-01-27 2017-07-27 Oracle International Corporation System and method for supporting node role attributes in a high performance computing environment
US11770349B2 (en) 2016-01-27 2023-09-26 Oracle International Corporation System and method for supporting configurable legacy P_Key table abstraction using a bitmap based hardware implementation in a high performance computing environment
US11695691B2 (en) * 2016-03-04 2023-07-04 Oracle International Corporation System and method for supporting dual-port virtual router in a high performance computing environment

Also Published As

Publication number Publication date
US20090141728A1 (en) 2009-06-04

Similar Documents

Publication Publication Date Title
US8331381B2 (en) Providing visibility of Ethernet components to a subnet manager in a converged InfiniBand over Ethernet network
US8165138B2 (en) Converged infiniband over ethernet network
US20090141727A1 (en) Method and System for Infiniband Over Ethernet by Mapping an Ethernet Media Access Control (MAC) Address to an Infiniband Local Identifier (LID)
US6115385A (en) Method and system for subnetting in a switched IP network
US8307048B2 (en) Network system with initiator subnetwork communication to target subnetwork communication including fibre channel over ethernet to fibre channel over internet protocol conversion
US9515844B2 (en) Methods, systems and apparatus for the interconnection of fibre channel over Ethernet devices
EP2600573B1 (en) Method for transmitting addresses correspondence relationship in second-layer protocol using link status routing
US9178969B2 (en) Methods, systems and apparatus for the servicing of fibre channel login frames
US8520686B2 (en) Method for interfacing a fibre channel network with an ethernet based network
CN100574272C (en) The method and the network terminal that automatic virtual local area network identifiers is found
US8559335B2 (en) Methods for creating virtual links between fibre channel over ethernet nodes for converged network adapters
US5796736A (en) ATM network topology auto discovery method
US9071630B2 (en) Methods for the interconnection of fibre channel over ethernet devices using a trill network
US6725264B1 (en) Apparatus and method for redirection of network management messages in a cluster of network devices
US8351442B1 (en) Method and system for network communication
US20120177044A1 (en) Methods, systems and apparatus for the interconnection of fibre channel over ethernet devices using shortest path bridging
JP2007228548A (en) Dynamic building of vlan interfaces based on subscriber information strings
RU2601194C2 (en) Devices and method for assigning network addresses
US20120163374A1 (en) Methods and apparatus for providing unique mac address to individual node for fibre channel over ethernet (fcoe) traffic
WO2012088901A1 (en) Method for allocating virtual local area network and associated device
US20100254396A1 (en) Method of connecting vlan systems to other networks via a router
KR20050051632A (en) A filter for traffic separation
Cisco Configuring the CDDI/FDDI Module
US20190312824A1 (en) Hard zoning of virtual local area networks in a fibre channel fabric
US10333866B1 (en) Soft zoning of virtual local area networks in a fibre channel fabric

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BROWN, AARON C.;HILL, JIMMY R.;PFISTER, GREGORY F.;AND OTHERS;REEL/FRAME:020192/0377;SIGNING DATES FROM 20071120 TO 20071128

Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BROWN, AARON C.;HILL, JIMMY R.;PFISTER, GREGORY F.;AND OTHERS;SIGNING DATES FROM 20071120 TO 20071128;REEL/FRAME:020192/0377

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20161211