WO2001044891A2 - Encapsulation protocol for linking storage area networks over a packet-based network - Google Patents

Encapsulation protocol for linking storage area networks over a packet-based network Download PDF

Info

Publication number
WO2001044891A2
WO2001044891A2 PCT/US2000/042087 US0042087W WO0144891A2 WO 2001044891 A2 WO2001044891 A2 WO 2001044891A2 US 0042087 W US0042087 W US 0042087W WO 0144891 A2 WO0144891 A2 WO 0144891A2
Authority
WO
WIPO (PCT)
Prior art keywords
network
nodes
protocol
packet
node
Prior art date
Application number
PCT/US2000/042087
Other languages
French (fr)
Other versions
WO2001044891A3 (en
Inventor
Robert Allen Reynolds
John Brent Haechten
Kenneth Donald Smeltzer
Original Assignee
Crossroads Systems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Crossroads Systems, Inc. filed Critical Crossroads Systems, Inc.
Priority to AU47070/01A priority Critical patent/AU4707001A/en
Priority to CA002391353A priority patent/CA2391353A1/en
Priority to JP2001545919A priority patent/JP2003517765A/en
Priority to EP00992795A priority patent/EP1240575A2/en
Publication of WO2001044891A2 publication Critical patent/WO2001044891A2/en
Publication of WO2001044891A3 publication Critical patent/WO2001044891A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/46Interconnection of networks
    • H04L12/4633Interconnection of networks using encapsulation techniques, e.g. tunneling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16Error detection or correction of the data by redundancy in hardware
    • G06F11/20Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/202Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Definitions

  • This invention relates generally to data and information communications systems and their operation, and, more particularly, to the field of storage area networking Even more particularly, the present invention relates to Fibre Channel Storage Area Networks (SANs) and an encapsulation protocol for linking Storage Area Networks over a packet-based network
  • SANs Fibre Channel Storage Area Networks
  • encapsulation protocol for linking Storage Area Networks over a packet-based network
  • storage routers In order for devices of a storage area network that use Fibre Channel to function with storage devices that use SCSI, storage routers must be installed between these devices.
  • storage routers are essential to shifting data back-up processes from a primary computer network to the storage area network, since most data back-up storage devices use the SCSI interface and can only connect to the storage area network through a storage router.
  • SCSI interface SCSI interface
  • storage routers will be increasingly essential to enable rapid, seamless communication among servers, storage devices and storage area network devices that use diverse protocols.
  • SANs are local Fibre Channel networks that serve one particular organization or one particular site. These SANs can be quite large, but cannot span great distances as they have distance limitations imposed upon them by the infrastructure necessary to carry Fibre Channel.
  • Fibre Channel standard defines a means to communicate over spans up to 10 km and, in some cases, up to 30 km in length.
  • the organization implementing the Fibre Channel network must typically own the fiber or lease dark fiber from some other party, which can be very expensive and, in most cases, is cost prohibitive.
  • Fibre Channel traffic can only carry Fibre Channel protocol traffic. They cannot be shared with other protocols. It is therefore more cost effective to transmit data over long distances using a protocol that can be carried over already existing networks, such as those owned by phone companies that can carry ATM traffic, SONET traffic and IP traffic. Therefore, SANs are usually limited as to the geographic area that they can serve (i.e., they are limited to local operation). Furthermore, two or more geographically diverse SANs cannot interconnect in a seamless fashion such that they operate and behave as if they were local to one another because the infrastructure to connect them does not exist or is cost prohibitive.
  • an encapsulation protocol with the ability to use existing telecommunications networks t connect multiple storage area networks over a packet-based network protocol such as IP, ATM, SONET, or other such currently existing telecommunications protocol.
  • the present invention provides an encapsulation protocol method and system for linking of multiple SANs over a packet-based network that substantially eliminates or reduces the disadvantages and problems associated with use of a Fibre Channel protocol over large distances.
  • the present invention provides a means for seamlessly interconnecting geographically distinct SANs such that they operate as if they were local to one another.
  • the present invention provides a method and system for encapsulating SCSI protocol for data transmission between two or more nodes across a packet-based network.
  • the method of the present invention includes the steps of, at each node in the network, identifying all other available nodes on the network, and the remote devices attached to those nodes; representing one or more of the attached remote devices such that they are made available to the node's local hosts; encapsulating the I/O phases between one or more local hosts and one or more of the remote devices; and repeating the encapsulating step for subsequent I/Os between one or more hosts and one or more devices.
  • the step of encapsulating I/O phases between a local host and a remote device can further comprise encapsulating task management functions, error recovery functions and normal I/O processing functions.
  • Each node can be a Fibre Channel-to-SCSI router.
  • Fibre Channel Protocol such as would be necessary to support a corporate or global storage area network solution.
  • the present invention provides an important technical advantage of an encapsulation protocol with the ability to use existing telecommunications networks to connect multiple storage area networks over a packet-based network protocol, such as IP, ATM, SONET, or other such currently existing telecommunications protocol.
  • a packet-based network protocol such as IP, ATM, SONET, or other such currently existing telecommunications protocol.
  • the present invention provides yet another important technical advantage of an encapsulation protocol that can link multiple storage area networks over a packet-based network in a seamless fashion, such that the multiple SANs operate as a single unified SAN.
  • FIGURE 1 is a simplified block diagram illustrating one implementation of the method and system of this invention within a typical SAN environment.
  • the present invention provides a method and system for encapsulating SCSI protocol for transmission between one or more nodes across a packet-based network that takes advantage of existing telecommunication networks to efficiently and cost-effectively connect multiple, and perhaps and geographically diverse SANs, such that they can operate as a single storage area network.
  • the method and system of this invention can thus effectively overcome distance limitations of existing Fibre Channel networks so that the SAN model can be extended to many SANs, over many miles.
  • the present invention could, for example, link a corporate SAN in Los Angeles to another corporate SAN in New York or Tokyo.
  • this invention will allow a back-up library to reside off-site at a remote location, thus ensuring data integrity should the local location be damaged by disaster, like fire or flood.
  • SANs implementing the present invention need not be limited to local use only.
  • FIGURE 1 is a simplified block diagram illustrating one implementation of the method and system of this invention within a typical SAN environment.
  • Network 100 of FIGURE 1 includes remote hosts 110, which can be local Fibre Channel SANs that access another local Fibre Channel SAN 115 for tape back-up and disk mirroring, for example.
  • Fibre Channel hosts 110 and Fibre Channel host 115 are attached to nodes 120, 130 and 150, respectively, which can be Fibre Channel-to-SCSI routers, such as those manufactured and sold by Crossroads
  • Nodes 120, 130 and 150 can be interfaces to the rest of the network 100 for SANs 110 and 115.
  • the Fibre Channel-to-SCSI routers that comprise nodes 120, 130 and 150 all can implement the EP layer such that the Fibre Channel protocol flows seamlessly over the packet-based WAN (wide area network) 140.
  • WAN 140 represents a physical packet-based transport such as ATM or Ethernet.
  • WAN 140 can be a dedicated link or switched network.
  • Hosts 110 and 115 are connected to their respective nodes via Fibre Channel links 190.
  • Nodes 120, 130 and 150 are each connected to WAN 140 via network links 192.
  • Fibre Channel links 190 can be copper or fiber-optic links, as required for a given application.
  • Network links 192 can similarly be copper or fiber-optic, as needed.
  • Remote host 110 and local host 115 can be comprised of multiple targets and multiple initiators.
  • SAN 115 includes Fibre Channel hub (switch) 160, tape library 170 and disk 180. Although only tape library 170 and disk 180 are shown, multiple initiators and target devices can be attached to Fibre Channel hub 160 and through it to Fibre Channel-to-SCSI router 150. Fibre Channel SAN 115 can thus comprise multiple hosts and multiple initiators.
  • Connecting two or more SANs together using an extender protocol requires mapping the local address of each SCSI device on one SAN to an intermediate address to get across the extender, and then mapping each intermediate address into a remote address on a remote SAN
  • This mapping is required to allow initiators on one SAN to address SCSI devices on a remote SAN as if they were SCSI devices on the local SAN to which the initiator is attached
  • devices on a remote SAN can be represented in such a way that they are made available to initiators on other SANs
  • the method and system of this invention provide a means to define the communications across the extension protocol, I e , a means to map Fibre Channel data into an extension protocol such that it can be decoded back to a Fibre Channel protocol for communication with a target at a remote SAN
  • the present invention thus defines a protocol that can be used to encapsulate Fibre Channel in a packet-based network This is accomplished by converting data to be transmitted from the protocol to be extended (Fibre Channel) to the extension protocol (the packet-based protocol for the particular application) and back to the extended protocol (Fibre Channel) at the remote SAN
  • the encapsulation protocol of the present invention can be configured to convert specific commands for a given protocol and can be extended to include new commands as the Fibre Channel protocol expands to provide new functionality Any Fibre Channel commands or messages referenced in the present invention are illustrative but not exclusive
  • the EP layer of the method and system of the present invention is composed of two parts Aspen Node Management (ANM) and Fibre Channel Protocol-Encapsulation Protocol (FCP-EP) These names have been arbitrarily chosen for desc ⁇ ptive purposes only ANM can be thought of as the control mechanism It defines a client server environment so that multiple SANs with multiple initiators and multiple targets can be managed concurrently as individual nodes on, for example, WAN 140 of FIGURE 1
  • ANM is designated as a server node and all nodes (including the server node) are clients
  • the following messages are used to define and manage the ANM control mechanism • Client Node Register Used by a client node to register with the server node This registers the client's EP address to allow the server to open future connections to the client (if necessary) • Client Node Target Register Used by a client node to register FC targets with the server node This registers all FC targets found on the local FC network • Target Table Update Sent by the server node to update a client's global target table
  • FCP-EP can be thought of as a data mechanism It defines the disassembly and reassembly of
  • the FCP-EP layer can itself be a packet-based protocol with payload definitions that are very similar to the payload definitions of SCSI-FCP sequences
  • the FCP sequences from the local SAN can be divided into smaller packets that are compatible with the lower-level transport protocol being used (e g , ATM or Ethernet)
  • the lower-level transport protocol e g , ATM or Ethernet
  • Message identifiers are used to retain sequence information du ⁇ ng disassembly
  • the disassembled sequences are then combined into frames for transport across the physical link Once across the link, another node receives these frames and uses the message identifiers to reassemble the FCP sequences
  • the packets can then be ready for transmission to the local SAN in the same format in which they were originally produced
  • the following messages are used to define and manage the FCP-EP data mechanism
  • SCSI Data Request Contains information regarding data transfer size for a write request This message requests an amount of data specified by a Data Size field, starting at a relative offset specified by a Relative Offset field
  • SCSI Data Contains a block of data and is used for reads and writes
  • SCSI Data Response Contains a block of data as well as FCP response information
  • the method and system of this invention can be implemented within a Fibre Channel-to-SCSI router such as routers 120, 130 and 150 of FIGURE 1 (nodes 120, 130 and 150)
  • the present invention can be implemented purely as software instructions stored withm memory within the Fibre Channel-to-SCSI routers and can be easily upgraded as new versions with new functionality are created. No change in the hardware of existing Fibre Channel-to-SCSI routers, is required to incorporate this invention.
  • the memory in which the software instructions of this invention are stored can be RAM (random access memory) or ROM (read-only memory), or other memory storage device.
  • An implementation of the present invention can include a dynamic discovery mechanism by which each node (router) in a multi-node implementation can communicate with every other node in order to, for example, initially discover the presence of other such nodes within the system.
  • This dynamic discovery mechanism can be used to allow each node to communicate with every other node through a common server.
  • Each node in the network can thus discover the presence of other nodes and communicate to the other nodes what attached targets it has available.
  • Each node can receive this information from every other node and can represent to their own attached hosts, or to technicians configuring each router (node), all of the available targets on all the available nodes.
  • At least one router must be designated as the server through which this discovery functionality can be implemented.
  • Other routers can also be designated as servers for, for example, fail over and error recovery cases or as a back-up.
  • a Fibre Channel-to-SCSI router can, however, contain and provide the server function. If the server function is provided by a separate device, the separate server can be integrated into the standard network equipment not within the SAN, and the routers of the SAN can communicate with this server to receive the required information. The server would thus be a true "server,” instead of an additional function within a Fibre Channel-to-SCSI router.
  • the server function of this invention can be analogized to a DNS server within an IP network.
  • the DNS server exists in the network infrastructure and knows how to communicate with the main servers. There is a defined protocol by which the main servers in an IP network can discover each other.
  • the dynamic discovery mechanism of the present invention provides essentially the same function, and can thus be integrated into the network, leaving the Fibre Channel-to-SCSI routers to be simple client nodes that can communicate with one another and with the server to discover information about any other nodes on the network.
  • the encapsulation protocol method and system of the present invention can be used over existing internet infrastmcmres and other existing network protocols.
  • the extension protocol can be a typical IP network protocol, an ATM network, gigabit Ethernet, or any protocol that allows data packets to flow between nodes.
  • the method and system of this invention by encapsulating Fibre Channel SCSI, provide a means by which data can be routed between any SCSI protocol SANs on either end of an extension network.
  • the method and system of this invention define a dynamic way to discover all the nodes available within a network implementation, so that a 1-to-n or an n-to-n relationship can be established between multiple nodes (routers) having multiple targets and initiators Each node (router) is an access point to its respective SAN
  • the method and system of this invention extend standardized messages across the intervening WAN 140 in such a way that they can be de-coded at a remote SAN and acted on within the remote SAN without loss or corruption
  • Standardized messages can thus be extended across WAN 140 from a local SAN to a remote SAN without the need for a proprietary protocol format
  • a Fibre Channel-to-SCSI router implementing this invention first comes online within a storage area network 110 or 115, it registers with the designated server to identify itself to the network and to receive in exchange information about every other node present on the network, and of the SCSI targets available on each node Similarly, the designated server can detect when a Fibre Channel-to-SCSI router drops from the network due to maintenance or malfunction
  • This functionality can be provided with, for example, a heartbeat message within the Fibre Channel SCSI protocol
  • the present invention is not limited to use in applications having storage area networks that each use the same Fibre Channel protocol
  • host 115 and hosts 110 of FIGURE 1 can each use a different protocol and still function properly using the encapsulation protocol of the present invention
  • the present invention provides sufficient information for translation to occur between, for example, a Fibre Channel network on one side of the extender and a parallel SCSI network on the other side of the extender
  • the present invention can perform this translation between any two types of SCSI networks
  • one embodiment of the method of the present invention comprises the following steps A Fibre Channel-to-SCSI router is brought online, the router communicates with a designated server to identify itself to the network and also to receive information of the other available nodes on the network The Fibre Channel-to-SCSI router will also receive information on the available devices attached to each of the other network nodes This process occurs at each node as it comes online on the storage area network The method and system of the present invention thus determines at each node what other nodes are available and what devices are attached to each of those nodes
  • the method of this invention represents each available device at each node as either a single target having one or more LUNs, or as a group of targets with one or more LUNs, and makes designed devices available to all other hosts on the local storage area network This means that each node coming online represents the reported devices on other nodes in such a way that they are made available to its own hosts
  • Communications from hosts attached to a Fibre Channel-to-SCSI router coming online can then be encapsulated and sent across to available devices over the extender through WAN 140 and, similarly, encapsulated messages can be received at the local node and passed on to its local hosts
  • This invention can thus encapsulate the I/O phases between a local host and remote devices that are made available to the host
  • the I/O phases encapsulated between a local host and a remote device can include, for example, a command phase, a data phase and a response phase
  • a host can thus send a command which is encapsulated by its associated Fibre Channel-to- SCSI router (node) and forwarded over the extender (WAN 140) to a remote node associated with the device for which the command is intended.
  • the remote node will de-encapsulate the command and forward it to the intended device
  • the device may then send back data or a response, or data and a response, which are then encapsulated by the remote node and sent to the node associated with the initiator (host) sending the command
  • the node associated with the initiating host receives and de- encapsulates the response or data, or combination of the two, and forwards them to the host
  • This sequence of command, data and/or response can comprise an I/O phase to be encapsulated
  • the present invention provides the encapsulation protocol but does not alter the data transmitted between host and device in any other way
  • the step of encapsulating the I/O phases between a local host and a remote device is repeated as necessary for subsequent I/Os Encapsulation can be performed between multiple hosts attached to multiple nodes communicating with multiple devices, all associated with multiple local or remote SANs
  • the method and system of this invention establish an initial network configuration and maintain communication between local routers in a local SAN and remote routers at one or more remote SANs, or between other local routers within the same SAN
  • the step of encapsulating the I/O phases can further comprise encapsulating individual commands and messages for a given Fibre Channel, SCSI or other protocol
  • task management functions, error recovery functions, and other I/O processing functions can be encapsulated
  • the method and system of this invention can be easily expanded to provide the same encapsulation function for additional commands and messages that may be added to existing protocols
  • the present invention provides the capability for extending an SAN model to many SANs over distances much greater than those currently allowed by the Fibre Channel protocol
  • This invention provides the capability to interconnect SANs in geographically diverse locations, such as different cities, in such a way that they can function in a seamless manner as if they comp ⁇ se a single local SAN
  • the present invention allows a back-up library to reside off-site at a remote location, thus ensuring data integrity should the local location be damaged by some failure or disaster.

Abstract

A method and system are disclosed for encapsulating SCSI protocol for data transmission between two or more nodes (110, 112, 100) across a packet-based network (140). The method of the present invention includes the steps of, at each node in the network, identifying all other available nodes on the network, and the remote devices attached to those nodes; representing one or more of the attached remote devices such that they are made available to the node's local host; encapsulating the I/O phases between one or more local hosts and one or more of the remote devices; and repeating the encapsulating step of subsequent I/Os between one or more hosts and one or more devices. The step of encapsulating I/O phases between a local host and a remote device can further comprise encapsulating task management functions, error recovery functions and normal I/O processing function. Each node (130, 120, 150) can be a Fibre Channel-to-SCSI router.

Description

DESCRIPTION
ENCAPSULATION PROTOCOL FOR LINKING STORAGE AREA
NETWORKS OVER A PACKET-BASED NETWORK
TECHNICAL FIELD OF THE INVENTION
This invention relates generally to data and information communications systems and their operation, and, more particularly, to the field of storage area networking Even more particularly, the present invention relates to Fibre Channel Storage Area Networks (SANs) and an encapsulation protocol for linking Storage Area Networks over a packet-based network
BACKGROUND OF THE INVENTION
Dramatic growth in the amount of data that must be stored, combined with the need for faster, more reliable and more efficient data access and data management capabilities, have led many organizations to seek an improved way of storing, accessing and managing data In traditional computer networks, each storage device is connected to only one server, and can be accessed only by that server The computer protocol used to connect and transfer data between the server and storage device is called the small computer system interface, or SCSI As more data must be stored and retrieved, organizations increasingly are finding that this one-to-one, or point-to-point, connection is not sufficiently fast, efficient and reliable to support growing demands for data access and storage In addition, in most organizations today, data back-up — or creating a duplicate copy of data to protect it from corruption or loss — is accomplished by moving large volumes of stored data from a dedicated storage device over the primary computer network to a back-up storage device Since the primary computer network also is responsible for conducting day-to-day computer operations, this added data movement results in substantial congestion, slowing day-to-day computer operations Storage area networks, or SANs, which are computer networks dedicated to data storage, can help resolve some of these problems A storage area network uses a different, higher-performance computer protocol, known as Fibre Channel, to transfer data A storage area network also removes the one-to-one connection between servers and storage devices, and instead allows many servers to connect to and share access with many storage devices The many-to-many connection enabled by the storage area network, combined with the Fibre Channel protocol, permits faster, more efficient, more reliable and more manageable data transfer processes Furthermore, the storage area network has the potential to enable data back-up to be accomplished over it, instead of over the primary computer network, thus substantially reducing congestion on the primary computer network and allowing much more efficient day-to-day operations Most storage devices in the market, however, continue to be sold with the small computer system interface Additionally, most organizations have made significant investments in storage devices and servers that use the small computer system interface. Therefore, in order for devices of a storage area network that use Fibre Channel to function with storage devices that use SCSI, storage routers must be installed between these devices. In particular, storage routers are essential to shifting data back-up processes from a primary computer network to the storage area network, since most data back-up storage devices use the SCSI interface and can only connect to the storage area network through a storage router. As new computer protocols are introduced, storage routers will be increasingly essential to enable rapid, seamless communication among servers, storage devices and storage area network devices that use diverse protocols.
However, typical SANs are local Fibre Channel networks that serve one particular organization or one particular site. These SANs can be quite large, but cannot span great distances as they have distance limitations imposed upon them by the infrastructure necessary to carry Fibre Channel. For example, the Fibre Channel standard defines a means to communicate over spans up to 10 km and, in some cases, up to 30 km in length. In order to do this, however, the organization implementing the Fibre Channel network must typically own the fiber or lease dark fiber from some other party, which can be very expensive and, in most cases, is cost prohibitive.
This is because the fibers used to carry Fibre Channel traffic can only carry Fibre Channel protocol traffic. They cannot be shared with other protocols. It is therefore more cost effective to transmit data over long distances using a protocol that can be carried over already existing networks, such as those owned by phone companies that can carry ATM traffic, SONET traffic and IP traffic. Therefore, SANs are usually limited as to the geographic area that they can serve (i.e., they are limited to local operation). Furthermore, two or more geographically diverse SANs cannot interconnect in a seamless fashion such that they operate and behave as if they were local to one another because the infrastructure to connect them does not exist or is cost prohibitive.
SUMMARY OF THE INVENTION
Therefore, a need exists for a method and system to connect multiple local SANs over distances greater than those currently available with the Fibre Channel Protocol, such as would be required to support a corporate or global storage area network solution.
Still further, a need exists for an encapsulation protocol with the ability to use existing telecommunications networks t connect multiple storage area networks over a packet-based network protocol such as IP, ATM, SONET, or other such currently existing telecommunications protocol.
Even further, a need exists for an encapsulation protocol that can link multiple storage area networks over a packet-based network in a seamless fashion, such that the SANs operate and behave as if they were local to one another. The present invention provides an encapsulation protocol method and system for linking of multiple SANs over a packet-based network that substantially eliminates or reduces the disadvantages and problems associated with use of a Fibre Channel protocol over large distances. In particular, the present invention provides a means for seamlessly interconnecting geographically distinct SANs such that they operate as if they were local to one another.
In particular, the present invention provides a method and system for encapsulating SCSI protocol for data transmission between two or more nodes across a packet-based network. The method of the present invention includes the steps of, at each node in the network, identifying all other available nodes on the network, and the remote devices attached to those nodes; representing one or more of the attached remote devices such that they are made available to the node's local hosts; encapsulating the I/O phases between one or more local hosts and one or more of the remote devices; and repeating the encapsulating step for subsequent I/Os between one or more hosts and one or more devices. The step of encapsulating I/O phases between a local host and a remote device can further comprise encapsulating task management functions, error recovery functions and normal I/O processing functions. Each node can be a Fibre Channel-to-SCSI router.
The present invention provides an important technical advantage of a method and system to connect multiple local SANs over long distances greater than those currently allowable under the
Fibre Channel Protocol, such as would be necessary to support a corporate or global storage area network solution.
Further still, the present invention provides an important technical advantage of an encapsulation protocol with the ability to use existing telecommunications networks to connect multiple storage area networks over a packet-based network protocol, such as IP, ATM, SONET, or other such currently existing telecommunications protocol.
The present invention provides yet another important technical advantage of an encapsulation protocol that can link multiple storage area networks over a packet-based network in a seamless fashion, such that the multiple SANs operate as a single unified SAN.
BRIEF DESCRIPTION OF THE DRAWINGS
A more complete understanding of the present invention and the advantages thereof may be acquired by referring to the following description, taken in conjunction with the accompanying drawings in which like reference numbers indicate like features and wherein: FIGURE 1 is a simplified block diagram illustrating one implementation of the method and system of this invention within a typical SAN environment.
DETAILED DESCRIPTION OF THE INVENTION
Preferred embodiments of the present invention are illustrated in the FIGURES, like numerals being used to refer to like and corresponding parts of various drawings. The present invention provides a method and system for encapsulating SCSI protocol for transmission between one or more nodes across a packet-based network that takes advantage of existing telecommunication networks to efficiently and cost-effectively connect multiple, and perhaps and geographically diverse SANs, such that they can operate as a single storage area network. The method and system of this invention can thus effectively overcome distance limitations of existing Fibre Channel networks so that the SAN model can be extended to many SANs, over many miles. The present invention could, for example, link a corporate SAN in Los Angeles to another corporate SAN in New York or Tokyo. In the case of storage recovery, this invention will allow a back-up library to reside off-site at a remote location, thus ensuring data integrity should the local location be damaged by disaster, like fire or flood. SANs implementing the present invention need not be limited to local use only.
To connect local SANs over greater distances than allowed under the Fiber Channel protocol, the present invention defines an encapsulation protocol (EP) that can run the Fibre Channel protocol (FCP) in such a way that it can travel over any packet-based transport, such as an Asynchronous Transfer Mode("ATM") or Ethernet network. FIGURE 1 is a simplified block diagram illustrating one implementation of the method and system of this invention within a typical SAN environment. Network 100 of FIGURE 1 includes remote hosts 110, which can be local Fibre Channel SANs that access another local Fibre Channel SAN 115 for tape back-up and disk mirroring, for example. Fibre Channel hosts 110 and Fibre Channel host 115 are attached to nodes 120, 130 and 150, respectively, which can be Fibre Channel-to-SCSI routers, such as those manufactured and sold by Crossroads
Systems, Inc. Nodes 120, 130 and 150 can be interfaces to the rest of the network 100 for SANs 110 and 115.
The Fibre Channel-to-SCSI routers that comprise nodes 120, 130 and 150 all can implement the EP layer such that the Fibre Channel protocol flows seamlessly over the packet-based WAN (wide area network) 140. WAN 140 represents a physical packet-based transport such as ATM or Ethernet. WAN 140 can be a dedicated link or switched network. Hosts 110 and 115 are connected to their respective nodes via Fibre Channel links 190. Nodes 120, 130 and 150 are each connected to WAN 140 via network links 192. Fibre Channel links 190 can be copper or fiber-optic links, as required for a given application. Network links 192 can similarly be copper or fiber-optic, as needed. Remote host 110 and local host 115 can be comprised of multiple targets and multiple initiators. For example, SAN 115 includes Fibre Channel hub (switch) 160, tape library 170 and disk 180. Although only tape library 170 and disk 180 are shown, multiple initiators and target devices can be attached to Fibre Channel hub 160 and through it to Fibre Channel-to-SCSI router 150. Fibre Channel SAN 115 can thus comprise multiple hosts and multiple initiators. Connecting two or more SANs together using an extender protocol, such as the encapsulation protocol of this invention, requires mapping the local address of each SCSI device on one SAN to an intermediate address to get across the extender, and then mapping each intermediate address into a remote address on a remote SAN This mapping is required to allow initiators on one SAN to address SCSI devices on a remote SAN as if they were SCSI devices on the local SAN to which the initiator is attached In this way, devices on a remote SAN can be represented in such a way that they are made available to initiators on other SANs Related patent application entitled " ," Serial
No , filed on , discloses a method and system for mapping addresses of
SCSI devices between two or more SANs connected by a SAN extender, such as the encapsulation protocol of this invention This application is hereby incorporated by reference in its entirety as disclosing one compatible method for mapping addresses of SCSI devices between two SANs that can be used with the present invention
The method and system of this invention provide a means to define the communications across the extension protocol, I e , a means to map Fibre Channel data into an extension protocol such that it can be decoded back to a Fibre Channel protocol for communication with a target at a remote SAN The present invention thus defines a protocol that can be used to encapsulate Fibre Channel in a packet-based network This is accomplished by converting data to be transmitted from the protocol to be extended (Fibre Channel) to the extension protocol (the packet-based protocol for the particular application) and back to the extended protocol (Fibre Channel) at the remote SAN The encapsulation protocol of the present invention can be configured to convert specific commands for a given protocol and can be extended to include new commands as the Fibre Channel protocol expands to provide new functionality Any Fibre Channel commands or messages referenced in the present invention are illustrative but not exclusive
The EP layer of the method and system of the present invention is composed of two parts Aspen Node Management (ANM) and Fibre Channel Protocol-Encapsulation Protocol (FCP-EP) These names have been arbitrarily chosen for descπptive purposes only ANM can be thought of as the control mechanism It defines a client server environment so that multiple SANs with multiple initiators and multiple targets can be managed concurrently as individual nodes on, for example, WAN 140 of FIGURE 1 In a multi-node environment, one node is designated as a server node and all nodes (including the server node) are clients The following messages are used to define and manage the ANM control mechanism • Client Node Register Used by a client node to register with the server node This registers the client's EP address to allow the server to open future connections to the client (if necessary) • Client Node Target Register Used by a client node to register FC targets with the server node This registers all FC targets found on the local FC network • Target Table Update Sent by the server node to update a client's global target table The Target Table Update contains all entnes for all registered clients but does not dictate the format of the table used by a client Each client can format the Target Table in a format that best optimizes the use of the table by each client node • Target Address Freeze Sent by the server node to notify a client node that there is going to be a Target Table Update and all FCP-EP outbound messages should be suspended until the Target Table Update message is received
• Node Acknowledgment An acknowledgment frame for ANM messages It is used for flow control purposes FCP-EP can be thought of as a data mechanism It defines the disassembly and reassembly of
FCP frames for transport across WAN 140 The FCP-EP layer can itself be a packet-based protocol with payload definitions that are very similar to the payload definitions of SCSI-FCP sequences During disassembly, the FCP sequences from the local SAN can be divided into smaller packets that are compatible with the lower-level transport protocol being used (e g , ATM or Ethernet) Message identifiers are used to retain sequence information duπng disassembly The disassembled sequences are then combined into frames for transport across the physical link Once across the link, another node receives these frames and uses the message identifiers to reassemble the FCP sequences The packets can then be ready for transmission to the local SAN in the same format in which they were originally produced The following messages are used to define and manage the FCP-EP data mechanism
• SCSI Command Contains the information for a new FCP command
• SCSI Command Plus Data Contains the information for a new FCP command as well as a block of data for the specified FCP command
• SCSI Data Request Contains information regarding data transfer size for a write request This message requests an amount of data specified by a Data Size field, starting at a relative offset specified by a Relative Offset field
• SCSI Data Contains a block of data and is used for reads and writes
• SCSI Data Response Contains a block of data as well as FCP response information
• SCSI Response Contains FCP response information • SCSI Abort Request Used to notify of an abort condition for an I/O
• SCSI Data Acknowledgement An acknowledgement frame for FCP-EP messages It is used for flow control purposes
The method and system of this invention can be implemented within a Fibre Channel-to-SCSI router such as routers 120, 130 and 150 of FIGURE 1 (nodes 120, 130 and 150) The present invention can be implemented purely as software instructions stored withm memory within the Fibre Channel-to-SCSI routers and can be easily upgraded as new versions with new functionality are created. No change in the hardware of existing Fibre Channel-to-SCSI routers, is required to incorporate this invention. The memory in which the software instructions of this invention are stored can be RAM (random access memory) or ROM (read-only memory), or other memory storage device. An implementation of the present invention can include a dynamic discovery mechanism by which each node (router) in a multi-node implementation can communicate with every other node in order to, for example, initially discover the presence of other such nodes within the system. This dynamic discovery mechanism can be used to allow each node to communicate with every other node through a common server. Each node in the network can thus discover the presence of other nodes and communicate to the other nodes what attached targets it has available. Each node can receive this information from every other node and can represent to their own attached hosts, or to technicians configuring each router (node), all of the available targets on all the available nodes.
At least one router (node) must be designated as the server through which this discovery functionality can be implemented. Other routers can also be designated as servers for, for example, fail over and error recovery cases or as a back-up. The server "module," in fact, need not reside within a Fibre Channel-to-SCSI router in the SAN. It could, instead, be a separate device that simply provides the server functionality. A Fibre Channel-to-SCSI router can, however, contain and provide the server function. If the server function is provided by a separate device, the separate server can be integrated into the standard network equipment not within the SAN, and the routers of the SAN can communicate with this server to receive the required information. The server would thus be a true "server," instead of an additional function within a Fibre Channel-to-SCSI router.
The server function of this invention can be analogized to a DNS server within an IP network. The DNS server exists in the network infrastructure and knows how to communicate with the main servers. There is a defined protocol by which the main servers in an IP network can discover each other. The dynamic discovery mechanism of the present invention provides essentially the same function, and can thus be integrated into the network, leaving the Fibre Channel-to-SCSI routers to be simple client nodes that can communicate with one another and with the server to discover information about any other nodes on the network.
The encapsulation protocol method and system of the present invention can be used over existing internet infrastmcmres and other existing network protocols. For example, the extension protocol can be a typical IP network protocol, an ATM network, gigabit Ethernet, or any protocol that allows data packets to flow between nodes. The method and system of this invention, by encapsulating Fibre Channel SCSI, provide a means by which data can be routed between any SCSI protocol SANs on either end of an extension network. The method and system of this invention define a dynamic way to discover all the nodes available within a network implementation, so that a 1-to-n or an n-to-n relationship can be established between multiple nodes (routers) having multiple targets and initiators Each node (router) is an access point to its respective SAN
By encapsulating the Fibre Channel protocol messages, the method and system of this invention extend standardized messages across the intervening WAN 140 in such a way that they can be de-coded at a remote SAN and acted on within the remote SAN without loss or corruption
Standardized messages can thus be extended across WAN 140 from a local SAN to a remote SAN without the need for a proprietary protocol format
In operation, when a Fibre Channel-to-SCSI router implementing this invention first comes online within a storage area network 110 or 115, it registers with the designated server to identify itself to the network and to receive in exchange information about every other node present on the network, and of the SCSI targets available on each node Similarly, the designated server can detect when a Fibre Channel-to-SCSI router drops from the network due to maintenance or malfunction This functionality can be provided with, for example, a heartbeat message within the Fibre Channel SCSI protocol There is currently no known theoretical limit to the number of nodes a storage area network implementing the present invention can contain Instead the number of nodes is constrained by hardware limitations, in particular by the amount of memory within a Fibre Channel-to-SCSI router
The present invention is not limited to use in applications having storage area networks that each use the same Fibre Channel protocol For example, host 115 and hosts 110 of FIGURE 1 can each use a different protocol and still function properly using the encapsulation protocol of the present invention By encapsulating Fibre Channel SCSI as the intermediary, the present invention provides sufficient information for translation to occur between, for example, a Fibre Channel network on one side of the extender and a parallel SCSI network on the other side of the extender With sufficient information within the messages of the Fibre Channel protocol being encapsulated, the present invention can perform this translation between any two types of SCSI networks
In summary, one embodiment of the method of the present invention comprises the following steps A Fibre Channel-to-SCSI router is brought online, the router communicates with a designated server to identify itself to the network and also to receive information of the other available nodes on the network The Fibre Channel-to-SCSI router will also receive information on the available devices attached to each of the other network nodes This process occurs at each node as it comes online on the storage area network The method and system of the present invention thus determines at each node what other nodes are available and what devices are attached to each of those nodes
The method of this invention represents each available device at each node as either a single target having one or more LUNs, or as a group of targets with one or more LUNs, and makes designed devices available to all other hosts on the local storage area network This means that each node coming online represents the reported devices on other nodes in such a way that they are made available to its own hosts
Communications from hosts attached to a Fibre Channel-to-SCSI router coming online can then be encapsulated and sent across to available devices over the extender through WAN 140 and, similarly, encapsulated messages can be received at the local node and passed on to its local hosts This invention can thus encapsulate the I/O phases between a local host and remote devices that are made available to the host The I/O phases encapsulated between a local host and a remote device can include, for example, a command phase, a data phase and a response phase
A host can thus send a command which is encapsulated by its associated Fibre Channel-to- SCSI router (node) and forwarded over the extender (WAN 140) to a remote node associated with the device for which the command is intended The remote node will de-encapsulate the command and forward it to the intended device The device may then send back data or a response, or data and a response, which are then encapsulated by the remote node and sent to the node associated with the initiator (host) sending the command The node associated with the initiating host receives and de- encapsulates the response or data, or combination of the two, and forwards them to the host This sequence of command, data and/or response can comprise an I/O phase to be encapsulated The present invention provides the encapsulation protocol but does not alter the data transmitted between host and device in any other way
The step of encapsulating the I/O phases between a local host and a remote device is repeated as necessary for subsequent I/Os Encapsulation can be performed between multiple hosts attached to multiple nodes communicating with multiple devices, all associated with multiple local or remote SANs In this way, the method and system of this invention establish an initial network configuration and maintain communication between local routers in a local SAN and remote routers at one or more remote SANs, or between other local routers within the same SAN The step of encapsulating the I/O phases can further comprise encapsulating individual commands and messages for a given Fibre Channel, SCSI or other protocol For example, task management functions, error recovery functions, and other I/O processing functions can be encapsulated Furthermore, the method and system of this invention can be easily expanded to provide the same encapsulation function for additional commands and messages that may be added to existing protocols
The present invention provides the capability for extending an SAN model to many SANs over distances much greater than those currently allowed by the Fibre Channel protocol This invention provides the capability to interconnect SANs in geographically diverse locations, such as different cities, in such a way that they can function in a seamless manner as if they compπse a single local SAN Further, for storage recovery purposes, the present invention allows a back-up library to reside off-site at a remote location, thus ensuring data integrity should the local location be damaged by some failure or disaster.
Although the present invention has been described in detail herein with reference to the illustrative embodiments, it should be understood that the description is by way of example only and is not to be construed in a limiting sense. It is to be further understood, therefore, that numerous changes in the details of the embodiments of this invention and additional embodiments of this invention will be apparent to, and may be made by, persons of ordinary skill in the art having reference to this description. It is contemplated that all such changes and additional embodiments are within the spirit and true scope of this invention as claimed below.

Claims

1. A method for encapsulating SCSI protocol for data transmission between two or more nodes across a packet-based network, comprising, at each node:
(a) identifying all other available nodes, and remote devices attached to each of said nodes, on said network;
(b) representing one or more of said remote devices such that they are made available to one or more local hosts;
(c) encapsulating an input/output (I/O) phase between one or more of said local hosts and one or more of said remote devices; and (d) repeating step (c) for subsequent I/O phases.
2. The method of Claim 1, wherein said input/output phase comprises a command phase, a data phase and a response phase.
3. The method of Claim 1, wherein encapsulating said I/O phase comprises encapsulating an individual command for a Fibre Channel or SCSI protocol.
4. The method of Claim 3, wherein said individual command is a task management function, an error recovery function or other I/O processing function.
5. The method of Claim 1, wherein each of said two or more nodes is communicatively connected to a Storage Area Network ("SAN").
6. The method of Claim 5, wherein each of said two or more nodes is an interface between its SAN and said packet-based network.
7. The method of Claim 5, wherein one of said SANs is a back-up library.
8. The method of Claim 1, wherein each of said nodes is a Fibre-Channel-to-SCSI router.
9. The method of Claim 1, wherein said SCSI protocol is a Fibre Channel SCSI protocol.
10. The method of Claim 1 , wherein said packet-based network is an Asynchronous
Transfer Mode ("ATM") network, an Ethernet network, an IP network or a SONET network.
11. The method of Claim 1 , wherein said packet-based network is a wide are network ("WAN").
12. The method of Claim 1, wherein said packet-based network is a dedicated link.
13. The method of Claim 1 , wherein said packet-based network is a switched network.
14. The method of Claim 1, wherein said representing step further comprises the steps of: mapping a local address for each of one or more of said remote devices attached to a node to an intermediate address; and mapping each of said intermediate addresses into a remote address at another node.
15. The method of Claim 1 , wherein said encapsulating step further comprises the steps of: converting said I/O phase from said SCSI protocol to a protocol associated with said packet- based network; and converting back said I/O phase to said SCSI protocol at a remote node.
16. The method of Claim 15, wherein said protocol associated with said packet-based network is an Asynchronous Transfer Mode ("ATM") protocol, an Ethernet protocol, an IP protocol or a SONET protocol.
17. The method of Claim 1 , wherein said identifying step further comprises dynamically discovering all other available nodes, and the devices attached to said nodes, through a common server.
18. The method of Claim 17, wherein at least one of said two or more nodes is designated as said common server.
19. The method of Claim 17, wherein said common server is a separate device from said nodes.
20. The method of Claim 17, further comprising a heartbeat message for determining, at said common server, if a node drops from said network.
21. The method of Claim 1 , wherein said packet-based network is any network that allows data packets to flow between nodes.
22. The method of Claim 1 , wherein different ones of said two or more nodes can be communicatively connected to a SAN using different network protocols.
23. A system for encapsulating SCSI protocol for data transmission between two or more nodes across a packet-based network, comprising, at each node:
(a) instructions for identifying all other available nodes, and remote devices attached to each of said nodes, on said network;
(b) instructions for representing one or more of said remote devices such that they are made available to one or more local hosts;
(c) instructions for encapsulating an input/output (I/O) phase between one or more of said local hosts and one or more of said remote devices; and (d) instructions for repeating step (c) for subsequent I/O phases.
24. The system of Claim 23, wherein said input/output phase comprises a command phase, a data phase and a response phase.
25. The system of Claim 23, wherein all instructions are stored in memory within each of said nodes.
26. The system of Claim 23, wherein said instructions for encapsulating said I/O phase comprise instructions for encapsulating an individual command for a Fibre Channel or SCSI protocol.
27. The system of Claim 26, wherein said individual command is a task management function, an error recovery function or other I/O processing function.
28. The system of Claim 23, further comprising a Storage Area Network ("SAN") communicatively connected to each of said two or more nodes.
29. The system of Claim 28, wherein each of said two or more nodes is an interface between its SAN and said packet-based network.
30. The system of Claim 28, wherein at least one of said SANs is a back-up library.
31. The system of Claim 23, wherein each of said nodes is a Fibre-Channel-to-SCSI router.
32. The system of Claim 23, wherein said SCSI protocol is a Fibre Channel SCSI protocol.
33. The system of Claim 23, wherein said packet-based network is an Asynchronous Transfer Mode ("ATM") network, an Ethernet network, an IP network or a SONET network.
34. The system of Claim 23, wherein said packet-based network is a wide are network
("WAN").
35. The system of Claim 23, wherein said packet-based network is a dedicated link.
36. The system of Claim 23, wherein said packet-based network is a switched network.
37. The system of Claim 23, wherein said instmctions for representing further comprise: instructions for mapping a local address, for each of one or more of said remote devices attached to a node, to an intermediate address; and instructions for mapping each of said intermediate addresses into a remote address at another node.
38. The system of Claim 23, wherein said instmctions for encapsulating further comprise: instructions for converting said I/O phase from said SCSI protocol to a protocol associated with said packet-based network; and instructions for converting back said I/O phase to said SCSI protocol at a remote node.
39. The system of Claim 38, wherein said protocol associated with said packet-based network is an Asynchronous Transfer Mode ("ATM") protocol, an Ethernet protocol, an IP protocol or a SONET protocol.
40. The system of Claim 23, further comprising a common server, and wherein said instructions for identifying further comprise instructions for dynamically discovering all other available nodes, and the devices attached to said nodes, through said common server.
41. The system of Claim 40, wherein at least one of said two or more nodes is designated as said common server.
42. The system of Claim 40, wherein said common server is a separate device from said nodes.
43. The system of Claim 40, further comprising instmctions for a heartbeat message to determine, at said common server, if a node drops from said network.
44. The system of Claim 23, wherein said packet-based network is any network that allows data packets to flow between nodes.
45. The system of Claim 23, wherein different ones of said two or more nodes can be communicatively connected to a SAN using different network protocols.
PCT/US2000/042087 1999-11-12 2000-11-13 Encapsulation protocol for linking storage area networks over a packet-based network WO2001044891A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
AU47070/01A AU4707001A (en) 1999-11-12 2000-11-13 Encapsulation protocol for linking storage area networks over a packet-based network
CA002391353A CA2391353A1 (en) 1999-11-12 2000-11-13 Encapsulation protocol for linking storage area networks over a packet-based network
JP2001545919A JP2003517765A (en) 1999-11-12 2000-11-13 Encapsulation protocol that links storage area networks via packet-based networks
EP00992795A EP1240575A2 (en) 1999-11-12 2000-11-13 Encapsulation protocol for linking storage area networks over a packet-based network

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16519499P 1999-11-12 1999-11-12
US60/165,194 1999-11-12

Publications (2)

Publication Number Publication Date
WO2001044891A2 true WO2001044891A2 (en) 2001-06-21
WO2001044891A3 WO2001044891A3 (en) 2002-01-24

Family

ID=22597864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/042087 WO2001044891A2 (en) 1999-11-12 2000-11-13 Encapsulation protocol for linking storage area networks over a packet-based network

Country Status (6)

Country Link
EP (1) EP1240575A2 (en)
JP (1) JP2003517765A (en)
CN (1) CN1409903A (en)
AU (1) AU4707001A (en)
CA (1) CA2391353A1 (en)
WO (1) WO2001044891A2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2372600A (en) * 2001-02-27 2002-08-28 3Com Corp Network area storage block and file aggregation
WO2002075569A1 (en) * 2001-03-16 2002-09-26 San Valley Systems, Inc. Encapsulating fibre channel signals for transmission over non-fibre channel networks
WO2005062578A1 (en) * 2003-12-19 2005-07-07 Intel Corporation (A Delaware Corporation) Method and architecture for optical networking between server and storage area networks
US6925533B2 (en) 2003-05-07 2005-08-02 International Business Machines Corporation Virtual disk image system with local cache disk for iSCSI communications
EP1604216A2 (en) * 2003-03-18 2005-12-14 Cisco Technology, Inc. Method and system for emulating a fibre channel link over a sonet/sdh path
WO2006118591A1 (en) * 2005-04-29 2006-11-09 Network Appliance, Inc. System and method for proxying network management protocol commands to enable cluster wide management of data backups
JP2007282197A (en) * 2001-09-27 2007-10-25 Emc Corp Remote data facility over ip network
CN100353307C (en) * 2006-02-16 2007-12-05 杭州华三通信技术有限公司 Storage system and method of storaging data and method of reading data
US7447788B2 (en) 2004-01-27 2008-11-04 Dell Products L.P. Providing host information to devices in multi SCSI transport protocols
US7586942B2 (en) 2003-12-09 2009-09-08 Dell Products L.P. Identifying host computers at a physical layer

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7298973B2 (en) * 2003-04-16 2007-11-20 Intel Corporation Architecture, method and system of multiple high-speed servers to network in WDM based photonic burst-switched networks
US11108591B2 (en) 2003-10-21 2021-08-31 John W. Hayes Transporting fibre channel over ethernet
US7653054B2 (en) * 2005-03-28 2010-01-26 Cisco Technology, Inc. Zone based quality of service in a fibre channel fabric
CN101494643B (en) * 2008-01-24 2012-03-28 中国移动通信集团公司 Method, device and system for exiting distributed wireless access system
JP5203041B2 (en) * 2008-05-22 2013-06-05 エヌイーシーコンピュータテクノ株式会社 Network system, network connection method, connection device, connection card

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5519695A (en) * 1994-10-27 1996-05-21 Hewlett-Packard Company Switch element for fiber channel networks
US5768623A (en) * 1995-09-19 1998-06-16 International Business Machines Corporation System and method for sharing multiple storage arrays by dedicating adapters as primary controller and secondary controller for arrays reside in different host computers
US5925119A (en) * 1997-03-28 1999-07-20 Quantum Corporation Computer architecture for automated storage library
US5941972A (en) * 1997-12-31 1999-08-24 Crossroads Systems, Inc. Storage router and method for providing virtual local storage
US5959994A (en) * 1996-08-19 1999-09-28 Ncr Corporation ATM/SONET network enhanced as a universal computer system interconnect
US5978875A (en) * 1996-03-18 1999-11-02 Kabushiki Kaisha Toshiba Apparatus and method for scheduling use of bus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5519695A (en) * 1994-10-27 1996-05-21 Hewlett-Packard Company Switch element for fiber channel networks
US5768623A (en) * 1995-09-19 1998-06-16 International Business Machines Corporation System and method for sharing multiple storage arrays by dedicating adapters as primary controller and secondary controller for arrays reside in different host computers
US5978875A (en) * 1996-03-18 1999-11-02 Kabushiki Kaisha Toshiba Apparatus and method for scheduling use of bus
US5959994A (en) * 1996-08-19 1999-09-28 Ncr Corporation ATM/SONET network enhanced as a universal computer system interconnect
US5925119A (en) * 1997-03-28 1999-07-20 Quantum Corporation Computer architecture for automated storage library
US5941972A (en) * 1997-12-31 1999-08-24 Crossroads Systems, Inc. Storage router and method for providing virtual local storage

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2372600B (en) * 2001-02-27 2003-02-19 3Com Corp Network area storage block and file aggregation
GB2372600A (en) * 2001-02-27 2002-08-28 3Com Corp Network area storage block and file aggregation
WO2002075569A1 (en) * 2001-03-16 2002-09-26 San Valley Systems, Inc. Encapsulating fibre channel signals for transmission over non-fibre channel networks
US7114009B2 (en) 2001-03-16 2006-09-26 San Valley Systems Encapsulating Fibre Channel signals for transmission over non-Fibre Channel networks
JP2007282197A (en) * 2001-09-27 2007-10-25 Emc Corp Remote data facility over ip network
EP1604216A4 (en) * 2003-03-18 2008-05-07 Cisco Tech Inc Method and system for emulating a fibre channel link over a sonet/sdh path
EP1604216A2 (en) * 2003-03-18 2005-12-14 Cisco Technology, Inc. Method and system for emulating a fibre channel link over a sonet/sdh path
US6925533B2 (en) 2003-05-07 2005-08-02 International Business Machines Corporation Virtual disk image system with local cache disk for iSCSI communications
US7586942B2 (en) 2003-12-09 2009-09-08 Dell Products L.P. Identifying host computers at a physical layer
WO2005062578A1 (en) * 2003-12-19 2005-07-07 Intel Corporation (A Delaware Corporation) Method and architecture for optical networking between server and storage area networks
US7634582B2 (en) 2003-12-19 2009-12-15 Intel Corporation Method and architecture for optical networking between server and storage area networks
US7447788B2 (en) 2004-01-27 2008-11-04 Dell Products L.P. Providing host information to devices in multi SCSI transport protocols
WO2006118591A1 (en) * 2005-04-29 2006-11-09 Network Appliance, Inc. System and method for proxying network management protocol commands to enable cluster wide management of data backups
US8886778B2 (en) 2005-04-29 2014-11-11 Netapp, Inc. System and method for proxying network management protocol commands to enable cluster wide management of data backups
CN100353307C (en) * 2006-02-16 2007-12-05 杭州华三通信技术有限公司 Storage system and method of storaging data and method of reading data

Also Published As

Publication number Publication date
JP2003517765A (en) 2003-05-27
CN1409903A (en) 2003-04-09
AU4707001A (en) 2001-06-25
CA2391353A1 (en) 2001-06-21
EP1240575A2 (en) 2002-09-18
WO2001044891A3 (en) 2002-01-24

Similar Documents

Publication Publication Date Title
US6848007B1 (en) System for mapping addresses of SCSI devices between plurality of SANs that can dynamically map SCSI device addresses across a SAN extender
US6965934B1 (en) Encapsulation protocol for linking storage area networks over a packet-based network
JP5068055B2 (en) Data processing system, address assignment method and computer program (obtaining multiple port addresses from the network fabric with Fiber Channel switches)
EP1797687B1 (en) Fibre channel transparent switch for mixed switch fabrics
US5954796A (en) System and method for automatically and dynamically changing an address associated with a device disposed in a fire channel environment
US7437477B2 (en) SCSI-based storage area network having a SCSI router that routes traffic between SCSI and IP networks
WO2011121664A1 (en) Communication network control system and control method
EP1240575A2 (en) Encapsulation protocol for linking storage area networks over a packet-based network
US20060034302A1 (en) Inter-fabric routing
US20020116564A1 (en) Fibre channel port adapter
US20050138184A1 (en) Efficient method for sharing data between independent clusters of virtualization switches
JP2002534880A (en) Network self-describing extended link service
CN1985492B (en) Method and system for supporting iSCSI read operations and iSCSI chimney
US7409432B1 (en) Efficient process for handover between subnet managers
US7103711B2 (en) Data logging by storage area network devices to a reserved storage area on the network
JP2004503122A (en) Method and apparatus for transferring data between different network devices via an IP network
CN101207569B (en) Method and device for determining communication paths on computer networks
US8051203B2 (en) Providing SCSI acceleration as a service in the SAN
WO2001035188A2 (en) Method and system for mapping addressing of scsi devices between storage area networks
EP1324536B1 (en) A method for managing data transfers in a computer network
US7155537B1 (en) Infiniband isolation bridge merged with architecture of an infiniband translation bridge
CN111078154A (en) Method and system for quickly loading data
Cisco Configuring IBM Network Media Translation
US7925758B1 (en) Fibre accelerated pipe data transport
US20040143682A1 (en) Network switch containing a hard disk drive

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2391353

Country of ref document: CA

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2001 545919

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 47070/01

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2000992795

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 008171564

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2000992795

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 2000992795

Country of ref document: EP