US7103653B2 - Storage area network management system, method, and computer-readable medium - Google Patents

Storage area network management system, method, and computer-readable medium Download PDF

Info

Publication number
US7103653B2
US7103653B2 US09/779,844 US77984401A US7103653B2 US 7103653 B2 US7103653 B2 US 7103653B2 US 77984401 A US77984401 A US 77984401A US 7103653 B2 US7103653 B2 US 7103653B2
Authority
US
United States
Prior art keywords
storage
access
information
host
management mechanism
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime, expires
Application number
US09/779,844
Other versions
US20010054093A1 (en
Inventor
Sawao Iwatani
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Assigned to FUJITSU LIMITED reassignment FUJITSU LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IWATANI, SAWAO
Publication of US20010054093A1 publication Critical patent/US20010054093A1/en
Application granted granted Critical
Publication of US7103653B2 publication Critical patent/US7103653B2/en
Adjusted expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • H04L41/0813Configuration setting characterised by the conditions triggering a change of settings
    • H04L41/0816Configuration setting characterised by the conditions triggering a change of settings the condition being an adaptation, e.g. in response to network events
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0866Checking the configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0876Aspects of the degree of configuration automation
    • H04L41/0883Semiautomatic configuration, e.g. proposals from system

Definitions

  • the present invention pertains to the management systems of storage area networks (hereafter referred to as SAN) that join several servers and several storage devices using fiber channel networks.
  • SAN storage area networks
  • a storage area network joining several servers and several storage devices together in this way is referred to as a storage area network (hereafter referred to as a SAN) and attempts are being made to reduce the total cost of ownership (TCO) or manage the storage needs of several servers that are increasingly dispersed.
  • TCO total cost of ownership
  • One of these problems is that it is possible for data in one storage device that is being used by one host to be inadvertently destroyed by another host when a SAN is made up of several host computers (hereafter referred to as hosts) and several storage systems. This is because all of the hosts are capable of accessing all of the storage systems.
  • SAN storage area network
  • FCA fiber channel adapter
  • HBA host bus adapter
  • WWN world wide name
  • PID port identification
  • TCO total cost of ownership
  • the present invention solves the above-mentioned problems.
  • An object of the present invention is to integrate and manage the traditionally dispersed security system from a single source.
  • Another object of the present invention is to provide good security administration automatically in a storage area network (SAN).
  • SAN storage area network
  • the present invention comprises a storage area network management system, method, and computer-readable medium storing a program executing processes.
  • the storage area network management system, method, and computer readable medium of the present invention comprise host computers, storage devices, switches, and an integrated management mechanism.
  • Each of the host computers comprises a storage area network management mechanism.
  • Each of the storage devices comprises a storage management mechanism.
  • the switches are coupled to the host computers and to the storage devices.
  • the switches interconnect the host computers and the storage devices.
  • Each of the switches comprises a region-setting mechanism.
  • the integrated management mechanism integrates and controls the storage area network.
  • the integrated management mechanism includes access route information of the host computers and the storage devices and, based on the access route information, transmits access management information to the storage devices and the storage area network management mechanisms of the host computers, transmits region information to the region-setting mechanisms of the switches, and transmits access limit information concerning the host computers to the storage management mechanisms of the storage devices.
  • the storage area network management system, method, and computer-readable medium of the present invention comprises the integrated management mechanism detecting whether fiber channel adapters mounted on the storage devices and the host computers, the host bus adapters mounted on the host computers, or the switches in the storage area network management system are replaced, obtaining settings information following the replacement from the storage area network management mechanism of the host computers, the switch region-setting mechanism, or the storage device storage management mechanism, and reconfiguring the access relationships to be equivalent to the access relationships prior to the replacement.
  • the storage area network management system, method, and computer-readable medium of the present invention integrates problem reports from related problems into a single problem report.
  • the present invention comprises a method of a storage area network system comprising integrating and controlling the storage area network by an integrated management mechanism managing access relationships between host computers of the storage area network and storage devices of the storage area network.
  • FIG. 1 is a schematic diagram of the present invention.
  • FIG. 2 is a diagram showing a typical SAN system configuration suitable for the present invention.
  • FIG. 3 is a diagram showing the configuration of the SAN management system of one embodiment of the present invention.
  • FIG. 4 is a diagram showing a typical storage device hardware configuration.
  • FIGS. 5( a ), 5 ( b ), 5 ( c ), and 5 ( d ) are diagrams showing examples of access pass settings information, a storage affinity table, a switch, a zoning table and a host affinity table.
  • FIG. 6 is a flowchart showing the process performed by the SAN integrated management mechanism of the present invention.
  • FIG. 7 is a flowchart showing the process performed by the zoning settings mechanism.
  • FIG. 8 is a diagram describing a SAN problem management.
  • FIG. 9 is a diagram showing a typical problem report method definition.
  • FIG. 10 is a flowchart of the SAN problem monitoring function performed by the SAN integrated management mechanism.
  • FIG. 1 is a schematic diagram of a Storage Area Network Management system 100 of the present invention.
  • the Storage Area Network Management system 100 of the present invention installs in a SAN environment, an integrated management mechanism 1 of the present invention that integrates and controls the SAN so that all of the access relationships of the hosts 2 and the storage devices 4 are managed using the integrated management mechanism 1 .
  • the system administrator sets up the regions on the storage device 4 side that are to access the integrated management mechanism 1 from the host 2 side as well as the fiber channel adapter (FCA) and host bus adapter (HBA) to be used when accessing that storage. These settings are referred to as the access paths.
  • FCA fiber channel adapter
  • HBA host bus adapter
  • this integrated management mechanism 1 Based on the access path information that was set up, this integrated management mechanism 1 first establishes the storage settings (or Storage affinity) that is seen from the host 2 side by the SAN management mechanism 2 a on the host 2 side.
  • the integrated management mechanism 1 establishes the zoning for the switch 3 zoning setting mechanism 3 a by securing the World Wide Name (WWN) and Port Identification (PID) information that the FCA and HBA have and then makes calculations that allow the access paths that were set up based on that information to be configured.
  • WWN World Wide Name
  • PID Port Identification
  • the settings are made in the storage management mechanism 4 a of the storage device 4 , to determine which FCA is to permit access to which HBA (WWN or PID) and to which regions.
  • installing the integrated management mechanism 1 makes it possible to conduct comprehensive security management and storage region to management in a storage area network system.
  • the integrated management mechanism 1 by setting up the above integrated management mechanism 1 so that the integrated management mechanism 1 holds the SAN configuration status as the configuration setting information 1 a , it is easy for the SAN to accommodate hosts that do not have SAN management functions or switches that do not have zoning devices, allowing for as much security as possible.
  • Integrated management mechanism 1 secures the SAN configuration status from individual devices and stores that as configuration settings information 1 a . Then, either at regular intervals or when given a command by a system administrator, the integrated management mechanism 1 reads in the current SAN configuration status and compares that with the SAN configuration settings information 1 a . If they differ, the integrated management mechanism 1 determines that there is a problem and notifies the system administrator. This makes it easy for system administrators to be able to learn about SAN problems.
  • the integrated management mechanism 1 secures access relationships information from the SAN management mechanism 2 a , the zoning settings mechanism 3 a and the storage management mechanism 4 a , and checks the compatibility of the access paths. If the access paths are not set up correctly, the integrated management mechanism 1 notifies the system administrator as to where the problem is. This makes it possible for the system administrator to verify the compatibility of the access paths.
  • the aforementioned integrated management mechanism 1 detects this, obtains the settings information after the replacement from the host 2 SAN management mechanism 2 a , the switch 3 zoning settings mechanism 3 a , or the storage management mechanism 4 a of the storage device 4 , and reconfigures the access relationships so that they will be equivalent to those prior to the replacement. This makes it possible to respond easily to modifications in the SAN configuration easily.
  • the settings to switch 3 are configured such that no access is allowed. This makes it possible to avoid settings which allow accidental access when the system is first started up and no access paths have been set up.
  • the transfer class to use is specified by the system administrator and, through the SAN management mechanism 2 a , the storage management mechanism 4 a , the integrated management mechanism 1 is set up so that the access paths set by the HBA and the FCA operate using the same transfer classes. This allows the elimination of the problem of being unable to transfer data when the transfer classes differ.
  • the integrated management mechanism 1 When a problem occurs inside the SAN, first, the integrated management mechanism 1 receives a report of that problem and temporarily stops sending reports to the system administrator. It then waits for a specific period of time to see if there have been any reports from any of the other devices managed by the integrated management mechanism 1 . It checks the content of any reports received during this waiting period against the WWN, PID and access path information of each adapter that the integrated management mechanism 1 holds and checks for a possible relationship to the problem reported first. If it is determined that there is a relationship, only one problem is reported to the system administrator. Based on this information, the system administrator can determine immediately the problem area.
  • the integrated management mechanism 1 secures not only settings information for each of the access paths in advance, it also secures logical volume information on the host 2 side that is used on each access path as well as information from the SAN management mechanism 2 a on the host 2 side and stores it as the configuration settings information la of the integrated management mechanism 1 .
  • the integrated management mechanism 1 reads in the configuration settings information 1 a in the integrated management mechanism 1 for the access path using the affected spot and reads the host logical volume using that access path and reports the logical volumes affected by the trouble to the system administrator. Once the logical volume affected by the problem is known, the recovery of that logical volume can be started immediately and the effect on business operations can be kept to a minimum.
  • FIG. 2 shows an example of a SAN system configuration 200 that could be used with the present invention discussed with reference to FIG. 1 .
  • the LAN (local area network) 210 in which many host computers (hereafter referred to as hosts) H 1 ⁇ Hn, management servers S which function as SAN comprehensive management devices (discussed below), the aforementioned switches SW 1 ⁇ SWm , the storage devices ST, and the magnetic tape devices MT are connected.
  • the SAN 220 (storage area network) is equipped with the hosts Hi ⁇ Hn, the switches SW, the storage devices ST, the magnetic tape devices MT and other devices. There are data paths among the various hosts H 1 ⁇ Hn, the switches SW 1 ⁇ SWm, the storage devices ST and the magnetic tape devices MT. Access between the hosts H 1 ⁇ Hn to the storage devices ST and other devices has priority over the data paths.
  • the information showing the configuration status of the SAN 220 is also transferred by the storage device ST over the LAN to the management server S and all of the settings information that comes from the management server S is transferred to the host computers H 1 ⁇ Hn, the switches SW and the storage devices ST.
  • FIG. 3 is a diagram showing the configuration of the storage area network (SAN) 200 of the embodiment of the present invention.
  • the SAN 200 includes the hosts 110 and 120 , the switch 300 and the storage devices 410 and 420 .
  • the hosts 110 and 120 are connected to the switches 300 by the fiber channel 303 , 304 through the host bus adapters (hereafter referred to as HBA) 111 , 112 and 121 .
  • the storage devices 410 and 420 are also connected to the switches 300 by the fiber channel adapters (hereafter referred to as FCA) 411 , 412 and 421 .
  • FCA fiber channel adapters
  • FIG. 4 shows an example of a hardware configuration of a storage device 430 corresponding to one of the storage devices 410 , 420 shown in FIG. 3 .
  • the subsystem control module 11 includes a memory 11 a , an MPU 11 b and a bus interface module 11 c .
  • the aforementioned MPU 11 b runs programs stored in the memory 11 a . In addition to programs, transfer data and control data are also stored in the memory 11 a.
  • Device control module 13 includes buffer 13 a , MPU 13 b and memory 13 c .
  • Memory 13 c stores programs that run on the aforementioned MPU 13 b and bus interface module 13 d.
  • the aforementioned subsystem control module 11 and the device control module 13 are connected to each other through the bus 138 .
  • the device control module 13 is connected to the disk drive group 15 through the device I/F module 14 .
  • the management mechanism 500 (corresponding to the management server S in FIG. 2 , mentioned above, which includes this function) which integrates and controls the SAN, was installed in this embodiment as shown in FIG. 3 .
  • the embodiment of SAN 220 is set up so that the management mechanism 500 can manage the access relationships between the hosts 110 and 120 and the storage devices 410 and 420 , as shown in FIG. 3 .
  • the SAN management mechanisms 118 and 128 are also installed on the hosts 110 and 120 and the storage management mechanisms 418 and 428 are installed on the storage devices 410 and 420 in order to respond to control from the management mechanism 500 .
  • the SAN management mechanisms are mechanisms that set up the storage affinity; also as described above, the storage management mechanisms are mechanisms that set up the host affinity.
  • the switch zoning settings mechanism 301 is installed on the switch 300
  • the system administrator sets up the region on the storage side that attempts to access the SAN integrated management mechanism 500 from the host side and the FCA (fiber channel adapter) and the HBA (host bus adapter) that are used when accessing that storage. These settings are referred to as the access path settings.
  • the access path information that has been set up is stored as access path settings information 600 in the SAN integrated management mechanism 500 shown in FIG. 5( a ).
  • the storage settings (Storage affinity) that can be seen from the host side are set up on the SAN management mechanisms 118 and 128 on the host side. That is, they are set up to determine which FCA (WWN or PID) can be accessed from which HAB.
  • the settings specifying which FCA can be accessed from which HBA are organized by creating a management table in the host like the storage affinity 602 shown in FIG. 5( b ) and specifying the FCA to be accessed.
  • the settings allow access to region 415 in the FCA of WWN c from HBA 111 .
  • the command on the fiber channel can be run through the WWN of the destination FCA.
  • FIG. 5( c ) shows an example of a switch zoning table 604 .
  • Zone A is recognized for access from the switch WWN a and an access restriction which only allows operations to be run on WWN c is put in place.
  • FIG. 5( d ) shows a sample host affinity table 606 .
  • the WWN, PID and other destination information are verified during that sequence.
  • the FCA determines whether or not access is permitted of the destination information of the WWN or PID that has been secured. The processing will continue only for devices permitted access. Access attempts by those without permission will result in check condition or other error responses.
  • FIG. 6 is a flowchart 650 showing a specific example of the operation of the SAN integrated management mechanism 500 .
  • the processes shown in FIG. 6 are stored on a computer-readable medium storing an integrated management program which, when executed by a computer, causes the computer to execute the processes shown in FIG. 6 .
  • the SAN integrated management mechanism 500 reads in the FCA, the WWN of the HBA and the PID (Process 652 ).
  • the SAN integrated management mechanism 500 would recognize that the HBA 111 of the host 110 was WWN a and PID a, that the FCA 411 of the storage device 410 was WWN c, PID c and the FCA 412 was WWN d and PID d.
  • the SAN integrated management mechanism 500 would accept the FCA scheduled for access from the HBA and its subordinate regions (Process 654 ). In the example in FIG. 3 , it would accept the path settings for access to the region 415 through the FCA 411 of the storage device 410 from the HBA 111 of the host 110 .
  • the host in question would check to see if the storage affinity function were supported or not (Process 656 ). If the storage affinity function is not supported, control would pass to Process 660 . If the storage affinity function is supported then in Process 650 , the storage affinity function would allow the SAN integrated management mechanism 500 to use the PID or the WWN to set up the devices (Process 658 ) that can access the host side SAN management mechanism from the HBA.
  • the SAN management mechanism 118 is set up so that it can access the WWN c or the PID c that are the identifiers of the FCA 411 of the storage device 410 from the HBA 111 of the host 110 . 10 .
  • the switch will check to see if the switch supports the zoning function (Process 660 ). If the zoning function is not supported, it will go on to Process 664 . If the zoning function is supported, the zoning settings mechanism of the switch establishes the zoning function to use WWN or PID in Process 662 .
  • the access to the FCA 411 of the storage device 410 from the HBA 111 of the host 110 would be either the WWN a ⁇ WWN c zoning settings or the PID a ⁇ PID c zoning settings. One of those would be set to the zoning settings function 301 of the switch 300 .
  • Process 664 there is a check to determines whether the storage device supports the host affinity function (Process 664 ). If the host affinity function is not supported, the process ends. If the host affinity function is supported, then, in Process 666 , the host affinity function is used to set up the relationships between the region and the PID or the WWN of the host-side HBA that is permitted access from the FCA.
  • the example in FIG. 3 is set up so that commands from the PID a or the WWN a of the host 110 HBA 111 are accepted by the FCA 411 of the storage device 410 .
  • the storage management mechanism 418 of the storage device 410 is set up so that it can access the region 415 in response to commands from either the WWN a or the PID a.
  • the flowchart 700 in FIG. 7 describes operations performed by the zoning settings mechanism 301 in the switches 300 .
  • the zoning settings mechanism 301 is set to a state without zoning settings (a mode which permits communications among all ports) (Process 702 ). That is, the standard is that no zones are set and that all access is permitted.
  • the zoning settings mechanism 301 accepts a non-permission setting for communications among all ports from the SAN integrated management mechanism 500 (Process 704 ), which sets it up so that communications among no ports is permitted (Process 706 ). By setting it up in this way so that no communication is permitted among ports, the problem of accidental access when the system is started up and no access paths have been specified can be avoided.
  • zone settings (the PID groups or the WWN groups, making up the zone) are accepted from the SAN integrated management mechanism 500 (Process 708 ). These zone settings are made, for example, by the system administrator through the SAN integrated management mechanism 500 .
  • New zone settings are made for the zoning settings mechanism 301 using the WWN groups or PID groups accepted above (Process 710 ).
  • the switches 300 secure the WWN of the destination ports connected to each of the ports (Process 712 ). Note that the PID is determined by the position of the physical port of the switches 300 .
  • the switch 300 accepts the aforementioned command (WWN x ⁇ WWN y) (Process 714 ). Then, the zoning settings mechanism 301 checks to see if WWN x and WWN y are set for the same zone (Process 716 ).
  • the command passes from the host port to the destination port. That is, the destination port is made recognizable using the name server function of the switch 300 (Process 718 ). And, if the settings are not for the same zone, the command is not allowed to pass. That is, the destination port recognition is deleted using the name server function of the switch 300 (Process 720 ).
  • the host 110 recognizes that the region 415 access requires accessing the FCA with a WWN c through the HBA 111 .
  • the host 110 issues a fiber channel frame to the HBA 111 switch 300 as the I/O for WWN c.
  • the I/O fiber channel frame is secured for the WWN c accepted from the HBA 111 of the switch 300 and access is permitted because the WWN c and WWN a of the HBA 111 are in the same zone on the switch zoning table shown in FIG. 5 ( c ) mentioned above.
  • the fiber channel frame is transferred to the FCA 411 that is specified by the WWN c value.
  • the fiber channel frame received from the FCA 411 is recognized as having come from WWN a which is designated in the host affinity table in FIG. 5 ( d ) mentioned above, so it determines that it can process this and runs the I/O.
  • the SAN integrated management mechanism 500 secures SAN configuration information from each of the devices and stores that in the SAN configuration settings information 501 .
  • the SAN integrated management mechanism 500 also reads in the current SAN configuration information at regular intervals or when instructed by a system administrator, compares that with the SAN configuration settings information 501 and notifies the system administrator if it determines that there has been a problem. For example, in the state in FIG. 3 above, the SAN configuration settings information 501 was registered and then the storage device 420 power supply went out. The SAN determines that there was a problem with the configuration and reported to the system administrator that the storage device 420 could no longer be seen.
  • the SAN integrated management mechanism 500 secures the access relationships information from the SAN management mechanisms 118 and 128 , the zoning settings mechanism 301 , the storage management mechanism 418 and 428 and verifies that the access path(s) match.
  • the existing SAN access paths can be checked to see if they are set up correctly.
  • the SAN management mechanism 118 detects the HBA replacement and notifies the system administrator. Using the new configuration settings command from the system administrator, the SAN management mechanism 118 reports that a new HBA WWN was replaced in the SAN integrated management mechanism 500 .
  • the SAN integrated management mechanism 500 uses the new WWN to re-establish access relationships that are equivalent to those prior to the HBA replacement. It then sets up the access relationships once more in two mechanisms that set up access relationships (Zoning settings mechanism 301 and the storage management mechanism 418 ).
  • the SAN management mechanism 118 on the host 110 detects that the settings are gone and notifies the system administrator. Using the new configuration settings command from the system administrator, the SAN management mechanism 118 reports that a new HBA WWN has been connected to the SAN integrated management mechanism 500 and the SAN integrated management mechanism 500 uses that WWN to establish access relationships that are equivalent to those prior to the HBA replacement. It then sets up the access relationships once more in two mechanisms that set up access relationships (Zoning settings mechanism 301 and the storage management mechanism 418 ).
  • a reconfigure settings command from the system administrator establishes a mechanism in the SAN integrated management mechanism 500 that will set the access relationships for the new switch to those prior to the failure. In this case, the access relationships in the new switch will be reset by the SAN integrated management mechanism 500 to those prior to the failure.
  • the switch 300 fails and is replaced, the absence of zoning information that was set up for the switch will be detected, but the system can be configured so that instead of sending a notice out to the system administrator, a mechanism can be built into the SAN integrated management mechanism 500 that automatically sets up the access relationships in the new switch to those prior to the failure from the SAN integrated management mechanism 500 .
  • FCA 411 fails and the FCA-side WWN are replaced, the system detects this and reports it to the system administrator.
  • the storage management mechanism 418 Based on a command from the system administrator to reconfigure the settings, the storage management mechanism 418 detects a new FCA WWN and reports this to the SAN integrated management mechanism 500 .
  • the SAN integrated management mechanism 500 uses that new WWN to re-establish access relationships that are equivalent to those prior to the FCA replacement. It then sets up the access relationships once again in two mechanisms that set up access relationships (the SAN management mechanism 118 and zoning settings mechanism 301 ).
  • the switches are set up so that they are not permitted any access when the system is brought up without the access path settings.
  • FC transfer classes Fiber Channels
  • the transfer classes in this system range from 1 ⁇ 3, and transfer class 1 is used sparingly.
  • Transfer class 2 returns an acknowledge following the transfer and transfer class 3 does not return an acknowledge following the transfer. If these parameters on the HBA and FCA sides are different, transfers cannot take place.
  • the classes to be used are specified by the system administrator and the management mechanism 500 is set up to run on the same classes specified for the access paths specified for the HBA and FCA throughout the management mechanisms 118 and 128 and the storage management mechanisms 418 and 428 .
  • the method used is basically that when using the SAN integrated management mechanism 500 , when there are problems with the devices making up the SAN (hosts, switches and storage devices), the SAN integrated management mechanism 500 receives all reports of device problems from the device side and reports them to the system administrator.
  • the switch 300 sends out a report that either the FCA 411 or the switch port connected to the FCA 411 has malfunctioned and a report that the access paths from the host 110 side and from the HBA 111 cannot be used.
  • the SAN integrated management mechanism 500 When there is a problem in the SAN, first the SAN integrated management mechanism 500 receives a report of that problem and then stops reports to the system administrator for a time. That is, the SAN integrated management mechanism 500 waits for a specific period of time (for example, one minute) to see if any other problems are reported from other devices that the SAN integrated management mechanism 500 manages.
  • a specific period of time for example, one minute
  • the SAN integrated management mechanism 500 reviews the content of the problem report that the SAN integrated management mechanism 500 received and the SAN integrated management mechanism 500 starts checking the WWN, PID or the aforementioned access path information held in the SAN integrated management mechanism 500 for each of the adapters to see if there might be something related to the first problem received.
  • FIG. 9 shows an example of the problem report method definition 800 .
  • the column on the left shows the problem information that the SAN integrated management mechanism 500 received and the column on the right shows the content of the problem report made up by the SAN integrated management mechanism 500 .
  • the SAN integrated management mechanism 500 receives the following problem reports: FCA error, switch port access error and host-side access error, the SAN integrated management mechanism 500 will judge it to be an FCA error and send out a problem report.
  • the following is a description of the SAN problem-monitoring function of the SAN integrated management mechanism 500 and an example of the FCA 411 problem report method based on the flowchart 1000 in FIG. 10 .
  • the SAN integrated management mechanism 500 receives a problem report (Process 1002 ). If, for example, the problem took place in the FCA 411 , the SAN integrated management mechanism 500 would receive an FCA 411 problem report from the storage device 410 .
  • the SAN integrated management mechanism 500 would wait for a specific period of time to see if there were problem reports from other devices (Process 1004 ).
  • the SAN integrated management mechanism 500 If the SAN integrated management mechanism 500 receives a problem report from the switch side (Process 1006 ), the SAN integrated management mechanism 500 would compare the content of the new problem report against the earlier problem report based on related information from the WWNs and other devices (Process 1008 ). For example, if the SAN integrated management mechanism 500 received a report that there were path errors with the WWN c and PID c from the switch 300 , the SAN integrated management mechanism 500 would recognize that they were the same error because the WWN c and PID c are part of the FCA 411 .
  • the content of the new problem report is compared against the content of the earlier problem report based on related information from the WWN and other devices (Process 1012 ). If, for example, a report about a WWN a and PID a path error is received from the host 110 , the SAN integrated management mechanism 500 is aware that the WWN a and PID a as well as the WWN c and the PID c are linked to the access path 600 , so they will be recognized as the same problem.
  • the related information is compared and the fundamental cause of the problem is determined (Process 1016 ).
  • This determination of the fundamental cause is performed using the aforementioned problem report definition contained in the SAN integrated management mechanism 500 . For example, based on the aforementioned problem report definition, a problem on the host side and a problem on the Switch 300 side would be judged to be an FCA problem on the storage side.
  • the SAN integrated management mechanism 500 also secures the host side logical volume information used in the access paths from the SAN management mechanism 118 in addition to the settings information for each access path and stores that in the SAN configuration Settings information 501 , the SAN integrated management mechanism 500 reports which logical volumes have been affected by the problem and report that to the system administrator.
  • the access paths using the affected point are read in by the SAN integrated management mechanism 500 from the SAN configuration settings information 501 in the SAN integrated management mechanism 500 . Furthermore, the host logical volumes using the access paths are also read in and the affected host logical volumes are reported to the system administrator as well. For example, for a problem with the FCA 411 , region 415 would become unusable.
  • a storage area network system of the present invention includes several computers and several storage devices forming a storage area network connected by switches.
  • the aforementioned storage area network is equipped with an integrated management device that integrates and manages said storage area network.
  • the integrated management device In addition to being equipped with access path information of the host computers and storage devices, the integrated management device also sends out access management information to the storage area network management mechanism of the host computers and to the storage devices, region information to the region setting mechanisms of the switches, and access restriction information concerning the aforementioned host computer to the storage management mechanisms of the storage devices.
  • the aforementioned integrated management mechanism detects this, obtains the settings information following the replacement from the storage area network management mechanism of the host computers, the switch region-setting mechanism or the storage device storage management mechanism and reconfigures the access relationships so that they are equivalent to those prior to the replacement.
  • the integrated management mechanism detects the replacement of the host bus adapter and notifies the system administrator.
  • the system administrator issues a reconfigure command and the integrated management mechanism passes along the settings information from the new, replacement host bus adapter in the storage area network management mechanism of the host computer. Using the new settings information, it configures the access relationships to be equivalent to those prior to the replacement of the host bus adapter and reconfigures the access relationships of the storage area network management mechanism, the region-setting mechanism and the storage management mechanism.
  • the integrated management mechanism detects that the storage area network management mechanism of the host computer has no settings and notifies the system administrator.
  • the system administrator issues a reconfigure command, which passes along to the integrated management mechanism the settings information of the connected host bus adapter.
  • the integrated management mechanism uses that information to reconfigure the access relationships to be equivalent to those prior to the host computer replacement and then sets up the access relationships of the region-setting mechanism and the storage management mechanism once again.
  • the integrated management mechanism detects that the region settings information that was set up in the switch is not present and notifies the system administrator.
  • the system administrator issues a reconfigure command, which sets the access relationships prior to the replacement in the new switch and can reconfigure the access relationships.
  • the integrated management mechanism detects that the region settings information that was set up in the switch is not present and the integrated management mechanism automatically sets up the access relationships prior to the failure in the new switch and then reconfigures the access relationships.
  • the integrated management mechanism detects this and notifies the system administrator.
  • the system administrator issues a reconfigure command and the storage management mechanism passes along the new settings information to the integrated management mechanism.
  • the integrated management mechanism uses that new settings information to reconfigure the access relationships so that they are equivalent to those prior to the replacement and then configures once again the access relationships of the storage area network management mechanism and the region management mechanism.
  • a storage area network system of the present invention includes several host computers and several storage devices connected by switches and is equipped with an integrated management mechanism that integrates and controls the above storage area network.
  • the integrated management mechanism is equipped with the access path information of the host computers and storage devices and using said access path information, the integrated management mechanism sends out access management information to the storage devices and to the storage area network management mechanism, and the integrated management mechanism sends out region information to the switch region-setting mechanisms and sends out access restriction information concerning the aforementioned host computers to the storage management mechanisms of the storage devices.
  • the aforementioned integrated management mechanism when the system is started up and the access path information has not been set up, the aforementioned integrated management mechanism first sets up the region-setting mechanisms of the switches so that no access is permitted and after that, the integrated management mechanism sets up the regions on the regions settings mechanisms of the switches.
  • a storage area network system of the present invention includes several host computers and several storage devices connected by switches and is equipped with an integrated management mechanism that integrates and control the above storage area network.
  • the integrated management mechanism is equipped with the access path information of the host computers and storage devices and, using the access path information, the integrated management mechanism sends out access management information to the storage devices, region information to the switch region-setting mechanisms, and access restriction information concerning the above host computers to the storage management mechanisms of the storage devices.
  • the above integrated management mechanism sets up the specified fiber channel transfer classes using the storage area network management mechanism of the host computers whose access information has been set up, and the storage management mechanism of the storage devices. This makes the host bus adapters of the host computers and the fiber channel adapters of the storage devices operate using the same transfer class.
  • a storage area network system of the present invention includes several host computers and several storage devices connected by means of switches and is equipped with an integrated management mechanism that integrates and control the above storage area network.
  • the integrated management mechanism is equipped with the access path information of the host computers and storage devices and, using said access path information, the integrated management mechanism sends out access management information to the storage devices and the storage area network management mechanisms, region information to the switch region-setting mechanisms, and access restriction information concerning the above host computers to the storage management mechanisms of the storage devices.
  • the above integrated management mechanism receives problem information and, for a specified period of time, the integrated management mechanism waits to see if there are other problem reports.
  • the integrated management mechanism checks the problem reports received during that period and investigates the relationship between them and the problem report received first. If the integrated management mechanism judges that they are related, the integrated management mechanism sends out a single report concerning just one affected area according to a problem report method definition set up in advance in the aforementioned integrated management mechanism.
  • the storage area network system of the present invention presents the related problem reports that it receives as related problems in addition to the single problem area.
  • the above integrated management mechanism in addition to the settings information for the access paths, the above integrated management mechanism also obtains and holds host-side logical volume information used in the access paths from the host computer storage area network management mechanism.
  • said access paths are used to read in the logical volume based on the access path information using said problem area, and report on the logical volumes that are affected by the problem.
  • the SAN is equipped with an integrated management mechanism that integrates and controls storage area networks and the integrated management mechanism above keeps track of all of the access relationships between the hosts and storage devices making the following effects possible.

Abstract

An integrated management mechanism of a storage area network (SAN) integrates and manages a traditionally dispersed security system from a single source and automates security management in the SAN. The integrated management mechanism integrates and manages the SAN, and is configured so that access relationships of the host computers and the storage devices of the SAN are managed using the integrated management mechanism. An access path on the integrated management mechanism, including a region of the storage devices to which access is attempted from the host computer, the fiber channel adapters used when accessing that storage, and the host bus adapters (HBA) are configured. Based on the access path information configured, the integrated management mechanism establishes respective storage settings, zoning settings, and accessible region permissions for a SAN management mechanism of the host computer, a zoning settings mechanism of the switch, and a storage management mechanism of the storage device.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
The contents of Japanese Patent Application No. 2000-167482, filed Jun. 5, 2000 in Japan, are incorporated herein by reference.
BACKGROUND OF THE INVENTION
1. Field of the invention
The present invention pertains to the management systems of storage area networks (hereafter referred to as SAN) that join several servers and several storage devices using fiber channel networks.
2. Description of the Related Art
In recent years, the capacity of single storage systems has increased and they now need to be able to function with several different types of servers. Also, with the advent of the widespread use of fiber channels, which can transfer data in parallel along data transfer routes at high speeds and among several host computers, it is expected that the scale of the connection format of storage systems is going to become even larger in this environment.
Joining several servers and several storage devices together in this way is referred to as a storage area network (hereafter referred to as a SAN) and attempts are being made to reduce the total cost of ownership (TCO) or manage the storage needs of several servers that are increasingly dispersed.
Be that as it may, however, there are some problems that require solving in the areas of security and the management of regions on a storage device.
One of these problems is that it is possible for data in one storage device that is being used by one host to be inadvertently destroyed by another host when a SAN is made up of several host computers (hereafter referred to as hosts) and several storage systems. This is because all of the hosts are capable of accessing all of the storage systems.
At present there are no perfect solutions to the problems of managing regions in storage systems or security. Moreover, when there is a problem with one of the many devices making up a SAN, many different error reports are sent to the system administrator, making it difficult to pinpoint an affected area and resulting in no real method for doing so.
Several terms used herein are well known in the art. More particularly, SAN (storage area network), FCA (fiber channel adapter), HBA (host bus adapter), WWN (world wide name), PID (port identification), and TCO (total cost of ownership) are terms which are well known in the art.
SUMMARY OF THE INVENTION
The present invention solves the above-mentioned problems.
An object of the present invention is to integrate and manage the traditionally dispersed security system from a single source.
Another object of the present invention is to provide good security administration automatically in a storage area network (SAN).
The present invention comprises a storage area network management system, method, and computer-readable medium storing a program executing processes.
The storage area network management system, method, and computer readable medium of the present invention comprise host computers, storage devices, switches, and an integrated management mechanism. Each of the host computers comprises a storage area network management mechanism. Each of the storage devices comprises a storage management mechanism. The switches are coupled to the host computers and to the storage devices. The switches interconnect the host computers and the storage devices. Each of the switches comprises a region-setting mechanism. The integrated management mechanism integrates and controls the storage area network. The integrated management mechanism includes access route information of the host computers and the storage devices and, based on the access route information, transmits access management information to the storage devices and the storage area network management mechanisms of the host computers, transmits region information to the region-setting mechanisms of the switches, and transmits access limit information concerning the host computers to the storage management mechanisms of the storage devices.
Moreover, the storage area network management system, method, and computer-readable medium of the present invention comprises the integrated management mechanism detecting whether fiber channel adapters mounted on the storage devices and the host computers, the host bus adapters mounted on the host computers, or the switches in the storage area network management system are replaced, obtaining settings information following the replacement from the storage area network management mechanism of the host computers, the switch region-setting mechanism, or the storage device storage management mechanism, and reconfiguring the access relationships to be equivalent to the access relationships prior to the replacement.
In addition, the storage area network management system, method, and computer-readable medium of the present invention integrates problem reports from related problems into a single problem report.
Further, the present invention comprises a method of a storage area network system comprising integrating and controlling the storage area network by an integrated management mechanism managing access relationships between host computers of the storage area network and storage devices of the storage area network.
These together with other objects and advantages which will be subsequently apparent, reside in the details of construction and operation as more fully hereinafter described and claimed, reference being had to the accompanying drawings forming a part hereof, wherein like numerals refer to like parts throughout.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic diagram of the present invention.
FIG. 2 is a diagram showing a typical SAN system configuration suitable for the present invention.
FIG. 3 is a diagram showing the configuration of the SAN management system of one embodiment of the present invention.
FIG. 4 is a diagram showing a typical storage device hardware configuration.
FIGS. 5( a), 5(b), 5(c), and 5(d) are diagrams showing examples of access pass settings information, a storage affinity table, a switch, a zoning table and a host affinity table.
FIG. 6 is a flowchart showing the process performed by the SAN integrated management mechanism of the present invention.
FIG. 7 is a flowchart showing the process performed by the zoning settings mechanism.
FIG. 8 is a diagram describing a SAN problem management.
FIG. 9 is a diagram showing a typical problem report method definition.
FIG. 10 is a flowchart of the SAN problem monitoring function performed by the SAN integrated management mechanism.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
FIG. 1 is a schematic diagram of a Storage Area Network Management system 100 of the present invention. As shown in FIG. 1, the Storage Area Network Management system 100 of the present invention installs in a SAN environment, an integrated management mechanism 1 of the present invention that integrates and controls the SAN so that all of the access relationships of the hosts 2 and the storage devices 4 are managed using the integrated management mechanism 1. The system administrator sets up the regions on the storage device 4 side that are to access the integrated management mechanism 1 from the host 2 side as well as the fiber channel adapter (FCA) and host bus adapter (HBA) to be used when accessing that storage. These settings are referred to as the access paths.
Based on the access path information that was set up, this integrated management mechanism 1 first establishes the storage settings (or Storage affinity) that is seen from the host 2 side by the SAN management mechanism 2 a on the host 2 side.
Then, the integrated management mechanism 1 establishes the zoning for the switch 3 zoning setting mechanism 3 a by securing the World Wide Name (WWN) and Port Identification (PID) information that the FCA and HBA have and then makes calculations that allow the access paths that were set up based on that information to be configured. Next, the settings are made in the storage management mechanism 4 a of the storage device 4, to determine which FCA is to permit access to which HBA (WWN or PID) and to which regions.
As above, installing the integrated management mechanism 1 makes it possible to conduct comprehensive security management and storage region to management in a storage area network system.
Also, by setting up the above integrated management mechanism 1 so that the integrated management mechanism 1 holds the SAN configuration status as the configuration setting information 1 a, it is easy for the SAN to accommodate hosts that do not have SAN management functions or switches that do not have zoning devices, allowing for as much security as possible.
Furthermore, by installing the aforementioned integrated management mechanism 1 the following functions become possible:
(1) Integrated management mechanism 1 secures the SAN configuration status from individual devices and stores that as configuration settings information 1 a. Then, either at regular intervals or when given a command by a system administrator, the integrated management mechanism 1 reads in the current SAN configuration status and compares that with the SAN configuration settings information 1 a. If they differ, the integrated management mechanism 1 determines that there is a problem and notifies the system administrator. This makes it easy for system administrators to be able to learn about SAN problems.
(2) When given the command from the system administrator, the integrated management mechanism 1 secures access relationships information from the SAN management mechanism 2 a, the zoning settings mechanism 3 a and the storage management mechanism 4 a, and checks the compatibility of the access paths. If the access paths are not set up correctly, the integrated management mechanism 1 notifies the system administrator as to where the problem is. This makes it possible for the system administrator to verify the compatibility of the access paths.
(3) When the host 2, the host 2 HBA, the switch 3 or the FCA of the storage device 3 are replaced, the aforementioned integrated management mechanism 1 detects this, obtains the settings information after the replacement from the host 2 SAN management mechanism 2 a, the switch 3 zoning settings mechanism 3 a, or the storage management mechanism 4 a of the storage device 4, and reconfigures the access relationships so that they will be equivalent to those prior to the replacement. This makes it possible to respond easily to modifications in the SAN configuration easily.
(4) When the access paths are not set up when the system is first brought up, the settings to switch 3 are configured such that no access is allowed. This makes it possible to avoid settings which allow accidental access when the system is first started up and no access paths have been set up.
(5) In the fiber channels, there are fiber channel transfer class parameters for which the HBA and FCA sides are to be set up with shared settings. If these parameters are different on the HBA side and FCA side, transfers will be impossible.
For this reason, when setting up the aforementioned access paths, the transfer class to use is specified by the system administrator and, through the SAN management mechanism 2 a, the storage management mechanism 4 a, the integrated management mechanism 1 is set up so that the access paths set by the HBA and the FCA operate using the same transfer classes. This allows the elimination of the problem of being unable to transfer data when the transfer classes differ.
(6) When a problem occurs inside the SAN, first, the integrated management mechanism 1 receives a report of that problem and temporarily stops sending reports to the system administrator. It then waits for a specific period of time to see if there have been any reports from any of the other devices managed by the integrated management mechanism 1. It checks the content of any reports received during this waiting period against the WWN, PID and access path information of each adapter that the integrated management mechanism 1 holds and checks for a possible relationship to the problem reported first. If it is determined that there is a relationship, only one problem is reported to the system administrator. Based on this information, the system administrator can determine immediately the problem area.
(7) It doesn't just report on one affected area. Even reports where the affected area has been judged to be unrelated in a report may be reported as a related problem. This makes it possible for the system administrator to determine the scope of the effect.
(8) The integrated management mechanism 1 secures not only settings information for each of the access paths in advance, it also secures logical volume information on the host 2 side that is used on each access path as well as information from the SAN management mechanism 2 a on the host 2 side and stores it as the configuration settings information la of the integrated management mechanism 1. When a problem is reported in the SAN, the integrated management mechanism 1 reads in the configuration settings information 1 a in the integrated management mechanism 1 for the access path using the affected spot and reads the host logical volume using that access path and reports the logical volumes affected by the trouble to the system administrator. Once the logical volume affected by the problem is known, the recovery of that logical volume can be started immediately and the effect on business operations can be kept to a minimum.
Embodiments of the Present Invention
FIG. 2 shows an example of a SAN system configuration 200 that could be used with the present invention discussed with reference to FIG. 1. As shown in FIG. 2, the LAN (local area network) 210 in which many host computers (hereafter referred to as hosts) H1˜Hn, management servers S which function as SAN comprehensive management devices (discussed below), the aforementioned switches SW1˜SWm , the storage devices ST, and the magnetic tape devices MT are connected.
The SAN 220 (storage area network) is equipped with the hosts Hi˜Hn, the switches SW, the storage devices ST, the magnetic tape devices MT and other devices. There are data paths among the various hosts H1˜Hn, the switches SW1˜SWm, the storage devices ST and the magnetic tape devices MT. Access between the hosts H1˜Hn to the storage devices ST and other devices has priority over the data paths. The information showing the configuration status of the SAN 220 is also transferred by the storage device ST over the LAN to the management server S and all of the settings information that comes from the management server S is transferred to the host computers H1˜Hn, the switches SW and the storage devices ST.
FIG. 3 is a diagram showing the configuration of the storage area network (SAN) 200 of the embodiment of the present invention. Here, as an example, the SAN 200 includes the hosts 110 and 120, the switch 300 and the storage devices 410 and 420. In FIG. 3, the hosts 110 and 120 are connected to the switches 300 by the fiber channel 303, 304 through the host bus adapters (hereafter referred to as HBA) 111, 112 and 121. The storage devices 410 and 420 are also connected to the switches 300 by the fiber channel adapters (hereafter referred to as FCA) 411, 412 and 421.
FIG. 4 shows an example of a hardware configuration of a storage device 430 corresponding to one of the storage devices 410, 420 shown in FIG. 3. In the storage device 430 shown in subsystem control module 11 is connected to upper devices 130, 132 (such as host devices 110, 120) through channel I/F modules 134, 136. The subsystem control module 11 includes a memory 11 a, an MPU 11 b and a bus interface module 11 c. The aforementioned MPU 11 b runs programs stored in the memory 11 a. In addition to programs, transfer data and control data are also stored in the memory 11 a.
Device control module 13 includes buffer 13 a, MPU 13 b and memory 13 c. Memory 13 c stores programs that run on the aforementioned MPU 13 b and bus interface module 13 d.
The aforementioned subsystem control module 11 and the device control module 13 are connected to each other through the bus 138. The device control module 13 is connected to the disk drive group 15 through the device I/F module 14.
In the SAN environment described above, the management mechanism 500 (corresponding to the management server S in FIG. 2, mentioned above, which includes this function) which integrates and controls the SAN, was installed in this embodiment as shown in FIG. 3. The embodiment of SAN 220 is set up so that the management mechanism 500 can manage the access relationships between the hosts 110 and 120 and the storage devices 410 and 420, as shown in FIG. 3.
The SAN management mechanisms 118 and 128 are also installed on the hosts 110 and 120 and the storage management mechanisms 418 and 428 are installed on the storage devices 410 and 420 in order to respond to control from the management mechanism 500.
As described above, the SAN management mechanisms are mechanisms that set up the storage affinity; also as described above, the storage management mechanisms are mechanisms that set up the host affinity. The switch zoning settings mechanism 301 is installed on the switch 300
The system administrator sets up the region on the storage side that attempts to access the SAN integrated management mechanism 500 from the host side and the FCA (fiber channel adapter) and the HBA (host bus adapter) that are used when accessing that storage. These settings are referred to as the access path settings.
In this SAN integrated management mechanism 500, the access path information that has been set up is stored as access path settings information 600 in the SAN integrated management mechanism 500 shown in FIG. 5( a). Using this settings information, the storage settings (Storage affinity) that can be seen from the host side are set up on the SAN management mechanisms 118 and 128 on the host side. That is, they are set up to determine which FCA (WWN or PID) can be accessed from which HAB.
The settings specifying which FCA can be accessed from which HBA are organized by creating a management table in the host like the storage affinity 602 shown in FIG. 5( b) and specifying the FCA to be accessed. In this example, the settings allow access to region 415 in the FCA of WWN c from HBA 111. The command on the fiber channel can be run through the WWN of the destination FCA.
The WWN and PID information held by the FCA and HBA is secured in advance in response to the zoning settings mechanisms 301 of the switches 300. Calculations are made so that the access paths originally set up are configured and the zoning is set up. FIG. 5( c) shows an example of a switch zoning table 604.
The zones here are set up using A and B and the identifier (here WWN) of the ports (HBA or FCA) that permits mutual access is stored in the respective zones. In this way, Zone A is recognized for access from the switch WWN a and an access restriction which only allows operations to be run on WWN c is put in place.
In the fiber channel environment, when the switches 300 and the ports are connected, a log-in sequence begins and the switch is able to secure WWN information as part of that log-in sequence. When commands are issued from the hosts 110 and 120 to the storage devices 410 and 420 using this information, if the access of a port that has not been specified for the zone is designated, the system control prevents the command from reaching the storage devices 410 and 420.
Next, the access settings are set up to determine which regions will be permitted access to the storage management mechanisms 418 and 428 of the storage devices 410 and 420 from which HBA or PID of the storage devices 410 and 420. FIG. 5( d) shows a sample host affinity table 606.
Based on this table 606, only access from the HBA of the WWN a will be allowed to region 415 for FCA 411 and only access from the HBA of the WWN e will be allowed to region 416 for FCA 412.
In a fiber channel environment, there is a log in sequence in which mutual port information is exchanged before accepting a command from a host.
The WWN, PID and other destination information are verified during that sequence.
Here, the FCA determines whether or not access is permitted of the destination information of the WWN or PID that has been secured. The processing will continue only for devices permitted access. Access attempts by those without permission will result in check condition or other error responses.
There are some devices that have no SAN management mechanism among the host devices making up the SAN. There are also devices which do not provide the aforementioned host affinity function even inside the storage device. For this reason, the management mechanism 500 would not designate the access relationships for this sort of device, but the security would be assured by other security systems (such as Storage affinity or zoning).
FIG. 6 is a flowchart 650 showing a specific example of the operation of the SAN integrated management mechanism 500. The processes shown in FIG. 6 are stored on a computer-readable medium storing an integrated management program which, when executed by a computer, causes the computer to execute the processes shown in FIG. 6.
First, the SAN integrated management mechanism 500 reads in the FCA, the WWN of the HBA and the PID (Process 652). In the example in FIG. 3, the SAN integrated management mechanism 500 would recognize that the HBA 111 of the host 110 was WWN a and PID a, that the FCA 411 of the storage device 410 was WWN c, PID c and the FCA 412 was WWN d and PID d.
Next, the SAN integrated management mechanism 500 would accept the FCA scheduled for access from the HBA and its subordinate regions (Process 654). In the example in FIG. 3, it would accept the path settings for access to the region 415 through the FCA 411 of the storage device 410 from the HBA 111 of the host 110.
Next, the host in question would check to see if the storage affinity function were supported or not (Process 656). If the storage affinity function is not supported, control would pass to Process 660. If the storage affinity function is supported then in Process 650, the storage affinity function would allow the SAN integrated management mechanism 500 to use the PID or the WWN to set up the devices (Process 658) that can access the host side SAN management mechanism from the HBA.
For example, in the example in FIG. 3, the SAN management mechanism 118 is set up so that it can access the WWN c or the PID c that are the identifiers of the FCA 411 of the storage device 410 from the HBA 111 of the host 110. 10. Next, it will check to see if the switch supports the zoning function (Process 660). If the zoning function is not supported, it will go on to Process 664. If the zoning function is supported, the zoning settings mechanism of the switch establishes the zoning function to use WWN or PID in Process 662.
In the example in FIG. 3, for instance, the access to the FCA 411 of the storage device 410 from the HBA 111 of the host 110 would be either the WWN a˜WWN c zoning settings or the PID a˜PID c zoning settings. One of those would be set to the zoning settings function 301 of the switch 300.
Next, there is a check to determines whether the storage device supports the host affinity function (Process 664). If the host affinity function is not supported, the process ends. If the host affinity function is supported, then, in Process 666, the host affinity function is used to set up the relationships between the region and the PID or the WWN of the host-side HBA that is permitted access from the FCA.
For example, the example in FIG. 3 is set up so that commands from the PID a or the WWN a of the host 110 HBA 111 are accepted by the FCA 411 of the storage device 410. Also, the storage management mechanism 418 of the storage device 410 is set up so that it can access the region 415 in response to commands from either the WWN a or the PID a.
Next, the flowchart 700 in FIG. 7 describes operations performed by the zoning settings mechanism 301 in the switches 300.
First, the zoning settings mechanism 301 is set to a state without zoning settings (a mode which permits communications among all ports) (Process 702). That is, the standard is that no zones are set and that all access is permitted.
Next, the zoning settings mechanism 301 accepts a non-permission setting for communications among all ports from the SAN integrated management mechanism 500 (Process 704), which sets it up so that communications among no ports is permitted (Process 706). By setting it up in this way so that no communication is permitted among ports, the problem of accidental access when the system is started up and no access paths have been specified can be avoided.
Next, the zone settings (the PID groups or the WWN groups, making up the zone) are accepted from the SAN integrated management mechanism 500 (Process 708). These zone settings are made, for example, by the system administrator through the SAN integrated management mechanism 500.
New zone settings are made for the zoning settings mechanism 301 using the WWN groups or PID groups accepted above (Process 710). Next, the switches 300 secure the WWN of the destination ports connected to each of the ports (Process 712). Note that the PID is determined by the position of the physical port of the switches 300.
Here, when the command is issued from the host port WWN x to the destination port WWN y, the switch 300 accepts the aforementioned command (WWN x→WWN y) (Process 714). Then, the zoning settings mechanism 301 checks to see if WWN x and WWN y are set for the same zone (Process 716).
If they are set for the same zone, the command passes from the host port to the destination port. That is, the destination port is made recognizable using the name server function of the switch 300 (Process 718). And, if the settings are not for the same zone, the command is not allowed to pass. That is, the destination port recognition is deleted using the name server function of the switch 300 (Process 720).
Next, the fundamentals of the host input/output process (I/O operations) in the SAN environment described above are described.
The following is a description (using FIG. 3 mentioned above) of a typical process in which an I/O operation issued from the host 110 and 120. Note that this description concerns the I/O to the storage devices 410 from the host 110 through the HBA 111, the switch 300 and the FCA 411.
First, from the storage affinity table shown in FIG. 5 (b) mentioned above, the host 110 recognizes that the region 415 access requires accessing the FCA with a WWN c through the HBA 111.
Based on this information, the host 110 issues a fiber channel frame to the HBA 111 switch 300 as the I/O for WWN c.
The I/O fiber channel frame is secured for the WWN c accepted from the HBA 111 of the switch 300 and access is permitted because the WWN c and WWN a of the HBA 111 are in the same zone on the switch zoning table shown in FIG. 5 (c) mentioned above. The fiber channel frame is transferred to the FCA 411 that is specified by the WWN c value.
The fiber channel frame received from the FCA 411 is recognized as having come from WWN a which is designated in the host affinity table in FIG. 5 (d) mentioned above, so it determines that it can process this and runs the I/O.
The following is a description of the functions of the SAN integrated management mechanism 500 above.
  • (1) Detection of System Problems by Comparing the SAN Configuration Settings Information
As stated above, the SAN integrated management mechanism 500 secures SAN configuration information from each of the devices and stores that in the SAN configuration settings information 501.
The SAN integrated management mechanism 500 also reads in the current SAN configuration information at regular intervals or when instructed by a system administrator, compares that with the SAN configuration settings information 501 and notifies the system administrator if it determines that there has been a problem. For example, in the state in FIG. 3 above, the SAN configuration settings information 501 was registered and then the storage device 420 power supply went out. The SAN determines that there was a problem with the configuration and reported to the system administrator that the storage device 420 could no longer be seen.
  • (2) Access Path Match Verification
When given a command by the system administrator, the SAN integrated management mechanism 500 secures the access relationships information from the SAN management mechanisms 118 and 128, the zoning settings mechanism 301, the storage management mechanism 418 and 428 and verifies that the access path(s) match.
If the access paths are not set up correctly, the system administrator will be notified of a problem in that section. This function makes checking for problems possible if a system administrator has gone and changed the settings on individual equipment.
Also, if the SAN is already in a state where the access paths have already been set up, when the SAN management logic is incorporated anew, the existing SAN access paths can be checked to see if they are set up correctly.
  • (3) Reconfiguring the Access Relationship Settings for HBA Replacement
When the HBA 111 on the host 110 side fails and is replaced with a new HBA, the SAN management mechanism 118 detects the HBA replacement and notifies the system administrator. Using the new configuration settings command from the system administrator, the SAN management mechanism 118 reports that a new HBA WWN was replaced in the SAN integrated management mechanism 500.
The SAN integrated management mechanism 500 uses the new WWN to re-establish access relationships that are equivalent to those prior to the HBA replacement. It then sets up the access relationships once more in two mechanisms that set up access relationships (Zoning settings mechanism 301 and the storage management mechanism 418).
  • (4) Reconfiguring the Access Relationship Settings for Host Replacement
When the host 110 fails and is replaced with a new host, the SAN management mechanism 118 on the host 110 detects that the settings are gone and notifies the system administrator. Using the new configuration settings command from the system administrator, the SAN management mechanism 118 reports that a new HBA WWN has been connected to the SAN integrated management mechanism 500 and the SAN integrated management mechanism 500 uses that WWN to establish access relationships that are equivalent to those prior to the HBA replacement. It then sets up the access relationships once more in two mechanisms that set up access relationships (Zoning settings mechanism 301 and the storage management mechanism 418).
  • (5) Reconfiguring the Access Relationship Settings for Switch Replacement When the switch 300 fails and is replaced, the system detects that the zoning information that was set in the switch is missing and notifies the system administrator.
A reconfigure settings command from the system administrator establishes a mechanism in the SAN integrated management mechanism 500 that will set the access relationships for the new switch to those prior to the failure. In this case, the access relationships in the new switch will be reset by the SAN integrated management mechanism 500 to those prior to the failure.
Note that when the switch 300 fails and is replaced, the absence of zoning information that was set up for the switch will be detected, but the system can be configured so that instead of sending a notice out to the system administrator, a mechanism can be built into the SAN integrated management mechanism 500 that automatically sets up the access relationships in the new switch to those prior to the failure from the SAN integrated management mechanism 500.
  • (6) Reconfiguring the Access Relationship Settings for FCA Replacement
When the storage device-side 410 FCA 411 fails and the FCA-side WWN are replaced, the system detects this and reports it to the system administrator.
Based on a command from the system administrator to reconfigure the settings, the storage management mechanism 418 detects a new FCA WWN and reports this to the SAN integrated management mechanism 500. The SAN integrated management mechanism 500 uses that new WWN to re-establish access relationships that are equivalent to those prior to the FCA replacement. It then sets up the access relationships once again in two mechanisms that set up access relationships (the SAN management mechanism 118 and zoning settings mechanism 301).
  • (7) Prevention of Accidental Access Settings
As stated above, in order to avoid settings that allow accidental access before the access paths have been set up when the system is started up, the switches are set up so that they are not permitted any access when the system is brought up without the access path settings.
Without such settings, all of the hosts would be able to access all of the SAN storage and that could cause problems of security.
  • (8) Setting up the Fiber Channel Transfer Classes
Fiber Channels (FC) have parameters referred to as FC transfer classes for which the settings should be shared on the HBA and FCA sides. The transfer classes in this system range from 1˜3, and transfer class 1 is used sparingly. Transfer class 2 returns an acknowledge following the transfer and transfer class 3 does not return an acknowledge following the transfer. If these parameters on the HBA and FCA sides are different, transfers cannot take place.
That is why when setting up the access paths discussed above, the classes to be used are specified by the system administrator and the management mechanism 500 is set up to run on the same classes specified for the access paths specified for the HBA and FCA throughout the management mechanisms 118 and 128 and the storage management mechanisms 418 and 428.
The following is a description of the aforementioned SAN trouble monitor using the SAN integrated management mechanism 500.
The method used is basically that when using the SAN integrated management mechanism 500, when there are problems with the devices making up the SAN (hosts, switches and storage devices), the SAN integrated management mechanism 500 receives all reports of device problems from the device side and reports them to the system administrator.
However, as shown in FIG. 8, when there is a problem with FCA 411, not only does the storage device 410 send a report to SAN integrated management mechanism 500 that the FCA 411 has failed, the switch 300 sends out a report that either the FCA 411 or the switch port connected to the FCA 411 has malfunctioned and a report that the access paths from the host 110 side and from the HBA 111 cannot be used.
It follows that a method is needed for compiling the problem reports from these three places into one report for the system administrator. This method is described below.
When there is a problem in the SAN, first the SAN integrated management mechanism 500 receives a report of that problem and then stops reports to the system administrator for a time. That is, the SAN integrated management mechanism 500 waits for a specific period of time (for example, one minute) to see if any other problems are reported from other devices that the SAN integrated management mechanism 500 manages.
While the SAN integrated management mechanism 500 is waiting, the SAN integrated management mechanism 500 reviews the content of the problem report that the SAN integrated management mechanism 500 received and the SAN integrated management mechanism 500 starts checking the WWN, PID or the aforementioned access path information held in the SAN integrated management mechanism 500 for each of the adapters to see if there might be something related to the first problem received.
If a related problem is found after the check, it follows the problem report method definition 800 shown in FIG. 9 that is set up in advance in the SAN integrated management mechanism 500 and reports just one problem to the system administrator. Using this information, the system administrator can determine where the affected point is immediately
FIG. 9 shows an example of the problem report method definition 800. FIG. 9, the column on the left shows the problem information that the SAN integrated management mechanism 500 received and the column on the right shows the content of the problem report made up by the SAN integrated management mechanism 500.
For instance, if the SAN integrated management mechanism 500 receives the following problem reports: FCA error, switch port access error and host-side access error, the SAN integrated management mechanism 500 will judge it to be an FCA error and send out a problem report.
The following is a description of the SAN problem-monitoring function of the SAN integrated management mechanism 500 and an example of the FCA 411 problem report method based on the flowchart 1000 in FIG. 10.
First the SAN integrated management mechanism 500 receives a problem report (Process 1002). If, for example, the problem took place in the FCA 411, the SAN integrated management mechanism 500 would receive an FCA 411 problem report from the storage device 410.
Based on this, the SAN integrated management mechanism 500 would wait for a specific period of time to see if there were problem reports from other devices (Process 1004).
If the SAN integrated management mechanism 500 receives a problem report from the switch side (Process 1006), the SAN integrated management mechanism 500 would compare the content of the new problem report against the earlier problem report based on related information from the WWNs and other devices (Process 1008). For example, if the SAN integrated management mechanism 500 received a report that there were path errors with the WWN c and PID c from the switch 300, the SAN integrated management mechanism 500 would recognize that they were the same error because the WWN c and PID c are part of the FCA 411.
Next, when a problem report is received from the host side (Process 1010), the content of the new problem report is compared against the content of the earlier problem report based on related information from the WWN and other devices (Process 1012). If, for example, a report about a WWN a and PID a path error is received from the host 110, the SAN integrated management mechanism 500 is aware that the WWN a and PID a as well as the WWN c and the PID c are linked to the access path 600, so they will be recognized as the same problem.
After the aforementioned wait for a specific amount of time (Process 1014), the related information is compared and the fundamental cause of the problem is determined (Process 1016). This determination of the fundamental cause is performed using the aforementioned problem report definition contained in the SAN integrated management mechanism 500. For example, based on the aforementioned problem report definition, a problem on the host side and a problem on the Switch 300 side would be judged to be an FCA problem on the storage side.
Only the fundamental cause is reported to the system administrator once it has been determined (Process 1018). For example, for the aforementioned problem with the FCA 411, only the FCA 411 problem would be reported to the system administrator.
In the foregoing description, only the affected area was reported, but the system could be set up so that reports on problems that were not judged to have been related may also be reported with the related problems. In this way, the scope of the effect of the problem can be determined by the system administrator.
If the SAN integrated management mechanism 500 also secures the host side logical volume information used in the access paths from the SAN management mechanism 118 in addition to the settings information for each access path and stores that in the SAN configuration Settings information 501, the SAN integrated management mechanism 500 reports which logical volumes have been affected by the problem and report that to the system administrator.
That is, if problems are reported from inside the SAN 220, the access paths using the affected point are read in by the SAN integrated management mechanism 500 from the SAN configuration settings information 501 in the SAN integrated management mechanism 500. Furthermore, the host logical volumes using the access paths are also read in and the affected host logical volumes are reported to the system administrator as well. For example, for a problem with the FCA 411, region 415 would become unusable.
If the system administrator can figure out the logical volumes affected by the problem, the recovery of those logical volumes would be possible immediately, keeping the effect on business operations to a minimum.
A storage area network system of the present invention includes several computers and several storage devices forming a storage area network connected by switches. The aforementioned storage area network is equipped with an integrated management device that integrates and manages said storage area network. In addition to being equipped with access path information of the host computers and storage devices, the integrated management device also sends out access management information to the storage area network management mechanism of the host computers and to the storage devices, region information to the region setting mechanisms of the switches, and access restriction information concerning the aforementioned host computer to the storage management mechanisms of the storage devices. When the fiber channel adapters which are mounted on the storage devices, the host computer, the host bus adapters which are mounted on the host computers or the switches in said storage area network management system are replaced, the aforementioned integrated management mechanism detects this, obtains the settings information following the replacement from the storage area network management mechanism of the host computers, the switch region-setting mechanism or the storage device storage management mechanism and reconfigures the access relationships so that they are equivalent to those prior to the replacement.
In addition, in the storage area network system of the present invention, when the host bus adapter of the host computer fails and is replaced, the integrated management mechanism detects the replacement of the host bus adapter and notifies the system administrator. The system administrator issues a reconfigure command and the integrated management mechanism passes along the settings information from the new, replacement host bus adapter in the storage area network management mechanism of the host computer. Using the new settings information, it configures the access relationships to be equivalent to those prior to the replacement of the host bus adapter and reconfigures the access relationships of the storage area network management mechanism, the region-setting mechanism and the storage management mechanism.
Moreover, in the storage area network system of the present invention, when the host computer fails and is replaced, the integrated management mechanism detects that the storage area network management mechanism of the host computer has no settings and notifies the system administrator. The system administrator issues a reconfigure command, which passes along to the integrated management mechanism the settings information of the connected host bus adapter. The integrated management mechanism uses that information to reconfigure the access relationships to be equivalent to those prior to the host computer replacement and then sets up the access relationships of the region-setting mechanism and the storage management mechanism once again.
Also in the storage area network system of the present invention, when a switch fails and is replaced, the integrated management mechanism detects that the region settings information that was set up in the switch is not present and notifies the system administrator. The system administrator issues a reconfigure command, which sets the access relationships prior to the replacement in the new switch and can reconfigure the access relationships.
Further in the storage area network system of the present invention, when a switch fails and is replaced, the integrated management mechanism detects that the region settings information that was set up in the switch is not present and the integrated management mechanism automatically sets up the access relationships prior to the failure in the new switch and then reconfigures the access relationships.
In addition in the storage area network system of the present invention, when the storage device side fiber channel adapter is replaced and the fiber channel adapter settings information is changed, the integrated management mechanism detects this and notifies the system administrator. The system administrator issues a reconfigure command and the storage management mechanism passes along the new settings information to the integrated management mechanism. The integrated management mechanism uses that new settings information to reconfigure the access relationships so that they are equivalent to those prior to the replacement and then configures once again the access relationships of the storage area network management mechanism and the region management mechanism.
Also, a storage area network system of the present invention includes several host computers and several storage devices connected by switches and is equipped with an integrated management mechanism that integrates and controls the above storage area network. The integrated management mechanism is equipped with the access path information of the host computers and storage devices and using said access path information, the integrated management mechanism sends out access management information to the storage devices and to the storage area network management mechanism, and the integrated management mechanism sends out region information to the switch region-setting mechanisms and sends out access restriction information concerning the aforementioned host computers to the storage management mechanisms of the storage devices. In this storage area network management system, when the system is started up and the access path information has not been set up, the aforementioned integrated management mechanism first sets up the region-setting mechanisms of the switches so that no access is permitted and after that, the integrated management mechanism sets up the regions on the regions settings mechanisms of the switches.
Further, a storage area network system of the present invention includes several host computers and several storage devices connected by switches and is equipped with an integrated management mechanism that integrates and control the above storage area network. The integrated management mechanism is equipped with the access path information of the host computers and storage devices and, using the access path information, the integrated management mechanism sends out access management information to the storage devices, region information to the switch region-setting mechanisms, and access restriction information concerning the above host computers to the storage management mechanisms of the storage devices. In this storage area network management system, the above integrated management mechanism sets up the specified fiber channel transfer classes using the storage area network management mechanism of the host computers whose access information has been set up, and the storage management mechanism of the storage devices. This makes the host bus adapters of the host computers and the fiber channel adapters of the storage devices operate using the same transfer class.
Moreover, a storage area network system of the present invention includes several host computers and several storage devices connected by means of switches and is equipped with an integrated management mechanism that integrates and control the above storage area network. The integrated management mechanism is equipped with the access path information of the host computers and storage devices and, using said access path information, the integrated management mechanism sends out access management information to the storage devices and the storage area network management mechanisms, region information to the switch region-setting mechanisms, and access restriction information concerning the above host computers to the storage management mechanisms of the storage devices. In this storage area network management system, when a problem occurs in the storage area network system the above integrated management mechanism receives problem information and, for a specified period of time, the integrated management mechanism waits to see if there are other problem reports. The integrated management mechanism checks the problem reports received during that period and investigates the relationship between them and the problem report received first. If the integrated management mechanism judges that they are related, the integrated management mechanism sends out a single report concerning just one affected area according to a problem report method definition set up in advance in the aforementioned integrated management mechanism.
In addition, the storage area network system of the present invention presents the related problem reports that it receives as related problems in addition to the single problem area.
Further, in the storage area network system of the present invention, in addition to the settings information for the access paths, the above integrated management mechanism also obtains and holds host-side logical volume information used in the access paths from the host computer storage area network management mechanism. When there is a report of a problem from within the storage area network, said access paths are used to read in the logical volume based on the access path information using said problem area, and report on the logical volumes that are affected by the problem.
Effects of the Present Invention
As described above, in the present invention, the SAN is equipped with an integrated management mechanism that integrates and controls storage area networks and the integrated management mechanism above keeps track of all of the access relationships between the hosts and storage devices making the following effects possible.
  • (1) It is possible to configure a highly reliable SAN system that is administered from one place. It is also compatible with past systems that lack host affinity, zoning or other functions, so it is not necessary to purchase an entirely new system in order to provide an operating environment for configuring a SAN.
  • (2) It is possible to check problems with SAN and the compatibility of access paths easily.
  • (3) The hosts, HAB , switches, storage devices, FCA and other components making up the SAN may be replaced or the SAN configuration may be changed and easily accommodated.
  • (4) If there is a problem with the SAN, the affect area and the scope of its effect can be determined easily, so the effect on business operations can be kept to a minimum.
The many features and advantages of the invention are apparent from the detailed specification and, thus, it is intended by the appended claims to cover all such features and advantages of the invention which fall within the true spirit and scope of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accordingly all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.
ELEMENT NUMBER LIST
  • 1 Integrated Management Mechanism
  • 1 a Configuration Settings Information
  • 2 Host
  • 2 a SAN Management Mechanism
  • 3 Switch
  • 3 a Zoning Settings Mechanism
  • 4 Storage Device
  • 4 a Storage Management Mechanism
  • 14 Device I/F Module
  • 100 Storage Area Network Management System
  • 110, 120 Host
  • 111, 112 Host Bus Adapter (HBA)
  • 121 Host Bus Adapter (HBA)
  • 130 Upper Device
  • 132 Upper Device
  • 134,136 Channel I/F Module
  • 138 Bus
  • 200 Storage Area Network System Configuration
  • 210 Local Area Network
  • 220 Storage Area Network
  • 300 Switch
  • 301 Zoning Settings Information
  • 303, 304 Fiber Channels
  • 410, 420 Storage Device
  • 411, 421 Fiber Channel Adapter (FCA)
  • 412 Fiber Channel Adapter (FCA)
  • 418, 428 Storage Management Mechanism
  • 500 SAN Integrated Management Mechanism
  • 501 SAN Configuration Settings Information

Claims (24)

1. A storage area network (SAN) management system comprising:
host computers, each comprising a storage area network management mechanism;
storage devices, each comprising a storage management mechanism;
switches coupled to the host computers and to the storage devices, said switches interconnecting the host computers and the storage devices, each of the switches comprising a region-setting mechanism; and
an integrated management mechanism to manage the SAN according to a process comprising:
obtaining access route information of the host computers and the storage devices;
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access route information;
transmitting access management information to the storage devices and to the storage area network management mechanisms of the host computers, based upon the set storage affinity for a host computer;
transmitting region information to the region-setting mechanisms of the switches, based upon the set switch zoning affinity; and
transmitting access limit information concerning the host computers to the storage management mechanisms of the storage devices, based upon the set host affinity for a storage device.
2. The storage area network management system as in claim 1, wherein the integrated management mechanism obtains a configuration status of the storage area network from each of the storage devices, the switches, and the host computers and stores said configuration status as the storage area network configuration settings information, and wherein at regular intervals, or when instructed by a system administrator, the integrated management mechanism gathers current configuration status of the storage area network, compares the current configuration status to the configuration settings information that was collected, and detects discrepancies based upon the comparison.
3. The storage area network management system as in claim 1, wherein the integrated management mechanism obtains information on access relationships as the access route information, from the host computer storage area network management mechanism, switches and/or the storage devices, and checks compatibility of the access route information and, if the integrated management mechanism finds any access routes which are not set up correctly, sends a notice about problems in a section corresponding thereto.
4. Host computers in a storage area network system (SAN) including storage devices and switches interconnecting the storage devices and the host computers, each host computer comprising:
an integrated management mechanism to integrate and manage the SAN according to a process comprising:
obtaining access route information of the host computers and the storage devices;
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access route information;
transmitting access management information to the storage devices and to storage area network management mechanisms of the host computers, based upon the set storage affinity for a host computer;
transmitting region information to region-setting mechanisms of the switches, based upon the set switch zoning affinity; and
transmitting access limit information concerning the host computers to storage management mechanisms of the storage devices, based upon the set host affinity for a storage device.
5. A switch in a storage area network system (SAN) including storage devices, host computers, and an integrated management mechanism integrating and managing the SAN, said switch comprising:
a region-setting mechanism carrying out storage device region access path settings, according to a process comprising:
receiving storage device region access path information, from the integrated management mechanism, and
setting access path information to a storage device region, based on the storage device region access path settings received from the integrated management mechanism,
wherein said switch communicatively interconnects the storage devices and the host computers according to the setting of the access path information according to the integrated management mechanism.
6. A storage device in a storage area network system (SAN) including host computers and switches that interconnect the host computers and the storage device, and an integrated management mechanism integrating and managing the storage area network system, said storage device comprising:
a storage management mechanism to establish conditions of access restrictions for the storage device according to a process comprising:
receiving storage device access restriction information, from the integrated management mechanism, and
establishing an access restriction condition to the storage device based on the storage device access restriction information transmitted by the integrated management mechanism.
7. An apparatus provided in a storage area network (SAN) including storage devices including storage management mechanisms, host computers including storage area network management mechanisms, and switches having a region setting mechanism and interconnecting the storage devices and the host computers, said apparatus comprising:
an integrated management mechanism to integrate and manage the SAN according to a process comprising:
obtaining access route information of the host computers and the storage devices;
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access route information;
transmitting access management information to the storage devices and to the storage area network management mechanisms of the host computers, based upon the set storage affinity for a host computer;
transmitting region information to the switch region-setting mechanism of the switches based upon the set switch zoning affinity, and
transmitting access restriction information concerning the host computers to the storage management mechanisms of the storage devices, based upon the set host affinity for a storage device,
wherein the integrated management mechanism transmits any combination of the one or more of the access management, region information, or access limit information.
8. A computer-readable medium including a program which program, when executed by a computer, causes the computer to execute the processes comprising:
integrating, managing, and controlling access relationships in a storage area network (SAN) including host computers and storage devices connected by switches, each switch having a region setting mechanism, through fiber channels, said processes further comprising:
obtaining access route information of the host computers and the storage devices;
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access route information,
transmitting access management information to the storage devices and storage area network management mechanisms of the host computers based upon the set storage affinity for a host computer,
transmitting region information to the region setting mechanisms of the switches, based upon the set switch zoning affinity, and
transmitting access restriction information about the host computers to storage management mechanisms of the storage devices based upon the set host affinity for a storage device.
9. A storage area network (SAN) system comprising:
computers as hosts comprising a storage area network management mechanism;
storage devices, each comprising a storage management mechanism;
switches interconnecting the computers and the storage devices, each of the switches comprising a region-setting mechanism; and
an integrated management device to integrated and manage said according to a process comprising:
obtaining access path information of the host computers and the storage devices,
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access path information,
transmitting access management information to the storage area network management mechanism of the host computers and to the storage devices, based upon the set storage affinity for a host computer,
transmitting region information to the region setting mechanisms of the switches, based upon the set switch zoning affinity,
transmitting access restriction information about the host computers to the storage management mechanisms of the storage devices, based upon the set host affinity for a storage device,
detecting whether fiber channel adapters mounted on the storage devices and the host computers, the host bus adapters mounted on the host computers, or the switches in said storage area network management system are replaced,
obtaining settings information following the replacement from the storage area network management mechanism of the host computers, the switch region-setting mechanism or the storage device storage management mechanism, and
reconfiguring the access paths to be equivalent to the access paths to the replacement.
10. The storage area network system as in claim 9, wherein when the host bus adapter of the host computer fails and is replaced, the integrated management mechanism detects the replacement of the host bus adapter and notifies a system administrator, wherein upon receipt of a reconfigure command from the system administrator, the integrated management mechanism passes along settings information from the new, replacement host bus adapter in the storage area network management mechanism of the host computer, and, using said new settings information, the integrated management mechanism configures the access paths to be equivalent to the access paths prior to the replacement of the host bus adapter and reconfigures the access paths of the storage area network management mechanism, the region-setting mechanism, and the storage management mechanism.
11. The storage area network system as in claim 9, wherein when the host computer fails and is replaced, the integrated management mechanism detects that the storage area network management mechanism of the host computer has no settings and notifies a system administrator, and upon receipt of a system administrator reconfigure command which passes along to the integrated management mechanism settings information of the connected host bus adapter, the integrated management mechanism uses settings information to reconfigure the access paths to be equivalent to the access paths prior to the host computer replacement and then re-establishes the access paths of the region-setting mechanism and the storage management mechanism.
12. The storage area network system as in claim 9, wherein when a switch fails and is replaced, the integrated management mechanism detects that region settings information set up in the switch is not present and notifies a system administrator, and upon receipt of a reconfigure command from the system administrator, said reconfigure command sets the access paths prior to the replacement in the new switch and reconfigures the access paths.
13. The storage area network system as in claim 9, wherein when a switch fails and is replaced, the integrated management mechanism detects that region settings information set up in the switch is not present and the integrated management mechanism automatically sets up the access routes prior to the failure in the new switch and then reconfigures the access routes.
14. The storage area network system as in claim 9, wherein when the storage device side fiber channel adapter is replaced and the fiber channel adapter settings information is changed, the integrated management mechanism detects this and notifies a system administrator, and upon receipt of a reconfigure command from the system administrator, the storage management mechanism passes along new settings information to the integrated management mechanism and the integrated management mechanism uses that new settings information to reconfigure the access paths so that the access paths are equivalent to the access paths prior to the replacement and then re-configures the access paths of the storage area network management mechanism and the region management mechanism.
15. A storage area network (SAN) system comprising:
host computers, each comprising a storage area network management mechanism;
storage devices, each comprising a storage management mechanism;
switches, each having a region setting mechanism, interconnecting the host computers and the storage devices; and
an integrated management mechanism to integrate and control the SAN according to a process comprising:
obtaining access path information of the host computers and the storage devices,
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access path information,
transmitting access management information to the storage devices and to the storage area network management mechanism of the host computers, based upon the set storage affinity for a host computer,
transmitting region information to the region-setting mechanisms of the switches, based upon the set switch zoning affinity,
transmitting access restriction information concerning the host computers to the storage management mechanisms of the storage devices, based upon the set host affinity for a storage device,
wherein when the SAN is started up and the access path information has not been set up, the integrated management mechanism first sets up the region-setting mechanisms of the switches so that no access is permitted and, after that, the integrated management mechanism sets up regions on the regions setting mechanisms of the switches.
16. A storage area network (SAN) system comprising:
host computers, each comprising a storage area network management mechanism;
storage devices, each comprising a storage management mechanism;
switches, each having a region setting mechanism, interconnecting the host computers and the storage devices; and
an integrated management mechanism to integrate and control the according to a process comprising:
obtaining access path information of the host computers and the storage devices,
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access path information,
transmitting access management information to the storage devices and to the storage area network management mechanisms of the host computers, based upon the set storage affinity for a host computer,
transmitting region information to the region-setting mechanisms of the switches, based upon the set switch zoning affinity,
transmitting access restriction information concerning the host computers to the storage management mechanisms of the storage devices,
establishing specified fiber channel transfer classes using the storage area network management mechanism of the host computers whose access information has been set up, and the storage management mechanism of the storage devices, such that host bus adapters of the host computers and the fiber channel adapters of the storage devices operate using same transfer class.
17. A storage area network (SAN) system comprising:
host computers, each comprising a storage area network management mechanism;
storage devices, each comprising a storage management mechanism;
switches, each having a region setting mechanism, interconnecting the host computers and the storage devices; and
an integrated management mechanism to integrate and control the SAN according to a process comprising:
obtaining access path information of the host computers and the storage devices,
setting up a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access path information,
transmitting access management information to the storage devices and to the storage area network management mechanisms of the host computers, based upon the set storage affinity for a host computer,
transmitting region information to the region-setting mechanisms of the switches, based upon the set switch zoning affinity, and
transmitting access restriction information concerning the above host computers to the storage management mechanisms of the storage devices, based upon the set host affinity for a storage device,
wherein when a problem occurs in the SAN, the integrated management mechanism receives problem information and, for a specified period of time, waits to see if there are other problem reports by checking problem reports received during the specified period and investigating relationship between the received problem reports and the problem report received first, and if the integrated management mechanism determines that the received problem reports and the problem report first received are related, the integrated management mechanism transmits a single report concerning one affected area according to a problem report method definition set up in advance in the integrated management mechanism.
18. The storage area network system as in claim 17, wherein the storage area network system presents related problem reports that the storage area network system receives as related problems in addition to the single problem area.
19. The storage area network system as in claim 17, wherein in addition to the access path information, the integrated management mechanism also obtains and stores host-side logical volume information used in the access paths from the storage area network management mechanisms of the host computers, and
wherein when there is a report of a problem from within the storage area network, said access paths are used to read in the logical volume based on the access path information using said problem area, and report on the logical volumes that are affected by the problem.
20. A method of integrating and controlling a storage area network (SAN) system, comprising:
providing an integrated, manager to manage access relationships, which comprises access management information, region information, or access limit information, between host computers of the SAN and storage devices of the SAN, wherein a switch connects the host computers and the storage devices;
obtaining by the integrated manager access route information of the host computers and the storage devices;
setting, by the integrated manager, a storage affinity for each host, a switch zoning affinity for each switch, and a host affinity for each storage device, as a SAN configuration setting information based on said obtained access route information;
transmitting, by the integrated manager, the access management information to the storage devices and to the host computers, based upon the set storage affinity for a host computer;
transmitting, by the integrated manager, the region information to the switches, based upon the set switch zoning affinity; and
transmitting, by the integrated manager, the access limit information concerning the host computers to the storage devices, based upon the set host affinity for a storage device.
21. The method according to claim 20, wherein the access relationships comprises establishing access paths between the host computers and the storage devices, said access paths being established and controlled by the integrated manager.
22. The method according to claim 21, wherein the access paths control access to regions of the storage devices by the host computers.
23. The method according to claim 20, further comprises, integrating, by the integrated manager, related problems into a single problem report.
24. The method of claim 20, wherein the access relationships comprise any combinations of one or more of the access management information for the storage devices and for the host computers, the region information for the switch, or the access restriction information for the host computers and for the storage devices.
US09/779,844 2000-06-05 2001-02-09 Storage area network management system, method, and computer-readable medium Expired - Lifetime US7103653B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2000167482 2000-06-05
JP2000-167482 2000-06-05

Publications (2)

Publication Number Publication Date
US20010054093A1 US20010054093A1 (en) 2001-12-20
US7103653B2 true US7103653B2 (en) 2006-09-05

Family

ID=18670632

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/779,844 Expired - Lifetime US7103653B2 (en) 2000-06-05 2001-02-09 Storage area network management system, method, and computer-readable medium

Country Status (1)

Country Link
US (1) US7103653B2 (en)

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030145078A1 (en) * 2002-01-30 2003-07-31 Hubbard Eric D. Method and apparatus for inferring topology of a network
US20030204583A1 (en) * 2002-04-26 2003-10-30 Yasunori Kaneda Operation management system, management apparatus, management method and management program
US20040008702A1 (en) * 2002-07-09 2004-01-15 Harushi Someya Connection control device, method and program
US20040028043A1 (en) * 2002-07-31 2004-02-12 Brocade Communications Systems, Inc. Method and apparatus for virtualizing storage devices inside a storage area network fabric
US20040078599A1 (en) * 2001-03-01 2004-04-22 Storeage Networking Technologies Storage area network (san) security
US20040205089A1 (en) * 2002-10-23 2004-10-14 Onaro Method and system for validating logical end-to-end access paths in storage area networks
US20040228290A1 (en) * 2003-04-28 2004-11-18 Graves David A. Method for verifying a storage area network configuration
US20050256961A1 (en) * 2002-10-23 2005-11-17 Roee Alon Methods and systems for predictive change management for access paths in networks
US20050262233A1 (en) * 2002-10-23 2005-11-24 Roee Alon Methods and systems for history analysis for access paths in networks
US20060136633A1 (en) * 2004-12-22 2006-06-22 Hitachi, Ltd. Storage system
US20060143341A1 (en) * 2001-12-12 2006-06-29 Emulex Design & Manufacturing Corporation Supercharge message exchanger
US20070055797A1 (en) * 2005-09-05 2007-03-08 Norio Shimozono Computer system, management computer, method of managing access path
US20070067589A1 (en) * 2005-09-20 2007-03-22 Cisco Technology, Inc. Smart zoning to enforce interoperability matrix in a storage area network
US20070088763A1 (en) * 2005-09-27 2007-04-19 Raphael Yahalom Methods and systems for validating accessibility and currency of replicated data
US20070220124A1 (en) * 2006-03-16 2007-09-20 Dell Products L.P. System and method for automatically creating and enabling zones in a network
US20080162681A1 (en) * 2006-12-28 2008-07-03 Computer Associates Think, Inc. Topology static zones
US7401338B1 (en) 2002-09-27 2008-07-15 Symantec Operating Corporation System and method for an access layer application programming interface for managing heterogeneous components of a storage area network
US7496551B1 (en) * 2006-03-28 2009-02-24 Emc Corporation Methods and apparatus associated with advisory generation
US20090083423A1 (en) * 2007-09-26 2009-03-26 Robert Beverley Basham System and Computer Program Product for Zoning of Devices in a Storage Area Network
US20090170574A1 (en) * 2007-12-28 2009-07-02 Motorola Inc Methods and slider form factor devices with contiguous surfaces when open
US20090222733A1 (en) * 2008-02-28 2009-09-03 International Business Machines Corporation Zoning of Devices in a Storage Area Network with LUN Masking/Mapping
US20100040053A1 (en) * 2008-08-14 2010-02-18 Dell Products, Lp System and method for dynamic maintenance of fabric subsets in a network
US20100064348A1 (en) * 2008-07-14 2010-03-11 International Business Machines Corporation Apparatus and method for managing access among devices
US20100088556A1 (en) * 2004-12-27 2010-04-08 Hirokazu Ikeda Fault management system in multistage copy configuration
US7734712B1 (en) 2001-02-13 2010-06-08 Netapp, Inc. Method and system for identifying storage devices
US20100232450A1 (en) * 2003-01-31 2010-09-16 Brocade Communications Systems, Inc. Method and apparatus for providing virtual ports with attached virtual devices in a storage area network
US20100306348A1 (en) * 2009-05-31 2010-12-02 International Business Machines Corporation Method and system for displaying and comparing storage zoning configurations
US20100312864A1 (en) * 2007-03-30 2010-12-09 Butt Kevin D Dynamic Run-Time Configuration Information Provision and Retrieval
US8332860B1 (en) 2006-12-30 2012-12-11 Netapp, Inc. Systems and methods for path-based tier-aware dynamic capacity management in storage network environments
WO2013163165A1 (en) * 2012-04-25 2013-10-31 Citrix Systems, Inc. Secure administration of virtual machines
WO2014068607A1 (en) 2012-10-30 2014-05-08 Hitachi, Ltd. Computer system and method for updating configuration information
US8826032B1 (en) 2006-12-27 2014-09-02 Netapp, Inc. Systems and methods for network change discovery and host name resolution in storage network environments
US9042263B1 (en) 2007-04-06 2015-05-26 Netapp, Inc. Systems and methods for comparative load analysis in storage networks

Families Citing this family (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020170004A1 (en) * 2001-05-08 2002-11-14 Shugart Technology, Inc. Storage area network monitor device and networked monitor system
US7343410B2 (en) * 2001-06-28 2008-03-11 Finisar Corporation Automated creation of application data paths in storage area networks
US7403987B1 (en) 2001-06-29 2008-07-22 Symantec Operating Corporation Transactional SAN management
JP2003256147A (en) * 2002-02-28 2003-09-10 Hitachi Ltd Cluster type disk array device and operation method for cluster type disk array device
US7085827B2 (en) * 2001-09-20 2006-08-01 Hitachi, Ltd. Integrated service management system for remote customer support
US7349961B2 (en) 2001-12-07 2008-03-25 Hitachi, Ltd. Detecting configuration inconsistency in storage networks
JP2003204327A (en) * 2001-12-28 2003-07-18 Hitachi Ltd Management method of computer system, management program, storage device, and display apparatus
US20030187987A1 (en) * 2002-03-29 2003-10-02 Messick Randall E. Storage area network with multiple pathways for command paths
US20030189929A1 (en) * 2002-04-04 2003-10-09 Fujitsu Limited Electronic apparatus for assisting realization of storage area network system
JP2003316616A (en) 2002-04-24 2003-11-07 Hitachi Ltd Computer system
JP2003316522A (en) * 2002-04-26 2003-11-07 Hitachi Ltd Computer system and method for controlling the same system
JP2003330762A (en) * 2002-05-09 2003-11-21 Hitachi Ltd Control method for storage system, storage system, switch and program
JP2003345531A (en) * 2002-05-24 2003-12-05 Hitachi Ltd Storage system, management server, and its application managing method
US7886031B1 (en) 2002-06-04 2011-02-08 Symantec Operating Corporation SAN configuration utility
US7194538B1 (en) 2002-06-04 2007-03-20 Veritas Operating Corporation Storage area network (SAN) management system for discovering SAN components using a SAN management server
JP3957065B2 (en) * 2002-08-28 2007-08-08 富士通株式会社 Network computer system and management device
US7260628B2 (en) * 2002-09-06 2007-08-21 Hitachi, Ltd. Event notification in storage networks
US8019849B1 (en) 2002-09-13 2011-09-13 Symantec Operating Corporation Server-side storage area network management interface
JP4202709B2 (en) * 2002-10-07 2008-12-24 株式会社日立製作所 Volume and failure management method in a network having a storage device
US7409583B2 (en) * 2002-10-07 2008-08-05 Hitachi, Ltd. Volume and failure management method on a network having a storage device
JP4130615B2 (en) * 2003-07-02 2008-08-06 株式会社日立製作所 Fault information management method and management server in a network having a storage device
US20040103220A1 (en) * 2002-10-21 2004-05-27 Bill Bostick Remote management system
EP1573962B1 (en) * 2002-12-20 2011-03-16 International Business Machines Corporation Secure system and method for san management in a non-trusted server environment
US7290051B2 (en) * 2003-01-09 2007-10-30 Sun Microsystems, Inc. Method and apparatus for hardware implementation independent verification of network layers
WO2004093391A1 (en) * 2003-04-10 2004-10-28 Fujitsu Limited Relation management control program, device, and system
JP4285058B2 (en) * 2003-04-21 2009-06-24 株式会社日立製作所 Network management program, management computer and management method
US8296406B2 (en) * 2003-04-25 2012-10-23 Hewlett-Packard Development Company, L.P. Configurable device replacement
US7885256B1 (en) 2003-05-30 2011-02-08 Symantec Operating Corporation SAN fabric discovery
JP2005018159A (en) * 2003-06-23 2005-01-20 Fujitsu Ltd Storage system construction support device, storage system construction support method and storage system construction support program
JP4516306B2 (en) * 2003-11-28 2010-08-04 株式会社日立製作所 How to collect storage network performance information
US7213021B2 (en) * 2004-03-11 2007-05-01 Hitachi, Ltd. Method and apparatus for storage network management
JP4495508B2 (en) * 2004-04-23 2010-07-07 株式会社日立製作所 Computer system configuration management method and configuration management apparatus
JP4272105B2 (en) * 2004-04-27 2009-06-03 株式会社日立製作所 Storage group setting method and apparatus
JP4726432B2 (en) * 2004-05-10 2011-07-20 株式会社日立製作所 Disk array device
JP4500118B2 (en) * 2004-07-06 2010-07-14 株式会社日立製作所 Storage device
JP2006134021A (en) * 2004-11-05 2006-05-25 Hitachi Ltd Storage system and configuration management method therefor
US7827261B1 (en) * 2004-12-22 2010-11-02 Crossroads Systems, Inc. System and method for device management
JP4837445B2 (en) * 2006-06-06 2011-12-14 株式会社日立製作所 Storage system and management apparatus and method
US7606889B1 (en) * 2006-06-30 2009-10-20 Emc Corporation Methods and systems for comparing storage area network configurations
JP4949804B2 (en) * 2006-11-07 2012-06-13 株式会社日立製作所 Integrated management computer, storage device management method, and computer system
US7925758B1 (en) 2006-11-09 2011-04-12 Symantec Operating Corporation Fibre accelerated pipe data transport
JP4983915B2 (en) * 2007-03-28 2012-07-25 富士通株式会社 Control program, control device, and control method
JP2008250591A (en) * 2007-03-30 2008-10-16 Hitachi Ltd Computer management device
US7778201B2 (en) * 2007-06-29 2010-08-17 World Wide Packets, Inc. Determining a logical neighbor of a network element
US8805982B1 (en) 2007-06-29 2014-08-12 Ciena Corporation Progressively determining a network topology and using neighbor information to determine network topology
US7773541B2 (en) * 2007-06-29 2010-08-10 World Wide Packets, Inc. Obtaining identification information for a neighboring network element
US7835297B2 (en) * 2007-06-29 2010-11-16 World Wide Packets, Inc. Determining the state of a tunnel with respect to a control protocol
US20090037565A1 (en) * 2007-08-02 2009-02-05 International Business Machines Corporation Address mapping scheme for sas zoning
JP2009157471A (en) * 2007-12-25 2009-07-16 Hitachi Ltd File sharing system and method of setting file sharing system
US8024442B1 (en) * 2008-07-08 2011-09-20 Network Appliance, Inc. Centralized storage management for multiple heterogeneous host-side servers
US8711864B1 (en) 2010-03-30 2014-04-29 Chengdu Huawei Symantec Technologies Co., Ltd. System and method for supporting fibre channel over ethernet communication
JP5425117B2 (en) 2011-01-26 2014-02-26 株式会社日立製作所 Computer system, management method thereof, and program
JP5342086B2 (en) 2011-02-24 2013-11-13 株式会社日立製作所 Computer system, management method thereof, and program
EP2574635A1 (en) * 2011-09-28 2013-04-03 Lanxess Inc. Process for continuous production of halogen-free thermoplastic elastomer compositions
US10423491B2 (en) * 2013-01-04 2019-09-24 Pure Storage, Inc. Preventing multiple round trips when writing to target widths
WO2015121998A1 (en) * 2014-02-17 2015-08-20 株式会社日立製作所 Storage system
US10523513B2 (en) * 2018-04-30 2019-12-31 Virtustream Ip Holding Company Llc Automated configuration of switch zones in a switch fabric
CN111949215B (en) * 2020-08-10 2024-03-29 中国工商银行股份有限公司 Partition changing method and device of FC-SAN network
US11750457B2 (en) 2021-07-28 2023-09-05 Dell Products L.P. Automated zoning set selection triggered by switch fabric notifications
US11586356B1 (en) 2021-09-27 2023-02-21 Dell Products L.P. Multi-path layer configured for detection and mitigation of link performance issues in a storage area network

Citations (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5297262A (en) * 1989-11-28 1994-03-22 International Business Machines Corporation Methods and apparatus for dynamically managing input/output (I/O) connectivity
JPH07281959A (en) 1994-04-12 1995-10-27 Fuji Electric Co Ltd Redundancy system for disk storage
JPH0887450A (en) 1994-09-16 1996-04-02 Toshiba Corp Information storage device
US5544319A (en) * 1992-03-25 1996-08-06 Encore Computer U.S., Inc. Fiber optic memory coupling system with converter transmitting and receiving bus data in parallel fashion and diagnostic data in serial fashion
US5604862A (en) * 1995-03-14 1997-02-18 Network Integrity, Inc. Continuously-snapshotted protection of computer files
US5617537A (en) * 1993-10-05 1997-04-01 Nippon Telegraph And Telephone Corporation Message passing system for distributed shared memory multiprocessor system and message passing method using the same
JPH1074129A (en) 1996-08-30 1998-03-17 Hitachi Ltd Disk array device
US5734709A (en) * 1992-01-27 1998-03-31 Sprint Communications Co. L.P. System for customer configuration of call routing in a telecommunications network
US5757642A (en) * 1995-01-20 1998-05-26 Dell Usa L.P. Multi-function server input/output subsystem and method
US5961607A (en) * 1994-10-31 1999-10-05 International Business Machines Corporation System for transmission of data flow in data communication networks
US6023730A (en) * 1996-09-13 2000-02-08 Digital Vision Laboratories Corporation Communication system with separate control network for managing stream data path
US6044405A (en) * 1996-04-12 2000-03-28 Wam!Net Inc. Service network incorporating geographically-remote hubs linked by high speed transmission paths
US6070243A (en) * 1997-06-13 2000-05-30 Xylan Corporation Deterministic user authentication service for communication network
US6184823B1 (en) * 1998-05-01 2001-02-06 Navigation Technologies Corp. Geographic database architecture for representation of named intersections and complex intersections and methods for formation thereof and use in a navigation application program
US6292747B1 (en) * 2000-04-20 2001-09-18 International Business Machines Corporation Heterogeneous wireless network for traveler information
US6321158B1 (en) * 1994-06-24 2001-11-20 Delorme Publishing Company Integrated routing/mapping information
US20010049799A1 (en) 2000-06-05 2001-12-06 Hirofumi Morita Disk array device including a memory with backup power supply and method thereof
US6360255B1 (en) * 1998-06-25 2002-03-19 Cisco Technology, Inc. Automatically integrating an external network with a network management system
US6363065B1 (en) * 1999-11-10 2002-03-26 Quintum Technologies, Inc. okApparatus for a voice over IP (voIP) telephony gateway and methods for use therein
US6370571B1 (en) * 1997-03-05 2002-04-09 At Home Corporation System and method for delivering high-performance online multimedia services
US6421711B1 (en) * 1998-06-29 2002-07-16 Emc Corporation Virtual ports for data transferring of a data storage system
US6419577B1 (en) * 1998-03-20 2002-07-16 Kabushiki Kaisha Bandai Semi-real time simulation type video game device
US6438591B1 (en) * 1988-09-14 2002-08-20 Compaq Information Technologies Group L.P. Entity management system
US6505254B1 (en) * 1999-04-19 2003-01-07 Cisco Technology, Inc. Methods and apparatus for routing requests in a network
US20030046347A1 (en) * 1994-11-15 2003-03-06 Takeshi Nishimura Data access right management apparatus in a data-independent computer system
US20030055929A1 (en) * 1999-06-30 2003-03-20 Da-Hai Ding Decentralized management architecture for a modular communication system
US6564274B1 (en) * 1999-12-17 2003-05-13 Omnicluster Technologies, Inc. Modular architecture for small computer networks
US6574655B1 (en) * 1999-06-29 2003-06-03 Thomson Licensing Sa Associative management of multimedia assets and associated resources using multi-domain agent-based communication between heterogeneous peers
US20030120955A1 (en) * 1999-01-29 2003-06-26 Lucent Technologies Inc. Method and apparatus for managing a firewall
US20030126221A1 (en) * 2000-07-10 2003-07-03 Katsumi Tanaka Network integrated management system
US6606706B1 (en) * 1999-02-08 2003-08-12 Nortel Networks Limited Hierarchical multicast traffic security system in an internetwork
US6611872B1 (en) * 1999-01-11 2003-08-26 Fastforward Networks, Inc. Performing multicast communication in computer networks by using overlay routing
US6615313B2 (en) 2000-06-05 2003-09-02 Fujitsu Limited Disk input/output control device maintaining write data in multiple cache memory modules and method and medium thereof
US6640278B1 (en) * 1999-03-25 2003-10-28 Dell Products L.P. Method for configuration and management of storage resources in a storage network
US6745243B2 (en) * 1998-06-30 2004-06-01 Nortel Networks Limited Method and apparatus for network caching and load balancing
US6834326B1 (en) * 2000-02-04 2004-12-21 3Com Corporation RAID method and device with network protocol between controller and storage devices
US20060059253A1 (en) * 1999-10-01 2006-03-16 Accenture Llp. Architectures for netcentric computing systems
US7024474B2 (en) * 2000-01-31 2006-04-04 Telecommunication Systems, Inc. System and method to publish information from servers to remote monitor devices

Patent Citations (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6438591B1 (en) * 1988-09-14 2002-08-20 Compaq Information Technologies Group L.P. Entity management system
US5297262A (en) * 1989-11-28 1994-03-22 International Business Machines Corporation Methods and apparatus for dynamically managing input/output (I/O) connectivity
US5734709A (en) * 1992-01-27 1998-03-31 Sprint Communications Co. L.P. System for customer configuration of call routing in a telecommunications network
US5544319A (en) * 1992-03-25 1996-08-06 Encore Computer U.S., Inc. Fiber optic memory coupling system with converter transmitting and receiving bus data in parallel fashion and diagnostic data in serial fashion
US5617537A (en) * 1993-10-05 1997-04-01 Nippon Telegraph And Telephone Corporation Message passing system for distributed shared memory multiprocessor system and message passing method using the same
JPH07281959A (en) 1994-04-12 1995-10-27 Fuji Electric Co Ltd Redundancy system for disk storage
US6321158B1 (en) * 1994-06-24 2001-11-20 Delorme Publishing Company Integrated routing/mapping information
JPH0887450A (en) 1994-09-16 1996-04-02 Toshiba Corp Information storage device
US5961607A (en) * 1994-10-31 1999-10-05 International Business Machines Corporation System for transmission of data flow in data communication networks
US20030046347A1 (en) * 1994-11-15 2003-03-06 Takeshi Nishimura Data access right management apparatus in a data-independent computer system
US5757642A (en) * 1995-01-20 1998-05-26 Dell Usa L.P. Multi-function server input/output subsystem and method
US5604862A (en) * 1995-03-14 1997-02-18 Network Integrity, Inc. Continuously-snapshotted protection of computer files
US6044405A (en) * 1996-04-12 2000-03-28 Wam!Net Inc. Service network incorporating geographically-remote hubs linked by high speed transmission paths
JPH1074129A (en) 1996-08-30 1998-03-17 Hitachi Ltd Disk array device
US6023730A (en) * 1996-09-13 2000-02-08 Digital Vision Laboratories Corporation Communication system with separate control network for managing stream data path
US6370571B1 (en) * 1997-03-05 2002-04-09 At Home Corporation System and method for delivering high-performance online multimedia services
US6070243A (en) * 1997-06-13 2000-05-30 Xylan Corporation Deterministic user authentication service for communication network
US6419577B1 (en) * 1998-03-20 2002-07-16 Kabushiki Kaisha Bandai Semi-real time simulation type video game device
US6184823B1 (en) * 1998-05-01 2001-02-06 Navigation Technologies Corp. Geographic database architecture for representation of named intersections and complex intersections and methods for formation thereof and use in a navigation application program
US6360255B1 (en) * 1998-06-25 2002-03-19 Cisco Technology, Inc. Automatically integrating an external network with a network management system
US6421711B1 (en) * 1998-06-29 2002-07-16 Emc Corporation Virtual ports for data transferring of a data storage system
US6745243B2 (en) * 1998-06-30 2004-06-01 Nortel Networks Limited Method and apparatus for network caching and load balancing
US6611872B1 (en) * 1999-01-11 2003-08-26 Fastforward Networks, Inc. Performing multicast communication in computer networks by using overlay routing
US20030120955A1 (en) * 1999-01-29 2003-06-26 Lucent Technologies Inc. Method and apparatus for managing a firewall
US6606706B1 (en) * 1999-02-08 2003-08-12 Nortel Networks Limited Hierarchical multicast traffic security system in an internetwork
US6640278B1 (en) * 1999-03-25 2003-10-28 Dell Products L.P. Method for configuration and management of storage resources in a storage network
US6505254B1 (en) * 1999-04-19 2003-01-07 Cisco Technology, Inc. Methods and apparatus for routing requests in a network
US6574655B1 (en) * 1999-06-29 2003-06-03 Thomson Licensing Sa Associative management of multimedia assets and associated resources using multi-domain agent-based communication between heterogeneous peers
US20030055929A1 (en) * 1999-06-30 2003-03-20 Da-Hai Ding Decentralized management architecture for a modular communication system
US20060059253A1 (en) * 1999-10-01 2006-03-16 Accenture Llp. Architectures for netcentric computing systems
US6363065B1 (en) * 1999-11-10 2002-03-26 Quintum Technologies, Inc. okApparatus for a voice over IP (voIP) telephony gateway and methods for use therein
US6564274B1 (en) * 1999-12-17 2003-05-13 Omnicluster Technologies, Inc. Modular architecture for small computer networks
US7024474B2 (en) * 2000-01-31 2006-04-04 Telecommunication Systems, Inc. System and method to publish information from servers to remote monitor devices
US6834326B1 (en) * 2000-02-04 2004-12-21 3Com Corporation RAID method and device with network protocol between controller and storage devices
US6292747B1 (en) * 2000-04-20 2001-09-18 International Business Machines Corporation Heterogeneous wireless network for traveler information
US6615313B2 (en) 2000-06-05 2003-09-02 Fujitsu Limited Disk input/output control device maintaining write data in multiple cache memory modules and method and medium thereof
US20010049799A1 (en) 2000-06-05 2001-12-06 Hirofumi Morita Disk array device including a memory with backup power supply and method thereof
US20030126221A1 (en) * 2000-07-10 2003-07-03 Katsumi Tanaka Network integrated management system

Non-Patent Citations (14)

* Cited by examiner, † Cited by third party
Title
A position-based multi-zone routing protocol for wide area mobile ad-hoc networks Amouris, K.N.; Papavassiliou, S.; Miao Li; Vehicular Technology Conference, 1999 IEEE 49<SUP>th </SUP>vol. 2, May 16-20, 1999 pp. 1365-1369 vol. 2. *
A route optimization algorithm and its application to mobile location management in ATM networks Dommety, G.; Veeraraghavan, M.; Singhal, M.; Selected Areas in Communications, IEEE Journal on vol. 16, Issue 6, Aug. 1998 pp. 890-908. *
A Visual Approach To Distributed Programming-Ng, Kramer, Magee, Dulay (1996) dse.doc.ic.ac.uk/dse-papers/design/kluwer.ps.gz. *
CCJ Proposal (Draft); rikweb.rhic.bnl.gov/ccj/doc/plan. *
Declarative Languages for Querying Portal Catalogs-Christophides, Plexousakis, .. (2000) www.ercim.org/publication/ws-proceedings/DelNoe01/21<SUB>-</SUB>Vassilis.pdf. *
Innovative Integration SCSI4X Hardware/Software Manual; www.innovative-dsp.com/support/manuals/scsi4xman.pdf. *
Integration of SNMP into a CORBA- and Web-based.. -Aschemann, Mohr, Ruppert (1999) www.isa.informatik.tu-darmstadt.de/VS/Publikationen/papers/kivs99-cosnmpgw.ps.gz. *
ODB-Tools: a description logics based tool for..-Bergamaschi.. sparc20.dsi.unimo.it/prototipo/paperaiia97.ps.gz. *
Payload Caching: High-Speed Data Forwarding for Network..-Yocum, Chase (2000) www.cs.duke.edu/ari/publications/pcache.ps. *
Pipelined Multi-Queue Management in a VLSI ATM..-Kornaros.. (1997) www.ccsf.caltech.edu/~markatos/avg/papers/1997.ARVLSI.Pipe<SUB>-</SUB>MultiQueue.ps.gz. *
Proposal to Establish the Northern Virginia Metacomputing Center; www.galaxy.gmu.edu/meta/metacomp.html. *
Proposal: www.cc.gatech.edu/fce/cybernet/proposal.html. *
Scalable unidirectional routing with zone routing protocol (ZRP) extensions for mobile ad-hoc networks Sinha, P.; Krishnamurthy, S.V.; Dao, S.; Wireless Communications and Networking Conference, 2000. WCNC. 2000 IEEE vol. 3, Sep. 23-28, 2000 pp. 1329-1339 vol. 3. *
Supporting reduced location management overhead and fault tolerance in Mobile-IP systems Omar, H.; Saadawi, T.; Lee, M.; Computers and Communications, 1999. Proceedings. IEEE International Symposium on Jul. 6-8, 1999 pp. 347-353. *

Cited By (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7734712B1 (en) 2001-02-13 2010-06-08 Netapp, Inc. Method and system for identifying storage devices
US7437753B2 (en) * 2001-03-01 2008-10-14 Lsi Technologies Israel Ltd. Storage area network (SAN) security
US20040078599A1 (en) * 2001-03-01 2004-04-22 Storeage Networking Technologies Storage area network (san) security
US20060143341A1 (en) * 2001-12-12 2006-06-29 Emulex Design & Manufacturing Corporation Supercharge message exchanger
US7363396B2 (en) * 2001-12-12 2008-04-22 Emulex Design & Manufacturing Corporation Supercharge message exchanger
US7509405B2 (en) * 2002-01-30 2009-03-24 Hewlett-Packard Development Company, L.P. Method and apparatus for inferring topology of a network
US20030145078A1 (en) * 2002-01-30 2003-07-31 Hubbard Eric D. Method and apparatus for inferring topology of a network
US7305463B2 (en) 2002-04-26 2007-12-04 Hitachi, Ltd. Operation management system, management apparatus, management method and management program
US20080071902A1 (en) * 2002-04-26 2008-03-20 Hitachi, Ltd. Operation management system, management apparatus, management method and management program
US20100023619A1 (en) * 2002-04-26 2010-01-28 Yasunori Kaneda Operation management system, management apparatus, management method and management program
US8001229B2 (en) 2002-04-26 2011-08-16 Hitachi, Ltd. Operation management system, management apparatus, management method and management program
US20030204583A1 (en) * 2002-04-26 2003-10-30 Yasunori Kaneda Operation management system, management apparatus, management method and management program
US7617306B2 (en) 2002-04-26 2009-11-10 Hitachi, Ltd. Operation management system, management apparatus, management method and management program
US8352595B2 (en) 2002-04-26 2013-01-08 Hitachi, Ltd. Operation management system, management apparatus, management method and management program
US7426212B2 (en) * 2002-07-09 2008-09-16 Hitachi, Ltd. Connection control device, method and program
US20040008702A1 (en) * 2002-07-09 2004-01-15 Harushi Someya Connection control device, method and program
US20040028043A1 (en) * 2002-07-31 2004-02-12 Brocade Communications Systems, Inc. Method and apparatus for virtualizing storage devices inside a storage area network fabric
US7401338B1 (en) 2002-09-27 2008-07-15 Symantec Operating Corporation System and method for an access layer application programming interface for managing heterogeneous components of a storage area network
US7617320B2 (en) * 2002-10-23 2009-11-10 Netapp, Inc. Method and system for validating logical end-to-end access paths in storage area networks
US7546333B2 (en) 2002-10-23 2009-06-09 Netapp, Inc. Methods and systems for predictive change management for access paths in networks
US8112510B2 (en) 2002-10-23 2012-02-07 Netapp, Inc. Methods and systems for predictive change management for access paths in networks
US7961594B2 (en) 2002-10-23 2011-06-14 Onaro, Inc. Methods and systems for history analysis for access paths in networks
US20040205089A1 (en) * 2002-10-23 2004-10-14 Onaro Method and system for validating logical end-to-end access paths in storage area networks
US20090313367A1 (en) * 2002-10-23 2009-12-17 Netapp, Inc. Methods and systems for predictive change management for access paths in networks
US20050256961A1 (en) * 2002-10-23 2005-11-17 Roee Alon Methods and systems for predictive change management for access paths in networks
US20050262233A1 (en) * 2002-10-23 2005-11-24 Roee Alon Methods and systems for history analysis for access paths in networks
US8077730B2 (en) 2003-01-31 2011-12-13 Brocade Communications Systems, Inc. Method and apparatus for providing virtual ports with attached virtual devices in a storage area network
US20100232450A1 (en) * 2003-01-31 2010-09-16 Brocade Communications Systems, Inc. Method and apparatus for providing virtual ports with attached virtual devices in a storage area network
US20040228290A1 (en) * 2003-04-28 2004-11-18 Graves David A. Method for verifying a storage area network configuration
US7817583B2 (en) * 2003-04-28 2010-10-19 Hewlett-Packard Development Company, L.P. Method for verifying a storage area network configuration
US20080052433A1 (en) * 2004-12-22 2008-02-28 Hitachi, Ltd. Storage system
US7302506B2 (en) 2004-12-22 2007-11-27 Hitachi, Ltd. Storage system
US20070124520A1 (en) * 2004-12-22 2007-05-31 Hitachi, Ltd. Storage system
US7822894B2 (en) 2004-12-22 2010-10-26 Hitachi, Ltd Managing storage system configuration information
US7188201B2 (en) * 2004-12-22 2007-03-06 Hitachi, Ltd. Storage system
US20060136633A1 (en) * 2004-12-22 2006-06-22 Hitachi, Ltd. Storage system
US7954003B2 (en) 2004-12-27 2011-05-31 Hitachi, Ltd. Fault management system in multistage copy configuration
US20100088556A1 (en) * 2004-12-27 2010-04-08 Hirokazu Ikeda Fault management system in multistage copy configuration
US20070055797A1 (en) * 2005-09-05 2007-03-08 Norio Shimozono Computer system, management computer, method of managing access path
US8161134B2 (en) * 2005-09-20 2012-04-17 Cisco Technology, Inc. Smart zoning to enforce interoperability matrix in a storage area network
US20070067589A1 (en) * 2005-09-20 2007-03-22 Cisco Technology, Inc. Smart zoning to enforce interoperability matrix in a storage area network
US8775387B2 (en) 2005-09-27 2014-07-08 Netapp, Inc. Methods and systems for validating accessibility and currency of replicated data
US20070088763A1 (en) * 2005-09-27 2007-04-19 Raphael Yahalom Methods and systems for validating accessibility and currency of replicated data
US7702667B2 (en) 2005-09-27 2010-04-20 Netapp, Inc. Methods and systems for validating accessibility and currency of replicated data
US20070220124A1 (en) * 2006-03-16 2007-09-20 Dell Products L.P. System and method for automatically creating and enabling zones in a network
US7496551B1 (en) * 2006-03-28 2009-02-24 Emc Corporation Methods and apparatus associated with advisory generation
US8826032B1 (en) 2006-12-27 2014-09-02 Netapp, Inc. Systems and methods for network change discovery and host name resolution in storage network environments
US8069229B2 (en) 2006-12-28 2011-11-29 Computer Associates Think, Inc. Topology static zones
US20080162681A1 (en) * 2006-12-28 2008-07-03 Computer Associates Think, Inc. Topology static zones
US8332860B1 (en) 2006-12-30 2012-12-11 Netapp, Inc. Systems and methods for path-based tier-aware dynamic capacity management in storage network environments
US20100312864A1 (en) * 2007-03-30 2010-12-09 Butt Kevin D Dynamic Run-Time Configuration Information Provision and Retrieval
US8621050B2 (en) * 2007-03-30 2013-12-31 International Business Machines Corporation Dynamic run-time configuration information provision and retrieval
US9042263B1 (en) 2007-04-06 2015-05-26 Netapp, Inc. Systems and methods for comparative load analysis in storage networks
US7996509B2 (en) 2007-09-26 2011-08-09 International Business Machines Corporation Zoning of devices in a storage area network
US20090083423A1 (en) * 2007-09-26 2009-03-26 Robert Beverley Basham System and Computer Program Product for Zoning of Devices in a Storage Area Network
US20090170574A1 (en) * 2007-12-28 2009-07-02 Motorola Inc Methods and slider form factor devices with contiguous surfaces when open
US8930537B2 (en) 2008-02-28 2015-01-06 International Business Machines Corporation Zoning of devices in a storage area network with LUN masking/mapping
US20090222733A1 (en) * 2008-02-28 2009-09-03 International Business Machines Corporation Zoning of Devices in a Storage Area Network with LUN Masking/Mapping
US9563380B2 (en) 2008-02-28 2017-02-07 International Business Machines Corporation Zoning of devices in a storage area network with LUN masking/mapping
US20120198523A1 (en) * 2008-07-14 2012-08-02 International Business Machines Corporation Apparatus and method for managing access among devices
US8739251B2 (en) * 2008-07-14 2014-05-27 International Business Machines Corporation Apparatus and method for managing access among devices
US20100064348A1 (en) * 2008-07-14 2010-03-11 International Business Machines Corporation Apparatus and method for managing access among devices
US20120221704A1 (en) * 2008-07-14 2012-08-30 International Business Machines Corporation Apparatus and method for managing access among devices
US8667567B2 (en) * 2008-07-14 2014-03-04 International Business Machines Corporation Apparatus and method for managing access among devices
US8201225B2 (en) * 2008-07-14 2012-06-12 International Business Machines Corporation Apparatus and method for managing access among devices
US8767720B2 (en) 2008-08-14 2014-07-01 Dell Products, Lp System and method for dynamic maintenance of fabric subsets in a network
US8031703B2 (en) 2008-08-14 2011-10-04 Dell Products, Lp System and method for dynamic maintenance of fabric subsets in a network
US20100040053A1 (en) * 2008-08-14 2010-02-18 Dell Products, Lp System and method for dynamic maintenance of fabric subsets in a network
US20100306348A1 (en) * 2009-05-31 2010-12-02 International Business Machines Corporation Method and system for displaying and comparing storage zoning configurations
WO2013163165A1 (en) * 2012-04-25 2013-10-31 Citrix Systems, Inc. Secure administration of virtual machines
US9258290B2 (en) 2012-04-25 2016-02-09 Citrix Systems, Inc. Secure administration of virtual machines
US8583920B1 (en) 2012-04-25 2013-11-12 Citrix Systems, Inc. Secure administration of virtual machines
WO2014068607A1 (en) 2012-10-30 2014-05-08 Hitachi, Ltd. Computer system and method for updating configuration information

Also Published As

Publication number Publication date
US20010054093A1 (en) 2001-12-20

Similar Documents

Publication Publication Date Title
US7103653B2 (en) Storage area network management system, method, and computer-readable medium
JP4794068B2 (en) Storage area network management system
US7437753B2 (en) Storage area network (SAN) security
US6845387B1 (en) Creating virtual private connections between end points across a SAN
US6745281B1 (en) Fiber channel connection magnetic disk device and fiber channel connection magnetic disk controller
US7984133B2 (en) Computer and access control method in a computer
US8027263B2 (en) Method to manage path failure threshold consensus
US5265241A (en) Method and apparatus for verifying the configuration of a link-connected network
US20040139240A1 (en) Storage system with LUN virtualization
US7865688B2 (en) Method and system for controlling information of logical division in a storage controller
JP2002063126A (en) Multi-path computer system
US7107332B2 (en) Storage controller and computer system for managing information related to connection port
JP2001337863A (en) Storage controller, storage system, and the method for setting security for storage system
US7979897B2 (en) System and article of manufacture for bidirectional data transfer
JP2006139477A (en) Computer system, management method, and storage network system
JP3957065B2 (en) Network computer system and management device
EP1811376A1 (en) Operation management program, operation management method, and operation management apparatus
US6981170B2 (en) Control method of storage control apparatus and storage control apparatus
US7039693B2 (en) Technique for validating a re-initialized channel-to-channel connection
US7908418B2 (en) Storage system, storage device, and host device
US7797567B2 (en) Storage apparatus, and method for performing fault recovery of storage apparatus
US7562137B2 (en) Method for validating a remote device
JPH03137759A (en) Information resources controller
TW202333051A (en) Server equipment and input and output device
CN106161548B (en) For database, application program and the system for storing safety in software defined network

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJITSU LIMITED, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IWATANI, SAWAO;REEL/FRAME:011544/0471

Effective date: 20010115

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

CC Certificate of correction
FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553)

Year of fee payment: 12