CA2042872A1 - Method and means for accessing dasd arrays with tuned data transfer rate and concurrency - Google Patents

Method and means for accessing dasd arrays with tuned data transfer rate and concurrency

Info

Publication number
CA2042872A1
CA2042872A1 CA2042872A CA2042872A CA2042872A1 CA 2042872 A1 CA2042872 A1 CA 2042872A1 CA 2042872 A CA2042872 A CA 2042872A CA 2042872 A CA2042872 A CA 2042872A CA 2042872 A1 CA2042872 A1 CA 2042872A1
Authority
CA
Canada
Prior art keywords
blocks
access
array
concurrency
dasds
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA2042872A
Other languages
French (fr)
Other versions
CA2042872C (en
Inventor
James Thomas Brady
Ruth Enid Cintron
Stephen Goldstein
Jean Ho-Ming Wang Ju
Jaishankar Moothedath Menon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CA2042872A1 publication Critical patent/CA2042872A1/en
Application granted granted Critical
Publication of CA2042872C publication Critical patent/CA2042872C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1008—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/18—Error detection or correction; Testing, e.g. of drop-outs
    • G11B20/1833—Error detection or correction; Testing, e.g. of drop-outs by adding special lists or symbols to the coded information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device

Abstract

A method and means for managing access to a logical track of KN blocks of which K are parity blocks. The KN blocks are distributed and stored in an array of N DASDs having K blocks per physical track per DASD. The array includes control means for securing synchronous access to selectable ones of the DASDs responsive to each access request. The method involves (a) formatting the blocks onto the array using a row major order modulus as the metric for balancing the data rate and concurrency (the number of DASDs bound per access) and (b) executing the random sequences of large and small access requests over the array.
CA002042872A 1990-05-24 1991-05-17 Method and means for accessing dasd arrays with tuned data transfer rate and concurrency Expired - Fee Related CA2042872C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US07/528,999 US5263145A (en) 1990-05-24 1990-05-24 Method and means for accessing DASD arrays with tuned data transfer rate and concurrency
US528,999 1990-05-24

Publications (2)

Publication Number Publication Date
CA2042872A1 true CA2042872A1 (en) 1991-11-25
CA2042872C CA2042872C (en) 1995-08-15

Family

ID=24108083

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002042872A Expired - Fee Related CA2042872C (en) 1990-05-24 1991-05-17 Method and means for accessing dasd arrays with tuned data transfer rate and concurrency

Country Status (7)

Country Link
US (1) US5263145A (en)
EP (1) EP0458554B1 (en)
JP (1) JPH0736144B2 (en)
KR (1) KR950004213B1 (en)
BR (1) BR9102061A (en)
CA (1) CA2042872C (en)
DE (1) DE69127229T2 (en)

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5544347A (en) 1990-09-24 1996-08-06 Emc Corporation Data storage system controlled remote data mirroring with respectively maintained data indices
JP3409859B2 (en) 1991-01-31 2003-05-26 株式会社日立製作所 Control method of control device
US6874101B2 (en) 1991-01-31 2005-03-29 Hitachi, Ltd. Storage unit subsystem
US5345584A (en) * 1991-03-11 1994-09-06 Laclead Enterprises System for managing data storage based on vector-summed size-frequency vectors for data sets, devices, and residual storage on devices
US5301297A (en) * 1991-07-03 1994-04-05 Ibm Corp. (International Business Machines Corp.) Method and means for managing RAID 5 DASD arrays having RAID DASD arrays as logical devices thereof
JP2913917B2 (en) * 1991-08-20 1999-06-28 株式会社日立製作所 Storage device and storage device system
US5522065A (en) * 1991-08-30 1996-05-28 Compaq Computer Corporation Method for performing write operations in a parity fault tolerant disk array
JP3451099B2 (en) * 1991-12-06 2003-09-29 株式会社日立製作所 External storage subsystem
US5506977A (en) * 1991-12-17 1996-04-09 Dell Usa, L.P. Method and controller for minimizing reads during partial stripe write operations to a disk drive
US5442752A (en) * 1992-01-24 1995-08-15 International Business Machines Corporation Data storage method for DASD arrays using striping based on file length
US5418921A (en) * 1992-05-05 1995-05-23 International Business Machines Corporation Method and means for fast writing data to LRU cached based DASD arrays under diverse fault tolerant modes
JP3294326B2 (en) * 1992-07-09 2002-06-24 株式会社日立製作所 Data processing method and device
US5315602A (en) * 1992-08-12 1994-05-24 Digital Equipment Corporation Optimized stripe detection for redundant arrays of disk drives
US5309451A (en) * 1992-08-12 1994-05-03 Digital Equipment Corporation Data and parity prefetching for redundant arrays of disk drives
US5581784A (en) * 1992-11-17 1996-12-03 Starlight Networks Method for performing I/O's in a storage system to maintain the continuity of a plurality of video streams
US5459853A (en) * 1992-11-23 1995-10-17 International Business Machines Corporation Efficient variable-block data storage system employing a staggered fixed-block-architecture array
US5819109A (en) * 1992-12-07 1998-10-06 Digital Equipment Corporation System for storing pending parity update log entries, calculating new parity, updating the parity block, and removing each entry from the log when update is complete
US5416915A (en) * 1992-12-11 1995-05-16 International Business Machines Corporation Method and system for minimizing seek affinity and enhancing write sensitivity in a DASD array
US5579474A (en) * 1992-12-28 1996-11-26 Hitachi, Ltd. Disk array system and its control method
EP0612015A1 (en) * 1993-02-16 1994-08-24 International Business Machines Corporation Improved disk array system having special parity groups for data blocks with high update activity
US5526511A (en) * 1993-12-23 1996-06-11 Unisys Corporation Enhanced least recently used round robin cache management method and apparatus for allocation and destaging of cache segments
US5809527A (en) * 1993-12-23 1998-09-15 Unisys Corporation Outboard file cache system
US5530948A (en) * 1993-12-30 1996-06-25 International Business Machines Corporation System and method for command queuing on raid levels 4 and 5 parity drives
US5805857A (en) * 1994-04-07 1998-09-08 International Business Machines Corporation DASD capacity in excess of 528 megabytes apparatus and method for personal computers
US5732239A (en) * 1994-05-19 1998-03-24 Starlight Networks Method for operating a disk storage system which stores video data so as to maintain the continuity of a plurality of video streams
US5802394A (en) * 1994-06-06 1998-09-01 Starlight Networks, Inc. Method for accessing one or more streams in a video storage system using multiple queues and maintaining continuity thereof
US5634028A (en) * 1994-12-15 1997-05-27 International Business Machines Corporation Compact track address translation mapping system and method
US5634033A (en) * 1994-12-16 1997-05-27 At&T Global Information Solutions Company Disk array storage system architecture for parity operations simultaneous with other data operations
US5613085A (en) * 1994-12-27 1997-03-18 International Business Machines Corporation System for parallel striping of multiple ordered data strings onto a multi-unit DASD array for improved read and write parallelism
US5574882A (en) * 1995-03-03 1996-11-12 International Business Machines Corporation System and method for identifying inconsistent parity in an array of storage
JP3358687B2 (en) * 1995-03-13 2002-12-24 株式会社日立製作所 Disk array device
US5875456A (en) * 1995-08-17 1999-02-23 Nstor Corporation Storage device array and methods for striping and unstriping data and for adding and removing disks online to/from a raid storage array
US5717850A (en) * 1996-03-12 1998-02-10 International Business Machines Corporation Efficient system for predicting and processing storage subsystem failure
US5854942A (en) * 1996-09-06 1998-12-29 International Business Machines Corporation Method and system for automatic storage subsystem configuration
US5940826A (en) * 1997-01-07 1999-08-17 Unisys Corporation Dual XPCS for disaster recovery in multi-host computer complexes
US5949970A (en) * 1997-01-07 1999-09-07 Unisys Corporation Dual XPCS for disaster recovery
US5974503A (en) * 1997-04-25 1999-10-26 Emc Corporation Storage and access of continuous media files indexed as lists of raid stripe sets associated with file names
US6701330B1 (en) 1997-12-30 2004-03-02 Unisys Corporation Protecting duplicate/lost updates against host failures
US6079000A (en) * 1997-12-30 2000-06-20 Unisys Corporation XPC backup for in-process audit
US6052799A (en) * 1998-05-15 2000-04-18 International Business Machines Corporation System and method for recovering a directory for a log structured array
US6070225A (en) * 1998-06-01 2000-05-30 International Business Machines Corporation Method and apparatus for optimizing access to coded indicia hierarchically stored on at least one surface of a cyclic, multitracked recording device
US6327644B1 (en) 1998-08-18 2001-12-04 International Business Machines Corporation Method and system for managing data in cache
US6381677B1 (en) 1998-08-19 2002-04-30 International Business Machines Corporation Method and system for staging data into cache
US6141731A (en) * 1998-08-19 2000-10-31 International Business Machines Corporation Method and system for managing data in cache using multiple data structures
US6389494B1 (en) * 1998-12-30 2002-05-14 Emc Corporation System for interfacing a data storage system to a host utilizing a plurality of busses for carrying end-user data and a separate bus for carrying interface state data
US7073020B1 (en) 1999-01-04 2006-07-04 Emc Corporation Method for message transfer in computer storage system
US7117275B1 (en) 1999-01-04 2006-10-03 Emc Corporation Data storage system having separate data transfer section and message network
US6463503B1 (en) 1999-05-12 2002-10-08 International Business Machines Corporation Method and system for increasing concurrency during staging and destaging in a log structured array
US6397292B1 (en) 1999-08-19 2002-05-28 Emc Corporation Asymmetrical striping of mirrored storage device arrays and concurrent access to even tracks in the first array and odd tracks in the second array to improve data access performance
US7007194B1 (en) 2000-06-29 2006-02-28 Emc Corporation Data storage system having point-to-point configuration
US7003601B1 (en) 2000-03-31 2006-02-21 Emc Corporation Data storage system having separate data transfer section and message network with plural directions on a common printed circuit board
US7010575B1 (en) 2000-03-31 2006-03-07 Emc Corporation Data storage system having separate data transfer section and message network having bus arbitration
US6779071B1 (en) 2000-04-28 2004-08-17 Emc Corporation Data storage system having separate data transfer section and message network with status register
US8356060B2 (en) 2009-04-30 2013-01-15 Oracle International Corporation Compression analyzer
US8583692B2 (en) * 2009-04-30 2013-11-12 Oracle International Corporation DDL and DML support for hybrid columnar compressed tables
US9667269B2 (en) 2009-04-30 2017-05-30 Oracle International Corporation Technique for compressing XML indexes
US8935223B2 (en) * 2009-04-30 2015-01-13 Oracle International Corporation Structure of hierarchical compressed data structure for tabular data
US8645337B2 (en) 2009-04-30 2014-02-04 Oracle International Corporation Storing compression units in relational tables
US8296517B2 (en) 2009-08-19 2012-10-23 Oracle International Corporation Database operation-aware striping technique
US9619157B2 (en) * 2014-04-03 2017-04-11 Analysis Solution Llc High-speed data storage
US9990308B2 (en) 2015-08-31 2018-06-05 Oracle International Corporation Selective data compression for in-memory databases

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3336582A (en) * 1964-09-01 1967-08-15 Ibm Interlocked communication system
US4092732A (en) * 1977-05-31 1978-05-30 International Business Machines Corporation System for recovering data stored in failed memory unit
US4571674A (en) * 1982-09-27 1986-02-18 International Business Machines Corporation Peripheral storage system having multiple data transfer rates
US4603380A (en) * 1983-07-01 1986-07-29 International Business Machines Corporation DASD cache block staging
CA1263194A (en) * 1985-05-08 1989-11-21 W. Daniel Hillis Storage system using multiple mechanically-driven storage units
US4761785B1 (en) * 1986-06-12 1996-03-12 Ibm Parity spreading to enhance storage access
CA1296103C (en) * 1987-06-02 1992-02-18 Theodore Jay Goodlander High-speed, high capacity, fault-tolerant, error-correcting storage system
US4993030A (en) * 1988-04-22 1991-02-12 Amdahl Corporation File system for a plurality of storage classes
US5077736A (en) * 1988-06-28 1991-12-31 Storage Technology Corporation Disk drive memory
JPH0290254A (en) * 1988-09-27 1990-03-29 Nec Corp Data input/output system
US5166939A (en) * 1990-03-02 1992-11-24 Micro Technology, Inc. Data storage apparatus and method
US5088081A (en) * 1990-03-28 1992-02-11 Prime Computer, Inc. Method and apparatus for improved disk access
US5124987A (en) * 1990-04-16 1992-06-23 Storage Technology Corporation Logical track write scheduling system for a parallel disk drive array data storage subsystem

Also Published As

Publication number Publication date
JPH04232557A (en) 1992-08-20
DE69127229T2 (en) 1998-02-12
KR950004213B1 (en) 1995-04-27
US5263145A (en) 1993-11-16
BR9102061A (en) 1991-12-24
EP0458554A2 (en) 1991-11-27
EP0458554B1 (en) 1997-08-13
KR910020562A (en) 1991-12-20
JPH0736144B2 (en) 1995-04-19
DE69127229D1 (en) 1997-09-18
CA2042872C (en) 1995-08-15
EP0458554A3 (en) 1994-06-29

Similar Documents

Publication Publication Date Title
CA2042872A1 (en) Method and means for accessing dasd arrays with tuned data transfer rate and concurrency
EP0720088A2 (en) Method and apparatus for distributing data on disk array
BR9202160A (en) METHOD AND APPARATUS FOR MANAGING THE CAPACITY OF AVAILABLE DIRECT ACCESS STORAGE DEVICES (DASD) AVAILABLE
CA2076666A1 (en) Data storage apparatus and method
DE69131551T2 (en) Logical division of a storage system with redundant matrix
JPS6458013A (en) Method and data processing system for guaranteeing large area identification and management of data memory
EP0639811A3 (en) Memory systems with data storage redundancy management
CA2225771A1 (en) Method for storing parity and rebuilding the data contents of failed disks in an external storage subsystem and apparatus therefor
EP0709765A3 (en) Method and system for selecting data for migration in a hierarchic data storage system using frequency distribution tables
EP0689125A3 (en) Method of utilizing storage disks of differing capacity in a single storage volume in a hierarchic disk array
EP0578139B1 (en) Programmable disk drive array controller
EP0499365A3 (en) Data processing system and method for encoding and rebuilding data contents of unavailable dasds
HK71296A (en) Tree structure database system
DE68920200T2 (en) Scoreboard with an active matrix.
DE69727083D1 (en) VERIFICATION SYSTEM TO MAINTAIN THE INTEGRITY OF THE PARITY OF A DISK MATRIX
CA2287608A1 (en) File management method using transposed file
NO904757D0 (en) MODULE DEVICE FOR RECEIVING, COLLECTING AND TRANSFERING SEISMIC DATA IN MULTIPLE MULTIPLE LEVELS.
EP0274426A3 (en) Computer memory system
EP0235525A3 (en) Statistical information access system
EP0361887A3 (en) Multiple processor/cache memory system and data transaction control therefor
Wiorkowski et al. The Optimizer: Invisible hand of the DBMS.
NL186120C (en) COMPUTER SYSTEM WITH VIDEO SUBSYSTEM.
WEIDA An algorithm for a pattern sensitive data storage system[Ph. D. Thesis]
COHEN et al. Defense data network support concept analysis[Final Technical Report, Sep.- Dec. 1984]
CA2585216A1 (en) Method and apparatus for striping data and for adding/removing disks in a raid storage system

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed