WO2001001581A9 - Data integrity management for data storage systems - Google Patents
Data integrity management for data storage systemsInfo
- Publication number
- WO2001001581A9 WO2001001581A9 PCT/US2000/017942 US0017942W WO0101581A9 WO 2001001581 A9 WO2001001581 A9 WO 2001001581A9 US 0017942 W US0017942 W US 0017942W WO 0101581 A9 WO0101581 A9 WO 0101581A9
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- blocks
- block
- information
- hosts
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1008—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/18—Error detection or correction; Testing, e.g. of drop-outs
- G11B20/1833—Error detection or correction; Testing, e.g. of drop-outs by adding special lists or symbols to the coded information
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
- H03M13/03—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
- H03M13/05—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
Definitions
- a representative unit of data here a 4 Kbyte (4096 bytes) sector 30 of data is transmitted by, for example, host 14a to disk storage 12.
- Each sector includes eight blocks of data, each 512 bytes long.
- Associated with sector 30 is a CRC result 34 calculated and stored by host 12 with a CRC algorithm.
- This CRC result 34 is generally stored separately from sector 30, for example, on another disk storage.
- the CRC algorithm is reapplied by host 14a and the result is compared with the previously calculated and stored CRC result 34. If the results are not the same, an indication that an error has occurred is generally provided in the form of an error message.
- CA channel adapters
- DA disk adapters
- channel adapters receive data from a particular host and assemble data into a memory format compatible with that host.
- Each channel adapter is configured to serve multiple hosts.
- channel adapter 48b is configured to interface with hosts 14b and 14c.
- Each of channel adapters 48a, 48b, 48c are configured to accommodate a particular type of host.
- channel adapter 48a is configured to interface with mainframe host 14a, which, in this embodiment, complies with IBM's fiber optic channel architecture, known as ESCON (Enterprise System Connection).
- ESCON Enterprise System Connection
- channel adapter 48b is configured to interface with hosts complying with well-known Small Computer Systems Interface (SCSI).
- Disk adapters on the back-end receive data from global memory 44 and disassemble data into the SCSI format compatible with disk array storages 46a, 46b, 46c.
- SCSI Small Computer Systems Interface
- a load buffer 74 is used to sequentially read each byte from receive buffers 72 so that for every clock cycle the contents of the load buffer are read into assembly bank buffers 74 of an assembly stage 76.
- a CRC generator 78 continuously calculates a CRC result (in this case, an ESCON CRC result), which is stored in an END OF BLK CRC register 80.
- a BLK counter 82 is used to count the number of bytes passing through load buffer 74. Once bank buffers 74 are full, all eight bytes of data are shifted in parallel into a first pipeline stage 84.
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP00943300A EP1198891B1 (en) | 1999-06-29 | 2000-06-29 | Data integrity management for data storage systems |
DE60032239T DE60032239T2 (en) | 1999-06-29 | 2000-06-29 | DATA INTEGRITY MANAGEMENT FOR DATA RECORDING SYSTEMS |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/342,955 US6915475B1 (en) | 1999-06-29 | 1999-06-29 | Data integrity management for data storage systems |
US09/342,955 | 1999-06-29 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2001001581A1 WO2001001581A1 (en) | 2001-01-04 |
WO2001001581A9 true WO2001001581A9 (en) | 2002-07-25 |
Family
ID=23344027
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2000/017942 WO2001001581A1 (en) | 1999-06-29 | 2000-06-29 | Data integrity management for data storage systems |
Country Status (4)
Country | Link |
---|---|
US (1) | US6915475B1 (en) |
EP (2) | EP1758253A1 (en) |
DE (1) | DE60032239T2 (en) |
WO (1) | WO2001001581A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7111228B1 (en) * | 2002-05-07 | 2006-09-19 | Marvell International Ltd. | System and method for performing parity checks in disk storage system |
US7996731B2 (en) | 2005-11-02 | 2011-08-09 | Advanced Micro Devices, Inc. | Error detection in high-speed asymmetric interfaces |
US20090238365A1 (en) | 2008-03-20 | 2009-09-24 | Kinamik Data Integrity, S.L. | Method and system to provide fine granular integrity to digital data |
WO2016122655A1 (en) * | 2015-01-30 | 2016-08-04 | Hewlett Packard Enterprise Development Lp | Validating data in a storage array |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4833679A (en) * | 1987-08-31 | 1989-05-23 | International Business Machines Corporation | Method and apparatus with improved error correction and error information availability |
US4849975A (en) * | 1987-11-10 | 1989-07-18 | International Business Machines Corporation | Error correction method and apparatus |
US5148432A (en) | 1988-11-14 | 1992-09-15 | Array Technology Corporation | Arrayed disk drive system and method |
WO1991001524A1 (en) | 1989-07-19 | 1991-02-07 | Cray Research, Inc. | An error recovery method and apparatus for high performance disk drives |
US5285456A (en) * | 1991-05-15 | 1994-02-08 | International Business Machines Corporation | System and method for improving the integrity of control information |
US5369758A (en) | 1991-11-15 | 1994-11-29 | Fujitsu Limited | Checking for proper locations of storage devices in a storage array |
US5483641A (en) | 1991-12-17 | 1996-01-09 | Dell Usa, L.P. | System for scheduling readahead operations if new request is within a proximity of N last read requests wherein N is dependent on independent activities |
JP2721099B2 (en) * | 1991-12-18 | 1998-03-04 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Trial and error method for error burst correction and multibyte error correction method |
JP3264465B2 (en) * | 1993-06-30 | 2002-03-11 | 株式会社日立製作所 | Storage system |
US5465260A (en) | 1993-11-04 | 1995-11-07 | Cirrus Logic, Inc. | Dual purpose cyclic redundancy check |
US5632012A (en) * | 1993-11-24 | 1997-05-20 | Storage Technology Corporation | Disk scrubbing system |
US6131176A (en) * | 1994-06-07 | 2000-10-10 | Unisys Corporation | On-the-fly data integrity transfer system handling mixed block sizes |
US5778009A (en) | 1995-06-14 | 1998-07-07 | Quantum Corporation | Dedicated ALU architecture for 10-bit Reed-Solomon error correction module |
US5844918A (en) | 1995-11-28 | 1998-12-01 | Sanyo Electric Co., Ltd. | Digital transmission/receiving method, digital communications method, and data receiving apparatus |
US5884055A (en) * | 1996-11-27 | 1999-03-16 | Emc Corporation | Method and apparatus including a shared resource and multiple processors running a common control program accessing the shared resource |
US5890207A (en) * | 1996-11-27 | 1999-03-30 | Emc Corporation | High performance integrated cached storage device |
US5890219A (en) * | 1996-11-27 | 1999-03-30 | Emc Corporation | Redundant writing of data to cached storage system |
US5894485A (en) * | 1997-03-31 | 1999-04-13 | Emc Corporation | Disk array write protection at the sub-unit level |
US6269464B1 (en) * | 1997-06-18 | 2001-07-31 | Sutmyn Storage Corporation | Error checking technique for use in mass storage systems |
US5941998A (en) * | 1997-07-25 | 1999-08-24 | Samsung Electronics Co., Ltd. | Disk drive incorporating read-verify after write method |
-
1999
- 1999-06-29 US US09/342,955 patent/US6915475B1/en not_active Expired - Lifetime
-
2000
- 2000-06-29 EP EP06124543A patent/EP1758253A1/en not_active Withdrawn
- 2000-06-29 WO PCT/US2000/017942 patent/WO2001001581A1/en active IP Right Grant
- 2000-06-29 DE DE60032239T patent/DE60032239T2/en not_active Expired - Lifetime
- 2000-06-29 EP EP00943300A patent/EP1198891B1/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
US6915475B1 (en) | 2005-07-05 |
WO2001001581A1 (en) | 2001-01-04 |
DE60032239D1 (en) | 2007-01-18 |
EP1758253A1 (en) | 2007-02-28 |
EP1198891B1 (en) | 2006-12-06 |
EP1198891A1 (en) | 2002-04-24 |
DE60032239T2 (en) | 2007-05-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7036066B2 (en) | Error detection using data block mapping | |
US5528755A (en) | Invalid data detection, recording and nullification | |
US6389503B1 (en) | Tape drive emulation by removable disk drive and media formatted therefor | |
US6748486B2 (en) | Method, system, and data structures for superimposing data records in a first data format to memory in a second data format | |
US8230317B2 (en) | Data protection method for variable length records by utilizing high performance block storage metadata | |
US7117422B2 (en) | Error detection in storage data | |
US20030023933A1 (en) | End-to-end disk data checksumming | |
US20060206680A1 (en) | File control apparatus | |
JPH0612895B2 (en) | Information processing system | |
CA2218296C (en) | Method and apparatus for storing and retrieving error check information | |
US7356622B2 (en) | Method and apparatus for managing and formatting metadata in an autonomous operation conducted by a third party | |
US7353299B2 (en) | Method and apparatus for managing autonomous third party data transfers | |
JPH02135534A (en) | Error processor | |
US5719885A (en) | Storage reliability method and apparatus | |
US20080104484A1 (en) | Mass storage system and method | |
US6584544B1 (en) | Method and apparatus for preparing a disk for use in a disk array | |
US20090259456A1 (en) | Data Protection for Variable Length Records by Utilizing High Performance Block Storage Metadata | |
US7921265B2 (en) | Data access method, channel adapter, and data access control device | |
US5734815A (en) | Method and apparatus for efficient cyclical redundancy check (CRC) maintenance for sub-sector writes | |
US20050021888A1 (en) | Method and system for data movement in data storage systems employing parcel-based data mapping | |
US6915475B1 (en) | Data integrity management for data storage systems | |
JPH10301720A (en) | Disk array device | |
US7293139B2 (en) | Disk array system generating a data guarantee code on data transferring | |
US8041850B2 (en) | Storage apparatus and data integrity assurance method | |
US8006052B1 (en) | Systems and methods for tracking portions of a logical volume that have never been written by a host |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): JP KR US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2000943300 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2000943300 Country of ref document: EP |
|
AK | Designated states |
Kind code of ref document: C2 Designated state(s): JP KR US |
|
AL | Designated countries for regional patents |
Kind code of ref document: C2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
COP | Corrected version of pamphlet |
Free format text: PAGES 1/6-6/6, DRAWINGS, REPLACED BY NEW PAGES 1/5-5/5; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE |
|
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWG | Wipo information: grant in national office |
Ref document number: 2000943300 Country of ref document: EP |