CA2424988A1 - Data integrity verification mechanism - Google Patents

Data integrity verification mechanism Download PDF

Info

Publication number
CA2424988A1
CA2424988A1 CA002424988A CA2424988A CA2424988A1 CA 2424988 A1 CA2424988 A1 CA 2424988A1 CA 002424988 A CA002424988 A CA 002424988A CA 2424988 A CA2424988 A CA 2424988A CA 2424988 A1 CA2424988 A1 CA 2424988A1
Authority
CA
Canada
Prior art keywords
data
block
data integrity
integrity verification
verification mechanism
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002424988A
Other languages
French (fr)
Other versions
CA2424988C (en
Inventor
Juan Loaiza
Wei-Ming Hu
Jingling Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corporation
Juan Loaiza
Wei-Ming Hu
Jingling Lee
Oracle Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corporation, Juan Loaiza, Wei-Ming Hu, Jingling Lee, Oracle Corporation filed Critical Oracle International Corporation
Publication of CA2424988A1 publication Critical patent/CA2424988A1/en
Application granted granted Critical
Publication of CA2424988C publication Critical patent/CA2424988C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1004—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1008—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/18—Error detection or correction; Testing, e.g. of drop-outs

Abstract

A method and apparatus is provided for maintaining data integrity. According to the method, a physical checksum calculation is performed on a block of data. After performing the physical checksum calculation, a logical check is performed on the data contained with the block of data. If the block of data passes the logical check, then the block of data may be written to nonvolatile memory. Thereafter, when the block of data is read from nonvolatile memory a physical checksum verification procedure is performed on the block of data to determine whether the block of data was corrupted after performing the logical check on the data contained with the block of data.
CA002424988A 2000-10-19 2001-10-19 Data integrity verification mechanism Expired - Lifetime CA2424988C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US24195900P 2000-10-19 2000-10-19
US60/241,959 2000-10-19
US09/765,680 US6928607B2 (en) 2000-10-19 2001-01-18 Data integrity verification mechanism
US09/765,680 2001-01-18
PCT/US2001/049760 WO2002057918A2 (en) 2000-10-19 2001-10-19 Data integrity verification mechanism

Publications (2)

Publication Number Publication Date
CA2424988A1 true CA2424988A1 (en) 2002-07-25
CA2424988C CA2424988C (en) 2009-07-07

Family

ID=26934722

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002424988A Expired - Lifetime CA2424988C (en) 2000-10-19 2001-10-19 Data integrity verification mechanism

Country Status (6)

Country Link
US (2) US6928607B2 (en)
EP (2) EP2369484B1 (en)
JP (2) JP2004530964A (en)
AU (1) AU2002246772B2 (en)
CA (1) CA2424988C (en)
WO (1) WO2002057918A2 (en)

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6928607B2 (en) * 2000-10-19 2005-08-09 Oracle International Corporation Data integrity verification mechanism
US7020835B2 (en) * 2000-10-19 2006-03-28 Oracle International Corporation Enhancements to data integrity verification mechanism
JP2002358245A (en) * 2001-06-01 2002-12-13 Toshiba It Solution Corp Backup system, backup method, program for backup, backup service providing system
FR2848327B1 (en) * 2002-12-06 2005-02-25 Thales Sa METHOD OF MANAGING WRITING IN A MEMORY
US7730222B2 (en) * 2004-08-24 2010-06-01 Symantec Operating System Processing storage-related I/O requests using binary tree data structures
US7409587B2 (en) * 2004-08-24 2008-08-05 Symantec Operating Corporation Recovering from storage transaction failures using checkpoints
US7725760B2 (en) 2003-09-23 2010-05-25 Symantec Operating Corporation Data storage system
US7904428B2 (en) 2003-09-23 2011-03-08 Symantec Corporation Methods and apparatus for recording write requests directed to a data store
US7577806B2 (en) * 2003-09-23 2009-08-18 Symantec Operating Corporation Systems and methods for time dependent data storage and recovery
US7239581B2 (en) * 2004-08-24 2007-07-03 Symantec Operating Corporation Systems and methods for synchronizing the internal clocks of a plurality of processor modules
US7631120B2 (en) * 2004-08-24 2009-12-08 Symantec Operating Corporation Methods and apparatus for optimally selecting a storage buffer for the storage of data
US7287133B2 (en) * 2004-08-24 2007-10-23 Symantec Operating Corporation Systems and methods for providing a modification history for a location within a data store
US7827362B2 (en) 2004-08-24 2010-11-02 Symantec Corporation Systems, apparatus, and methods for processing I/O requests
US7991748B2 (en) 2003-09-23 2011-08-02 Symantec Corporation Virtual data store creation and use
US7246289B2 (en) * 2003-09-30 2007-07-17 Nortel Networks Limited Memory integrity self checking in VT/TU cross-connect
US7302603B2 (en) * 2003-11-20 2007-11-27 International Business Machines Corporation Host-initiated data reconstruction for improved RAID read operations
US7496586B1 (en) * 2004-05-26 2009-02-24 Sun Microsystems, Inc. Method and apparatus for compressing data in a file system
FR2874440B1 (en) 2004-08-17 2008-04-25 Oberthur Card Syst Sa METHOD AND DEVICE FOR PROCESSING DATA
US7681069B1 (en) * 2004-08-30 2010-03-16 Netapp, Inc. Corruption checking during backup
US7627614B2 (en) * 2005-03-03 2009-12-01 Oracle International Corporation Lost write detection and repair
US7552357B2 (en) * 2005-04-29 2009-06-23 Network Appliance, Inc. Lost writes detection in a redundancy group based on RAID with multiple parity
WO2007047346A2 (en) * 2005-10-14 2007-04-26 Symantec Operating Corporation Technique for timeline compression in a data store
US7516246B2 (en) * 2005-10-27 2009-04-07 International Business Machines Corporation Communications channel method for verifying integrity of untrusted subsystem responses to a request
US7986480B2 (en) * 2005-11-03 2011-07-26 Hitachi Global Storage Technologies Netherlands B.V. Micro-journaling of data on a storage device
JP4852315B2 (en) 2006-02-03 2012-01-11 株式会社日立製作所 Data reliability improvement method and information processing apparatus using the method
US7761657B2 (en) 2006-07-10 2010-07-20 Hitachi, Ltd. Storage control system, control method for storage control system, port selector, and controller
JP2008077783A (en) * 2006-09-22 2008-04-03 Fujitsu Ltd Memory data processor, memory, and memory data processing program
US8224813B2 (en) * 2006-10-20 2012-07-17 Oracle International Corporation Cost based analysis of direct I/O access
JP2008112343A (en) * 2006-10-31 2008-05-15 Hitachi Ltd Computer system, access-controlling method, and host computer
US7716166B2 (en) * 2007-01-07 2010-05-11 Apple Inc. Method and apparatus for simplifying the decoding of data
US9104662B2 (en) * 2008-08-08 2015-08-11 Oracle International Corporation Method and system for implementing parallel transformations of records
JP2010055210A (en) * 2008-08-26 2010-03-11 Hitachi Ltd Storage system and data guarantee method
US8566689B2 (en) * 2009-10-22 2013-10-22 Microsoft Corporation Data integrity units in nonvolatile memory
TWI451425B (en) 2011-04-25 2014-09-01 Silicon Motion Inc Flash memory device and data protection method thereof
KR101889503B1 (en) * 2013-02-28 2018-08-17 한국전자통신연구원 Method and apparatus for providing flight data protection
US10152500B2 (en) 2013-03-14 2018-12-11 Oracle International Corporation Read mostly instances
US9519551B2 (en) * 2013-03-28 2016-12-13 Microsoft Technology Licensing, Llc Recovery processing for database in persistent system
US9632878B1 (en) * 2013-09-20 2017-04-25 Amazon Technologies, Inc. Verification of database table partitions during backup
US9633051B1 (en) 2013-09-20 2017-04-25 Amazon Technologies, Inc. Backup of partitioned database tables
US9767178B2 (en) 2013-10-30 2017-09-19 Oracle International Corporation Multi-instance redo apply
US9892153B2 (en) 2014-12-19 2018-02-13 Oracle International Corporation Detecting lost writes
US11657037B2 (en) 2015-10-23 2023-05-23 Oracle International Corporation Query execution against an in-memory standby database
US10747752B2 (en) 2015-10-23 2020-08-18 Oracle International Corporation Space management for transactional consistency of in-memory objects on a standby database
US10105189B2 (en) * 2015-11-10 2018-10-23 Mako Surgical Corp. Techniques for correcting an error in a nonvolatile memory of an embedded component for an end effector in a robotic surgical system
US10698771B2 (en) 2016-09-15 2020-06-30 Oracle International Corporation Zero-data-loss with asynchronous redo shipping to a standby database
US10891291B2 (en) 2016-10-31 2021-01-12 Oracle International Corporation Facilitating operations on pluggable databases using separate logical timestamp services
US11475006B2 (en) 2016-12-02 2022-10-18 Oracle International Corporation Query and change propagation scheduling for heterogeneous database systems
US10691722B2 (en) 2017-05-31 2020-06-23 Oracle International Corporation Consistent query execution for big data analytics in a hybrid database
US10282129B1 (en) 2017-10-24 2019-05-07 Bottomline Technologies (De), Inc. Tenant aware, variable length, deduplication of stored data
CN108021468A (en) * 2017-12-08 2018-05-11 泰康保险集团股份有限公司 The method of calibration and device of business datum in medical treatment endowment cooperative system
CN110413441A (en) * 2019-06-18 2019-11-05 平安科技（深圳）有限公司 Active and standby storage volume synchrodata method of calibration, device, equipment and storage medium
US11048425B2 (en) 2019-08-30 2021-06-29 Hewlett Packard Enterprise Development Lp Data integrity verification
CN112713964B (en) * 2020-12-22 2022-08-05 潍柴动力股份有限公司 Data verification acceleration method and device, computer equipment and storage medium
CN112767767B (en) * 2021-01-29 2022-12-23 重庆子元科技有限公司 Virtual training system

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4602368A (en) * 1983-04-15 1986-07-22 Honeywell Information Systems Inc. Dual validity bit arrays
CH667543A5 (en) * 1985-04-19 1988-10-14 Bbc Brown Boveri & Cie Data communication for processing network - using stored table in communication unit for each node defining data segment storage location
US5146571A (en) * 1988-03-28 1992-09-08 Emc Corporation Remapping defects in a storage system through the use of a tree structure
US5233618A (en) * 1990-03-02 1993-08-03 Micro Technology, Inc. Data correcting applicable to redundant arrays of independent disks
US5182752A (en) * 1990-06-29 1993-01-26 Digital Equipment Corporation Method and apparatus for transferring data between a data bus and a data storage device
US5289478A (en) 1991-03-11 1994-02-22 Fujitsu Limited Method and means for verification of write data
US5524250A (en) * 1991-08-23 1996-06-04 Silicon Graphics, Inc. Central processing unit for processing a plurality of threads using dedicated general purpose registers and masque register for providing access to the registers
JP2855019B2 (en) * 1992-02-10 1999-02-10 富士通株式会社 External storage device data guarantee method and external storage device
US5696775A (en) 1994-09-23 1997-12-09 Cirrus Logic, Inc. Method and apparatus for detecting the transfer of a wrong sector
US5586253A (en) * 1994-12-15 1996-12-17 Stratus Computer Method and apparatus for validating I/O addresses in a fault-tolerant computer system
JPH08190796A (en) * 1995-01-09 1996-07-23 Mitsubishi Denki Semiconductor Software Kk Flash memory having data refreshing function and data refreshing method for flash memory
US5619461A (en) * 1995-07-28 1997-04-08 Micron Quantum Devices, Inc. Memory system having internal state monitoring circuit
US5805799A (en) 1995-12-01 1998-09-08 Quantum Corporation Data integrity and cross-check code with logical block address
US5689514A (en) * 1996-09-30 1997-11-18 International Business Machines Corporation Method and apparatus for testing the address system of a memory system
FR2754926B1 (en) * 1996-10-23 1998-11-20 Schlumberger Ind Sa METHOD FOR MANAGING DATA INTEGRITY FAULTS IN A REWRITE MEMORY
JP3196925B2 (en) * 1997-01-13 2001-08-06 日本電気株式会社 Relational database delay constraint check method
US6237124B1 (en) 1998-03-16 2001-05-22 Actel Corporation Methods for errors checking the configuration SRAM and user assignable SRAM data in a field programmable gate array
US6009542A (en) 1998-03-31 1999-12-28 Quantum Corporation Method for preventing transfer of data to corrupt addresses
US6098190A (en) * 1998-08-04 2000-08-01 Hewlett-Packard Co. Method and apparatus for use of a host address to validate accessed data
US6438724B1 (en) * 1999-03-16 2002-08-20 International Business Machines Corporation Method and apparatus for deterministically altering cyclic redundancy check information for data storage
US6446234B1 (en) * 1999-03-16 2002-09-03 International Business Machines Corporation Method and apparatus for updating cyclic redundancy check information for data storage
US6928607B2 (en) 2000-10-19 2005-08-09 Oracle International Corporation Data integrity verification mechanism
US7020835B2 (en) * 2000-10-19 2006-03-28 Oracle International Corporation Enhancements to data integrity verification mechanism
US6751757B2 (en) * 2000-12-07 2004-06-15 3Ware Disk drive data protection using clusters containing error detection sectors
US7627614B2 (en) 2005-03-03 2009-12-01 Oracle International Corporation Lost write detection and repair

Also Published As

Publication number Publication date
EP1472603A2 (en) 2004-11-03
JP2009259286A (en) 2009-11-05
CA2424988C (en) 2009-07-07
US20040199743A1 (en) 2004-10-07
EP2369484A3 (en) 2012-04-04
WO2002057918A3 (en) 2004-08-19
US6928607B2 (en) 2005-08-09
AU2002246772B2 (en) 2007-05-17
US20020049950A1 (en) 2002-04-25
EP2369484B1 (en) 2016-12-14
JP2004530964A (en) 2004-10-07
JP4647021B2 (en) 2011-03-09
EP2369484A2 (en) 2011-09-28
US7231564B2 (en) 2007-06-12
EP1472603B1 (en) 2017-05-17
WO2002057918A2 (en) 2002-07-25

Similar Documents

Publication Publication Date Title
CA2424988A1 (en) Data integrity verification mechanism
CA2482891A1 (en) Enhancements to data integrity verification mechanism
WO2003010671A1 (en) Non-volatile memory and non-volatile memory data rewriting method
ATE306099T1 (en) METHOD FOR DETECTING MALICIAL COMPUTER CODE
EP1256881A3 (en) Method and apparatus for write protecting a gaming storage medium
MY128904A (en) Memory devices and methods for use therewith
WO2006052321A3 (en) System and method of reading non-volatile computer memory
SG97859A1 (en) Method and apparatus for updating cyclic redundancy check information for data storage
WO2004059651A3 (en) Nonvolatile memory unit with specific cache
AU7639096A (en) Secret data storage device, secret data reading method, and control program storing medium
GB0324934D0 (en) Method and apparatus for improving reliability of write back cache information
WO2002046930A3 (en) Data storage system and method employing a write-ahead hash log
HK1045022A1 (en) Memory, wrinting apparatus, reading apparatus, writing method, and reading method.
AU1648501A (en) Data adapting device, data adapting method, storage medium, and program
CA2219844A1 (en) Method and apparatus for testing multi-port memory
DE69922749D1 (en) Data processing device, data processing method and storage medium for storing information processing program
EP1235381A4 (en) Information processing device, information processing method and program storage medium
CA2469682A1 (en) Cache operation with non-cache memory
EP0381885A3 (en) Method for identifying bad data
EP1387238A3 (en) Method and apparatus for reproducing information using a security module
EP1271542A3 (en) Method and system for fast data access using a memory array
AU2001255690A1 (en) Methods and apparatus for authenticating data stored in memory
WO2001098872A3 (en) A method of checking eeprom data with an embedded crc
AU2002215967A1 (en) Method and device for identifying an eye that is to be treated in operations
WO2003083663A3 (en) Use of context identifiers in cache memory

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20211019