WO2004097572A3 - Transparent file migration using namespace replication - Google Patents

Transparent file migration using namespace replication Download PDF

Info

Publication number
WO2004097572A3
WO2004097572A3 PCT/US2004/012847 US2004012847W WO2004097572A3 WO 2004097572 A3 WO2004097572 A3 WO 2004097572A3 US 2004012847 W US2004012847 W US 2004012847W WO 2004097572 A3 WO2004097572 A3 WO 2004097572A3
Authority
WO
WIPO (PCT)
Prior art keywords
nas
file
switch
handles
namespace
Prior art date
Application number
PCT/US2004/012847
Other languages
French (fr)
Other versions
WO2004097572A2 (en
Inventor
Thomas K Wong
Panagiotis Tsirigotis
Anand Iyengar
Rajeev Chawla
Original Assignee
Neopath Networks Inc
Thomas K Wong
Panagiotis Tsirigotis
Anand Iyengar
Rajeev Chawla
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US10/831,376 external-priority patent/US7346664B2/en
Priority claimed from US10/831,701 external-priority patent/US7587422B2/en
Application filed by Neopath Networks Inc, Thomas K Wong, Panagiotis Tsirigotis, Anand Iyengar, Rajeev Chawla filed Critical Neopath Networks Inc
Priority to JP2006513342A priority Critical patent/JP4588024B2/en
Priority to EP04750678A priority patent/EP1618500A4/en
Publication of WO2004097572A2 publication Critical patent/WO2004097572A2/en
Publication of WO2004097572A3 publication Critical patent/WO2004097572A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/119—Details of migration of file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G06F16/184—Distributed file systems implemented as replicated file system
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30—Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32—Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Abstract

A NAS switch provides file migrations in a NAS storage network that are transparent to the clients. A source file server exports an original NAS file handles indicative of object locations on the source file server to the NAS switch. The NAS switch modifies the original NAS file handles to an internal file system and maps the original NAS file handles to a switch file handles independent of location. The NAS switch exports the switch file handles to a client. The client looks-up objects and makes NAS requests to the source file server using switch file handles. The NAS switch performs file migration by first replicating the namespace containing data to be migrated from source file server to a destination file server. Separately, the NAS replicates data which is a relatively longer process than the namespace replication. During data replication, namespace access requests for objects are directed to the replicated namespace. After data replication, file object requests for migrated objects are redirected to the destination file server in a process that is transparent to the client.
PCT/US2004/012847 2003-04-24 2004-04-26 Transparent file migration using namespace replication WO2004097572A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2006513342A JP4588024B2 (en) 2003-04-24 2004-04-26 Transparent file movement using namespace replication
EP04750678A EP1618500A4 (en) 2003-04-24 2004-04-26 Transparent file migration using namespace replication

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US46557803P 2003-04-24 2003-04-24
US46557903P 2003-04-24 2003-04-24
US60/465,578 2003-04-24
US60/465,579 2003-04-24
US10/831,376 US7346664B2 (en) 2003-04-24 2004-04-23 Transparent file migration using namespace replication
US10/831,376 2004-04-23
US10/831,701 US7587422B2 (en) 2003-04-24 2004-04-23 Transparent file replication using namespace replication
US10/831,701 2004-04-23

Publications (2)

Publication Number Publication Date
WO2004097572A2 WO2004097572A2 (en) 2004-11-11
WO2004097572A3 true WO2004097572A3 (en) 2005-01-06

Family

ID=33425572

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/US2004/012847 WO2004097572A2 (en) 2003-04-24 2004-04-26 Transparent file migration using namespace replication
PCT/US2004/012846 WO2004097686A1 (en) 2003-04-24 2004-04-26 Transparent file replication using namespace replication

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/US2004/012846 WO2004097686A1 (en) 2003-04-24 2004-04-26 Transparent file replication using namespace replication

Country Status (3)

Country Link
EP (1) EP1618500A4 (en)
JP (1) JP4588024B2 (en)
WO (2) WO2004097572A2 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8131689B2 (en) 2005-09-30 2012-03-06 Panagiotis Tsirigotis Accumulating access frequency and file attributes for supporting policy based storage management
US8180843B2 (en) 2003-04-24 2012-05-15 Neopath Networks, Inc. Transparent file migration using namespace replication
US8190741B2 (en) 2004-04-23 2012-05-29 Neopath Networks, Inc. Customizing a namespace in a decentralized storage environment
US8195627B2 (en) 2004-04-23 2012-06-05 Neopath Networks, Inc. Storage policy monitoring for a storage network
US8539081B2 (en) 2003-09-15 2013-09-17 Neopath Networks, Inc. Enabling proxy services using referral mechanisms
US8832697B2 (en) 2005-06-29 2014-09-09 Cisco Technology, Inc. Parallel filesystem traversal for transparent mirroring of directories and files

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7587422B2 (en) 2003-04-24 2009-09-08 Neopath Networks, Inc. Transparent file replication using namespace replication
US7831641B2 (en) 2003-04-24 2010-11-09 Neopath Networks, Inc. Large file support for a network file server
US7720796B2 (en) 2004-04-23 2010-05-18 Neopath Networks, Inc. Directory and file mirroring for migration, snapshot, and replication
JP4451293B2 (en) * 2004-12-10 2010-04-14 株式会社日立製作所 Network storage system of cluster configuration sharing name space and control method thereof
DE102005013502A1 (en) * 2005-03-23 2006-09-28 Fujitsu Siemens Computers Gmbh A method for removing a mass storage system from a computer network and computer program product and computer network for performing the method
US7716420B2 (en) 2006-04-28 2010-05-11 Network Appliance, Inc. Methods of converting traditional volumes into flexible volumes
JP4288525B2 (en) 2007-02-16 2009-07-01 日本電気株式会社 File sharing system and file sharing method
US9235595B2 (en) * 2009-10-02 2016-01-12 Symantec Corporation Storage replication systems and methods
JP2012008854A (en) * 2010-06-25 2012-01-12 Hitachi Ltd Storage virtualization device
JP6485352B2 (en) * 2013-07-23 2019-03-20 株式会社アレスシステム Receiving apparatus, method, computer program
CN104407947B (en) * 2014-10-29 2018-04-27 中国建设银行股份有限公司 Active and standby NAS switching methods and device
JP6720744B2 (en) 2016-07-15 2020-07-08 富士通株式会社 Information processing system, information processing apparatus, and control program
CN109428942A (en) * 2017-09-05 2019-03-05 南京南瑞继保电气有限公司 Live File Serving System and file server are across live synchronous method more than a kind of
JP7347007B2 (en) 2019-08-28 2023-09-20 富士フイルムビジネスイノベーション株式会社 Information processing device, information processing system, and information processing program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5689701A (en) * 1994-12-14 1997-11-18 International Business Machines Corporation System and method for providing compatibility between distributed file system namespaces and operating system pathname syntax
US6389427B1 (en) * 1998-02-20 2002-05-14 Redleaf Group, Inc. File system performance enhancement
US6442548B1 (en) * 1997-01-31 2002-08-27 International Business Machines Corporation Database interface for database unaware applications
US20040054748A1 (en) * 2002-09-16 2004-03-18 Emmanuel Ackaouy Apparatus and method for processing data in a network

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3410010B2 (en) * 1997-12-24 2003-05-26 株式会社日立製作所 Subsystem migration method and information processing system
US6850959B1 (en) * 2000-10-26 2005-02-01 Microsoft Corporation Method and system for transparently extending non-volatile storage
US6976060B2 (en) 2000-12-05 2005-12-13 Agami Sytems, Inc. Symmetric shared file storage system
AU2002249939A1 (en) * 2001-01-11 2002-07-24 Z-Force Communications, Inc. File switch and switched file system
US20030154236A1 (en) * 2002-01-22 2003-08-14 Shaul Dar Database Switch enabling a database area network
US7225204B2 (en) * 2002-03-19 2007-05-29 Network Appliance, Inc. System and method for asynchronous mirroring of snapshots at a destination using a purgatory directory and inode mapping
US6540337B1 (en) * 2002-07-26 2003-04-01 Hewlett-Packard Company Slotted substrates and methods and systems for forming same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5689701A (en) * 1994-12-14 1997-11-18 International Business Machines Corporation System and method for providing compatibility between distributed file system namespaces and operating system pathname syntax
US6442548B1 (en) * 1997-01-31 2002-08-27 International Business Machines Corporation Database interface for database unaware applications
US6389427B1 (en) * 1998-02-20 2002-05-14 Redleaf Group, Inc. File system performance enhancement
US20040054748A1 (en) * 2002-09-16 2004-03-18 Emmanuel Ackaouy Apparatus and method for processing data in a network

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8180843B2 (en) 2003-04-24 2012-05-15 Neopath Networks, Inc. Transparent file migration using namespace replication
US8539081B2 (en) 2003-09-15 2013-09-17 Neopath Networks, Inc. Enabling proxy services using referral mechanisms
US8190741B2 (en) 2004-04-23 2012-05-29 Neopath Networks, Inc. Customizing a namespace in a decentralized storage environment
US8195627B2 (en) 2004-04-23 2012-06-05 Neopath Networks, Inc. Storage policy monitoring for a storage network
US8832697B2 (en) 2005-06-29 2014-09-09 Cisco Technology, Inc. Parallel filesystem traversal for transparent mirroring of directories and files
US8131689B2 (en) 2005-09-30 2012-03-06 Panagiotis Tsirigotis Accumulating access frequency and file attributes for supporting policy based storage management

Also Published As

Publication number Publication date
EP1618500A2 (en) 2006-01-25
WO2004097686A1 (en) 2004-11-11
JP4588024B2 (en) 2010-11-24
JP2006524873A (en) 2006-11-02
WO2004097572A2 (en) 2004-11-11
EP1618500A4 (en) 2009-01-07

Similar Documents

Publication Publication Date Title
WO2004097572A3 (en) Transparent file migration using namespace replication
CN106250270B (en) A kind of data back up method under cloud computing platform
CN106156359B (en) A kind of data synchronization updating method under cloud computing platform
CN106294585B (en) A kind of storage method under cloud computing platform
US9967298B2 (en) Appending to files via server-side chunking and manifest manipulation
US9633038B2 (en) Detecting out-of-band (OOB) changes when replicating a source file system using an in-line system
EP2962218B1 (en) Decoupled content and metadata in a distributed object storage ecosystem
Mashtizadeh et al. Replication, history, and grafting in the ori file system
US9323758B1 (en) Efficient migration of replicated files from a file server having a file de-duplication facility
US20090204649A1 (en) File Deduplication Using Storage Tiers
JP2008506161A5 (en)
US20040267832A1 (en) Extended storage capacity for a network file server
CA2211654A1 (en) Fault tolerant nfs server system and mirroring protocol
WO2005119494A3 (en) Transaction based virtual file system optimized for high-latency network connections
WO2006015097A3 (en) Metadata management for fixed content distributed data storage
WO2005089446A3 (en) A novel media file access and storage solution for multi-workstation/multi-platform non-linear video editing systems
DE69636192D1 (en) DATA MIGRATION SYSTEM AND METHOD USING LEAKAGE FILES
AU2002214659A1 (en) Method and system for managing distributed content and related metadata
US20170091215A1 (en) Write-back cache transaction replication to object-based storage
Xu et al. Data deduplication mechanism for cloud storage systems
Matri et al. Týrfs: Increasing small files access performance with dynamic metadata replication
CN105721520A (en) File synchronization method and file synchronization device
CN106528667A (en) Low-power-consumption mass data full-text retrieval system frame capable of carrying out read-write separation
WO2009064720A2 (en) Load sharing, file migration, network configuration, and file deduplication using file virtualization
Sethi et al. Leveraging hadoop framework to develop duplication detector and analysis using Mapreduce, Hive and Pig

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006513342

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2004750678

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2004750678

Country of ref document: EP