WO2007047934A3 - Method and apparatus for increasing throughput in a storage server - Google Patents

Method and apparatus for increasing throughput in a storage server Download PDF

Info

Publication number
WO2007047934A3
WO2007047934A3 PCT/US2006/041055 US2006041055W WO2007047934A3 WO 2007047934 A3 WO2007047934 A3 WO 2007047934A3 US 2006041055 W US2006041055 W US 2006041055W WO 2007047934 A3 WO2007047934 A3 WO 2007047934A3
Authority
WO
WIPO (PCT)
Prior art keywords
storage server
domain
processes
increasing throughput
subsets
Prior art date
Application number
PCT/US2006/041055
Other languages
French (fr)
Other versions
WO2007047934A2 (en
Inventor
Jason A Lango
Robert M English
Yasuhiro Endo
Mehul S Shah
William P Mcgovern
Original Assignee
Network Appliance Inc
Jason A Lango
Robert M English
Yasuhiro Endo
Mehul S Shah
William P Mcgovern
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Network Appliance Inc, Jason A Lango, Robert M English, Yasuhiro Endo, Mehul S Shah, William P Mcgovern filed Critical Network Appliance Inc
Priority to JP2008536828A priority Critical patent/JP2009512948A/en
Priority to EP06826356A priority patent/EP1949230A2/en
Publication of WO2007047934A2 publication Critical patent/WO2007047934A2/en
Publication of WO2007047934A3 publication Critical patent/WO2007047934A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5066—Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/52—Program synchronisation; Mutual exclusion, e.g. by means of semaphores

Abstract

Multiple domains are created for processes of a storage server. The processes are capable of execution on a plurality of processors in the storage server. The domains include a first domain, which includes multiple threads that can execute processes in the first domain in parallel, to service data access requests. A data set managed by the storage server is logically divided into multiple subsets, and each of the subsets is assigned to exactly one of the threads in the first domain, for processing of data access requests directed to the data set.
PCT/US2006/041055 2005-10-20 2006-10-19 Method and apparatus for increasing throughput in a storage server WO2007047934A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2008536828A JP2009512948A (en) 2005-10-20 2006-10-19 Method and apparatus for increasing throughput in a storage server
EP06826356A EP1949230A2 (en) 2005-10-20 2006-10-19 Method and apparatus for increasing throughput in a storage server

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/255,859 US8347293B2 (en) 2005-10-20 2005-10-20 Mutual exclusion domains to perform file system processes on stripes
US11/255,859 2005-10-20

Publications (2)

Publication Number Publication Date
WO2007047934A2 WO2007047934A2 (en) 2007-04-26
WO2007047934A3 true WO2007047934A3 (en) 2007-07-05

Family

ID=37649293

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/041055 WO2007047934A2 (en) 2005-10-20 2006-10-19 Method and apparatus for increasing throughput in a storage server

Country Status (4)

Country Link
US (1) US8347293B2 (en)
EP (1) EP1949230A2 (en)
JP (1) JP2009512948A (en)
WO (1) WO2007047934A2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8078674B2 (en) * 2007-05-10 2011-12-13 International Business Machines Corporation Server device operating in response to received request
US7975102B1 (en) 2007-08-06 2011-07-05 Netapp, Inc. Technique to avoid cascaded hot spotting
US8051091B2 (en) * 2008-02-19 2011-11-01 Sap Ag Parallelizing data manipulation by data set abstraction
US8296515B1 (en) * 2009-05-22 2012-10-23 Nvidia Corporation RAID-6 computation system and method
US8627331B1 (en) 2010-04-30 2014-01-07 Netapp, Inc. Multi-level parallelism of process execution in a mutual exclusion domain of a processing system
US10382527B2 (en) * 2013-10-16 2019-08-13 International Business Machines Corporation Performing optimized collective operations in an irregular subcommunicator of compute nodes in a parallel computer
JP6555029B2 (en) * 2015-09-08 2019-08-07 富士通株式会社 Storage system, storage apparatus and communication method
US11687771B2 (en) * 2019-01-23 2023-06-27 Samsung Electronics Co., Ltd. Platform for concurrent execution of GPU operations
CN114995771B (en) * 2022-08-02 2022-12-13 苏州浪潮智能科技有限公司 Formatting scheduling method, device, equipment and medium for redundant array of independent disks

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002012839A2 (en) * 2000-08-10 2002-02-14 Informatica Corporation Method and apparatus relating to data transport
US6691166B1 (en) * 1999-01-07 2004-02-10 Sun Microsystems, Inc. System and method for transferring partitioned data sets over multiple threads

Family Cites Families (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4333144A (en) 1980-02-05 1982-06-01 The Bendix Corporation Task communicator for multiple computer system
US4488231A (en) 1980-09-29 1984-12-11 Honeywell Information Systems Inc. Communication multiplexer having dual microprocessors
FR2500659B1 (en) 1981-02-25 1986-02-28 Philips Ind Commerciale DEVICE FOR THE DYNAMIC ALLOCATION OF THE TASKS OF A MULTIPROCESSOR COMPUTER
JPS57164340A (en) 1981-04-03 1982-10-08 Hitachi Ltd Information processing method
US4604694A (en) 1983-12-14 1986-08-05 International Business Machines Corporation Shared and exclusive access control
US4745450A (en) 1984-03-02 1988-05-17 Zilog, Inc. Integrated circuit high voltage protection
US4742447A (en) 1986-01-16 1988-05-03 International Business Machines Corporation Method to control I/O accesses in a multi-tasking virtual memory virtual machine type data processing system
US4951193A (en) 1986-09-05 1990-08-21 Hitachi, Ltd. Parallel computer with distributed shared memories and distributed task activating circuits
US4785392A (en) 1986-10-14 1988-11-15 Amdahl Corporation Addressing multiple storage spaces
US4875159A (en) 1987-12-22 1989-10-17 Amdahl Corporation Version management system using plural control fields for synchronizing two versions of files in a multiprocessor system
US5055999A (en) 1987-12-22 1991-10-08 Kendall Square Research Corporation Multiprocessor digital data processing system
US4914583A (en) 1988-04-13 1990-04-03 Motorola, Inc. Method of indicating processes resident within a cell of a data processing system
JPH07101410B2 (en) 1990-01-17 1995-11-01 インターナショナル、ビジネス、マシーンズ、コーポレーション Method for synchronizing instruction stream execution for testing serialization means in a data processing network
DE69029084D1 (en) 1990-02-27 1996-12-12 Ibm Message routing device by several computers that are coupled by means of a shared intelligent memory
US5253359A (en) 1990-06-11 1993-10-12 Supercomputer Systems Limited Partnership Control and maintenance subsystem network for use with a multiprocessor computer system
US5280614A (en) 1990-08-21 1994-01-18 International Business Machines Corporation Apparatus and method for controlling access to data using domains
DE69130630T2 (en) 1990-09-14 1999-09-09 Hitachi Ltd Synchronous process and device for processors
JPH04308961A (en) 1991-01-18 1992-10-30 Ncr Corp Means and apparatus for notifying state of synchronous locking of occupied process
DE4129809C2 (en) 1991-01-28 2000-08-17 Bosch Gmbh Robert Multi-computer system
JPH0827755B2 (en) 1991-02-15 1996-03-21 インターナショナル・ビジネス・マシーンズ・コーポレイション How to access data units at high speed
US5483641A (en) * 1991-12-17 1996-01-09 Dell Usa, L.P. System for scheduling readahead operations if new request is within a proximity of N last read requests wherein N is dependent on independent activities
DK0702815T3 (en) 1993-06-03 2000-12-18 Network Appliance Inc Set up a file system for writing at any location
US5963962A (en) 1995-05-31 1999-10-05 Network Appliance, Inc. Write anywhere file-system layout
CA2125258C (en) * 1993-08-05 1998-12-22 Dinah B Quiachon Multicapsule intraluminal grafting system and method
JPH0784851A (en) 1993-09-13 1995-03-31 Toshiba Corp Shared data managing method
CA2172514C (en) * 1993-09-27 2000-02-22 Gary Hallmark Method and apparatus for parallel processing in a database system
US5481706A (en) 1993-11-01 1996-01-02 International Business Machines Corporation System and method for creating thread-safe shared libraries
US5644709A (en) 1994-04-21 1997-07-01 Wisconsin Alumni Research Foundation Method for detecting computer memory access errors
JP3231571B2 (en) 1994-12-20 2001-11-26 日本電気株式会社 Ordered multi-thread execution method and its execution device
US5872909A (en) 1995-01-24 1999-02-16 Wind River Systems, Inc. Logic analyzer for software
US5513314A (en) * 1995-01-27 1996-04-30 Auspex Systems, Inc. Fault tolerant NFS server system and mirroring protocol
JP3778593B2 (en) 1995-06-23 2006-05-24 富士通株式会社 System resource management apparatus and management method
US6105053A (en) 1995-06-23 2000-08-15 Emc Corporation Operating system for a non-uniform memory access multiprocessor system
US6728959B1 (en) 1995-08-08 2004-04-27 Novell, Inc. Method and apparatus for strong affinity multiprocessor scheduling
US6151618A (en) 1995-12-04 2000-11-21 Microsoft Corporation Safe general purpose virtual machine computing system
US5826081A (en) 1996-05-06 1998-10-20 Sun Microsystems, Inc. Real time thread dispatcher for multiprocessor applications
US6714960B1 (en) 1996-11-20 2004-03-30 Silicon Graphics, Inc. Earnings-based time-share scheduling
US5931938A (en) 1996-12-12 1999-08-03 Sun Microsystems, Inc. Multiprocessor computer having configurable hardware system domains
US6269390B1 (en) 1996-12-17 2001-07-31 Ncr Corporation Affinity scheduling of data within multi-processor computer systems
US6317774B1 (en) 1997-01-09 2001-11-13 Microsoft Corporation Providing predictable scheduling of programs using a repeating precomputed schedule
US5790851A (en) 1997-04-15 1998-08-04 Oracle Corporation Method of sequencing lock call requests to an O/S to avoid spinlock contention within a multi-processor environment
JPH10311944A (en) 1997-05-14 1998-11-24 Olympus Optical Co Ltd Projecting device
US6366945B1 (en) 1997-05-23 2002-04-02 Ibm Corporation Flexible dynamic partitioning of resources in a cluster computing environment
JP3052908B2 (en) 1997-09-04 2000-06-19 日本電気株式会社 Transaction program parallel execution method and transaction program parallel execution method
US5940828A (en) 1997-11-18 1999-08-17 International Business Machines Corporation Locking contention resolution for shared resources
US6675189B2 (en) 1998-05-28 2004-01-06 Hewlett-Packard Development Company, L.P. System for learning and applying integrated task and data parallel strategies in dynamic applications
US6345240B1 (en) 1998-08-24 2002-02-05 Agere Systems Guardian Corp. Device and method for parallel simulation task generation and distribution
US6289369B1 (en) 1998-08-25 2001-09-11 International Business Machines Corporation Affinity, locality, and load balancing in scheduling user program-level threads for execution by a computer system
US6622155B1 (en) 1998-11-24 2003-09-16 Sun Microsystems, Inc. Distributed monitor concurrency control
US6378066B1 (en) * 1999-02-04 2002-04-23 Sun Microsystems, Inc. Method, apparatus, and article of manufacture for developing and executing data flow programs, and optimizing user input specifications
US6604123B1 (en) 1999-02-23 2003-08-05 Lucent Technologies Inc. Operating system transfer of control and parameter manipulation using portals
US6801943B1 (en) 1999-04-30 2004-10-05 Honeywell International Inc. Network scheduler for real time applications
US6546546B1 (en) 1999-05-19 2003-04-08 International Business Machines Corporation Integrating operating systems and run-time systems
US6434631B1 (en) 1999-10-15 2002-08-13 Lucent Technologies Inc. Method and system for providing computer storage access with quality of service guarantees
US6529983B1 (en) * 1999-11-03 2003-03-04 Cisco Technology, Inc. Group and virtual locking mechanism for inter processor synchronization
JP2001167060A (en) 1999-12-07 2001-06-22 Hitachi Ltd Task paralleling method
ATE291303T1 (en) 1999-12-23 2005-04-15 Cetacean Networks Inc NETWORK SWITCHING WITH PACKET SEQUENCING CONTROL
US7213247B1 (en) 2000-01-10 2007-05-01 Wind River Systems, Inc. Protection domains for a computer operating system
US7080386B2 (en) 2000-01-25 2006-07-18 Texas Instruments Incorporated Architecture with digital signal processor plug-ins for general purpose processor media frameworks
AU2001241430A1 (en) 2000-01-28 2001-08-07 Pointserve, Inc. Multi-layer engine using generic controls for optimal routing scheme
US6658449B1 (en) 2000-02-17 2003-12-02 International Business Machines Corporation Apparatus and method for periodic load balancing in a multiple run queue system
AU2001243365A1 (en) 2000-03-02 2001-09-12 Alarity Corporation System and method for process protection
US20010042139A1 (en) 2000-03-31 2001-11-15 Aprisma Management Technologies Replicated resource management system for managing resources in a distributed application and maintaining a relativistic view of state
US6910212B2 (en) * 2000-12-04 2005-06-21 International Business Machines Corporation System and method for improved complex storage locks
US6678772B2 (en) 2000-12-19 2004-01-13 International Businesss Machines Corporation Adaptive reader-writer lock
US7178137B1 (en) * 2001-04-05 2007-02-13 Network Appliance, Inc. Automatic verification of scheduling domain consistency
US7694302B1 (en) * 2001-04-05 2010-04-06 Network Appliance, Inc. Symmetric multiprocessor synchronization using migrating scheduling domains
US6725959B1 (en) * 2001-12-20 2004-04-27 Raymond Shea Motorized snow board vehicle
US7337442B2 (en) 2002-12-03 2008-02-26 Microsoft Corporation Methods and systems for cooperative scheduling of hardware resource elements
US7290260B2 (en) 2003-02-20 2007-10-30 International Business Machines Corporation Dynamic processor redistribution between partitions in a computing system
US7404067B2 (en) * 2003-09-08 2008-07-22 Intel Corporation Method and apparatus for efficient utilization for prescient instruction prefetch
US8171480B2 (en) * 2004-01-27 2012-05-01 Network Appliance, Inc. Method and apparatus for allocating shared resources to process domains according to current processor utilization in a shared resource processor

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6691166B1 (en) * 1999-01-07 2004-02-10 Sun Microsystems, Inc. System and method for transferring partitioned data sets over multiple threads
WO2002012839A2 (en) * 2000-08-10 2002-02-14 Informatica Corporation Method and apparatus relating to data transport

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JIN XIONG ET AL: "Design and performance of the dawning cluster file system", CLUSTER COMPUTING, 2003. PROCEEDINGS. 2003 IEEE INTERNATIONAL CONFERENCE ON DEC. 1-4, 2003, PISCATAWAY, NJ, USA,IEEE, 1 December 2003 (2003-12-01), pages 232 - 239, XP010674297, ISBN: 0-7695-2066-9 *
JOUKOV N ET AL: "Increasing distributed storage survivability with a stackable raid-like file system", CLUSTER COMPUTING AND THE GRID, 2005. CCGRID 2005. IEEE INTERNATIONAL SYMPOSIUM ON CARDIFF, WALES, UK MAY 9-12, 2005, PISCATAWAY, NJ, USA,IEEE, 9 May 2005 (2005-05-09), pages 82 - 89, XP010863593, ISBN: 0-7803-9074-1 *

Also Published As

Publication number Publication date
WO2007047934A2 (en) 2007-04-26
US8347293B2 (en) 2013-01-01
US20070094529A1 (en) 2007-04-26
EP1949230A2 (en) 2008-07-30
JP2009512948A (en) 2009-03-26

Similar Documents

Publication Publication Date Title
WO2007047934A3 (en) Method and apparatus for increasing throughput in a storage server
WO2019025864A3 (en) A memory-based distributed processor architecture
WO2014110167A3 (en) Integrated machine learning for a data management product
WO2006121572A3 (en) System and method for scanning obfuscated files for pestware
WO2020086123A8 (en) Data processing method and apparatus
WO2007082044A3 (en) Method and apparatus for processing algorithm steps of multimedia data in parallel processing systems
WO2008086093A3 (en) Method, system and computer program product for enforcing privacy policies
WO2010006132A3 (en) Network storage
WO2008148130A3 (en) Distributed system for monitoring information events
WO2009044461A1 (en) Device access control program, device access control method, and information processor
EP1577770A3 (en) Method and system for grid-enabled virtual machines with distributed management of applications
EP2723095A3 (en) Set top box architecture supporting mixed secure and unsecure media pathways
WO2008030569A3 (en) Methods and apparatus for identifying workflow graphs using an iterative analysis of empirical data
WO2010147926A3 (en) Catalog-based software component management
WO2012138847A3 (en) System and method for providing vehicle and fleet profiles and presentations of trends
BRPI0819170A8 (en) METHOD TO PERFORM A COMPUTATIONAL TASK, AND, NETWORK COMPUTER SYSTEM CONFIGURED TO PERFORM A COMPUTATIONAL TASK
JP2005235019A5 (en)
WO2007016624A3 (en) A method and system for hierarchical license servers
WO2016167980A3 (en) Virtual machine systems
WO2007127234A3 (en) System and method for separating multiple workloads processing in a single computer operating environment
WO2008144179A8 (en) Method and apparatus for cache transactions in a data processing system
WO2017109502A3 (en) Methods. apparatuses. and computer programs for data processing. and hierarchical domain name system zone files
WO2009079274A3 (en) Method and apparatus for processing a multi-step authentication sequence
TW200612244A (en) Free resource error/event log for autonomic data processing system
WO2007027211A3 (en) System and method for scanning memory for pestware

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 2008536828

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2006826356

Country of ref document: EP