US20100205150A1 - Systems and methods for classifying and transferring information in a storage network - Google Patents

Systems and methods for classifying and transferring information in a storage network Download PDF

Info

Publication number
US20100205150A1
US20100205150A1 US12/766,146 US76614610A US2010205150A1 US 20100205150 A1 US20100205150 A1 US 20100205150A1 US 76614610 A US76614610 A US 76614610A US 2010205150 A1 US2010205150 A1 US 2010205150A1
Authority
US
United States
Prior art keywords
data
storage
data storage
access
metabase
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/766,146
Inventor
Anand Prahlad
Jeremy A. Schwartz
David Ngo
Brian Brockway
Marcus S. Muller
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Commvault Systems Inc
Original Assignee
Commvault Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=37989185&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20100205150(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Commvault Systems Inc filed Critical Commvault Systems Inc
Priority to US12/766,146 priority Critical patent/US20100205150A1/en
Publication of US20100205150A1 publication Critical patent/US20100205150A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1727Details of free space management performed by the file system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0605Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1415Saving, restoring, recovering or retrying at system level
    • G06F11/1435Saving, restoring, recovering or retrying at system level using file system or storage system metadata
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1466Management of the backup or restore process to make the backup process non-disruptive
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/119Details of migration of file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/122File system administration, e.g. details of archiving or snapshots using management policies
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices
    • G06F16/134Distributed indices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1734Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2457Query processing with adaptation to user needs
    • G06F16/24575Query processing with adaptation to user needs using context
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1461Backup scheduling policy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1471Saving, restoring, recovering or retrying involving logging of persistent data for recovery
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80Database-specific techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647Migration mechanisms
    • G06F3/0649Lifecycle management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0685Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99942Manipulating data structure, e.g. compression, compaction, compilation
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99948Application of database or data structure, e.g. distributed, multimedia, or image
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99951File or database maintenance
    • Y10S707/99952Coherency, e.g. same view to multiple users
    • Y10S707/99955Archiving or backup

Definitions

  • aspects of the invention disclosed herein relate generally to performing operations on electronic data in a computer network. More particularly, aspects of the present invention relate to detecting data interactions within a computer network and/or performing storage-related operations for a computer network according to a specified classification paradigm.
  • data can be stored in primary storage as a primary copy or in secondary storage as various types of secondary copies including, as a backup copy, a snapshot copy, a hierarchical storage management copy (“HSM”), as an archive copy, and as other types of copies.
  • primary copy or in secondary storage as various types of secondary copies including, as a backup copy, a snapshot copy, a hierarchical storage management copy (“HSM”), as an archive copy, and as other types of copies.
  • HSM hierarchical storage management copy
  • a primary copy of data is generally a production copy or other “live” version of the data which is used by a software application and is generally in the native format of that application.
  • Primary copy data may be maintained in a local memory or other high-speed storage device that allows for relatively fast data access if necessary.
  • Such primary copy data is typically intended for short term retention (e.g., several hours or days) before some or all of the data is stored as one or more secondary copies, for example to prevent loss of data in the event a problem occurred with the data stored in primary storage.
  • Secondary copies include point-in-time data and are typically for intended for long-term retention (e.g., weeks, months or years depending on retention criteria, for example as specified in a storage policy as further described herein) before some or all of the data is moved to other storage or discarded. Secondary copies may be indexed so users can browse and restore the data at another point in time. After certain primary copy data is backed up, a pointer or other location indicia such as a stub may be placed in the primary copy to indicate the current location of that data.
  • a backup copy is generally a point-in-time copy of the primary copy data stored in a backup format as opposed to in native application format.
  • a backup copy may be stored in a backup format that is optimized for compression and efficient long-term storage.
  • Backup copies generally have relatively long retention periods and may be stored on media with slower retrieval times than other types of secondary copies and media. In some cases, backup copies may be stored at on offsite location.
  • a snapshot may be thought as an instant image of the primary copy data at a given point in time.
  • a snapshot generally captures the directory structure of a primary copy volume at a particular moment in time, and also preserves file attributes and contents.
  • a snapshot may exist as a virtual file system, parallel to the actual file system. Users typically gain a read-only access to the record of files and directories of the snapshot. By electing to restore primary copy data from a snapshot taken at a given point in time, users may also return the current file system to the prior state of the file system that existed when the snapshot was taken.
  • a snapshot may be created instantly, using a minimum of file space, but may still function as a conventional file system backup.
  • a snapshot may not actually create another physical copy of all the data, but may simply create pointers that are able to map files and directories to specific disk blocks.
  • the initial snapshot may use only a small amount of disk space needed to record a mapping or other data structure representing or otherwise tracking the blocks that correspond to the current state of the file system. Additional disk space is usually only required when files and directories are actually modified later. Furthermore, when files are modified, typically only the pointers which map to blocks are copied, not the blocks themselves. In some embodiments, for example in the case of copy-on-write snapshots, when a block changes in primary storage, the block is copied to secondary storage before the block is overwritten in primary storage and the snapshot mapping of file system data is updated to reflect the changed block(s) at that particular point in time.
  • An HSM copy is generally a copy of the primary copy data, but typically includes only a subset of the primary copy data that meets a certain criteria and is usually stored in a format other than the native application format.
  • an HSM copy might include only that data from the primary copy that is larger than a given size threshold or older than a given age threshold and that is stored in a backup format.
  • HSM data is removed from the primary copy, and a stub is stored in the primary copy to indicate its new location.
  • systems use the stub to locate the data and often make recovery of the data appear transparent even though the HSM data may be stored at a location different from the remaining primary copy data.
  • An archive copy is generally similar to an HSM copy, however, the data satisfying criteria for removal from the primary copy is generally completely removed with no stub left in the primary copy to indicate the new location (i.e., where it has been moved to).
  • Archive copies of data are generally stored in a backup format or other non-native application format.
  • archive copies are generally retained for very long periods of time (e.g., years) and in some cases are never deleted. Such archive copies may be made and kept for extended periods in order to meet compliance regulations or for other permanent storage applications.
  • ILM information lifecycle management
  • the QiNetix system leverages a modular storage management architecture that may include, among other things, storage manager components, client or data agent components, and media agent components as further described in U.S. patent application Ser. No. 10/818,749 which is hereby incorporated herein by reference in its entirety.
  • the QiNetix system also may be hierarchically configured into backup cells to store and retrieve backup copies of electronic data as further described in U.S. patent application Ser. No. 09/354,058 which is hereby incorporated by reference in its entirety.
  • conventional storage management systems perform storage operations associated with electronic data based on location-specific criteria. For example, data generated by applications running on a particular client is typically copied according to location-specific criteria, such as from a certain location such as a specific folder or subfolder, according to a specified data path, etc.
  • a module installed on the client or elsewhere in the system may supervise the transfer of data from the client to another location in a primary or secondary storage. Similar data transfers associated with location-specific criteria are performed when restoring data from secondary storage to primary storage. For example, to restore data, a user or system process must specify a particular secondary storage device, piece of media, archive file, etc.
  • the precision with which conventional storage management systems perform storage operations on electronic data is generally limited by the ability to define or specify storage operations based on data location rather than information relating to or describing the data itself.
  • FIG. 1 is a flow chart in accordance with an embodiment of the present invention
  • FIG. 2 is a system constructed in accordance with an embodiment of the present invention
  • FIG. 3 a is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 3 b is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 4 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 5 is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 6 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 7 is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 8 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 9 is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 10 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 11 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 11 a is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 12 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 13 is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 14 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 15 is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 16 is a data arrangement in accordance with an embodiment of the present invention.
  • FIG. 17 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 18 is a system constructed in accordance with an embodiment of the present invention.
  • FIG. 19 is a flow chart in accordance with an embodiment of the present invention.
  • FIG. 20 is a flow chart in accordance with an embodiment of the present invention.
  • aspects of the present invention are generally concerned with systems and methods that analyze and classify various forms of data that, among other things, facilitates identification, searching, storage and retrieval of data that satisfies certain criteria.
  • the inventions disclosed herein have broad-based applicability to any wireless or hard-wired network or data transfer system that stores and conveys data from one point to another, including communication networks, enterprise networks, storage networks, and the like.
  • aspects of the present invention provide systems and methods for data classification to facilitate and improve data management within an enterprise.
  • the disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things.
  • methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.
  • the systems and methods described in detail below are for analyzing data and other information in a computer network (sometimes referred to herein as a “data object”) and creating a database or index of information which may describe certain pertinent aspects of the data objects that allow a user or system process to consult the database to obtain information regarding the network data.
  • a data collection agent may traverse a network file system and obtain certain characteristics and other attributes of data in the system.
  • such a database may be a collection of metadata and/or other information regarding the network data and may be referred to herein as a “metabase.”
  • metadata refers to data or information about data, and may include, for example, data relating to storage operations or storage management, such as data locations, storage management components associated with data, storage devices used in performing storage operations, index data, data application type, or other data.
  • a flow chart 100 illustrating some of the steps associated with one embodiment of the present invention is shown in FIG. 1 .
  • classification agents may be installed globally on a computing device or with respect to certain subsystems on a computing device.
  • the classification software may monitor certain information regarding data objects generated by the computers and classify this information for use as further described herein.
  • a monitor agent may be initialized.
  • a monitoring agent may be resident or installed on each computing device similar to the deployment of classification agents described above and may be configured to monitor and record certain data interactions within each machine or process.
  • the monitor agent may include a filter driver program and may be deployed on an input/output port or data stack and operate in conjunction with a file management program to record interactions with computing device data. This may involve creating a data structure such as a record or journal of each interaction.
  • the records may be stored in a journal data structure and may chronicle data interactions on an interaction by interaction basis.
  • the journal may include information regarding the type of interaction that has occurred along with certain relevant properties of the data involved in the interaction.
  • One example of such a monitor program may include Microsoft's Change Journal or similar program.
  • the portions of the network or subject system may be quiesced such that no data interactions are permitted prior to completing an optional scan of system files as described in conjunction with step 106 below. This may be done in order to obtain an accurate point in time picture of the data being scanned and to maintain referential integrity within the system. For example, if the system were not quiesced, data interactions would continue and be allowed to pass through to mass storage and thus data would change. However, in some embodiments, the subject system may be allowed to continue to operate, with operations or instructions queued in a cache. These operations are typically performed after the scan is complete so that any such data interactions occur based on the cached operations are captured by the monitor agent.
  • the file scanning of step 106 may be performed by a data classification agent and may include traversing the file system of a client to identify data objects or other files, email or other information currently stored or present in the system and obtain certain information regarding the information such as any available metadata.
  • metadata may include information about data objects or characteristics associated with data objects such as the data owner (e.g., the client or user that generates the data or other data manager), the last modified time (e.g., the time of the most recent modification), the data size (e.g., number of bytes of data), information about the data content (e.g., the application that generated the data, the user that generated the data, etc.), to/from information for email (e.g., an email sender, recipient or individual or group on an email distribution list), creation date (e.g., the date on which the data object was created), file type (e.g., format or application type), last accessed time (e.g., the time the data object was most recently accessed or viewed), application type (e.g.,
  • the network or subject system may be released from the quiesced state and normal operation may resume.
  • the monitor agent may monitor system operations to record changes to system data in the change journal database as described above.
  • the change journal database may include a database of metadata or data changes and may comprise log files of the data or metadata changes.
  • the data classification agent may periodically consult the change journal database for new entries. If new entries exist, these entries may be examined, and if deemed relevant, then analyzed, parsed, and written to the metabase as an update (step 112 ).
  • change journal entries may be supplied substantially in parallel to the journal database and data classification agent. This allows the metabase to maintain substantially current information regarding the state of system data at any given point in time.
  • one benefit of such a metabase is it significantly reduces the amount of time required to obtain information by substantially eliminating the need to obtain information directly from the source data. For example, assume a system administrator desires to identify data objects that a certain user has interacted with that contain certain content or other characteristics. Rather than search each file in each directory, a very time consuming process, the administrator may simply search the metabase to identify such data objects and any properties associated with those objects, (e.g., metadata, which may include location, size, etc.), resulting in significant time savings.
  • metadata which may include location, size, etc.
  • metabase for satisfying data queries also minimizes the involvement of network resources in this process, substantially reducing any processing burden on the host system. For example, as described above, if an administrator desires to identify certain data objects, querying the metabase rather than the file system virtually removes the host system from the query process (i.e., no brute force scanning of directories and files required), allowing host computing devices to continue performing host tasks rather than be occupied with search tasks.
  • FIG. 2 shows one embodiment of a client 200 constructed in accordance with principles of the present invention.
  • client 200 may include a classification agent 202 and a monitor agent 206 , which, in some embodiments, may be combined as an update agent 204 , and which may be a single module encompassing the functionality of both agents.
  • Client 200 may also include an internal or external data store 209 , metabase 210 , and change record 212 .
  • client 200 may be a computing device, or any portion of a computing device that generates electronic data.
  • Data store 209 generally represents application data such as production volume data used by client 200 .
  • Metabase 210 which may be internal or external to client 200 may contain information generated by classification agent 202 as described above.
  • change journal 212 which also may be internal or external to client 200 , may contain information generated by monitor agent 206 as described above.
  • data interactions occurring within client 200 may be monitored with update agent 204 or monitor agent 206 . Any relevant interaction may be recorded and written to change record 206 .
  • Data classification agent 202 may scan or receive entries from monitor agent 206 and update metabase 210 accordingly.
  • monitored data interactions may be processed in parallel with updates to change record 212 and written to data store 208 and metabase 210 occurring accordingly.
  • a file system 207 may be used to conduct or process data from the client to a data store 209 .
  • FIG. 3 a provides a more detailed view of the journaling and classification mechanisms of client 200 generally shown in FIG. 2 .
  • system 300 may include a memory 302 , an update agent 304 which may include a separate or integrated monitor agent 306 , classification agents 312 a and 312 b , a content agent 315 , a monitor program index 310 , metabase 314 and mass storage device 318 .
  • memory 302 may include random access memory (RAM) or other memory device employed by a computer in client 200 in performing data processing tasks.
  • RAM random access memory
  • Certain information from memory 302 may be periodically read or written to mass storage device 318 which may include a magnetic or optical disk drive such as a hard drive or other storage device known in the art.
  • monitoring agent 306 which, in some embodiments, may include any suitable monitoring or journaling agent as further described herein.
  • system 300 may also include an administrative file system program 316 , such as a file system program known in the art, which may include operating system programs, a FAT, an NTFS, etc. that may be used to manage data movement to and from mass storage device 318 .
  • data may be written from memory 302 to mass storage device 318 via file system program 316 .
  • Such an operation may occur, for example, to access data used to service an application running on a computing device.
  • monitor agent 306 may capture this interaction and generate a record indicating that an interaction has occurred and store the record in index 310 .
  • the data may be stored in mass storage 318 under the supervision of file system manager 316 .
  • monitor agent 306 may analyze data interactions such as interactions between memory 302 and mass storage 318 via the file system manager 316 , and record any such interactions in monitor index 310 .
  • monitor index 310 may represent a list of data interactions wherein each entry represents a change that has occurred to client data along with certain information regarding the interaction.
  • entries may include a unique identifier such as an update sequence number (USN), certain change journal reason codes identifying information associated with a reason(s) for the change made, along with data or metadata describing the data and certain data properties, data copy types, etc.
  • USN update sequence number
  • certain change journal reason codes identifying information associated with a reason(s) for the change made, along with data or metadata describing the data and certain data properties, data copy types, etc.
  • monitor agent 304 may create and write an entry to index 310 which may in turn, be analyzed and classified by classification agent 312 b for entry in metabase 314 .
  • classification agent 312 a may be coupled with mass storage device (either directly or through file system manager 316 ) and write metadata entries to both metabase 314 and mass storage device 318 .
  • the metabase information may be stored on mass storage device 318 .
  • classification agent 312 b may periodically copy or backup metabase 314 to the storage device under the direction of a storage manager and/or pursuant to a storage policy (not shown) such that the information in metabase 314 may be quickly restored if lost, deleted or is otherwise unavailable.
  • optional classification agent 312 a may operate in conjunction with monitor agent 306 such that data moving to mass storage device 318 is classified as further described herein and written to device 318 . With this arrangement, the data, along with the processed metadata describing that data, is written to mass storage device 318 . This may occur, for example in embodiments in which monitor agent 306 and classification agent 312 a are combined into update agent 304 . Writing metadata in this way allows it to be recovered or accessed from mass storage device 318 if necessary, for example, when metabase 314 is missing certain information, busy, or otherwise inaccessible.
  • Content agent 315 may be generally used to obtain or filter data relating to content of the data moving from memory 302 to mass storage 318 .
  • content agent 315 may read data payload information and generate metadata based on the operation for storage in metabase 314 and may include a pointer to the data item in mass storage 318 .
  • the pointer information may optionally be stored in an index.
  • This metadata may also be stored with the data item in mass storage 318 or as an entry functioning in place of or in addition to metabase 314 .
  • Storing metadata relating to data content in metabase 314 provides the capability to perform content searches for data in the metabase 314 , instead of searching entries in mass storage 318 . This allows the system to quickly locate information satisfying a content query that may be retrieved from mass storage 318 , if necessary.
  • content metadata may be generated and used in locating data based on content features throughout a hierarchy within a storage operation system (e.g., content metadata may be generated and stored at each or certain levels of storage within the system (primary. secondary, tertiary, etc.) to facilitate location and retrieval of data based on content).
  • content agent 315 classification agent 312 a & b and monitor agent 306 may be provided by one or more modules or components such that the modules may be integrated into a single module providing the described functions, or may be implemented in one more separate modules each providing some of the functions.
  • FIG. 3 b is a flow chart 350 illustrating some of the steps that may be involved in the journaling process described above.
  • the monitor program may be initialized, which may include instantiating a data structure or index for recording interaction entries, and the assignment of a unique journal ID number which allows the system to differentiate between various journaling data structures that may be operating within the system.
  • the monitor program may include a filter driver or other application that monitors data operations (step 360 ).
  • the monitor agent may observe data interactions between memory and mass storage to determine that certain data interactions have occurred. Information relating to the interactions may be captured and used to populate the metabase. In some instances, interaction types or certain aspects of interactions are captured.
  • Such types or aspects may be defined in an interaction definition, which may be a change journal reason codes as used by Microsoft's Change Journal program, or be defined by a user or network administrator to capture some or all data interactions in order to meet user needs.
  • an interaction definition which may be a change journal reason codes as used by Microsoft's Change Journal program, or be defined by a user or network administrator to capture some or all data interactions in order to meet user needs.
  • certain change definitions may record every data interaction that occurs regardless of whether any data actually changes or not. Such information may be useful, for example, to determine users or processes that have “touched scanned or otherwise accessed data without actually changing it.
  • interaction definitions may capture a relatively broad or narrow set of operations, allowing a user to customize the monitor program to meet certain goals.
  • Such interaction definitions may define or describe data movement, changes, manipulations or other operations or interactions that may be of interest to a system user or administrator (e.g., any operation that “touches” data may be recording along with the action or operation that caused the interaction (e.g. read, write, copy, parse, etc.)
  • change definitions may evolve over time or may be dynamic based on the entries sent to the index. For example, if expected results are not obtained, change definitions may be modified or additional definitions used until appropriate or desired results are obtained. This may be accomplished, for example by globally linking certain libraries of interaction definitions and selectively enabling libraries on a rolling basis until acceptable results are achieved. This process may be performed after the initial activation of the monitor agent and periodically thereafter, depending on changing needs or objectives.
  • the system may support the use of “user tags” that allow certain types of information to be tagged so they may be identified and tracked throughout the system.
  • a user may designate a particular type of data or information such as project information, or information shared between or accessed by particular group of users to be tracked across the system or through various levels of storage. This may be accomplished through a user interface (not shown) that allows a user to define certain information to be tagged, for example, by using any available attribute within the system such as those specified above with respect to the classification agent or filter used in the system.
  • the user may define one or more tags using these or other attributes which may be further refined by combining them through the use of logical or Boolean operators to a define a certain tag expression.
  • a user may define a certain tag by specifying one or more criteria to be satisfied such as certain system users, a certain data permission level, a certain project, etc. These criteria may be defined using a logical operators such as an AND or OR operators to conditionally combine various attributes to create a condition that defines a tag. All information satisfying those criteria may be tagged and tracked within the system. For example, as data passes through the monitor agent 306 (or other module within update agent 304 ), the data satisfying these criteria may be identified and tagged with a header or a flag or other identifying information as is known in the art. This information may be copied or otherwise noted by metabase 314 and mass storage 318 so that the information may be quickly identified.
  • criteria such as certain system users, a certain data permission level, a certain project, etc. These criteria may be defined using a logical operators such as an AND or OR operators to conditionally combine various attributes to create a condition that defines a tag. All information satisfying those criteria may be tagged and tracked within the system. For example, as data passes through the monitor agent 30
  • the metabase may contain entries keeping track of all entries satisfying the tag criteria along with information relating to the types of operations performed on the information as well as certain metadata relating to the data content and its location in mass storage 318 . This allows the system to search the metabase at a particular level of storage for the information, and quickly locate it within mass storage device for potential retrieval.
  • a step 365 the monitor agent may continue to monitor data interactions based on change definitions until an interaction satisfying a definition occurs.
  • a system may continue to monitor data interactions at steps 360 and 365 until a defined interaction, such as an interaction satisfying or corresponding to a selection criterion, such as an interaction definition, etc., occurs. If a defined interaction does occur, the monitor agent may create a record, which may be stored in a monitor program index, and in some embodiments, assign an interaction code that describes the interaction observed on the data object.
  • the monitor program may identify a data object identifier associated with the data and that is associated with the data interaction, such as a file reference number (FRN) related to the data object.
  • FPN file reference number
  • the FRN may include certain information such as the location or path of the associated data object. Any additional information (e.g., data properties, copy properties, storage policy information, etc.) associated with the FRN may also be obtained in order to enrich or enhance the record. In some embodiments, this may further involve obtaining information from other system files including master file tables (MFTs) to further enhance the metabase entries. Additional processing or formatting of the metabase entries may also occur in accordance with certain defined classification paradigms in order to populate the metabase with optimal or preferred information.
  • MFTs master file tables
  • the record may be assigned record identifier such as a unique update sequence number (USN) that may be used to uniquely identify the entry within the index, and, in some embodiments, act as an index memory location.
  • USN unique update sequence number
  • a particular record may be quickly located with a data structure based on the USN.
  • the information described above may be concatenated or otherwise combined with other data or metadata data obtained by the monitor agent and arranged in an appropriate or expected format to create the record that may be written to the monitor index.
  • the information described above may be written to the index and arranged at the index into an expected format or may be written to the record “as received” and include metadata or other information, such as a header describing that information such that adherence to a strict data format is not required. For example, some records may contain more or less information than other records, as appropriate.
  • the record may be “closed” by the system at step 385 and the system may then assign another USN to the next detected change.
  • the monitor agent or update agent may request any missing information to complete the entry. If such information is not received, the monitor agent may set a flag within the record to indicate it contains incomplete information and the record may then be closed.
  • FIG. 4 is a flow chart 400 illustrating some of the steps that may be involved in a data classification process.
  • the classification agent may be initialized, which may include activating, reserving and/or clearing certain buffers and/or linking to libraries associated with deployment of the classification agent.
  • the classification agent may classify existing stored data by, for example, traversing the file and directory structure of an object system to initially populate the metabase as described herein.
  • the classification agent may scan the entries in the interaction journal to determine whether new entries exist since any previous classification processing was performed, for example, by determining whether the most recent entry currently in the journal is more or less recent than the last journal entry analyzed. This may be accomplished in several ways. One method may include scanning a time or date information associated with the last journal entry examined and comparing it to the most recent time or date information than the entry currently present in the journal. If it is determined that the most recent journal entry occurred after a previous classification process, this process may be performed iteratively by “walking backwards” through the journal entries until the last entry previously analyzed by the classification agent is found. All entries with time information after that point may be considered new or unprocessed by the classification agent (step 440 ). If the last entry analyzed has the same time stamp as the most recent entry in the journal, no new entries exist and the system may return to step 420 to continue monitoring, etc.
  • Another method of identifying new journal entries may include comparing record identifiers such as USN numbers assigned to each journal entry (step 430 ). Journal entries with a larger USN number than the last entry previously analyzed may be considered new or unprocessed. If the last entry analyzed has the same USN number as the current entry, no new entries exist and the system may return to step 420 to continue monitoring, etc. This comparison may be performed until new entries are located (step 440 ) or until it is determined that no new entries exist.
  • any entries created by the journal agent may be automatically sent to the classification agent and the identification process may be largely unnecessary (except for the case where such scanning is necessary or desirable, for example, to repopulate the journal or verify certain information, etc.).
  • the system may determine if a metabase record already exists for the data object associated with those entries. This may be accomplished by comparing data object identifiers, such as FRNs of metabase entries with data object identifiers such as FRNs of journal entries. Matching these and other unique data characteristics may be used to match or correlate metabase and journal entries.
  • a new record may be created at step 460 . This may involve creating a new metabase entry ID, analyzing the journal entry and parsing the entry into a predetermined format, and copying certain portions of the parsed data to the new metabase entry (steps 460 and 470 ), as further described herein. Any additional metadata or file system information may also be associated with the new entry to enhance its content, including information from an FRN information derived from an interaction code present in the journal entry, file system, e.g., MFT, etc. (step 480 ).
  • the new journal entry may be processed as described above and may overwrite some or all of the corresponding entry.
  • Such an updated pre-existing entry may receive an updated time stamp to indicate a current revision.
  • a new entry may be created and written to the metabase and optionally associated with the existing record.
  • the older related record may be maintained, for example, archival, recreation, historical or diagnostic purposes, and in some embodiments, may be marked or indicated as outdated or otherwise superseded.
  • Such corresponding entries may be linked to one another via a pointer or other mechanism such that entries relating to the history of a particular data object may be quickly obtained.
  • step 490 the system may process any additional new journal entries detected by returning to step 450 , where those additional new entries may be processed as described above. If no new entries are detected, the system may return to step 420 to perform additional scans on the journal data structure and continue monitoring.
  • FIG. 5 illustrates an embodiment of the present invention in which a secondary processor performs some or all of functions associated with the data classification process described herein, including certain search functions.
  • system 500 may include a manager module 505 which may include an index 510 , a first computing device 515 , (which may include a first processor 520 , a journal agent 530 , and a data classification agent 535 ), and a second computing device 540 which may include a second processor 545 and a data classification agent 535 .
  • System 500 may also include data store 550 , a metabase 555 and change journal 560 .
  • Computing devices 515 and 544 may be any suitable computing device as described herein and may include clients, servers or other network computers running software, such as applications or programs that create, transfer, and store electronic data.
  • metabase 555 and journal 560 may be physically located within computing device 515 , e.g., stored on local mass storage. In other embodiments the metabase 555 and journal 560 may be external to computing device 515 (or distributed between the two). In yet other embodiments, metabase 555 is accessible via a network and journal 560 is a local device.
  • computing device 515 may operate in a substantially similar manner as system 300 shown in FIG. 3 with second processor 545 in second computing device 540 performing certain functions.
  • data classification agent 535 and journaling agent 530 may operate substantially as described in connection with FIG. 3 , i.e., journaling agent monitors data interactions on computing device 515 and records the interactions in journal 535 and classification agent processes journal entries and populates metabase 555 , etc.
  • journal agent 530 and/or classification agent 535 may run on or be directed by second processor 545 and may also utilize support resources located on or associated with computing device 540 such that the resources on computing device 515 are substantially unimpacted by these operations. This may serve to offload certain non-critical tasks from the host system ( 515 ) and have them performed by a secondary computing device 545 .
  • the processing burden associated with some or all of the following tasks normally performed by first computing device 515 may be performed by processor 545 and associated resources in second computing device 540 : (1) the initial scan of client files by the classification agent 535 and population of metabase 555 , (2) the ongoing monitoring of data interactions of computing device (e.g., 515 ) and generation of interaction records for storage in journal 560 , (3) processing and classification of journal information for updating metabase 555 ; and (4) searching or otherwise analyzing or accessing metabase 555 and/or journal 560 for certain information.
  • Performing such operations using a secondary or other processor may be desirable, for example, when the primary processor (e.g., processor 520 ) is unavailable, over utilized, unavailable or otherwise heavily used, or when it is otherwise desired to remove the primary processor and other primary system resources from performing certain tasks such as the ones described above.
  • the primary processor e.g., processor 520
  • the secondary processor may be located on computing device 515 (e.g., processor 525 ) and may perform the operations described herein in connection with processor 545 .
  • some embodiments may include a manager module 505 which may coordinate overall operations between the various computing devices.
  • manager module 505 may monitor or otherwise be cognizant of the processing load on each computing device and may assign processing tasks based on availability (e.g., load balance). For example, if processor 520 is idle or operating at a low capacity, a request to search metabase 555 may be handled by processor 520 . However, if processor 520 is busy or scheduled to perform or is performing priority work, manager 505 may assign the task to processor 545 . Manager 505 may act as a general arbiter for such processor assignments to ensure system 500 is making efficient use of system resources.
  • FIG. 6 is flow chart 600 illustrating some of the steps involved in performing a query on a metabase in a multiple processor system similar to the system shown in FIG. 5 .
  • a query may be received by the system for certain information. This request may be processed and analyzed by a manager module or other system process that determines or otherwise identifies which metabase or metabases within the system likely include at least some of the requested information, step 630 .
  • the query itself may suggest which metabases to search and/or the management module may consult an index that contains information regarding metabase content within the system as further described herein. It will be understood that the identification process may require searching and identifying multiple computing devices within an enterprise or network that may contain information satisfying search criteria.
  • search requests may be automatically referred to a secondary processor to minimize processing demands on the computing device that may have created or is otherwise associated with the identified metabase(s).
  • the computing device that created or is otherwise associated with the identified metabase(s) may consult with a manager or index associated with other computing devices to identify metabases with responsive information.
  • the secondary processor may search metabases to identify appropriate data set that may potentially have information related to the query. This may involve performing iterative searches that examine results generated by previous searches and subsequently searching additional, previously unidentified metabases to find responsive information that may not have been found during the initial search. Thus the initial metabase search may serve as a starting point for searching tasks that may be expanded based on returned or collected results.
  • the returned results may be optionally analyzed for relevance, arranged, and placed in a format suitable for subsequent use (e.g., with another application), or suitable for viewing by a user and reported (step 650 ).
  • FIG. 7 presents a system 700 constructed in accordance with the principles of the present invention employing a centralized metabase 760 that may serve multiple computing devices 715 - 725 .
  • system 700 may include computing devices 715 - 725 , each of which may include a journaling agent ( 730 - 740 respectively), a classification agent ( 745 - 755 respectively), and centralized metabase 760 , and in some embodiments, a manager module 705 with an index 710 .
  • system 700 may operate substantially similarly to system 300 shown in FIG. 3 with each computing device 715 - 725 storing classification entries in centralized metabase 760 rather than each computing device having its own dedicated metabase.
  • data classification agents 745 - 755 may operate substantially as described herein and communicate results to centralized metabase 760 . That is, analyze and process entries within the respective journals associated with journaling agents 730 - 740 , and report results to metabase 760 .
  • the classification agent may provide each metabase entry with an ID tag or other indicia that identifies which computing device 715 - 725 the entry originated from to facilitate future searches and efficiently designate entry ownership, or other associations between entries and computing devices.
  • each entry to metabase 760 may be assigned a unique identifier for management purposes. As mentioned above, this number may represent the index location or offset of the entry within centralized metabase 760 .
  • entries may be communicated to metabase 760 from the computing devices 715 - 725 on a rolling basis and may be arranged and formatted for storage by the metabase 760 .
  • metabase 760 may receive multiple entries at substantially the same point in time from multiple computing devices 715 - 725 and may be responsible for queuing and arranging such entries for storage within the metabase 760 .
  • system 700 may include manager module 705 that may be responsible for assigning or removing associations between certain computing devices 715 - 725 and a particular centralized metabase 760 .
  • manager 705 may direct certain computing devices 715 - 725 to write classification entries to a particular centralized metabase 760 .
  • Information indicating an association of the metabase 760 and the computing devices 715 - 725 may be stored in the index 710 .
  • This allows system 700 to reassign resources (globally or locally) to optimize system performance without the need to change device pointers or code associated with each computing device 715 - 725 that may be affected by a particular reallocation.
  • manager 705 may reassign certain computing devices 715 - 725 to another metabase by changing a destination address in an appropriate index.
  • FIG. 8 is flow chart 800 illustrating some of the steps involved in using a centralized metabase with multiple computing devices similar to the one shown in FIG. 7 .
  • a centralized metabase may be instantiated by a manager module or in accordance with certain system management or provisioning policies. This may involve securing certain processing, storage, and management resources for performing the task, loading certain routines into various memory buffers and informing the management module that the metabase is ready for operation.
  • the management module may review system resources, management policies, operating trends, and other information, for example, to identify computing devices to associate with the instantiated centralized metabase. This may further involve identifying pathways to the metabase from the various computing devices, locating operational policies governing the computing devices and, creating certain logical associations between the centralized metabases and the identified computing devices. These associations, once created, may be stored in an index or database for system management purposes.
  • classification agents within each associated computing device may scan existing files or data on the computing devices or clients (step 825 ) and populate the centralized metabase as further described herein (step 830 ).
  • a computing device identifier or other indicia may be appended or otherwise associated with the entry prior to transmission to the metabase such that each entry in the metabase can be tracked to its associated source computing device (step 840 ).
  • the centralized metabase may be populated with entries (step 850 ) and may communicate with the management module to establish and monitor a list of computing devices serviced by the centralized metabase and return to step 830 .
  • the system continues to monitor the associated computing devices for data interactions, which may be reported to the centralized metabase on an ongoing, periodic, or rolling basis.
  • the centralized metabase may need to assimilate or otherwise integrate existing entries with new entries reported by the computing devices.
  • the centralized metabase may become disconnected or unavailable for a period of time and subsequently be required to integrate a large number of queued entries.
  • the metabase or management module may examine existing metabase entries as described herein and communicate with computing devices to identify: (1) the amount of time the object computer and the metabases have been disconnected, (2) the number of queued entries at the computing devices that need to be processed (for example, entries cached once the centralized metabase was inaccessible for write operations), (3) whether there are any duplicative entries, and (4) which entries need to be integrated and in what order of preference (assuming multiple computing devices contain queued entries).
  • the management module or centralized metabase may assimilate the relevant entries into the metabase in the appropriate order until the backlog is eliminated and the system returns to normal operation. If it is determined during this process that certain information is lost to cache overflow, accidental deletion, corruption, or other reasons, the metabase and/or manager module may indicate such a discontinuity with the metadata or index associated with the centralized storage device or management module. In this case, clients, computing devices or other data sources may be rescanned to replace or repair the faulty entries. In other embodiments, the points of discontinuity may be noted and interpolation or other data healing techniques may be employed to provide derived information for the unknown points based on known information.
  • FIG. 9 presents a system 900 constructed in accordance with the principles of the present invention including a computing device that interacts with a network attached storage device (NAS).
  • system 900 may include a management module 905 and index 910 , computing devices 915 - 925 , each of which may include a journaling agent ( 945 - 955 respectively), a classification agent ( 930 - 940 respectively), data stores 960 and 965 , and metabases 970 - 980 .
  • System 900 may also include NAS device 995 which may include NAS storage device 990 and NAS file system manager 985 .
  • computing device 925 may be configured to operate as a NAS proxy device supervising the transfer of data to and from NAS device 995 .
  • system 900 may operate substantially similar to system 300 shown in FIG. 3 a with exception of the NAS portion shown on the right-hand side.
  • data classification agents 930 - 940 may operate substantially as described herein and communicate results to their respective metabases 970 - 980 . That is, analyze and process entries within the respective journals associated with journaling agents 945 - 955 , and report results to metabases 970 - 980 which may be supervised in whole or in part by management module 905 .
  • journaling agent 955 may reside on computing device 925 and track each or certain data interactions between NAS device 995 and external applications.
  • the location of the journaling agent 955 may be external to the NAS device 995 due, at least in part, to its proprietary nature (i.e., a closed system) and the difficulty associated with attempting to run other programs on the NAS device 995 itself.
  • the NAS portion 995 of system 900 may operate somewhat differently.
  • computing device 925 may operate as a NAS proxy for moving data files to and from NAS device 995 using a specialized protocol such as the Network Data Management Protocol (NDMP) that is an open network protocol designed to perform data backups over heterogeneous networks.
  • NDMP Network Data Management Protocol
  • NDMP may be used to enhance performance by transferring data over a network by separating data and control paths, while maintaining centralized backup administration.
  • Journaling agent 955 may record any interactions between NAS data and external applications and record those interactions in computing device 925 as described herein.
  • a journaling agent may include specialized routines for interpreting and processing data in NAS format.
  • Data classification agent 940 may analyze journal entries and populate metabase 980 initially and periodically as further described herein.
  • manager 905 may initially evaluate any search request and consult index 910 or other information stores to determine which metabases within the system are likely to include responsive information.
  • the results of this evaluation may be provided to the computing device handling the search request and may be in the form of pointers or other indicia or identifiers identifying a metabase such as a metabase ID. This may allow the computing device posing the search request to contact and search the identified metadata directly.
  • manager 905 may process the request and provide substantially complete results to the computing device that submitted the query.
  • FIG. 10 is flow chart 1000 illustrating some of the steps that may be involved in using the NAS system similar to or the same as the one shown of FIG. 9 .
  • a copy operation may be initiated that directs data from computing device to a NAS device. This may involve identifying certain data to moved, for example, based on a data management or storage policy. Other factors that may also be considered may include data size, the last time the data was moved to the NAS device, the file owner, application type, etc.
  • computing device 925 may be used as a NAS proxy that routes data from other network computing devices (not shown) to NAS device 995 with the computing device 925 supervising the data movement using certain specialized transfer programs to assist in the effort (step 1020 ).
  • journaling agent 955 may monitor interactions with NAS device 995 and create interaction entries for an interaction journal (step 1030 ). This may be accomplished by consulting with NAS file manager 985 and identifying which files in NAS 995 that have been involved in a data interaction as further described herein (step 1040 ). Next, journal entries may be created or updated to reflect data interactions currently detected as previously described herein (step 1050 ).
  • the interaction journal may then be scanned to analyze the journal records (step 1060 ) and perform the classification process as further described herein to create metabase entries (step 1070 ). At this point metabase entries may be assigned an identifier and used to populate metabase 980 (step 1080 ).
  • FIG. 11 includes a flow chart 1100 illustrating some of the steps that may be performed in searching a multiple metabase system in accordance with certain aspects of the present invention.
  • a user wants to locate and copy all data relating to a certain specified criteria such as data relating to a specific marketing project created and edited by a specific group of users over a certain period of time.
  • the requestor may formulate such a request through a user interface (not shown) using techniques known in the art and submit the request to the system for processing. This may also be accomplished by an automated computerized process, for example, when the system is performing certain management functions.
  • the system may receive and analyze this query (step 1110 ). In some embodiments, this may be performed by a computing device configured to support the user interface. In other embodiments, the computing device may simply pass the request to the system where a management module or other system process computing device may perform the analysis.
  • the analysis may include determining characteristics of data in the metabase that may satisfy the selected criteria.
  • the system may identify all metabases likely to contain records related to relevant data objects based on a query. This may be accomplished by using information obtained from analyzing or parsing the request as well as consulting with a management module that may have a substantially global view of metabases within the system that includes index information or a general overview of the information the metabases contain.
  • the management module or other computing device may perform the search to identify a data set satisfying a query as further described herein and return a set of results (step 1130 ).
  • the results may optionally be normalized. If normalization is not required, the results may be reported at step 1150 .
  • the system may analyze the results for both content and completeness. If, based on the returned results, other unsearched metabases are implicated as potentially having information that satisfies the search criteria, those metabases may be searched as well. This process may continue in an iterative fashion until a substantially complete set of results is obtained. Even if no additional metabases are implicated, these results may then be optionally normalized by performing certain functions such as locating and removing duplicative results, identifying network pathways to data objects identified in the search, and formatting or arranging the results for further processing (whether another computing process or for a user). For example, the returned results may be used to locate and retrieve the responsive data objects that may include information located on primary or secondary storage devices within the system or for other purposes as further described herein.
  • the systems and methods of the present invention may be employed to identify and track some or all data interactions on a user or group basis. For example, a system administrator or user may wish to record and keep track of all data interactions involving some or all system groups or users. This may include, for example, read and write operations performed on the user's or group's behalf, information and applications used or accessed, viewed web pages, electronic gaming interactions, chat, instant messages, and other communication interactions, multimedia usage, and other Internet or network based electronic interactions as known in the art.
  • the system identifies, captures, classifies, and may otherwise track user and group interactions with electronic data creating a data store or other repository of these interactions and metadata associated with these interactions.
  • this repository may serve as a “digital or electronic life record” that effectively chronicles and catalogues some or all user or group interactions with electronic information and data during a given time period as further described herein.
  • FIG. 11 a illustrates a system constructed in accordance with the principles of the present invention that identifies, captures, classifies, and otherwise tracks user and group interactions with electronic data.
  • the system may generally include computing device 1162 , one or more classification agents 1164 , one or more journaling agents 1165 , metabase 1166 , change record 1167 , and database 1168 .
  • computing device 1162 may be coupled to or interact with various other applications, networks, and electronic information such as, for example multimedia applications 1170 , instant messaging/chat applications 1172 , network applications 1174 such as an enterprise WAN or LAN, Internet 1176 , and gaming applications 1178 . It will be understood, however, that these are only examples and that any other network, application, or type of electronic information suitable for the purposes described herein may be added if desired.
  • Journaling agents 1165 and classification agents 1164 may operate in conjunction with one another to detect and record data interactions as further described herein. For example, each type of electronic data interaction (e.g.—instant messaging, web surfing, Internet search activities, electronic gaming, multimedia usage, etc.) may be identified, captured, classified, and otherwise tracked by a different journaling agent 1165 and classification agent 1164 , for example an interaction-specific journaling agent 1165 or classification agent 1164 dedicated to processing a single type of interaction with electronic data.
  • each type of electronic data interaction e.g.—instant messaging, web surfing, Internet search activities, electronic gaming, multimedia usage, etc.
  • each type of electronic data interaction e.g.—instant messaging, web surfing, Internet search activities, electronic gaming, multimedia usage, etc.
  • journaling agent 1165 and classification agent 1164 for example an interaction-specific journaling agent 1165 or classification agent 1164 dedicated to processing a single type of interaction with electronic data.
  • journaling agent 1165 and classification agent 1164 may function as a single module capable of performing some or all functions associated with journaling agent 1165 and a classification agent 1164 .
  • Change record 1167 and metabase 1166 may record certain aspects of the interactions as further described herein and may represent an interaction by interaction log of the user's computing activities.
  • a user of computing device 1162 may interact with certain applications such as multimedia application 1170 and instant messaging application 1172 . This may include sending, receiving, viewing and responding to various audio/video files in any suitable format and may include instant, text or email messages.
  • Journaling agent 1165 may detect the interactions between these applications and computing device 1162 and classification agent 1164 may classify and record information (e.g., metadata) associated with these interactions in metabase 1166 as further described herein.
  • some or all the content being exchanged or otherwise associated with these interactions may be captured and stored in database 1168 or other storage locations in the system. This may include capturing screen shots or summaries of information exchanges during data interactions. For example, the system may download all content associated with web pages viewed thus being able to recreate the original page content and interaction without access to the original or source version of the page on the Internet or other network. This may be advantageous, for example, if a user wishes to interact with content associated with a previous interaction when that content is no longer available, as is common with web pages and other network resources over time. As another example, the system may also capture or otherwise store data associated with other interactions, for example chat transcripts, video game replays, search queries, search results, and associated search content, songs accessed, movies accessed, stored songs and movies, in addition to metadata, etc.
  • chat transcripts for example chat transcripts, video game replays, search queries, search results, and associated search content, songs accessed, movies accessed, stored songs and movies, in addition to metadata, etc.
  • specialized classifications agents may be employed for some or all of the applications that a user or administrator desires to track and record.
  • the multimedia and instant messaging applications described above may each have a dedicated classification agent that analyzes journal records to create entries for metabase 1166 .
  • each classification agent may have its own associated metabase and or repository for source data (not shown), so application histories and content may be quickly indexed and searched.
  • a “universal” classification agent may be used that recognizes the application type (e.g., based on the journaling agent entries) and process interactions accordingly (which may include routing metadata to one or more specialized metabases).
  • computing device 1162 may also interact with various network applications 1174 such as LAN or WAN applications. These may include interaction with certain distributed programs such as Microsoft Word or Outlook. Users may also interact with Internet 1176 and download various web pages and other information. In accordance with an aspect of the present invention, interactions with these networks/applications may also be journaled as described above with certain information regarding these interactions stored in metabase 1166 . Portions of exchanged content may also be stored in database 1166 . For example, Word documents, emails, web pages, web addresses and HTML content may be captured and stored on database 1168 such that it substantially represents a record of all user interactions with computing device 1162 , or other system devices. For example, user interactions may be recorded with respect to any identified user based on identifiers and tracked at any network computing device.
  • network applications 1174 such as LAN or WAN applications. These may include interaction with certain distributed programs such as Microsoft Word or Outlook. Users may also interact with Internet 1176 and download various web pages and other information.
  • interactions with these networks/applications may also be journaled as described above
  • a user may retrieve captured data and review or replay certain data exchanges or save such records for future reference. For example, a user may store all instant messaging interactions for replay or transmission to another. In some instances, it may be desirable to not record certain interactions, such as personal or private information. In some embodiments, this may be accomplished by “disabling” the appropriate classification agent for a certain period of time, etc.
  • interactions with gaming applications may also be recorded stored with appropriate information stored in database 1168 and metabase 1166 .
  • a user may have the ability to retrieve, replay and transmit certain saved gaming sequences to third parties.
  • database 1168 may become large and thus some information stored thereon may be moved to single instance storage from database 1168 with a pointer placed in the logical address of the instanced information (not shown). This may be performed as a memory saving measure as at least some of the entries in database 1168 are likely to be duplicative.
  • a group or user of interest may be identified based on certain user related information or other network characteristics (step 1210 ).
  • Such characteristics may include Active Directory privileges, network login, machine ID, or certain biometrics associated with a user or group member. These characteristics may be combined together or associated with one another to create a user or group profile.
  • Such profiles may be stored in a database or index within a management module of the system and may be used as classification definitions within the system.
  • the system may compare certain attributes of the data involved in a detected interaction and associate that interaction with a particular group or user based on profile information (step 1220 ).
  • Such associations may be stored in a metabase created to keep track of user or group interactions.
  • the metabase essentially represents a list of all data interaction for a particular group or user. If desired, a list or copy of all the data items touched (e.g., interacted with) by a group or user may be quickly obtained.
  • the system may, through the use of a journaling agent or the like, monitor data interactions for a particular computing device as described herein.
  • the interactions may be analyzed by a classification agent as described herein and associated with one or more profiles (step 1230 ).
  • the association may be recorded in an identified metabase(s) that keeps track of a user's or group's interactions (step 1240 ) which may include references to the data object(s) identified, the attributes compared, and the basis for the association, etc.
  • the journaling agent may continue to monitor data interactions throughout operation, so that each metabase is updated and continues to accurately represent the data touched by a particular group or user.
  • the identified metabases are associated with an identified group or user (step 1250 ), such as by storing an indication of the association in an index.
  • FIG. 13 presents a system 1300 constructed in accordance with the principles of the present invention for communicating metadata and/or data objects between two or more computing devices.
  • system 1300 may generally include first and second computing devices 1310 and 1320 , respectively, associated data stores 1330 and 1340 , and metabases 1350 and 1360 .
  • Computing devices in system 1300 may store data objects and metadata in their respective metabases and data stores as further described herein. In certain situations, however, it may be desired to transfer certain metadata between metabases 1350 and 1360 and certain data objects between data stores 1330 and 1340 . This may be desirable for example, to move certain data from one computing device to another, to recreate a certain application at another location, or to copy or backup certain data objects and associated metadata.
  • FIG. 14 presents a flow chart 1400 illustrating some of the steps associated with moving data between the computing devices described above.
  • data objects and/or associated metadata may be identified for movement from one computing device to another. This may be accomplished by forming a query for certain data, such as a search for data that may be to be moved or copied pursuant to a data management or storage policy, or in response to a request to move data relating to certain processes or applications from one computing device to another, for any other suitable purpose such as disaster recovery, resource reallocation or reorganization, load balancing, etc.
  • the query may be analyzed and a first data store associated with a first computer may be searched for data objects satisfying the search criteria.
  • Data objects identified during this process may then be transferred to a second data store associated with a second computing device (step 1430 ).
  • Metadata associated with the transferred data objects may also be identified in a first metabase associated with the first computing device and transferred to an appropriate second metabase associated with the second computing device (step 1440 ).
  • Such a transfer may involve copying data objects and metadata from one data store and metabase to another, or in some embodiments, may involve migrating the data from its original location to a second location and leaving a pointer or other reference to the second location so the moved information may be quickly located from information present at the original location.
  • FIG. 15 illustrates a one arrangement of resources in a computing network in accordance with the principles of the present invention.
  • storage operation cell 1550 may generally include a storage manager 1501 , a data agent 1595 , a media agent 1505 , a storage device 1515 , and, in some embodiments, may include certain other components such as a client 1585 , a data or information store 1590 , database 1511 , jobs agent 1520 , an interface module 1525 , and a management agent 1530 .
  • Such system and elements thereof are exemplary of a modular storage system such as the CommVault QiNetix system, and also the CommVault GALAXY backup system, available from CommVault Systems, Inc. of Oceanport, N.J., and further described in U.S. patent application Ser. No. 09/610,738 which is incorporated herein by reference in its entirety.
  • a storage operation cell such as cell 1550
  • storage operations cell 50 may be related to backup cells and provide some or all of the functionality of backup cells as described in application Ser. No. 09/354,058, which is hereby incorporated by reference in its entirety.
  • storage operation cells may also perform additional types of storage operations and other types of storage management functions that are not generally offered by backup cells.
  • additional storage operations performed by storage operation cells may include creating, storing, retrieving, and migrating primary storage data (e.g., 1590 ) and secondary storage data (which may include, for example, snapshot copies, backup copies, HSM copies, archive copies, and other types of copies of electronic data) stored on storage devices 1515 .
  • storage operation cells may also provide one or more integrated management consoles for users or system processes to interface with in order to perform certain storage operations on electronic data as further described herein. Such integrated management consoles may be displayed at a central control facility or several similar consoles distributed throughout multiple network locations to provide global or geographically specific network data storage information.
  • storage operations may be performed according to various storage preferences, for example as expressed by a user preference or storage policy.
  • a storage policy is generally a data structure or other information source that includes a set of preferences and other storage criteria associated with performing a storage operation.
  • the preferences and storage criteria may include, but are not limited to, a storage location, relationships between system components, network pathway to utilize, retention policies, data characteristics, compression or encryption requirements, preferred system components to utilize in a storage operation, and other criteria relating to a storage operation.
  • a storage policy may indicate that certain data is to be stored in a specific storage device, retained for a specified period of time before being aged to another tier of secondary storage, copied to secondary storage using a specified number of streams, etc.
  • a storage policy may be stored in a storage manager database 1511 , to archive media as metadata for use in restore operations or other storage operations, or to other locations or components of the system.
  • a schedule policy may specify when to perform storage operations and how often and may also specify performing certain storage operations on sub-clients of data and how to treat those sub-clients.
  • a sub-client may represent static or dynamic associations of portions of data of a volume and are typically mutually exclusive. Thus, a portion of data may be given a label and the association is stored as a static entity in an index, database or other storage location used by the system.
  • Sub-clients may also be used as an effective administrative scheme of organizing data according to data type, department within the enterprise, storage preferences, etc.
  • Storage operation cells may contain not only physical devices, but also may represent logical concepts, organizations, and hierarchies.
  • a first storage operation cell 1550 may be configured to perform a first type of storage operations such as HSM operations, which may include backup or other types of data migration, and may include a variety of physical components including a storage manager 1501 (or management agent 1530 ), a media agent 1505 , a client component 1585 , and other components as described herein.
  • a second storage operation cell may contain the same or similar physical components, however, it may be configured to perform a second type of storage operations such as SRM operations, and may include as monitoring a primary data copy or performing other known SRM operations.
  • each cell may contain the same or similar physical devices in both storage operation cells.
  • different storage operation cells may contain some of the same physical devices and not others.
  • a storage operation cell 1550 configured to perform SRM tasks may contain a media agent 1505 , client 1585 , or other network device connected to a primary storage volume
  • a storage operation cell 1550 configured to perform HSM tasks may instead include a media agent 1505 , client 1585 , or other network device connected to a secondary storage volume and not contain the elements or components associated with and including the primary storage volume.
  • These two cells may each include a different storage manager 1501 that coordinates storage operations via the same media agents 1505 and storage devices 1515 .
  • This “overlapping” configuration allows storage resources to be accessed by more than one storage manager 1501 such that multiple paths exist to each storage device 1515 facilitating failover, load balancing and promoting robust data access via alternative routes.
  • the same storage manager 1501 may control two or more cells 1550 (whether or not each storage cell 1550 has its own dedicated storage manager 100 ).
  • the extent or type of overlap may be user-defined (through a control console (not shown)) or may be automatically configured to optimize data storage and/or retrieval.
  • Data agent 1595 may be a software module or part of a software module that is generally responsible for copying, archiving, migrating, and recovering data from client computer 1585 stored in an information store 1590 or other memory location. Each client computer 1585 may have at least one data agent 1595 and the system can support multiple client computers 1585 . In some embodiments, data agents 1595 may be distributed between client 1585 and storage manager 1501 (and any other intermediate components (not shown)) or may be deployed from a remote location or its functions approximated by a remote process that performs some or all of the functions of data agent 1595 .
  • Embodiments of the present invention may employ multiple data agents 1595 each of which may backup, migrate, and recover data associated with a different application.
  • different individual data agents 1595 may be designed to handle Microsoft Exchange data, Lotus Notes data, Microsoft Windows 2000 file system data, Microsoft Active Directory Objects data, and other types of data known in the art.
  • Other embodiments may employ one or more generic data agents 1595 that can handle and process multiple data types rather than using the specialized data agents described above.
  • one data agent 1595 may be required for each data type to copy, archive, migrate, and restore the client computer 1585 data.
  • the client computer 1585 may use one Microsoft Exchange 2000 Mailbox data agent 1595 to backup the Exchange 2000 mailboxes, one Microsoft Exchange 2000 Database data agent 1595 to backup the Exchange 2000 databases, one Microsoft Exchange 2000 Public Folder data agent 1595 to backup the Exchange 2000 Public Folders, and one Microsoft Windows 2000 File System data agent 1595 to backup the client computer's 1585 file system.
  • These data agents 1595 would be treated as four separate data agents 1595 by the system even though they reside on the same client computer 1585 .
  • one or more generic data agents 1595 may be used to back up, migrate and restore Microsoft Exchange 2000 Mailbox data and Microsoft Exchange 2000 Database data while another generic data agent may handle Microsoft Exchange 2000 Public Folder data and Microsoft Windows 2000 File System data, etc.
  • Data agents 1595 may be responsible for arranging or packing data to be copied or migrated into a certain format such as an archive file which is discussed in more detail in connection with FIG. 16 herein. Nonetheless, it will be understood this represents only one example and any suitable packing or containerization technique or transfer methodology may be used if desired.
  • Such an archive file may include a list of files or data objects copied in metadata, the file and data objects themselves.
  • any data moved by the data agents may be tracked within the system by updating indexes associated appropriate storage managers or media agents.
  • storage manager 1501 may be a software module or other application that coordinates and controls storage operations performed by storage operation cell 1550 .
  • Storage manager 1501 may communicate with some or all elements of storage operation cell 1550 including client computers 1585 , data agents 1595 , media agents 1505 , and storage devices 1515 , to initiate and manage system backups, migrations, and data recovery.
  • Storage manager 1501 may include a jobs agent 1520 that monitors the status of some or all storage operations previously performed, currently being performed, or scheduled to be performed by storage operation cell 1550 .
  • Jobs agent 1520 may be communicatively coupled with an interface agent 1525 (typically a software module or application).
  • Interface agent 1525 may include information processing and display software, such as a graphical user interface (“GUI”), an application program interface (“API”), or other interactive interface through which users and system processes can retrieve information about the status of storage operations.
  • GUI graphical user interface
  • API application program interface
  • users may optionally issue instructions to various storage operation cells 1550 regarding performance of the storage operations as described and contemplated by the present invention.
  • a user may modify a schedule concerning the number of pending snapshot copies or other types of copies scheduled as needed to suit particular needs or requirements.
  • a user may employ the GUI to view the status of pending storage operations in some or all of the storage operation cells in a given network or to monitor the status of certain components in a particular storage operation cell (e.g., the amount of storage capacity left in a particular storage device).
  • Storage manager 1501 may also include a management agent 1530 that is typically implemented as a software module or application program.
  • management agent 1530 provides an interface that allows various management components 1501 in other storage operation cells 1550 to communicate with one another. For example, assume a certain network configuration includes multiple cells 1550 adjacent to one another or otherwise logically related in a WAN or LAN configuration (not shown). With this arrangement, each cell 1550 may be connected to the other through each respective interface agent 1525 . This allows each cell 1550 to send and receive certain pertinent information from other cells 1550 including status information, routing information, information regarding capacity and utilization, etc. These communication paths may also be used to convey information and instructions regarding storage operations.
  • a management agent 1530 in first storage operation cell 1550 may communicate with a management agent 1530 in a second storage operation cell 1550 regarding the status of storage operations in the second storage operation cell.
  • Another illustrative example includes the case where a management agent 1530 in first storage operation cell 1550 communicates with a management agent 1530 in a second storage operation cell to control the storage manager 1501 (and other components) of the second storage operation cell via the management agent 1530 contained in the storage manager 100 .
  • management agent 130 in the first storage operation cell 1550 communicates directly with and controls the components in the second storage management cell 1550 and bypasses the storage manager 1501 in the second storage management cell.
  • storage operation cells 1550 can also be organized hierarchically such that hierarchically superior cells control or pass information to hierarchically subordinate cells or vice versa.
  • Storage manager 1501 may also maintain an index, a database, or other data structure 1511 .
  • the data stored in database 1511 may be used to indicate logical associations between components of the system, user preferences, management tasks, media containerization and data storage information or other useful data.
  • the storage manager 1501 may use data from database 1511 to track logical associations between media agent 1505 and storage devices 1515 (or movement of data as containerized from primary to secondary storage).
  • a media agent which may also be referred to as a secondary storage computing device, 1505 may be implemented as software module that conveys data, as directed by storage manager 1501 , between a client computer 1585 and one or more storage devices 1515 such as a tape library, a magnetic media storage device, an optical media storage device, or any other suitable storage device.
  • secondary computing device 1505 may be communicatively coupled with and control a storage device 1515 .
  • a secondary computing device 1505 may be considered to be associated with a particular storage device 1515 if that secondary computing device 1505 is capable of routing and storing data to particular storage device 1515 .
  • a secondary computing device 1505 associated with a particular storage device 1515 may instruct the storage device to use a robotic arm or other retrieval means to load or eject a certain storage media, and to subsequently archive, migrate, or restore data to or from that media.
  • Secondary computing device 1505 may communicate with a storage device 1515 via a suitable communications path such as a SCSI or fiber channel communications link.
  • the storage device 1515 may be communicatively coupled to a data agent 105 via a Storage Area Network (“SAN”).
  • SAN Storage Area Network
  • Each secondary storage computing device 1505 may maintain a index, a database, or other data structure 1506 which may store index data generated during backup, migration, and restore and other storage operations as described herein. For example, performing storage operations on Microsoft Exchange data may generate index data. Such index data provides a secondary computing device 1505 or other external device with a fast and efficient mechanism for locating data stored or backed up.
  • a secondary storage computing device index 1506 may store data associating a client 1585 with a particular secondary computing device 1505 or storage device 1515 , for example, as specified in a storage policy, while a database or other data structure in secondary computing device 1505 may indicate where specifically the client 1585 data is stored in storage device 1515 , what specific files were stored, and other information associated with storage of client 1585 data.
  • index data may be stored along with the data backed up in a storage device 1515 , with an additional copy of the index data written to index cache in a secondary storage device.
  • the data is readily available for use in storage operations and other activities without having to be first retrieved from the storage device 1515 .
  • information stored in cache is typically recent information that reflects certain particulars about operations that have recently occurred. After a certain period of time, this information is sent to secondary storage and tracked. This information may need to be retrieved and uploaded back into a cache or other memory in a secondary computing device before data can be retrieved from storage device 1515 .
  • the cached information may include information regarding format or containerization of archive or other files stored on storage device 1515 .
  • a client computer 1585 such as a data agent 1595 , or a storage manager 1501 coordinates and directs local archiving, migration, and retrieval application functions as further described in U.S. patent application Ser. No. 09/610,738.
  • This client computer 1585 can function independently or together with other similar client computers 1585 .
  • clients 1585 and secondary computing devices 1505 may each have associated metabases ( 1525 and 1560 , respectively).
  • each “tier” of storage such as primary storage, secondary storage, tertiary storage, etc., may have multiple metabases or a centralized metabase, as described herein.
  • the metabases on this storage tier may be centralized as discussed further herein.
  • second and other tiers of storage may have either centralized or distributed metabases.
  • mixed architectures systems may be used if desired, that may include a first tier centralized metabase system coupled to with a second tier storage system having distributed metabases and vice versa, etc.
  • a storage manager 1501 or other management module may keep track of certain information that allows the storage manager to select, designated or otherwise identify metabases to be searched in response to certain queries as further described herein. Movement of data between primary and secondary storage may also involvement movement of associated metadata and other tracking information as further described herein.
  • FIG. 16 is a diagram illustrating one arrangement of data that may be used in constructing an archive file according to one aspect of the invention.
  • archive file 1600 may include header section 1610 , index section 1620 and payload section 1630 .
  • Such an archive file may be constructed by a data agent at a client computing device when migrating data, for example, from primary to secondary storage, primary storage to other primary storage, etc.
  • the payload section 1610 may include the data objects that are to be moved from a first location to a second location within the system (e.g., primary to secondary storage). These data objects may be identified by a data agent and designated to be moved pursuant to a storage preference such as a storage policy, a user preference, etc.
  • Header 1610 may include routing and path information that identifies the origin and destination of the payload data and may include other information such as a list of files copied, checksums, etc.
  • Index section 1620 may include certain other information regarding the payload data objects such as size, file type, and any offset or other logical indexing information that may been tracked by a storage management component or other component previously managing the data objects in the payload.
  • storage managers may index information regarding archive files and related payload by time and storage on certain media so the archive files can be quickly located and/or retrieved. For example, it may be desired to identify certain data based on a query. The query may be analyzed and a certain time frame of interest may be identified. The system may use this information as a basis for a query search of certain index information (e.g., only search for records concerning operations that occurred during a specific time). This streamlines the search and retrieval process by narrowing the universe of data needs to be searched to locate responsive information.
  • FIG. 17 presents a flow chart 1700 that illustrates some of the steps that may be performed in moving data from primary storage to other storage devices within the system.
  • a query seeking certain data may be identified.
  • the query may include aspects of data such as a schedule policy, storage policy, storage preference or other preference.
  • the query may be analyzed and a primary metabase searched to identify data objects that satisfy the query (step 1704 ). This may include parsing the query into constituent parts and analyzing each part alone or in combination with other portions as part of the evaluation process.
  • it may be determined, whether data objects satisfying the query are to be copied to other primary storage devices, to secondary storage devices or both (pursuant to a storage policy, etc.).
  • destination may be determined dynamically, such that it is selected based on certain system preferences or optimization routines that select a storage device based on storage capacity, availability, data paths to the destination, etc.
  • the identified data objects may be copied from primary storage of a first computing device (the source) to primary storage of a second computing device (the target or destination). Any metadata associated with the first computing device describing the copied data may also be copied to a metabase associated with the second computing device such that this description information is not abandoned or lost, but rather travels with the copied data for subsequent use (step 1710 ).
  • step 1712 it may be determined whether the copied data objects and associated metadata are to be deleted from the source computing device. For example, this may be done in order to free storage space on the source computer or in accordance with certain data aging or migration criteria. If it is decided to delete the data objects (and associated metadata) the memory locations which include the data may be erased or designated for overwrite (step 1714 and 1716 ).
  • the data objects may be deleted but certain metadata may be retained. If it is decided not delete the data objects, the data is retained and an index in an associated storage manager may be updated (step 1718 ), for example by updating an index to reflect a new location, data object status, any changes, etc., and return to step 1702 .
  • an index in an associated storage manager may be updated (step 1718 ), for example by updating an index to reflect a new location, data object status, any changes, etc., and return to step 1702 .
  • data is deleted from the system, for example, a user permanently deletes certain data from an application, that associated data may also be deleted from both primary and secondary storage devices and associated metabases to free storage space within the system.
  • step 1706 it is also determined whether certain data objects currently stored in primary storage are to be migrated to one or more secondary storage devices. If so, an archive file similar to the one described in FIG. 16 or other data structure suitable for transport may be constructed or created by the source computing device with identified data objects placed in the payload section and header and index information added (step 1722 ). Data may be moved from primary to secondary storage in predefined chunks which are constructed from such archive files, for example, using a data pipe, such as the data pipe described in U.S. Pat. No. 6,418,478 titled PIPELINED HIGH SPEED DATA TRANSFER MECHANISM.
  • one or more target secondary storage devices may be identified. This may involve consulting a storage policy or storage manager to determine the destination point. In some embodiments, destination maybe determined dynamically, such that it is selected based on certain system preferences or optimization routines that select a storage device based on storage capacity, availability, data paths to the destination, etc.
  • the archive files may be routed to a media agent, storage manager, or other system component that supervises the transfer to the target secondary storage device (steps 1724 and 1728 ). This may involve selecting and appropriate data transfer route and ensuring the proper resources and are available (e.g., bandwidth) such that the data may be copied with a certain period of time.
  • Supervision may further include parsing a copy operation into several portions with each portion being transferred by certain media agent or other resources, etc, to meet system or transfer requirements (e.g., a time window).
  • the appropriate media within the target storage device may be identified (step 1730 ) and the archive files may be transferred from the media management device to the secondary storage device (step 1732 ).
  • Such media may be selected from available media already associated with a similar data transfer or may be selected and reserved from an available media pool or scratch pool within the storage device.
  • a media agent index or storage manager index associated with the secondary storage device may be updated to reflect the transfer (step 1733 ). This may include copying the appropriate management files to the media management index such as offset, media ID file name or other management information.
  • any metadata stored in a first metabase associated with the transferred data objects may also be transferred and used to update a second metabase associated with the target secondary storage device.
  • Such metadata may be copied from the first metabase to the second metabase using network transmission resources.
  • the metadata in the first metabase may be deleted after it is confirmed the metadata has been copied to the second metabase.
  • the metadata may remain in both first and second metabases.
  • step 1736 it may be determined whether the data objects transferred from the primary storage device are to be deleted. If so, the data objects and associated metadata in a first metabase may be erased or otherwise designated for overwrite (steps 1738 and 1740 ). In some cases, a pointer or other reference such as a file stub may be left in the original data location
  • FIG. 18 presents a generalized block diagram of a hierarchically organized group of storage operation cells in a system to perform storage operations on electronic data in a computer network in accordance with an embodiment of the present invention. It will be understood that although the storage operation cells generally depicted in FIG. 18 have different reference numbers than the storage operation cell 1550 shown in FIG. 15 , these cells may be configured the same as or similar to the storage cell 1550 as depicted in FIG. 15 .
  • the system illustrated in FIG. 18 may include a master storage manager component 1835 and various other storage operations cells.
  • the illustrative embodiment in FIG. 18 includes a first storage operation cell 1840 , a second storage operation cell 1845 , a third storage operation cell 1850 , a fourth storage operation cell 1855 , and may be extended to include nth storage operation cell, if desired (not shown).
  • this illustration is only exemplary and that fewer or more storage operation cells may be present or interconnected differently if desired.
  • Storage operation cells such as the ones shown in FIG. 18 may be communicatively coupled and hierarchically organized.
  • a master storage manager 1835 may be associated with, communicate with, and direct storage operations for a first storage operation cell 1840 , a second storage operation cell 1845 , a third storage operation cell 1850 , and fourth storage operation cell 1855 .
  • the master storage manager 1835 may not be part of any particular storage operation cell.
  • master storage manager 1835 may itself be part of a certain storage operation cell.
  • This logical organization provides a framework in which data objects, metadata and other management data may be hierarchically organized and associated with appropriate devices components (e.g., storage devices).
  • the storage operation cells may be configured in any suitable fashion, including those which involve distributed or centralized metabases.
  • storage operation cell 1840 may include a centralized primary storage metabase and a centralized secondary storage metabase
  • storage operation cell 1845 may include a centralized primary storage metabase and multiple secondary storage metabases
  • storage operation cell 1850 may include multiple primary storage metabases and a centralized secondary storage metabase
  • storage operation cell 1855 may include multiple primary storage metabases and multiple secondary storage metabases (not shown).
  • this is merely illustrative, and any other suitable configuration may be used if desired.
  • master storage manager 1835 may communicate with a management agent of the storage manager of the first storage operation cell 1840 (or directly with the other components of first cell 1840 ) with respect to storage operations performed in the first storage operation cell 1840 .
  • master storage manager 1835 may instruct the first storage operation cell 1840 with certain commands regarding a desired storage operation such as how and when to perform particular storage operations including the type of operation and the data on which to perform the operation.
  • metabases associated with each storage operation cell may contain information relating to data and storage operations as described herein.
  • master storage manager 1835 may include a master metabase index or database (not shown) that reflects some or all of the metadata information from the hierarchically subordinate storage operation cells within the system. This allows the system to consult the master storage index or database for information relating to data within those storage operation cells rather than requiring each cell be contacted of polled directly for such information.
  • master storage manager 1835 may track the status of its associated storage operation cells, such as the status of jobs, system components, system resources, and other items, by communicating with manager agents (or other components) in the respective storage operation cells. Moreover, master storage manager 1835 may track the status of its associated storage operation cells by receiving periodic status updates from the manager agents (or other components) in the respective cells regarding jobs, system components, system resources, and other items. For example, master storage manager 1835 may use methods to monitor network resources such as mapping network pathways and topologies to, among other things, physically monitor storage operations and suggest, for example, alternate routes for storing data as further described herein.
  • master storage manager 1835 may store status information and other information regarding its associated storage operation cells and other system information in an index cache, database or other data structure accessible to manager 1835 .
  • a presentation interface included in certain embodiments of master storage manager 1835 may access this information and present it to users and system processes with information regarding the status of storage operations, storage operation cells, system components, and other information of the system.
  • master storage manager 1835 may store and/or track metadata and other information regarding its associated storage operation cells and other system information in an index cache, database or other data structure accessible to manager 1835 .
  • queries can be directed to a specific storage operation cell or cells based on the cell's function, past involvement, routing or other information maintained within the storage manager or other management component.
  • storage operation cells may be organized hierarchically. With this configuration, storage operation cells may inherit properties from hierarchically superior storage operation cells or be controlled by other storage operation cells in the hierarchy (automatically or otherwise). Thus, in the embodiment shown in FIG. 18 , storage operation cell 1845 may control or is otherwise hierarchically superior to storage operation cells 1850 and 1855 . Similarly, storage operation cell 1850 may control storage operation cells 1855 . Alternatively, in some embodiments, storage operation cells may inherit or otherwise be associated with storage policies, storage preferences, storage metrics, or other properties or characteristics according to their relative position in a hierarchy of storage operation cells.
  • Storage operation cells may also be organized hierarchically according to function, geography, architectural considerations, or other factors useful or desirable in performing storage operations.
  • storage operation cell 1840 may be directed to create snapshot copies of primary copy data
  • storage operation cell 1845 may be directed to create backup copies of primary copy data or other data.
  • Storage operation cell 1840 may represent a geographic segment of an enterprise, such as a Chicago office
  • storage operation cell 1845 may represents a different geographic segment, such as a New York office.
  • the second storage operation cells 1845 , 1850 and 1855 may represent departments within the New York office.
  • these storage operation cells could be further divided by function performing various types of copies for the New York office or load balancing storage operations for the New York office.
  • different storage operation cells directed to different functions may also contain the same or a subset of the same set of physical devices.
  • one storage operation cell in accordance with the principles of the present invention may be configured to perform SRM operations and may contain the same, similar or a subset of the same physical devices as a cell configured to perform HSM or other types of storage operations.
  • Each storage operation cell may, however, share the same parent or, alternatively, may be located on different branches of a storage operation cell hierarchy tree.
  • storage operation cell 1845 may be directed to SRM operations whereas storage operation cell 1855 may be directed to HSM operations.
  • Those skilled in the art will recognize that a wide variety of such combinations and arrangements of storage operation cells are possible to address a broad range of different aspects of performing storage operations in a hierarchy of storage operation cells.
  • hierarchical organization of storage operation cells facilitates, among other things, system security and other considerations. For example, in some embodiments, only authorized users may be allowed to access or control certain storage operation cells. For example, a network administrator for an enterprise may have access to many or all storage operation cells including master storage manager 1835 . But a network administrator for only the New York office, according to a previous example, may only have access to storage operation cells 1845 - 1855 , which form the New York office storage management system.
  • queries performed by the system may be subject to similar restrictions.
  • users may be limited or otherwise excluded from searching a certain cell or cells.
  • a user may be limited to searching information in cells or metabases within the system that are unrestricted or to those which specific access rights have been granted.
  • certain users may not have privileges to all information within the system.
  • users may have access privileges to information in cells that they interact with.
  • confidential and sensitive information may be selectively restricted except only to certain users with express privileges (e.g., financial or legal information, etc.).
  • certain classification information within the metabases in the system may be restricted and therefore accessed only by those with the proper privileges.
  • search criteria may include the scope of the search. For example, in a large network with many storage cells may require dedicating significant amounts of resources to perform go global or comprehensive searches. Thus, if a certain resource threshold is exceeded by a proposed search, the system may prompt that search to be modified or otherwise cancelled.
  • master storage manager 1835 may alert a user such as a system administrator when a particular resource is unavailable or congested. For example, a particular storage device might be full or require additional media.
  • a master storage manager may use information from an HSM storage operation cell and an SRM storage operation cell to present indicia or otherwise alert a user or otherwise identify aspects of storage associated with the storage management system and hierarchy of storage operation cells.
  • master storage manager 1835 may utilize the global data regarding its associated storage operation cells to suggest solutions to such problems when they occur (or act as a warning prior to occurrence). For example, master storage manager 1835 may alert the user that a storage device in a particular storage operation cell is full or otherwise congested, and then suggest, based on job and data storage information contained in its database, or associated metabase, or an alternate storage device.
  • corrective actions based an such information may include suggesting an alternate data path to a particular storage device, or dividing data to be stored among various available storage devices as a load balancing measure or to otherwise optimize storage or retrieval time.
  • suggestions or corrective actions may be performed automatically, if desired. This may include automatically monitoring the relative health or status of various storage operation cells and searching for information within the cells of the system relating to systems or resource performance within that cell (e.g., index, metabase, database, etc.) for use in diagnostics or for suggesting corrective action.
  • HSM and SRM components may be aware of each other due to a common database or metabase of information that may include normalized data from a plurality of cells. Therefore, in those embodiments there is no need for such information to pass through a master storage manager as these components may be able to communicate directly with one another.
  • storage operation cell 1845 may communicate directly with storage operation cell 1855 and vice versa. This may be accomplished through a direct communications link between the two or by passing data through intermediate cells.
  • searches may be performed across a numerous storage cells within the hierarchy.
  • a query may be posed to master storage manager 1835 that may pass the query down through the hierarchy from cells 1840 to 1845 to 1850 and 1855 , etc. This may be accomplished by passing the query form one manager component of each cell to another, or from one data classification agent to another, one metabase to another etc.
  • the results may be passed upward through the hierarchy and compiled with other results such that master storage manager 1835 has a complete set of results to report.
  • each storage manager cell may report results directly to the requestor or to a designated location.
  • FIG. 19 presents a flow chart 1900 that illustrates some of the steps that may be involved in performing searches for data objects across systems that include multiple primary and secondary storage devices.
  • a query seeking certain data may be identified (e.g., from a storage policy, user preference, other process, etc.).
  • the query may be analyzed to identify system components, such as clients potentially having information such as certain data objects or metadata that may satisfy the query (e.g., by excluding certain clients that are unlikely to have data being sought based on certain query parameters such as location, time frame, client or other component, department, application type, or any other criteria used to classify data as described herein, etc. (step 1910 )).
  • Results may be presented based on a confidence factor indicating the likelihood that the results meet the specified parameters.
  • results substantially satisfying most or all criteria may be listed first with the confidence factors provided based on a percentage of the criteria satisfied (e.g., a query that returned results having three out of four criteria satisfied may be represented with a 75% confidence factor etc.). Less relevant results may be listed subsequently with the confidence factor provided based on any suitable relevant factor such as number of parameters satisfied, how close the match is, etc.
  • the search process may further involve consulting one or more indexes associated with the clients to identify where responsive data objects or other copies of client data, etc., may be located within the system.
  • it may be determined whether client data objects satisfying the query are located in primary storage, secondary storage, or both (e.g., based on index information in a storage manager). This may be based on polling various storage managers or a master storage manager that includes information the covers or represents whole system or the portion of system specified for search.
  • responsive data objects are only located on client(s) in primary storage, that client may be added to the list of clients to be searched (step 1955 ). If it is determined that responsive data objects are located in secondary storage devices (or other primary storage locations that may be identified), the system may consult a storage manager index to identify archive files (or other files) based on certain query parameters such as a specified point in time, origination point, etc., or on index data stored in a storage manager index identifying archive files or other file associated with the data objects.
  • step 1920 storage managers may be consulted to identify responsive archive files.
  • step 1925 media management components that may have handled responsive data objects are be identified. This may be based on information retrieved from the storage manager index regarding archive files, e.g., an association of archive files with media agents and media items. It may then be determined whether the identified media management components have metadata relating to the identified archive files available readily available in an index cache (step 1930 ).
  • step 1940 determines whether another media management component needs to be analyzed.
  • the index information may need to be loaded from the secondary storage device so archive files may be retrieved and accessed. This may involve identifying the particular media on which the index data is stored and upload it to the media management component cache (step 1935 ). In some embodiments, a master storage manager or other component with information relating to files may be consulted to identify media containing the responsive information. These media may be mounted in drive or other input/output device and examined to locate the proper files or data structures. Index information may then be located and uploaded to an index or database associated with the appropriate media management component (e.g., media agent). This allows the media management component to locate and retrieve specific data objects on the media that satisfy the search criteria.
  • media management component e.g., media agent
  • a list of media management components to be searched may be compiled (step 1945 ).
  • a list of clients identified as potentially having responsive data objects may also be compiled.
  • the associated metabases are queried for these components, step 1960 , and results are returned indicating data objects that may satisfy the search criteria, step 1965 .
  • these results may be reviewed and analyzed to ensure relevance, with only reasonably relevant or responsive data objects actually being retrieved.
  • FIG. 20 presents a flow chart 2000 that illustrates some of the steps that may be involved in retrieving data objects from secondary storage (or other tiers or other storage locations) in accordance with principles of the present invention.
  • Certain data e.g. data objects or associated metadata
  • the query may be used to search the system and identify media on which responsive data may be located. Once located, data satisfying the selection criteria may be uploaded and retrieved and analyzed for relevance, other action may be taken. Or, alternatively, the identified data may be moved to other tiers of storage. More specific steps involved in this process may be as follows.
  • a query seeking certain data may be identified.
  • the query may be analyzed to ascertain certain additional information that may assist in identifying responsive information such as identifying a certain point in time to search (step 2004 ).
  • This may involve consulting storage manager and/or media agent index or database for responsive information relating to a certain point in time.
  • This may also involve consulting certain metabases for similar information that may be associated with these or other media management components providing copy and management functions.
  • Point in time information may be specified by the user or may be assigned by the system absent a specific time frame established by the user. For example, a user may specify a certain time range within the query (e.g., a time range, a certain date, all information related to a project since its inception etc.).
  • the system may assign a certain time limit based on the query (e.g., such as based on the specifics of the query (e.g., only have data relating to a certain time frame)), and may limit the search to the time frame of information present in certain metabases, master storage manager, or index within the system, and/or poll or otherwise communicate with storage devices within the system to determine the range or time frame of available data within the system and present the user with options for retrieving it (e.g., some, all within a time frame, etc.)
  • certain archive files may be identified and associated media agents (step 2008 ) that may have been involved in transferring responsive data objects. This may be determined by consulting a master storage manager or other media management component index or metabase to determine whether the archive files have been handled by such components. Once the appropriate media agents have been identified, it may be determined whether information regarding the identified archive files is present in a cache or index associated with the media agents (step 2010 ). If not, the index information may need to be uploaded so the appropriate archive files may be retrieved and accessed. This process may be performed until all identified media agents have the appropriate index information loaded and/or until it is determined that no responsive information has been handled by the media agents and therefore no index information need be uploaded.
  • data objects satisfying the query criteria may be identified by searching metabases and/or indexes.
  • data objects may be compiled into a list of data objects for present or subsequent retrieval.
  • a list of responsive data objects may be provided to the user (which may itself satisfy the query) and then provide the user with the option to actually retrieve all or certain selected identified data objects.
  • the new destination for the data objects may be determined. For example, if certain data objects are being migrated off as part of an ILM operation, the query or other information may indicate the intent or reason for the search and the data object's destination. This may be useful in determining whether certain data objects are responsive to search criteria or query.
  • the new destination is primary storage (a restore operation) or secondary or other tier of storage (ILM). Such information may be further useful in determining whether the data objects are likely to fall within a time frame or category of interest and thus may be useful in further identifying data objects of interest.
  • the data objects may be repackaged into form suitable for secondary storage, which may include repackaging into an archive file, converting to a new format, compressing of the data objects and associated files, encryption, or any other containerization technique known in the art (step 2022 ).
  • the data objects may be copied to the appropriate storage destination by the system. This may be accomplished by a media agent or media component in conjunction with a storage manager or other media management component that coordinate routing and the specifics involved with file transfer (step 2024 ), as further described herein. Metadata relating to the copied data objects may then be copied to a metabase associated with a computing device at the destination (step 2026 ).
  • Metadata relating to the data being copied may be copied along with the data to the secondary storage device and may be copied to an index in the media agent or other media management component involved in the data transfer. This allows the media management component to locate and retrieve and otherwise manage the stored data.
  • metadata may also useful when performing searches of secondary storage devices (or other tiers) as further described herein.
  • Metadata stored along with the data on the secondary storage device may be useful to restore or refresh the media agent index in the case of lost or corrupt data and also may be transferred along with the data on storage media in the case whether it is necessary to copy all such data (or actually physically relocate) to another storage device.
  • a master storage manager index or metabase associated with destination computing device may be updated reflecting the arrival and new location of the transferred data objects and/or archive file for system management purposes (step 2034 ).
  • the copied data objects and metadata may be deleted from the source location (steps 2028 - 2032 ). For example, at step 2028 , it may be determined whether the copied data objects should be deleted based user preferences, storage policy requirements or other system constraints such has diminished storage capacity, etc.
  • the data objects and records may be deleted. However, a stub, pointer or other referential element may be placed at the same logical location to act as a marker for the moved data. This allows subsequent operations to quickly track down and locate the moved data at its new location.
  • the data objects may be reformatted (e.g., unpacked from archive file format) for copying to a computing device (step 2038 ).
  • the unpacked data may be copied to a target computing device along with any associated metadata (steps 2040 and 2042 ). For example, this may involve reading metadata and/or index information from the archive file and repopulating the metabase and/or management component indexes with this information as further described herein.
  • metadata from the archive file may be retrieved and integrated into a metabase associated with the target computing device including information relating to data management and as well as certain content and storage information as further described herein with respect to the classification process and metabase population.
  • metadata from the archive file may be retrieved and integrated into a metabase associated with the target computing device including information relating to data management and as well as certain content and storage information as further described herein with respect to the classification process and metabase population.
  • information relating to system management may be uploaded and used to repopulate storage management components within the system such as a storage manager or master storage manager reflecting the return of the retrieved data to primary storage (step 2050 ).
  • a storage manager index may be updated to reflect the presence of the retrieved data along with certain management information such as logical offsets and location of the retrieved information such that the retrieved information may be located and accessed.
  • Other management components, such as a master storage manager may also be updated with the appropriate identification and location information to reflect the return of the retrieved data within the system.
  • the copied data and metadata may be deleted from the source location (steps 2044 - 2048 ). For example, at step 2044 , it may be determined whether the copied data objects in secondary storage should be deleted based user preferences, storage policy requirements or other system constraints such has diminished storage capacity, etc. At steps 2046 and 2048 the data objects and records may be deleted within the system including any metabase or other system management information associated with the retrieved data. Storage management components such as storage managers, media agents may also be updated to reflect the removal or deletion of such information (step 2050 ).
  • Systems and modules described herein may comprise software, firmware, hardware, or any combination(s) of software, firmware, or hardware suitable for the purposes described herein.
  • Software and other modules may reside on servers, workstations, personal computers, computerized tablets, personal digital assistants (PDAs), and other devices suitable for the purposes described herein.
  • PDAs personal digital assistants
  • the software and other modules described herein may be executed by a general-purpose computer, e.g., a server computer, wireless device or personal computer.
  • aspects of the invention can be practiced with other communications, data processing, or computer system configurations, including: Internet appliances, hand-held devices (including PDAs), wearable computers, all manner of cellular or mobile phones, multi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, mainframe computers, and the like.
  • the terms “computer,” “server,” “host,” “host system,” and the like are generally used interchangeably herein, and refer to any of the above devices and systems, as well as any data processor.
  • aspects of the invention can be embodied in a special purpose computer or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein.
  • Software and other modules may be accessible via local memory, via a network, via a browser or other application in an ASP context, or via other means suitable for the purposes described herein. Aspects of the invention can also be practiced in distributed computing environments where tasks or modules are performed by remote processing devices, which are linked through a communications network, such as a Local Area Network (LAN), Wide Area Network (WAN), or the Internet.
  • program modules may be located in both local and remote memory storage devices.
  • Data structures described herein may comprise computer files, variables, programming arrays, programming structures, or any electronic information storage schemes or methods, or any combinations thereof, suitable for the purposes described herein.
  • User interface elements described herein may comprise elements from graphical user interfaces, command line interfaces, and other interfaces suitable for the purposes described herein. Screenshots presented and described herein can be displayed differently as known in the art to input, access, change, manipulate, modify, alter, and work with information.
  • aspects of the invention may be stored or distributed on computer-readable media, including magnetically or optically readable computer discs, hard-wired or preprogrammed chips (e.g., EEPROM semiconductor chips), nanotechnology memory, biological memory, or other data storage media.
  • computer implemented instructions, data structures, screen displays, and other data under aspects of the invention may be distributed over the Internet or over other networks (including wireless networks), on a propagated signal on a propagation medium (e.g., an electromagnetic wave(s), a sound wave, etc.) over a period of time, or they may be provided on any analog or digital network (packet switched, circuit switched, or other scheme).
  • the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to.”
  • the terms “connected,” “coupled,” or any variant thereof means any connection or coupling, either direct or indirect, between two or more elements; the coupling of connection between the elements can be physical, logical, or a combination thereof.
  • the words “herein,” “above,” “below,” and words of similar import when used in this application, shall refer to this application as a whole and not to any particular portions of this application.
  • words in the above Detailed Description using the singular or plural number may also include the plural or singular number respectively.
  • the word “or,” in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list.

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Description

    CROSS-REFERENCE TO RELATED APPLICATION(S)
  • This application is a divisional of U.S. patent application Ser. No. 11/564,221, entitled SYSTEMS AND METHODS FOR CLASSIFYING AND TRANSFERRING INFORMATION IN A STORAGE NETWORK, filed Nov. 28, 2006, which claims the benefit of U.S. Provisional Application No. 60/740,686, entitled SYSTEMS AND METHODS FOR CLASSIFYING INFORMATION IN A STORAGE NETWORK, filed Nov. 28, 2005, attorney docket no. 60692-8029.US00 and U.S. Provisional Application No. 60/752,203, entitled SYSTEMS AND METHODS FOR CLASSIFYING AND TRANSFERRING INFORMATION IN A STORAGE NETWORK, filed Dec. 19, 2005, attorney docket no. 60692-8029.US01 all of which are hereby incorporated herein by reference in their entireties.
  • This application is related to the following patents and U.S. applications, each of which is hereby incorporated herein by reference in its entirety:
      • application Ser. No. 09/354,058, titled HIERARCHICAL BACKUP AND RETRIEVAL SYSTEM, filed Jul. 15, 1999, docket number 4982/5, now U.S. Pat. No. 7,395,282;
      • U.S. Pat. No. 6,418,478, titled PIPELINED HIGH SPEED DATA TRANSFER MECHANISM, issued Jul. 9, 2002, docket number 4982/6;
      • application Ser. No. 09/610,738, titled MODULAR BACKUP AND RETRIEVAL SYSTEM USED IN CONJUNCTION WITH A STORAGE AREA NETWORK, filed Jul. 6, 2000, docket number 4982/8, now U.S. Pat. No. 7,035,880;
      • U.S. Pat. No. 6,542,972 titled LOGICAL VIEW AND ACCESS TO PHYSICAL STORAGE IN MODULAR DATA AND STORAGE MANAGEMENT SYSTEM, issued Apr. 1, 2003, docket number 4982/10;
      • U.S. Pat. No. 6,658,436, titled LOGICAL VIEW AND ACCESS TO DATA MANAGE BY A MODULAR DATA AND STORAGE MANAGEMENT SYSTEM, issued Dec. 2, 2003, docket number 4982/13;
      • application Ser. No. 10/658,095, titled DYNAMIC STORAGE DEVICE POOLING IN A COMPUTER SYSTEM, filed Sep. 9, 2003, docket number 4982/18, now U.S. Pat. No. 7,130,970;
      • application Ser. No. 10/262,556, titled SYSTEM AND METHOD FOR GENERATING AND MANAGING QUICK RECOVERY VOLUMES, filed Sep. 30, 2002, docket number 4982/20, now U.S. Pat. No. 7,346,623;
      • application Ser. No. 10/818,749, entitled SYSTEM AND METHOD FOR DYNAMICALLY PERFORMING STORAGE OPERATIONS IN A COMPUTER NETWORK, filed Apr. 5, 2004, docket number 4982/35, now U.S. Pat. No. 7,246,207;
      • application Ser. No. 10/877,831, entitled HIERARCHICAL SYSTEM AND METHOD FOR PERFORMING STORAGE OPERATIONS IN A COMPUTER NETWORK, filed Jun. 25, 2004, docket number 4982/39, now U.S. Pat. No. 7,454,569;
      • application Ser. No. 11/313,256, entitled SYSTEM AND METHOD FOR CONTAINERIZED DATA STORAGE AND TRACKING, filed Dec. 19, 2005, docket number 4982/93, now U.S. Pat. No. 7,584,227;
      • Application Ser. No. 60/752,198, entitled SYSTEMS AND METHODS FOR GRANULAR RESOURCE MANAGEMENT IN A STORAGE NETWORK, filed Dec. 19, 2005, docket number 4982184;
      • application Ser. No. 11/313,224, entitled SYSTEMS AND METHODS FOR PERFORMING MULTI-PATH STORAGE OPERATIONS, filed Dec. 19, 2005, docket number 4982/88, now U.S. Pat. No. 7,620,710;
      • Application Ser. No. 60/752,196, entitled SYSTEMS AND METHODS FOR MIGRATING COMPONENTS IN A HIERARCHICAL STORAGE NETWORK, filed Dec. 19, 2005, docket number 4982/95;
      • Application Ser. No. 60/752,202, entitled SYSTEMS AND METHODS FOR UNIFIED RECONSTRUCTION OF DATA IN A STORAGE NETWORK, filed Dec. 19, 2005, docket number 4982/97;
      • Application Ser. No. 60/752,201, entitled SYSTEMS AND METHODS FOR RESYNCHRONIZING STORAGE OPERATIONS, filed Dec. 19, 2005, docket number 4982/98;
      • Application Ser. No. 60/752,197, entitled SYSTEMS AND METHODS FOR HIERARCHICAL CLIENT GROUP MANAGEMENT, filed Dec. 19, 2005, docket number 4982/102.
    BACKGROUND
  • Aspects of the invention disclosed herein relate generally to performing operations on electronic data in a computer network. More particularly, aspects of the present invention relate to detecting data interactions within a computer network and/or performing storage-related operations for a computer network according to a specified classification paradigm.
  • Current storage management systems employ a number of different methods to perform storage operations on electronic data. For example, data can be stored in primary storage as a primary copy or in secondary storage as various types of secondary copies including, as a backup copy, a snapshot copy, a hierarchical storage management copy (“HSM”), as an archive copy, and as other types of copies.
  • A primary copy of data is generally a production copy or other “live” version of the data which is used by a software application and is generally in the native format of that application. Primary copy data may be maintained in a local memory or other high-speed storage device that allows for relatively fast data access if necessary. Such primary copy data is typically intended for short term retention (e.g., several hours or days) before some or all of the data is stored as one or more secondary copies, for example to prevent loss of data in the event a problem occurred with the data stored in primary storage.
  • Secondary copies include point-in-time data and are typically for intended for long-term retention (e.g., weeks, months or years depending on retention criteria, for example as specified in a storage policy as further described herein) before some or all of the data is moved to other storage or discarded. Secondary copies may be indexed so users can browse and restore the data at another point in time. After certain primary copy data is backed up, a pointer or other location indicia such as a stub may be placed in the primary copy to indicate the current location of that data.
  • One type of secondary copy is a backup copy. A backup copy is generally a point-in-time copy of the primary copy data stored in a backup format as opposed to in native application format. For example, a backup copy may be stored in a backup format that is optimized for compression and efficient long-term storage. Backup copies generally have relatively long retention periods and may be stored on media with slower retrieval times than other types of secondary copies and media. In some cases, backup copies may be stored at on offsite location.
  • Another form of secondary copy is a snapshot copy. From an end-user viewpoint, a snapshot may be thought as an instant image of the primary copy data at a given point in time. A snapshot generally captures the directory structure of a primary copy volume at a particular moment in time, and also preserves file attributes and contents. In some embodiments, a snapshot may exist as a virtual file system, parallel to the actual file system. Users typically gain a read-only access to the record of files and directories of the snapshot. By electing to restore primary copy data from a snapshot taken at a given point in time, users may also return the current file system to the prior state of the file system that existed when the snapshot was taken.
  • A snapshot may be created instantly, using a minimum of file space, but may still function as a conventional file system backup. A snapshot may not actually create another physical copy of all the data, but may simply create pointers that are able to map files and directories to specific disk blocks.
  • In some embodiments, once a snapshot has been taken, subsequent changes to the file system typically do not overwrite the blocks in use at the time of snapshot. Therefore, the initial snapshot may use only a small amount of disk space needed to record a mapping or other data structure representing or otherwise tracking the blocks that correspond to the current state of the file system. Additional disk space is usually only required when files and directories are actually modified later. Furthermore, when files are modified, typically only the pointers which map to blocks are copied, not the blocks themselves. In some embodiments, for example in the case of copy-on-write snapshots, when a block changes in primary storage, the block is copied to secondary storage before the block is overwritten in primary storage and the snapshot mapping of file system data is updated to reflect the changed block(s) at that particular point in time. An HSM copy is generally a copy of the primary copy data, but typically includes only a subset of the primary copy data that meets a certain criteria and is usually stored in a format other than the native application format. For example, an HSM copy might include only that data from the primary copy that is larger than a given size threshold or older than a given age threshold and that is stored in a backup format. Often, HSM data is removed from the primary copy, and a stub is stored in the primary copy to indicate its new location. When a user requests access to the HSM data that has been removed or migrated, systems use the stub to locate the data and often make recovery of the data appear transparent even though the HSM data may be stored at a location different from the remaining primary copy data.
  • An archive copy is generally similar to an HSM copy, however, the data satisfying criteria for removal from the primary copy is generally completely removed with no stub left in the primary copy to indicate the new location (i.e., where it has been moved to). Archive copies of data are generally stored in a backup format or other non-native application format. In addition, archive copies are generally retained for very long periods of time (e.g., years) and in some cases are never deleted. Such archive copies may be made and kept for extended periods in order to meet compliance regulations or for other permanent storage applications.
  • In some embodiments, application data over its lifetime moves from more expensive quick access storage to less expensive slower access storage. This process of moving data through these various tiers of storage is sometimes referred to as information lifecycle management (“ILM”). This is the process by which data is “aged” from more forms of secondary storage with faster access/restore times down through less expensive secondary storage with slower access/restore times, for example, as the data becomes less important or mission critical over time.
  • Examples of various types of data and copies of data are further described in the above-referenced related applications that are hereby incorporated by reference in their entirety. One example of a system that performs storage operations on electronic data that produce such copies is the QiNetix storage management system by CommVault Systems of Oceanport, N.J.
  • The QiNetix system leverages a modular storage management architecture that may include, among other things, storage manager components, client or data agent components, and media agent components as further described in U.S. patent application Ser. No. 10/818,749 which is hereby incorporated herein by reference in its entirety. The QiNetix system also may be hierarchically configured into backup cells to store and retrieve backup copies of electronic data as further described in U.S. patent application Ser. No. 09/354,058 which is hereby incorporated by reference in its entirety.
  • Regardless of where data is stored, conventional storage management systems perform storage operations associated with electronic data based on location-specific criteria. For example, data generated by applications running on a particular client is typically copied according to location-specific criteria, such as from a certain location such as a specific folder or subfolder, according to a specified data path, etc. A module installed on the client or elsewhere in the system may supervise the transfer of data from the client to another location in a primary or secondary storage. Similar data transfers associated with location-specific criteria are performed when restoring data from secondary storage to primary storage. For example, to restore data, a user or system process must specify a particular secondary storage device, piece of media, archive file, etc. Thus, the precision with which conventional storage management systems perform storage operations on electronic data is generally limited by the ability to define or specify storage operations based on data location rather than information relating to or describing the data itself.
  • Moreover, when identifying data objects, such as files associated with performing storage operations, conventional storage systems often scan the file system of a client or other computing device to determine which data objects on the client should be associated with the storage operation. This may involve collecting file and/or folder attributes by traversing the file system of the client prior to performing storage operations. This process is typically time-consuming and uses significant client resources that might be more desirably spent performing other tasks associated with production applications. There is thus a need for systems and methods for performing more precise and efficient storage operations.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention is illustrated in the figures of the accompanying drawings which are meant to be exemplary and not limiting, in which like references are intended to refer to like or corresponding parts, and in which:
  • FIG. 1 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 2 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 3 a is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 3 b is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 4 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 5 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 6 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 7 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 8 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 9 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 10 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 11 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 11 a is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 12 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 13 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 14 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 15 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 16 is a data arrangement in accordance with an embodiment of the present invention;
  • FIG. 17 is a flow chart in accordance with an embodiment of the present invention;
  • FIG. 18 is a system constructed in accordance with an embodiment of the present invention;
  • FIG. 19 is a flow chart in accordance with an embodiment of the present invention; and
  • FIG. 20 is a flow chart in accordance with an embodiment of the present invention.
  • COPYRIGHT NOTICE
  • A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosures, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever.
  • DETAILED DESCRIPTION
  • Aspects of the present invention are generally concerned with systems and methods that analyze and classify various forms of data that, among other things, facilitates identification, searching, storage and retrieval of data that satisfies certain criteria. Although described in connection with certain specific embodiments, it will be understood that the inventions disclosed herein have broad-based applicability to any wireless or hard-wired network or data transfer system that stores and conveys data from one point to another, including communication networks, enterprise networks, storage networks, and the like.
  • Aspects of the present invention provide systems and methods for data classification to facilitate and improve data management within an enterprise. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.
  • Generally, the systems and methods described in detail below are for analyzing data and other information in a computer network (sometimes referred to herein as a “data object”) and creating a database or index of information which may describe certain pertinent aspects of the data objects that allow a user or system process to consult the database to obtain information regarding the network data. For example, a data collection agent may traverse a network file system and obtain certain characteristics and other attributes of data in the system. In some embodiments, such a database may be a collection of metadata and/or other information regarding the network data and may be referred to herein as a “metabase.” Generally, metadata refers to data or information about data, and may include, for example, data relating to storage operations or storage management, such as data locations, storage management components associated with data, storage devices used in performing storage operations, index data, data application type, or other data.
  • With this arrangement, if it is desired to obtain information regarding network data, a system administrator or system process may simply consult the metabase for such information rather than iteratively access and analyze each data item in the network. Thus, this significantly reduces the amount of time required to obtain data object information by substantially eliminating the need to obtain information from the source data, and furthermore minimizes the involvement of network resources in this process, substantially reducing the processing burden on the host system.
  • Various embodiments of the invention will now be described. The following description provides specific details for a thorough understanding and enabling description of these embodiments. One skilled in the art will understand, however, that the invention may be practiced without many of these details. Additionally, some well-known structures functions may not be shown or described in detail, so as to avoid unnecessarily obscuring the relevant description of the various embodiments.
  • The terminology used in the description presented below is intended to be interpreted in its broadest reasonable manner, even though it is being used in conjunction with a detailed description of certain specific embodiments of the invention. Certain terms may even be emphasized below; however, any terminology intended to be interpreted in any restricted manner will be overtly and specifically defined as such in this Detailed Description section.
  • A flow chart 100 illustrating some of the steps associated with one embodiment of the present invention is shown in FIG. 1. In order to perform some of the functions described herein, it may be necessary at the outset to install certain data classification software or data classification agents on computing devices within at least parts of the network (step 102). This may be done, for example, by installing classification software on client computers and/or servers within a given network. In some embodiments, classification agents may be installed globally on a computing device or with respect to certain subsystems on a computing device. The classification software may monitor certain information regarding data objects generated by the computers and classify this information for use as further described herein.
  • Next, at step 104, a monitor agent may be initialized. Such a monitoring agent may be resident or installed on each computing device similar to the deployment of classification agents described above and may be configured to monitor and record certain data interactions within each machine or process. For example, the monitor agent may include a filter driver program and may be deployed on an input/output port or data stack and operate in conjunction with a file management program to record interactions with computing device data. This may involve creating a data structure such as a record or journal of each interaction. The records may be stored in a journal data structure and may chronicle data interactions on an interaction by interaction basis. The journal may include information regarding the type of interaction that has occurred along with certain relevant properties of the data involved in the interaction. One example of such a monitor program may include Microsoft's Change Journal or similar program.
  • Prior to populating a metabase with metadata, the portions of the network or subject system may be quiesced such that no data interactions are permitted prior to completing an optional scan of system files as described in conjunction with step 106 below. This may be done in order to obtain an accurate point in time picture of the data being scanned and to maintain referential integrity within the system. For example, if the system were not quiesced, data interactions would continue and be allowed to pass through to mass storage and thus data would change. However, in some embodiments, the subject system may be allowed to continue to operate, with operations or instructions queued in a cache. These operations are typically performed after the scan is complete so that any such data interactions occur based on the cached operations are captured by the monitor agent.
  • Generally, the file scanning of step 106 may be performed by a data classification agent and may include traversing the file system of a client to identify data objects or other files, email or other information currently stored or present in the system and obtain certain information regarding the information such as any available metadata. Such metadata may include information about data objects or characteristics associated with data objects such as the data owner (e.g., the client or user that generates the data or other data manager), the last modified time (e.g., the time of the most recent modification), the data size (e.g., number of bytes of data), information about the data content (e.g., the application that generated the data, the user that generated the data, etc.), to/from information for email (e.g., an email sender, recipient or individual or group on an email distribution list), creation date (e.g., the date on which the data object was created), file type (e.g., format or application type), last accessed time (e.g., the time the data object was most recently accessed or viewed), application type (e.g., the application which generated the data object), location/network (e.g., a current, past or future location of the data object and network pathways to/from the data object), frequency of change (e.g., a period in which the data object is modified), business unit (e.g., a group or department that generates, manages or is otherwise associated with the data object), and aging information (e.g., a schedule, which may include a time period, in which the data object is migrated to secondary or long term storage), etc. The information obtained in the scanning process may be used to initially populate the metabase of information regarding network data at step 108.
  • After the metabase has been populated, the network or subject system may be released from the quiesced state and normal operation may resume. Next, at step 110, the monitor agent may monitor system operations to record changes to system data in the change journal database as described above. The change journal database may include a database of metadata or data changes and may comprise log files of the data or metadata changes. In some embodiments, the data classification agent may periodically consult the change journal database for new entries. If new entries exist, these entries may be examined, and if deemed relevant, then analyzed, parsed, and written to the metabase as an update (step 112). In other embodiments, change journal entries may be supplied substantially in parallel to the journal database and data classification agent. This allows the metabase to maintain substantially current information regarding the state of system data at any given point in time.
  • As mentioned above, one benefit of such a metabase is it significantly reduces the amount of time required to obtain information by substantially eliminating the need to obtain information directly from the source data. For example, assume a system administrator desires to identify data objects that a certain user has interacted with that contain certain content or other characteristics. Rather than search each file in each directory, a very time consuming process, the administrator may simply search the metabase to identify such data objects and any properties associated with those objects, (e.g., metadata, which may include location, size, etc.), resulting in significant time savings.
  • Moreover, use of the metabase for satisfying data queries also minimizes the involvement of network resources in this process, substantially reducing any processing burden on the host system. For example, as described above, if an administrator desires to identify certain data objects, querying the metabase rather than the file system virtually removes the host system from the query process (i.e., no brute force scanning of directories and files required), allowing host computing devices to continue performing host tasks rather than be occupied with search tasks.
  • FIG. 2 shows one embodiment of a client 200 constructed in accordance with principles of the present invention. As shown, client 200 may include a classification agent 202 and a monitor agent 206, which, in some embodiments, may be combined as an update agent 204, and which may be a single module encompassing the functionality of both agents. Client 200 may also include an internal or external data store 209, metabase 210, and change record 212.
  • Generally, client 200 may be a computing device, or any portion of a computing device that generates electronic data. Data store 209 generally represents application data such as production volume data used by client 200. Metabase 210, which may be internal or external to client 200 may contain information generated by classification agent 202 as described above. Similarly, change journal 212, which also may be internal or external to client 200, may contain information generated by monitor agent 206 as described above.
  • In operation, data interactions occurring within client 200 may be monitored with update agent 204 or monitor agent 206. Any relevant interaction may be recorded and written to change record 206. Data classification agent 202 may scan or receive entries from monitor agent 206 and update metabase 210 accordingly. Moreover, in the case where update agent 204 is present, monitored data interactions may be processed in parallel with updates to change record 212 and written to data store 208 and metabase 210 occurring accordingly. A file system 207 may be used to conduct or process data from the client to a data store 209.
  • FIG. 3 a provides a more detailed view of the journaling and classification mechanisms of client 200 generally shown in FIG. 2. As shown, system 300 may include a memory 302, an update agent 304 which may include a separate or integrated monitor agent 306, classification agents 312 a and 312 b, a content agent 315, a monitor program index 310, metabase 314 and mass storage device 318.
  • In operation, data interactions that occur between memory 302 and mass storage device 318 may be monitored by monitor agent 306. In some embodiments, memory 302 may include random access memory (RAM) or other memory device employed by a computer in client 200 in performing data processing tasks. Certain information from memory 302 may be periodically read or written to mass storage device 318 which may include a magnetic or optical disk drive such as a hard drive or other storage device known in the art. Such data interactions are monitored by monitoring agent 306 which, in some embodiments, may include any suitable monitoring or journaling agent as further described herein.
  • As shown, system 300 may also include an administrative file system program 316, such as a file system program known in the art, which may include operating system programs, a FAT, an NTFS, etc. that may be used to manage data movement to and from mass storage device 318. Thus, in operation, data may be written from memory 302 to mass storage device 318 via file system program 316. Such an operation may occur, for example, to access data used to service an application running on a computing device. During this operation, monitor agent 306 may capture this interaction and generate a record indicating that an interaction has occurred and store the record in index 310. The data may be stored in mass storage 318 under the supervision of file system manager 316.
  • As shown in FIG. 3 a, monitor agent 306 may analyze data interactions such as interactions between memory 302 and mass storage 318 via the file system manager 316, and record any such interactions in monitor index 310. Thus, as described above, monitor index 310 may represent a list of data interactions wherein each entry represents a change that has occurred to client data along with certain information regarding the interaction. In embodiments where Microsoft Change Journal or other similar software is used, such entries may include a unique identifier such as an update sequence number (USN), certain change journal reason codes identifying information associated with a reason(s) for the change made, along with data or metadata describing the data and certain data properties, data copy types, etc.
  • Thus, in operation, as data moves from memory 302 to mass storage 318 (or vice versa), monitor agent 304 may create and write an entry to index 310 which may in turn, be analyzed and classified by classification agent 312 b for entry in metabase 314. In some embodiments, classification agent 312 a may be coupled with mass storage device (either directly or through file system manager 316) and write metadata entries to both metabase 314 and mass storage device 318. In some embodiments, the metabase information may be stored on mass storage device 318. Moreover, in an alternate embodiment, classification agent 312 b may periodically copy or backup metabase 314 to the storage device under the direction of a storage manager and/or pursuant to a storage policy (not shown) such that the information in metabase 314 may be quickly restored if lost, deleted or is otherwise unavailable.
  • In some embodiments, optional classification agent 312 a may operate in conjunction with monitor agent 306 such that data moving to mass storage device 318 is classified as further described herein and written to device 318. With this arrangement, the data, along with the processed metadata describing that data, is written to mass storage device 318. This may occur, for example in embodiments in which monitor agent 306 and classification agent 312 a are combined into update agent 304. Writing metadata in this way allows it to be recovered or accessed from mass storage device 318 if necessary, for example, when metabase 314 is missing certain information, busy, or otherwise inaccessible.
  • Content agent 315 may be generally used to obtain or filter data relating to content of the data moving from memory 302 to mass storage 318. For example, content agent 315 may read data payload information and generate metadata based on the operation for storage in metabase 314 and may include a pointer to the data item in mass storage 318. The pointer information may optionally be stored in an index. This metadata may also be stored with the data item in mass storage 318 or as an entry functioning in place of or in addition to metabase 314. Storing metadata relating to data content in metabase 314 provides the capability to perform content searches for data in the metabase 314, instead of searching entries in mass storage 318. This allows the system to quickly locate information satisfying a content query that may be retrieved from mass storage 318, if necessary.
  • Moreover, such content metadata may be generated and used in locating data based on content features throughout a hierarchy within a storage operation system (e.g., content metadata may be generated and stored at each or certain levels of storage within the system (primary. secondary, tertiary, etc.) to facilitate location and retrieval of data based on content). As will be understood by one of skill in the art, the functionality provided by the content agent 315, classification agent 312 a & b and monitor agent 306 may be provided by one or more modules or components such that the modules may be integrated into a single module providing the described functions, or may be implemented in one more separate modules each providing some of the functions.
  • FIG. 3 b is a flow chart 350 illustrating some of the steps that may be involved in the journaling process described above. At step 355, the monitor program may be initialized, which may include instantiating a data structure or index for recording interaction entries, and the assignment of a unique journal ID number which allows the system to differentiate between various journaling data structures that may be operating within the system. As mentioned above, the monitor program may include a filter driver or other application that monitors data operations (step 360). During the monitoring process, the monitor agent may observe data interactions between memory and mass storage to determine that certain data interactions have occurred. Information relating to the interactions may be captured and used to populate the metabase. In some instances, interaction types or certain aspects of interactions are captured. Such types or aspects may be defined in an interaction definition, which may be a change journal reason codes as used by Microsoft's Change Journal program, or be defined by a user or network administrator to capture some or all data interactions in order to meet user needs. For example, certain change definitions may record every data interaction that occurs regardless of whether any data actually changes or not. Such information may be useful, for example, to determine users or processes that have “touched scanned or otherwise accessed data without actually changing it.
  • Thus, it is possible to employ interaction definitions that may capture a relatively broad or narrow set of operations, allowing a user to customize the monitor program to meet certain goals. Such interaction definitions may define or describe data movement, changes, manipulations or other operations or interactions that may be of interest to a system user or administrator (e.g., any operation that “touches” data may be recording along with the action or operation that caused the interaction (e.g. read, write, copy, parse, etc.) Moreover, change definitions may evolve over time or may be dynamic based on the entries sent to the index. For example, if expected results are not obtained, change definitions may be modified or additional definitions used until appropriate or desired results are obtained. This may be accomplished, for example by globally linking certain libraries of interaction definitions and selectively enabling libraries on a rolling basis until acceptable results are achieved. This process may be performed after the initial activation of the monitor agent and periodically thereafter, depending on changing needs or objectives.
  • Moreover, in some embodiments, the system may support the use of “user tags” that allow certain types of information to be tagged so they may be identified and tracked throughout the system. For example, a user may designate a particular type of data or information such as project information, or information shared between or accessed by particular group of users to be tracked across the system or through various levels of storage. This may be accomplished through a user interface (not shown) that allows a user to define certain information to be tagged, for example, by using any available attribute within the system such as those specified above with respect to the classification agent or filter used in the system. In some embodiments, the user may define one or more tags using these or other attributes which may be further refined by combining them through the use of logical or Boolean operators to a define a certain tag expression.
  • For example, a user may define a certain tag by specifying one or more criteria to be satisfied such as certain system users, a certain data permission level, a certain project, etc. These criteria may be defined using a logical operators such as an AND or OR operators to conditionally combine various attributes to create a condition that defines a tag. All information satisfying those criteria may be tagged and tracked within the system. For example, as data passes through the monitor agent 306 (or other module within update agent 304), the data satisfying these criteria may be identified and tagged with a header or a flag or other identifying information as is known in the art. This information may be copied or otherwise noted by metabase 314 and mass storage 318 so that the information may be quickly identified. For example, the metabase may contain entries keeping track of all entries satisfying the tag criteria along with information relating to the types of operations performed on the information as well as certain metadata relating to the data content and its location in mass storage 318. This allows the system to search the metabase at a particular level of storage for the information, and quickly locate it within mass storage device for potential retrieval.
  • Next, a step 365, the monitor agent may continue to monitor data interactions based on change definitions until an interaction satisfying a definition occurs. Thus, a system according to one embodiment of the present invention may continue to monitor data interactions at steps 360 and 365 until a defined interaction, such as an interaction satisfying or corresponding to a selection criterion, such as an interaction definition, etc., occurs. If a defined interaction does occur, the monitor agent may create a record, which may be stored in a monitor program index, and in some embodiments, assign an interaction code that describes the interaction observed on the data object. Next, a step 370, the monitor program may identify a data object identifier associated with the data and that is associated with the data interaction, such as a file reference number (FRN) related to the data object. The FRN may include certain information such as the location or path of the associated data object. Any additional information (e.g., data properties, copy properties, storage policy information, etc.) associated with the FRN may also be obtained in order to enrich or enhance the record. In some embodiments, this may further involve obtaining information from other system files including master file tables (MFTs) to further enhance the metabase entries. Additional processing or formatting of the metabase entries may also occur in accordance with certain defined classification paradigms in order to populate the metabase with optimal or preferred information.
  • Next, at step 375 the record may be assigned record identifier such as a unique update sequence number (USN) that may be used to uniquely identify the entry within the index, and, in some embodiments, act as an index memory location. Thus a particular record may be quickly located with a data structure based on the USN. Next at step 380, the information described above may be concatenated or otherwise combined with other data or metadata data obtained by the monitor agent and arranged in an appropriate or expected format to create the record that may be written to the monitor index.
  • In alternate embodiments, the information described above may be written to the index and arranged at the index into an expected format or may be written to the record “as received” and include metadata or other information, such as a header describing that information such that adherence to a strict data format is not required. For example, some records may contain more or less information than other records, as appropriate. After the record has been constructed and deemed complete, the record may be “closed” by the system at step 385 and the system may then assign another USN to the next detected change. However, if the record is determined to be incomplete, the monitor agent or update agent may request any missing information to complete the entry. If such information is not received, the monitor agent may set a flag within the record to indicate it contains incomplete information and the record may then be closed.
  • FIG. 4 is a flow chart 400 illustrating some of the steps that may be involved in a data classification process. At step 410, the classification agent may be initialized, which may include activating, reserving and/or clearing certain buffers and/or linking to libraries associated with deployment of the classification agent. Prior to scanning the interaction records generated by the monitor agent as described above, the classification agent may classify existing stored data by, for example, traversing the file and directory structure of an object system to initially populate the metabase as described herein.
  • Next, at step 420, during normal operation, the classification agent may scan the entries in the interaction journal to determine whether new entries exist since any previous classification processing was performed, for example, by determining whether the most recent entry currently in the journal is more or less recent than the last journal entry analyzed. This may be accomplished in several ways. One method may include scanning a time or date information associated with the last journal entry examined and comparing it to the most recent time or date information than the entry currently present in the journal. If it is determined that the most recent journal entry occurred after a previous classification process, this process may be performed iteratively by “walking backwards” through the journal entries until the last entry previously analyzed by the classification agent is found. All entries with time information after that point may be considered new or unprocessed by the classification agent (step 440). If the last entry analyzed has the same time stamp as the most recent entry in the journal, no new entries exist and the system may return to step 420 to continue monitoring, etc.
  • Another method of identifying new journal entries may include comparing record identifiers such as USN numbers assigned to each journal entry (step 430). Journal entries with a larger USN number than the last entry previously analyzed may be considered new or unprocessed. If the last entry analyzed has the same USN number as the current entry, no new entries exist and the system may return to step 420 to continue monitoring, etc. This comparison may be performed until new entries are located (step 440) or until it is determined that no new entries exist.
  • In other embodiments, rather than scanning the journal data structure for new entries, any entries created by the journal agent may be automatically sent to the classification agent and the identification process may be largely unnecessary (except for the case where such scanning is necessary or desirable, for example, to repopulate the journal or verify certain information, etc.).
  • Next, at step 450, assuming new journal entries are identified, the system may determine if a metabase record already exists for the data object associated with those entries. This may be accomplished by comparing data object identifiers, such as FRNs of metabase entries with data object identifiers such as FRNs of journal entries. Matching these and other unique data characteristics may be used to match or correlate metabase and journal entries.
  • If no corresponding metabase record is identified, a new record may be created at step 460. This may involve creating a new metabase entry ID, analyzing the journal entry and parsing the entry into a predetermined format, and copying certain portions of the parsed data to the new metabase entry (steps 460 and 470), as further described herein. Any additional metadata or file system information may also be associated with the new entry to enhance its content, including information from an FRN information derived from an interaction code present in the journal entry, file system, e.g., MFT, etc. (step 480).
  • On the other hand, if a corresponding metadata entry is identified, the new journal entry may be processed as described above and may overwrite some or all of the corresponding entry. Such an updated pre-existing entry may receive an updated time stamp to indicate a current revision. However, in some embodiments, even if a corresponding entry is located, a new entry may be created and written to the metabase and optionally associated with the existing record. In such a system, the older related record may be maintained, for example, archival, recreation, historical or diagnostic purposes, and in some embodiments, may be marked or indicated as outdated or otherwise superseded. Such corresponding entries may be linked to one another via a pointer or other mechanism such that entries relating to the history of a particular data object may be quickly obtained.
  • Next, at step 490 the system may process any additional new journal entries detected by returning to step 450, where those additional new entries may be processed as described above. If no new entries are detected, the system may return to step 420 to perform additional scans on the journal data structure and continue monitoring.
  • FIG. 5 illustrates an embodiment of the present invention in which a secondary processor performs some or all of functions associated with the data classification process described herein, including certain search functions. As shown, system 500 may include a manager module 505 which may include an index 510, a first computing device 515, (which may include a first processor 520, a journal agent 530, and a data classification agent 535), and a second computing device 540 which may include a second processor 545 and a data classification agent 535. System 500 may also include data store 550, a metabase 555 and change journal 560.
  • Computing devices 515 and 544 may be any suitable computing device as described herein and may include clients, servers or other network computers running software, such as applications or programs that create, transfer, and store electronic data. In some embodiments, metabase 555 and journal 560 may be physically located within computing device 515, e.g., stored on local mass storage. In other embodiments the metabase 555 and journal 560 may be external to computing device 515 (or distributed between the two). In yet other embodiments, metabase 555 is accessible via a network and journal 560 is a local device.
  • In operation, computing device 515 may operate in a substantially similar manner as system 300 shown in FIG. 3 with second processor 545 in second computing device 540 performing certain functions. For example, as shown, data classification agent 535 and journaling agent 530 may operate substantially as described in connection with FIG. 3, i.e., journaling agent monitors data interactions on computing device 515 and records the interactions in journal 535 and classification agent processes journal entries and populates metabase 555, etc.
  • However, certain of the functions may be initiated or performed in whole or in part by second processor 545. Computing operations associated with journal agent 530 and/or classification agent 535 may run on or be directed by second processor 545 and may also utilize support resources located on or associated with computing device 540 such that the resources on computing device 515 are substantially unimpacted by these operations. This may serve to offload certain non-critical tasks from the host system (515) and have them performed by a secondary computing device 545.
  • For example, in some embodiments, the processing burden associated with some or all of the following tasks normally performed by first computing device 515 may be performed by processor 545 and associated resources in second computing device 540: (1) the initial scan of client files by the classification agent 535 and population of metabase 555, (2) the ongoing monitoring of data interactions of computing device (e.g., 515) and generation of interaction records for storage in journal 560, (3) processing and classification of journal information for updating metabase 555; and (4) searching or otherwise analyzing or accessing metabase 555 and/or journal 560 for certain information. However, in some embodiments it may be preferred to assign the secondary computing device the certain tasks such as those associated with searching metabase 555, while other tasks such as updating the journal and metabase may be performed by the primary computing device.
  • Performing such operations using a secondary or other processor may be desirable, for example, when the primary processor (e.g., processor 520) is unavailable, over utilized, unavailable or otherwise heavily used, or when it is otherwise desired to remove the primary processor and other primary system resources from performing certain tasks such as the ones described above. For example, in the case where it is desired to search or access metabase 555 for certain information, it may be preferable to avoid using processor 520 for this task so it remains free to perform other tasks associated with programs operating on computing device 515 (e.g., when computing device 515 is busy performing other network or application-related functions).
  • In some embodiments, the secondary processor may be located on computing device 515 (e.g., processor 525) and may perform the operations described herein in connection with processor 545. Moreover, some embodiments may include a manager module 505 which may coordinate overall operations between the various computing devices. For example, manager module 505 may monitor or otherwise be cognizant of the processing load on each computing device and may assign processing tasks based on availability (e.g., load balance). For example, if processor 520 is idle or operating at a low capacity, a request to search metabase 555 may be handled by processor 520. However, if processor 520 is busy or scheduled to perform or is performing priority work, manager 505 may assign the task to processor 545. Manager 505 may act as a general arbiter for such processor assignments to ensure system 500 is making efficient use of system resources.
  • FIG. 6 is flow chart 600 illustrating some of the steps involved in performing a query on a metabase in a multiple processor system similar to the system shown in FIG. 5. At step 610, a query may be received by the system for certain information. This request may be processed and analyzed by a manager module or other system process that determines or otherwise identifies which metabase or metabases within the system likely include at least some of the requested information, step 630. For example, the query itself may suggest which metabases to search and/or the management module may consult an index that contains information regarding metabase content within the system as further described herein. It will be understood that the identification process may require searching and identifying multiple computing devices within an enterprise or network that may contain information satisfying search criteria.
  • In other embodiments, search requests may be automatically referred to a secondary processor to minimize processing demands on the computing device that may have created or is otherwise associated with the identified metabase(s). In some embodiments, it is preferable that the computing device that created or is otherwise associated with the identified metabase(s) not be involved in processing search operations as further described herein. Thus, the secondary computing device may consult with a manager or index associated with other computing devices to identify metabases with responsive information.
  • Next at step 640, the secondary processor may search metabases to identify appropriate data set that may potentially have information related to the query. This may involve performing iterative searches that examine results generated by previous searches and subsequently searching additional, previously unidentified metabases to find responsive information that may not have been found during the initial search. Thus the initial metabase search may serve as a starting point for searching tasks that may be expanded based on returned or collected results. Next, at step 650, the returned results may be optionally analyzed for relevance, arranged, and placed in a format suitable for subsequent use (e.g., with another application), or suitable for viewing by a user and reported (step 650).
  • FIG. 7 presents a system 700 constructed in accordance with the principles of the present invention employing a centralized metabase 760 that may serve multiple computing devices 715-725. For example, as shown, system 700 may include computing devices 715-725, each of which may include a journaling agent (730-740 respectively), a classification agent (745-755 respectively), and centralized metabase 760, and in some embodiments, a manager module 705 with an index 710.
  • In operation, system 700 may operate substantially similarly to system 300 shown in FIG. 3 with each computing device 715-725 storing classification entries in centralized metabase 760 rather than each computing device having its own dedicated metabase. For example, as shown, data classification agents 745-755 may operate substantially as described herein and communicate results to centralized metabase 760. That is, analyze and process entries within the respective journals associated with journaling agents 730-740, and report results to metabase 760. With this arrangement, the classification agent may provide each metabase entry with an ID tag or other indicia that identifies which computing device 715-725 the entry originated from to facilitate future searches and efficiently designate entry ownership, or other associations between entries and computing devices.
  • Moreover, each entry to metabase 760 may be assigned a unique identifier for management purposes. As mentioned above, this number may represent the index location or offset of the entry within centralized metabase 760. In some embodiments, entries may be communicated to metabase 760 from the computing devices 715-725 on a rolling basis and may be arranged and formatted for storage by the metabase 760. For example, metabase 760 may receive multiple entries at substantially the same point in time from multiple computing devices 715-725 and may be responsible for queuing and arranging such entries for storage within the metabase 760.
  • In some embodiments, system 700 may include manager module 705 that may be responsible for assigning or removing associations between certain computing devices 715-725 and a particular centralized metabase 760. For example, in accordance with certain system preferences defined in index 710, manager 705 may direct certain computing devices 715-725 to write classification entries to a particular centralized metabase 760. Information indicating an association of the metabase 760 and the computing devices 715-725 may be stored in the index 710. This allows system 700 to reassign resources (globally or locally) to optimize system performance without the need to change device pointers or code associated with each computing device 715-725 that may be affected by a particular reallocation. For example, manager 705 may reassign certain computing devices 715-725 to another metabase by changing a destination address in an appropriate index.
  • FIG. 8 is flow chart 800 illustrating some of the steps involved in using a centralized metabase with multiple computing devices similar to the one shown in FIG. 7. At step 810, a centralized metabase may be instantiated by a manager module or in accordance with certain system management or provisioning policies. This may involve securing certain processing, storage, and management resources for performing the task, loading certain routines into various memory buffers and informing the management module that the metabase is ready for operation.
  • Next, at step 820, the management module may review system resources, management policies, operating trends, and other information, for example, to identify computing devices to associate with the instantiated centralized metabase. This may further involve identifying pathways to the metabase from the various computing devices, locating operational policies governing the computing devices and, creating certain logical associations between the centralized metabases and the identified computing devices. These associations, once created, may be stored in an index or database for system management purposes.
  • After the metabase has been instantiated and associated with computing devices, classification agents within each associated computing device may scan existing files or data on the computing devices or clients (step 825) and populate the centralized metabase as further described herein (step 830). During the scanning process, a computing device identifier or other indicia may be appended or otherwise associated with the entry prior to transmission to the metabase such that each entry in the metabase can be tracked to its associated source computing device (step 840). Next, the centralized metabase may be populated with entries (step 850) and may communicate with the management module to establish and monitor a list of computing devices serviced by the centralized metabase and return to step 830. At this point, the system continues to monitor the associated computing devices for data interactions, which may be reported to the centralized metabase on an ongoing, periodic, or rolling basis.
  • In certain circumstances, the centralized metabase may need to assimilate or otherwise integrate existing entries with new entries reported by the computing devices. For example, the centralized metabase may become disconnected or unavailable for a period of time and subsequently be required to integrate a large number of queued entries. In this case, the metabase or management module may examine existing metabase entries as described herein and communicate with computing devices to identify: (1) the amount of time the object computer and the metabases have been disconnected, (2) the number of queued entries at the computing devices that need to be processed (for example, entries cached once the centralized metabase was inaccessible for write operations), (3) whether there are any duplicative entries, and (4) which entries need to be integrated and in what order of preference (assuming multiple computing devices contain queued entries).
  • Based on these criteria, the management module or centralized metabase may assimilate the relevant entries into the metabase in the appropriate order until the backlog is eliminated and the system returns to normal operation. If it is determined during this process that certain information is lost to cache overflow, accidental deletion, corruption, or other reasons, the metabase and/or manager module may indicate such a discontinuity with the metadata or index associated with the centralized storage device or management module. In this case, clients, computing devices or other data sources may be rescanned to replace or repair the faulty entries. In other embodiments, the points of discontinuity may be noted and interpolation or other data healing techniques may be employed to provide derived information for the unknown points based on known information.
  • FIG. 9 presents a system 900 constructed in accordance with the principles of the present invention including a computing device that interacts with a network attached storage device (NAS). As shown, system 900 may include a management module 905 and index 910, computing devices 915-925, each of which may include a journaling agent (945-955 respectively), a classification agent (930-940 respectively), data stores 960 and 965, and metabases 970-980. System 900 may also include NAS device 995 which may include NAS storage device 990 and NAS file system manager 985. Moreover, computing device 925 may be configured to operate as a NAS proxy device supervising the transfer of data to and from NAS device 995.
  • In operation, system 900 may operate substantially similar to system 300 shown in FIG. 3 a with exception of the NAS portion shown on the right-hand side. For example, as shown, data classification agents 930-940 may operate substantially as described herein and communicate results to their respective metabases 970-980. That is, analyze and process entries within the respective journals associated with journaling agents 945-955, and report results to metabases 970-980 which may be supervised in whole or in part by management module 905.
  • Data from computing device 925 may be journaled and classified using methods similar to those described herein. For example, journaling agent 955 may reside on computing device 925 and track each or certain data interactions between NAS device 995 and external applications. The location of the journaling agent 955 may be external to the NAS device 995 due, at least in part, to its proprietary nature (i.e., a closed system) and the difficulty associated with attempting to run other programs on the NAS device 995 itself.
  • The NAS portion 995 of system 900 may operate somewhat differently. For example computing device 925 may operate as a NAS proxy for moving data files to and from NAS device 995 using a specialized protocol such as the Network Data Management Protocol (NDMP) that is an open network protocol designed to perform data backups over heterogeneous networks. NDMP may be used to enhance performance by transferring data over a network by separating data and control paths, while maintaining centralized backup administration.
  • Journaling agent 955 may record any interactions between NAS data and external applications and record those interactions in computing device 925 as described herein. In some embodiments, such a journaling agent may include specialized routines for interpreting and processing data in NAS format. Data classification agent 940 may analyze journal entries and populate metabase 980 initially and periodically as further described herein.
  • Once initially populated, it may be desired to search the metabases of system 900 for certain information. This is discussed in more detail below in connection with the flow chart 1100 of FIG. 11. In some embodiments, this may be handled by manager 905 or other system process which may initially evaluate any search request and consult index 910 or other information stores to determine which metabases within the system are likely to include responsive information. The results of this evaluation may be provided to the computing device handling the search request and may be in the form of pointers or other indicia or identifiers identifying a metabase such as a metabase ID. This may allow the computing device posing the search request to contact and search the identified metadata directly. In other embodiments manager 905 may process the request and provide substantially complete results to the computing device that submitted the query.
  • FIG. 10 is flow chart 1000 illustrating some of the steps that may be involved in using the NAS system similar to or the same as the one shown of FIG. 9. At step 1010 a copy operation may be initiated that directs data from computing device to a NAS device. This may involve identifying certain data to moved, for example, based on a data management or storage policy. Other factors that may also be considered may include data size, the last time the data was moved to the NAS device, the file owner, application type, etc.
  • It will be understood that in some embodiments it may be preferred to use computing device 925 as a NAS proxy that routes data from other network computing devices (not shown) to NAS device 995 with the computing device 925 supervising the data movement using certain specialized transfer programs to assist in the effort (step 1020). As the data is routed though computing device 925, journaling agent 955 may monitor interactions with NAS device 995 and create interaction entries for an interaction journal (step 1030). This may be accomplished by consulting with NAS file manager 985 and identifying which files in NAS 995 that have been involved in a data interaction as further described herein (step 1040). Next, journal entries may be created or updated to reflect data interactions currently detected as previously described herein (step 1050). The interaction journal may then be scanned to analyze the journal records (step 1060) and perform the classification process as further described herein to create metabase entries (step 1070). At this point metabase entries may be assigned an identifier and used to populate metabase 980 (step 1080).
  • As mentioned above, under certain circumstances, it may be desired to search a system that includes multiple metabases for certain information such as system 900 shown in FIG. 9 whether or not NAS included. FIG. 11 includes a flow chart 1100 illustrating some of the steps that may be performed in searching a multiple metabase system in accordance with certain aspects of the present invention.
  • Assume, for example, a user wants to locate and copy all data relating to a certain specified criteria such as data relating to a specific marketing project created and edited by a specific group of users over a certain period of time. First, the requestor may formulate such a request through a user interface (not shown) using techniques known in the art and submit the request to the system for processing. This may also be accomplished by an automated computerized process, for example, when the system is performing certain management functions. Next the system may receive and analyze this query (step 1110). In some embodiments, this may be performed by a computing device configured to support the user interface. In other embodiments, the computing device may simply pass the request to the system where a management module or other system process computing device may perform the analysis. The analysis may include determining characteristics of data in the metabase that may satisfy the selected criteria.
  • Once the search request or query has been analyzed or parsed, the system may identify all metabases likely to contain records related to relevant data objects based on a query. This may be accomplished by using information obtained from analyzing or parsing the request as well as consulting with a management module that may have a substantially global view of metabases within the system that includes index information or a general overview of the information the metabases contain. After a set of metabases have been identified, the management module or other computing device may perform the search to identify a data set satisfying a query as further described herein and return a set of results (step 1130). At step 1140 the results may optionally be normalized. If normalization is not required, the results may be reported at step 1150. If normalization is desired, the system may analyze the results for both content and completeness. If, based on the returned results, other unsearched metabases are implicated as potentially having information that satisfies the search criteria, those metabases may be searched as well. This process may continue in an iterative fashion until a substantially complete set of results is obtained. Even if no additional metabases are implicated, these results may then be optionally normalized by performing certain functions such as locating and removing duplicative results, identifying network pathways to data objects identified in the search, and formatting or arranging the results for further processing (whether another computing process or for a user). For example, the returned results may be used to locate and retrieve the responsive data objects that may include information located on primary or secondary storage devices within the system or for other purposes as further described herein.
  • In some embodiments, the systems and methods of the present invention may be employed to identify and track some or all data interactions on a user or group basis. For example, a system administrator or user may wish to record and keep track of all data interactions involving some or all system groups or users. This may include, for example, read and write operations performed on the user's or group's behalf, information and applications used or accessed, viewed web pages, electronic gaming interactions, chat, instant messages, and other communication interactions, multimedia usage, and other Internet or network based electronic interactions as known in the art. Thus, the system identifies, captures, classifies, and may otherwise track user and group interactions with electronic data creating a data store or other repository of these interactions and metadata associated with these interactions. In some embodiments, this repository may serve as a “digital or electronic life record” that effectively chronicles and catalogues some or all user or group interactions with electronic information and data during a given time period as further described herein.
  • For example, FIG. 11 a illustrates a system constructed in accordance with the principles of the present invention that identifies, captures, classifies, and otherwise tracks user and group interactions with electronic data. As shown, the system may generally include computing device 1162, one or more classification agents 1164, one or more journaling agents 1165, metabase 1166, change record 1167, and database 1168.
  • In operation computing device 1162 may be coupled to or interact with various other applications, networks, and electronic information such as, for example multimedia applications 1170, instant messaging/chat applications 1172, network applications 1174 such as an enterprise WAN or LAN, Internet 1176, and gaming applications 1178. It will be understood, however, that these are only examples and that any other network, application, or type of electronic information suitable for the purposes described herein may be added if desired.
  • Journaling agents 1165 and classification agents 1164 may operate in conjunction with one another to detect and record data interactions as further described herein. For example, each type of electronic data interaction (e.g.—instant messaging, web surfing, Internet search activities, electronic gaming, multimedia usage, etc.) may be identified, captured, classified, and otherwise tracked by a different journaling agent 1165 and classification agent 1164, for example an interaction-specific journaling agent 1165 or classification agent 1164 dedicated to processing a single type of interaction with electronic data. Thus, the system may have a first journaling agent 1165 and a first classification agent 1164 monitoring network traffic on a given network interface (not shown) directed to interactions associated with Internet usage, and a second journaling agent 1165 and a second classification agent 1164 monitoring a different system resource directed to interactions associated with electronic gaming (e.g.—recording and classifying gaming interactions such as recording games played, opponents played, win/loss records, etc.) or directed to interactions associated with use of an Internet browser to “surf” web (e.g.—tracking pages visited, content, use patterns, etc.) In some embodiments, journaling agent 1165 and classification agent 1164 may function as a single module capable of performing some or all functions associated with journaling agent 1165 and a classification agent 1164.
  • Thus, as a user or group interacts with various types of electronic information, some or all of those interactions may be captured and recorded in database 1168. Change record 1167 and metabase 1166 may record certain aspects of the interactions as further described herein and may represent an interaction by interaction log of the user's computing activities.
  • For example, in operation, a user of computing device 1162 may interact with certain applications such as multimedia application 1170 and instant messaging application 1172. This may include sending, receiving, viewing and responding to various audio/video files in any suitable format and may include instant, text or email messages. Journaling agent 1165 may detect the interactions between these applications and computing device 1162 and classification agent 1164 may classify and record information (e.g., metadata) associated with these interactions in metabase 1166 as further described herein.
  • Moreover, in some embodiments, some or all the content being exchanged or otherwise associated with these interactions may be captured and stored in database 1168 or other storage locations in the system. This may include capturing screen shots or summaries of information exchanges during data interactions. For example, the system may download all content associated with web pages viewed thus being able to recreate the original page content and interaction without access to the original or source version of the page on the Internet or other network. This may be advantageous, for example, if a user wishes to interact with content associated with a previous interaction when that content is no longer available, as is common with web pages and other network resources over time. As another example, the system may also capture or otherwise store data associated with other interactions, for example chat transcripts, video game replays, search queries, search results, and associated search content, songs accessed, movies accessed, stored songs and movies, in addition to metadata, etc.
  • Moreover, in some embodiments, specialized classifications agents may be employed for some or all of the applications that a user or administrator desires to track and record. For example, the multimedia and instant messaging applications described above may each have a dedicated classification agent that analyzes journal records to create entries for metabase 1166. Further still, each classification agent may have its own associated metabase and or repository for source data (not shown), so application histories and content may be quickly indexed and searched. In other embodiments, however, a “universal” classification agent may be used that recognizes the application type (e.g., based on the journaling agent entries) and process interactions accordingly (which may include routing metadata to one or more specialized metabases).
  • As shown in FIG. 11 a, computing device 1162 may also interact with various network applications 1174 such as LAN or WAN applications. These may include interaction with certain distributed programs such as Microsoft Word or Outlook. Users may also interact with Internet 1176 and download various web pages and other information. In accordance with an aspect of the present invention, interactions with these networks/applications may also be journaled as described above with certain information regarding these interactions stored in metabase 1166. Portions of exchanged content may also be stored in database 1166. For example, Word documents, emails, web pages, web addresses and HTML content may be captured and stored on database 1168 such that it substantially represents a record of all user interactions with computing device 1162, or other system devices. For example, user interactions may be recorded with respect to any identified user based on identifiers and tracked at any network computing device.
  • Thus, if desired a user may retrieve captured data and review or replay certain data exchanges or save such records for future reference. For example, a user may store all instant messaging interactions for replay or transmission to another. In some instances, it may be desirable to not record certain interactions, such as personal or private information. In some embodiments, this may be accomplished by “disabling” the appropriate classification agent for a certain period of time, etc.
  • Likewise, interactions with gaming applications (network or stand alone) may also be recorded stored with appropriate information stored in database 1168 and metabase 1166. Thus, a user may have the ability to retrieve, replay and transmit certain saved gaming sequences to third parties.
  • In some embodiments, database 1168 may become large and thus some information stored thereon may be moved to single instance storage from database 1168 with a pointer placed in the logical address of the instanced information (not shown). This may be performed as a memory saving measure as at least some of the entries in database 1168 are likely to be duplicative.
  • Some of the steps associated with the method generally described above are illustrated in chart 1200 of FIG. 12 and may include the following. At the outset, a group or user of interest may be identified based on certain user related information or other network characteristics (step 1210). Such characteristics may include Active Directory privileges, network login, machine ID, or certain biometrics associated with a user or group member. These characteristics may be combined together or associated with one another to create a user or group profile. Such profiles may be stored in a database or index within a management module of the system and may be used as classification definitions within the system. When it is desired to identify or classify data items associated with a particular interaction, the system may compare certain attributes of the data involved in a detected interaction and associate that interaction with a particular group or user based on profile information (step 1220).
  • Such associations may be stored in a metabase created to keep track of user or group interactions. Thus, in one embodiment, the metabase essentially represents a list of all data interaction for a particular group or user. If desired, a list or copy of all the data items touched (e.g., interacted with) by a group or user may be quickly obtained.
  • In operation, the system may, through the use of a journaling agent or the like, monitor data interactions for a particular computing device as described herein. The interactions may be analyzed by a classification agent as described herein and associated with one or more profiles (step 1230). The association may be recorded in an identified metabase(s) that keeps track of a user's or group's interactions (step 1240) which may include references to the data object(s) identified, the attributes compared, and the basis for the association, etc. As discussed herein, the journaling agent may continue to monitor data interactions throughout operation, so that each metabase is updated and continues to accurately represent the data touched by a particular group or user. The identified metabases are associated with an identified group or user (step 1250), such as by storing an indication of the association in an index.
  • FIG. 13 presents a system 1300 constructed in accordance with the principles of the present invention for communicating metadata and/or data objects between two or more computing devices. As shown, system 1300 may generally include first and second computing devices 1310 and 1320, respectively, associated data stores 1330 and 1340, and metabases 1350 and 1360. Computing devices in system 1300 may store data objects and metadata in their respective metabases and data stores as further described herein. In certain situations, however, it may be desired to transfer certain metadata between metabases 1350 and 1360 and certain data objects between data stores 1330 and 1340. This may be desirable for example, to move certain data from one computing device to another, to recreate a certain application at another location, or to copy or backup certain data objects and associated metadata.
  • FIG. 14 presents a flow chart 1400 illustrating some of the steps associated with moving data between the computing devices described above. First, at step 1410, data objects and/or associated metadata may be identified for movement from one computing device to another. This may be accomplished by forming a query for certain data, such as a search for data that may be to be moved or copied pursuant to a data management or storage policy, or in response to a request to move data relating to certain processes or applications from one computing device to another, for any other suitable purpose such as disaster recovery, resource reallocation or reorganization, load balancing, etc.
  • At step 1420, the query may be analyzed and a first data store associated with a first computer may be searched for data objects satisfying the search criteria. Data objects identified during this process may then be transferred to a second data store associated with a second computing device (step 1430). Metadata associated with the transferred data objects may also be identified in a first metabase associated with the first computing device and transferred to an appropriate second metabase associated with the second computing device (step 1440). Such a transfer may involve copying data objects and metadata from one data store and metabase to another, or in some embodiments, may involve migrating the data from its original location to a second location and leaving a pointer or other reference to the second location so the moved information may be quickly located from information present at the original location.
  • FIG. 15 illustrates a one arrangement of resources in a computing network in accordance with the principles of the present invention. As shown, storage operation cell 1550 may generally include a storage manager 1501, a data agent 1595, a media agent 1505, a storage device 1515, and, in some embodiments, may include certain other components such as a client 1585, a data or information store 1590, database 1511, jobs agent 1520, an interface module 1525, and a management agent 1530. Such system and elements thereof are exemplary of a modular storage system such as the CommVault QiNetix system, and also the CommVault GALAXY backup system, available from CommVault Systems, Inc. of Oceanport, N.J., and further described in U.S. patent application Ser. No. 09/610,738 which is incorporated herein by reference in its entirety.
  • A storage operation cell, such as cell 1550, may generally include combinations of hardware and software components associated with performing storage operations on electronic data. According to some embodiments of the invention, storage operations cell 50 may be related to backup cells and provide some or all of the functionality of backup cells as described in application Ser. No. 09/354,058, which is hereby incorporated by reference in its entirety. However, in certain embodiments, storage operation cells may also perform additional types of storage operations and other types of storage management functions that are not generally offered by backup cells.
  • In accordance with certain embodiments of the present invention, additional storage operations performed by storage operation cells may include creating, storing, retrieving, and migrating primary storage data (e.g., 1590) and secondary storage data (which may include, for example, snapshot copies, backup copies, HSM copies, archive copies, and other types of copies of electronic data) stored on storage devices 1515. In some embodiments, storage operation cells may also provide one or more integrated management consoles for users or system processes to interface with in order to perform certain storage operations on electronic data as further described herein. Such integrated management consoles may be displayed at a central control facility or several similar consoles distributed throughout multiple network locations to provide global or geographically specific network data storage information.
  • In some embodiments, storage operations may be performed according to various storage preferences, for example as expressed by a user preference or storage policy. A storage policy is generally a data structure or other information source that includes a set of preferences and other storage criteria associated with performing a storage operation. The preferences and storage criteria may include, but are not limited to, a storage location, relationships between system components, network pathway to utilize, retention policies, data characteristics, compression or encryption requirements, preferred system components to utilize in a storage operation, and other criteria relating to a storage operation. Thus, a storage policy may indicate that certain data is to be stored in a specific storage device, retained for a specified period of time before being aged to another tier of secondary storage, copied to secondary storage using a specified number of streams, etc. A storage policy may be stored in a storage manager database 1511, to archive media as metadata for use in restore operations or other storage operations, or to other locations or components of the system.
  • A schedule policy may specify when to perform storage operations and how often and may also specify performing certain storage operations on sub-clients of data and how to treat those sub-clients. A sub-client may represent static or dynamic associations of portions of data of a volume and are typically mutually exclusive. Thus, a portion of data may be given a label and the association is stored as a static entity in an index, database or other storage location used by the system. Sub-clients may also be used as an effective administrative scheme of organizing data according to data type, department within the enterprise, storage preferences, etc.
  • For example, an administrator may find it preferable to separate e-mail data from financial data using two different sub-clients having different storage preferences, retention criteria, etc. Storage operation cells may contain not only physical devices, but also may represent logical concepts, organizations, and hierarchies. For example, a first storage operation cell 1550 may be configured to perform a first type of storage operations such as HSM operations, which may include backup or other types of data migration, and may include a variety of physical components including a storage manager 1501 (or management agent 1530), a media agent 1505, a client component 1585, and other components as described herein. A second storage operation cell may contain the same or similar physical components, however, it may be configured to perform a second type of storage operations such as SRM operations, and may include as monitoring a primary data copy or performing other known SRM operations.
  • Thus, as can be seen from the above, although the first and second storage operation cells are logically distinct entities configured to perform different management functions (i.e., HSM and SRM respectively), each cell may contain the same or similar physical devices in both storage operation cells. Alternatively, in other embodiments, different storage operation cells may contain some of the same physical devices and not others. For example, a storage operation cell 1550 configured to perform SRM tasks may contain a media agent 1505, client 1585, or other network device connected to a primary storage volume, while a storage operation cell 1550 configured to perform HSM tasks may instead include a media agent 1505, client 1585, or other network device connected to a secondary storage volume and not contain the elements or components associated with and including the primary storage volume. These two cells, however, may each include a different storage manager 1501 that coordinates storage operations via the same media agents 1505 and storage devices 1515. This “overlapping” configuration allows storage resources to be accessed by more than one storage manager 1501 such that multiple paths exist to each storage device 1515 facilitating failover, load balancing and promoting robust data access via alternative routes.
  • Alternatively, in some embodiments, the same storage manager 1501 may control two or more cells 1550 (whether or not each storage cell 1550 has its own dedicated storage manager 100). Moreover, in certain embodiments, the extent or type of overlap may be user-defined (through a control console (not shown)) or may be automatically configured to optimize data storage and/or retrieval.
  • Data agent 1595 may be a software module or part of a software module that is generally responsible for copying, archiving, migrating, and recovering data from client computer 1585 stored in an information store 1590 or other memory location. Each client computer 1585 may have at least one data agent 1595 and the system can support multiple client computers 1585. In some embodiments, data agents 1595 may be distributed between client 1585 and storage manager 1501 (and any other intermediate components (not shown)) or may be deployed from a remote location or its functions approximated by a remote process that performs some or all of the functions of data agent 1595.
  • Embodiments of the present invention may employ multiple data agents 1595 each of which may backup, migrate, and recover data associated with a different application. For example, different individual data agents 1595 may be designed to handle Microsoft Exchange data, Lotus Notes data, Microsoft Windows 2000 file system data, Microsoft Active Directory Objects data, and other types of data known in the art. Other embodiments may employ one or more generic data agents 1595 that can handle and process multiple data types rather than using the specialized data agents described above.
  • If a client computer 1585 has two or more types of data, one data agent 1595 may be required for each data type to copy, archive, migrate, and restore the client computer 1585 data. For example, to backup, migrate, and restore all of the data on a Microsoft Exchange 2000 server, the client computer 1585 may use one Microsoft Exchange 2000 Mailbox data agent 1595 to backup the Exchange 2000 mailboxes, one Microsoft Exchange 2000 Database data agent 1595 to backup the Exchange 2000 databases, one Microsoft Exchange 2000 Public Folder data agent 1595 to backup the Exchange 2000 Public Folders, and one Microsoft Windows 2000 File System data agent 1595 to backup the client computer's 1585 file system. These data agents 1595 would be treated as four separate data agents 1595 by the system even though they reside on the same client computer 1585.
  • Alternatively, other embodiments may use one or more generic data agents 1595, each of which may be capable of handling two or more data types. For example, one generic data agent 1595 may be used to back up, migrate and restore Microsoft Exchange 2000 Mailbox data and Microsoft Exchange 2000 Database data while another generic data agent may handle Microsoft Exchange 2000 Public Folder data and Microsoft Windows 2000 File System data, etc.
  • Data agents 1595 may be responsible for arranging or packing data to be copied or migrated into a certain format such as an archive file which is discussed in more detail in connection with FIG. 16 herein. Nonetheless, it will be understood this represents only one example and any suitable packing or containerization technique or transfer methodology may be used if desired. Such an archive file may include a list of files or data objects copied in metadata, the file and data objects themselves. Moreover, any data moved by the data agents may be tracked within the system by updating indexes associated appropriate storage managers or media agents.
  • Generally speaking, storage manager 1501 may be a software module or other application that coordinates and controls storage operations performed by storage operation cell 1550. Storage manager 1501 may communicate with some or all elements of storage operation cell 1550 including client computers 1585, data agents 1595, media agents 1505, and storage devices 1515, to initiate and manage system backups, migrations, and data recovery.
  • Storage manager 1501 may include a jobs agent 1520 that monitors the status of some or all storage operations previously performed, currently being performed, or scheduled to be performed by storage operation cell 1550. Jobs agent 1520 may be communicatively coupled with an interface agent 1525 (typically a software module or application). Interface agent 1525 may include information processing and display software, such as a graphical user interface (“GUI”), an application program interface (“API”), or other interactive interface through which users and system processes can retrieve information about the status of storage operations. Through interface 1525, users may optionally issue instructions to various storage operation cells 1550 regarding performance of the storage operations as described and contemplated by the present invention. For example, a user may modify a schedule concerning the number of pending snapshot copies or other types of copies scheduled as needed to suit particular needs or requirements. As another example, a user may employ the GUI to view the status of pending storage operations in some or all of the storage operation cells in a given network or to monitor the status of certain components in a particular storage operation cell (e.g., the amount of storage capacity left in a particular storage device).
  • Storage manager 1501 may also include a management agent 1530 that is typically implemented as a software module or application program. In general, management agent 1530 provides an interface that allows various management components 1501 in other storage operation cells 1550 to communicate with one another. For example, assume a certain network configuration includes multiple cells 1550 adjacent to one another or otherwise logically related in a WAN or LAN configuration (not shown). With this arrangement, each cell 1550 may be connected to the other through each respective interface agent 1525. This allows each cell 1550 to send and receive certain pertinent information from other cells 1550 including status information, routing information, information regarding capacity and utilization, etc. These communication paths may also be used to convey information and instructions regarding storage operations.
  • For example, a management agent 1530 in first storage operation cell 1550 may communicate with a management agent 1530 in a second storage operation cell 1550 regarding the status of storage operations in the second storage operation cell. Another illustrative example includes the case where a management agent 1530 in first storage operation cell 1550 communicates with a management agent 1530 in a second storage operation cell to control the storage manager 1501 (and other components) of the second storage operation cell via the management agent 1530 contained in the storage manager 100.
  • Another illustrative example is the case where management agent 130 in the first storage operation cell 1550 communicates directly with and controls the components in the second storage management cell 1550 and bypasses the storage manager 1501 in the second storage management cell. If desired, storage operation cells 1550 can also be organized hierarchically such that hierarchically superior cells control or pass information to hierarchically subordinate cells or vice versa.
  • Storage manager 1501 may also maintain an index, a database, or other data structure 1511. The data stored in database 1511 may be used to indicate logical associations between components of the system, user preferences, management tasks, media containerization and data storage information or other useful data. For example, the storage manager 1501 may use data from database 1511 to track logical associations between media agent 1505 and storage devices 1515 (or movement of data as containerized from primary to secondary storage).
  • Generally speaking, a media agent, which may also be referred to as a secondary storage computing device, 1505 may be implemented as software module that conveys data, as directed by storage manager 1501, between a client computer 1585 and one or more storage devices 1515 such as a tape library, a magnetic media storage device, an optical media storage device, or any other suitable storage device. In one embodiment, secondary computing device 1505 may be communicatively coupled with and control a storage device 1515. A secondary computing device 1505 may be considered to be associated with a particular storage device 1515 if that secondary computing device 1505 is capable of routing and storing data to particular storage device 1515.
  • In operation, a secondary computing device 1505 associated with a particular storage device 1515 may instruct the storage device to use a robotic arm or other retrieval means to load or eject a certain storage media, and to subsequently archive, migrate, or restore data to or from that media. Secondary computing device 1505 may communicate with a storage device 1515 via a suitable communications path such as a SCSI or fiber channel communications link. In some embodiments, the storage device 1515 may be communicatively coupled to a data agent 105 via a Storage Area Network (“SAN”).
  • Each secondary storage computing device 1505 may maintain a index, a database, or other data structure 1506 which may store index data generated during backup, migration, and restore and other storage operations as described herein. For example, performing storage operations on Microsoft Exchange data may generate index data. Such index data provides a secondary computing device 1505 or other external device with a fast and efficient mechanism for locating data stored or backed up. Thus, in some embodiments, a secondary storage computing device index 1506, or a storage manager database 1511, may store data associating a client 1585 with a particular secondary computing device 1505 or storage device 1515, for example, as specified in a storage policy, while a database or other data structure in secondary computing device 1505 may indicate where specifically the client 1585 data is stored in storage device 1515, what specific files were stored, and other information associated with storage of client 1585 data. In some embodiments, such index data may be stored along with the data backed up in a storage device 1515, with an additional copy of the index data written to index cache in a secondary storage device. Thus the data is readily available for use in storage operations and other activities without having to be first retrieved from the storage device 1515.
  • Generally speaking, information stored in cache is typically recent information that reflects certain particulars about operations that have recently occurred. After a certain period of time, this information is sent to secondary storage and tracked. This information may need to be retrieved and uploaded back into a cache or other memory in a secondary computing device before data can be retrieved from storage device 1515. In some embodiments, the cached information may include information regarding format or containerization of archive or other files stored on storage device 1515.
  • In some embodiments, certain components may reside and execute on the same computer. For example, in some embodiments, a client computer 1585 such as a data agent 1595, or a storage manager 1501 coordinates and directs local archiving, migration, and retrieval application functions as further described in U.S. patent application Ser. No. 09/610,738. This client computer 1585 can function independently or together with other similar client computers 1585.
  • Moreover, as shown in FIG. 15, clients 1585 and secondary computing devices 1505 may each have associated metabases (1525 and 1560, respectively). However in some embodiments each “tier” of storage, such as primary storage, secondary storage, tertiary storage, etc., may have multiple metabases or a centralized metabase, as described herein. For example, in FIG. 15, rather than a separate metabase 1525 associated with each client 1585, the metabases on this storage tier may be centralized as discussed further herein. Similarly, second and other tiers of storage may have either centralized or distributed metabases. Moreover, mixed architectures systems may be used if desired, that may include a first tier centralized metabase system coupled to with a second tier storage system having distributed metabases and vice versa, etc.
  • Moreover, in operation, a storage manager 1501 or other management module may keep track of certain information that allows the storage manager to select, designated or otherwise identify metabases to be searched in response to certain queries as further described herein. Movement of data between primary and secondary storage may also involvement movement of associated metadata and other tracking information as further described herein.
  • FIG. 16 is a diagram illustrating one arrangement of data that may be used in constructing an archive file according to one aspect of the invention. As shown, archive file 1600 may include header section 1610, index section 1620 and payload section 1630. Such an archive file may be constructed by a data agent at a client computing device when migrating data, for example, from primary to secondary storage, primary storage to other primary storage, etc. The payload section 1610 may include the data objects that are to be moved from a first location to a second location within the system (e.g., primary to secondary storage). These data objects may be identified by a data agent and designated to be moved pursuant to a storage preference such as a storage policy, a user preference, etc. Header 1610 may include routing and path information that identifies the origin and destination of the payload data and may include other information such as a list of files copied, checksums, etc. Index section 1620 may include certain other information regarding the payload data objects such as size, file type, and any offset or other logical indexing information that may been tracked by a storage management component or other component previously managing the data objects in the payload.
  • In some embodiments, storage managers may index information regarding archive files and related payload by time and storage on certain media so the archive files can be quickly located and/or retrieved. For example, it may be desired to identify certain data based on a query. The query may be analyzed and a certain time frame of interest may be identified. The system may use this information as a basis for a query search of certain index information (e.g., only search for records concerning operations that occurred during a specific time). This streamlines the search and retrieval process by narrowing the universe of data needs to be searched to locate responsive information.
  • FIG. 17 presents a flow chart 1700 that illustrates some of the steps that may be performed in moving data from primary storage to other storage devices within the system. First, at step 1702, a query seeking certain data may be identified. The query may include aspects of data such as a schedule policy, storage policy, storage preference or other preference. The query may be analyzed and a primary metabase searched to identify data objects that satisfy the query (step 1704). This may include parsing the query into constituent parts and analyzing each part alone or in combination with other portions as part of the evaluation process. At step 1706, it may be determined, whether data objects satisfying the query are to be copied to other primary storage devices, to secondary storage devices or both (pursuant to a storage policy, etc.).
  • If at least some data objects satisfying the search criteria are to be copied to other primary storage devices, those data objects may be identified as further described herein and the target primary storage device(s) identified. This may involve consulting a storage policy or storage manager to determine the destination point. In some embodiments, destination maybe determined dynamically, such that it is selected based on certain system preferences or optimization routines that select a storage device based on storage capacity, availability, data paths to the destination, etc.
  • At step 1708 the identified data objects may be copied from primary storage of a first computing device (the source) to primary storage of a second computing device (the target or destination). Any metadata associated with the first computing device describing the copied data may also be copied to a metabase associated with the second computing device such that this description information is not abandoned or lost, but rather travels with the copied data for subsequent use (step 1710).
  • Next, at step 1712, it may be determined whether the copied data objects and associated metadata are to be deleted from the source computing device. For example, this may be done in order to free storage space on the source computer or in accordance with certain data aging or migration criteria. If it is decided to delete the data objects (and associated metadata) the memory locations which include the data may be erased or designated for overwrite (step 1714 and 1716).
  • In some embodiments the data objects may be deleted but certain metadata may be retained. If it is decided not delete the data objects, the data is retained and an index in an associated storage manager may be updated (step 1718), for example by updating an index to reflect a new location, data object status, any changes, etc., and return to step 1702. In other embodiments, if data is deleted from the system, for example, a user permanently deletes certain data from an application, that associated data may also be deleted from both primary and secondary storage devices and associated metabases to free storage space within the system.
  • Returning to step 1706, it is also determined whether certain data objects currently stored in primary storage are to be migrated to one or more secondary storage devices. If so, an archive file similar to the one described in FIG. 16 or other data structure suitable for transport may be constructed or created by the source computing device with identified data objects placed in the payload section and header and index information added (step 1722). Data may be moved from primary to secondary storage in predefined chunks which are constructed from such archive files, for example, using a data pipe, such as the data pipe described in U.S. Pat. No. 6,418,478 titled PIPELINED HIGH SPEED DATA TRANSFER MECHANISM.
  • Next, at step 1724 one or more target secondary storage devices may be identified. This may involve consulting a storage policy or storage manager to determine the destination point. In some embodiments, destination maybe determined dynamically, such that it is selected based on certain system preferences or optimization routines that select a storage device based on storage capacity, availability, data paths to the destination, etc. Once the secondary storage device(s) are identified, the archive files may be routed to a media agent, storage manager, or other system component that supervises the transfer to the target secondary storage device (steps 1724 and 1728). This may involve selecting and appropriate data transfer route and ensuring the proper resources and are available (e.g., bandwidth) such that the data may be copied with a certain period of time. Supervision may further include parsing a copy operation into several portions with each portion being transferred by certain media agent or other resources, etc, to meet system or transfer requirements (e.g., a time window).
  • Next, the appropriate media within the target storage device may be identified (step 1730) and the archive files may be transferred from the media management device to the secondary storage device (step 1732). Such media may be selected from available media already associated with a similar data transfer or may be selected and reserved from an available media pool or scratch pool within the storage device. During or after the transfer, a media agent index or storage manager index associated with the secondary storage device may be updated to reflect the transfer (step 1733). This may include copying the appropriate management files to the media management index such as offset, media ID file name or other management information.
  • At step 1734, any metadata stored in a first metabase associated with the transferred data objects may also be transferred and used to update a second metabase associated with the target secondary storage device. Such metadata may be copied from the first metabase to the second metabase using network transmission resources. In some embodiments, the metadata in the first metabase may be deleted after it is confirmed the metadata has been copied to the second metabase. In other embodiments, the metadata may remain in both first and second metabases.
  • At step 1736, it may be determined whether the data objects transferred from the primary storage device are to be deleted. If so, the data objects and associated metadata in a first metabase may be erased or otherwise designated for overwrite (steps 1738 and 1740). In some cases, a pointer or other reference such as a file stub may be left in the original data location
  • FIG. 18 presents a generalized block diagram of a hierarchically organized group of storage operation cells in a system to perform storage operations on electronic data in a computer network in accordance with an embodiment of the present invention. It will be understood that although the storage operation cells generally depicted in FIG. 18 have different reference numbers than the storage operation cell 1550 shown in FIG. 15, these cells may be configured the same as or similar to the storage cell 1550 as depicted in FIG. 15.
  • As shown, the system illustrated in FIG. 18 may include a master storage manager component 1835 and various other storage operations cells. As shown, the illustrative embodiment in FIG. 18 includes a first storage operation cell 1840, a second storage operation cell 1845, a third storage operation cell 1850, a fourth storage operation cell 1855, and may be extended to include nth storage operation cell, if desired (not shown). However, it will be understood this illustration is only exemplary and that fewer or more storage operation cells may be present or interconnected differently if desired.
  • Storage operation cells, such as the ones shown in FIG. 18 may be communicatively coupled and hierarchically organized. For example, a master storage manager 1835 may be associated with, communicate with, and direct storage operations for a first storage operation cell 1840, a second storage operation cell 1845, a third storage operation cell 1850, and fourth storage operation cell 1855. In some embodiments, the master storage manager 1835 may not be part of any particular storage operation cell. In other embodiments (not shown), master storage manager 1835 may itself be part of a certain storage operation cell. This logical organization provides a framework in which data objects, metadata and other management data may be hierarchically organized and associated with appropriate devices components (e.g., storage devices).
  • The storage operation cells may be configured in any suitable fashion, including those which involve distributed or centralized metabases. For example, storage operation cell 1840 may include a centralized primary storage metabase and a centralized secondary storage metabase, storage operation cell 1845 may include a centralized primary storage metabase and multiple secondary storage metabases, storage operation cell 1850 may include multiple primary storage metabases and a centralized secondary storage metabase, and storage operation cell 1855 may include multiple primary storage metabases and multiple secondary storage metabases (not shown). However, it will be understood that this is merely illustrative, and any other suitable configuration may be used if desired.
  • Thus, in operation, master storage manager 1835 may communicate with a management agent of the storage manager of the first storage operation cell 1840 (or directly with the other components of first cell 1840) with respect to storage operations performed in the first storage operation cell 1840. For example, in some embodiments, master storage manager 1835 may instruct the first storage operation cell 1840 with certain commands regarding a desired storage operation such as how and when to perform particular storage operations including the type of operation and the data on which to perform the operation.
  • Moreover, metabases associated with each storage operation cell may contain information relating to data and storage operations as described herein. In some embodiments, master storage manager 1835 may include a master metabase index or database (not shown) that reflects some or all of the metadata information from the hierarchically subordinate storage operation cells within the system. This allows the system to consult the master storage index or database for information relating to data within those storage operation cells rather than requiring each cell be contacted of polled directly for such information.
  • In other embodiments, master storage manager 1835 may track the status of its associated storage operation cells, such as the status of jobs, system components, system resources, and other items, by communicating with manager agents (or other components) in the respective storage operation cells. Moreover, master storage manager 1835 may track the status of its associated storage operation cells by receiving periodic status updates from the manager agents (or other components) in the respective cells regarding jobs, system components, system resources, and other items. For example, master storage manager 1835 may use methods to monitor network resources such as mapping network pathways and topologies to, among other things, physically monitor storage operations and suggest, for example, alternate routes for storing data as further described herein.
  • In some embodiments, master storage manager 1835 may store status information and other information regarding its associated storage operation cells and other system information in an index cache, database or other data structure accessible to manager 1835. A presentation interface included in certain embodiments of master storage manager 1835 may access this information and present it to users and system processes with information regarding the status of storage operations, storage operation cells, system components, and other information of the system.
  • In some embodiments, master storage manager 1835 may store and/or track metadata and other information regarding its associated storage operation cells and other system information in an index cache, database or other data structure accessible to manager 1835. Thus, during a search procedure as further described herein, queries can be directed to a specific storage operation cell or cells based on the cell's function, past involvement, routing or other information maintained within the storage manager or other management component.
  • As mentioned above, storage operation cells may be organized hierarchically. With this configuration, storage operation cells may inherit properties from hierarchically superior storage operation cells or be controlled by other storage operation cells in the hierarchy (automatically or otherwise). Thus, in the embodiment shown in FIG. 18, storage operation cell 1845 may control or is otherwise hierarchically superior to storage operation cells 1850 and 1855. Similarly, storage operation cell 1850 may control storage operation cells 1855. Alternatively, in some embodiments, storage operation cells may inherit or otherwise be associated with storage policies, storage preferences, storage metrics, or other properties or characteristics according to their relative position in a hierarchy of storage operation cells.
  • Storage operation cells may also be organized hierarchically according to function, geography, architectural considerations, or other factors useful or desirable in performing storage operations. For example, in one embodiment, storage operation cell 1840 may be directed to create snapshot copies of primary copy data, storage operation cell 1845 may be directed to create backup copies of primary copy data or other data. Storage operation cell 1840 may represent a geographic segment of an enterprise, such as a Chicago office, and storage operation cell 1845 may represents a different geographic segment, such as a New York office. In this example, the second storage operation cells 1845, 1850 and 1855 may represent departments within the New York office. Alternatively, these storage operation cells could be further divided by function performing various types of copies for the New York office or load balancing storage operations for the New York office.
  • As another example, and as previously described herein, different storage operation cells directed to different functions may also contain the same or a subset of the same set of physical devices. Thus, one storage operation cell in accordance with the principles of the present invention may be configured to perform SRM operations and may contain the same, similar or a subset of the same physical devices as a cell configured to perform HSM or other types of storage operations. Each storage operation cell may, however, share the same parent or, alternatively, may be located on different branches of a storage operation cell hierarchy tree. For example, storage operation cell 1845 may be directed to SRM operations whereas storage operation cell 1855 may be directed to HSM operations. Those skilled in the art will recognize that a wide variety of such combinations and arrangements of storage operation cells are possible to address a broad range of different aspects of performing storage operations in a hierarchy of storage operation cells.
  • In some embodiments, hierarchical organization of storage operation cells facilitates, among other things, system security and other considerations. For example, in some embodiments, only authorized users may be allowed to access or control certain storage operation cells. For example, a network administrator for an enterprise may have access to many or all storage operation cells including master storage manager 1835. But a network administrator for only the New York office, according to a previous example, may only have access to storage operation cells 1845-1855, which form the New York office storage management system.
  • Moreover, queries performed by the system may be subject to similar restrictions. For example, depending on access privileges, users may be limited or otherwise excluded from searching a certain cell or cells. For example, a user may be limited to searching information in cells or metabases within the system that are unrestricted or to those which specific access rights have been granted. For example, certain users may not have privileges to all information within the system. Accordingly, in some embodiments, as a default setting, users may have access privileges to information in cells that they interact with. Thus, confidential and sensitive information may be selectively restricted except only to certain users with express privileges (e.g., financial or legal information, etc.). For example, certain classification information within the metabases in the system may be restricted and therefore accessed only by those with the proper privileges.
  • Other restrictions on search criteria may include the scope of the search. For example, in a large network with many storage cells may require dedicating significant amounts of resources to perform go global or comprehensive searches. Thus, if a certain resource threshold is exceeded by a proposed search, the system may prompt that search to be modified or otherwise cancelled.
  • In other embodiments master storage manager 1835 may alert a user such as a system administrator when a particular resource is unavailable or congested. For example, a particular storage device might be full or require additional media. For example, a master storage manager may use information from an HSM storage operation cell and an SRM storage operation cell to present indicia or otherwise alert a user or otherwise identify aspects of storage associated with the storage management system and hierarchy of storage operation cells.
  • Alternatively, a storage manager in a particular storage operation cell may be unavailable due to hardware failure, software problems, or other reasons. In some embodiments, master storage manager 1835 (or another storage manager within the hierarchy of storage operation cells) may utilize the global data regarding its associated storage operation cells to suggest solutions to such problems when they occur (or act as a warning prior to occurrence). For example, master storage manager 1835 may alert the user that a storage device in a particular storage operation cell is full or otherwise congested, and then suggest, based on job and data storage information contained in its database, or associated metabase, or an alternate storage device. Other types of corrective actions based an such information may include suggesting an alternate data path to a particular storage device, or dividing data to be stored among various available storage devices as a load balancing measure or to otherwise optimize storage or retrieval time. In some embodiments, such suggestions or corrective actions may be performed automatically, if desired. This may include automatically monitoring the relative health or status of various storage operation cells and searching for information within the cells of the system relating to systems or resource performance within that cell (e.g., index, metabase, database, etc.) for use in diagnostics or for suggesting corrective action.
  • In alternate embodiments, HSM and SRM components may be aware of each other due to a common database or metabase of information that may include normalized data from a plurality of cells. Therefore, in those embodiments there is no need for such information to pass through a master storage manager as these components may be able to communicate directly with one another. For example, storage operation cell 1845 may communicate directly with storage operation cell 1855 and vice versa. This may be accomplished through a direct communications link between the two or by passing data through intermediate cells.
  • Moreover, in some embodiments searches may be performed across a numerous storage cells within the hierarchy. For example, a query may be posed to master storage manager 1835 that may pass the query down through the hierarchy from cells 1840 to 1845 to 1850 and 1855, etc. This may be accomplished by passing the query form one manager component of each cell to another, or from one data classification agent to another, one metabase to another etc. The results may be passed upward through the hierarchy and compiled with other results such that master storage manager 1835 has a complete set of results to report. In other embodiments, each storage manager cell may report results directly to the requestor or to a designated location.
  • FIG. 19 presents a flow chart 1900 that illustrates some of the steps that may be involved in performing searches for data objects across systems that include multiple primary and secondary storage devices. First, at step 1905, a query seeking certain data may be identified (e.g., from a storage policy, user preference, other process, etc.). The query may be analyzed to identify system components, such as clients potentially having information such as certain data objects or metadata that may satisfy the query (e.g., by excluding certain clients that are unlikely to have data being sought based on certain query parameters such as location, time frame, client or other component, department, application type, or any other criteria used to classify data as described herein, etc. (step 1910)). Results may be presented based on a confidence factor indicating the likelihood that the results meet the specified parameters. For example, results substantially satisfying most or all criteria may be listed first with the confidence factors provided based on a percentage of the criteria satisfied (e.g., a query that returned results having three out of four criteria satisfied may be represented with a 75% confidence factor etc.). Less relevant results may be listed subsequently with the confidence factor provided based on any suitable relevant factor such as number of parameters satisfied, how close the match is, etc.
  • The search process may further involve consulting one or more indexes associated with the clients to identify where responsive data objects or other copies of client data, etc., may be located within the system. At step 1915, it may be determined whether client data objects satisfying the query are located in primary storage, secondary storage, or both (e.g., based on index information in a storage manager). This may be based on polling various storage managers or a master storage manager that includes information the covers or represents whole system or the portion of system specified for search.
  • If it is determined that responsive data objects are only located on client(s) in primary storage, that client may be added to the list of clients to be searched (step 1955). If it is determined that responsive data objects are located in secondary storage devices (or other primary storage locations that may be identified), the system may consult a storage manager index to identify archive files (or other files) based on certain query parameters such as a specified point in time, origination point, etc., or on index data stored in a storage manager index identifying archive files or other file associated with the data objects.
  • Next at step 1920, storage managers may be consulted to identify responsive archive files. At step 1925, media management components that may have handled responsive data objects are be identified. This may be based on information retrieved from the storage manager index regarding archive files, e.g., an association of archive files with media agents and media items. It may then be determined whether the identified media management components have metadata relating to the identified archive files available readily available in an index cache (step 1930).
  • This may be accomplished by searching for reference information relating to the identified archive files. If such information is already present in the cache, responsive data objects may be identified and retrieved using the index cache information, which may include, offsets and any file identifiers, etc., by the media management component, and the system may proceed to step 1940 (determine whether another media management component needs to be analyzed).
  • If not, the index information may need to be loaded from the secondary storage device so archive files may be retrieved and accessed. This may involve identifying the particular media on which the index data is stored and upload it to the media management component cache (step 1935). In some embodiments, a master storage manager or other component with information relating to files may be consulted to identify media containing the responsive information. These media may be mounted in drive or other input/output device and examined to locate the proper files or data structures. Index information may then be located and uploaded to an index or database associated with the appropriate media management component (e.g., media agent). This allows the media management component to locate and retrieve specific data objects on the media that satisfy the search criteria.
  • Next, if no further media management components have been identified, a list of media management components to be searched may be compiled (step 1945). At step 1950, a list of clients identified as potentially having responsive data objects may also be compiled. After a complete list of secondary storages devices and clients potentially having responsive data objects is identified, the associated metabases are queried for these components, step 1960, and results are returned indicating data objects that may satisfy the search criteria, step 1965. In some embodiments, these results may be reviewed and analyzed to ensure relevance, with only reasonably relevant or responsive data objects actually being retrieved.
  • FIG. 20 presents a flow chart 2000 that illustrates some of the steps that may be involved in retrieving data objects from secondary storage (or other tiers or other storage locations) in accordance with principles of the present invention. This may be accomplished generally as follows. Certain data (e.g. data objects or associated metadata) from the system may need to be retrieved. That data may be requested and communicated to the system in the form of a query. The query may be used to search the system and identify media on which responsive data may be located. Once located, data satisfying the selection criteria may be uploaded and retrieved and analyzed for relevance, other action may be taken. Or, alternatively, the identified data may be moved to other tiers of storage. More specific steps involved in this process may be as follows.
  • First, at step 2002, a query seeking certain data may be identified. The query may be analyzed to ascertain certain additional information that may assist in identifying responsive information such as identifying a certain point in time to search (step 2004). This may involve consulting storage manager and/or media agent index or database for responsive information relating to a certain point in time. This may also involve consulting certain metabases for similar information that may be associated with these or other media management components providing copy and management functions. Point in time information may be specified by the user or may be assigned by the system absent a specific time frame established by the user. For example, a user may specify a certain time range within the query (e.g., a time range, a certain date, all information related to a project since its inception etc.). The system however, may assign a certain time limit based on the query (e.g., such as based on the specifics of the query (e.g., only have data relating to a certain time frame)), and may limit the search to the time frame of information present in certain metabases, master storage manager, or index within the system, and/or poll or otherwise communicate with storage devices within the system to determine the range or time frame of available data within the system and present the user with options for retrieving it (e.g., some, all within a time frame, etc.)
  • Next, at step 2006 certain archive files may be identified and associated media agents (step 2008) that may have been involved in transferring responsive data objects. This may be determined by consulting a master storage manager or other media management component index or metabase to determine whether the archive files have been handled by such components. Once the appropriate media agents have been identified, it may be determined whether information regarding the identified archive files is present in a cache or index associated with the media agents (step 2010). If not, the index information may need to be uploaded so the appropriate archive files may be retrieved and accessed. This process may be performed until all identified media agents have the appropriate index information loaded and/or until it is determined that no responsive information has been handled by the media agents and therefore no index information need be uploaded.
  • Next, at step 2016 data objects satisfying the query criteria may be identified by searching metabases and/or indexes. In some embodiments, such data objects may be compiled into a list of data objects for present or subsequent retrieval. For example, such a list of responsive data objects may be provided to the user (which may itself satisfy the query) and then provide the user with the option to actually retrieve all or certain selected identified data objects.
  • At step 2018, the new destination for the data objects may be determined. For example, if certain data objects are being migrated off as part of an ILM operation, the query or other information may indicate the intent or reason for the search and the data object's destination. This may be useful in determining whether certain data objects are responsive to search criteria or query. At step 220 it may be determined whether the new destination is primary storage (a restore operation) or secondary or other tier of storage (ILM). Such information may be further useful in determining whether the data objects are likely to fall within a time frame or category of interest and thus may be useful in further identifying data objects of interest.
  • If the identified data objects are moving to other secondary storage tiers, the data objects may be repackaged into form suitable for secondary storage, which may include repackaging into an archive file, converting to a new format, compressing of the data objects and associated files, encryption, or any other containerization technique known in the art (step 2022).
  • Once the data objects are in a suitable format, they may be copied to the appropriate storage destination by the system. This may be accomplished by a media agent or media component in conjunction with a storage manager or other media management component that coordinate routing and the specifics involved with file transfer (step 2024), as further described herein. Metadata relating to the copied data objects may then be copied to a metabase associated with a computing device at the destination (step 2026).
  • For example, metadata relating to the data being copied may be copied along with the data to the secondary storage device and may be copied to an index in the media agent or other media management component involved in the data transfer. This allows the media management component to locate and retrieve and otherwise manage the stored data. Such metadata may also useful when performing searches of secondary storage devices (or other tiers) as further described herein. Metadata stored along with the data on the secondary storage device may be useful to restore or refresh the media agent index in the case of lost or corrupt data and also may be transferred along with the data on storage media in the case whether it is necessary to copy all such data (or actually physically relocate) to another storage device. A master storage manager index or metabase associated with destination computing device may be updated reflecting the arrival and new location of the transferred data objects and/or archive file for system management purposes (step 2034).
  • In some embodiments, the copied data objects and metadata may be deleted from the source location (steps 2028-2032). For example, at step 2028, it may be determined whether the copied data objects should be deleted based user preferences, storage policy requirements or other system constraints such has diminished storage capacity, etc. At steps 2030 and 2032 the data objects and records may be deleted. However, a stub, pointer or other referential element may be placed at the same logical location to act as a marker for the moved data. This allows subsequent operations to quickly track down and locate the moved data at its new location.
  • If, however, at step 2020, it is determined that the identified data objects are moving to primary storage, accordingly, the data objects may be reformatted (e.g., unpacked from archive file format) for copying to a computing device (step 2038). Next the unpacked data may be copied to a target computing device along with any associated metadata (steps 2040 and 2042). For example, this may involve reading metadata and/or index information from the archive file and repopulating the metabase and/or management component indexes with this information as further described herein. For example, metadata from the archive file may be retrieved and integrated into a metabase associated with the target computing device including information relating to data management and as well as certain content and storage information as further described herein with respect to the classification process and metabase population. Thus, such archive information may be fully restored to primary storage and any associated information, such as metabase information may be searched and retrieved accordingly.
  • Moreover, information relating to system management may be uploaded and used to repopulate storage management components within the system such as a storage manager or master storage manager reflecting the return of the retrieved data to primary storage (step 2050). For example, a storage manager index may be updated to reflect the presence of the retrieved data along with certain management information such as logical offsets and location of the retrieved information such that the retrieved information may be located and accessed. Other management components, such as a master storage manager may also be updated with the appropriate identification and location information to reflect the return of the retrieved data within the system.
  • In certain embodiments, the copied data and metadata may be deleted from the source location (steps 2044-2048). For example, at step 2044, it may be determined whether the copied data objects in secondary storage should be deleted based user preferences, storage policy requirements or other system constraints such has diminished storage capacity, etc. At steps 2046 and 2048 the data objects and records may be deleted within the system including any metabase or other system management information associated with the retrieved data. Storage management components such as storage managers, media agents may also be updated to reflect the removal or deletion of such information (step 2050).
  • Systems and modules described herein may comprise software, firmware, hardware, or any combination(s) of software, firmware, or hardware suitable for the purposes described herein. Software and other modules may reside on servers, workstations, personal computers, computerized tablets, personal digital assistants (PDAs), and other devices suitable for the purposes described herein. In other words, the software and other modules described herein may be executed by a general-purpose computer, e.g., a server computer, wireless device or personal computer. Those skilled in the relevant art will appreciate that aspects of the invention can be practiced with other communications, data processing, or computer system configurations, including: Internet appliances, hand-held devices (including PDAs), wearable computers, all manner of cellular or mobile phones, multi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, mainframe computers, and the like. Indeed, the terms “computer,” “server,” “host,” “host system,” and the like are generally used interchangeably herein, and refer to any of the above devices and systems, as well as any data processor. Furthermore, aspects of the invention can be embodied in a special purpose computer or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein.
  • Software and other modules may be accessible via local memory, via a network, via a browser or other application in an ASP context, or via other means suitable for the purposes described herein. Aspects of the invention can also be practiced in distributed computing environments where tasks or modules are performed by remote processing devices, which are linked through a communications network, such as a Local Area Network (LAN), Wide Area Network (WAN), or the Internet. In a distributed computing environment, program modules may be located in both local and remote memory storage devices. Data structures described herein may comprise computer files, variables, programming arrays, programming structures, or any electronic information storage schemes or methods, or any combinations thereof, suitable for the purposes described herein. User interface elements described herein may comprise elements from graphical user interfaces, command line interfaces, and other interfaces suitable for the purposes described herein. Screenshots presented and described herein can be displayed differently as known in the art to input, access, change, manipulate, modify, alter, and work with information.
  • Aspects of the invention may be stored or distributed on computer-readable media, including magnetically or optically readable computer discs, hard-wired or preprogrammed chips (e.g., EEPROM semiconductor chips), nanotechnology memory, biological memory, or other data storage media. Indeed, computer implemented instructions, data structures, screen displays, and other data under aspects of the invention may be distributed over the Internet or over other networks (including wireless networks), on a propagated signal on a propagation medium (e.g., an electromagnetic wave(s), a sound wave, etc.) over a period of time, or they may be provided on any analog or digital network (packet switched, circuit switched, or other scheme).
  • Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to.” As used herein, the terms “connected,” “coupled,” or any variant thereof, means any connection or coupling, either direct or indirect, between two or more elements; the coupling of connection between the elements can be physical, logical, or a combination thereof. Additionally, the words “herein,” “above,” “below,” and words of similar import, when used in this application, shall refer to this application as a whole and not to any particular portions of this application. Where the context permits, words in the above Detailed Description using the singular or plural number may also include the plural or singular number respectively. The word “or,” in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list.
  • The above detailed description of embodiments of the invention is not intended to be exhaustive or to limit the invention to the precise form disclosed above. While specific embodiments of, and examples for, the invention are described above for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize. For example, while processes or blocks are presented in a given order, alternative embodiments may perform routines having steps, or employ systems having blocks, in a different order, and some processes or blocks may be deleted, moved, added, subdivided, combined, and/or modified to provide alternative or subcombinations. Each of these processes or blocks may be implemented in a variety of different ways. Also, while processes or blocks are at times shown as being performed in series, these processes or blocks may instead be performed in parallel, or may be performed at different times.
  • The teachings of the invention provided herein can be applied to other systems, not necessarily the system described above. The elements and acts of the various embodiments described above can be combined to provide further embodiments. Any patents and applications and other references noted above, including any that may be listed in accompanying filing papers, are incorporated herein by reference. Aspects of the invention can be modified, if necessary, to employ the systems, functions, and concepts of the various references described above to provide yet further embodiments of the invention.
  • These and other changes can be made to the invention in light of the above Detailed Description. While the above description describes certain embodiments of the invention, and describes the best mode contemplated, no matter how detailed the above appears in text, the invention can be practiced in many ways. Details of the system and method for classifying and transferring information may vary considerably in its implementation details, while still being encompassed by the invention disclosed herein. As noted above, particular terminology used when describing certain features or aspects of the invention should not be taken to imply that the terminology is being redefined herein to be restricted to any specific characteristics, features, or aspects of the invention with which that terminology is associated. In general, the terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification, unless the above Detailed Description section explicitly defines such terms. Accordingly, the actual scope of the invention encompasses not only the disclosed embodiments, but also all equivalent ways of practicing or implementing the invention under the claims.
  • While certain aspects of the invention are presented below in certain claim forms, the inventors contemplate the various aspects of the invention in any number of claim forms. For example, while only one aspect of the invention is recited as embodied in a computer-readable medium, other aspects may likewise be embodied in a computer-readable medium. Accordingly, the inventors reserve the right to add additional claims after filing the application to pursue such additional claim forms for other aspects of the invention.

Claims (22)

1. A method of accessing documents available through a network, wherein the documents are stored on one or more data storage devices coupled to the network, the method comprising:
receiving a request to access one or more documents;
searching a metabase to locate metadata describing one or more documents satisfying the request based on data classifications stored within the metadata that describe characteristics of the documents;
resolving references in the located metadata to identify one of the one or more data storage devices containing the data, wherein the resolving at least assists in determining which of the more or more data storage devices to access the data from, and wherein the access is at least in part based on a data access criteria; and
providing a signal to access, via the network and in response to the request, the one or more documents at the one or more identified data storage devices.
2. The method of claim 1 wherein the data storage devices comprise network attached storage, and wherein the providing of the signal to access comprises accessing the network attached storage via an open network protocol designed to permit backups over heterogeneous networks.
3. The method of claim 1 wherein the resolving of references determines an availability of the one or more documents at each data storage device, wherein at least one data storage device is magnetic disk, and at least one data storage device is magnetic tape and is less available than the magnetic disk.
4. The method of claim 1 wherein the metabase is distributed across multiple server systems and the searching of the metabase comprises identifying one or more metabases containing metadata describing documents satisfying the request.
5. The method of claim 1 wherein the resolving of references comprises determining which of multiple copies of the document is currently available for access.
6. The method of claim 1 wherein the resolving of references comprises determining at least an access time associated with multiple types of data storage devices, and wherein at least one of the data storage devices has an access time that is less than an access time of another data storage device.
7. The method of claim 1 wherein at least one identified data storage device is network attached storage.
8. The method of claim 1 wherein the data access criteria is based on reducing the impact of the request on a primary data storage device, and wherein the signal to access is provided to a secondary data storage device when the secondary data storage device is available.
9. The method of claim 1 wherein the data classifications identify a type of data storage media used or identify an aging criteria of stored data.
10. A non-transitory computer-readable medium storing instructions that, when implemented by one or more computers, perform a method of accessing documents available through a network, wherein the documents are stored on one or more data storage devices coupled to the network, the method comprising:
receiving a request to access one or more documents;
searching a metabase to locate metadata describing one or more documents satisfying the request based on data classifications stored within the metadata that describe characteristics of the documents;
resolving references in the located metadata to identify one of the one or more data storage devices containing the data, wherein the resolving at least assists in determining which of the more or more data storage devices to access the data from, and wherein the access is at least in part based on a data access criteria; and
providing a signal to access, via the network and in response to the request, the one or more documents at the one or more identified data storage devices.
11. The non-transitory computer-readable medium of claim 10 wherein the data storage devices comprise network attached storage, and wherein the providing of the signal to access comprises accessing the network attached storage via an open network protocol designed to permit backups over heterogeneous networks.
12. The non-transitory computer-readable medium of claim 10 wherein the data access criteria is based on reducing an impact of the request on a primary data storage device, and wherein the signal to access is provided to a secondary data storage device when the secondary data storage device is available.
13. The non-transitory computer-readable medium of claim 10 wherein the resolving of references determines an availability of the one or more documents at each data storage device, wherein at least one data storage device is magnetic disk, and at least one data storage device is magnetic tape and is less available than the magnetic disk.
14. The non-transitory computer-readable medium of claim 10 wherein the metabase is distributed across multiple server systems and the searching of the metabase comprises identifying one or more metabases containing metadata describing documents satisfying the request.
15. The non-transitory computer-readable medium of claim 10 wherein the resolving of references comprises determining which of multiple copies of the document is currently available for access.
16. The non-transitory computer-readable medium of claim 10 wherein the resolving of references comprises determining at least an access time associated with multiple types of data storage devices, and wherein at least one of the data storage devices has an access time that is less than an access time of another data storage device.
17. A method of accessing documents available through a network, wherein the documents are stored on one or more data storage devices coupled to the network, the method comprising:
providing a request to access one or more documents, wherein the provided request results in searching a metabase to locate metadata describing one or more documents satisfying the request based on data classifications,
wherein the data classifications are stored within the metadata, and
wherein the data classifications describe characteristics of the documents; and,
receiving access to the one or more documents, wherein the access is a result of resolving references in the located metadata to identify one of the one or more data storage devices containing the data,
wherein the resolving at least assists in determining which of the more or more data storage devices to access the data from,
wherein the access is at least in part based on a data access criteria, and
wherein the one or more documents are accessed via the network at the one or more identified data storage devices.
18. The method of claim 17 wherein the data storage devices comprise network attached storage, and wherein the providing of the signal to access comprises accessing the network attached storage via an open network protocol designed to permit backups over heterogeneous networks.
19. The method of claim 17 wherein the resolving of references determines an availability of the one or more documents at each data storage device, wherein at least one data storage device is magnetic disk, and at least one data storage device is magnetic tape and is less available than the magnetic disk.
20. The method of claim 17 wherein the metabase is distributed across multiple server systems and the searching of the metabase comprises identifying one or more metabases containing metadata describing documents satisfying the request.
21. The method of claim 17 wherein the resolving of references comprises determining at least an access time associated with multiple types of data storage devices, and wherein at least one of the data storage devices has an access time that is less than an access time of another data storage device.
22. A system for backing up data, comprising:
a means for managing storage of data;
a means for creating a backup of the stored data;
a means for creating one or more copies of the backup using multiple storage devices; and
a means for storing metadata describing an availability of the backup data from the multiple storage devices, wherein the means for storing metadata includes means for tracking interactions with the backup data by components external to the means for storing metadata;
wherein the means for creating one or more copies of the backup creates a secondary copy from a primary copy of the backup; and
wherein the means for creating one or more copies modifies the backup by performing storage operations on the backup before creating the one or more copies.
US12/766,146 2005-11-28 2010-04-23 Systems and methods for classifying and transferring information in a storage network Abandoned US20100205150A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/766,146 US20100205150A1 (en) 2005-11-28 2010-04-23 Systems and methods for classifying and transferring information in a storage network

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US74068605P 2005-11-28 2005-11-28
US75219705P 2005-12-19 2005-12-19
US75219805P 2005-12-19 2005-12-19
US75220105P 2005-12-19 2005-12-19
US75219605P 2005-12-19 2005-12-19
US75220205P 2005-12-19 2005-12-19
US75220305P 2005-12-19 2005-12-19
US11/564,221 US7711700B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US12/766,146 US20100205150A1 (en) 2005-11-28 2010-04-23 Systems and methods for classifying and transferring information in a storage network

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/564,221 Division US7711700B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network

Publications (1)

Publication Number Publication Date
US20100205150A1 true US20100205150A1 (en) 2010-08-12

Family

ID=37989185

Family Applications (36)

Application Number Title Priority Date Filing Date
US11/564,177 Active 2029-02-27 US8271548B2 (en) 2005-11-28 2006-11-28 Systems and methods for using metadata to enhance storage operations
US11/564,130 Expired - Fee Related US7613752B2 (en) 2005-11-28 2006-11-28 Systems and methods for using metadata to enhance data management operations
US11/564,119 Active 2027-03-10 US7668884B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/605,944 Expired - Fee Related US7660807B2 (en) 2005-11-28 2006-11-28 Systems and methods for cataloging metadata for a metabase
US11/564,136 Active 2028-06-06 US7937393B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/605,931 Active 2027-04-17 US7849059B2 (en) 2005-11-28 2006-11-28 Data classification systems and methods for organizing a metabase
US11/564,221 Active 2028-02-15 US7711700B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,197 Active 2028-03-22 US7734593B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/605,932 Active 2027-08-18 US7657550B2 (en) 2005-11-28 2006-11-28 User interfaces and methods for managing data in a metabase
US11/564,174 Active 2029-07-07 US7801864B2 (en) 2005-11-28 2006-11-28 Systems and methods for using metadata to enhance data identification operations
US11/564,163 Active 2028-04-22 US7631151B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/563,940 Active 2028-03-01 US7747579B2 (en) 2005-11-28 2006-11-28 Metabase for facilitating data classification
US11/564,153 Active 2027-04-21 US7660800B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,194 Active 2028-11-08 US7725671B2 (en) 2005-11-28 2006-11-28 System and method for providing redundant access to metadata over a network
US11/564,170 Active 2029-02-18 US7831795B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,180 Abandoned US20070203938A1 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,215 Expired - Fee Related US7707178B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US12/610,931 Active US8131680B2 (en) 2005-11-28 2009-11-02 Systems and methods for using metadata to enhance data management operations
US12/695,289 Expired - Fee Related US7831553B2 (en) 2005-11-28 2010-01-28 Systems and methods for classifying and transferring information in a storage network
US12/695,203 Expired - Fee Related US8051095B2 (en) 2005-11-28 2010-01-28 Systems and methods for classifying and transferring information in a storage network
US12/766,146 Abandoned US20100205150A1 (en) 2005-11-28 2010-04-23 Systems and methods for classifying and transferring information in a storage network
US12/767,939 Active US7831622B2 (en) 2005-11-28 2010-04-27 Systems and methods for classifying and transferring information in a storage network
US12/822,043 Active US8285685B2 (en) 2005-11-28 2010-06-23 Metabase for facilitating data classification
US12/886,487 Active US8131725B2 (en) 2005-11-28 2010-09-20 Systems and methods for using metadata to enhance data identification operations
US12/939,244 Active US8010769B2 (en) 2005-11-28 2010-11-04 Systems and methods for classifying and transferring information in a storage network
US13/077,516 Abandoned US20110178986A1 (en) 2005-11-28 2011-03-31 Systems and methods for classifying and transferring information in a storage network
US13/188,317 Active US8285964B2 (en) 2005-11-28 2011-07-21 Systems and methods for classifying and transferring information in a storage network
US13/411,350 Active US8352472B2 (en) 2005-11-28 2012-03-02 Systems and methods for using metadata to enhance data identification operations
US13/610,691 Active US8725737B2 (en) 2005-11-28 2012-09-11 Systems and methods for using metadata to enhance data identification operations
US13/616,197 Active US8612714B2 (en) 2005-11-28 2012-09-14 Systems and methods for classifying and transferring information in a storage network
US14/102,780 Active US8832406B2 (en) 2005-11-28 2013-12-11 Systems and methods for classifying and transferring information in a storage network
US14/271,756 Active US9098542B2 (en) 2005-11-28 2014-05-07 Systems and methods for using metadata to enhance data identification operations
US14/814,173 Active US9606994B2 (en) 2005-11-28 2015-07-30 Systems and methods for using metadata to enhance data identification operations
US15/456,318 Active US10198451B2 (en) 2005-11-28 2017-03-10 Systems and methods for using metadata to enhance data identification operations
US16/223,596 Active US11256665B2 (en) 2005-11-28 2018-12-18 Systems and methods for using metadata to enhance data identification operations
US17/215,644 Abandoned US20210349856A1 (en) 2005-11-28 2021-03-29 Systems and methods for using metadata to enhance data identification operations

Family Applications Before (20)

Application Number Title Priority Date Filing Date
US11/564,177 Active 2029-02-27 US8271548B2 (en) 2005-11-28 2006-11-28 Systems and methods for using metadata to enhance storage operations
US11/564,130 Expired - Fee Related US7613752B2 (en) 2005-11-28 2006-11-28 Systems and methods for using metadata to enhance data management operations
US11/564,119 Active 2027-03-10 US7668884B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/605,944 Expired - Fee Related US7660807B2 (en) 2005-11-28 2006-11-28 Systems and methods for cataloging metadata for a metabase
US11/564,136 Active 2028-06-06 US7937393B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/605,931 Active 2027-04-17 US7849059B2 (en) 2005-11-28 2006-11-28 Data classification systems and methods for organizing a metabase
US11/564,221 Active 2028-02-15 US7711700B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,197 Active 2028-03-22 US7734593B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/605,932 Active 2027-08-18 US7657550B2 (en) 2005-11-28 2006-11-28 User interfaces and methods for managing data in a metabase
US11/564,174 Active 2029-07-07 US7801864B2 (en) 2005-11-28 2006-11-28 Systems and methods for using metadata to enhance data identification operations
US11/564,163 Active 2028-04-22 US7631151B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/563,940 Active 2028-03-01 US7747579B2 (en) 2005-11-28 2006-11-28 Metabase for facilitating data classification
US11/564,153 Active 2027-04-21 US7660800B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,194 Active 2028-11-08 US7725671B2 (en) 2005-11-28 2006-11-28 System and method for providing redundant access to metadata over a network
US11/564,170 Active 2029-02-18 US7831795B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,180 Abandoned US20070203938A1 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US11/564,215 Expired - Fee Related US7707178B2 (en) 2005-11-28 2006-11-28 Systems and methods for classifying and transferring information in a storage network
US12/610,931 Active US8131680B2 (en) 2005-11-28 2009-11-02 Systems and methods for using metadata to enhance data management operations
US12/695,289 Expired - Fee Related US7831553B2 (en) 2005-11-28 2010-01-28 Systems and methods for classifying and transferring information in a storage network
US12/695,203 Expired - Fee Related US8051095B2 (en) 2005-11-28 2010-01-28 Systems and methods for classifying and transferring information in a storage network

Family Applications After (15)

Application Number Title Priority Date Filing Date
US12/767,939 Active US7831622B2 (en) 2005-11-28 2010-04-27 Systems and methods for classifying and transferring information in a storage network
US12/822,043 Active US8285685B2 (en) 2005-11-28 2010-06-23 Metabase for facilitating data classification
US12/886,487 Active US8131725B2 (en) 2005-11-28 2010-09-20 Systems and methods for using metadata to enhance data identification operations
US12/939,244 Active US8010769B2 (en) 2005-11-28 2010-11-04 Systems and methods for classifying and transferring information in a storage network
US13/077,516 Abandoned US20110178986A1 (en) 2005-11-28 2011-03-31 Systems and methods for classifying and transferring information in a storage network
US13/188,317 Active US8285964B2 (en) 2005-11-28 2011-07-21 Systems and methods for classifying and transferring information in a storage network
US13/411,350 Active US8352472B2 (en) 2005-11-28 2012-03-02 Systems and methods for using metadata to enhance data identification operations
US13/610,691 Active US8725737B2 (en) 2005-11-28 2012-09-11 Systems and methods for using metadata to enhance data identification operations
US13/616,197 Active US8612714B2 (en) 2005-11-28 2012-09-14 Systems and methods for classifying and transferring information in a storage network
US14/102,780 Active US8832406B2 (en) 2005-11-28 2013-12-11 Systems and methods for classifying and transferring information in a storage network
US14/271,756 Active US9098542B2 (en) 2005-11-28 2014-05-07 Systems and methods for using metadata to enhance data identification operations
US14/814,173 Active US9606994B2 (en) 2005-11-28 2015-07-30 Systems and methods for using metadata to enhance data identification operations
US15/456,318 Active US10198451B2 (en) 2005-11-28 2017-03-10 Systems and methods for using metadata to enhance data identification operations
US16/223,596 Active US11256665B2 (en) 2005-11-28 2018-12-18 Systems and methods for using metadata to enhance data identification operations
US17/215,644 Abandoned US20210349856A1 (en) 2005-11-28 2021-03-29 Systems and methods for using metadata to enhance data identification operations

Country Status (4)

Country Link
US (36) US8271548B2 (en)
EP (3) EP2375347A3 (en)
CA (3) CA2631197C (en)
WO (2) WO2007062429A2 (en)

Cited By (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080320259A1 (en) * 2007-06-21 2008-12-25 Garg Vijay K Method for Providing Fault Tolerance to Multiple Servers
US7962455B2 (en) 2005-12-19 2011-06-14 Commvault Systems, Inc. Pathname translation in a data replication system
US7962709B2 (en) 2005-12-19 2011-06-14 Commvault Systems, Inc. Network redirector systems and methods for performing data replication
US20110187861A1 (en) * 2010-02-01 2011-08-04 Beat-Sonic Co., Ltd. Vehicle-mounted surveillance device
US8010769B2 (en) 2005-11-28 2011-08-30 Commvault Systems, Inc. Systems and methods for classifying and transferring information in a storage network
US8024294B2 (en) 2005-12-19 2011-09-20 Commvault Systems, Inc. Systems and methods for performing replication copy storage operations
US8037031B2 (en) 2006-10-17 2011-10-11 Commvault Systems, Inc. Method and system for offline indexing of content and classifying stored data
US8041673B2 (en) 1999-07-15 2011-10-18 Commvault Systems, Inc. Hierarchical systems and methods for performing data storage operations
US8078583B2 (en) 2003-11-13 2011-12-13 Comm Vault Systems, Inc. Systems and methods for performing storage operations using network attached storage
US8086809B2 (en) 2000-01-31 2011-12-27 Commvault Systems, Inc. Interface systems and methods for accessing stored data
US8103829B2 (en) 2003-06-25 2012-01-24 Commvault Systems, Inc. Hierarchical systems and methods for performing storage operations in a computer network
US8103670B2 (en) 2000-01-31 2012-01-24 Commvault Systems, Inc. Systems and methods for retrieving data in a computer network
US8121983B2 (en) 2005-12-19 2012-02-21 Commvault Systems, Inc. Systems and methods for monitoring application data in a data replication system
US8190565B2 (en) 2003-11-13 2012-05-29 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US8204859B2 (en) 2008-12-10 2012-06-19 Commvault Systems, Inc. Systems and methods for managing replicated database data
US8214444B2 (en) 2000-01-31 2012-07-03 Commvault Systems, Inc. Email attachment management in a computer system
US8234249B2 (en) 2006-12-22 2012-07-31 Commvault Systems, Inc. Method and system for searching stored data
US8271830B2 (en) 2005-12-19 2012-09-18 Commvault Systems, Inc. Rolling cache configuration for a data replication system
US8285684B2 (en) 2005-12-19 2012-10-09 Commvault Systems, Inc. Systems and methods for performing data replication
US8290808B2 (en) 2007-03-09 2012-10-16 Commvault Systems, Inc. System and method for automating customer-validated statement of work for a data storage environment
US8352433B2 (en) 1999-07-14 2013-01-08 Commvault Systems, Inc. Modular backup and retrieval system used in conjunction with a storage area network
US8352422B2 (en) 2010-03-30 2013-01-08 Commvault Systems, Inc. Data restore systems and methods in a replication environment
US8356018B2 (en) 2008-01-30 2013-01-15 Commvault Systems, Inc. Systems and methods for grid-based data scanning
WO2013034798A1 (en) * 2011-09-09 2013-03-14 Nokia Corporation Method and apparatus for providing criticality based data backup
US8433679B2 (en) 1999-07-15 2013-04-30 Commvault Systems, Inc. Modular systems and methods for managing data storage operations
US8442983B2 (en) 2009-12-31 2013-05-14 Commvault Systems, Inc. Asynchronous methods of data classification using change journals and other data structures
US8489656B2 (en) 2010-05-28 2013-07-16 Commvault Systems, Inc. Systems and methods for performing data replication
US8504515B2 (en) 2010-03-30 2013-08-06 Commvault Systems, Inc. Stubbing systems and methods in a data replication environment
US8504517B2 (en) 2010-03-29 2013-08-06 Commvault Systems, Inc. Systems and methods for selective data replication
US8655850B2 (en) 2005-12-19 2014-02-18 Commvault Systems, Inc. Systems and methods for resynchronizing information
US8719264B2 (en) 2011-03-31 2014-05-06 Commvault Systems, Inc. Creating secondary copies of data based on searches for content
US8725698B2 (en) 2010-03-30 2014-05-13 Commvault Systems, Inc. Stub file prioritization in a data replication system
US8726242B2 (en) 2006-07-27 2014-05-13 Commvault Systems, Inc. Systems and methods for continuous data replication
US8892523B2 (en) 2012-06-08 2014-11-18 Commvault Systems, Inc. Auto summarization of content
US8930496B2 (en) 2005-12-19 2015-01-06 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US9021198B1 (en) 2011-01-20 2015-04-28 Commvault Systems, Inc. System and method for sharing SAN storage
US9262435B2 (en) 2013-01-11 2016-02-16 Commvault Systems, Inc. Location-based data synchronization management
US9298715B2 (en) 2012-03-07 2016-03-29 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US9342537B2 (en) 2012-04-23 2016-05-17 Commvault Systems, Inc. Integrated snapshot interface for a data storage system
US9448731B2 (en) 2014-11-14 2016-09-20 Commvault Systems, Inc. Unified snapshot storage management
US9471578B2 (en) 2012-03-07 2016-10-18 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US9495251B2 (en) 2014-01-24 2016-11-15 Commvault Systems, Inc. Snapshot readiness checking and reporting
US9495382B2 (en) 2008-12-10 2016-11-15 Commvault Systems, Inc. Systems and methods for performing discrete data replication
US9509652B2 (en) 2006-11-28 2016-11-29 Commvault Systems, Inc. Method and system for displaying similar email messages based on message contents
US9632874B2 (en) 2014-01-24 2017-04-25 Commvault Systems, Inc. Database application backup in single snapshot for multiple applications
US9639426B2 (en) 2014-01-24 2017-05-02 Commvault Systems, Inc. Single snapshot for multiple applications
US9648105B2 (en) 2014-11-14 2017-05-09 Commvault Systems, Inc. Unified snapshot storage management, using an enhanced storage manager and enhanced media agents
US9753812B2 (en) 2014-01-24 2017-09-05 Commvault Systems, Inc. Generating mapping information for single snapshot for multiple applications
US9774672B2 (en) 2014-09-03 2017-09-26 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US9886346B2 (en) 2013-01-11 2018-02-06 Commvault Systems, Inc. Single snapshot for multiple agents
US10042716B2 (en) 2014-09-03 2018-08-07 Commvault Systems, Inc. Consolidated processing of storage-array commands using a forwarder media agent in conjunction with a snapshot-control media agent
US10389810B2 (en) 2016-11-02 2019-08-20 Commvault Systems, Inc. Multi-threaded scanning of distributed file systems
US10503753B2 (en) 2016-03-10 2019-12-10 Commvault Systems, Inc. Snapshot replication operations based on incremental block change tracking
US10540516B2 (en) 2016-10-13 2020-01-21 Commvault Systems, Inc. Data protection within an unsecured storage environment
US10642886B2 (en) 2018-02-14 2020-05-05 Commvault Systems, Inc. Targeted search of backup data using facial recognition
US10732885B2 (en) 2018-02-14 2020-08-04 Commvault Systems, Inc. Block-level live browsing and private writable snapshots using an ISCSI server
US10922189B2 (en) 2016-11-02 2021-02-16 Commvault Systems, Inc. Historical network data-based scanning thread generation
US10984041B2 (en) 2017-05-11 2021-04-20 Commvault Systems, Inc. Natural language processing integrated with database and data storage management
US11042318B2 (en) 2019-07-29 2021-06-22 Commvault Systems, Inc. Block-level data replication
US11159469B2 (en) 2018-09-12 2021-10-26 Commvault Systems, Inc. Using machine learning to modify presentation of mailbox objects
WO2022182911A1 (en) * 2021-02-24 2022-09-01 Nebulon, Inc. Efficient encryption in storage providing data-at-rest encryption and data mirroring
US11442820B2 (en) 2005-12-19 2022-09-13 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US11494417B2 (en) 2020-08-07 2022-11-08 Commvault Systems, Inc. Automated email classification in an information management system
US11809285B2 (en) 2022-02-09 2023-11-07 Commvault Systems, Inc. Protecting a management database of a data storage management system to meet a recovery point objective (RPO)

Families Citing this family (868)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US7581077B2 (en) 1997-10-30 2009-08-25 Commvault Systems, Inc. Method and system for transferring data in a storage operation
US6418478B1 (en) 1997-10-30 2002-07-09 Commvault Systems, Inc. Pipelined high speed data transfer mechanism
US7966078B2 (en) 1999-02-01 2011-06-21 Steven Hoffberg Network media appliance system and method
US20060288297A1 (en) * 1999-08-12 2006-12-21 Robert Haitani System, method and technique for enabling users to interact and edit address fields of messaging applications
US20060288298A1 (en) * 1999-08-12 2006-12-21 Robert Haitani System, method and technique for enabling users to interact with address fields of messaging applications
US7434219B2 (en) 2000-01-31 2008-10-07 Commvault Systems, Inc. Storage of application specific profiles correlating to document versions
WO2003028183A1 (en) 2001-09-28 2003-04-03 Commvault Systems, Inc. System and method for generating and managing quick recovery volumes
EP1442387A4 (en) 2001-09-28 2008-01-23 Commvault Systems Inc System and method for archiving objects in an information store
US8346733B2 (en) 2006-12-22 2013-01-01 Commvault Systems, Inc. Systems and methods of media management, such as management of media to and from a media storage library
AU2003270482A1 (en) 2002-09-09 2004-03-29 Commvault Systems, Inc. Dynamic storage device pooling in a computer system
AU2003267109A1 (en) * 2002-09-13 2004-04-30 Natural Selection, Inc. Intelligently interactive profiling system and method
GB2409553B (en) 2002-09-16 2007-04-04 Commvault Systems Inc System and method for optimizing storage operations
US7568080B2 (en) 2002-10-07 2009-07-28 Commvault Systems, Inc. Snapshot storage and management system with indexing and user interface
WO2004090789A2 (en) 2003-04-03 2004-10-21 Commvault Systems, Inc. System and method for extended media retention
EP1625526B1 (en) 2003-04-03 2012-10-03 Commvault Systems, Inc. System and method for dynamically performing storage operations in a computer network
US7295852B1 (en) 2003-05-01 2007-11-13 Palm, Inc. Automated telephone conferencing method and system
PL1644336T3 (en) 2003-06-06 2011-07-29 Fibrogen Inc Nitrogen-containing heteroaryl compounds and their use in increasing endogeneous erythropoietin
US7996511B1 (en) * 2003-10-28 2011-08-09 Emc Corporation Enterprise-scalable scanning using grid-based architecture with remote agents
US8527618B1 (en) 2004-09-24 2013-09-03 Emc Corporation Repercussionless ephemeral agent for scalable parallel operation of distributed computers
WO2005050385A2 (en) 2003-11-13 2005-06-02 Commvault Systems, Inc. System and method for performing integrated storage operations
GB2425199B (en) 2003-11-13 2007-08-15 Commvault Systems Inc System and method for combining data streams in pipelined storage operations in a storage network
US8190999B2 (en) * 2004-05-20 2012-05-29 International Business Machines Corporation System and method for in-context, topic-oriented instant messaging
US8953908B2 (en) 2004-06-22 2015-02-10 Digimarc Corporation Metadata management and generation using perceptual features
US7809914B2 (en) 2004-11-05 2010-10-05 Commvault Systems, Inc. Methods and system of pooling storage devices
WO2006053050A2 (en) * 2004-11-08 2006-05-18 Commvault Systems, Inc. System and method for performing auxiliary storage operations
US8959299B2 (en) 2004-11-15 2015-02-17 Commvault Systems, Inc. Using a snapshot as a data source
US8775823B2 (en) 2006-12-29 2014-07-08 Commvault Systems, Inc. System and method for encrypting secondary copies of data
US8140786B2 (en) 2006-12-04 2012-03-20 Commvault Systems, Inc. Systems and methods for creating copies of data, such as archive copies
US9195397B2 (en) 2005-04-20 2015-11-24 Axxana (Israel) Ltd. Disaster-proof data recovery
EP2328089B1 (en) * 2005-04-20 2014-07-09 Axxana (Israel) Ltd. Remote data mirroring system
US7640746B2 (en) * 2005-05-27 2010-01-05 Markon Technologies, LLC Method and system integrating solar heat into a regenerative rankine steam cycle
US8184326B2 (en) * 2005-06-22 2012-05-22 Xerox Corpoaration Information dissemination multifunction device
US7966292B1 (en) 2005-06-30 2011-06-21 Emc Corporation Index processing
US8156079B1 (en) 2005-06-30 2012-04-10 Emc Corporation System and method for index processing
US8161005B1 (en) 2005-06-30 2012-04-17 Emc Corporation Efficient index processing
US7680513B2 (en) 2005-08-08 2010-03-16 Palm, Inc. Contact-centric user-interface features for computing devices
US7970743B1 (en) 2005-09-15 2011-06-28 Emc Corporation Retention and disposition of stored content associated with multiple stored objects
US7698325B1 (en) 2005-09-30 2010-04-13 Emc Corporation Index processing for legacy systems
US7627609B1 (en) 2005-09-30 2009-12-01 Emc Corporation Index processing using transformed values
US7752211B1 (en) * 2005-09-30 2010-07-06 Emc Corporation Adaptive index processing
US7912933B2 (en) * 2005-11-29 2011-03-22 Microsoft Corporation Tags for management systems
US7774316B2 (en) * 2005-11-30 2010-08-10 Oracle International Corp. Filesystem snapshot enhancement to improve system performance
US8572330B2 (en) 2005-12-19 2013-10-29 Commvault Systems, Inc. Systems and methods for granular resource management in a storage network
US9009076B2 (en) * 2005-12-19 2015-04-14 Commvault Systems, Inc. Systems and methods for dynamic digital asset resource management
US20070143352A1 (en) * 2005-12-21 2007-06-21 International Business Machines Corporation Method and system for implementing database migration using a staged approach
TWI307026B (en) * 2005-12-30 2009-03-01 Ind Tech Res Inst System and method for storage management
JP4856955B2 (en) * 2006-01-17 2012-01-18 株式会社日立製作所 NAS system and remote copy method
JP2007265384A (en) * 2006-01-31 2007-10-11 Victor Co Of Japan Ltd Structured data storage device, structured data storage program, and structured data storage method
US8645403B2 (en) * 2006-02-03 2014-02-04 Autodesk, Inc. Database-managed rendering
US7818300B1 (en) 2006-03-07 2010-10-19 Emc Corporation Consistent retention and disposition of managed content and associated metadata
US7814063B1 (en) 2006-03-07 2010-10-12 Emc Corporation Retention and disposition of components of a complex stored object
US7594082B1 (en) * 2006-03-07 2009-09-22 Emc Corporation Resolving retention policy conflicts
US20070214183A1 (en) * 2006-03-08 2007-09-13 Omneon Video Networks Methods for dynamic partitioning of a redundant data fabric
US8561146B2 (en) 2006-04-14 2013-10-15 Varonis Systems, Inc. Automatic folder access management
US7870102B2 (en) * 2006-07-12 2011-01-11 International Business Machines Corporation Apparatus and method to store and manage information and meta data
JP4749266B2 (en) * 2006-07-27 2011-08-17 株式会社日立製作所 Backup control apparatus and method without duplication of information resources
US7685199B2 (en) * 2006-07-31 2010-03-23 Microsoft Corporation Presenting information related to topics extracted from event classes
US7849079B2 (en) * 2006-07-31 2010-12-07 Microsoft Corporation Temporal ranking of search results
US7577718B2 (en) * 2006-07-31 2009-08-18 Microsoft Corporation Adaptive dissemination of personalized and contextually relevant information
US8230235B2 (en) 2006-09-07 2012-07-24 International Business Machines Corporation Selective encryption of data stored on removable media in an automated data storage library
US7539783B2 (en) 2006-09-22 2009-05-26 Commvault Systems, Inc. Systems and methods of media management, such as management of media to and from a media storage library, including removable media
US7801862B1 (en) 2006-09-29 2010-09-21 Emc Corporation Retention of complex objects
US7603397B1 (en) 2006-10-03 2009-10-13 Emc Corporation Detecting and managing missing parents between primary and secondary data stores
US7640406B1 (en) 2006-10-03 2009-12-29 Emc Corporation Detecting and managing orphan files between primary and secondary data stores for content addressed storage
US7685177B1 (en) * 2006-10-03 2010-03-23 Emc Corporation Detecting and managing orphan files between primary and secondary data stores
US7599971B1 (en) * 2006-10-03 2009-10-06 Emc Corporation Detecting and managing missing parents between primary and secondary data stores for content addressed storage
US20080086491A1 (en) * 2006-10-04 2008-04-10 Mediatek Inc. Multimedia management and playback apparatus
US9015703B2 (en) 2006-10-17 2015-04-21 Manageiq, Inc. Enforcement of compliance policies in managed virtual systems
US8752045B2 (en) * 2006-10-17 2014-06-10 Manageiq, Inc. Methods and apparatus for using tags to control and manage assets
US9086917B1 (en) 2006-10-17 2015-07-21 Manageiq, Inc. Registering and accessing virtual systems for use in a managed system
US9038062B2 (en) * 2006-10-17 2015-05-19 Manageiq, Inc. Registering and accessing virtual systems for use in a managed system
US8949826B2 (en) * 2006-10-17 2015-02-03 Managelq, Inc. Control and management of virtual systems
US8234641B2 (en) 2006-10-17 2012-07-31 Managelq, Inc. Compliance-based adaptations in managed virtual systems
US8612971B1 (en) 2006-10-17 2013-12-17 Manageiq, Inc. Automatic optimization for virtual systems
US8458695B2 (en) 2006-10-17 2013-06-04 Manageiq, Inc. Automatic optimization for virtual systems
US8234640B1 (en) 2006-10-17 2012-07-31 Manageiq, Inc. Compliance-based adaptations in managed virtual systems
US8949825B1 (en) 2006-10-17 2015-02-03 Manageiq, Inc. Enforcement of compliance policies in managed virtual systems
US9697019B1 (en) 2006-10-17 2017-07-04 Manageiq, Inc. Adapt a virtual machine to comply with system enforced policies and derive an optimized variant of the adapted virtual machine
US8515912B2 (en) 2010-07-15 2013-08-20 Palantir Technologies, Inc. Sharing and deconflicting data changes in a multimaster database system
US8930379B2 (en) * 2006-11-28 2015-01-06 International Business Machines Corporation Merging distributed mail into a unified folder view
US8677091B2 (en) 2006-12-18 2014-03-18 Commvault Systems, Inc. Writing data and storage system specific metadata to network attached storage device
GB0625643D0 (en) * 2006-12-21 2007-01-31 Symbian Software Ltd Sync field filtering
US8312323B2 (en) 2006-12-22 2012-11-13 Commvault Systems, Inc. Systems and methods for remote monitoring in a computer network and reporting a failed migration operation without accessing the data being moved
US7840537B2 (en) 2006-12-22 2010-11-23 Commvault Systems, Inc. System and method for storing redundant information
US8719809B2 (en) 2006-12-22 2014-05-06 Commvault Systems, Inc. Point in time rollback and un-installation of software
US7734669B2 (en) 2006-12-22 2010-06-08 Commvault Systems, Inc. Managing copies of data
US9124602B2 (en) * 2007-01-05 2015-09-01 International Business Machines Corporation Method and apparatus for creating custom access control hierarchies
US20080172636A1 (en) * 2007-01-12 2008-07-17 Microsoft Corporation User interface for selecting members from a dimension
CN101637005B (en) * 2007-01-17 2014-04-09 英特托拉斯技术公司 Methods, systems, and apparatus for fragmented file sharing
US7716186B2 (en) * 2007-01-22 2010-05-11 International Business Machines Corporation Method and system for transparent backup to a hierarchical storage system
US20080181107A1 (en) * 2007-01-30 2008-07-31 Moorthi Jay R Methods and Apparatus to Map and Transfer Data and Properties Between Content-Addressed Objects and Data Files
US20080182665A1 (en) * 2007-01-30 2008-07-31 Microsoft Corporation Video game to web site upload utility
US8540642B2 (en) * 2007-01-31 2013-09-24 Medtronic, Inc. Implantable medical device and method for physiological event monitoring
US8166389B2 (en) * 2007-02-09 2012-04-24 General Electric Company Methods and apparatus for including customized CDA attributes for searching and retrieval
US8868495B2 (en) * 2007-02-21 2014-10-21 Netapp, Inc. System and method for indexing user data on storage systems
ES2730219T3 (en) 2007-02-26 2019-11-08 Microsoft Israel Res And Development 2002 Ltd System and procedure for automatic data protection in a computer network
JP5049618B2 (en) * 2007-03-15 2012-10-17 株式会社日立製作所 Disaster recovery system and method
US20080243769A1 (en) * 2007-03-30 2008-10-02 Symantec Corporation System and method for exporting data directly from deduplication storage to non-deduplication storage
US7827147B1 (en) * 2007-03-30 2010-11-02 Data Center Technologies System and method for automatically redistributing metadata across managers
US8375005B1 (en) * 2007-03-31 2013-02-12 Emc Corporation Rapid restore
US8239925B2 (en) * 2007-04-26 2012-08-07 Varonis Systems, Inc. Evaluating removal of access permissions
US20090043768A1 (en) * 2007-05-03 2009-02-12 Kivati Software, Llc method for differentiating states of n machines
JP4881219B2 (en) * 2007-05-10 2012-02-22 キヤノン株式会社 Information processing apparatus and information processing method
US8688924B2 (en) 2007-06-08 2014-04-01 Sandisk Technologies Inc. Method for improving accuracy of a time estimate from a memory device
US20080307237A1 (en) * 2007-06-08 2008-12-11 Michael Holtzman Method for improving accuracy of a time estimate used to authenticate an entity to a memory device
US8688588B2 (en) * 2007-06-08 2014-04-01 Sandisk Technologies Inc. Method for improving accuracy of a time estimate used in digital rights management (DRM) license validation
US8869288B2 (en) * 2007-06-08 2014-10-21 Sandisk Technologies Inc. Method for using time from a trusted host device
US9509795B2 (en) * 2007-07-20 2016-11-29 Broadcom Corporation Method and system for tagging data with context data tags in a wireless system
US8332575B2 (en) * 2007-06-20 2012-12-11 Samsung Electronics Co., Ltd. Data management systems, methods and computer program products using a phase-change random access memory for selective data maintenance
US8566502B2 (en) * 2008-05-29 2013-10-22 Vmware, Inc. Offloading storage operations to storage hardware using a switch
US8615798B2 (en) * 2007-06-29 2013-12-24 International Business Machines Corporation Optimizing a data deduplication system using client authentication information
US8818936B1 (en) * 2007-06-29 2014-08-26 Emc Corporation Methods, systems, and computer program products for processing read requests received during a protected restore operation
US9298417B1 (en) * 2007-07-25 2016-03-29 Emc Corporation Systems and methods for facilitating management of data
US8060484B2 (en) * 2007-08-07 2011-11-15 International Business Machines Corporation Graphical user interface for data management
US8707070B2 (en) 2007-08-28 2014-04-22 Commvault Systems, Inc. Power management of data processing resources, such as power adaptive management of data storage operations
US8706976B2 (en) 2007-08-30 2014-04-22 Commvault Systems, Inc. Parallel access virtual tape library and drives
KR20090025607A (en) * 2007-09-06 2009-03-11 삼성전자주식회사 Method for updating a metadata of contents and apparatus therefor
US8146098B2 (en) * 2007-09-07 2012-03-27 Manageiq, Inc. Method and apparatus for interfacing with a computer user via virtual thumbnails
US20090076959A1 (en) * 2007-09-11 2009-03-19 Patrick Devaney System and method for brokering ad hoc personal identification transactions between two consenting parties
CA2699565C (en) * 2007-09-20 2014-07-15 C&S Operations, Inc. Computer system with multiple terminals
US8341121B1 (en) * 2007-09-28 2012-12-25 Emc Corporation Imminent failure prioritized backup
US8738669B1 (en) * 2007-10-08 2014-05-27 Emc Corporation Method and apparatus for providing access to data objects within another data object
EP2201456A4 (en) * 2007-10-08 2012-02-15 Axxana Israel Ltd Fast data recovery system
US8438611B2 (en) 2007-10-11 2013-05-07 Varonis Systems Inc. Visualization of access permission status
JP5184041B2 (en) * 2007-10-16 2013-04-17 株式会社バッファロー File system management apparatus and file system management program
US8396838B2 (en) * 2007-10-17 2013-03-12 Commvault Systems, Inc. Legal compliance, electronic discovery and electronic document handling of online and offline copies of data
US7949635B1 (en) * 2007-10-26 2011-05-24 Acronis Inc. Backup server architecture
US8438612B2 (en) * 2007-11-06 2013-05-07 Varonis Systems Inc. Visualization of access permission status
US8418173B2 (en) 2007-11-27 2013-04-09 Manageiq, Inc. Locating an unauthorized virtual machine and bypassing locator code by adjusting a boot pointer of a managed virtual machine in authorized environment
US8407688B2 (en) 2007-11-27 2013-03-26 Managelq, Inc. Methods and apparatus for storing and transmitting historical configuration data associated with information technology assets
US20080172391A1 (en) * 2007-11-28 2008-07-17 The Go Daddy Group, Inc. Multiple format file archiving in an online social community
US20080071901A1 (en) * 2007-11-28 2008-03-20 The Go Daddy Group, Inc. Online business community
US20080065405A1 (en) * 2007-11-28 2008-03-13 The Go Daddy Group, Inc. Sub-communities within an online business community
US20080065406A1 (en) * 2007-11-28 2008-03-13 The Go Daddy Group, Inc. Designating membership in an online business community
US20090150477A1 (en) * 2007-12-07 2009-06-11 Brocade Communications Systems, Inc. Distributed file system optimization using native server functions
US8229895B2 (en) * 2008-01-08 2012-07-24 International Business Machines Corporation Preservation management of digital content
US20090187593A1 (en) * 2008-01-17 2009-07-23 Qualcomm Incorporated Methods and Apparatus for Targeted Media Content Delivery and Acquisition in a Wireless Communication Network
US7890548B2 (en) * 2008-01-22 2011-02-15 International Business Machines Corporation Automation process system and method to upgrade from non-unicode transformation support to unicode data transformation support
US8296301B2 (en) 2008-01-30 2012-10-23 Commvault Systems, Inc. Systems and methods for probabilistic data classification
JP5127489B2 (en) * 2008-02-07 2013-01-23 株式会社東芝 Information life cycle management system, information management server device, electronic medium control device, and program
US8862548B2 (en) * 2008-03-04 2014-10-14 Apple Inc. File system cloning between a target device and a host device
US8219544B2 (en) * 2008-03-17 2012-07-10 International Business Machines Corporation Method and a computer program product for indexing files and searching files
CN101547161B (en) 2008-03-28 2012-09-26 阿里巴巴集团控股有限公司 Folder transmission system, folder transmission device and folder transmission method
US8103628B2 (en) * 2008-04-09 2012-01-24 Harmonic Inc. Directed placement of data in a redundant data storage system
WO2009127492A1 (en) * 2008-04-15 2009-10-22 International Business Machines Corporation A method and system for improved document access
CN101562631A (en) * 2008-04-18 2009-10-21 鸿富锦精密工业(深圳)有限公司 Network memory management unit and method
JP5389902B2 (en) 2008-04-28 2014-01-15 セールスフォース ドット コム インコーポレイティッド An object-oriented system for creating and managing websites and their content
US8078957B2 (en) 2008-05-02 2011-12-13 Microsoft Corporation Document synchronization over stateless protocols
EP2286343A4 (en) * 2008-05-19 2012-02-15 Axxana Israel Ltd Resilient data storage in the presence of replication faults and rolling disasters
JP5183300B2 (en) * 2008-05-28 2013-04-17 株式会社日立製作所 File system migration method, migration computer and program
US8266099B2 (en) * 2008-05-29 2012-09-11 Vmware, Inc. Offloading storage operations to storage hardware using a third party server
US8745336B2 (en) * 2008-05-29 2014-06-03 Vmware, Inc. Offloading storage operations to storage hardware
US8769048B2 (en) 2008-06-18 2014-07-01 Commvault Systems, Inc. Data protection scheduling, such as providing a flexible backup window in a data protection system
US9128883B2 (en) 2008-06-19 2015-09-08 Commvault Systems, Inc Data storage resource allocation by performing abbreviated resource checks based on relative chances of failure of the data storage resources to determine whether data storage requests would fail
US8352954B2 (en) 2008-06-19 2013-01-08 Commvault Systems, Inc. Data storage resource allocation by employing dynamic methods and blacklisting resource request pools
US20090319285A1 (en) * 2008-06-20 2009-12-24 Microsoft Corporation Techniques for managing disruptive business events
US20090319532A1 (en) * 2008-06-23 2009-12-24 Jens-Peter Akelbein Method of and system for managing remote storage
US9098495B2 (en) 2008-06-24 2015-08-04 Commvault Systems, Inc. Application-aware and remote single instance data management
US8219524B2 (en) * 2008-06-24 2012-07-10 Commvault Systems, Inc. Application-aware and remote single instance data management
US8484162B2 (en) 2008-06-24 2013-07-09 Commvault Systems, Inc. De-duplication systems and methods for application-specific data
US7877477B2 (en) * 2008-06-30 2011-01-25 Oracle America, Inc. Method and system for discovering managed systems in a network
US7899898B2 (en) * 2008-06-30 2011-03-01 Oracle America, Inc. Scaling systems management using a stateless proxy
US8904003B2 (en) * 2008-06-30 2014-12-02 Oracle America, Inc. Method and system for delegated job control across a network
US9418110B1 (en) * 2008-06-30 2016-08-16 Emc Corporation Intelligent, scalable, low-overhead mechanism for data retrieval in a distributed network environment
US8335776B2 (en) 2008-07-02 2012-12-18 Commvault Systems, Inc. Distributed indexing system for data storage
US8166263B2 (en) 2008-07-03 2012-04-24 Commvault Systems, Inc. Continuous data protection over intermittent connections, such as continuous data backup for laptops or wireless devices
GB0813397D0 (en) * 2008-07-22 2008-08-27 Watkin Peter M Monitoring of backup activity on a computer system
US8055868B2 (en) * 2008-07-29 2011-11-08 International Business Machines Corporation Apparatus and method to store original point-in-time data
US7991756B2 (en) * 2008-08-12 2011-08-02 International Business Machines Corporation Adding low-latency updateable metadata to a text index
US8307177B2 (en) 2008-09-05 2012-11-06 Commvault Systems, Inc. Systems and methods for management of virtualization data
US8725688B2 (en) 2008-09-05 2014-05-13 Commvault Systems, Inc. Image level copy or restore, such as image level restore without knowledge of data object metadata
US8332368B2 (en) * 2008-09-10 2012-12-11 International Business Machines Corporation Generating information on application tasks for component objects grouped in a composite object
US7890626B1 (en) 2008-09-11 2011-02-15 Gadir Omar M A High availability cluster server for enterprise data management
US20100070474A1 (en) * 2008-09-12 2010-03-18 Lad Kamleshkumar K Transferring or migrating portions of data objects, such as block-level data migration or chunk-based data migration
US20100070466A1 (en) * 2008-09-15 2010-03-18 Anand Prahlad Data transfer techniques within data storage devices, such as network attached storage performing data migration
US20100082700A1 (en) * 2008-09-22 2010-04-01 Riverbed Technology, Inc. Storage system for data virtualization and deduplication
US8255914B1 (en) 2008-09-25 2012-08-28 Emc Corporation Information retrieval techniques involving the use of prioritized object requests
US8073870B2 (en) * 2008-09-25 2011-12-06 Air Products And Chemicals, Inc. Methods for storing data
US9015181B2 (en) 2008-09-26 2015-04-21 Commvault Systems, Inc. Systems and methods for managing single instancing data
AU2009296695B2 (en) * 2008-09-26 2013-08-01 Commvault Systems, Inc. Systems and methods for managing single instancing data
US8239389B2 (en) * 2008-09-29 2012-08-07 International Business Machines Corporation Persisting external index data in a database
WO2010038019A2 (en) * 2008-09-30 2010-04-08 Clearpace Software Limited System and method for data storage
US8589445B2 (en) * 2008-10-21 2013-11-19 Anaplan, Inc. Creating and dynamically maintaining relationships between operational data and output data
CN101727454A (en) * 2008-10-30 2010-06-09 日电(中国)有限公司 Method for automatic classification of objects and system
US20100114832A1 (en) * 2008-10-31 2010-05-06 Lillibridge Mark D Forensic snapshot
US8412677B2 (en) 2008-11-26 2013-04-02 Commvault Systems, Inc. Systems and methods for byte-level or quasi byte-level single instancing
US8943183B2 (en) 2008-12-10 2015-01-27 Commvault Systems, Inc. Decoupled installation of data management systems
US20100161348A1 (en) * 2008-12-19 2010-06-24 Empathic Software Systems Clinical Management System
US8055614B1 (en) * 2008-12-23 2011-11-08 Symantec Corporation Method and apparatus for providing single instance restoration of data files
US9075871B2 (en) * 2008-12-24 2015-07-07 Sap Se Technique to classify data displayed in a user interface based on a user defined classification
US8289694B2 (en) * 2009-01-05 2012-10-16 Axxana (Israel) Ltd. Disaster-proof storage unit having transmission capabilities
US8898267B2 (en) * 2009-01-19 2014-11-25 Netapp, Inc. Modifying information lifecycle management rules in a distributed system
US9454368B2 (en) 2009-01-21 2016-09-27 Vmware, Inc. Data mover permitting data transfer without transferring data between application and operating system
US9218347B2 (en) 2009-02-13 2015-12-22 International Business Machines Corporation System and method for archiving to a single database table information located across multiple tables
US8397051B2 (en) 2009-02-23 2013-03-12 Autonomy, Inc. Hybrid hash tables
US8145598B2 (en) * 2009-02-23 2012-03-27 Iron Mountain Incorporated Methods and systems for single instance storage of asset parts
US9134922B2 (en) 2009-03-12 2015-09-15 Vmware, Inc. System and method for allocating datastores for virtual machines
US8401996B2 (en) 2009-03-30 2013-03-19 Commvault Systems, Inc. Storing a variable number of instances of data objects
AU2010232688C1 (en) 2009-03-31 2014-04-10 Commvault Systems, Inc. Systems and methods for normalizing data of heterogeneous data sources
US8209307B2 (en) 2009-03-31 2012-06-26 Commvault Systems, Inc. Systems and methods for data migration in a clustered file system
US9031914B2 (en) * 2009-04-22 2015-05-12 International Business Machines Corporation Tier-based data management
US20100274750A1 (en) * 2009-04-22 2010-10-28 Microsoft Corporation Data Classification Pipeline Including Automatic Classification Rules
CN101551736B (en) * 2009-05-20 2010-11-03 杭州华三通信技术有限公司 Cache management device and method based on address pointer linked list
US8578120B2 (en) 2009-05-22 2013-11-05 Commvault Systems, Inc. Block-level single instancing
WO2010138728A2 (en) * 2009-05-27 2010-12-02 Graffectivity Llc Systems and methods for assisting persons in storing and retrieving information in an information storage system
US8219526B2 (en) 2009-06-05 2012-07-10 Microsoft Corporation Synchronizing file partitions utilizing a server storage model
US8856140B2 (en) * 2009-06-09 2014-10-07 Microsoft Corporation Querying dialog prompts using hash values
US8166038B2 (en) * 2009-06-11 2012-04-24 Kaufman Mark A Intelligent retrieval of digital assets
US20100333116A1 (en) 2009-06-30 2010-12-30 Anand Prahlad Cloud gateway system for managing data storage to cloud storage sites
US9641334B2 (en) * 2009-07-07 2017-05-02 Varonis Systems, Inc. Method and apparatus for ascertaining data access permission of groups of users to groups of data elements
US8930306B1 (en) 2009-07-08 2015-01-06 Commvault Systems, Inc. Synchronized data deduplication
JP5422298B2 (en) 2009-08-12 2014-02-19 株式会社日立製作所 Hierarchical storage system and storage system operation method
US8448009B2 (en) 2009-08-17 2013-05-21 Sandisk Il Ltd. Method and memory device for generating a time estimate
EP2469803A4 (en) * 2009-08-18 2017-05-17 Fujitsu Limited Information management device, information management method, and information management program
US9092411B2 (en) * 2009-08-18 2015-07-28 Miosoft Corporation Understanding data in data sets
US9256598B1 (en) 2009-08-19 2016-02-09 Emc Corporation Systems, methods, and computer readable media for copy-on-demand optimization for large writes
US8768846B2 (en) * 2009-08-27 2014-07-01 International Business Machines Corporation System, method, and apparatus for management of media objects
US9092500B2 (en) 2009-09-03 2015-07-28 Commvault Systems, Inc. Utilizing snapshots for access to databases and other applications
US8706867B2 (en) * 2011-03-31 2014-04-22 Commvault Systems, Inc. Realtime streaming of multimedia content from secondary storage devices
US8719767B2 (en) 2011-03-31 2014-05-06 Commvault Systems, Inc. Utilizing snapshots to provide builds to developer computing devices
WO2011030324A1 (en) * 2009-09-09 2011-03-17 Varonis Systems, Inc. Enterprise level data management
US8578507B2 (en) 2009-09-09 2013-11-05 Varonis Systems, Inc. Access permissions entitlement review
US10229191B2 (en) 2009-09-09 2019-03-12 Varonis Systems Ltd. Enterprise level data management
US8433682B2 (en) * 2009-12-31 2013-04-30 Commvault Systems, Inc. Systems and methods for analyzing snapshots
CN102025515A (en) 2009-09-14 2011-04-20 阿里巴巴集团控股有限公司 File directory based file transmission method, device and system
US8874628B1 (en) * 2009-10-15 2014-10-28 Symantec Corporation Systems and methods for projecting hierarchical storage management functions
US8370306B1 (en) * 2009-11-13 2013-02-05 Symantec Corporation Systems and methods for recovering from continuous-data-protection blackouts
WO2011067702A1 (en) 2009-12-02 2011-06-09 Axxana (Israel) Ltd. Distributed intelligent network
US9489266B2 (en) * 2009-12-11 2016-11-08 Google Inc. System and method of storing backup image catalog
WO2011082138A1 (en) 2009-12-31 2011-07-07 Commvault Systems, Inc. Systems and methods for performing data management operations using snapshots
DE102010005172B4 (en) * 2010-01-20 2016-01-14 Siemens Aktiengesellschaft Method for operating a medical image data archiving system and archiving system
JP5244831B2 (en) * 2010-01-25 2013-07-24 株式会社日立製作所 Computer system and integrated storage management method
CN102822792B (en) * 2010-01-27 2016-10-26 瓦欧尼斯系统有限公司 Utilize and access and the data management of content information
US8202205B2 (en) * 2010-02-09 2012-06-19 GoBe Healthy, LLC Omni-directional exercise device
US8239390B2 (en) * 2010-02-26 2012-08-07 International Business Machines Corporation Filtered remote journal
WO2011108021A1 (en) * 2010-03-01 2011-09-09 Hitachi,Ltd. File level hierarchical storage management system, method, and apparatus
US20110218883A1 (en) * 2010-03-03 2011-09-08 Daniel-Alexander Billsus Document processing using retrieval path data
US20110219030A1 (en) * 2010-03-03 2011-09-08 Daniel-Alexander Billsus Document presentation using retrieval path data
US20110219029A1 (en) * 2010-03-03 2011-09-08 Daniel-Alexander Billsus Document processing using retrieval path data
US9628722B2 (en) 2010-03-30 2017-04-18 Personify, Inc. Systems and methods for embedding a foreground video into a background feed based on a control input
US8364640B1 (en) * 2010-04-09 2013-01-29 Symantec Corporation System and method for restore of backup data
JP5592493B2 (en) * 2010-04-13 2014-09-17 株式会社日立製作所 Storage network system and control method thereof
US9852150B2 (en) 2010-05-03 2017-12-26 Panzura, Inc. Avoiding client timeouts in a distributed filesystem
US9852149B1 (en) 2010-05-03 2017-12-26 Panzura, Inc. Transferring and caching a cloud file in a distributed filesystem
US9811532B2 (en) 2010-05-03 2017-11-07 Panzura, Inc. Executing a cloud command for a distributed filesystem
US9678981B1 (en) 2010-05-03 2017-06-13 Panzura, Inc. Customizing data management for a distributed filesystem
US9824095B1 (en) 2010-05-03 2017-11-21 Panzura, Inc. Using overlay metadata in a cloud controller to generate incremental snapshots for a distributed filesystem
US9613064B1 (en) 2010-05-03 2017-04-04 Panzura, Inc. Facilitating the recovery of a virtual machine using a distributed filesystem
US9678968B1 (en) 2010-05-03 2017-06-13 Panzura, Inc. Deleting a file from a distributed filesystem
US8805968B2 (en) 2010-05-03 2014-08-12 Panzura, Inc. Accessing cached data from a peer cloud controller in a distributed filesystem
US8799413B2 (en) 2010-05-03 2014-08-05 Panzura, Inc. Distributing data for a distributed filesystem across multiple cloud storage systems
US8799414B2 (en) 2010-05-03 2014-08-05 Panzura, Inc. Archiving data for a distributed filesystem
US9811662B2 (en) 2010-05-03 2017-11-07 Panzura, Inc. Performing anti-virus checks for a distributed filesystem
US9679040B1 (en) 2010-05-03 2017-06-13 Panzura, Inc. Performing deduplication in a distributed filesystem
US8805967B2 (en) 2010-05-03 2014-08-12 Panzura, Inc. Providing disaster recovery for a distributed filesystem
US8341363B2 (en) * 2010-05-03 2012-12-25 Panzura, Inc. Efficient cloud network attached storage
US9792298B1 (en) 2010-05-03 2017-10-17 Panzura, Inc. Managing metadata and data storage for a cloud controller in a distributed filesystem
US8285762B2 (en) * 2010-05-11 2012-10-09 International Business Machines Corporation Migration of metadata and storage management of data in a first storage environment to a second storage environment
US10296596B2 (en) 2010-05-27 2019-05-21 Varonis Systems, Inc. Data tagging
WO2011148375A1 (en) * 2010-05-27 2011-12-01 Varonis Systems, Inc. Automation framework
US10037358B2 (en) 2010-05-27 2018-07-31 Varonis Systems, Inc. Data classification
US8572719B2 (en) 2010-05-28 2013-10-29 Commvault Systems, Inc. Firewall proxy systems and methods in a backup environment
US11449394B2 (en) 2010-06-04 2022-09-20 Commvault Systems, Inc. Failover systems and methods for performing backup operations, including heterogeneous indexing and load balancing of backup and indexing resources
US8504526B2 (en) 2010-06-04 2013-08-06 Commvault Systems, Inc. Failover systems and methods for performing backup operations
US8990167B2 (en) 2010-06-11 2015-03-24 Microsoft Technology Licensing, Llc Multi-faceted metadata storage
US8504684B1 (en) * 2010-06-23 2013-08-06 Emc Corporation Control of data storage system management application activation
US9449007B1 (en) * 2010-06-29 2016-09-20 Emc Corporation Controlling access to XAM metadata
US8495420B2 (en) 2010-07-16 2013-07-23 Commvault Systems, Inc. Registry key federation systems and methods
US8504869B2 (en) 2010-07-16 2013-08-06 Commvault Systems, Inc. Kernel swapping systems and methods for recovering a network device
US8473458B2 (en) * 2010-07-29 2013-06-25 Accenture Global Services Limited Document migration
US8649592B2 (en) 2010-08-30 2014-02-11 University Of Illinois At Urbana-Champaign System for background subtraction with 3D camera
US20120072533A1 (en) * 2010-09-20 2012-03-22 Agco Corporation Dynamic service generation in an agricultural service architecture
US8397022B2 (en) * 2010-09-24 2013-03-12 Dell Products L.P. System and method for optimized data backup
US10339173B2 (en) * 2010-09-27 2019-07-02 Adobe Inc. Content aggregation
US9223892B2 (en) 2010-09-30 2015-12-29 Salesforce.Com, Inc. Device abstraction for page generation
WO2012045023A2 (en) 2010-09-30 2012-04-05 Commvault Systems, Inc. Archiving data objects using secondary copies
US9244779B2 (en) 2010-09-30 2016-01-26 Commvault Systems, Inc. Data recovery operations, such as recovery from modified network data management protocol data
EP2622469B1 (en) 2010-09-30 2019-11-13 Commvault Systems, Inc. Efficient data management improvements, such as docking limited-feature data management modules to a full-featured data management system
US8572340B2 (en) 2010-09-30 2013-10-29 Commvault Systems, Inc. Systems and methods for retaining and using data block signatures in data protection operations
US8364652B2 (en) 2010-09-30 2013-01-29 Commvault Systems, Inc. Content aligned block-based deduplication
US8843452B2 (en) 2010-11-01 2014-09-23 International Business Machines Corporation Utilizing metadata to optimize efficiency for archiving emails
US8516270B2 (en) * 2010-11-18 2013-08-20 Apple Inc. Incremental and bulk storage system
US8886900B2 (en) 2010-11-22 2014-11-11 International Business Machines Corporation Legacy data management
US9336139B2 (en) * 2010-11-29 2016-05-10 Cleversafe, Inc. Selecting a memory for storage of an encoded data slice in a dispersed storage network
US8935360B2 (en) 2010-12-03 2015-01-13 Salesforce.Com, Inc. Techniques for metadata-driven dynamic content serving
US9824091B2 (en) 2010-12-03 2017-11-21 Microsoft Technology Licensing, Llc File system backup using change journal
WO2012078747A1 (en) 2010-12-08 2012-06-14 YottaStor Methods, system, and apparatus for enterprise wide storage and retrieval of large amounts of data
US9384198B2 (en) * 2010-12-10 2016-07-05 Vertafore, Inc. Agency management system and content management system integration
US9208071B2 (en) 2010-12-13 2015-12-08 SanDisk Technologies, Inc. Apparatus, system, and method for accessing memory
US10817502B2 (en) 2010-12-13 2020-10-27 Sandisk Technologies Llc Persistent memory management
US10817421B2 (en) 2010-12-13 2020-10-27 Sandisk Technologies Llc Persistent data structures
US20120150818A1 (en) 2010-12-14 2012-06-14 Commvault Systems, Inc. Client-side repository in a networked deduplicated storage system
US9020900B2 (en) 2010-12-14 2015-04-28 Commvault Systems, Inc. Distributed deduplicated storage system
US8447735B2 (en) * 2010-12-14 2013-05-21 International Business Machines Corporation Backing up data objects identified by search program and corresponding to search query
US8620894B2 (en) 2010-12-21 2013-12-31 Microsoft Corporation Searching files
US9164687B1 (en) * 2011-01-14 2015-10-20 Symantec Corporation Deduplicating messages for improving message sampling quality
US9680839B2 (en) 2011-01-27 2017-06-13 Varonis Systems, Inc. Access permissions management system and method
US8909673B2 (en) 2011-01-27 2014-12-09 Varonis Systems, Inc. Access permissions management system and method
EP2668563A4 (en) 2011-01-27 2015-06-10 Varonis Systems Inc Access permissions management system and method
US8589403B2 (en) * 2011-02-28 2013-11-19 Splunk Inc. Compressed journaling in event tracking files for metadata recovery and replication
US8849768B1 (en) * 2011-03-08 2014-09-30 Symantec Corporation Systems and methods for classifying files as candidates for deduplication
US8407235B2 (en) * 2011-03-09 2013-03-26 Microsoft Corporation Exposing and using metadata and meta-metadata
US9792941B2 (en) * 2011-03-23 2017-10-17 Stormagic Limited Method and system for data replication
US8548961B2 (en) * 2011-03-30 2013-10-01 Splunk Inc. System and method for fast file tracking and change monitoring
US8566336B2 (en) 2011-03-30 2013-10-22 Splunk Inc. File identification management and tracking
US8849762B2 (en) 2011-03-31 2014-09-30 Commvault Systems, Inc. Restoring computing environments, such as autorecovery of file systems at certain points in time
US9449010B2 (en) * 2011-04-02 2016-09-20 Open Invention Network, Llc System and method for managing sensitive data using intelligent mobile agents on a network
CA3089869C (en) * 2011-04-11 2022-08-16 Evertz Microsystems Ltd. Methods and systems for network based video clip generation and management
US9031958B2 (en) 2011-04-18 2015-05-12 International Business Machines Corporation File searching on mobile devices
US9323466B2 (en) 2011-04-27 2016-04-26 Commvault Systems, Inc. System and method for client policy assignment in a data storage system
US8745034B1 (en) 2011-05-04 2014-06-03 Google Inc. Selectively retrieving search results in accordance with predefined sort criteria
JP5691817B2 (en) * 2011-05-12 2015-04-01 富士ゼロックス株式会社 Information processing apparatus and information processing program
US8656253B2 (en) * 2011-06-06 2014-02-18 Cleversafe, Inc. Storing portions of data in a dispersed storage network
US8983911B2 (en) * 2011-06-20 2015-03-17 Microsoft Technology Licensing, Llc Storage media abstraction for uniform data storage
US8650166B1 (en) * 2011-07-11 2014-02-11 Symantec Corporation Systems and methods for classifying files
US9229818B2 (en) 2011-07-20 2016-01-05 Microsoft Technology Licensing, Llc Adaptive retention for backup data
JP6053787B2 (en) 2011-08-03 2016-12-27 アマゾン テクノロジーズ インコーポレイテッド Collect transaction data associated with a locally stored data file
US8849819B2 (en) 2011-08-05 2014-09-30 Deacon Johnson System and method for controlling and organizing metadata associated with on-line content
US8595460B2 (en) 2011-08-26 2013-11-26 Vmware, Inc. Configuring object storage system for input/output operations
US8495064B2 (en) 2011-09-08 2013-07-23 Microsoft Corporation Management of metadata for life cycle assessment data
US20130066838A1 (en) * 2011-09-12 2013-03-14 Microsoft Corporation Efficient data recovery
RU2469388C1 (en) * 2011-09-19 2012-12-10 Российская Федерация, от имени которой выступает Государственная корпорация по атомной энергии "Росатом" - Госкорпорация "Росатом" Method of handling data stored in parallel file system with hierarchical memory organisation
US9223618B2 (en) 2011-09-20 2015-12-29 Intel Corporation Multi-threaded queuing system for pattern matching
US10929040B1 (en) * 2011-09-28 2021-02-23 EMC IP Holding Company LLC RAID 1—half compressed data storage
US8973135B2 (en) 2011-09-29 2015-03-03 Microsoft Technology Licensing, Llc Selectively scanning objects for infection by malware
US9461881B2 (en) 2011-09-30 2016-10-04 Commvault Systems, Inc. Migration of existing computing systems to cloud computing sites or virtual machines
US9372827B2 (en) 2011-09-30 2016-06-21 Commvault Systems, Inc. Migration of an existing computing system to new hardware
US9116633B2 (en) 2011-09-30 2015-08-25 Commvault Systems, Inc. Information management of virtual machines having mapped storage devices
US9514154B2 (en) * 2011-10-27 2016-12-06 International Business Machines Corporation Virtual file system interface for communicating changes of metadata in a data storage system
US8965847B1 (en) * 2011-10-28 2015-02-24 Oxygen Cloud, Inc. Independent synchronization of file data and file metadata
US9122637B1 (en) * 2011-11-01 2015-09-01 Symantec Corporation Systems and methods for enhancing electronic discovery searches
US9110933B1 (en) 2011-11-04 2015-08-18 Google Inc. Processing data triggers in an untrusted environment based on information stored in a trusted environment
US9805054B2 (en) 2011-11-14 2017-10-31 Panzura, Inc. Managing a global namespace for a distributed filesystem
US9804928B2 (en) 2011-11-14 2017-10-31 Panzura, Inc. Restoring an archived file in a distributed filesystem
US9529829B1 (en) * 2011-11-18 2016-12-27 Veritas Technologies Llc System and method to facilitate the use of processed data from a storage system to perform tasks
US9148329B1 (en) 2011-11-30 2015-09-29 Google Inc. Resource constraints for request processing
US20130144844A1 (en) * 2011-12-01 2013-06-06 Hitachi, Ltd. Computer system and file system management method using the same
US8442951B1 (en) 2011-12-07 2013-05-14 International Business Machines Corporation Processing archive content based on hierarchical classification levels
US8930667B2 (en) * 2011-12-13 2015-01-06 International Business Machines Corporation Controlling the placement of data in a storage system
US8818951B1 (en) * 2011-12-29 2014-08-26 Emc Corporation Distributed file system having separate data and metadata and providing a consistent snapshot thereof
US9235524B1 (en) 2011-12-30 2016-01-12 Emc Corporation System and method for improving cache performance
US8930947B1 (en) 2011-12-30 2015-01-06 Emc Corporation System and method for live migration of a virtual machine with dedicated cache
US9009416B1 (en) 2011-12-30 2015-04-14 Emc Corporation System and method for managing cache system content directories
US9104529B1 (en) * 2011-12-30 2015-08-11 Emc Corporation System and method for copying a cache system
US9053033B1 (en) 2011-12-30 2015-06-09 Emc Corporation System and method for cache content sharing
US9158578B1 (en) 2011-12-30 2015-10-13 Emc Corporation System and method for migrating virtual machines
US8627012B1 (en) 2011-12-30 2014-01-07 Emc Corporation System and method for improving cache performance
US9984079B1 (en) * 2012-01-13 2018-05-29 Amazon Technologies, Inc. Managing data storage using storage policy specifications
US10311021B1 (en) * 2012-02-08 2019-06-04 Veritas Technologies Llc Systems and methods for indexing backup file metadata
US20130227352A1 (en) 2012-02-24 2013-08-29 Commvault Systems, Inc. Log monitoring
US9262449B2 (en) 2012-03-08 2016-02-16 Commvault Systems, Inc. Automated, tiered data retention
US8799245B2 (en) 2012-03-08 2014-08-05 Commvault Systems, Inc. Automated, tiered data retention
US20130246553A1 (en) * 2012-03-16 2013-09-19 Empire Technology Development Llc Data migration
US20130253977A1 (en) 2012-03-23 2013-09-26 Commvault Systems, Inc. Automation of data storage activities
US8725663B1 (en) * 2012-03-28 2014-05-13 Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College System, method, and computer program product for data mining applications
US9235607B1 (en) 2012-03-29 2016-01-12 Google Inc. Specifying a predetermined degree of inconsistency for test data
US8950009B2 (en) 2012-03-30 2015-02-03 Commvault Systems, Inc. Information management of data associated with multiple cloud services
US10157184B2 (en) 2012-03-30 2018-12-18 Commvault Systems, Inc. Data previewing before recalling large data files
US9286327B2 (en) 2012-03-30 2016-03-15 Commvault Systems, Inc. Data storage recovery automation
WO2013148096A1 (en) 2012-03-30 2013-10-03 Commvault Systems, Inc. Informaton management of mobile device data
US9020890B2 (en) 2012-03-30 2015-04-28 Commvault Systems, Inc. Smart archiving and data previewing for mobile devices
US9262496B2 (en) 2012-03-30 2016-02-16 Commvault Systems, Inc. Unified access to personal data
US9268916B1 (en) * 2012-03-30 2016-02-23 Emc Corporation Polymorphic application of policy
US8938428B1 (en) 2012-04-16 2015-01-20 Emc Corporation Systems and methods for efficiently locating object names in a large index of records containing object names
US9921752B2 (en) 2012-05-04 2018-03-20 Netapp, Inc. Systems, methods, and computer program products providing read access in a storage system
US8812464B2 (en) * 2012-05-30 2014-08-19 Oracle International Corporation Content management system and method of managing retention and disposition of content items
US9189167B2 (en) 2012-05-31 2015-11-17 Commvault Systems, Inc. Shared library in a data storage system
US8977672B2 (en) 2012-06-08 2015-03-10 Commvault Systems, Inc. Intelligent scheduling for remote computers
US9189170B2 (en) 2012-06-12 2015-11-17 Commvault Systems, Inc. External storage manager for a data storage cell
US20130339310A1 (en) 2012-06-13 2013-12-19 Commvault Systems, Inc. Restore using a client side signature repository in a networked storage system
CN102768676B (en) * 2012-06-14 2014-03-12 腾讯科技(深圳)有限公司 Method and device for processing file with unknown format
US20180336097A1 (en) * 2012-06-25 2018-11-22 International Business Machines Corporation Namespace affinity and failover for processing units in a dispersed storage network
US20140006616A1 (en) * 2012-06-29 2014-01-02 Nokia Corporation Method and apparatus for categorizing application access requests on a device
JP6196671B2 (en) * 2012-07-16 2017-09-13 フィブロジェン インコーポレイテッド Method for producing isoquinoline compound
US20140025796A1 (en) 2012-07-19 2014-01-23 Commvault Systems, Inc. Automated grouping of computing devices in a networked data storage system
US9275086B2 (en) 2012-07-20 2016-03-01 Commvault Systems, Inc. Systems and methods for database archiving
US20140040580A1 (en) 2012-07-31 2014-02-06 Commvault Systems, Inc. Administering a shared, on-line pool of data storage resources for performing data storage operations
US9495301B2 (en) * 2012-08-07 2016-11-15 Dell Products L.P. System and method for utilizing non-volatile memory in a cache
US9549037B2 (en) 2012-08-07 2017-01-17 Dell Products L.P. System and method for maintaining solvency within a cache
GB2504719A (en) 2012-08-07 2014-02-12 Ibm Grid based data mobility
US9852073B2 (en) 2012-08-07 2017-12-26 Dell Products L.P. System and method for data redundancy within a cache
US9026498B2 (en) 2012-08-13 2015-05-05 Commvault Systems, Inc. Lightweight mounting of a secondary copy of file system data
US8938481B2 (en) 2012-08-13 2015-01-20 Commvault Systems, Inc. Generic file level restore from a block-level secondary copy
US9589000B2 (en) * 2012-08-30 2017-03-07 Atheer, Inc. Method and apparatus for content association and history tracking in virtual and augmented reality
US20140074834A1 (en) * 2012-09-13 2014-03-13 Transparent Io, Inc. Storage Block Metadata Tagger
US8886882B2 (en) * 2012-09-14 2014-11-11 Hitachi, Ltd. Method and apparatus of storage tier and cache management
JP5561334B2 (en) * 2012-09-27 2014-07-30 日本電気株式会社 Data transfer device
US9785647B1 (en) 2012-10-02 2017-10-10 Axcient, Inc. File system virtualization
US9081975B2 (en) * 2012-10-22 2015-07-14 Palantir Technologies, Inc. Sharing information between nexuses that use different classification schemes for information access control
US9501761B2 (en) 2012-11-05 2016-11-22 Palantir Technologies, Inc. System and method for sharing investigation results
US9852140B1 (en) 2012-11-07 2017-12-26 Axcient, Inc. Efficient file replication
US20140129546A1 (en) * 2012-11-08 2014-05-08 Callidus Software Incorporated Incremental calculation by auto detection of changes to data
US9460099B2 (en) 2012-11-13 2016-10-04 Amazon Technologies, Inc. Dynamic selection of storage tiers
US9871842B2 (en) 2012-12-08 2018-01-16 Evertz Microsystems Ltd. Methods and systems for network based video clip processing and management
US9229993B2 (en) * 2012-12-19 2016-01-05 Sap Se Processing hybrid co-tenancy in a multi-database cloud
US20140181438A1 (en) 2012-12-21 2014-06-26 Commvault Systems, Inc. Filtered reference copy of secondary storage data in a data storage system
US9311121B2 (en) 2012-12-21 2016-04-12 Commvault Systems, Inc. Archiving virtual machines in a data storage system
US20140181441A1 (en) 2012-12-21 2014-06-26 Commvault Systems, Inc. Identifying files for multiple secondary copy operations using data obtained during backup of primary storage
US9201906B2 (en) 2012-12-21 2015-12-01 Commvault Systems, Inc. Systems and methods to perform data backup in data storage systems
US10379988B2 (en) 2012-12-21 2019-08-13 Commvault Systems, Inc. Systems and methods for performance monitoring
US20140181047A1 (en) 2012-12-21 2014-06-26 Commvault Systems, Inc. Systems and methods to protect deleted files
US20140181046A1 (en) 2012-12-21 2014-06-26 Commvault Systems, Inc. Systems and methods to backup unprotected virtual machines
US9633216B2 (en) 2012-12-27 2017-04-25 Commvault Systems, Inc. Application of information management policies based on operation with a geographic entity
US9069799B2 (en) 2012-12-27 2015-06-30 Commvault Systems, Inc. Restoration of centralized data storage manager, such as data storage manager in a hierarchical data storage system
US10346259B2 (en) 2012-12-28 2019-07-09 Commvault Systems, Inc. Data recovery using a cloud-based remote data recovery center
JP6015438B2 (en) * 2012-12-28 2016-10-26 ブラザー工業株式会社 Printing device
US9633022B2 (en) 2012-12-28 2017-04-25 Commvault Systems, Inc. Backup and restoration for a deduplicated file system
US9378035B2 (en) 2012-12-28 2016-06-28 Commvault Systems, Inc. Systems and methods for repurposing virtual machines
US20140196039A1 (en) 2013-01-08 2014-07-10 Commvault Systems, Inc. Virtual machine categorization system and method
US9804930B2 (en) 2013-01-11 2017-10-31 Commvault Systems, Inc. Partial file restore in a data storage system
US9846620B2 (en) 2013-01-11 2017-12-19 Commvault Systems, Inc. Table level database restore in a data storage system
US9665591B2 (en) 2013-01-11 2017-05-30 Commvault Systems, Inc. High availability distributed deduplicated storage system
US9760444B2 (en) 2013-01-11 2017-09-12 Commvault Systems, Inc. Sharing of secondary storage data
US9495404B2 (en) 2013-01-11 2016-11-15 Commvault Systems, Inc. Systems and methods to process block-level backup for selective file restoration for virtual machines
US9286110B2 (en) 2013-01-14 2016-03-15 Commvault Systems, Inc. Seamless virtual machine recall in a data storage system
US9483489B2 (en) 2013-01-14 2016-11-01 Commvault Systems, Inc. Partial sharing of secondary storage files in a data storage system
US9020945B1 (en) * 2013-01-25 2015-04-28 Humana Inc. User categorization system and method
JP2014170515A (en) * 2013-02-08 2014-09-18 Ricoh Co Ltd Device, information storage program, and information storage method
US9251363B2 (en) 2013-02-20 2016-02-02 Varonis Systems, Inc. Systems and methodologies for controlling access to a file system
US10241870B1 (en) * 2013-02-22 2019-03-26 Veritas Technologies Llc Discovery operations using backup data
US9880776B1 (en) 2013-02-22 2018-01-30 Veritas Technologies Llc Content-driven data protection method for multiple storage devices
US9397907B1 (en) * 2013-03-07 2016-07-19 Axcient, Inc. Protection status determinations for computing devices
US9864755B2 (en) 2013-03-08 2018-01-09 Go Daddy Operating Company, LLC Systems for associating an online file folder with a uniform resource locator
US9459968B2 (en) 2013-03-11 2016-10-04 Commvault Systems, Inc. Single index to query multiple backup formats
US20140281518A1 (en) 2013-03-12 2014-09-18 Commvault Systems, Inc. Multi-tier file restoration
US9110680B1 (en) 2013-03-14 2015-08-18 Amazon Technologies, Inc. Avoiding or deferring data copies
US8819241B1 (en) * 2013-03-14 2014-08-26 State Farm Mutual Automobile Insurance Company System and method for a self service portal and automation for internally hosted virtual server resources
US20140279913A1 (en) * 2013-03-15 2014-09-18 Geoffrey Ray Wehrman File system replication
WO2014147692A1 (en) * 2013-03-18 2014-09-25 株式会社日立製作所 Monitored device, agent program, and monitoring system
US9569476B2 (en) * 2013-04-02 2017-02-14 International Business Machines Corporation Intelligent data routing and storage provisioning
US10785029B2 (en) 2018-10-31 2020-09-22 Nutanix, Inc. Systems and methods for pairing on-premise clusters to clouds using identity service providers
GB2512856A (en) * 2013-04-09 2014-10-15 Ibm Method for file handling in a hierarchical storage environment and corresponding hierarchical storage environment
US9405635B2 (en) 2013-04-16 2016-08-02 Commvault Systems, Inc. Multi-source restore in an information management system
EP2995100B1 (en) * 2013-05-06 2021-07-28 Convida Wireless, LLC Semantics support and management in m2m systems
US9483364B2 (en) 2013-05-08 2016-11-01 Commvault Systems, Inc. Synchronization of local secondary copies with a remote storage management component
US9483558B2 (en) 2013-05-29 2016-11-01 Commvault Systems, Inc. Assessing user performance in a community of users of data storage resources
US9165413B2 (en) * 2013-06-03 2015-10-20 Honda Motor Co., Ltd. Diagnostic assistance
US20140379640A1 (en) * 2013-06-21 2014-12-25 Lexmark International, Inc. Metadata Replication for Non-Dicom Content
EP3014490A4 (en) * 2013-06-24 2017-02-22 K2View Ltd. Cdbms (cloud database management system) distributed logical unit repository
US9424133B2 (en) * 2013-07-10 2016-08-23 Netapp, Inc. Providing an eventually-consistent snapshot of nodes in a storage network
US9483479B2 (en) * 2013-08-12 2016-11-01 Sap Se Main-memory based conceptual framework for file storage and fast data retrieval
US20150074536A1 (en) 2013-09-12 2015-03-12 Commvault Systems, Inc. File manager integration with virtualization in an information management system, including user control and storage management of virtual machines
US9477679B2 (en) * 2013-09-20 2016-10-25 Google Inc. Programmatically choosing preferred storage parameters for files in large-scale distributed storage systems
WO2015056169A1 (en) 2013-10-16 2015-04-23 Axxana (Israel) Ltd. Zero-transaction-loss recovery for database systems
US9489119B1 (en) 2013-10-25 2016-11-08 Theodore Root Smith, Jr. Associative data management system utilizing metadata
US9590886B2 (en) 2013-11-01 2017-03-07 Commvault Systems, Inc. Systems and methods for differential health checking of an information management system
US9507814B2 (en) 2013-12-10 2016-11-29 Vertafore, Inc. Bit level comparator systems and methods
US9485433B2 (en) 2013-12-31 2016-11-01 Personify, Inc. Systems and methods for iterative adjustment of video-capture settings based on identified persona
US9414016B2 (en) 2013-12-31 2016-08-09 Personify, Inc. System and methods for persona identification using combined probability maps
US10324897B2 (en) 2014-01-27 2019-06-18 Commvault Systems, Inc. Techniques for serving archived electronic mail
US10169121B2 (en) 2014-02-27 2019-01-01 Commvault Systems, Inc. Work flow management for an information management system
US9648100B2 (en) 2014-03-05 2017-05-09 Commvault Systems, Inc. Cross-system storage management for transferring data across autonomous information management systems
US9596521B2 (en) 2014-03-13 2017-03-14 Verance Corporation Interactive content acquisition using embedded codes
US10504200B2 (en) 2014-03-13 2019-12-10 Verance Corporation Metadata acquisition using embedded watermarks
US9633026B2 (en) 2014-03-13 2017-04-25 Commvault Systems, Inc. Systems and methods for protecting email data
US9633056B2 (en) 2014-03-17 2017-04-25 Commvault Systems, Inc. Maintaining a deduplication database
US10380072B2 (en) 2014-03-17 2019-08-13 Commvault Systems, Inc. Managing deletions from a deduplication database
US9811427B2 (en) 2014-04-02 2017-11-07 Commvault Systems, Inc. Information management by a media agent in the absence of communications with a storage manager
US9823978B2 (en) 2014-04-16 2017-11-21 Commvault Systems, Inc. User-level quota management of data objects stored in information management systems
US9740574B2 (en) 2014-05-09 2017-08-22 Commvault Systems, Inc. Load balancing across multiple data paths
WO2015172107A1 (en) 2014-05-09 2015-11-12 Nutanix, Inc. Mechanism for providing external access to a secured networked virtualization environment
US10409920B1 (en) * 2014-05-23 2019-09-10 EMC IP Holding Company LLC Data services for tiered memory
US10454778B2 (en) * 2014-06-03 2019-10-22 Box, Inc. Policy-based computation and storage of cloud-based collaboration objects
US9087012B1 (en) 2014-06-04 2015-07-21 Pure Storage, Inc. Disaster recovery at high reliability in a storage cluster
US9563382B2 (en) 2014-06-05 2017-02-07 Sandisk Technologies Llc Methods, systems, and computer readable media for providing flexible host memory buffer
US10652193B2 (en) * 2014-06-18 2020-05-12 Western Digital Technologies, Inc. Managing and accessing data storage systems
US10853356B1 (en) 2014-06-20 2020-12-01 Amazon Technologies, Inc. Persistent metadata catalog
RU2014125412A (en) * 2014-06-24 2015-12-27 Общество С Ограниченной Ответственностью "Яндекс" METHOD FOR PROCESSING SEARCH REQUEST (OPTIONS) AND SERVER (OPTIONS)
RU2014125471A (en) 2014-06-24 2015-12-27 Общество С Ограниченной Ответственностью "Яндекс" SEARCH QUERY PROCESSING METHOD AND SERVER
US20160004605A1 (en) 2014-07-01 2016-01-07 Commvault Systems, Inc. Lightweight data reconstruction based on backup data
US9811677B2 (en) 2014-07-03 2017-11-07 Pure Storage, Inc. Secure data replication in a storage grid
US20160019117A1 (en) 2014-07-16 2016-01-21 Commvault Systems, Inc. Creating customized bootable image for client computing device from backup copy
US20160019317A1 (en) 2014-07-16 2016-01-21 Commvault Systems, Inc. Volume or virtual machine level backup and generating placeholders for virtual machine files
US20160019300A1 (en) * 2014-07-18 2016-01-21 Microsoft Corporation Identifying Files for Data Write Operations
US20160019224A1 (en) 2014-07-18 2016-01-21 Commvault Systems, Inc. File system content archiving based on third-party application archiving rules and metadata
US10031917B2 (en) * 2014-07-29 2018-07-24 Commvault Systems, Inc. Efficient volume-level replication of data via snapshots in an information management system
US9641388B2 (en) 2014-07-29 2017-05-02 Commvault Systems, Inc. Customized deployment in information management systems
US11249858B2 (en) 2014-08-06 2022-02-15 Commvault Systems, Inc. Point-in-time backups of a production application made accessible over fibre channel and/or ISCSI as data sources to a remote application by representing the backups as pseudo-disks operating apart from the production application and its host
US9852026B2 (en) 2014-08-06 2017-12-26 Commvault Systems, Inc. Efficient application recovery in an information management system based on a pseudo-storage-device driver
US10360110B2 (en) 2014-08-06 2019-07-23 Commvault Systems, Inc. Point-in-time backups of a production application made accessible over fibre channel and/or iSCSI as data sources to a remote application by representing the backups as pseudo-disks operating apart from the production application and its host
US9747556B2 (en) 2014-08-20 2017-08-29 Vertafore, Inc. Automated customized web portal template generation systems and methods
US10268584B2 (en) 2014-08-20 2019-04-23 Sandisk Technologies Llc Adaptive host memory buffer (HMB) caching using unassisted hinting
US10007442B2 (en) 2014-08-20 2018-06-26 Sandisk Technologies Llc Methods, systems, and computer readable media for automatically deriving hints from accesses to a storage device and from file system metadata and for optimizing utilization of the storage device based on the hints
US10228854B2 (en) * 2014-08-20 2019-03-12 Sandisk Technologies Llc Storage devices and methods for optimizing use of storage devices based on storage device parsing of file system metadata in host write operations
WO2016028936A1 (en) 2014-08-20 2016-02-25 Verance Corporation Watermark detection using a multiplicity of predicted patterns
US9405928B2 (en) 2014-09-17 2016-08-02 Commvault Systems, Inc. Deriving encryption rules based on file content
US9417968B2 (en) 2014-09-22 2016-08-16 Commvault Systems, Inc. Efficiently restoring execution of a backed up virtual machine based on coordination with virtual-machine-file-relocation operations
US9710465B2 (en) 2014-09-22 2017-07-18 Commvault Systems, Inc. Efficiently restoring execution of a backed up virtual machine based on coordination with virtual-machine-file-relocation operations
US9436555B2 (en) 2014-09-22 2016-09-06 Commvault Systems, Inc. Efficient live-mount of a backed up virtual machine in a storage management system
WO2016048295A1 (en) * 2014-09-24 2016-03-31 Hewlett Packard Enterprise Development Lp Assigning a document to partial membership in communities
JP2016066193A (en) * 2014-09-24 2016-04-28 株式会社リコー Information processing system and information processing method
US9609058B2 (en) 2014-10-13 2017-03-28 Commvault Systems, Inc. Storage management operations based on executable files served on demand to storage management components
US9444811B2 (en) 2014-10-21 2016-09-13 Commvault Systems, Inc. Using an enhanced data agent to restore backed up data across autonomous storage management systems
US9575673B2 (en) 2014-10-29 2017-02-21 Commvault Systems, Inc. Accessing a file system using tiered deduplication
US9547440B2 (en) 2014-11-07 2017-01-17 International Business Machines Corporation Managing a set of blocks in a storage system
US10776209B2 (en) 2014-11-10 2020-09-15 Commvault Systems, Inc. Cross-platform virtual machine backup and replication
US9848046B2 (en) 2014-11-13 2017-12-19 Commvault Systems, Inc. Archiving applications in information management systems
US10417192B2 (en) 2014-11-17 2019-09-17 Red Hat, Inc. File classification in a distributed file system
US9912625B2 (en) 2014-11-18 2018-03-06 Commvault Systems, Inc. Storage and management of mail attachments
US20160142485A1 (en) 2014-11-19 2016-05-19 Commvault Systems, Inc. Migration to cloud storage from backup
US9983936B2 (en) 2014-11-20 2018-05-29 Commvault Systems, Inc. Virtual machine change block tracking
US10474648B2 (en) * 2014-11-25 2019-11-12 Sap Se Migration of unified table metadata graph nodes
US10558495B2 (en) 2014-11-25 2020-02-11 Sap Se Variable sized database dictionary block encoding
US10552402B2 (en) 2014-11-25 2020-02-04 Amarnadh Sai Eluri Database lockless index for accessing multi-version concurrency control data
US10255309B2 (en) 2014-11-25 2019-04-09 Sap Se Versioned insert only hash table for in-memory columnar stores
US9942602B2 (en) 2014-11-25 2018-04-10 Verance Corporation Watermark detection and metadata delivery associated with a primary content
US10725987B2 (en) 2014-11-25 2020-07-28 Sap Se Forced ordering of a dictionary storing row identifier values
US9769543B2 (en) 2014-11-25 2017-09-19 Verance Corporation Enhanced metadata and content delivery using watermarks
US10296611B2 (en) 2014-11-25 2019-05-21 David Wein Optimized rollover processes to accommodate a change in value identifier bit size and related system reload processes
US20160162364A1 (en) 2014-12-03 2016-06-09 Commvault Systems, Inc. Secondary storage pruning
US9632713B2 (en) 2014-12-03 2017-04-25 Commvault Systems, Inc. Secondary storage editor
US9645891B2 (en) 2014-12-04 2017-05-09 Commvault Systems, Inc. Opportunistic execution of secondary copy operations
US9753816B2 (en) 2014-12-05 2017-09-05 Commvault Systems, Inc. Synchronization based on filtered browsing
CN105740303B (en) 2014-12-12 2019-09-06 国际商业机器公司 The method and device of improved object storage
WO2016100916A1 (en) 2014-12-18 2016-06-23 Verance Corporation Service signaling recovery for multimedia content using embedded watermarks
US11567911B2 (en) 2014-12-19 2023-01-31 Sergey Anatol'evich GORISHNIY System and method for management of functionally linked data
US10067959B1 (en) * 2014-12-19 2018-09-04 Amazon Technologies, Inc. Techniques for adapting data storage systems for peaky usage models
US20160210306A1 (en) 2015-01-15 2016-07-21 Commvault Systems, Inc. Managing structured data in a data storage system
US20160210044A1 (en) 2015-01-15 2016-07-21 Commvault Systems, Inc. Intelligent hybrid drive caching
US9588849B2 (en) 2015-01-20 2017-03-07 Commvault Systems, Inc. Synchronizing selected portions of data in a storage management system
US9952934B2 (en) 2015-01-20 2018-04-24 Commvault Systems, Inc. Synchronizing selected portions of data in a storage management system
US10380486B2 (en) * 2015-01-20 2019-08-13 International Business Machines Corporation Classifying entities by behavior
US10108687B2 (en) 2015-01-21 2018-10-23 Commvault Systems, Inc. Database protection using block-level mapping
US9904481B2 (en) 2015-01-23 2018-02-27 Commvault Systems, Inc. Scalable auxiliary copy processing in a storage management system using media agent resources
US9898213B2 (en) 2015-01-23 2018-02-20 Commvault Systems, Inc. Scalable auxiliary copy processing using media agent resources
JP6043819B2 (en) * 2015-01-28 2016-12-14 グリー株式会社 Construction method, program, information processing system, and information processing apparatus
US10685136B1 (en) 2015-02-12 2020-06-16 Wells Fargo Bank, N.A. Systems and methods for secure information storage and sharing
US9971821B1 (en) 2015-02-17 2018-05-15 Cohesity, Inc. Search and analytics for a storage systems
US9575804B2 (en) 2015-03-27 2017-02-21 Commvault Systems, Inc. Job management and resource allocation
US9928144B2 (en) 2015-03-30 2018-03-27 Commvault Systems, Inc. Storage management of data using an open-archive architecture, including streamlined access to primary data originally stored on network-attached storage and archived to secondary storage
US9910742B1 (en) * 2015-03-31 2018-03-06 EMC IP Holding Company LLC System comprising front-end and back-end storage tiers, data mover modules and associated metadata warehouse
US10445289B1 (en) * 2015-03-31 2019-10-15 EMC IP Holding Company LLC Method and apparatus for automatic cleanup of disfavored content
CN104699860A (en) * 2015-04-09 2015-06-10 成都卡莱博尔信息技术有限公司 Data processing and storage method for sharing-type master data
US9483408B1 (en) * 2015-04-09 2016-11-01 International Business Machines Corporation Deferred metadata initialization
US9934265B2 (en) 2015-04-09 2018-04-03 Commvault Systems, Inc. Management of log data
US10339106B2 (en) 2015-04-09 2019-07-02 Commvault Systems, Inc. Highly reusable deduplication database after disaster recovery
US10311150B2 (en) 2015-04-10 2019-06-04 Commvault Systems, Inc. Using a Unix-based file system to manage and serve clones to windows-based computing clients
US9710253B2 (en) 2015-04-16 2017-07-18 Commvault Systems, Inc. Managing a software-patch submission queue
US9904598B2 (en) 2015-04-21 2018-02-27 Commvault Systems, Inc. Content-independent and database management system-independent synthetic full backup of a database based on snapshot technology
US9639286B2 (en) 2015-05-14 2017-05-02 Commvault Systems, Inc. Restore of secondary data using thread pooling
US9563962B2 (en) 2015-05-19 2017-02-07 Personify, Inc. Methods and systems for assigning pixels distance-cost values using a flood fill technique
US9916668B2 (en) 2015-05-19 2018-03-13 Personify, Inc. Methods and systems for identifying background in video data using geometric primitives
US10324914B2 (en) 2015-05-20 2019-06-18 Commvalut Systems, Inc. Handling user queries against production and archive storage systems, such as for enterprise customers having large and/or numerous files
US20160350391A1 (en) 2015-05-26 2016-12-01 Commvault Systems, Inc. Replication using deduplicated secondary copy data
US10379958B2 (en) 2015-06-03 2019-08-13 Axxana (Israel) Ltd. Fast archiving for database systems
CN104915176B (en) * 2015-06-17 2017-12-26 福州瑞芯微电子股份有限公司 Based on priority data in data flow are carried out with the method and system of selection operation
US9563514B2 (en) 2015-06-19 2017-02-07 Commvault Systems, Inc. Assignment of proxies for virtual-machine secondary copy operations including streaming backup jobs
US10084873B2 (en) 2015-06-19 2018-09-25 Commvault Systems, Inc. Assignment of data agent proxies for executing virtual-machine secondary copy operations including streaming backup jobs
US9674361B2 (en) 2015-06-29 2017-06-06 Genesys Telecommunications Laboratories, Inc. System and method for intelligent task management in a workbin
US9823949B2 (en) * 2015-06-29 2017-11-21 Genesys Telecommunications Laboratories, Inc. System and method for intelligent task management and routing
US10740004B2 (en) 2015-07-07 2020-08-11 International Business Machines Corporation Efficiently managing movement of large amounts object data in a storage hierarchy
US9766825B2 (en) 2015-07-22 2017-09-19 Commvault Systems, Inc. Browse and restore for block-level backups
JP6279816B2 (en) * 2015-07-28 2018-02-14 株式会社日立製作所 Storage monitoring system and monitoring method thereof
US9892071B2 (en) 2015-08-03 2018-02-13 Pure Storage, Inc. Emulating a remote direct memory access (‘RDMA’) link between controllers in a storage array
US10192065B2 (en) 2015-08-31 2019-01-29 Commvault Systems, Inc. Automated intelligent provisioning of data storage resources in response to user requests in a data storage management system
US10311042B1 (en) 2015-08-31 2019-06-04 Commvault Systems, Inc. Organically managing primary and secondary storage of a data object based on expiry timeframe supplied by a user of the data object
US10101913B2 (en) 2015-09-02 2018-10-16 Commvault Systems, Inc. Migrating data to disk without interrupting running backup operations
US10133759B1 (en) * 2015-09-15 2018-11-20 Amazon Technologies, Inc. System for determining storage or output of data objects
WO2017048723A1 (en) 2015-09-18 2017-03-23 Commvault Systems, Inc. Data storage management operations in a secondary storage subsystem using image recognition and image-based criteria
US10459801B2 (en) 2015-09-30 2019-10-29 Commvault Systems, Inc. Dynamic triggering of block-level backups based on block change thresholds and corresponding file identities using indexing in a data storage management system
US10678788B2 (en) * 2015-10-22 2020-06-09 Oracle International Corporation Columnar caching in tiered storage
US11657037B2 (en) 2015-10-23 2023-05-23 Oracle International Corporation Query execution against an in-memory standby database
US9600400B1 (en) 2015-10-29 2017-03-21 Vertafore, Inc. Performance testing of web application components using image differentiation
US10353994B2 (en) 2015-11-03 2019-07-16 Commvault Systems, Inc. Summarization of email on a client computing device based on content contribution to an email thread using classification and word frequency considerations
US10394789B1 (en) 2015-12-07 2019-08-27 Amazon Technologies, Inc. Techniques and systems for scalable request handling in data processing systems
US10228962B2 (en) 2015-12-09 2019-03-12 Commvault Systems, Inc. Live synchronization and management of virtual machines across computing and virtualization platforms and using live synchronization to support disaster recovery
US9927997B2 (en) 2015-12-21 2018-03-27 Sandisk Technologies Llc Methods, systems, and computer readable media for automatically and selectively enabling burst mode operation in a storage device
US10387266B2 (en) 2015-12-23 2019-08-20 Commvault Systems, Inc. Application-level live synchronization across computing platforms including synchronizing co-resident applications to disparate standby destinations and selectively synchronizing some applications and not others
US10310953B2 (en) 2015-12-30 2019-06-04 Commvault Systems, Inc. System for redirecting requests after a secondary storage computing device failure
US10235468B2 (en) 2015-12-30 2019-03-19 Business Objects Software Limited Indirect filtering in blended data operations
US10140325B2 (en) * 2015-12-30 2018-11-27 Business Objects Software Limited Data source identification mapping in blended data operations
US10268737B2 (en) 2015-12-30 2019-04-23 Business Objects Software Limited System and method for performing blended data operations
US20170228409A1 (en) * 2016-02-08 2017-08-10 Red Hat, Inc. In-memory journaling
US11669320B2 (en) 2016-02-12 2023-06-06 Nutanix, Inc. Self-healing virtualized file server
US10956192B2 (en) 2016-02-12 2021-03-23 Nutanix, Inc. Entity database historical data
US10684924B2 (en) 2016-02-18 2020-06-16 Commvault Systems, Inc. Data restoration operations based on network path information
US10296368B2 (en) 2016-03-09 2019-05-21 Commvault Systems, Inc. Hypervisor-independent block-level live browse for access to backed up virtual machine (VM) data and hypervisor-free file-level recovery (block-level pseudo-mount)
US10452490B2 (en) 2016-03-09 2019-10-22 Commvault Systems, Inc. Data management and backup of distributed storage environment
US10592350B2 (en) 2016-03-09 2020-03-17 Commvault Systems, Inc. Virtual server cloud file system for virtual machine restore to cloud operations
US10795577B2 (en) 2016-05-16 2020-10-06 Commvault Systems, Inc. De-duplication of client-side data cache for virtual disks
US10846024B2 (en) 2016-05-16 2020-11-24 Commvault Systems, Inc. Global de-duplication of virtual disks in a storage platform
US11218418B2 (en) 2016-05-20 2022-01-04 Nutanix, Inc. Scalable leadership election in a multi-processing computing environment
US10248174B2 (en) 2016-05-24 2019-04-02 Hedvig, Inc. Persistent reservations for virtual disk using multiple targets
US10529099B2 (en) 2016-06-14 2020-01-07 Sap Se Overlay visualizations utilizing data layer
US9883155B2 (en) 2016-06-14 2018-01-30 Personify, Inc. Methods and systems for combining foreground video and background video using chromatic matching
US10560369B2 (en) * 2016-06-23 2020-02-11 Wipro Limited Methods and systems for detecting and transferring defect information during manufacturing processes
US10482068B2 (en) * 2016-06-29 2019-11-19 Salesforce.Com, Inc. Automated systems and techniques to manage cloud-based metadata configurations
JP2018005509A (en) * 2016-06-30 2018-01-11 キヤノン株式会社 Information processing device, control method, and program
US10664447B2 (en) 2016-07-12 2020-05-26 Commvault Systems, Inc. Dynamic management of expandable cache storage for multiple network shares configured in a file server
US10521118B2 (en) 2016-07-13 2019-12-31 Sandisk Technologies Llc Methods, systems, and computer readable media for write classification and aggregation using host memory buffer (HMB)
US10402439B2 (en) 2016-07-29 2019-09-03 Rovi Guides, Inc. Systems and methods for executing a supplemental function for a natural language query
US10305753B2 (en) 2016-08-30 2019-05-28 Red Hat, Inc. Supplementing log messages with metadata
US11860940B1 (en) 2016-09-26 2024-01-02 Splunk Inc. Identifying buckets for query execution using a catalog of buckets
US10353965B2 (en) 2016-09-26 2019-07-16 Splunk Inc. Data fabric service system architecture
US11620336B1 (en) 2016-09-26 2023-04-04 Splunk Inc. Managing and storing buckets to a remote shared storage system based on a collective bucket size
US11093564B1 (en) 2016-09-26 2021-08-17 Splunk Inc. Identifying configuration parameters for a query using a metadata catalog
US10204059B2 (en) * 2016-09-29 2019-02-12 International Business Machines Corporation Memory optimization by phase-dependent data residency
US10747630B2 (en) 2016-09-30 2020-08-18 Commvault Systems, Inc. Heartbeat monitoring of virtual machines for initiating failover operations in a data storage management system, including operations by a master monitor node
US10528485B2 (en) * 2016-09-30 2020-01-07 Intel Corporation Method and apparatus for sharing security metadata memory space
US10296390B2 (en) * 2016-10-14 2019-05-21 International Business Machines Corporation Feedback mechanism for controlling dispatching work tasks in a multi-tier storage environment
US9881207B1 (en) 2016-10-25 2018-01-30 Personify, Inc. Methods and systems for real-time user extraction using deep learning networks
US10152251B2 (en) 2016-10-25 2018-12-11 Commvault Systems, Inc. Targeted backup of virtual machine
US10210048B2 (en) 2016-10-25 2019-02-19 Commvault Systems, Inc. Selective snapshot and backup copy operations for individual virtual machines in a shared storage
US10162528B2 (en) 2016-10-25 2018-12-25 Commvault Systems, Inc. Targeted snapshot based on virtual machine location
US10452672B2 (en) 2016-11-04 2019-10-22 Microsoft Technology Licensing, Llc Enriching data in an isolated collection of resources and relationships
US10481960B2 (en) 2016-11-04 2019-11-19 Microsoft Technology Licensing, Llc Ingress and egress of data using callback notifications
US10614057B2 (en) 2016-11-04 2020-04-07 Microsoft Technology Licensing, Llc Shared processing of rulesets for isolated collections of resources and relationships
US10885114B2 (en) * 2016-11-04 2021-01-05 Microsoft Technology Licensing, Llc Dynamic entity model generation from graph data
US10402408B2 (en) 2016-11-04 2019-09-03 Microsoft Technology Licensing, Llc Versioning of inferred data in an enriched isolated collection of resources and relationships
US11475320B2 (en) 2016-11-04 2022-10-18 Microsoft Technology Licensing, Llc Contextual analysis of isolated collections based on differential ontologies
US11106632B2 (en) 2016-11-16 2021-08-31 Commvault Systems, Inc. Dynamically configuring a proxy server using containerization for concurrent and/or overlapping backup, restore, and/or test operations
KR101956236B1 (en) 2016-11-16 2019-03-11 주식회사 실크로드소프트 Data replication technique in database management system
US10678758B2 (en) 2016-11-21 2020-06-09 Commvault Systems, Inc. Cross-platform virtual machine data and memory backup and replication
US11562034B2 (en) 2016-12-02 2023-01-24 Nutanix, Inc. Transparent referrals for distributed file servers
US10728090B2 (en) 2016-12-02 2020-07-28 Nutanix, Inc. Configuring network segmentation for a virtualization environment
US11568073B2 (en) 2016-12-02 2023-01-31 Nutanix, Inc. Handling permissions for virtualized file servers
US10824455B2 (en) 2016-12-02 2020-11-03 Nutanix, Inc. Virtualized server systems and methods including load balancing for virtualized file servers
US11294777B2 (en) 2016-12-05 2022-04-05 Nutanix, Inc. Disaster recovery for distributed file servers, including metadata fixers
US11288239B2 (en) 2016-12-06 2022-03-29 Nutanix, Inc. Cloning virtualized file servers
US11281484B2 (en) 2016-12-06 2022-03-22 Nutanix, Inc. Virtualized server systems and methods including scaling of file system virtual machines
US10558478B2 (en) 2016-12-15 2020-02-11 Nutanix, Inc. Specification-based computing system configuration
US10887102B2 (en) 2016-12-15 2021-01-05 Nutanix, Inc. Intent framework
CN106874144A (en) * 2016-12-30 2017-06-20 上海中信信息发展股份有限公司 Storage backup policy evaluation method based on electronic record attribute
US10481988B2 (en) * 2017-01-24 2019-11-19 Zerto Ltd. System and method for consistency verification of replicated data in a recovery system
US10848405B2 (en) * 2017-02-08 2020-11-24 Red Hat Israel, Ltd. Reporting progress of operation executing on unreachable host
US10838821B2 (en) 2017-02-08 2020-11-17 Commvault Systems, Inc. Migrating content and metadata from a backup system
US10719495B2 (en) 2017-02-09 2020-07-21 Micron Technology, Inc. Stream selection for multi-stream storage devices
US10706105B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree garbage metrics
US10706106B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree modifications for maintenance operations
US10740193B2 (en) 2017-02-27 2020-08-11 Commvault Systems, Inc. Hypervisor-independent reference copies of virtual machine payload data based on block-level pseudo-mount
US10331624B2 (en) 2017-03-03 2019-06-25 Transitive Innovation, Llc Automated data classification system
US10459666B2 (en) 2017-03-03 2019-10-29 Commvault Systems, Inc. Using storage managers in respective data storage management systems for license distribution, compliance, and updates
US10592326B2 (en) 2017-03-08 2020-03-17 Axxana (Israel) Ltd. Method and apparatus for data loss assessment
US11032350B2 (en) 2017-03-15 2021-06-08 Commvault Systems, Inc. Remote commands framework to control clients
US10949308B2 (en) 2017-03-15 2021-03-16 Commvault Systems, Inc. Application aware backup of virtual machines
US10474542B2 (en) 2017-03-24 2019-11-12 Commvault Systems, Inc. Time-based virtual machine reversion
US10891069B2 (en) 2017-03-27 2021-01-12 Commvault Systems, Inc. Creating local copies of data stored in online data repositories
US11108858B2 (en) 2017-03-28 2021-08-31 Commvault Systems, Inc. Archiving mail servers via a simple mail transfer protocol (SMTP) server
US10613939B2 (en) 2017-03-28 2020-04-07 Commvault Systems, Inc. Backup index generation process
US10776329B2 (en) 2017-03-28 2020-09-15 Commvault Systems, Inc. Migration of a database management system to cloud storage
US10949398B2 (en) 2017-03-29 2021-03-16 Commvault Systems, Inc. Synchronization operations for network-accessible folders
US11074138B2 (en) 2017-03-29 2021-07-27 Commvault Systems, Inc. Multi-streaming backup operations for mailboxes
US10387073B2 (en) 2017-03-29 2019-08-20 Commvault Systems, Inc. External dynamic virtual machine synchronization
US11074140B2 (en) 2017-03-29 2021-07-27 Commvault Systems, Inc. Live browsing of granular mailbox data
US10599527B2 (en) 2017-03-29 2020-03-24 Commvault Systems, Inc. Information management cell health monitoring system
US10552294B2 (en) 2017-03-31 2020-02-04 Commvault Systems, Inc. Management of internet of things devices
US10853195B2 (en) 2017-03-31 2020-12-01 Commvault Systems, Inc. Granular restoration of virtual machine application data
US11221939B2 (en) 2017-03-31 2022-01-11 Commvault Systems, Inc. Managing data from internet of things devices in a vehicle
US11294786B2 (en) 2017-03-31 2022-04-05 Commvault Systems, Inc. Management of internet of things devices
US11010261B2 (en) 2017-03-31 2021-05-18 Commvault Systems, Inc. Dynamically allocating streams during restoration of data
US10853425B2 (en) * 2017-04-20 2020-12-01 Open Text Sa Ulc Systems and methods for managed asset distribution in a distributed heterogeneous storage environment
US10713235B1 (en) * 2017-04-20 2020-07-14 Veritas Technologies Llc Systems and methods for evaluating and storing data items
US10585752B1 (en) * 2017-04-27 2020-03-10 EMC IP Holding Company LLC Intelligent snapshot cataloging using separate logical containers to reduce snapshot query times
US10523677B2 (en) * 2017-04-28 2019-12-31 Versata Development Group, Inc. Managing metadata for external content within a computing environment
US10360099B2 (en) 2017-04-28 2019-07-23 Netapp Inc. Object format resilient to remote object store errors
US10565168B2 (en) * 2017-05-02 2020-02-18 Oxygen Cloud, Inc. Independent synchronization with state transformation
US11416466B2 (en) * 2017-06-02 2022-08-16 Chaossearch, Inc. Data edge platform for improved storage and analytics
US10846285B2 (en) * 2017-06-02 2020-11-24 Chaossearch, Inc. Materialization for data edge platform
US20180357381A1 (en) * 2017-06-09 2018-12-13 Intelligent Medical Objects, Inc. Method and System for Generating Persistent Local Instances of Ontological Mappings
US10664352B2 (en) 2017-06-14 2020-05-26 Commvault Systems, Inc. Live browsing of backed up data residing on cloned disks
US10449670B2 (en) 2017-07-17 2019-10-22 Bank Of America Corporation Event processing using robotic entities
US11481662B1 (en) * 2017-07-31 2022-10-25 Amazon Technologies, Inc. Analysis of interactions with data objects stored by a network-based storage service
US10691738B1 (en) 2017-08-07 2020-06-23 Amdocs Development Limited System, method, and computer program for tagging application data with enrichment information for interpretation and analysis by an analytics system
US10349108B2 (en) 2017-08-24 2019-07-09 Mobitv, Inc. System and method for storing multimedia files using an archive file format
US10903985B2 (en) 2017-08-25 2021-01-26 Keysight Technologies Singapore (Sales) Pte. Ltd. Monitoring encrypted network traffic flows in a virtual environment using dynamic session key acquisition techniques
US10678831B2 (en) * 2017-08-31 2020-06-09 Ca Technologies, Inc. Page journey determination from fingerprint information in web event journals
US10831809B2 (en) * 2017-08-31 2020-11-10 Ca Technologies, Inc. Page journey determination from web event journals
US11263088B2 (en) 2017-09-14 2022-03-01 Commvault Systems, Inc. Distributed architecture for tracking content indexing
US11086834B2 (en) 2017-09-14 2021-08-10 Commvault Systems, Inc. Distributed framework for data proximity-based task splitting in a content indexing system
US10846180B2 (en) 2017-09-14 2020-11-24 Commvault Systems, Inc. Distributed framework for task splitting and task assignments in a content indexing system
US10846266B2 (en) 2017-09-14 2020-11-24 Commvault Systems, Inc. Distributed architecture for content indexing emails
US11036592B2 (en) 2017-09-14 2021-06-15 Commvault Systems, Inc. Distributed content indexing architecture with separately stored file previews
US10803093B2 (en) * 2017-09-22 2020-10-13 Microsoft Technology Licensing, Llc Systems and methods for enabling a file management label to persist on a data file
US11675761B2 (en) 2017-09-30 2023-06-13 Oracle International Corporation Performing in-memory columnar analytic queries on externally resident data
US11574287B2 (en) 2017-10-10 2023-02-07 Text IQ, Inc. Automatic document classification
US11455168B1 (en) 2017-10-19 2022-09-27 Pure Storage, Inc. Batch building for deep learning training workloads
US11494692B1 (en) 2018-03-26 2022-11-08 Pure Storage, Inc. Hyperscale artificial intelligence and machine learning infrastructure
US11861423B1 (en) 2017-10-19 2024-01-02 Pure Storage, Inc. Accelerating artificial intelligence (‘AI’) workflows
US10360214B2 (en) 2017-10-19 2019-07-23 Pure Storage, Inc. Ensuring reproducibility in an artificial intelligence infrastructure
US10671434B1 (en) 2017-10-19 2020-06-02 Pure Storage, Inc. Storage based artificial intelligence infrastructure
US11093338B2 (en) 2017-11-27 2021-08-17 Nutanix, Inc. Emulating high-frequency application-consistent snapshots by forming restore point data sets based on remote site replay of I/O commands
US11442647B2 (en) 2017-11-27 2022-09-13 Nutanix, Inc. Lossless data restore using multiple levels of lightweight snapshots
US11157368B2 (en) 2017-11-27 2021-10-26 Nutanix, Inc. Using snapshots to establish operable portions of computing entities on secondary sites for use on the secondary sites before the computing entity is fully transferred
US10942822B2 (en) 2017-11-27 2021-03-09 Nutanix, Inc. Consistency group restoration from a secondary site
US10635546B2 (en) 2017-12-07 2020-04-28 Commvault Systems, Inc. Synthesizing a restore image from one or more secondary copies to facilitate data restore operations to a file server
US10740300B1 (en) 2017-12-07 2020-08-11 Commvault Systems, Inc. Synchronization of metadata in a distributed storage system
US10742735B2 (en) 2017-12-12 2020-08-11 Commvault Systems, Inc. Enhanced network attached storage (NAS) services interfacing to cloud storage
US10331660B1 (en) * 2017-12-22 2019-06-25 Capital One Services, Llc Generating a data lineage record to facilitate source system and destination system mapping
US20190205056A1 (en) * 2017-12-28 2019-07-04 RackTop Systems, Inc. Transparent data movement between a private cloud and storage ecosystem and another storage system
US10831591B2 (en) 2018-01-11 2020-11-10 Commvault Systems, Inc. Remedial action based on maintaining process awareness in data storage management
US11782882B2 (en) * 2018-01-22 2023-10-10 Jpmorgan Chase Bank, N.A. Methods for automated artifact storage management and devices thereof
US11119993B2 (en) 2018-01-30 2021-09-14 Salesforce.Com, Inc. Referential data migration system
US10795927B2 (en) 2018-02-05 2020-10-06 Commvault Systems, Inc. On-demand metadata extraction of clinical image data
US11074099B2 (en) 2018-02-06 2021-07-27 Nutanix, Inc. System and method for storage during virtual machine migration
JP2019139628A (en) * 2018-02-14 2019-08-22 富士ゼロックス株式会社 Information processing device, information processing system and program
US10592145B2 (en) 2018-02-14 2020-03-17 Commvault Systems, Inc. Machine learning-based data object storage
US11157510B2 (en) 2018-02-28 2021-10-26 Chaossearch, Inc. Data normalization using data edge platform
US10848468B1 (en) 2018-03-05 2020-11-24 Commvault Systems, Inc. In-flight data encryption/decryption for a distributed storage platform
US10877928B2 (en) 2018-03-07 2020-12-29 Commvault Systems, Inc. Using utilities injected into cloud-based virtual machines for speeding up virtual machine backup operations
US10761942B2 (en) 2018-03-12 2020-09-01 Commvault Systems, Inc. Recovery point objective (RPO) driven backup scheduling in a data storage management system using an enhanced data agent
US10789387B2 (en) 2018-03-13 2020-09-29 Commvault Systems, Inc. Graphical representation of an information management system
US10831521B2 (en) 2018-04-27 2020-11-10 Nutanix, Inc. Efficient metadata management
US10839093B2 (en) 2018-04-27 2020-11-17 Nutanix, Inc. Low latency access to physical storage locations by implementing multiple levels of metadata
US11086826B2 (en) 2018-04-30 2021-08-10 Nutanix, Inc. Virtualized server systems and methods including domain joining techniques
US11334543B1 (en) 2018-04-30 2022-05-17 Splunk Inc. Scalable bucket merging for a data intake and query system
US11238049B1 (en) * 2018-04-30 2022-02-01 Splunk Inc. Revising catalog metadata based on parsing queries
US11249863B2 (en) 2018-05-02 2022-02-15 Commvault Systems, Inc. Backup-based media agent configuration
US10628267B2 (en) 2018-05-02 2020-04-21 Commvault Systems, Inc. Client managed data backup process within an enterprise information management system
US10673943B2 (en) 2018-05-02 2020-06-02 Commvault Systems, Inc. Network storage backup using distributed media agents
US11321183B2 (en) 2018-05-02 2022-05-03 Commvault Systems, Inc. Multi-tiered backup indexing
US11226974B2 (en) 2018-05-10 2022-01-18 Sap Se Remote data blending
US11301421B2 (en) 2018-05-25 2022-04-12 Microsoft Technology Licensing, Llc Scalable multi-tier storage structures and techniques for accessing entries therein
US10817333B2 (en) 2018-06-26 2020-10-27 Nutanix, Inc. Managing memory in devices that host virtual machines and have shared memory
US10868782B2 (en) 2018-07-12 2020-12-15 Bank Of America Corporation System for flagging data transmissions for retention of metadata and triggering appropriate transmission placement
US10936435B2 (en) * 2018-07-13 2021-03-02 EMC IP Holding Company LLC Automatically setting a dynamic backup policy in a cloud environment
US11194680B2 (en) 2018-07-20 2021-12-07 Nutanix, Inc. Two node clusters recovery on a failure
US10893103B2 (en) 2018-07-25 2021-01-12 Commvault Systems, Inc. Distributed and scalable storage management using a storage-microservices server
US10891304B2 (en) 2018-07-25 2021-01-12 Commvault Systems, Inc. Distributed and scalable client-based storage management
US10891198B2 (en) 2018-07-30 2021-01-12 Commvault Systems, Inc. Storing data to cloud libraries in cloud native formats
US11249919B2 (en) * 2018-07-31 2022-02-15 SK Hynix Inc. Apparatus and method for managing meta data for engagement of plural memory system to store data
US11367160B2 (en) * 2018-08-02 2022-06-21 Nvidia Corporation Simultaneous compute and graphics scheduling
US10893030B2 (en) 2018-08-10 2021-01-12 Keysight Technologies, Inc. Methods, systems, and computer readable media for implementing bandwidth limitations on specific application traffic at a proxy element
US10884920B2 (en) 2018-08-14 2021-01-05 Western Digital Technologies, Inc. Metadata-based operations for use with solid state devices
US11016696B2 (en) 2018-09-14 2021-05-25 Commvault Systems, Inc. Redundant distributed data storage system
US10728255B2 (en) 2018-09-24 2020-07-28 Nutanix, Inc. System and method for protection of entities across availability zones
US11340810B2 (en) 2018-10-09 2022-05-24 Western Digital Technologies, Inc. Optimizing data storage device operation by grouping logical block addresses and/or physical block addresses using hints
US11249664B2 (en) 2018-10-09 2022-02-15 Western Digital Technologies, Inc. File system metadata decoding for optimizing flash translation layer operations
US10915546B2 (en) 2018-10-10 2021-02-09 Micron Technology, Inc. Counter-based compaction of key-value store tree data block
US11100071B2 (en) 2018-10-10 2021-08-24 Micron Technology, Inc. Key-value store tree data block spill with compaction
US11170002B2 (en) 2018-10-19 2021-11-09 Oracle International Corporation Integrating Kafka data-in-motion with data-at-rest tables
US10963353B2 (en) * 2018-10-23 2021-03-30 Capital One Services, Llc Systems and methods for cross-regional back up of distributed databases on a cloud service
CN111104057B (en) * 2018-10-25 2022-03-29 华为技术有限公司 Node capacity expansion method in storage system and storage system
US11770447B2 (en) 2018-10-31 2023-09-26 Nutanix, Inc. Managing high-availability file servers
US20220052988A1 (en) * 2018-11-13 2022-02-17 Banqu, Inc. Managing permissions to access user data in a distributed ledger trust network
US11010258B2 (en) 2018-11-27 2021-05-18 Commvault Systems, Inc. Generating backup copies through interoperability between components of a data storage management system and appliances for data storage and deduplication
US11169885B2 (en) 2018-11-30 2021-11-09 Nutanix, Inc. System and method for reconfiguring configuration parameters of virtual objects during recovery
CN109542910B (en) * 2018-12-03 2022-10-28 中国电波传播研究所(中国电子科技集团公司第二十二研究所) Mass sea clutter data classification storage method
US11200124B2 (en) 2018-12-06 2021-12-14 Commvault Systems, Inc. Assigning backup resources based on failover of partnered data storage servers in a data storage management system
US10860443B2 (en) 2018-12-10 2020-12-08 Commvault Systems, Inc. Evaluation and reporting of recovery readiness in a data storage management system
US10990385B1 (en) * 2018-12-12 2021-04-27 Amazon Technologies, Inc. Streaming configuration management
US11698727B2 (en) 2018-12-14 2023-07-11 Commvault Systems, Inc. Performing secondary copy operations based on deduplication performance
US11048755B2 (en) 2018-12-14 2021-06-29 Micron Technology, Inc. Key-value store tree with selective use of key portion
US11012508B2 (en) 2018-12-14 2021-05-18 Commvault Systems, Inc. Region-based distributed information management system
USD886143S1 (en) 2018-12-14 2020-06-02 Nutanix, Inc. Display screen or portion thereof with a user interface for database time-machine
US10852978B2 (en) 2018-12-14 2020-12-01 Micron Technology, Inc. Key-value store using journaling with selective data storage format
US10817157B2 (en) 2018-12-20 2020-10-27 Nutanix, Inc. User interface for database management services
US10936661B2 (en) 2018-12-26 2021-03-02 Micron Technology, Inc. Data tree with order-based node traversal
US11010336B2 (en) 2018-12-27 2021-05-18 Nutanix, Inc. System and method for provisioning databases in a hyperconverged infrastructure system
US11816066B2 (en) 2018-12-27 2023-11-14 Nutanix, Inc. System and method for protecting databases in a hyperconverged infrastructure system
US11165883B2 (en) 2019-01-02 2021-11-02 Bank Of America Corporation Entry point classification of requests requiring access to data
US11017117B2 (en) 2019-01-02 2021-05-25 Bank Of America Corporation Pre-firewall data classification
US10872069B2 (en) 2019-01-22 2020-12-22 Commvault Systems, Inc. File indexing for virtual machine backups in a data storage management system
US11347707B2 (en) 2019-01-22 2022-05-31 Commvault Systems, Inc. File indexing for virtual machine backups based on using live browse features
US11176000B2 (en) * 2019-01-25 2021-11-16 International Business Machines Corporation Methods and systems for custom metadata driven data protection and identification of data
US10768971B2 (en) 2019-01-30 2020-09-08 Commvault Systems, Inc. Cross-hypervisor live mount of backed up virtual machine data
US10996974B2 (en) 2019-01-30 2021-05-04 Commvault Systems, Inc. Cross-hypervisor live mount of backed up virtual machine data, including management of cache storage for virtual machine data
US11262934B2 (en) * 2019-02-27 2022-03-01 International Business Machines Corporation Deletion of stored data
US11126365B2 (en) 2019-03-11 2021-09-21 Commvault Systems, Inc. Skipping data backed up in prior backup operations
US11269732B2 (en) 2019-03-12 2022-03-08 Commvault Systems, Inc. Managing structured data in a data storage system
US11204892B2 (en) * 2019-03-21 2021-12-21 Microsoft Technology Licensing, Llc Techniques for snapshotting scalable multitier storage structures
US11321184B2 (en) 2019-03-26 2022-05-03 Commvault Systems, Inc. Streamlined secondary copy operations for data stored on shared file storage
US11579681B2 (en) 2019-04-08 2023-02-14 Commvault Systems, Inc. Power management of components within a storage management system
US10977071B2 (en) 2019-04-10 2021-04-13 Nutanix, Inc. System and method for VM cloning in a software defined storage environment
US20200327017A1 (en) 2019-04-10 2020-10-15 Commvault Systems, Inc. Restore using deduplicated secondary copy data
US11366723B2 (en) 2019-04-30 2022-06-21 Commvault Systems, Inc. Data storage management system for holistic protection and migration of serverless applications across multi-cloud computing environments
US11100064B2 (en) 2019-04-30 2021-08-24 Commvault Systems, Inc. Automated log-based remediation of an information management system
US11442623B2 (en) 2019-05-02 2022-09-13 Commvault Systems, Inc. Faster browse of secondary copies of block-level data volumes
US11463264B2 (en) 2019-05-08 2022-10-04 Commvault Systems, Inc. Use of data block signatures for monitoring in an information management system
WO2020231396A1 (en) * 2019-05-13 2020-11-19 Hewlett-Packard Development Company, L.P. Data monitoring
US10963182B2 (en) 2019-05-29 2021-03-30 Nutanix, Inc. System and method for on-demand recovery points
US11423151B2 (en) 2019-05-31 2022-08-23 Microsoft Technology Licensing, Llc Systems and methods for managing data storage cluster synchronization
US11461184B2 (en) 2019-06-17 2022-10-04 Commvault Systems, Inc. Data storage management system for protecting cloud-based data including on-demand protection, recovery, and migration of databases-as-a-service and/or serverless database management systems
US10805144B1 (en) * 2019-06-18 2020-10-13 Cisco Technology, Inc. Monitoring interactions between entities in a network by an agent for particular types of interactions and indexing and establishing relationships of the components of each interaction
US11093465B2 (en) 2019-06-20 2021-08-17 Western Digital Technologies, Inc. Object storage system with versioned meta objects
US11079960B2 (en) 2019-06-20 2021-08-03 Western Digital Technologies, Inc. Object storage system with priority meta object replication
US11308034B2 (en) 2019-06-27 2022-04-19 Commvault Systems, Inc. Continuously run log backup with minimal configuration and resource usage from the source machine
WO2020264352A1 (en) * 2019-06-28 2020-12-30 Tape Management Systems, Inc. Aggregated control of removable digital storage media using a triplex data structuring system
US11561866B2 (en) 2019-07-10 2023-01-24 Commvault Systems, Inc. Preparing containerized applications for backup using a backup services container and a backup services container-orchestration pod
US20210037112A1 (en) 2019-07-29 2021-02-04 Commvault Systems, Inc. Data storage system with rapid restore capability
US11263173B2 (en) 2019-07-30 2022-03-01 Commvault Systems, Inc. Transaction log index generation in an enterprise backup system
US11095735B2 (en) 2019-08-06 2021-08-17 Tealium Inc. Configuration of event data communication in computer networks
US11442959B2 (en) 2019-08-07 2022-09-13 Nutanix, Inc. System and method of time-based snapshot synchronization
US11513922B2 (en) 2019-08-14 2022-11-29 Commvault Systems, Inc. Systems and methods for change block tracking for backing up changed data
CN110555001B (en) * 2019-09-05 2021-05-28 腾讯科技(深圳)有限公司 Data processing method, device, terminal and medium
US11218450B2 (en) 2019-09-11 2022-01-04 Commvault Systems, Inc. Data protection component scaling in a cloud-based data storage system
US11256673B2 (en) 2019-09-11 2022-02-22 Commvault Systems, Inc. Anomaly detection in deduplication pruning operations
US11237935B2 (en) 2019-09-11 2022-02-01 Commvault Systems, Inc. Anomaly detection in data protection operations
EP3669263B1 (en) 2019-09-12 2022-03-02 Advanced New Technologies Co., Ltd. Log-structured storage systems
WO2019228575A2 (en) 2019-09-12 2019-12-05 Alibaba Group Holding Limited Log-structured storage systems
EP3682344A4 (en) 2019-09-12 2020-12-02 Advanced New Technologies Co., Ltd. Log-structured storage systems
SG11202002587TA (en) 2019-09-12 2020-04-29 Alibaba Group Holding Ltd Log-structured storage systems
EP3695586A4 (en) * 2019-09-12 2020-12-09 Alibaba Group Holding Limited Log-structured storage systems
WO2019228568A2 (en) 2019-09-12 2019-12-05 Alibaba Group Holding Limited Log-structured storage systems
WO2019228574A2 (en) 2019-09-12 2019-12-05 Alibaba Group Holding Limited Log-structured storage systems
WO2019228571A2 (en) 2019-09-12 2019-12-05 Alibaba Group Holding Limited Log-structured storage systems
US10942852B1 (en) 2019-09-12 2021-03-09 Advanced New Technologies Co., Ltd. Log-structured storage systems
US11010255B2 (en) * 2019-09-18 2021-05-18 International Business Machines Corporation Data storage strategy determination
US11687601B2 (en) 2019-10-04 2023-06-27 The Toronto-Dominion Bank Dynamic user interface for navigating user account data
US10735585B1 (en) * 2019-10-15 2020-08-04 Verint Americas Inc. System and method of sentiment modeling and application to determine optimized agent action
US11663241B2 (en) 2019-10-25 2023-05-30 Nutanix, Inc. System and method for catalog service
CN112748991A (en) * 2019-10-30 2021-05-04 伊姆西Ip控股有限责任公司 Method, apparatus and computer program product for backing up data
US11663178B2 (en) 2019-11-04 2023-05-30 Commvault Systems, Inc. Efficient implementation of multiple deduplication databases in a heterogeneous data storage system
US11119676B2 (en) 2019-11-08 2021-09-14 International Business Machines Corporation Using spare bits in memory systems
US20210173811A1 (en) 2019-12-04 2021-06-10 Commvault Systems, Inc. Optimizing the restoration of deduplicated data stored in multi-node replicated file systems
US11237924B2 (en) 2019-12-11 2022-02-01 Commvault Systems, Inc. Dynamic resizing and re-distribution of destination data storage resources for bare metal restore operations in a data storage management system
US11146656B2 (en) 2019-12-20 2021-10-12 Tealium Inc. Feature activation control and data prefetching with network-connected mobile devices
US11223535B2 (en) 2019-12-31 2022-01-11 Commvault Systems, Inc. Smart network topology systems and methods
US11500558B2 (en) * 2020-01-24 2022-11-15 EMC IP Holding Company LLC Dynamic storage device system configuration adjustment
US11190417B2 (en) * 2020-02-04 2021-11-30 Keysight Technologies, Inc. Methods, systems, and computer readable media for processing network flow metadata at a network packet broker
US11467753B2 (en) 2020-02-14 2022-10-11 Commvault Systems, Inc. On-demand restore of virtual machine data
US11321188B2 (en) 2020-03-02 2022-05-03 Commvault Systems, Inc. Platform-agnostic containerized application data protection
US11422900B2 (en) 2020-03-02 2022-08-23 Commvault Systems, Inc. Platform-agnostic containerized application data protection
US11334442B2 (en) 2020-03-10 2022-05-17 Commvault Systems, Inc. Management database long-term archiving to a recovery manager
US11005935B1 (en) 2020-03-10 2021-05-11 Commvault Systems, Inc. Using multiple streams with network data management protocol to improve performance and granularity of backup and restore operations from/to a file server
US11442768B2 (en) 2020-03-12 2022-09-13 Commvault Systems, Inc. Cross-hypervisor live recovery of virtual machines
US11099956B1 (en) 2020-03-26 2021-08-24 Commvault Systems, Inc. Snapshot-based disaster recovery orchestration of virtual machine failover and failback operations
CN111625536B (en) * 2020-04-23 2023-09-22 北京城市网邻信息技术有限公司 Data access method and device
US11768809B2 (en) 2020-05-08 2023-09-26 Nutanix, Inc. Managing incremental snapshots for fast leader node bring-up
US11500669B2 (en) 2020-05-15 2022-11-15 Commvault Systems, Inc. Live recovery of virtual machines in a public cloud computing environment
US11556423B2 (en) 2020-05-22 2023-01-17 Vmware, Inc. Using erasure coding in a single region to reduce the likelihood of losing objects maintained in cloud object storage
US11544147B2 (en) 2020-05-22 2023-01-03 Vmware, Inc. Using erasure coding across multiple regions to reduce the likelihood of losing objects maintained in cloud object storage
US11481319B2 (en) * 2020-05-22 2022-10-25 Vmware, Inc. Using data mirroring across multiple regions to reduce the likelihood of losing objects maintained in cloud object storage
US11687424B2 (en) 2020-05-28 2023-06-27 Commvault Systems, Inc. Automated media agent state management
US11327663B2 (en) 2020-06-09 2022-05-10 Commvault Systems, Inc. Ensuring the integrity of data storage volumes used in block-level live synchronization operations in a data storage management system
US11537959B2 (en) 2020-06-16 2022-12-27 Commvault Systems, Inc. Dynamic computing progress tracker
US11853264B2 (en) * 2020-06-29 2023-12-26 Rubrik, Inc. Aggregating metrics in file systems using structured journals
US11487468B2 (en) 2020-07-17 2022-11-01 Commvault Systems, Inc. Healing failed erasure-coded write attempts in a distributed data storage system configured with fewer storage nodes than data plus parity fragments
JP2022029976A (en) * 2020-08-06 2022-02-18 富士通株式会社 Meta data management program and information processing device
US11604705B2 (en) 2020-08-14 2023-03-14 Nutanix, Inc. System and method for cloning as SQL server AG databases in a hyperconverged system
US11513708B2 (en) 2020-08-25 2022-11-29 Commvault Systems, Inc. Optimized deduplication based on backup frequency in a distributed data storage system
US11108861B1 (en) 2020-08-26 2021-08-31 Commvault Systems, Inc. System for managing multiple information management cells
US11907167B2 (en) 2020-08-28 2024-02-20 Nutanix, Inc. Multi-cluster database management services
US11874853B2 (en) 2020-09-09 2024-01-16 Satori Cyber Ltd. Data classification by on-the-fly inspection of data transactions
US20220092210A1 (en) * 2020-09-18 2022-03-24 International Business Machines Corporation Policy-based data migration
US11570243B2 (en) 2020-09-22 2023-01-31 Commvault Systems, Inc. Decommissioning, re-commissioning, and commissioning new metadata nodes in a working distributed data storage system
US11789830B2 (en) 2020-09-22 2023-10-17 Commvault Systems, Inc. Anti-entropy-based metadata recovery in a strongly consistent distributed data storage system
US11314687B2 (en) 2020-09-24 2022-04-26 Commvault Systems, Inc. Container data mover for migrating data between distributed data storage systems integrated with application orchestrators
US11704313B1 (en) 2020-10-19 2023-07-18 Splunk Inc. Parallel branch operation using intermediary nodes
US11640340B2 (en) 2020-10-20 2023-05-02 Nutanix, Inc. System and method for backing up highly available source databases in a hyperconverged system
US11656951B2 (en) 2020-10-28 2023-05-23 Commvault Systems, Inc. Data loss vulnerability detection
US11474753B2 (en) 2020-10-30 2022-10-18 Commvault Systems, Inc. Systems and methods for backing up to a virtual tape library
US11868495B2 (en) 2020-11-13 2024-01-09 RackTop Systems, Inc. Cybersecurity active defense in a data storage system
WO2022108599A1 (en) * 2020-11-23 2022-05-27 Hitachi Vantara Llc Data processing independent of storage, format or schema
CN112597109B (en) * 2020-12-15 2024-01-19 广州红石创想科技有限公司 Data storage method, device, electronic equipment and storage medium
US11604806B2 (en) 2020-12-28 2023-03-14 Nutanix, Inc. System and method for highly available database service
US11323513B1 (en) 2021-01-22 2022-05-03 Commvault Systems, Inc. Geo-location-based data replication
US11159419B1 (en) 2021-01-29 2021-10-26 Netskope, Inc. Policy-driven data locality and residency
US11604706B2 (en) 2021-02-02 2023-03-14 Commvault Systems, Inc. Back up and restore related data on different cloud storage tiers
US11722741B2 (en) 2021-02-08 2023-08-08 Verance Corporation System and method for tracking content timeline in the presence of playback rate changes
US11800056B2 (en) 2021-02-11 2023-10-24 Logitech Europe S.A. Smart webcam system
US11645175B2 (en) 2021-02-12 2023-05-09 Commvault Systems, Inc. Automatic failover of a storage manager
US11800048B2 (en) 2021-02-24 2023-10-24 Logitech Europe S.A. Image generating system with background replacement or modification capabilities
US11520788B2 (en) 2021-03-05 2022-12-06 Insight Direct Usa, Inc. Methods and systems for transforming distributed database structure for reduced compute load
US11574050B2 (en) 2021-03-12 2023-02-07 Commvault Systems, Inc. Media agent hardening against ransomware attacks
US11892918B2 (en) 2021-03-22 2024-02-06 Nutanix, Inc. System and method for availability group database patching
US11366765B1 (en) 2021-04-21 2022-06-21 International Business Machines Corporation Optimize metadata management to boost overall system performance
WO2023277846A1 (en) * 2021-06-28 2023-01-05 Dogus Bilgi Islem Ve Teknoloji Hiz. A.S. A security system
US11561978B2 (en) 2021-06-29 2023-01-24 Commvault Systems, Inc. Intelligent cache management for mounted snapshots based on a behavior model
US11816356B2 (en) 2021-07-06 2023-11-14 Pure Storage, Inc. Container orchestrator-aware storage system
US11880479B2 (en) 2021-08-05 2024-01-23 Bank Of America Corporation Access control for updating documents in a digital document repository
US11790098B2 (en) 2021-08-05 2023-10-17 Bank Of America Corporation Digital document repository access control using encoded graphical codes
US11615147B2 (en) 2021-08-23 2023-03-28 Commvault Systems, Inc. Mobile storage manager control application for managing a storage manager of an information management system
US11593223B1 (en) 2021-09-02 2023-02-28 Commvault Systems, Inc. Using resource pool administrative entities in a data storage management system to provide shared infrastructure to tenants
US11829328B2 (en) 2021-09-15 2023-11-28 Nutanix, Inc. Garbage collection from archival of storage snapshots
US11803368B2 (en) 2021-10-01 2023-10-31 Nutanix, Inc. Network learning to control delivery of updates
US11664099B1 (en) 2022-01-19 2023-05-30 Vignet Incorporated Decentralized data collection for clinical trials
US11522703B1 (en) * 2022-01-19 2022-12-06 Vignet Incorporated Decentralized applications and data sharing platform for clinical research

Citations (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6006225A (en) * 1998-06-15 1999-12-21 Amazon.Com Refining search queries by the suggestion of correlated terms from prior searches
US6088697A (en) * 1997-12-18 2000-07-11 International Business Machines Corporation Dynamic change management in an extended remote copy operation
US20010047365A1 (en) * 2000-04-19 2001-11-29 Hiawatha Island Software Co, Inc. System and method of packaging and unpackaging files into a markup language record for network search and archive services
US20020049626A1 (en) * 2000-04-14 2002-04-25 Peter Mathias Method and system for interfacing clients with relationship management (RM) accounts and for permissioning marketing
US20020069324A1 (en) * 1999-12-07 2002-06-06 Gerasimov Dennis V. Scalable storage architecture
US20020069550A1 (en) * 2000-12-12 2002-06-13 Michikazu Noguchi Method of alignment between sheet materials, method of alignment, substrate assembling method and aligning apparatus
US20020161753A1 (en) * 2001-04-05 2002-10-31 Matsushita Electric Industrial Co., Ltd. Distributed document retrieval method and device, and distributed document retrieval program and recording medium recording the program
US6507852B1 (en) * 2000-04-17 2003-01-14 Ncr Corporation Location-independent service for monitoring and alerting on an event log
US20030018607A1 (en) * 2000-08-04 2003-01-23 Lennon Alison Joan Method of enabling browse and search access to electronically-accessible multimedia databases
US6516314B1 (en) * 1998-11-17 2003-02-04 Telefonaktiebolaget L M Ericsson (Publ) Optimization of change log handling
US20030046313A1 (en) * 2001-08-31 2003-03-06 Arkivio, Inc. Techniques for restoring data based on contents and attributes of the data
US20030130993A1 (en) * 2001-08-08 2003-07-10 Quiver, Inc. Document categorization engine
US20030182583A1 (en) * 2002-03-25 2003-09-25 Panareef Pty. Ltd. Electronic document classification and monitoring
US20040010493A1 (en) * 1997-11-19 2004-01-15 Ns Solutions Corporation Database system and a method of data retrieval from the system
US20040015514A1 (en) * 2002-04-03 2004-01-22 Austin Melton Method and system for managing data objects
US20040254919A1 (en) * 2003-06-13 2004-12-16 Microsoft Corporation Log parser
US20040260678A1 (en) * 2003-06-18 2004-12-23 Microsoft Corporation State based configuration failure detection using checkpoint comparison
US20050010588A1 (en) * 2003-07-08 2005-01-13 Zalewski Stephen H. Method and apparatus for determining replication schema against logical data disruptions
US20050050075A1 (en) * 2003-08-29 2005-03-03 Fujitsu Limited Data classification processing apparatus, data classification processing method and storage medium
US20050055352A1 (en) * 2003-09-08 2005-03-10 Sony Corporation Content directory and synchronization bridge
US20050055386A1 (en) * 2003-09-05 2005-03-10 Sierra Wireless, Inc. A Canadian Corp. Mail server based application record synchronization
US20050154695A1 (en) * 2004-01-09 2005-07-14 Oracle International Corporation Rule-based transformation of metadata
US20050188248A1 (en) * 2003-05-09 2005-08-25 O'brien John Scalable storage architecture
US20050187937A1 (en) * 2004-02-25 2005-08-25 Fuji Xerox Co., Ltd. Computer program product, device system, and method for providing document view
US20050216453A1 (en) * 2004-03-23 2005-09-29 Koichi Sasaki System and method for data classification usable for data search
US20050228794A1 (en) * 2004-03-30 2005-10-13 Navas Julio C Method and apparatus for virtual content access systems built on a content routing network
US20050262097A1 (en) * 2004-05-07 2005-11-24 Sim-Tang Siew Y System for moving real-time data events across a plurality of devices in a network for simultaneous data protection, replication, and access services
US20060004820A1 (en) * 2004-07-01 2006-01-05 Claudatos Christopher H Storage pools for information management
US20060010227A1 (en) * 2004-06-01 2006-01-12 Rajeev Atluri Methods and apparatus for accessing data from a primary data storage system for secondary storage
US20060031225A1 (en) * 2004-08-06 2006-02-09 Grand Central Communications, Inc. Providing on-demand access to services in a wide area network
US20060031263A1 (en) * 2004-06-25 2006-02-09 Yan Arrouye Methods and systems for managing data
US20060106814A1 (en) * 2004-11-17 2006-05-18 Steven Blumenau Systems and methods for unioning different taxonomy tags for a digital asset
US20060224746A1 (en) * 2005-03-29 2006-10-05 Nec Corporation Presence service system, a presence apparatus, a presence service method, and a presence service program
US20060253495A1 (en) * 2002-04-02 2006-11-09 Png Teck H Metadata database management system and method therefor
US20060259527A1 (en) * 2005-05-13 2006-11-16 Devarakonda Murthy V Changed files list with time buckets for efficient storage management
US20060259468A1 (en) * 2005-05-10 2006-11-16 Michael Brooks Methods for electronic records management
US20060294094A1 (en) * 2004-02-15 2006-12-28 King Martin T Processing techniques for text capture from a rendered document
US7165082B1 (en) * 2003-10-31 2007-01-16 Veritas Operating Corporation Incremental method for backup of email messages
US20070033191A1 (en) * 2004-06-25 2007-02-08 John Hornkvist Methods and systems for managing permissions data and/or indexes
US20070043956A1 (en) * 2005-08-19 2007-02-22 Microsoft Corporation System and methods that facilitate third party code test development
US20070100867A1 (en) * 2005-10-31 2007-05-03 Celik Aytek E System for displaying ads
US20070174840A1 (en) * 2005-12-30 2007-07-26 Microsoft Corporation Determining the level of availability of a computing resource
US20070179995A1 (en) * 2005-11-28 2007-08-02 Anand Prahlad Metabase for facilitating data classification
US20070185917A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for classifying and transferring information in a storage network
US20080091747A1 (en) * 2006-10-17 2008-04-17 Anand Prahlad System and method for storage operation access security
US20080229037A1 (en) * 2006-12-04 2008-09-18 Alan Bunte Systems and methods for creating copies of data, such as archive copies
US7634478B2 (en) * 2003-12-02 2009-12-15 Microsoft Corporation Metadata driven intelligent data navigation
US20090319534A1 (en) * 2008-06-24 2009-12-24 Parag Gokhale Application-aware and remote single instance data management
US20090319585A1 (en) * 2008-06-24 2009-12-24 Parag Gokhale Application-aware and remote single instance data management
US20100082672A1 (en) * 2008-09-26 2010-04-01 Rajiv Kottomtharayil Systems and methods for managing single instancing data
US20100114952A1 (en) * 2000-04-04 2010-05-06 Robert Scanlon System and method for accessing data in disparate information sources
US7720801B2 (en) * 2003-12-19 2010-05-18 Netapp, Inc. System and method for supporting asynchronous data replication with very short update intervals
US7734669B2 (en) * 2006-12-22 2010-06-08 Commvault Systems, Inc. Managing copies of data
US7756837B2 (en) * 2004-01-09 2010-07-13 Index Engines, Inc. Methods and apparatus for searching backup data based on content and attributes
US20100250549A1 (en) * 2009-03-30 2010-09-30 Muller Marcus S Storing a variable number of instances of data objects
US7840537B2 (en) * 2006-12-22 2010-11-23 Commvault Systems, Inc. System and method for storing redundant information
US20100299490A1 (en) * 2009-05-22 2010-11-25 Attarde Deepak R Block-level single instancing

Family Cites Families (495)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US114406A (en) * 1871-05-02 Improvement in electro-magnetic burglar-alarms
US10487A (en) * 1854-01-31 Chtjkbt
US2006A (en) * 1841-03-16 Clamp for crimping leather
US758A (en) * 1838-05-30 Mode op
US564228A (en) * 1896-07-21 William sparling
US37601A (en) * 1863-02-03 Improvement in machines for rolling metals
US4686620A (en) 1984-07-26 1987-08-11 American Telephone And Telegraph Company, At&T Bell Laboratories Database backup method
GB8622010D0 (en) 1986-09-12 1986-10-22 Hewlett Packard Ltd File backup facility
FR2606399B1 (en) * 1986-11-06 1989-01-13 Saint Gobain Vitrage METHOD AND INSTALLATION FOR BOMBING GLASS PLATES, WITH HIGH CAPACITY
US5193154A (en) 1987-07-10 1993-03-09 Hitachi, Ltd. Buffered peripheral system and method for backing up and retrieving data to and from backup memory device
US5005122A (en) 1987-09-08 1991-04-02 Digital Equipment Corporation Arrangement with cooperating management server node and network service node
JPH0743676B2 (en) 1988-03-11 1995-05-15 株式会社日立製作所 Back-up data dump control method and device
US4995035A (en) 1988-10-31 1991-02-19 International Business Machines Corporation Centralized management in a computer network
US5093912A (en) * 1989-06-26 1992-03-03 International Business Machines Corporation Dynamic resource pool expansion and contraction in multiprocessing environments
ATE145998T1 (en) 1989-06-30 1996-12-15 Digital Equipment Corp METHOD AND ARRANGEMENT FOR CONTROLLING SHADOW STORAGE
US5133065A (en) * 1989-07-27 1992-07-21 Personal Computer Peripherals Corporation Backup computer program for networks
US5321816A (en) 1989-10-10 1994-06-14 Unisys Corporation Local-remote apparatus with specialized image storage modules
US5504873A (en) 1989-11-01 1996-04-02 E-Systems, Inc. Mass data storage and retrieval system
US5276867A (en) 1989-12-19 1994-01-04 Epoch Systems, Inc. Digital data storage system with improved data migration
US5276860A (en) * 1989-12-19 1994-01-04 Epoch Systems, Inc. Digital data processor with improved backup storage
GB2246218B (en) 1990-07-18 1994-02-09 Stc Plc Distributed data processing systems
US5239647A (en) 1990-09-07 1993-08-24 International Business Machines Corporation Data storage hierarchy with shared storage level
US5544347A (en) 1990-09-24 1996-08-06 Emc Corporation Data storage system controlled remote data mirroring with respectively maintained data indices
US5212772A (en) 1991-02-11 1993-05-18 Gigatrend Incorporated System for storing data in backup tape device
DE4114334A1 (en) * 1991-05-02 1992-11-05 Buss Ag THICK FILM EVAPORATOR MADE OF CORROSION-RESISTANT MATERIAL
US5287500A (en) 1991-06-03 1994-02-15 Digital Equipment Corporation System for allocating storage spaces based upon required and optional service attributes having assigned piorities
US5333315A (en) * 1991-06-27 1994-07-26 Digital Equipment Corporation System of device independent file directories using a tag between the directories and file descriptors that migrate with the files
US5347653A (en) 1991-06-28 1994-09-13 Digital Equipment Corporation System for reconstructing prior versions of indexes using records indicating changes between successive versions of the indexes
US5410700A (en) 1991-09-04 1995-04-25 International Business Machines Corporation Computer system which supports asynchronous commitment of data
US5263154A (en) 1992-04-20 1993-11-16 International Business Machines Corporation Method and system for incremental time zero backup copying of data
US5241668A (en) 1992-04-20 1993-08-31 International Business Machines Corporation Method and system for automated termination and resumption in a time zero backup copy process
US5241670A (en) 1992-04-20 1993-08-31 International Business Machines Corporation Method and system for automated backup copy ordering in a time zero backup copy session
WO1994012944A1 (en) * 1992-11-23 1994-06-09 Paragon Concepts, Inc. Computer filing system with user selected categories to provide file access
JP3130536B2 (en) 1993-01-21 2001-01-31 アップル コンピューター インコーポレーテッド Apparatus and method for transferring and storing data from multiple networked computer storage devices
WO1994018634A1 (en) 1993-02-01 1994-08-18 Lsc, Inc. Archiving file system for data servers in a distributed network environment
DE69425658T2 (en) 1993-06-03 2001-04-19 Network Appliance Inc ARRANGEMENT OF A FILE SYSTEM FOR DESCRIBING ANY AREAS
JPH0721135A (en) 1993-07-02 1995-01-24 Fujitsu Ltd Data processing system with duplex monitor function
JPH0744568A (en) 1993-07-30 1995-02-14 Mitsubishi Electric Corp Retrieval interface device
US5544345A (en) 1993-11-08 1996-08-06 International Business Machines Corporation Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage
EP0728333A1 (en) 1993-11-09 1996-08-28 Arcada Software Data backup and restore system for a computer network
US5495607A (en) 1993-11-15 1996-02-27 Conner Peripherals, Inc. Network management system having virtual catalog overview of files distributively stored across network domain
US5590318A (en) * 1993-11-18 1996-12-31 Microsoft Corporation Method and system for tracking files pending processing
US6339767B1 (en) * 1997-06-02 2002-01-15 Aurigin Systems, Inc. Using hyperbolic trees to visualize data generated by patent-centric and group-oriented data processing
US5623679A (en) * 1993-11-19 1997-04-22 Waverley Holdings, Inc. System and method for creating and manipulating notes each containing multiple sub-notes, and linking the sub-notes to portions of data objects
US6090555A (en) * 1997-12-11 2000-07-18 Affymetrix, Inc. Scanned image alignment systems and methods
US5491810A (en) 1994-03-01 1996-02-13 International Business Machines Corporation Method and system for automated data storage system space allocation utilizing prioritized data set parameters
US5673381A (en) 1994-05-27 1997-09-30 Cheyenne Software International Sales Corp. System and parallel streaming and data stripping to back-up a network
US5638509A (en) 1994-06-10 1997-06-10 Exabyte Corporation Data storage and protection system
US5574906A (en) 1994-10-24 1996-11-12 International Business Machines Corporation System and method for reducing storage requirement in backup subsystems utilizing segmented compression and differencing
US6272465B1 (en) 1994-11-02 2001-08-07 Legerity, Inc. Monolithic PC audio circuit
JP2855409B2 (en) 1994-11-17 1999-02-10 日本アイ・ビー・エム株式会社 Natural language processing method and system
US5559957A (en) 1995-05-31 1996-09-24 Lucent Technologies Inc. File system for a data storage device having a power fail recovery mechanism for write/replace operations
JP3335801B2 (en) 1995-07-05 2002-10-21 株式会社日立製作所 Information processing system enabling access to different types of files and control method thereof
US5699361A (en) 1995-07-18 1997-12-16 Industrial Technology Research Institute Multimedia channel formulation mechanism
US5813009A (en) 1995-07-28 1998-09-22 Univirtual Corp. Computer based records management system method
US5619644A (en) 1995-09-18 1997-04-08 International Business Machines Corporation Software directed microcode state save for distributed storage controller
US5892917A (en) * 1995-09-27 1999-04-06 Microsoft Corporation System for log record and log expansion with inserted log records representing object request for specified object corresponding to cached object copies
US5838323A (en) 1995-09-29 1998-11-17 Apple Computer, Inc. Document summary computer system user interface
US5819020A (en) 1995-10-16 1998-10-06 Network Specialists, Inc. Real time backup system
US5778395A (en) 1995-10-23 1998-07-07 Stac, Inc. System for backing up files from disk volumes on multiple nodes of a computer network
US5737747A (en) * 1995-10-27 1998-04-07 Emc Corporation Prefetching to service multiple video streams from an integrated cached disk array
US5829046A (en) 1995-10-27 1998-10-27 Emc Corporation On-line tape backup using an integrated cached disk array
US5729743A (en) 1995-11-17 1998-03-17 Deltatech Research, Inc. Computer apparatus and method for merging system deltas
JP3637660B2 (en) 1995-12-15 2005-04-13 ソニー株式会社 Data distribution method and apparatus
US5761677A (en) 1996-01-03 1998-06-02 Sun Microsystems, Inc. Computer system method and apparatus providing for various versions of a file without requiring data copy or log operations
KR970076238A (en) 1996-05-23 1997-12-12 포만 제프리 엘 Servers, methods and program products thereof for creating and managing multiple copies of client data files
US5901327A (en) 1996-05-28 1999-05-04 Emc Corporation Bundling of write data from channel commands in a command chain for transmission over a data link between data storage systems for remote data mirroring
US5812398A (en) 1996-06-10 1998-09-22 Sun Microsystems, Inc. Method and system for escrowed backup of hotelled world wide web sites
DE19627472A1 (en) 1996-07-08 1998-01-15 Ser Systeme Ag Database system
US6438586B1 (en) 1996-09-30 2002-08-20 Emc Corporation File transfer utility which employs an intermediate data storage system
US5758359A (en) 1996-10-24 1998-05-26 Digital Equipment Corporation Method and apparatus for performing retroactive backups in a computer system
US5907621A (en) 1996-11-15 1999-05-25 International Business Machines Corporation System and method for session management
US6487644B1 (en) 1996-11-22 2002-11-26 Veritas Operating Corporation System and method for multiplexed data back-up to a storage tape and restore operations using client identification tags
AU5365998A (en) * 1996-11-27 1998-06-22 1 Vision Software, L.L.C. File directory and file navigation system
US5875478A (en) 1996-12-03 1999-02-23 Emc Corporation Computer backup using a file system, network, disk, tape and remote archiving repository media system
US6131095A (en) 1996-12-11 2000-10-10 Hewlett-Packard Company Method of accessing a target entity over a communications network
WO1998033113A1 (en) 1997-01-23 1998-07-30 Overland Data, Inc. Virtual media library
US7216043B2 (en) 1997-02-12 2007-05-08 Power Measurement Ltd. Push communications architecture for intelligent electronic devices
US6658526B2 (en) 1997-03-12 2003-12-02 Storage Technology Corporation Network attached virtual data storage subsystem
US5924102A (en) * 1997-05-07 1999-07-13 International Business Machines Corporation System and method for managing critical files
US6094416A (en) 1997-05-09 2000-07-25 I/O Control Corporation Multi-tier architecture for control network
US5887134A (en) 1997-06-30 1999-03-23 Sun Microsystems System and method for preserving message order while employing both programmed I/O and DMA operations
US6092062A (en) * 1997-06-30 2000-07-18 International Business Machines Corporation Relational database query optimization to perform query evaluation plan, pruning based on the partition properties
EP1008048B1 (en) 1997-08-29 2001-10-31 Hewlett-Packard Company Data backup and recovery systems
EP0899662A1 (en) 1997-08-29 1999-03-03 Hewlett-Packard Company Backup and restore system for a computer network
US6067541A (en) * 1997-09-17 2000-05-23 Microsoft Corporation Monitoring document changes in a file system of documents with the document change information stored in a persistent log
US5950205A (en) 1997-09-25 1999-09-07 Cisco Technology, Inc. Data transmission over the internet using a cache memory file system
US6275953B1 (en) 1997-09-26 2001-08-14 Emc Corporation Recovery from failure of a data processor in a network server
US6052735A (en) * 1997-10-24 2000-04-18 Microsoft Corporation Electronic mail object synchronization between a desktop computer and mobile device
US6021415A (en) 1997-10-29 2000-02-01 International Business Machines Corporation Storage management system with file aggregation and space reclamation within aggregated files
US6418478B1 (en) * 1997-10-30 2002-07-09 Commvault Systems, Inc. Pipelined high speed data transfer mechanism
US6061692A (en) * 1997-11-04 2000-05-09 Microsoft Corporation System and method for administering a meta database as an integral component of an information server
US6260068B1 (en) 1998-06-10 2001-07-10 Compaq Computer Corporation Method and apparatus for migrating resources in a multi-processor computer system
JPH11143754A (en) 1997-11-05 1999-05-28 Hitachi Ltd Version information and constitution information display method and device therefor, and computer readable recording medium for recording version information and constitution information display program
JP3272283B2 (en) 1997-11-14 2002-04-08 富士通株式会社 Electronic data storage device
US5918232A (en) 1997-11-26 1999-06-29 Whitelight Systems, Inc. Multidimensional domain modeling method and system
JP3665460B2 (en) 1997-12-05 2005-06-29 富士通株式会社 Route selection system, method, and recording medium by response time tuning of distributed autonomous cooperation type
US6131190A (en) 1997-12-18 2000-10-10 Sidwell; Leland P. System for modifying JCL parameters to optimize data storage allocations
US6023710A (en) * 1997-12-23 2000-02-08 Microsoft Corporation System and method for long-term administration of archival storage
US6374336B1 (en) 1997-12-24 2002-04-16 Avid Technology, Inc. Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner
US6076148A (en) * 1997-12-26 2000-06-13 Emc Corporation Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information stored on mass storage subsystem
US6154787A (en) 1998-01-21 2000-11-28 Unisys Corporation Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed
US6260069B1 (en) 1998-02-10 2001-07-10 International Business Machines Corporation Direct data retrieval in a distributed computing system
DE69816415T2 (en) 1998-03-02 2004-04-15 Hewlett-Packard Co. (N.D.Ges.D.Staates Delaware), Palo Alto Data Backup System
US6026414A (en) * 1998-03-05 2000-02-15 International Business Machines Corporation System including a proxy client to backup files in a distributed computing environment
US6161111A (en) 1998-03-31 2000-12-12 Emc Corporation System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map
US6175829B1 (en) * 1998-04-22 2001-01-16 Nec Usa, Inc. Method and apparatus for facilitating query reformulation
US6167402A (en) 1998-04-27 2000-12-26 Sun Microsystems, Inc. High performance message store
US6154852A (en) 1998-06-10 2000-11-28 International Business Machines Corporation Method and apparatus for data backup and recovery
US6438595B1 (en) 1998-06-24 2002-08-20 Emc Corporation Load balancing using directory services in a data processing system
US6665687B1 (en) 1998-06-26 2003-12-16 Alexander James Burke Composite user interface and search system for internet and multimedia applications
US6421711B1 (en) 1998-06-29 2002-07-16 Emc Corporation Virtual ports for data transferring of a data storage system
US6542909B1 (en) 1998-06-30 2003-04-01 Emc Corporation System for determining mapping of logical objects in a computer system
US6829635B1 (en) 1998-07-01 2004-12-07 Brent Townshend System and method of automatically generating the criteria to identify bulk electronic mail
US6112221A (en) 1998-07-09 2000-08-29 Lucent Technologies, Inc. System and method for scheduling web servers with a quality-of-service guarantee for each user
US6353878B1 (en) * 1998-08-13 2002-03-05 Emc Corporation Remote control of backup media in a secondary storage subsystem through access to a primary storage subsystem
US6269431B1 (en) * 1998-08-13 2001-07-31 Emc Corporation Virtual storage and block level direct access of secondary storage for recovery of backup data
GB2341249A (en) 1998-08-17 2000-03-08 Connected Place Limited A method of generating a difference file defining differences between an updated file and a base file
US6240416B1 (en) 1998-09-11 2001-05-29 Ambeo, Inc. Distributed metadata system and method
GB2342214B (en) 1998-09-28 2003-02-26 Dascom Software Dev Services L A tape system storage and retrieval process
DE19846587C1 (en) * 1998-10-09 2000-03-16 Karlsruhe Forschzent Supporting system for superisolation in annular gap between flexible corrugated pipes has cylindrical rod frames between superisolation and inner and outer corrugated pipes
US6549957B1 (en) 1998-12-22 2003-04-15 International Business Machines Corporation Apparatus for preventing automatic generation of a chain reaction of messages if a prior extracted message is similar to current processed message
US6487561B1 (en) 1998-12-31 2002-11-26 Emc Corporation Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size
US6920537B2 (en) 1998-12-31 2005-07-19 Emc Corporation Apparatus and methods for copying, backing up and restoring logical objects in a computer storage system by transferring blocks out of order or in parallel
US6212512B1 (en) * 1999-01-06 2001-04-03 Hewlett-Packard Company Integration of a database into file management software for protecting, tracking and retrieving data
US6324581B1 (en) 1999-03-03 2001-11-27 Emc Corporation File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems
US6725392B1 (en) 1999-03-03 2004-04-20 Adaptec, Inc. Controller fault recovery system for a distributed file system
US6350199B1 (en) * 1999-03-16 2002-02-26 International Game Technology Interactive gaming machine and method with customized game screen presentation
JP3763992B2 (en) * 1999-03-30 2006-04-05 富士通株式会社 Data processing apparatus and recording medium
US6421683B1 (en) * 1999-03-31 2002-07-16 Verizon Laboratories Inc. Method and product for performing data transfer in a computer system
US6389432B1 (en) * 1999-04-05 2002-05-14 Auspex Systems, Inc. Intelligent virtual volume access
US6516348B1 (en) 1999-05-21 2003-02-04 Macfarlane Druce Ian Craig Rattray Collecting and predicting capacity information for composite network resource formed by combining ports of an access server and/or links of wide arear network
US6519679B2 (en) * 1999-06-11 2003-02-11 Dell Usa, L.P. Policy based storage configuration
US7035880B1 (en) * 1999-07-14 2006-04-25 Commvault Systems, Inc. Modular backup and retrieval system used in conjunction with a storage area network
US7395282B1 (en) 1999-07-15 2008-07-01 Commvault Systems, Inc. Hierarchical backup and retrieval system
US7389311B1 (en) 1999-07-15 2008-06-17 Commvault Systems, Inc. Modular backup and retrieval system
US6538669B1 (en) 1999-07-15 2003-03-25 Dell Products L.P. Graphical user interface for configuration of a storage system
US6389433B1 (en) * 1999-07-16 2002-05-14 Microsoft Corporation Method and system for automatically merging files into a single instance store
US6430575B1 (en) 1999-09-10 2002-08-06 Xerox Corporation Collaborative document management system with customizable filing structures that are mutually intelligible
US6343324B1 (en) * 1999-09-13 2002-01-29 International Business Machines Corporation Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access to the devices
FR2799023B1 (en) * 1999-09-24 2003-04-18 France Telecom METHOD FOR THEMATIC CLASSIFICATION OF DOCUMENTS, MODULE FOR THEMATIC CLASSIFICATION AND SEARCH ENGINE INCORPORATING SUCH A MODULE
US6976053B1 (en) * 1999-10-14 2005-12-13 Arcessa, Inc. Method for using agents to create a computer index corresponding to the contents of networked computers
US6516337B1 (en) * 1999-10-14 2003-02-04 Arcessa, Inc. Sending to a central indexing site meta data or signatures from objects on a computer network
US6785864B1 (en) * 1999-12-01 2004-08-31 International Business Machines Corporation System and method for notifying of changes in web page hyperlinked documents
US7146566B1 (en) 1999-12-14 2006-12-05 International Business Machines Corporation Method and system for multiformat presentation
US6625623B1 (en) 1999-12-16 2003-09-23 Livevault Corporation Systems and methods for backing up data files
US6779003B1 (en) 1999-12-16 2004-08-17 Livevault Corporation Systems and methods for backing up data files
US6847984B1 (en) * 1999-12-16 2005-01-25 Livevault Corporation Systems and methods for backing up data files
US6401178B1 (en) * 1999-12-23 2002-06-04 Emc Corporatiion Data processing method and apparatus for enabling independent access to replicated data
DE60139157D1 (en) 2000-01-14 2009-08-13 Thinkstream Inc DISTRIBUTED INFORMATION NETWORK WITH GLOBAL ACCESS
US6564228B1 (en) 2000-01-14 2003-05-13 Sun Microsystems, Inc. Method of enabling heterogeneous platforms to utilize a universal file system in a storage area network
US6542972B2 (en) * 2000-01-31 2003-04-01 Commvault Systems, Inc. Logical view and access to physical storage in modular data and storage management system
US6658436B2 (en) 2000-01-31 2003-12-02 Commvault Systems, Inc. Logical view and access to data managed by a modular data and storage management system
US20020120741A1 (en) 2000-03-03 2002-08-29 Webb Theodore S. Systems and methods for using distributed interconnects in information management enviroments
US7167895B1 (en) 2000-03-22 2007-01-23 Intel Corporation Signaling method and apparatus to provide content on demand in a broadcast system
US6792472B1 (en) 2000-03-31 2004-09-14 International Business Machines Corporation System, method and computer readable medium for intelligent raid controllers operating as data routers
US7240100B1 (en) * 2000-04-14 2007-07-03 Akamai Technologies, Inc. Content delivery network (CDN) content server request handling mechanism with metadata framework support
US6760721B1 (en) 2000-04-14 2004-07-06 Realnetworks, Inc. System and method of managing metadata data
US6996616B1 (en) 2000-04-17 2006-02-07 Akamai Technologies, Inc. HTML delivery from edge-of-network servers in a content delivery network (CDN)
US6678700B1 (en) 2000-04-27 2004-01-13 General Atomics System of and method for transparent management of data objects in containers across distributed heterogenous resources
US6356801B1 (en) * 2000-05-19 2002-03-12 International Business Machines Corporation High availability work queuing in an automated data storage library
US6836806B1 (en) 2000-06-01 2004-12-28 Aerocast, Inc. System for network addressing
AR030286A1 (en) 2000-06-01 2003-08-20 Aerocast Com Inc CONTENT MONITORING SYSTEM, CONTENT MONITORING METHOD FOR COMMUNICATING INFORMATION TO REMOTE LOCATIONS AND CONTENT MONITORING METHOD IN A CONTENT DISTRIBUTION SYSTEM.
US6961838B2 (en) 2000-06-02 2005-11-01 Hewlett-Packard Development Company, L.P. Generating updated virtual disks using distributed mapping tables accessible by mapping agents and managed by a centralized controller
US7404005B1 (en) 2000-06-09 2008-07-22 International Business Machines Corporation Method, system, and program for selecting one of multiple paths to communicate with a device
US9699129B1 (en) 2000-06-21 2017-07-04 International Business Machines Corporation System and method for increasing email productivity
US6330642B1 (en) 2000-06-29 2001-12-11 Bull Hn Informatin Systems Inc. Three interconnected raid disk controller data processing system architecture
US6810376B1 (en) 2000-07-11 2004-10-26 Nusuara Technologies Sdn Bhd System and methods for determining semantic similarity of sentences
US7346676B1 (en) * 2000-07-19 2008-03-18 Akamai Technologies, Inc. Load balancing service
EP1174795A1 (en) 2000-07-19 2002-01-23 Hewlett-Packard Company, A Delaware Corporation Multiplexing computing apparatus
US20020049738A1 (en) * 2000-08-03 2002-04-25 Epstein Bruce A. Information collaboration and reliability assessment
US6886020B1 (en) 2000-08-17 2005-04-26 Emc Corporation Method and apparatus for storage system metrics management and archive
US6925476B1 (en) 2000-08-17 2005-08-02 Fusionone, Inc. Updating application data including adding first change log to aggreagate change log comprising summary of changes
US6981005B1 (en) * 2000-08-24 2005-12-27 Microsoft Corporation Partial migration of an object to another storage location in a computer system
US20020056091A1 (en) 2000-09-13 2002-05-09 Bala Ravi Narayan Software agent for facilitating electronic commerce transactions through display of targeted promotions or coupons
EP1193616A1 (en) 2000-09-29 2002-04-03 Sony France S.A. Fixed-length sequence generation of items out of a database using descriptors
US6611849B1 (en) 2000-09-29 2003-08-26 Palm Source, Inc. System for synchronizing databases on multiple devices utilizing a home base
US7106691B1 (en) 2000-11-01 2006-09-12 At&T Corp. Method for tracking source and destination internet protocol data
US7925967B2 (en) 2000-11-21 2011-04-12 Aol Inc. Metadata quality improvement
US7068597B1 (en) 2000-11-27 2006-06-27 3Com Corporation System and method for automatic load balancing in a data-over-cable network
GB0029159D0 (en) 2000-11-29 2001-01-17 Calaba Ltd Data storage and retrieval system
US20030149739A1 (en) 2000-11-30 2003-08-07 Doug Adams Method for retrieving, organizing and utilizing on-line poster abstracts
US20020156792A1 (en) * 2000-12-06 2002-10-24 Biosentients, Inc. Intelligent object handling device and method for intelligent object data in heterogeneous data environments with high data density and dynamic application needs
US6647396B2 (en) 2000-12-28 2003-11-11 Trilogy Development Group, Inc. Classification based content management system
US20020124137A1 (en) 2001-01-29 2002-09-05 Ulrich Thomas R. Enhancing disk array performance via variable parity based load balancing
US6990667B2 (en) * 2001-01-29 2006-01-24 Adaptec, Inc. Server-independent object positioning for load balancing drives and servers
JP2002262369A (en) 2001-02-27 2002-09-13 Canon Inc Data wireless communication system and operating state display method for peripheral device
US7734715B2 (en) 2001-03-01 2010-06-08 Ricoh Company, Ltd. System, computer program product and method for managing documents
US6832229B2 (en) * 2001-03-09 2004-12-14 Oracle International Corporation System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic
EP1379938A1 (en) 2001-03-09 2004-01-14 N2 Broadband, Inc. Method and system for managing and updating metadata associated with digital assets
US7194454B2 (en) 2001-03-12 2007-03-20 Lucent Technologies Method for organizing records of database search activity by topical relevance
US6836779B2 (en) 2001-03-13 2004-12-28 Christian D. Poulin Network transaction method
WO2002079993A1 (en) 2001-03-29 2002-10-10 Reallegal.Com Methods for synchronizing on-line and off-line transcript projects
US6947935B1 (en) 2001-04-04 2005-09-20 Microsoft Corporation Training, inference and user interface for guiding the caching of media content on local stores
US20020147734A1 (en) * 2001-04-06 2002-10-10 Shoup Randall Scott Archiving method and system
US6993023B2 (en) 2001-04-27 2006-01-31 The Boeing Company Parallel analysis of incoming data transmissions
US6883108B2 (en) 2001-05-07 2005-04-19 Sun Microsystems, Inc. Fault-tolerant routing scheme for a multi-path interconnection fabric in a storage network
US6976039B2 (en) 2001-05-25 2005-12-13 International Business Machines Corporation Method and system for processing backup data associated with application, querying metadata files describing files accessed by the application
US7028079B2 (en) 2001-05-25 2006-04-11 Lenovo (Singapore) Pte, Ltd. Method and apparatus for the automatic migration of applications and their associated data and configuration files
US6763351B1 (en) 2001-06-18 2004-07-13 Siebel Systems, Inc. Method, apparatus, and system for attaching search results
US7343410B2 (en) 2001-06-28 2008-03-11 Finisar Corporation Automated creation of application data paths in storage area networks
US7171619B1 (en) * 2001-07-05 2007-01-30 Sun Microsystems, Inc. Methods and apparatus for accessing document content
JP4042359B2 (en) * 2001-07-10 2008-02-06 日本電気株式会社 Cache control method and cache device
US20030020749A1 (en) 2001-07-10 2003-01-30 Suhayya Abu-Hakima Concept-based message/document viewer for electronic communications and internet searching
US20030018657A1 (en) 2001-07-18 2003-01-23 Imation Corp. Backup of data on a network
JP4161557B2 (en) 2001-09-03 2008-10-08 株式会社日立製作所 Packet transfer method and apparatus
JP2003157259A (en) 2001-09-05 2003-05-30 Fuji Xerox Co Ltd Information retrieval system
MXPA04002479A (en) * 2001-09-19 2004-05-31 Thomson Licensing Sa Programmable bandwidth limiter using handshake suppression.
US7024517B1 (en) 2001-09-27 2006-04-04 Emc Corporation System and method for configuring data storage in accordance with workload requirements
EP1442387A4 (en) 2001-09-28 2008-01-23 Commvault Systems Inc System and method for archiving objects in an information store
US20030079018A1 (en) 2001-09-28 2003-04-24 Lolayekar Santosh C. Load balancing in a storage network
WO2003028183A1 (en) * 2001-09-28 2003-04-03 Commvault Systems, Inc. System and method for generating and managing quick recovery volumes
JP4183937B2 (en) * 2001-10-31 2008-11-19 株式会社デンソー Starter
US20050086231A1 (en) * 2001-10-31 2005-04-21 Alan Moore Information archiving software
US7584227B2 (en) 2005-12-19 2009-09-01 Commvault Systems, Inc. System and method for containerized data storage and tracking
US20030101183A1 (en) * 2001-11-26 2003-05-29 Navin Kabra Information retrieval index allowing updating while in use
US6915314B2 (en) 2001-12-11 2005-07-05 Adtech-Gesi, Llc System for archiving and retrieving data from a database
US7149750B2 (en) * 2001-12-19 2006-12-12 International Business Machines Corporation Method, system and program product for extracting essence from a multimedia file received in a first format, creating a metadata file in a second file format and using a unique identifier assigned to the essence to access the essence and metadata file
EP1324216A1 (en) * 2001-12-28 2003-07-02 Deutsche Thomson-Brandt Gmbh Machine for classification of metadata
DE10200381A1 (en) * 2002-01-08 2003-07-17 Guenther Boehler Gmbh Device for processing surfaces comprises a device holder, a tool holder, an eccentric part coupled to the tool holder, and an arrangement preventing rotation but allowing pivoting of the tool holder
JP2005515556A (en) * 2002-01-15 2005-05-26 ネットワーク アプライアンス, インコーポレイテッド Active file change notification
FR2835139B1 (en) * 2002-01-22 2004-06-11 Innovi Technologies Ltd METHOD FOR TRANSMITTING VOICE / DATA SIGNALS BETWEEN A BASIC DEVICE AND A SECONDARY OR INTERMEDIATE DEVICE
US7089260B2 (en) * 2002-02-14 2006-08-08 International Business Machines Corporation Database optimization apparatus and method
US7343365B2 (en) * 2002-02-20 2008-03-11 Microsoft Corporation Computer system architecture for automatic context associations
JP2003248605A (en) 2002-02-26 2003-09-05 Hitachi Ltd Storage system, main storing system, sub-storing system, and its data copying method
US7072304B2 (en) 2002-02-27 2006-07-04 Nortel Networks Limited Network path selection based on bandwidth
US7886298B2 (en) 2002-03-26 2011-02-08 Hewlett-Packard Development Company, L.P. Data transfer protocol for data replication between multiple pairs of storage controllers on a san fabric
JP4196579B2 (en) 2002-04-10 2008-12-17 株式会社日立製作所 Storage operation management method and system
US6857053B2 (en) 2002-04-10 2005-02-15 International Business Machines Corporation Method, system, and program for backing up objects by creating groups of objects
US7532340B2 (en) 2002-04-19 2009-05-12 Toshiba Tec Kabushiki Kaisha Document management system rule-based automation
US7546364B2 (en) 2002-05-16 2009-06-09 Emc Corporation Replication of remote copy data for internet protocol (IP) transmission
US7249118B2 (en) * 2002-05-17 2007-07-24 Aleri, Inc. Database system and methods
US6871163B2 (en) * 2002-05-31 2005-03-22 Sap Aktiengesellschaft Behavior-based adaptation of computer systems
US7269612B2 (en) 2002-05-31 2007-09-11 International Business Machines Corporation Method, system, and program for a policy based storage manager
AU2003245564A1 (en) * 2002-06-20 2004-01-06 Arizona Board Of Regents Method and arrangement of rotating magnetically inducible particles
US20040003078A1 (en) * 2002-06-26 2004-01-01 Todd Charlene J. Component management framework for high availability and related methods
AU2003252024A1 (en) * 2002-07-16 2004-02-02 Bruce L. Horn Computer system for automatic organization, indexing and viewing of information from multiple sources
US7085787B2 (en) 2002-07-19 2006-08-01 International Business Machines Corporation Capturing data changes utilizing data-space tracking
US20040125143A1 (en) * 2002-07-22 2004-07-01 Kenneth Deaton Display system and method for displaying a multi-dimensional file visualizer and chooser
US7031974B1 (en) * 2002-08-01 2006-04-18 Oracle International Corporation Replicating DDL changes using streams
US7316676B2 (en) * 2002-08-20 2008-01-08 Gholam A. Peyman Treatment of retinal detachment
AU2003270482A1 (en) 2002-09-09 2004-03-29 Commvault Systems, Inc. Dynamic storage device pooling in a computer system
US7307948B2 (en) 2002-10-21 2007-12-11 Emulex Design & Manufacturing Corporation System with multiple path fail over, fail back and load balancing
US7401064B1 (en) 2002-11-07 2008-07-15 Data Advantage Group, Inc. Method and apparatus for obtaining metadata from multiple information sources within an organization in real time
US7583861B2 (en) 2002-11-27 2009-09-01 Teramedica, Inc. Intelligent medical image management system
US7386531B2 (en) * 2002-12-19 2008-06-10 Mathon Systems, Inc. System and method for managing content
US20040128269A1 (en) 2002-12-27 2004-07-01 Milligan Charles A. System and method for managing data through families of inter-related metadata tables
US7890469B1 (en) * 2002-12-30 2011-02-15 Symantec Operating Corporation File change log
US7047236B2 (en) 2002-12-31 2006-05-16 International Business Machines Corporation Method for automatic deduction of rules for matching content to categories
US20040187075A1 (en) * 2003-01-08 2004-09-23 Maxham Jason G. Document management apparatus, system and method
JP4255699B2 (en) 2003-01-20 2009-04-15 株式会社日立製作所 Storage device control apparatus control method and storage device control apparatus
KR101168423B1 (en) 2003-02-05 2012-07-25 가부시키가이샤 자나비 인포메틱스 Path search method of navigation apparatus and display method of traffic information
US7343394B2 (en) 2003-03-10 2008-03-11 International Business Machines Corporation Method of managing e-mail messages
JP4322031B2 (en) 2003-03-27 2009-08-26 株式会社日立製作所 Storage device
EP1625526B1 (en) 2003-04-03 2012-10-03 Commvault Systems, Inc. System and method for dynamically performing storage operations in a computer network
US7158985B1 (en) 2003-04-09 2007-01-02 Cisco Technology, Inc. Method and apparatus for efficient propagation of large datasets under failure conditions
US7607010B2 (en) 2003-04-12 2009-10-20 Deep Nines, Inc. System and method for network edge data protection
US6839724B2 (en) 2003-04-17 2005-01-04 Oracle International Corporation Metamodel-based metadata change management
US7328366B2 (en) * 2003-06-06 2008-02-05 Cascade Basic Research Corp. Method and system for reciprocal data backup
JP4486927B2 (en) 2003-06-12 2010-06-23 富士通株式会社 User authentication system
WO2005001646A2 (en) 2003-06-25 2005-01-06 Arkivio, Inc. Techniques for performing policy automated operations
US7454569B2 (en) * 2003-06-25 2008-11-18 Commvault Systems, Inc. Hierarchical system and method for performing storage operations in a computer network
US7533103B2 (en) * 2003-07-22 2009-05-12 Sap Ag Self-describing business objects
US7246211B1 (en) 2003-07-22 2007-07-17 Swsoft Holdings, Ltd. System and method for using file system snapshots for online data backup
US7539728B2 (en) 2003-08-07 2009-05-26 International Business Machines Corporation Time sensitive electronic mail
JP4404246B2 (en) 2003-09-12 2010-01-27 株式会社日立製作所 Backup system and method based on data characteristics
US7647327B2 (en) * 2003-09-24 2010-01-12 Hewlett-Packard Development Company, L.P. Method and system for implementing storage strategies of a file autonomously of a user
JP4492084B2 (en) 2003-10-07 2010-06-30 株式会社日立製作所 Storage path control method
US7322493B2 (en) * 2003-10-09 2008-01-29 Polytop Corporation Dispensing closure having complete peripheral seal
US7200726B1 (en) * 2003-10-24 2007-04-03 Network Appliance, Inc. Method and apparatus for reducing network traffic during mass storage synchronization phase of synchronous data mirroring
JP4522073B2 (en) * 2003-10-24 2010-08-11 ユニ・チャーム株式会社 Disposable wearing articles
JP4066932B2 (en) 2003-11-10 2008-03-26 株式会社日立製作所 Computer resource allocation method based on prediction
GB2425198B (en) 2003-11-13 2008-04-09 Commvault Systems Inc System and method for performing a snapshot
GB2425199B (en) 2003-11-13 2007-08-15 Commvault Systems Inc System and method for combining data streams in pipelined storage operations in a storage network
US7440982B2 (en) 2003-11-13 2008-10-21 Commvault Systems, Inc. System and method for stored data archive verification
FI20031702A0 (en) * 2003-11-21 2003-11-21 Nokia Corp Allocation of multiple carriers for multiple users in a communication system
EP1687745A2 (en) * 2003-11-26 2006-08-09 Veritas Operating Corporation System and method for generating extensible file system metadata and file system content processing
US7328217B2 (en) * 2003-11-26 2008-02-05 Symantec Operating Corporation System and method for detecting and storing file identity change information within a file system
US7272606B2 (en) * 2003-11-26 2007-09-18 Veritas Operating Corporation System and method for detecting and storing file content access information within a file system
US7469262B2 (en) 2003-12-29 2008-12-23 Oracle International Corporation Customizable metadata merging framework
US7103740B1 (en) 2003-12-31 2006-09-05 Veritas Operating Corporation Backup mechanism for a multi-class file system
US7418464B2 (en) 2004-01-27 2008-08-26 International Business Machines Corporation Method, system, and program for storing data for retrieval and transfer
JP2005217815A (en) 2004-01-30 2005-08-11 Hitachi Ltd Path control method
WO2005078606A2 (en) 2004-02-11 2005-08-25 Storage Technology Corporation Clustered hierarchical file services
US7440966B2 (en) 2004-02-12 2008-10-21 International Business Machines Corporation Method and apparatus for file system snapshot persistence
US7197502B2 (en) 2004-02-18 2007-03-27 Friendly Polynomials, Inc. Machine-implemented activity management system using asynchronously shared activity data objects and journal data items
US7565139B2 (en) 2004-02-20 2009-07-21 Google Inc. Image-based search engine for mobile phones with camera
US7533181B2 (en) 2004-02-26 2009-05-12 International Business Machines Corporation Apparatus, system, and method for data access management
US20050198559A1 (en) * 2004-03-08 2005-09-08 Kabushiki Kaisha Toshiba Document information management system, document information management program, and document information management method
JP2005285047A (en) 2004-03-31 2005-10-13 Nec Corp Message distribution system, server and message distribution program
US20050228875A1 (en) 2004-04-13 2005-10-13 Arnold Monitzer System for estimating processing requirements
US8868670B2 (en) 2004-04-27 2014-10-21 Avaya Inc. Method and apparatus for summarizing one or more text messages using indicative summaries
US7213022B2 (en) * 2004-04-29 2007-05-01 Filenet Corporation Enterprise content management network-attached system
US7627670B2 (en) 2004-04-29 2009-12-01 International Business Machines Corporation Method and apparatus for scoring unsolicited e-mail
CA2564967C (en) 2004-04-30 2014-09-30 Commvault Systems, Inc. Hierarchical systems and methods for providing a unified view of storage information
US7340652B2 (en) 2004-04-30 2008-03-04 International Business Machines Corporation Invalidation of storage control unit cache metadata
US7617321B2 (en) 2004-05-07 2009-11-10 International Business Machines Corporation File system architecture requiring no direct access to user data from a metadata manager
US7386663B2 (en) 2004-05-13 2008-06-10 Cousins Robert E Transaction-based storage system and method that uses variable sized objects to store data
US7330997B1 (en) * 2004-06-03 2008-02-12 Gary Odom Selective reciprocal backup
JP4581500B2 (en) 2004-06-17 2010-11-17 株式会社日立製作所 Disaster recovery system, program, and database recovery method
US20060015524A1 (en) * 2004-06-18 2006-01-19 Allan Gardiner System and method for creating and recreating image-based databases
US8131674B2 (en) 2004-06-25 2012-03-06 Apple Inc. Methods and systems for managing data
US7730012B2 (en) * 2004-06-25 2010-06-01 Apple Inc. Methods and systems for managing data
US7383462B2 (en) 2004-07-02 2008-06-03 Hitachi, Ltd. Method and apparatus for encrypted remote copy for secure data backup and restoration
WO2006014504A2 (en) 2004-07-07 2006-02-09 Sciencelogic, Llc Self configuring network management system
US7131027B2 (en) 2004-07-09 2006-10-31 Hitachi, Ltd. Method and apparatus for disk array based I/O routing and multi-layered external storage linkage
US7590997B2 (en) 2004-07-30 2009-09-15 Broadband Itv, Inc. System and method for managing, converting and displaying video content on a video-on-demand platform, including ads used for drill-down navigation and consumer-generated classified ads
US20060047714A1 (en) 2004-08-30 2006-03-02 Mendocino Software, Inc. Systems and methods for rapid presentation of historical views of stored data
US7533230B2 (en) * 2004-10-13 2009-05-12 Hewlett-Packard Developmetn Company, L.P. Transparent migration of files among various types of storage volumes based on file access properties
DE102004051843B4 (en) 2004-10-25 2006-09-28 Repower Systems Ag Wind turbine and method for automatically correcting wind vane misadjustments
US8060650B2 (en) 2004-10-27 2011-11-15 Hewlett-Packard Development Company, L.P. Diagnosing a path in a storage network
US7809914B2 (en) 2004-11-05 2010-10-05 Commvault Systems, Inc. Methods and system of pooling storage devices
WO2006053050A2 (en) 2004-11-08 2006-05-18 Commvault Systems, Inc. System and method for performing auxiliary storage operations
US7512814B2 (en) * 2004-11-09 2009-03-31 Fortiva Inc. Secure and searchable storage system and method
US7792757B2 (en) 2004-11-17 2010-09-07 Iron Mountain Incorporated Systems and methods for risk based information management
US7529745B2 (en) 2004-11-19 2009-05-05 International Business Machines Corporation Method of verifying metadata of a migrated file
KR100611578B1 (en) 2004-11-23 2006-08-10 한국전자통신연구원 A resource allocation device for providing the differentiated service, and a method thereof
US7841011B2 (en) 2004-11-30 2010-11-23 Siebel Systems, Inc. Methods and apparatuses for tiered option specification
US7624443B2 (en) * 2004-12-21 2009-11-24 Microsoft Corporation Method and system for a self-heating device
US7657583B2 (en) 2004-12-29 2010-02-02 International Business Machines Corporation Calculating recovery time of an application system
US7512601B2 (en) * 2005-01-18 2009-03-31 Microsoft Corporation Systems and methods that enable search engines to present relevant snippets
US7370050B2 (en) 2005-02-28 2008-05-06 Microsoft Corporation Discoverability and enumeration mechanisms in a hierarchically secure storage system
US7966495B2 (en) * 2005-03-21 2011-06-21 Revinetix, Inc. Conserving file system with backup and validation
US7571441B2 (en) 2005-03-22 2009-08-04 Microsoft Corporation Efficient retrieval of information from a network service using soap
US7489639B2 (en) 2005-03-23 2009-02-10 International Business Machines Corporation Root-cause analysis of network performance problems
US7213116B2 (en) 2005-03-24 2007-05-01 Hitachi, Ltd. Method and apparatus for mirroring objects between storage systems
US8086569B2 (en) * 2005-03-30 2011-12-27 Emc Corporation Asynchronous detection of local event based point-in-time state of local-copy in the remote-copy in a delta-set asynchronous remote replication
US7461230B1 (en) 2005-03-31 2008-12-02 Symantec Operating Corporation Maintaining spatial locality of write operations
US20060248055A1 (en) 2005-04-28 2006-11-02 Microsoft Corporation Analysis and comparison of portfolios by classification
US8006125B1 (en) 2005-04-29 2011-08-23 Microsoft Corporation Automatic detection and recovery of corrupt disk metadata
US7454406B2 (en) 2005-04-29 2008-11-18 Adaptec, Inc. System and method of handling file metadata
US20080177640A1 (en) 2005-05-09 2008-07-24 Salih Burak Gokturk System and method for using image analysis and search in e-commerce
US20060277154A1 (en) 2005-06-02 2006-12-07 Lunt Tracy T Data structure generated in accordance with a method for identifying electronic files using derivative attributes created from native file attributes
US7617134B2 (en) 2005-06-17 2009-11-10 Match.Com, L.L.C. System and method for providing a certified photograph in a network environment
US7440984B2 (en) * 2005-06-28 2008-10-21 International Business Machines Corporation Reconciliation of local and remote backup data
US8209500B1 (en) 2005-06-30 2012-06-26 Symantec Operating Corporation Method and apparatus for providing intelligent interpretation of calendaring information to schedule computer data operations
US7496589B1 (en) * 2005-07-09 2009-02-24 Google Inc. Highly compressed randomly accessed storage of large tables with arbitrary columns
US7653622B2 (en) * 2005-07-29 2010-01-26 Microsoft Corporation Automated content categorization
US20070027929A1 (en) 2005-08-01 2007-02-01 Whelan Gary J System, method, and/or computer program product for a file system interface
US7716171B2 (en) 2005-08-18 2010-05-11 Emc Corporation Snapshot indexing
US9026512B2 (en) 2005-08-18 2015-05-05 Emc Corporation Data object search and retrieval
US8051045B2 (en) * 2005-08-31 2011-11-01 Sap Ag Archive indexing engine
WO2007036372A1 (en) 2005-09-08 2007-04-05 International Business Machines Corporation Load distribution in storage area networks
US7617541B2 (en) 2005-09-09 2009-11-10 Netapp, Inc. Method and/or system to authorize access to stored data
US8447827B2 (en) * 2005-09-15 2013-05-21 Emc Corporation Providing local access to managed content
JP4688617B2 (en) * 2005-09-16 2011-05-25 株式会社日立製作所 Storage control system and method
GB2430507A (en) * 2005-09-21 2007-03-28 Stephen Robert Ives System for managing the display of sponsored links together with search results on a mobile/wireless device
US8503624B2 (en) 2005-09-28 2013-08-06 Cisco Technology, Inc. Method and apparatus to process an incoming message
US7366859B2 (en) * 2005-10-06 2008-04-29 Acronis Inc. Fast incremental backup method and system
AU2006299819B2 (en) * 2005-10-12 2011-02-10 Carbonite Gmbh Method and system for data backup
US7822595B2 (en) 2005-10-12 2010-10-26 Storage Appliance Corporation Systems and methods for selectively copying embedded data files
US7689736B2 (en) 2005-11-07 2010-03-30 Dot Hill Systems Corporation Method and apparatus for a storage controller to dynamically determine the usage of onboard I/O ports
US7529748B2 (en) 2005-11-15 2009-05-05 Ji-Rong Wen Information classification paradigm
US7860968B2 (en) 2005-11-21 2010-12-28 Sap Ag Hierarchical, multi-tiered mapping and monitoring architecture for smart items
WO2007062258A2 (en) 2005-11-28 2007-05-31 Storagedna, Inc. Distributed file system with file fragmentation
WO2007064878A2 (en) 2005-12-01 2007-06-07 Firestar Software, Inc. System and method for exchanging information among exchange applications
US7620710B2 (en) 2005-12-19 2009-11-17 Commvault Systems, Inc. System and method for performing multi-path storage operations
US20200257596A1 (en) 2005-12-19 2020-08-13 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US7617262B2 (en) 2005-12-19 2009-11-10 Commvault Systems, Inc. Systems and methods for monitoring application data in a data replication system
US8930496B2 (en) 2005-12-19 2015-01-06 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US7962709B2 (en) * 2005-12-19 2011-06-14 Commvault Systems, Inc. Network redirector systems and methods for performing data replication
US20070143559A1 (en) 2005-12-20 2007-06-21 Yuichi Yagawa Apparatus, system and method incorporating virtualization for data storage
US20070150502A1 (en) 2005-12-22 2007-06-28 Bloebaum L S Methods, systems and computer program products for calendar based delivery of downloadable content
US7668796B2 (en) * 2006-01-06 2010-02-23 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Automata learning algorithms and processes for providing more complete systems requirements specification by scenario generation, CSP-based syntax-oriented model construction, and R2D2C system requirements transformation
US8117196B2 (en) * 2006-01-23 2012-02-14 Chacha Search, Inc. Search tool providing optional use of human search guides
US8392409B1 (en) 2006-01-23 2013-03-05 Symantec Corporation Methods, systems, and user interface for E-mail analysis and review
US20070208780A1 (en) 2006-03-02 2007-09-06 Anglin Matthew J Apparatus, system, and method for maintaining metadata for offline repositories in online databases for efficient access
JP4645483B2 (en) 2006-03-03 2011-03-09 富士ゼロックス株式会社 Electronic document system, program and method, and image forming apparatus
US20070250576A1 (en) 2006-04-21 2007-10-25 Shruti Kumar Method and system for automatically providing an abstract of a response message in a subject line of the response message
US20070256003A1 (en) 2006-04-24 2007-11-01 Seth Wagoner Platform for the interactive contextual augmentation of the web
US8028026B2 (en) 2006-05-31 2011-09-27 Microsoft Corporation Perimeter message filtering with extracted user-specific preferences
US20070282680A1 (en) * 2006-05-31 2007-12-06 Davis Corey T Systems and methods for providing an electronic channel for content generation and delivery
US8190571B2 (en) 2006-06-07 2012-05-29 Microsoft Corporation Managing data with backup server indexing
US20080005249A1 (en) 2006-07-03 2008-01-03 Hart Matt E Method and apparatus for determining the importance of email messages
US7809687B2 (en) 2006-08-04 2010-10-05 Apple Inc. Searching a backup archive
US7684651B2 (en) 2006-08-23 2010-03-23 Microsoft Corporation Image-based face search
US8495102B2 (en) * 2006-09-01 2013-07-23 International Business Machines Corporation Method, system, and program product for organizing a database
US8135685B2 (en) 2006-09-18 2012-03-13 Emc Corporation Information classification
US9141627B2 (en) * 2006-09-26 2015-09-22 Sony Corporation Providing a user access to data files distributed in a plurality of different types of user devices
US7882077B2 (en) 2006-10-17 2011-02-01 Commvault Systems, Inc. Method and system for offline indexing of content and classifying stored data
US7792789B2 (en) 2006-10-17 2010-09-07 Commvault Systems, Inc. Method and system for collaborative searching
US8370442B2 (en) 2008-08-29 2013-02-05 Commvault Systems, Inc. Method and system for leveraging identified changes to a mail server
US8085995B2 (en) 2006-12-01 2011-12-27 Google Inc. Identifying images using face recognition
US20080147878A1 (en) 2006-12-15 2008-06-19 Rajiv Kottomtharayil System and methods for granular resource management in a storage network
US20080228771A1 (en) 2006-12-22 2008-09-18 Commvault Systems, Inc. Method and system for searching stored data
US9015301B2 (en) 2007-01-05 2015-04-21 Digital Doors, Inc. Information infrastructure management tools with extractor, secure storage, content analysis and classification and method therefor
JP4295326B2 (en) * 2007-01-10 2009-07-15 株式会社日立製作所 Computer system
US20080183662A1 (en) * 2007-01-31 2008-07-31 Benjamin Clay Reed Resolving at least one file-path for a change-record of a computer file-system object in a computer file-system
US20080195455A1 (en) 2007-02-09 2008-08-14 Research In Motion Limited Electronic device and method of scheduling calendar events
US20080195619A1 (en) 2007-02-09 2008-08-14 Jain Rohit Rocky Electronic device and method of sharing calendar-event information
US7912816B2 (en) 2007-04-18 2011-03-22 Alumni Data Inc. Adaptive archive data management
US8732161B2 (en) 2007-04-27 2014-05-20 The Regents Of The University Of California Event based organization and access of digital photos
US20080281922A1 (en) 2007-05-09 2008-11-13 Microsoft Corporation Automatic generation of email previews and summaries
US8209617B2 (en) 2007-05-11 2012-06-26 Microsoft Corporation Summarization of attached, linked or related materials
US7920042B2 (en) * 2007-09-10 2011-04-05 Enpirion, Inc. Micromagnetic device and method of forming the same
US8250192B2 (en) 2007-10-12 2012-08-21 International Business Machines Corporation Data server administration using a chatbot
US7693940B2 (en) 2007-10-23 2010-04-06 International Business Machines Corporation Method and system for conversation detection in email systems
US8141152B1 (en) 2007-12-18 2012-03-20 Avaya Inc. Method to detect spam over internet telephony (SPIT)
US9495116B2 (en) 2007-12-26 2016-11-15 Sandisk Il Ltd. Storage device coordinator and a host device that includes the same
US7925856B1 (en) * 2007-12-28 2011-04-12 Symantec Corporation Method and apparatus for maintaining an amount of reserve space using virtual placeholders
US10169646B2 (en) 2007-12-31 2019-01-01 Applied Recognition Inc. Face authentication to mitigate spoofing
US9037560B2 (en) 2008-03-05 2015-05-19 Chacha Search, Inc. Method and system for triggering a search request
US8140630B2 (en) 2008-03-05 2012-03-20 International Business Machines Corporation Publish/subscribe message broker for message sequences
US7953945B2 (en) 2008-03-27 2011-05-31 International Business Machines Corporation System and method for providing a backup/restore interface for third party HSM clients
US9753948B2 (en) 2008-05-27 2017-09-05 Match.Com, L.L.C. Face search in personals
US8307177B2 (en) 2008-09-05 2012-11-06 Commvault Systems, Inc. Systems and methods for management of virtualization data
US9495382B2 (en) * 2008-12-10 2016-11-15 Commvault Systems, Inc. Systems and methods for performing discrete data replication
US20150089007A1 (en) 2008-12-12 2015-03-26 At&T Intellectual Property I, L.P. E-mail handling based on a behavioral history
US20100306171A1 (en) 2009-06-02 2010-12-02 Microsoft Corporation Timeline Experience for Restore User Interface
US20100333116A1 (en) 2009-06-30 2010-12-30 Anand Prahlad Cloud gateway system for managing data storage to cloud storage sites
WO2011001002A1 (en) 2009-06-30 2011-01-06 Nokia Corporation A method, devices and a service for searching
US20110010352A1 (en) 2009-07-07 2011-01-13 Chacha Search, Inc. Method and system of providing search tools
US8670597B2 (en) 2009-08-07 2014-03-11 Google Inc. Facial recognition with social network aiding
US8352465B1 (en) 2009-09-03 2013-01-08 Google Inc. Grouping of image search results
US8245135B2 (en) 2009-09-08 2012-08-14 International Business Machines Corporation Producing a visual summarization of text documents
US8605956B2 (en) 2009-11-18 2013-12-10 Google Inc. Automatically mining person models of celebrities for visual search applications
US9489266B2 (en) 2009-12-11 2016-11-08 Google Inc. System and method of storing backup image catalog
US8442983B2 (en) 2009-12-31 2013-05-14 Commvault Systems, Inc. Asynchronous methods of data classification using change journals and other data structures
US8495057B2 (en) 2010-05-17 2013-07-23 Microsoft Corporation Image searching with recognition suggestion
EP2402867B1 (en) 2010-07-02 2018-08-22 Accenture Global Services Limited A computer-implemented method, a computer program product and a computer system for image processing
US9189770B2 (en) 2010-09-16 2015-11-17 Bullhorn, Inc. Automatic tracking of contact interactions
US8364652B2 (en) 2010-09-30 2013-01-29 Commvault Systems, Inc. Content aligned block-based deduplication
US8572340B2 (en) 2010-09-30 2013-10-29 Commvault Systems, Inc. Systems and methods for retaining and using data block signatures in data protection operations
US9251507B2 (en) 2010-10-28 2016-02-02 International Business Machines Corporation Reducing email message size
US20120150818A1 (en) 2010-12-14 2012-06-14 Commvault Systems, Inc. Client-side repository in a networked deduplicated storage system
US9020900B2 (en) 2010-12-14 2015-04-28 Commvault Systems, Inc. Distributed deduplicated storage system
US20120155717A1 (en) 2010-12-16 2012-06-21 Microsoft Corporation Image search including facial image
US9342590B2 (en) 2010-12-23 2016-05-17 Microsoft Technology Licensing, Llc Keywords extraction and enrichment via categorization systems
US8639870B2 (en) 2011-01-14 2014-01-28 Oracle International Corporation String searching within peripheral storage devices
JP5232260B2 (en) 2011-03-11 2013-07-10 株式会社東芝 Topic extraction device and program
US8719264B2 (en) 2011-03-31 2014-05-06 Commvault Systems, Inc. Creating secondary copies of data based on searches for content
WO2012154164A1 (en) 2011-05-08 2012-11-15 Hewlett-Packard Development Company, L.P. Indicating documents in a thread reaching a threshold
US8930837B2 (en) 2011-05-23 2015-01-06 Facebook, Inc. Graphical user interface for map search
US20120304247A1 (en) 2011-05-25 2012-11-29 John Badger System and process for hierarchical tagging with permissions
US8909625B1 (en) 2011-06-02 2014-12-09 Google Inc. Image search
US8832096B1 (en) 2011-09-01 2014-09-09 Google Inc. Query-dependent image similarity
US20130069980A1 (en) 2011-09-15 2013-03-21 Beau R. Hartshorne Dynamically Cropping Images
JP5706966B2 (en) 2011-10-28 2015-04-22 株式会社日立製作所 Information processing system and file restoration method using the same
US20130124643A1 (en) 2011-11-11 2013-05-16 International Business Machines Corporation System and method for communication thread management
US8645349B2 (en) 2012-01-27 2014-02-04 Microsoft Corporation Indexing structures using synthetic document summaries
US9256862B2 (en) 2012-02-10 2016-02-09 International Business Machines Corporation Multi-tiered approach to E-mail prioritization
US20130218888A1 (en) 2012-02-21 2013-08-22 Avaya Inc. System and method for assigning tags in a calendar
US20130238375A1 (en) 2012-03-08 2013-09-12 Sven Graupner Evaluating email information and aggregating evaluation results
JP5857124B2 (en) 2012-05-24 2016-02-10 株式会社日立製作所 Image analysis apparatus, image analysis system, and image analysis method
US20130332451A1 (en) 2012-06-06 2013-12-12 Fliptop, Inc. System and method for correlating personal identifiers with corresponding online presence
US8892523B2 (en) 2012-06-08 2014-11-18 Commvault Systems, Inc. Auto summarization of content
US9098584B1 (en) 2012-07-19 2015-08-04 Google Inc. Image search privacy protection techniques
US9183205B1 (en) 2012-10-05 2015-11-10 Symantec Corporation User-based backup
US9830632B2 (en) 2012-10-10 2017-11-28 Ebay Inc. System and methods for personalization and enhancement of a marketplace
US20140136967A1 (en) 2012-11-09 2014-05-15 Research In Motion Limited Method of providing predictive text
US9235782B1 (en) 2012-12-24 2016-01-12 Google Inc. Searching images and identifying images with similar facial features
US9665591B2 (en) 2013-01-11 2017-05-30 Commvault Systems, Inc. High availability distributed deduplicated storage system
US20140201485A1 (en) 2013-01-14 2014-07-17 Commvault Systems, Inc. Pst file archiving
JP6080940B2 (en) 2013-02-28 2017-02-15 株式会社日立国際電気 Person search method and home staying person search device
US9405771B2 (en) 2013-03-14 2016-08-02 Microsoft Technology Licensing, Llc Associating metadata with images in a personal image collection
US20140283125A1 (en) 2013-03-15 2014-09-18 Ground Six Spaceworks Facial recognition-based information discovery
US9892172B2 (en) 2013-03-15 2018-02-13 Dropbox, Inc. Date and time handling
US9317736B1 (en) 2013-05-08 2016-04-19 Amazon Technologies, Inc. Individual record verification based on features
US9330183B2 (en) 2013-05-08 2016-05-03 Facebook, Inc. Approximate privacy indexing for search queries on online social networks
JP6099046B2 (en) 2013-06-11 2017-03-22 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation Apparatus and method for retrieving sentences
US20140379815A1 (en) 2013-06-24 2014-12-25 International Business Machines Corporation Aggregating message responses into topic-organized content
US9191345B2 (en) 2013-06-26 2015-11-17 Timyo Holdings, Inc. Method and system for exchanging emails
US9286328B2 (en) 2013-07-19 2016-03-15 International Business Machines Corporation Producing an image copy of a database object based on information within database buffer pools
CN104346370B (en) 2013-07-31 2018-10-23 阿里巴巴集团控股有限公司 Picture search, the method and device for obtaining image text information
WO2015047323A1 (en) 2013-09-27 2015-04-02 Hewlett-Packard Development Company, L. P. Notifying a user of critical emails via text messages
WO2015047377A1 (en) 2013-09-30 2015-04-02 Hewlett-Packard Development Company, L.P. Delivering an email attachment as a summary
US9015730B1 (en) 2013-12-17 2015-04-21 International Business Machines Corporation Natural language access to application programming interfaces
US20150242418A1 (en) 2014-02-27 2015-08-27 International Business Machines Corporation Device-based identification
WO2015151155A1 (en) 2014-03-31 2015-10-08 株式会社日立国際電気 Personal safety verification system and similarity search method for data encrypted for confidentiality
US20150341300A1 (en) 2014-05-20 2015-11-26 Sublime-Mail, Inc. Method and system for automated email categorization and end-user presentation
US9450902B2 (en) 2014-05-30 2016-09-20 Apple Inc. Method and system for marking email threads
US10187339B2 (en) 2014-06-26 2019-01-22 MailWise Email Solutions Ltd. Email message grouping
US9792364B2 (en) 2014-08-08 2017-10-17 Facebook, Inc. Blending search results on online social networks
US9405928B2 (en) 2014-09-17 2016-08-02 Commvault Systems, Inc. Deriving encryption rules based on file content
US9588704B2 (en) 2014-12-23 2017-03-07 Commvault Systems, Inc. Secondary storage operation instruction tags in information management systems
KR102402511B1 (en) 2015-02-03 2022-05-27 삼성전자주식회사 Method and device for searching image
US20160350391A1 (en) 2015-05-26 2016-12-01 Commvault Systems, Inc. Replication using deduplicated secondary copy data
US9652486B2 (en) 2015-06-07 2017-05-16 Apple Inc. Power saving techniques for a navigation application
US10783127B2 (en) 2015-06-17 2020-09-22 Disney Enterprises Inc. Componentized data storage
US9929997B2 (en) 2015-07-31 2018-03-27 Wipro Limited Method for dynamically prioritizing electronic messages in an electronic device
WO2017048723A1 (en) 2015-09-18 2017-03-23 Commvault Systems, Inc. Data storage management operations in a secondary storage subsystem using image recognition and image-based criteria
US10353994B2 (en) 2015-11-03 2019-07-16 Commvault Systems, Inc. Summarization of email on a client computing device based on content contribution to an email thread using classification and word frequency considerations
US20170161372A1 (en) 2015-12-04 2017-06-08 Codeq Llc Method and system for summarizing emails and extracting tasks
US10228962B2 (en) 2015-12-09 2019-03-12 Commvault Systems, Inc. Live synchronization and management of virtual machines across computing and virtualization platforms and using live synchronization to support disaster recovery
US10235467B2 (en) 2015-12-11 2019-03-19 Samsung Electronics Co., Ltd. Providing search results based on an estimated age of a current user of a mobile computing device
US10387266B2 (en) 2015-12-23 2019-08-20 Commvault Systems, Inc. Application-level live synchronization across computing platforms including synchronizing co-resident applications to disparate standby destinations and selectively synchronizing some applications and not others
US10310953B2 (en) 2015-12-30 2019-06-04 Commvault Systems, Inc. System for redirecting requests after a secondary storage computing device failure
US20170235647A1 (en) 2016-02-12 2017-08-17 Commvault Systems, Inc. Data protection operations based on network path information
US10684924B2 (en) 2016-02-18 2020-06-16 Commvault Systems, Inc. Data restoration operations based on network path information
US20180095938A1 (en) 2016-09-30 2018-04-05 Sap Se Synchronized calendar and timeline adaptive user interface
US10540516B2 (en) 2016-10-13 2020-01-21 Commvault Systems, Inc. Data protection within an unsecured storage environment
US20180315062A1 (en) 2017-04-26 2018-11-01 SalesWise, Inc. Systems and methods for aggregating, analyzing, and presenting data from multiple applications
US10984041B2 (en) 2017-05-11 2021-04-20 Commvault Systems, Inc. Natural language processing integrated with database and data storage management
US20190251204A1 (en) 2018-02-14 2019-08-15 Commvault Systems, Inc. Targeted search of backup data using calendar event data
US10642886B2 (en) 2018-02-14 2020-05-05 Commvault Systems, Inc. Targeted search of backup data using facial recognition

Patent Citations (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040010493A1 (en) * 1997-11-19 2004-01-15 Ns Solutions Corporation Database system and a method of data retrieval from the system
US6088697A (en) * 1997-12-18 2000-07-11 International Business Machines Corporation Dynamic change management in an extended remote copy operation
US6006225A (en) * 1998-06-15 1999-12-21 Amazon.Com Refining search queries by the suggestion of correlated terms from prior searches
US6516314B1 (en) * 1998-11-17 2003-02-04 Telefonaktiebolaget L M Ericsson (Publ) Optimization of change log handling
US20020069324A1 (en) * 1999-12-07 2002-06-06 Gerasimov Dennis V. Scalable storage architecture
US20100114952A1 (en) * 2000-04-04 2010-05-06 Robert Scanlon System and method for accessing data in disparate information sources
US20020049626A1 (en) * 2000-04-14 2002-04-25 Peter Mathias Method and system for interfacing clients with relationship management (RM) accounts and for permissioning marketing
US6507852B1 (en) * 2000-04-17 2003-01-14 Ncr Corporation Location-independent service for monitoring and alerting on an event log
US20010047365A1 (en) * 2000-04-19 2001-11-29 Hiawatha Island Software Co, Inc. System and method of packaging and unpackaging files into a markup language record for network search and archive services
US20030018607A1 (en) * 2000-08-04 2003-01-23 Lennon Alison Joan Method of enabling browse and search access to electronically-accessible multimedia databases
US20020069550A1 (en) * 2000-12-12 2002-06-13 Michikazu Noguchi Method of alignment between sheet materials, method of alignment, substrate assembling method and aligning apparatus
US20020161753A1 (en) * 2001-04-05 2002-10-31 Matsushita Electric Industrial Co., Ltd. Distributed document retrieval method and device, and distributed document retrieval program and recording medium recording the program
US20030130993A1 (en) * 2001-08-08 2003-07-10 Quiver, Inc. Document categorization engine
US20030046313A1 (en) * 2001-08-31 2003-03-06 Arkivio, Inc. Techniques for restoring data based on contents and attributes of the data
US20030182583A1 (en) * 2002-03-25 2003-09-25 Panareef Pty. Ltd. Electronic document classification and monitoring
US20060253495A1 (en) * 2002-04-02 2006-11-09 Png Teck H Metadata database management system and method therefor
US20040015514A1 (en) * 2002-04-03 2004-01-22 Austin Melton Method and system for managing data objects
US20050188248A1 (en) * 2003-05-09 2005-08-25 O'brien John Scalable storage architecture
US20040254919A1 (en) * 2003-06-13 2004-12-16 Microsoft Corporation Log parser
US20040260678A1 (en) * 2003-06-18 2004-12-23 Microsoft Corporation State based configuration failure detection using checkpoint comparison
US20050010588A1 (en) * 2003-07-08 2005-01-13 Zalewski Stephen H. Method and apparatus for determining replication schema against logical data disruptions
US20050050075A1 (en) * 2003-08-29 2005-03-03 Fujitsu Limited Data classification processing apparatus, data classification processing method and storage medium
US20050055386A1 (en) * 2003-09-05 2005-03-10 Sierra Wireless, Inc. A Canadian Corp. Mail server based application record synchronization
US20050055352A1 (en) * 2003-09-08 2005-03-10 Sony Corporation Content directory and synchronization bridge
US7165082B1 (en) * 2003-10-31 2007-01-16 Veritas Operating Corporation Incremental method for backup of email messages
US7634478B2 (en) * 2003-12-02 2009-12-15 Microsoft Corporation Metadata driven intelligent data navigation
US7720801B2 (en) * 2003-12-19 2010-05-18 Netapp, Inc. System and method for supporting asynchronous data replication with very short update intervals
US20050154695A1 (en) * 2004-01-09 2005-07-14 Oracle International Corporation Rule-based transformation of metadata
US7756837B2 (en) * 2004-01-09 2010-07-13 Index Engines, Inc. Methods and apparatus for searching backup data based on content and attributes
US20060294094A1 (en) * 2004-02-15 2006-12-28 King Martin T Processing techniques for text capture from a rendered document
US20050187937A1 (en) * 2004-02-25 2005-08-25 Fuji Xerox Co., Ltd. Computer program product, device system, and method for providing document view
US20050216453A1 (en) * 2004-03-23 2005-09-29 Koichi Sasaki System and method for data classification usable for data search
US20050228794A1 (en) * 2004-03-30 2005-10-13 Navas Julio C Method and apparatus for virtual content access systems built on a content routing network
US20050262097A1 (en) * 2004-05-07 2005-11-24 Sim-Tang Siew Y System for moving real-time data events across a plurality of devices in a network for simultaneous data protection, replication, and access services
US20060010227A1 (en) * 2004-06-01 2006-01-12 Rajeev Atluri Methods and apparatus for accessing data from a primary data storage system for secondary storage
US20060031263A1 (en) * 2004-06-25 2006-02-09 Yan Arrouye Methods and systems for managing data
US20070112809A1 (en) * 2004-06-25 2007-05-17 Yan Arrouye Methods and systems for managing data
US20070033191A1 (en) * 2004-06-25 2007-02-08 John Hornkvist Methods and systems for managing permissions data and/or indexes
US20060004820A1 (en) * 2004-07-01 2006-01-05 Claudatos Christopher H Storage pools for information management
US20060031225A1 (en) * 2004-08-06 2006-02-09 Grand Central Communications, Inc. Providing on-demand access to services in a wide area network
US20060106814A1 (en) * 2004-11-17 2006-05-18 Steven Blumenau Systems and methods for unioning different taxonomy tags for a digital asset
US20060224746A1 (en) * 2005-03-29 2006-10-05 Nec Corporation Presence service system, a presence apparatus, a presence service method, and a presence service program
US20060259468A1 (en) * 2005-05-10 2006-11-16 Michael Brooks Methods for electronic records management
US20060259527A1 (en) * 2005-05-13 2006-11-16 Devarakonda Murthy V Changed files list with time buckets for efficient storage management
US20070043956A1 (en) * 2005-08-19 2007-02-22 Microsoft Corporation System and methods that facilitate third party code test development
US20070100867A1 (en) * 2005-10-31 2007-05-03 Celik Aytek E System for displaying ads
US20070185925A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for classifying and transferring information in a storage network
US20070185917A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for classifying and transferring information in a storage network
US20070185915A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for classifying and transferring information in a storage network
US20070185926A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for classifying and transferring information in a storage network
US20070185916A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for classifying and transferring information in a storage network
US20070185914A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for using metadata to enhance data management operations
US20070185921A1 (en) * 2005-11-28 2007-08-09 Anand Prahlad Systems and methods for cataloging metadata for a metabase
US20070179995A1 (en) * 2005-11-28 2007-08-02 Anand Prahlad Metabase for facilitating data classification
US20070174840A1 (en) * 2005-12-30 2007-07-26 Microsoft Corporation Determining the level of availability of a computing resource
US20080091747A1 (en) * 2006-10-17 2008-04-17 Anand Prahlad System and method for storage operation access security
US20080229037A1 (en) * 2006-12-04 2008-09-18 Alan Bunte Systems and methods for creating copies of data, such as archive copies
US7734669B2 (en) * 2006-12-22 2010-06-08 Commvault Systems, Inc. Managing copies of data
US7840537B2 (en) * 2006-12-22 2010-11-23 Commvault Systems, Inc. System and method for storing redundant information
US20090319585A1 (en) * 2008-06-24 2009-12-24 Parag Gokhale Application-aware and remote single instance data management
US20090319534A1 (en) * 2008-06-24 2009-12-24 Parag Gokhale Application-aware and remote single instance data management
US20100082672A1 (en) * 2008-09-26 2010-04-01 Rajiv Kottomtharayil Systems and methods for managing single instancing data
US20100250549A1 (en) * 2009-03-30 2010-09-30 Muller Marcus S Storing a variable number of instances of data objects
US20100299490A1 (en) * 2009-05-22 2010-11-25 Attarde Deepak R Block-level single instancing

Cited By (172)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352433B2 (en) 1999-07-14 2013-01-08 Commvault Systems, Inc. Modular backup and retrieval system used in conjunction with a storage area network
US8930319B2 (en) 1999-07-14 2015-01-06 Commvault Systems, Inc. Modular backup and retrieval system used in conjunction with a storage area network
US8566278B2 (en) 1999-07-15 2013-10-22 Commvault Systems, Inc. Hierarchical systems and methods for performing data storage operations
US8433679B2 (en) 1999-07-15 2013-04-30 Commvault Systems, Inc. Modular systems and methods for managing data storage operations
US8041673B2 (en) 1999-07-15 2011-10-18 Commvault Systems, Inc. Hierarchical systems and methods for performing data storage operations
US8725731B2 (en) 2000-01-31 2014-05-13 Commvault Systems, Inc. Systems and methods for retrieving data in a computer network
US8725964B2 (en) 2000-01-31 2014-05-13 Commvault Systems, Inc. Interface systems and methods for accessing stored data
US8504634B2 (en) 2000-01-31 2013-08-06 Commvault Systems, Inc. Email attachment management in a computer system
US8214444B2 (en) 2000-01-31 2012-07-03 Commvault Systems, Inc. Email attachment management in a computer system
US9003137B2 (en) 2000-01-31 2015-04-07 Commvault Systems, Inc. Interface systems and methods for accessing stored data
US8086809B2 (en) 2000-01-31 2011-12-27 Commvault Systems, Inc. Interface systems and methods for accessing stored data
US8103670B2 (en) 2000-01-31 2012-01-24 Commvault Systems, Inc. Systems and methods for retrieving data in a computer network
US8266397B2 (en) 2000-01-31 2012-09-11 Commvault Systems, Inc. Interface systems and methods for accessing stored data
US8103829B2 (en) 2003-06-25 2012-01-24 Commvault Systems, Inc. Hierarchical systems and methods for performing storage operations in a computer network
US8402219B2 (en) 2003-06-25 2013-03-19 Commvault Systems, Inc. Hierarchical systems and methods for performing storage operations in a computer network
US9003117B2 (en) 2003-06-25 2015-04-07 Commvault Systems, Inc. Hierarchical systems and methods for performing storage operations in a computer network
US9619341B2 (en) 2003-11-13 2017-04-11 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US8195623B2 (en) 2003-11-13 2012-06-05 Commvault Systems, Inc. System and method for performing a snapshot and for restoring data
US9104340B2 (en) 2003-11-13 2015-08-11 Commvault Systems, Inc. Systems and methods for performing storage operations using network attached storage
US8190565B2 (en) 2003-11-13 2012-05-29 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US8645320B2 (en) 2003-11-13 2014-02-04 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US8266106B2 (en) 2003-11-13 2012-09-11 Commvault Systems, Inc. Systems and methods for performing storage operations using network attached storage
US8078583B2 (en) 2003-11-13 2011-12-13 Comm Vault Systems, Inc. Systems and methods for performing storage operations using network attached storage
US9405631B2 (en) 2003-11-13 2016-08-02 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US9208160B2 (en) 2003-11-13 2015-12-08 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US8886595B2 (en) 2003-11-13 2014-11-11 Commvault Systems, Inc. System and method for performing an image level snapshot and for restoring partial volume data
US8577844B2 (en) 2003-11-13 2013-11-05 Commvault Systems, Inc. Systems and methods for performing storage operations using network attached storage
US8352472B2 (en) 2005-11-28 2013-01-08 Commvault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US8725737B2 (en) 2005-11-28 2014-05-13 Commvault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US11256665B2 (en) 2005-11-28 2022-02-22 Commvault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US8131680B2 (en) 2005-11-28 2012-03-06 Commvault Systems, Inc. Systems and methods for using metadata to enhance data management operations
US8285964B2 (en) 2005-11-28 2012-10-09 Commvault Systems, Inc. Systems and methods for classifying and transferring information in a storage network
US8832406B2 (en) 2005-11-28 2014-09-09 Commvault Systems, Inc. Systems and methods for classifying and transferring information in a storage network
US8271548B2 (en) 2005-11-28 2012-09-18 Commvault Systems, Inc. Systems and methods for using metadata to enhance storage operations
US8285685B2 (en) 2005-11-28 2012-10-09 Commvault Systems, Inc. Metabase for facilitating data classification
US8010769B2 (en) 2005-11-28 2011-08-30 Commvault Systems, Inc. Systems and methods for classifying and transferring information in a storage network
US8131725B2 (en) 2005-11-28 2012-03-06 Comm Vault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US9098542B2 (en) 2005-11-28 2015-08-04 Commvault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US8612714B2 (en) 2005-11-28 2013-12-17 Commvault Systems, Inc. Systems and methods for classifying and transferring information in a storage network
US10198451B2 (en) 2005-11-28 2019-02-05 Commvault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US9606994B2 (en) 2005-11-28 2017-03-28 Commvault Systems, Inc. Systems and methods for using metadata to enhance data identification operations
US11442820B2 (en) 2005-12-19 2022-09-13 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US7962455B2 (en) 2005-12-19 2011-06-14 Commvault Systems, Inc. Pathname translation in a data replication system
US8024294B2 (en) 2005-12-19 2011-09-20 Commvault Systems, Inc. Systems and methods for performing replication copy storage operations
US9996430B2 (en) 2005-12-19 2018-06-12 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US8271830B2 (en) 2005-12-19 2012-09-18 Commvault Systems, Inc. Rolling cache configuration for a data replication system
US9208210B2 (en) 2005-12-19 2015-12-08 Commvault Systems, Inc. Rolling cache configuration for a data replication system
US8463751B2 (en) 2005-12-19 2013-06-11 Commvault Systems, Inc. Systems and methods for performing replication copy storage operations
US8285684B2 (en) 2005-12-19 2012-10-09 Commvault Systems, Inc. Systems and methods for performing data replication
US9971657B2 (en) 2005-12-19 2018-05-15 Commvault Systems, Inc. Systems and methods for performing data replication
US8655850B2 (en) 2005-12-19 2014-02-18 Commvault Systems, Inc. Systems and methods for resynchronizing information
US8656218B2 (en) 2005-12-19 2014-02-18 Commvault Systems, Inc. Memory configuration for data replication system including identification of a subsequent log entry by a destination computer
US9639294B2 (en) 2005-12-19 2017-05-02 Commvault Systems, Inc. Systems and methods for performing data replication
US9020898B2 (en) 2005-12-19 2015-04-28 Commvault Systems, Inc. Systems and methods for performing data replication
US9002799B2 (en) 2005-12-19 2015-04-07 Commvault Systems, Inc. Systems and methods for resynchronizing information
US8121983B2 (en) 2005-12-19 2012-02-21 Commvault Systems, Inc. Systems and methods for monitoring application data in a data replication system
US9298382B2 (en) 2005-12-19 2016-03-29 Commvault Systems, Inc. Systems and methods for performing replication copy storage operations
US8935210B2 (en) 2005-12-19 2015-01-13 Commvault Systems, Inc. Systems and methods for performing replication copy storage operations
US7962709B2 (en) 2005-12-19 2011-06-14 Commvault Systems, Inc. Network redirector systems and methods for performing data replication
US8725694B2 (en) 2005-12-19 2014-05-13 Commvault Systems, Inc. Systems and methods for performing replication copy storage operations
US8930496B2 (en) 2005-12-19 2015-01-06 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US8793221B2 (en) 2005-12-19 2014-07-29 Commvault Systems, Inc. Systems and methods for performing data replication
US9633064B2 (en) 2005-12-19 2017-04-25 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US8726242B2 (en) 2006-07-27 2014-05-13 Commvault Systems, Inc. Systems and methods for continuous data replication
US9003374B2 (en) 2006-07-27 2015-04-07 Commvault Systems, Inc. Systems and methods for continuous data replication
US9158835B2 (en) 2006-10-17 2015-10-13 Commvault Systems, Inc. Method and system for offline indexing of content and classifying stored data
US8037031B2 (en) 2006-10-17 2011-10-11 Commvault Systems, Inc. Method and system for offline indexing of content and classifying stored data
US10783129B2 (en) 2006-10-17 2020-09-22 Commvault Systems, Inc. Method and system for offline indexing of content and classifying stored data
US9509652B2 (en) 2006-11-28 2016-11-29 Commvault Systems, Inc. Method and system for displaying similar email messages based on message contents
US9967338B2 (en) 2006-11-28 2018-05-08 Commvault Systems, Inc. Method and system for displaying similar email messages based on message contents
US9639529B2 (en) 2006-12-22 2017-05-02 Commvault Systems, Inc. Method and system for searching stored data
US8615523B2 (en) 2006-12-22 2013-12-24 Commvault Systems, Inc. Method and system for searching stored data
US8234249B2 (en) 2006-12-22 2012-07-31 Commvault Systems, Inc. Method and system for searching stored data
US8290808B2 (en) 2007-03-09 2012-10-16 Commvault Systems, Inc. System and method for automating customer-validated statement of work for a data storage environment
US8428995B2 (en) 2007-03-09 2013-04-23 Commvault Systems, Inc. System and method for automating customer-validated statement of work for a data storage environment
US8799051B2 (en) 2007-03-09 2014-08-05 Commvault Systems, Inc. System and method for automating customer-validated statement of work for a data storage environment
US20080320259A1 (en) * 2007-06-21 2008-12-25 Garg Vijay K Method for Providing Fault Tolerance to Multiple Servers
US7831859B2 (en) * 2007-06-21 2010-11-09 The Board Of Regents, University Of Texas System Method for providing fault tolerance to multiple servers
US8356018B2 (en) 2008-01-30 2013-01-15 Commvault Systems, Inc. Systems and methods for grid-based data scanning
US10708353B2 (en) 2008-08-29 2020-07-07 Commvault Systems, Inc. Method and system for displaying similar email messages based on message contents
US11516289B2 (en) 2008-08-29 2022-11-29 Commvault Systems, Inc. Method and system for displaying similar email messages based on message contents
US11082489B2 (en) 2008-08-29 2021-08-03 Commvault Systems, Inc. Method and system for displaying similar email messages based on message contents
US8666942B2 (en) 2008-12-10 2014-03-04 Commvault Systems, Inc. Systems and methods for managing snapshots of replicated databases
US9047357B2 (en) 2008-12-10 2015-06-02 Commvault Systems, Inc. Systems and methods for managing replicated database data in dirty and clean shutdown states
US8204859B2 (en) 2008-12-10 2012-06-19 Commvault Systems, Inc. Systems and methods for managing replicated database data
US9495382B2 (en) 2008-12-10 2016-11-15 Commvault Systems, Inc. Systems and methods for performing discrete data replication
US9396244B2 (en) 2008-12-10 2016-07-19 Commvault Systems, Inc. Systems and methods for managing replicated database data
US9047296B2 (en) 2009-12-31 2015-06-02 Commvault Systems, Inc. Asynchronous methods of data classification using change journals and other data structures
US8442983B2 (en) 2009-12-31 2013-05-14 Commvault Systems, Inc. Asynchronous methods of data classification using change journals and other data structures
US20110187861A1 (en) * 2010-02-01 2011-08-04 Beat-Sonic Co., Ltd. Vehicle-mounted surveillance device
US8504517B2 (en) 2010-03-29 2013-08-06 Commvault Systems, Inc. Systems and methods for selective data replication
US8868494B2 (en) 2010-03-29 2014-10-21 Commvault Systems, Inc. Systems and methods for selective data replication
US8352422B2 (en) 2010-03-30 2013-01-08 Commvault Systems, Inc. Data restore systems and methods in a replication environment
US8504515B2 (en) 2010-03-30 2013-08-06 Commvault Systems, Inc. Stubbing systems and methods in a data replication environment
US8725698B2 (en) 2010-03-30 2014-05-13 Commvault Systems, Inc. Stub file prioritization in a data replication system
US9002785B2 (en) 2010-03-30 2015-04-07 Commvault Systems, Inc. Stubbing systems and methods in a data replication environment
US9483511B2 (en) 2010-03-30 2016-11-01 Commvault Systems, Inc. Stubbing systems and methods in a data replication environment
US8589347B2 (en) 2010-05-28 2013-11-19 Commvault Systems, Inc. Systems and methods for performing data replication
US8572038B2 (en) 2010-05-28 2013-10-29 Commvault Systems, Inc. Systems and methods for performing data replication
US8489656B2 (en) 2010-05-28 2013-07-16 Commvault Systems, Inc. Systems and methods for performing data replication
US8745105B2 (en) 2010-05-28 2014-06-03 Commvault Systems, Inc. Systems and methods for performing data replication
US9578101B2 (en) 2011-01-20 2017-02-21 Commvault Systems, Inc. System and method for sharing san storage
US11228647B2 (en) 2011-01-20 2022-01-18 Commvault Systems, Inc. System and method for sharing SAN storage
US9021198B1 (en) 2011-01-20 2015-04-28 Commvault Systems, Inc. System and method for sharing SAN storage
US10372675B2 (en) 2011-03-31 2019-08-06 Commvault Systems, Inc. Creating secondary copies of data based on searches for content
US8719264B2 (en) 2011-03-31 2014-05-06 Commvault Systems, Inc. Creating secondary copies of data based on searches for content
US11003626B2 (en) 2011-03-31 2021-05-11 Commvault Systems, Inc. Creating secondary copies of data based on searches for content
US9274898B2 (en) 2011-09-09 2016-03-01 Nokia Technologies Oy Method and apparatus for providing criticality based data backup
WO2013034798A1 (en) * 2011-09-09 2013-03-14 Nokia Corporation Method and apparatus for providing criticality based data backup
US9471578B2 (en) 2012-03-07 2016-10-18 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US9298715B2 (en) 2012-03-07 2016-03-29 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US9898371B2 (en) 2012-03-07 2018-02-20 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US9928146B2 (en) 2012-03-07 2018-03-27 Commvault Systems, Inc. Data storage system utilizing proxy device for storage operations
US11269543B2 (en) 2012-04-23 2022-03-08 Commvault Systems, Inc. Integrated snapshot interface for a data storage system
US10698632B2 (en) 2012-04-23 2020-06-30 Commvault Systems, Inc. Integrated snapshot interface for a data storage system
US9342537B2 (en) 2012-04-23 2016-05-17 Commvault Systems, Inc. Integrated snapshot interface for a data storage system
US9928002B2 (en) 2012-04-23 2018-03-27 Commvault Systems, Inc. Integrated snapshot interface for a data storage system
US8892523B2 (en) 2012-06-08 2014-11-18 Commvault Systems, Inc. Auto summarization of content
US11036679B2 (en) 2012-06-08 2021-06-15 Commvault Systems, Inc. Auto summarization of content
US11580066B2 (en) 2012-06-08 2023-02-14 Commvault Systems, Inc. Auto summarization of content for use in new storage policies
US9418149B2 (en) 2012-06-08 2016-08-16 Commvault Systems, Inc. Auto summarization of content
US10372672B2 (en) 2012-06-08 2019-08-06 Commvault Systems, Inc. Auto summarization of content
US9430491B2 (en) 2013-01-11 2016-08-30 Commvault Systems, Inc. Request-based data synchronization management
US9336226B2 (en) 2013-01-11 2016-05-10 Commvault Systems, Inc. Criteria-based data synchronization management
US9886346B2 (en) 2013-01-11 2018-02-06 Commvault Systems, Inc. Single snapshot for multiple agents
US11847026B2 (en) 2013-01-11 2023-12-19 Commvault Systems, Inc. Single snapshot for multiple agents
US10853176B2 (en) 2013-01-11 2020-12-01 Commvault Systems, Inc. Single snapshot for multiple agents
US9262435B2 (en) 2013-01-11 2016-02-16 Commvault Systems, Inc. Location-based data synchronization management
US10223365B2 (en) 2014-01-24 2019-03-05 Commvault Systems, Inc. Snapshot readiness checking and reporting
US9892123B2 (en) 2014-01-24 2018-02-13 Commvault Systems, Inc. Snapshot readiness checking and reporting
US9495251B2 (en) 2014-01-24 2016-11-15 Commvault Systems, Inc. Snapshot readiness checking and reporting
US9639426B2 (en) 2014-01-24 2017-05-02 Commvault Systems, Inc. Single snapshot for multiple applications
US10572444B2 (en) 2014-01-24 2020-02-25 Commvault Systems, Inc. Operation readiness checking and reporting
US9632874B2 (en) 2014-01-24 2017-04-25 Commvault Systems, Inc. Database application backup in single snapshot for multiple applications
US9753812B2 (en) 2014-01-24 2017-09-05 Commvault Systems, Inc. Generating mapping information for single snapshot for multiple applications
US10671484B2 (en) 2014-01-24 2020-06-02 Commvault Systems, Inc. Single snapshot for multiple applications
US10942894B2 (en) 2014-01-24 2021-03-09 Commvault Systems, Inc Operation readiness checking and reporting
US10042716B2 (en) 2014-09-03 2018-08-07 Commvault Systems, Inc. Consolidated processing of storage-array commands using a forwarder media agent in conjunction with a snapshot-control media agent
US9774672B2 (en) 2014-09-03 2017-09-26 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US10419536B2 (en) 2014-09-03 2019-09-17 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US10044803B2 (en) 2014-09-03 2018-08-07 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US10798166B2 (en) 2014-09-03 2020-10-06 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US11245759B2 (en) 2014-09-03 2022-02-08 Commvault Systems, Inc. Consolidated processing of storage-array commands by a snapshot-control media agent
US10891197B2 (en) 2014-09-03 2021-01-12 Commvault Systems, Inc. Consolidated processing of storage-array commands using a forwarder media agent in conjunction with a snapshot-control media agent
US9648105B2 (en) 2014-11-14 2017-05-09 Commvault Systems, Inc. Unified snapshot storage management, using an enhanced storage manager and enhanced media agents
US9921920B2 (en) 2014-11-14 2018-03-20 Commvault Systems, Inc. Unified snapshot storage management, using an enhanced storage manager and enhanced media agents
US9448731B2 (en) 2014-11-14 2016-09-20 Commvault Systems, Inc. Unified snapshot storage management
US10628266B2 (en) 2014-11-14 2020-04-21 Commvault System, Inc. Unified snapshot storage management
US11507470B2 (en) 2014-11-14 2022-11-22 Commvault Systems, Inc. Unified snapshot storage management
US9996428B2 (en) 2014-11-14 2018-06-12 Commvault Systems, Inc. Unified snapshot storage management
US10521308B2 (en) 2014-11-14 2019-12-31 Commvault Systems, Inc. Unified snapshot storage management, using an enhanced storage manager and enhanced media agents
US10503753B2 (en) 2016-03-10 2019-12-10 Commvault Systems, Inc. Snapshot replication operations based on incremental block change tracking
US11836156B2 (en) 2016-03-10 2023-12-05 Commvault Systems, Inc. Snapshot replication operations based on incremental block change tracking
US11238064B2 (en) 2016-03-10 2022-02-01 Commvault Systems, Inc. Snapshot replication operations based on incremental block change tracking
US10540516B2 (en) 2016-10-13 2020-01-21 Commvault Systems, Inc. Data protection within an unsecured storage environment
US11443061B2 (en) 2016-10-13 2022-09-13 Commvault Systems, Inc. Data protection within an unsecured storage environment
US10389810B2 (en) 2016-11-02 2019-08-20 Commvault Systems, Inc. Multi-threaded scanning of distributed file systems
US11669408B2 (en) 2016-11-02 2023-06-06 Commvault Systems, Inc. Historical network data-based scanning thread generation
US11677824B2 (en) 2016-11-02 2023-06-13 Commvault Systems, Inc. Multi-threaded scanning of distributed file systems
US10922189B2 (en) 2016-11-02 2021-02-16 Commvault Systems, Inc. Historical network data-based scanning thread generation
US10798170B2 (en) 2016-11-02 2020-10-06 Commvault Systems, Inc. Multi-threaded scanning of distributed file systems
US10984041B2 (en) 2017-05-11 2021-04-20 Commvault Systems, Inc. Natural language processing integrated with database and data storage management
US10740022B2 (en) 2018-02-14 2020-08-11 Commvault Systems, Inc. Block-level live browsing and private writable backup copies using an ISCSI server
US11422732B2 (en) 2018-02-14 2022-08-23 Commvault Systems, Inc. Live browsing and private writable environments based on snapshots and/or backup copies provided by an ISCSI server
US10732885B2 (en) 2018-02-14 2020-08-04 Commvault Systems, Inc. Block-level live browsing and private writable snapshots using an ISCSI server
US10642886B2 (en) 2018-02-14 2020-05-05 Commvault Systems, Inc. Targeted search of backup data using facial recognition
US11159469B2 (en) 2018-09-12 2021-10-26 Commvault Systems, Inc. Using machine learning to modify presentation of mailbox objects
US11042318B2 (en) 2019-07-29 2021-06-22 Commvault Systems, Inc. Block-level data replication
US11709615B2 (en) 2019-07-29 2023-07-25 Commvault Systems, Inc. Block-level data replication
US11494417B2 (en) 2020-08-07 2022-11-08 Commvault Systems, Inc. Automated email classification in an information management system
WO2022182911A1 (en) * 2021-02-24 2022-09-01 Nebulon, Inc. Efficient encryption in storage providing data-at-rest encryption and data mirroring
US11809285B2 (en) 2022-02-09 2023-11-07 Commvault Systems, Inc. Protecting a management database of a data storage management system to meet a recovery point objective (RPO)

Also Published As

Publication number Publication date
US20110078146A1 (en) 2011-03-31
US20070203937A1 (en) 2007-08-30
US7660800B2 (en) 2010-02-09
US20070198570A1 (en) 2007-08-23
WO2007062429A3 (en) 2008-06-05
US7711700B2 (en) 2010-05-04
WO2007062254A2 (en) 2007-05-31
US7613752B2 (en) 2009-11-03
US20070192360A1 (en) 2007-08-16
US20110178986A1 (en) 2011-07-21
US20070203938A1 (en) 2007-08-30
US8131680B2 (en) 2012-03-06
US20110047180A1 (en) 2011-02-24
US20070198601A1 (en) 2007-08-23
US8725737B2 (en) 2014-05-13
US20070179995A1 (en) 2007-08-02
US8285685B2 (en) 2012-10-09
US20070185916A1 (en) 2007-08-09
US20070185925A1 (en) 2007-08-09
US7937393B2 (en) 2011-05-03
AU2006318338A1 (en) 2007-05-31
WO2007062254A3 (en) 2007-09-20
CA2629833C (en) 2015-10-27
US8832406B2 (en) 2014-09-09
US20210349856A1 (en) 2021-11-11
US7668884B2 (en) 2010-02-23
US20120173531A1 (en) 2012-07-05
US8352472B2 (en) 2013-01-08
US20190227993A1 (en) 2019-07-25
US20070185914A1 (en) 2007-08-09
US8051095B2 (en) 2011-11-01
US8271548B2 (en) 2012-09-18
US20130013609A1 (en) 2013-01-10
US20150339296A1 (en) 2015-11-26
CA2837984C (en) 2021-11-16
EP1960903A2 (en) 2008-08-27
US8612714B2 (en) 2013-12-17
US10198451B2 (en) 2019-02-05
US7831795B2 (en) 2010-11-09
US7831553B2 (en) 2010-11-09
EP1960918A2 (en) 2008-08-27
US20130007002A1 (en) 2013-01-03
WO2007062429A2 (en) 2007-05-31
US7801864B2 (en) 2010-09-21
US20100131467A1 (en) 2010-05-27
US20140101160A1 (en) 2014-04-10
CA2629833A1 (en) 2007-05-31
US20100211571A1 (en) 2010-08-19
US20070198593A1 (en) 2007-08-23
US20070198612A1 (en) 2007-08-23
US7734593B2 (en) 2010-06-08
US20070198608A1 (en) 2007-08-23
US7707178B2 (en) 2010-04-27
CA2631197A1 (en) 2007-05-31
US8285964B2 (en) 2012-10-09
US11256665B2 (en) 2022-02-22
US7747579B2 (en) 2010-06-29
EP2375347A2 (en) 2011-10-12
US7849059B2 (en) 2010-12-07
US20170185622A1 (en) 2017-06-29
US20100131461A1 (en) 2010-05-27
US20070198613A1 (en) 2007-08-23
US20070198611A1 (en) 2007-08-23
US20110276664A1 (en) 2011-11-10
CA2631197C (en) 2013-01-29
US20070192385A1 (en) 2007-08-16
US9098542B2 (en) 2015-08-04
US7657550B2 (en) 2010-02-02
CA2837984A1 (en) 2007-05-31
US20070185921A1 (en) 2007-08-09
US7725671B2 (en) 2010-05-25
US20100114829A1 (en) 2010-05-06
US7660807B2 (en) 2010-02-09
EP1960903A4 (en) 2009-01-28
US20070185915A1 (en) 2007-08-09
US8131725B2 (en) 2012-03-06
US20110016163A1 (en) 2011-01-20
US7831622B2 (en) 2010-11-09
US8010769B2 (en) 2011-08-30
US20140358935A1 (en) 2014-12-04
AU2006318338A2 (en) 2008-09-11
EP2375347A3 (en) 2012-12-19
US9606994B2 (en) 2017-03-28
US7631151B2 (en) 2009-12-08

Similar Documents

Publication Publication Date Title
US8832406B2 (en) Systems and methods for classifying and transferring information in a storage network
US7822749B2 (en) Systems and methods for classifying and transferring information in a storage network

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION