US20080313209A1 - Partition/table allocation on demand - Google Patents
Partition/table allocation on demand Download PDFInfo
- Publication number
- US20080313209A1 US20080313209A1 US11/764,131 US76413107A US2008313209A1 US 20080313209 A1 US20080313209 A1 US 20080313209A1 US 76413107 A US76413107 A US 76413107A US 2008313209 A1 US2008313209 A1 US 2008313209A1
- Authority
- US
- United States
- Prior art keywords
- space
- metadata
- segment
- data
- processors
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- G06F16/24554—Unary operations; Data partitioning operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
Definitions
- the present invention relates generally to data storage and, more particularly, to the on-demand allocation of data storage spaces and partitions.
- Data stored on a computer system is typically arranged into one or more data storage spaces. Collectively, these data storage spaces are often referred to as a database. Each data storage space comprises one or more data items. Data items in a particular space share common characteristics. A data item may have a value for each of these characteristics. For example, relational databases store data in a number of spaces known as tables. The data items in each table, forming the “rows” of the table, share the same “columns” of data, in that for each column of data, any item in the table may have a value.
- partition data storage spaces for administrative purposes such as archiving, caching, enhancing performance, copying or deleting data, and free space management.
- spaces that store data items with date characteristics are often partitioned so that each partition comprises only those items that pertain to a particular range of dates.
- One partition for example, might only store data items pertaining to a particular month.
- Another partition might only store data items that pertain to a particular fiscal quarter. Since a partition also comprises data items that share common characteristics, a partition may also be considered a data storage space.
- the determination of to which, if any, partition a data item pertains is made by looking up one or more of the data item's values in a partition mapping.
- the partition mapping maps certain sets or ranges of values to certain partitions. These sets or ranges of values correspond to one or more characteristics shared by the data items in the partitioned storage space. These characteristics are known as partitioning characteristics. For tables, these sets or ranges of values may correspond to the value of a particular column upon which the partition mapping is said to be based. This column is known as the partitioning column. For example, a partition mapping for a table might be based upon the value of a data item's date column. The mapping could define ranges of dates, such as months or years. Each range could pertain to a separate partition.
- Partition mappings may be based on multiple partitioning columns, which is often the case with subpartitions. Partition mappings may also be based on a variety of other characteristics, such as whether a data item pertains to a particular range of numbers or set of discrete values.
- a database system When a new data storage space (or partition) is created, a database system typically performs a number of tasks. One of these tasks is to allocate a segment for the space.
- a segment is the region within a system's memory or filesystem wherein data for a storage space is stored. The segment may be located via a corresponding segment address. The size of the segment may be defined during the creation process, or may be determined by the database system based on factors such as characteristics of the data storage space and database configuration parameters.
- Metadata describing the new space is subsequently maintained by the database system.
- Database systems typically maintain metadata describing each data storage space and partition.
- metadata may describe, for instance, a data space's name, segment address, and segment size.
- the metadata may also indicate information that helps interpret the data stored within the segment, such as information about the characteristics of the data items within the data storage space. For example, it may define the size, name, and type of each column of data found within a table. It may also describe a partition's name and mapping scheme. It may also describe performance or functionality enhancing ancillary objects such as indexes. Many database systems maintain this metadata in one or more system storage spaces.
- Techniques are provided for the on-demand allocation of segments and creation of metadata for previously-created data storage spaces and partitions. By executing the tasks of allocating segments and creating certain (but not necessarily all) metadata the first time that a data storage space is used as opposed to at the time of the space's creation, the techniques disclosed guarantee that unused spaces do not waste system resources with empty segments and unnecessary metadata, thus overcoming a major disadvantage of up-front storage space creation strategies.
- data is received describing a space to be created in a database system. Based on the data, metadata describing the space is created and maintained in the database system. Data indicating that the space has been created is returned without allocating a segment for the space.
- data is received indicating a new item to be stored in the database system. It is determined that the new item should be stored in a space for which no segment has previously been allocated. In response to this determination, a segment is allocated for the space. The new item can then be stored in the space. Metadata describing the space is also created in response to the determination.
- a space is created in a database system.
- first metadata describing the space is created and maintained in the database system.
- Data is received indicating a new item.
- a segment is allocated for the space.
- Second metadata describing the space is also created in response to the determination.
- the new item can then be stored in the space.
- the first metadata indicates information necessary to allocate a segment for the space, determine that an item pertains to the space, and generate the second metadata.
- the second metadata indicates any information essential to the normal operation of the data storage space not contained in the first metadata.
- FIG. 1A depicts an exemplary database system in which an embodiment of the invention may be practiced.
- FIG. 1B depicts an exemplary database system in which a new data storage space has been created according to an embodiment of the invention.
- FIG. 1C depicts an exemplary database system in which a new data item has been added according to an embodiment of the invention.
- FIG. 2 is a flowchart illustrating the operation of an embodiment of the invention in which a data storage space is created without allocating a segment for the space.
- FIG. 3 is a flowchart illustrating the operation of an embodiment of the invention in which a segment is allocated for a previously created data storage space on demand instead of when the space was created.
- FIG. 4 is a block diagram that illustrates a computer system upon which an embodiment of the invention may be implemented.
- FIG. 1A depicts an exemplary database system in which an embodiment of the invention may be practiced.
- Database system 100 is a relational database comprising a number of data storage spaces.
- the term “space” refers to database objects such as tables and partitions. Among these spaces are table 110 , storing example data, and system tables 120 , 130 , and 140 , storing metadata describing spaces in database system 100 .
- Database system 100 may reside on any computing system, including a single computer or system of clustered servers.
- System table 120 comprises data indicating the name of each table in the database.
- row 122 indicates that there is a table named sales in the database.
- the name of table 110 is sales.
- System table 130 comprises data indicating the columns that may be found in each table within the database. For example, row 132 indicates that there is a column named stores within the sales table. Row 134 indicates that there is a column named amount within the sales table. Indeed, table 110 contains both of these columns.
- System table 140 comprises data indicating the location of the segment wherein the data for a particular space may be found.
- row 142 indicates that the segment for the table named sales is found at the address 0 ⁇ 000.
- table 110 is located within segment 150 , which is depicted to start at address 0 ⁇ 0001.
- Segment 150 stores the data constituting table 110 .
- Segment 150 may reside on any medium capable of storing data, including in system memory or on a physical disc within the system. It should be noted that table 110 is merely an interpretation of the data stored within segment 150 , based on the previously described metadata from system tables 120 and 130 . Table 110 is not necessarily representative of how the data in segment 150 is actually stored. Indeed, the data in segment 150 may be stored using any means known within the art, as long as it may be interpreted by database system 100 to represent table 110 . The same holds true of any table or segment within database system 100 .
- FIG. 1B depicts an exemplary database system in which a new data storage space has been created according to an embodiment of the invention.
- FIG. 1B depicts the changes made to database system 100 of FIG. 1A in response to SQL statement 180 , which indicates a data storage space to add to database system 100 .
- SQL statement 180 is the following statement:
- Database system 100 Data indicating this SQL statement has been received by database system 100 .
- database system 100 has created a table named expenses with number-based columns store and amount. However, because no data items pertaining to the table named expenses have been received by database system 100 , database system 100 has not allocated a segment for the table named expenses.
- Database system 100 has, however, created metadata describing the table named expenses. This metadata has been stored within the database as rows 126 , 136 , and 138 .
- Row 126 indicates that there is a table named expenses within database system 100 .
- Row 136 indicates that there is column named store within the expenses table.
- Row 138 indicates that there is a column named amount within the expenses table.
- database system 100 may continue to function normally with regards to operations concerning any table without an allocated segment, as long as the operation does not result in data being stored in the table.
- This technique may be modified to accommodate metadata other than that depicted in FIG. 1B .
- metadata could be stored within the database to indicate these qualities.
- One of the depicted system tables could be modified to store this metadata, or other system tables could be used.
- the database system may create metadata indicating all information necessary to allocate fully a segment for the space in the future, as well as all information necessary to generate any other metadata that may be required for normal operations upon segment allocation.
- This metadata may fully describe, for example, each column within the storage space.
- This metadata may also indicate information necessary to determine which data items should be stored in the space, such as a user-defined name for the table, or, in the case of partitions, a partition mapping scheme.
- FIG. 1C depicts an exemplary database system in which a new data item has been added according to an embodiment of the invention.
- Database system 100 is the same as depicted in FIG. 1B , except that a new segment has been allocated and new metadata has been created. These changes were made after receiving data indicating the SQL statement 181 , which reads as follows:
- This SQL statement instructed database system 100 to add a new data item to the table named expenses. Based on system table 120 , database system 100 determined that database system 100 does indeed contain a table named expenses to which the new data item may be added. However, when database system 100 tried to locate the segment for the expenses table, database system 100 discovered that there was no row in system table 140 of FIG. 1B for the expenses table. Accordingly, database system 100 determined that no segment had previously been allocated for the expenses table.
- table 170 comprises two columns, store and amount. Having fully allocated a segment for the expenses table, and having created metadata describing the segment, the new data item was stored in table 170 as row 172 .
- Metadata other than that depicted in FIG. 1C may be created in response to determining that a new item should be stored in a data storage space for which no segment has previously been allocated. For example, ancillary objects such as indexes may be created at this time. If the data storage space is a partition, a partition name may be created at this time as well. Metadata indicating such information could be stored in a modified version of one of the depicted tables or in other system tables.
- the techniques described above may be implemented for spaces other than tables and in non-relational databases.
- the metadata may be maintained in forms other than as system tables.
- the segment$ table could indicate the segment at which each partition may be found.
- a partition$ table could describe the partitions and their mappings.
- a determination of whether a new item pertains to a partition for which no segment previously has been allocated could be made by determining which partition the item is mapped to in the relevant partition mapping, and then determining whether there is an entry for that partition in the segment$ table.
- FIG. 2 is a flowchart illustrating the operation of an embodiment of the invention in which a data storage space is created without allocating a segment for the space.
- step 210 data is received indicating a space to be created in the database.
- the data may be, for example, an SQL statement such as CREATE TABLE or a database schema.
- the data may also describe characteristics of the space.
- the space may be any data storage space, including a table or partition of a table.
- step 220 based on this data, metadata is created describing the space.
- This metadata may be maintained within system tables in the database, or in other data storage locations.
- the metadata may comprise data indicating information sufficient to allocate a segment for the space in the future and allow for normal operations with relation to the space once the segment has been allocated.
- the metadata may describe the name of the space, characteristics of the space such as column names and types, and the size of the segment that should be allocated to the space. Because this information may have been indicated in the data received in step 210 , the metadata created may be based in whole or in part on the data received in step 210 .
- the metadata may also indicate that no segment has been allocated for the table, either implicitly, in that no segment address has been assigned to the space, or explicitly.
- the metadata created in this step need not be all metadata that the database system would need to create in order to allow for normal operation upon segment allocation. Rather the metadata may merely be sufficient enough that all metadata necessary for normal operation upon segment allocation could be created based on the metadata created in this step. For example, many database systems require metadata indicating a segment address for a space. This metadata does not need to be created in step 220 . Rather, the database system could use metadata from step 220 , such as the desired segment size, to create the segment address metadata when the segment is allocated.
- step 230 upon creating the metadata, data is returned indicating that the space has been created. No segment is allocated for the space at this time. However, depending on the metadata created in step 220 , many operations may subsequently be performed in relation with the space without allocating a segment. Such operations may include deleting the space, altering the space, or querying for information about the space's characteristics.
- a segment is only necessary when the space is used to store data.
- no system resources are wasted by potentially empty spaces as a result of space creation according to this embodiment of the invention.
- the creation of certain metadata may be postponed until segment creation, space is also conserved in relation to this metadata.
- both segment allocation and metadata creation can be time-intensive operations, the speed of the space creation process is increased according to this embodiment.
- FIG. 3 is a flowchart illustrating the operation of an embodiment of the invention in which a segment is allocated for a previously created data storage space on demand instead of when the space was created.
- step 310 data is received indicating a data item.
- the data may be, for example, an SQL statement such as INSERT.
- step 320 it is determined that the data item is to be stored in a particular space (i.e. the targeted space).
- the determination may be made using any means known within the art, and may be at least partly based on the data received in step 310 .
- the data may mention the targeted space by name.
- a partition mapping may also be examined to determine that the data item pertains to the targeted space.
- the targeted space is a space for which no segment has been allocated.
- the space may have been previously created using a technique such as that depicted in FIG. 2 that does not involve allocating a segment for the space.
- the determination may be made using any means known within the art, and may be based at least partly on previously created metadata, such as that created in step 220 of FIG. 2 . For example, there may be metadata available to the database system indicating that no segment has been allocated for the space. Also, the determination may be based on the lack of metadata indicating a segment address for the space.
- a segment is allocated for the targeted space.
- Methods for allocating segments for data storage spaces are well-known within the art.
- the segment may be allocated in accordance with previously created metadata, such as that created in step 220 of FIG. 2 .
- metadata may, for example, indicate a size for the segment.
- any previously uncreated metadata necessary to facilitate normal operation of the database system with respect to the targeted space and the newly allocated segment are created.
- metadata may include, for example, data indicating information about the segment, such as the segment address and size, or about the space, such as a partition name.
- metadata may also include performance or functionality enhancing ancillary objects such as indexes. Depending on what metadata has already been created for the space, it may not be necessary to create any metadata in this step.
- FIG. 4 is a block diagram that illustrates a computer system 400 upon which an embodiment of the invention may be implemented.
- Computer system 400 includes a bus 402 or other communication mechanism for communicating information, and a processor 404 coupled with bus 402 for processing information.
- Computer system 400 also includes a main memory 406 , such as a random access memory (RAM) or other dynamic storage device, coupled to bus 402 for storing information and instructions to be executed by processor 404 .
- Main memory 406 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 404 .
- Computer system 400 further includes a read only memory (ROM) 408 or other static storage device coupled to bus 402 for storing static information and instructions for processor 404 .
- a storage device 410 such as a magnetic disk or optical disk, is provided and coupled to bus 402 for storing information and instructions.
- Computer system 400 may be coupled via bus 402 to a display 412 , such as a cathode ray tube (CRT), for displaying information to a computer user.
- a display 412 such as a cathode ray tube (CRT)
- An input device 414 is coupled to bus 402 for communicating information and command selections to processor 404 .
- cursor control 416 is Another type of user input device
- cursor control 416 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 404 and for controlling cursor movement on display 412 .
- This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
- the invention is related to the use of computer system 400 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 400 in response to processor 404 executing one or more sequences of one or more instructions contained in main memory 406 . Such instructions may be read into main memory 406 from another machine-readable medium, such as storage device 410 . Execution of the sequences of instructions contained in main memory 406 causes processor 404 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
- machine-readable medium refers to any medium that participates in providing data that causes a machine to operation in a specific fashion.
- various machine-readable media are involved, for example, in providing instructions to processor 404 for execution.
- Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media.
- Non-volatile media includes, for example, optical or magnetic disks, such as storage device 410 .
- Volatile media includes dynamic memory, such as main memory 406 .
- Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 402 .
- Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.
- Machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to processor 404 for execution.
- the instructions may initially be carried on a magnetic disk of a remote computer.
- the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
- a modem local to computer system 400 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
- An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 402 .
- Bus 402 carries the data to main memory 406 , from which processor 404 retrieves and executes the instructions.
- the instructions received by main memory 406 may optionally be stored on storage device 410 either before or after execution by processor 404 .
- Computer system 400 also includes a communication interface 418 coupled to bus 402 .
- Communication interface 418 provides a two-way data communication coupling to a network link 420 that is connected to a local network 422 .
- communication interface 418 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line.
- ISDN integrated services digital network
- communication interface 418 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
- LAN local area network
- Wireless links may also be implemented.
- communication interface 418 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
- Network link 420 typically provides data communication through one or more networks to other data devices.
- network link 420 may provide a connection through local network 422 to a host computer 424 or to data equipment operated by an Internet Service Provider (ISP) 426 .
- ISP 426 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 428 .
- Internet 428 uses electrical, electromagnetic or optical signals that carry digital data streams.
- the signals through the various networks and the signals on network link 420 and through communication interface 418 which carry the digital data to and from computer system 400 , are exemplary forms of carrier waves transporting the information.
- Computer system 400 can send messages and receive data, including program code, through the network(s), network link 420 and communication interface 418 .
- a server 430 might transmit a requested code for an application program through Internet 428 , ISP 426 , local network 422 and communication interface 418 .
- the received code may be executed by processor 404 as it is received, and/or stored in storage device 410 , or other non-volatile storage for later execution. In this manner, computer system 400 may obtain application code in the form of a carrier wave.
Abstract
Description
- The present invention relates generally to data storage and, more particularly, to the on-demand allocation of data storage spaces and partitions.
- Data stored on a computer system is typically arranged into one or more data storage spaces. Collectively, these data storage spaces are often referred to as a database. Each data storage space comprises one or more data items. Data items in a particular space share common characteristics. A data item may have a value for each of these characteristics. For example, relational databases store data in a number of spaces known as tables. The data items in each table, forming the “rows” of the table, share the same “columns” of data, in that for each column of data, any item in the table may have a value.
- It is helpful to partition data storage spaces for administrative purposes such as archiving, caching, enhancing performance, copying or deleting data, and free space management. For example, spaces that store data items with date characteristics are often partitioned so that each partition comprises only those items that pertain to a particular range of dates. One partition, for example, might only store data items pertaining to a particular month. Another partition might only store data items that pertain to a particular fiscal quarter. Since a partition also comprises data items that share common characteristics, a partition may also be considered a data storage space.
- The determination of to which, if any, partition a data item pertains is made by looking up one or more of the data item's values in a partition mapping. The partition mapping maps certain sets or ranges of values to certain partitions. These sets or ranges of values correspond to one or more characteristics shared by the data items in the partitioned storage space. These characteristics are known as partitioning characteristics. For tables, these sets or ranges of values may correspond to the value of a particular column upon which the partition mapping is said to be based. This column is known as the partitioning column. For example, a partition mapping for a table might be based upon the value of a data item's date column. The mapping could define ranges of dates, such as months or years. Each range could pertain to a separate partition. To determine the partition to which a new data item pertains, one would determine under which of the defined ranges the value of the item's date column fell. Partition mappings may be based on multiple partitioning columns, which is often the case with subpartitions. Partition mappings may also be based on a variety of other characteristics, such as whether a data item pertains to a particular range of numbers or set of discrete values.
- When a new data storage space (or partition) is created, a database system typically performs a number of tasks. One of these tasks is to allocate a segment for the space. A segment is the region within a system's memory or filesystem wherein data for a storage space is stored. The segment may be located via a corresponding segment address. The size of the segment may be defined during the creation process, or may be determined by the database system based on factors such as characteristics of the data storage space and database configuration parameters.
- Another task typically performed when a space is created is to create metadata describing the new space, which is subsequently maintained by the database system. Database systems typically maintain metadata describing each data storage space and partition. Such metadata may describe, for instance, a data space's name, segment address, and segment size. The metadata may also indicate information that helps interpret the data stored within the segment, such as information about the characteristics of the data items within the data storage space. For example, it may define the size, name, and type of each column of data found within a table. It may also describe a partition's name and mapping scheme. It may also describe performance or functionality enhancing ancillary objects such as indexes. Many database systems maintain this metadata in one or more system storage spaces.
- Applications that make use of databases often create a large number of permanent data storage spaces when they are installed or initiated. Often, this is done according to a schema describing each space and partition that the application may use during the course of its operation. By creating spaces up front, applications avoid making costly determinations at later stages concerning the existence of a particular space. However, some or even most of these spaces may not be used for a very long time, if at all. Since segments and metadata must be created for each of them, memory or filesystem resources that could have been used for other purposes are potentially permanently tied up with empty segments and unused metadata. Furthermore, to the extent that certain spaces remain permanently unused, the time spent creating metadata and allocating segments for them also represents undesirable waste.
- Currently, the only way to circumvent this problem is for application developers or database administrators to create storage spaces only when they are necessary. Unfortunately, this workaround requires high overhead. Application developers may end up writing potentially large amounts of code to make sure that the required spaces are created at the proper place and time. Database administrators may end up having to become unnecessarily familiar with the structure of their databases, and may furthermore have to devote large amounts of time to anticipating or tracking the needs of applications that use their databases.
- It is therefore highly desirable to provide a less overhead-intensive mechanism to overcome the problem of resource-wasting inherent to up-front data storage space creation strategies.
- The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section.
- Techniques are provided for the on-demand allocation of segments and creation of metadata for previously-created data storage spaces and partitions. By executing the tasks of allocating segments and creating certain (but not necessarily all) metadata the first time that a data storage space is used as opposed to at the time of the space's creation, the techniques disclosed guarantee that unused spaces do not waste system resources with empty segments and unnecessary metadata, thus overcoming a major disadvantage of up-front storage space creation strategies.
- According to one embodiment, data is received describing a space to be created in a database system. Based on the data, metadata describing the space is created and maintained in the database system. Data indicating that the space has been created is returned without allocating a segment for the space.
- According to one embodiment, data is received indicating a new item to be stored in the database system. It is determined that the new item should be stored in a space for which no segment has previously been allocated. In response to this determination, a segment is allocated for the space. The new item can then be stored in the space. Metadata describing the space is also created in response to the determination.
- According to one embodiment, a space is created in a database system. As part of this creation process, first metadata describing the space is created and maintained in the database system. Data is received indicating a new item. Based on the first metadata, it is determined that the new item pertains to the space. In response to the determination, a segment is allocated for the space. Second metadata describing the space is also created in response to the determination. The new item can then be stored in the space. The first metadata indicates information necessary to allocate a segment for the space, determine that an item pertains to the space, and generate the second metadata. The second metadata indicates any information essential to the normal operation of the data storage space not contained in the first metadata.
- The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
-
FIG. 1A depicts an exemplary database system in which an embodiment of the invention may be practiced. -
FIG. 1B depicts an exemplary database system in which a new data storage space has been created according to an embodiment of the invention. -
FIG. 1C depicts an exemplary database system in which a new data item has been added according to an embodiment of the invention. -
FIG. 2 is a flowchart illustrating the operation of an embodiment of the invention in which a data storage space is created without allocating a segment for the space. -
FIG. 3 is a flowchart illustrating the operation of an embodiment of the invention in which a segment is allocated for a previously created data storage space on demand instead of when the space was created. -
FIG. 4 is a block diagram that illustrates a computer system upon which an embodiment of the invention may be implemented. - In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
-
FIG. 1A depicts an exemplary database system in which an embodiment of the invention may be practiced.Database system 100 is a relational database comprising a number of data storage spaces. As used herein, the term “space” refers to database objects such as tables and partitions. Among these spaces are table 110, storing example data, and system tables 120, 130, and 140, storing metadata describing spaces indatabase system 100.Database system 100 may reside on any computing system, including a single computer or system of clustered servers. - System table 120, labeled table$, comprises data indicating the name of each table in the database. For example,
row 122 indicates that there is a table named sales in the database. Indeed, the name of table 110 is sales. - System table 130, labeled col$, comprises data indicating the columns that may be found in each table within the database. For example,
row 132 indicates that there is a column named stores within the sales table. Row 134 indicates that there is a column named amount within the sales table. Indeed, table 110 contains both of these columns. - System table 140, labeled segment$, comprises data indicating the location of the segment wherein the data for a particular space may be found. For example,
row 142 indicates that the segment for the table named sales is found at the address 0×000. Indeed, table 110 is located withinsegment 150, which is depicted to start at address 0×0001. -
Segment 150 stores the data constituting table 110.Segment 150 may reside on any medium capable of storing data, including in system memory or on a physical disc within the system. It should be noted that table 110 is merely an interpretation of the data stored withinsegment 150, based on the previously described metadata from system tables 120 and 130. Table 110 is not necessarily representative of how the data insegment 150 is actually stored. Indeed, the data insegment 150 may be stored using any means known within the art, as long as it may be interpreted bydatabase system 100 to represent table 110. The same holds true of any table or segment withindatabase system 100. -
FIG. 1B depicts an exemplary database system in which a new data storage space has been created according to an embodiment of the invention. In particular,FIG. 1B depicts the changes made todatabase system 100 ofFIG. 1A in response toSQL statement 180, which indicates a data storage space to add todatabase system 100.SQL statement 180 is the following statement: - CREATE TABLE expenses (store NUMBER, amount NUMBER);
- Data indicating this SQL statement has been received by
database system 100. In response to receiving this statement,database system 100 has created a table named expenses with number-based columns store and amount. However, because no data items pertaining to the table named expenses have been received bydatabase system 100,database system 100 has not allocated a segment for the table named expenses.Database system 100 has, however, created metadata describing the table named expenses. This metadata has been stored within the database asrows database system 100. Row 136 indicates that there is column named store within the expenses table. Row 138 indicates that there is a column named amount within the expenses table. - Because metadata describing the expenses table exists within
database system 100, certain operations may now be performed with respect to the expenses table even though no segment has been allocated for the expenses table. For example, a request to drop the expenses table, alter that table's characteristics, or query that table's column names may be honored based on the metadata already stored for the expenses table. Indeed, assuming the relevant metadata has been stored,database system 100 may continue to function normally with regards to operations concerning any table without an allocated segment, as long as the operation does not result in data being stored in the table. - This technique may be modified to accommodate metadata other than that depicted in
FIG. 1B . For example, if the CREATE TABLE statement were to describe certain qualities of the columns contained within the table, such as that a column is an indexed column or contains unique values, metadata could be stored within the database to indicate these qualities. One of the depicted system tables could be modified to store this metadata, or other system tables could be used. - Indeed, in response to a request to create a new data storage space, the database system may create metadata indicating all information necessary to allocate fully a segment for the space in the future, as well as all information necessary to generate any other metadata that may be required for normal operations upon segment allocation. This metadata may fully describe, for example, each column within the storage space. This metadata may also indicate information necessary to determine which data items should be stored in the space, such as a user-defined name for the table, or, in the case of partitions, a partition mapping scheme.
-
FIG. 1C depicts an exemplary database system in which a new data item has been added according to an embodiment of the invention.Database system 100 is the same as depicted inFIG. 1B , except that a new segment has been allocated and new metadata has been created. These changes were made after receiving data indicating theSQL statement 181, which reads as follows: - INSERT INTO expenses VALUES (‘1’, ‘10000’);
- This SQL statement instructed
database system 100 to add a new data item to the table named expenses. Based on system table 120,database system 100 determined thatdatabase system 100 does indeed contain a table named expenses to which the new data item may be added. However, whendatabase system 100 tried to locate the segment for the expenses table,database system 100 discovered that there was no row in system table 140 ofFIG. 1B for the expenses table. Accordingly,database system 100 determined that no segment had previously been allocated for the expenses table. - The changes to
database system 100 depicted inFIG. 1C were made in response to this determination.Segment 160 was allocated for the expenses table. New metadata was also created in response to the afore-mentioned determination. This metadata has been stored inrow 146 of system table 140. The metadata indicates the segment address at which the newly allocatedsegment 160 for table 170 may be found. - Using this new metadata in tandem with the already existing metadata within system tables 120 and 130, the data in
segment 160 is properly interpreted as table 170. In accordance with the metadata stored within table 130, table 170 comprises two columns, store and amount. Having fully allocated a segment for the expenses table, and having created metadata describing the segment, the new data item was stored in table 170 asrow 172. - Metadata other than that depicted in
FIG. 1C may be created in response to determining that a new item should be stored in a data storage space for which no segment has previously been allocated. For example, ancillary objects such as indexes may be created at this time. If the data storage space is a partition, a partition name may be created at this time as well. Metadata indicating such information could be stored in a modified version of one of the depicted tables or in other system tables. - Furthermore, the techniques described above may be implemented for spaces other than tables and in non-relational databases. Likewise, the metadata may be maintained in forms other than as system tables.
- The techniques described above may also be implemented for partitions. For example, the segment$ table could indicate the segment at which each partition may be found. A partition$ table could describe the partitions and their mappings. A determination of whether a new item pertains to a partition for which no segment previously has been allocated could be made by determining which partition the item is mapped to in the relevant partition mapping, and then determining whether there is an entry for that partition in the segment$ table.
-
FIG. 2 is a flowchart illustrating the operation of an embodiment of the invention in which a data storage space is created without allocating a segment for the space. Instep 210, data is received indicating a space to be created in the database. The data may be, for example, an SQL statement such as CREATE TABLE or a database schema. The data may also describe characteristics of the space. The space may be any data storage space, including a table or partition of a table. - In
step 220, based on this data, metadata is created describing the space. This metadata may be maintained within system tables in the database, or in other data storage locations. The metadata may comprise data indicating information sufficient to allocate a segment for the space in the future and allow for normal operations with relation to the space once the segment has been allocated. For example, the metadata may describe the name of the space, characteristics of the space such as column names and types, and the size of the segment that should be allocated to the space. Because this information may have been indicated in the data received instep 210, the metadata created may be based in whole or in part on the data received instep 210. The metadata may also indicate that no segment has been allocated for the table, either implicitly, in that no segment address has been assigned to the space, or explicitly. - The metadata created in this step need not be all metadata that the database system would need to create in order to allow for normal operation upon segment allocation. Rather the metadata may merely be sufficient enough that all metadata necessary for normal operation upon segment allocation could be created based on the metadata created in this step. For example, many database systems require metadata indicating a segment address for a space. This metadata does not need to be created in
step 220. Rather, the database system could use metadata fromstep 220, such as the desired segment size, to create the segment address metadata when the segment is allocated. - In
step 230, upon creating the metadata, data is returned indicating that the space has been created. No segment is allocated for the space at this time. However, depending on the metadata created instep 220, many operations may subsequently be performed in relation with the space without allocating a segment. Such operations may include deleting the space, altering the space, or querying for information about the space's characteristics. - According to one embodiment, a segment is only necessary when the space is used to store data. Thus, no system resources are wasted by potentially empty spaces as a result of space creation according to this embodiment of the invention. Furthermore, because the creation of certain metadata may be postponed until segment creation, space is also conserved in relation to this metadata. Finally, since both segment allocation and metadata creation can be time-intensive operations, the speed of the space creation process is increased according to this embodiment.
-
FIG. 3 is a flowchart illustrating the operation of an embodiment of the invention in which a segment is allocated for a previously created data storage space on demand instead of when the space was created. - In
step 310, data is received indicating a data item. The data may be, for example, an SQL statement such as INSERT. - In
step 320, it is determined that the data item is to be stored in a particular space (i.e. the targeted space). The determination may be made using any means known within the art, and may be at least partly based on the data received instep 310. For example, the data may mention the targeted space by name. In the case of a partition, a partition mapping may also be examined to determine that the data item pertains to the targeted space. - In
step 330, it is determined that the targeted space is a space for which no segment has been allocated. The space may have been previously created using a technique such as that depicted inFIG. 2 that does not involve allocating a segment for the space. The determination may be made using any means known within the art, and may be based at least partly on previously created metadata, such as that created instep 220 ofFIG. 2 . For example, there may be metadata available to the database system indicating that no segment has been allocated for the space. Also, the determination may be based on the lack of metadata indicating a segment address for the space. - In
step 340, in response to the determinations ofstep step 220 ofFIG. 2 . Such metadata may, for example, indicate a size for the segment. - In
step 350, any previously uncreated metadata necessary to facilitate normal operation of the database system with respect to the targeted space and the newly allocated segment are created. Such metadata may include, for example, data indicating information about the segment, such as the segment address and size, or about the space, such as a partition name. Such metadata may also include performance or functionality enhancing ancillary objects such as indexes. Depending on what metadata has already been created for the space, it may not be necessary to create any metadata in this step. -
FIG. 4 is a block diagram that illustrates acomputer system 400 upon which an embodiment of the invention may be implemented.Computer system 400 includes abus 402 or other communication mechanism for communicating information, and aprocessor 404 coupled withbus 402 for processing information.Computer system 400 also includes amain memory 406, such as a random access memory (RAM) or other dynamic storage device, coupled tobus 402 for storing information and instructions to be executed byprocessor 404.Main memory 406 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed byprocessor 404.Computer system 400 further includes a read only memory (ROM) 408 or other static storage device coupled tobus 402 for storing static information and instructions forprocessor 404. Astorage device 410, such as a magnetic disk or optical disk, is provided and coupled tobus 402 for storing information and instructions. -
Computer system 400 may be coupled viabus 402 to adisplay 412, such as a cathode ray tube (CRT), for displaying information to a computer user. Aninput device 414, including alphanumeric and other keys, is coupled tobus 402 for communicating information and command selections toprocessor 404. Another type of user input device iscursor control 416, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections toprocessor 404 and for controlling cursor movement ondisplay 412. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane. - The invention is related to the use of
computer system 400 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed bycomputer system 400 in response toprocessor 404 executing one or more sequences of one or more instructions contained inmain memory 406. Such instructions may be read intomain memory 406 from another machine-readable medium, such asstorage device 410. Execution of the sequences of instructions contained inmain memory 406 causesprocessor 404 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software. - The term “machine-readable medium” as used herein refers to any medium that participates in providing data that causes a machine to operation in a specific fashion. In an embodiment implemented using
computer system 400, various machine-readable media are involved, for example, in providing instructions toprocessor 404 for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such asstorage device 410. Volatile media includes dynamic memory, such asmain memory 406. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprisebus 402. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine. - Common forms of machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to
processor 404 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local tocomputer system 400 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data onbus 402.Bus 402 carries the data tomain memory 406, from whichprocessor 404 retrieves and executes the instructions. The instructions received bymain memory 406 may optionally be stored onstorage device 410 either before or after execution byprocessor 404. -
Computer system 400 also includes acommunication interface 418 coupled tobus 402.Communication interface 418 provides a two-way data communication coupling to anetwork link 420 that is connected to alocal network 422. For example,communication interface 418 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example,communication interface 418 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation,communication interface 418 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information. - Network link 420 typically provides data communication through one or more networks to other data devices. For example,
network link 420 may provide a connection throughlocal network 422 to ahost computer 424 or to data equipment operated by an Internet Service Provider (ISP) 426.ISP 426 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 428.Local network 422 andInternet 428 both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals onnetwork link 420 and throughcommunication interface 418, which carry the digital data to and fromcomputer system 400, are exemplary forms of carrier waves transporting the information. -
Computer system 400 can send messages and receive data, including program code, through the network(s),network link 420 andcommunication interface 418. In the Internet example, aserver 430 might transmit a requested code for an application program throughInternet 428,ISP 426,local network 422 andcommunication interface 418. - The received code may be executed by
processor 404 as it is received, and/or stored instorage device 410, or other non-volatile storage for later execution. In this manner,computer system 400 may obtain application code in the form of a carrier wave. - In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. Thus, the sole and exclusive indicator of what is the invention, and is intended by the applicants to be the invention, is the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction. Any definitions expressly set forth herein for terms contained in such claims shall govern the meaning of such terms as used in the claims. Hence, no limitation, element, property, feature, advantage or attribute that is not expressly recited in a claim should limit the scope of such claim in any way. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (23)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/764,131 US8135688B2 (en) | 2007-06-15 | 2007-06-15 | Partition/table allocation on demand |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/764,131 US8135688B2 (en) | 2007-06-15 | 2007-06-15 | Partition/table allocation on demand |
Publications (2)
Publication Number | Publication Date |
---|---|
US20080313209A1 true US20080313209A1 (en) | 2008-12-18 |
US8135688B2 US8135688B2 (en) | 2012-03-13 |
Family
ID=40133329
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/764,131 Active 2028-05-08 US8135688B2 (en) | 2007-06-15 | 2007-06-15 | Partition/table allocation on demand |
Country Status (1)
Country | Link |
---|---|
US (1) | US8135688B2 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120311118A1 (en) * | 2011-06-03 | 2012-12-06 | Jon Maloy | Hierarchical binding and lookup of addresses in inter-process communications systems |
CN102982186A (en) * | 2012-12-26 | 2013-03-20 | 厦门市美亚柏科信息股份有限公司 | Method and system for maintaining range partitioning table based on oracle database system |
JP2015095206A (en) * | 2013-11-14 | 2015-05-18 | 富士ゼロックス株式会社 | Data management system and program |
US20150237400A1 (en) * | 2013-01-05 | 2015-08-20 | Benedict Ow | Secured file distribution system and method |
CN109445694A (en) * | 2018-10-19 | 2019-03-08 | 郑州云海信息技术有限公司 | A kind of distributed memory system separated from meta-data method and apparatus |
CN110489426A (en) * | 2019-08-26 | 2019-11-22 | 杭州安恒信息技术股份有限公司 | A kind of automation partition method, device and the equipment of database table |
CN113722623A (en) * | 2021-09-03 | 2021-11-30 | 锐掣(杭州)科技有限公司 | Data processing method and device, electronic equipment and storage medium |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9430550B2 (en) | 2012-09-28 | 2016-08-30 | Oracle International Corporation | Clustering a table in a relational database management system |
US9514187B2 (en) | 2012-09-28 | 2016-12-06 | Oracle International Corporation | Techniques for using zone map information for post index access pruning |
US8996544B2 (en) | 2012-09-28 | 2015-03-31 | Oracle International Corporation | Pruning disk blocks of a clustered table in a relational database management system |
US8943107B2 (en) * | 2012-12-04 | 2015-01-27 | At&T Intellectual Property I, L.P. | Generating and using temporal metadata partitions |
US10642837B2 (en) | 2013-03-15 | 2020-05-05 | Oracle International Corporation | Relocating derived cache during data rebalance to maintain application performance |
US10223387B2 (en) | 2015-09-08 | 2019-03-05 | International Business Machines Corporation | Managing relational databases |
US10530584B2 (en) * | 2016-06-29 | 2020-01-07 | Aram Kovach | Systems and methods for tracking controlled items |
US11086876B2 (en) | 2017-09-29 | 2021-08-10 | Oracle International Corporation | Storing derived summaries on persistent memory of a storage device |
Citations (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5551027A (en) * | 1993-01-07 | 1996-08-27 | International Business Machines Corporation | Multi-tiered indexing method for partitioned data |
US5822142A (en) * | 1996-07-26 | 1998-10-13 | Western Digital Corporation | Method of mapping logical sectors to physical sectors in a disk drive sparing partition |
US5832496A (en) * | 1995-10-12 | 1998-11-03 | Ncr Corporation | System and method for performing intelligent analysis of a computer database |
US5983215A (en) * | 1997-05-08 | 1999-11-09 | The Trustees Of Columbia University In The City Of New York | System and method for performing joins and self-joins in a database system |
US6002866A (en) * | 1995-09-01 | 1999-12-14 | Sun Microsystems, Inc. | Partitioning within a partition in a disk file storage system |
US6003036A (en) * | 1998-02-12 | 1999-12-14 | Martin; Michael W. | Interval-partitioning method for multidimensional data |
US6341289B1 (en) * | 1999-05-06 | 2002-01-22 | International Business Machines Corporation | Object identity and partitioning for user defined extents |
US6405198B1 (en) * | 1998-09-04 | 2002-06-11 | International Business Machines Corporation | Complex data query support in a partitioned database system |
US6427147B1 (en) * | 1995-12-01 | 2002-07-30 | Sand Technology Systems International | Deletion of ordered sets of keys in a compact O-complete tree |
US6473774B1 (en) * | 1998-09-28 | 2002-10-29 | Compaq Computer Corporation | Method and apparatus for record addressing in partitioned files |
US6484179B1 (en) * | 1999-10-25 | 2002-11-19 | Oracle Corporation | Storing multidimensional data in a relational database management system |
US20020194196A1 (en) * | 2000-12-12 | 2002-12-19 | Weinberg Paul N. | Method and apparatus for transforming data |
US20020194157A1 (en) * | 1999-09-27 | 2002-12-19 | Mohamed Zait | Partition pruning with composite partitioning |
US20030061263A1 (en) * | 2001-09-26 | 2003-03-27 | Guy Riddle | Dynamic partitioning of network resources |
US20030149702A1 (en) * | 2002-02-05 | 2003-08-07 | Compaq Information Technologies Group, L.P. | Operational data store |
US6609131B1 (en) * | 1999-09-27 | 2003-08-19 | Oracle International Corporation | Parallel partition-wise joins |
US6711563B1 (en) * | 2000-11-29 | 2004-03-23 | Lafayette Software Inc. | Methods of organizing data and processing queries in a database system, and database system and software product for implementing such methods |
US6820095B1 (en) * | 1997-10-31 | 2004-11-16 | Oracle International Corporation | Import/export and repartitioning of partitioned objects |
US20040260671A1 (en) * | 2003-02-21 | 2004-12-23 | Cognos Incorporated | Dimension-based partitioned cube |
US20040267782A1 (en) * | 2003-06-30 | 2004-12-30 | Yukio Nakano | Database system |
US6867991B1 (en) * | 2003-07-03 | 2005-03-15 | Integrated Device Technology, Inc. | Content addressable memory devices with virtual partitioning and methods of operating the same |
US6920460B1 (en) * | 2002-05-29 | 2005-07-19 | Oracle International Corporation | Systems and methods for managing partitioned indexes that are created and maintained by user-defined indexing schemes |
US20050187897A1 (en) * | 2004-02-11 | 2005-08-25 | Microsoft Corporation | System and method for switching a data partition |
US20060206507A1 (en) * | 2005-02-16 | 2006-09-14 | Dahbour Ziyad M | Hierarchal data management |
US20060253431A1 (en) * | 2004-11-12 | 2006-11-09 | Sense, Inc. | Techniques for knowledge discovery by constructing knowledge correlations using terms |
US7143091B2 (en) * | 2002-02-04 | 2006-11-28 | Cataphorn, Inc. | Method and apparatus for sociological data mining |
US7146377B2 (en) * | 2000-09-11 | 2006-12-05 | Agami Systems, Inc. | Storage system having partitioned migratable metadata |
US7158996B2 (en) * | 2003-01-27 | 2007-01-02 | International Business Machines Corporation | Method, system, and program for managing database operations with respect to a database table |
US20070239793A1 (en) * | 2006-03-31 | 2007-10-11 | Tyrrell John C | System and method for implementing a flexible storage manager with threshold control |
US20070260842A1 (en) * | 2006-05-08 | 2007-11-08 | Sorin Faibish | Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system |
US7334002B2 (en) * | 2004-02-27 | 2008-02-19 | Microsoft Corporation | System and method for recovery units in databases |
US7356549B1 (en) * | 2005-04-11 | 2008-04-08 | Unisys Corporation | System and method for cross-reference linking of local partitioned B-trees |
US20080091690A1 (en) * | 2006-10-13 | 2008-04-17 | International Business Machines Corporation | Deriving a Data Model From a Hierarchy Of Related Terms, And Deriving a Hierarchy Of Related Terms From a Data Model |
US20080104359A1 (en) * | 2006-10-30 | 2008-05-01 | Sauer Jonathan M | Pattern-based mapping for storage space management |
US20080114749A1 (en) * | 2006-11-14 | 2008-05-15 | Nikhil Chandhok | Event Searching |
US20080140937A1 (en) * | 2006-12-12 | 2008-06-12 | Sybase, Inc. | System and Methodology Providing Multiple Heterogeneous Buffer Caches |
US7395402B2 (en) * | 2004-04-15 | 2008-07-01 | Broadcom Corporation | Method and system of data storage capacity allocation and management using one or more data storage drives |
US7406499B2 (en) * | 2003-05-09 | 2008-07-29 | Microsoft Corporation | Architecture for partition computation and propagation of changes in data replication |
US20080228829A1 (en) * | 2007-03-12 | 2008-09-18 | Bea Systems, Inc. | Partitioning fact tables in an analytics system |
US20080256029A1 (en) * | 2007-04-13 | 2008-10-16 | Acei Ab | Partition management system |
US7447839B2 (en) * | 2005-09-13 | 2008-11-04 | Yahoo! Inc. | System for a distributed column chunk data store |
US7458066B2 (en) * | 2005-02-28 | 2008-11-25 | Hewlett-Packard Development Company, L.P. | Computer system and method for transferring executables between partitions |
US7457832B2 (en) * | 2004-08-31 | 2008-11-25 | Microsoft Corporation | Verifying dynamically generated operations on a data store |
US7483981B2 (en) * | 2000-08-03 | 2009-01-27 | Microsoft Corporation | Scalable virtual partitioning of resources |
US7617370B2 (en) * | 2005-04-29 | 2009-11-10 | Netapp, Inc. | Data allocation within a storage system architecture |
US7676514B2 (en) * | 2006-05-08 | 2010-03-09 | Emc Corporation | Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset |
US7698334B2 (en) * | 2005-04-29 | 2010-04-13 | Netapp, Inc. | System and method for multi-tiered meta-data caching and distribution in a clustered computer environment |
US7716420B2 (en) * | 2006-04-28 | 2010-05-11 | Network Appliance, Inc. | Methods of converting traditional volumes into flexible volumes |
US7716448B2 (en) * | 2007-02-28 | 2010-05-11 | Red Hat, Inc. | Page oriented memory management |
US7890541B2 (en) * | 2006-02-17 | 2011-02-15 | International Business Machines Corporation | Partition by growth table space |
US7949865B1 (en) * | 2007-09-19 | 2011-05-24 | Network Appliance, Inc. | Mounting volumes on demand |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6910044B2 (en) | 2000-09-20 | 2005-06-21 | Sap Aktiengesellschaft | Method and apparatus for structuring, maintaining, and using families of data |
US6931390B1 (en) | 2001-02-27 | 2005-08-16 | Oracle International Corporation | Method and mechanism for database partitioning |
US8005792B2 (en) | 2004-05-14 | 2011-08-23 | Oracle International Corporation | System and method for managing versions of metadata |
US7774329B1 (en) | 2006-12-22 | 2010-08-10 | Amazon Technologies, Inc. | Cross-region data access in partitioned framework |
-
2007
- 2007-06-15 US US11/764,131 patent/US8135688B2/en active Active
Patent Citations (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5551027A (en) * | 1993-01-07 | 1996-08-27 | International Business Machines Corporation | Multi-tiered indexing method for partitioned data |
US6002866A (en) * | 1995-09-01 | 1999-12-14 | Sun Microsystems, Inc. | Partitioning within a partition in a disk file storage system |
US5832496A (en) * | 1995-10-12 | 1998-11-03 | Ncr Corporation | System and method for performing intelligent analysis of a computer database |
US6427147B1 (en) * | 1995-12-01 | 2002-07-30 | Sand Technology Systems International | Deletion of ordered sets of keys in a compact O-complete tree |
US5822142A (en) * | 1996-07-26 | 1998-10-13 | Western Digital Corporation | Method of mapping logical sectors to physical sectors in a disk drive sparing partition |
US5983215A (en) * | 1997-05-08 | 1999-11-09 | The Trustees Of Columbia University In The City Of New York | System and method for performing joins and self-joins in a database system |
US6820095B1 (en) * | 1997-10-31 | 2004-11-16 | Oracle International Corporation | Import/export and repartitioning of partitioned objects |
US6003036A (en) * | 1998-02-12 | 1999-12-14 | Martin; Michael W. | Interval-partitioning method for multidimensional data |
US6405198B1 (en) * | 1998-09-04 | 2002-06-11 | International Business Machines Corporation | Complex data query support in a partitioned database system |
US6473774B1 (en) * | 1998-09-28 | 2002-10-29 | Compaq Computer Corporation | Method and apparatus for record addressing in partitioned files |
US6341289B1 (en) * | 1999-05-06 | 2002-01-22 | International Business Machines Corporation | Object identity and partitioning for user defined extents |
US6609131B1 (en) * | 1999-09-27 | 2003-08-19 | Oracle International Corporation | Parallel partition-wise joins |
US20020194157A1 (en) * | 1999-09-27 | 2002-12-19 | Mohamed Zait | Partition pruning with composite partitioning |
US6484179B1 (en) * | 1999-10-25 | 2002-11-19 | Oracle Corporation | Storing multidimensional data in a relational database management system |
US7483981B2 (en) * | 2000-08-03 | 2009-01-27 | Microsoft Corporation | Scalable virtual partitioning of resources |
US7146377B2 (en) * | 2000-09-11 | 2006-12-05 | Agami Systems, Inc. | Storage system having partitioned migratable metadata |
US6711563B1 (en) * | 2000-11-29 | 2004-03-23 | Lafayette Software Inc. | Methods of organizing data and processing queries in a database system, and database system and software product for implementing such methods |
US20020194196A1 (en) * | 2000-12-12 | 2002-12-19 | Weinberg Paul N. | Method and apparatus for transforming data |
US20030061263A1 (en) * | 2001-09-26 | 2003-03-27 | Guy Riddle | Dynamic partitioning of network resources |
US7143091B2 (en) * | 2002-02-04 | 2006-11-28 | Cataphorn, Inc. | Method and apparatus for sociological data mining |
US20030149702A1 (en) * | 2002-02-05 | 2003-08-07 | Compaq Information Technologies Group, L.P. | Operational data store |
US6920460B1 (en) * | 2002-05-29 | 2005-07-19 | Oracle International Corporation | Systems and methods for managing partitioned indexes that are created and maintained by user-defined indexing schemes |
US7158996B2 (en) * | 2003-01-27 | 2007-01-02 | International Business Machines Corporation | Method, system, and program for managing database operations with respect to a database table |
US20040260671A1 (en) * | 2003-02-21 | 2004-12-23 | Cognos Incorporated | Dimension-based partitioned cube |
US7406499B2 (en) * | 2003-05-09 | 2008-07-29 | Microsoft Corporation | Architecture for partition computation and propagation of changes in data replication |
US20040267782A1 (en) * | 2003-06-30 | 2004-12-30 | Yukio Nakano | Database system |
US7143105B2 (en) * | 2003-06-30 | 2006-11-28 | Hitachi, Ltd. | Database system |
US6867991B1 (en) * | 2003-07-03 | 2005-03-15 | Integrated Device Technology, Inc. | Content addressable memory devices with virtual partitioning and methods of operating the same |
US20050187897A1 (en) * | 2004-02-11 | 2005-08-25 | Microsoft Corporation | System and method for switching a data partition |
US7334002B2 (en) * | 2004-02-27 | 2008-02-19 | Microsoft Corporation | System and method for recovery units in databases |
US7395402B2 (en) * | 2004-04-15 | 2008-07-01 | Broadcom Corporation | Method and system of data storage capacity allocation and management using one or more data storage drives |
US7457832B2 (en) * | 2004-08-31 | 2008-11-25 | Microsoft Corporation | Verifying dynamically generated operations on a data store |
US20060253431A1 (en) * | 2004-11-12 | 2006-11-09 | Sense, Inc. | Techniques for knowledge discovery by constructing knowledge correlations using terms |
US20060206507A1 (en) * | 2005-02-16 | 2006-09-14 | Dahbour Ziyad M | Hierarchal data management |
US7458066B2 (en) * | 2005-02-28 | 2008-11-25 | Hewlett-Packard Development Company, L.P. | Computer system and method for transferring executables between partitions |
US7356549B1 (en) * | 2005-04-11 | 2008-04-08 | Unisys Corporation | System and method for cross-reference linking of local partitioned B-trees |
US7617370B2 (en) * | 2005-04-29 | 2009-11-10 | Netapp, Inc. | Data allocation within a storage system architecture |
US7698334B2 (en) * | 2005-04-29 | 2010-04-13 | Netapp, Inc. | System and method for multi-tiered meta-data caching and distribution in a clustered computer environment |
US7447839B2 (en) * | 2005-09-13 | 2008-11-04 | Yahoo! Inc. | System for a distributed column chunk data store |
US7890541B2 (en) * | 2006-02-17 | 2011-02-15 | International Business Machines Corporation | Partition by growth table space |
US20070239793A1 (en) * | 2006-03-31 | 2007-10-11 | Tyrrell John C | System and method for implementing a flexible storage manager with threshold control |
US7716420B2 (en) * | 2006-04-28 | 2010-05-11 | Network Appliance, Inc. | Methods of converting traditional volumes into flexible volumes |
US7676514B2 (en) * | 2006-05-08 | 2010-03-09 | Emc Corporation | Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset |
US20070260842A1 (en) * | 2006-05-08 | 2007-11-08 | Sorin Faibish | Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system |
US20080091690A1 (en) * | 2006-10-13 | 2008-04-17 | International Business Machines Corporation | Deriving a Data Model From a Hierarchy Of Related Terms, And Deriving a Hierarchy Of Related Terms From a Data Model |
US20080104359A1 (en) * | 2006-10-30 | 2008-05-01 | Sauer Jonathan M | Pattern-based mapping for storage space management |
US20080114749A1 (en) * | 2006-11-14 | 2008-05-15 | Nikhil Chandhok | Event Searching |
US20080140937A1 (en) * | 2006-12-12 | 2008-06-12 | Sybase, Inc. | System and Methodology Providing Multiple Heterogeneous Buffer Caches |
US7716448B2 (en) * | 2007-02-28 | 2010-05-11 | Red Hat, Inc. | Page oriented memory management |
US20080228829A1 (en) * | 2007-03-12 | 2008-09-18 | Bea Systems, Inc. | Partitioning fact tables in an analytics system |
US20080256029A1 (en) * | 2007-04-13 | 2008-10-16 | Acei Ab | Partition management system |
US7949865B1 (en) * | 2007-09-19 | 2011-05-24 | Network Appliance, Inc. | Mounting volumes on demand |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120311118A1 (en) * | 2011-06-03 | 2012-12-06 | Jon Maloy | Hierarchical binding and lookup of addresses in inter-process communications systems |
US8713198B2 (en) * | 2011-06-03 | 2014-04-29 | Telefonaktiebolaget L M Ericsson (Publ) | Hierarchical binding and lookup of addresses in inter-process communications systems |
CN102982186A (en) * | 2012-12-26 | 2013-03-20 | 厦门市美亚柏科信息股份有限公司 | Method and system for maintaining range partitioning table based on oracle database system |
US20150237400A1 (en) * | 2013-01-05 | 2015-08-20 | Benedict Ow | Secured file distribution system and method |
JP2015095206A (en) * | 2013-11-14 | 2015-05-18 | 富士ゼロックス株式会社 | Data management system and program |
CN109445694A (en) * | 2018-10-19 | 2019-03-08 | 郑州云海信息技术有限公司 | A kind of distributed memory system separated from meta-data method and apparatus |
CN110489426A (en) * | 2019-08-26 | 2019-11-22 | 杭州安恒信息技术股份有限公司 | A kind of automation partition method, device and the equipment of database table |
CN113722623A (en) * | 2021-09-03 | 2021-11-30 | 锐掣(杭州)科技有限公司 | Data processing method and device, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
US8135688B2 (en) | 2012-03-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8135688B2 (en) | Partition/table allocation on demand | |
US7756889B2 (en) | Partitioning of nested tables | |
US7890541B2 (en) | Partition by growth table space | |
US9767131B2 (en) | Hierarchical tablespace space management | |
EP3170106B1 (en) | High throughput data modifications using blind update operations | |
US7814047B2 (en) | Direct loading of semistructured data | |
AU2003290654B2 (en) | Scalable access to data in an arbitrarily large document | |
US8930332B2 (en) | Method and system for partitioning search indexes | |
US7934211B2 (en) | Multi-level patching operation | |
US7472140B2 (en) | Label-aware index for efficient queries in a versioning system | |
US8209294B2 (en) | Dynamic creation of database partitions | |
US20100306444A1 (en) | Free-Space Reduction in Cached Database Pages | |
US20120011096A1 (en) | Efficiently updating rows in a data warehouse | |
US7313572B2 (en) | Attribute partitioning for user extensibility | |
US20100235344A1 (en) | Mechanism for utilizing partitioning pruning techniques for xml indexes | |
US20100235348A1 (en) | Loading an index with minimal effect on availability of applications using the corresponding table | |
KR20110010736A (en) | Paging hierarchical data | |
CN110399333B (en) | Method, apparatus and computer program product for deleting snapshots | |
US7519574B2 (en) | Associating information related to components in structured documents stored in their native format in a database | |
US7984072B2 (en) | Three-dimensional data structure for storing data of multiple domains and the management thereof | |
US9442948B2 (en) | Resource-specific control blocks for database cache | |
US20130132443A1 (en) | Structure-specific record count database operations | |
US20110231398A1 (en) | Single Repository Manifestation Of A Multi-Repository System | |
US11526513B2 (en) | SQL interface for embedded graph subqueries | |
US8356014B2 (en) | Referring to partitions with for (values) clause |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ORACLE INTERNATIONAL CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHANKAR, SHRIKANTH;RAGHAVAN, ANANTH;VARANASI, BADHRI G.;REEL/FRAME:019438/0855;SIGNING DATES FROM 20070530 TO 20070531 Owner name: ORACLE INTERNATIONAL CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHANKAR, SHRIKANTH;RAGHAVAN, ANANTH;VARANASI, BADHRI G.;SIGNING DATES FROM 20070530 TO 20070531;REEL/FRAME:019438/0855 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |