CN103514295B - historical data archiving method and historical data archiving device - Google Patents
historical data archiving method and historical data archiving device Download PDFInfo
- Publication number
- CN103514295B CN103514295B CN201310471385.5A CN201310471385A CN103514295B CN 103514295 B CN103514295 B CN 103514295B CN 201310471385 A CN201310471385 A CN 201310471385A CN 103514295 B CN103514295 B CN 103514295B
- Authority
- CN
- China
- Prior art keywords
- data
- task
- historical data
- edited
- filing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of historical data archiving method, the method includes: contains with the overall historical data base of each task related data from gather and store, extracts the historical data matched with task to be edited；Filing historical data is edited and formed to the historical data extracted；Task identification is set for filing historical data, and the filing history data store being provided with task identification is filed in historical data base to pre-setting of task.The application present invention, can improve task historical data access speed.
Description
Technical field
The present invention relates to areas of information technology, particularly relate to a kind of historical data archiving method and historical data is returned
Latch device.
Background technology
In actual application, the industry such as finance, communication needs opening relationships database application system, passes through
Overall historical data base carrys out the substantial amounts of data of real time record, meanwhile, often in order to meet a certain task need
Ask, need to be updated data relevant to task in the overall data prestored safeguarding.Such as,
For a large-scale function system module, when running this function system module, can be to this function series
The all properties index parameter of system module carries out real time record, and the performance indications of all real time record are joined
Number constitutes overall historical data；And in order to carry out one about performance indications Y under the conditions of X for property
The influence research of energy index Z, needs to edit the data relevant to this research.
Existing, after task to be edited starts, current time is contained each task to be edited and is correlated with
Data relevant to task in the overall data of data edits and updates, at the end of task, by
The overall data of editor stores in overall historical data base as overall historical data archiving, wherein,
The overall data edited includes the data relevant to task and the data unrelated with task.Due to
The different time periods is to meet different mission requirements to produce different overall historical datas, therefore,
Index information can be set up, in order to different the going through produced according to the edit session section performing this task
History overall data makes differentiation.
The historical data archiving method of this task based access control data updating, needs to take bigger storage empty
Between store these different time sections produce overall historical data；And, the overall history number of generation
There is the problem repeating storage in data unrelated with task according to, causes the waste of memory space.Separately
On the one hand, in needing to obtain a certain historical time section, mission requirements and the task relevant to task are met
During historical data, it is necessary to according to this corresponding index information of historical time section from overall historical data base
Middle acquisition overall historical data accordingly, then, seeks the overall historical data of whole acquisition all over, therefrom
Meet mission requirements the task historical data relevant to task in filtering out this historical time section, exist
The problem that task historical data access speed is slow.
For solving the problem of waste of storage space, existing proposition is relevant to task in overall data
After data are updated safeguarding, data that are relevant to task and that be updated safeguarding individually are filed
Storage, history of forming more new data；In different time sections, can produce for meeting different mission requirements
Raw different history more new data, therefore, it can by adding the mark letter such as timestamp or record number
Different history more new data is made differentiation by breath.The technical scheme of this improvement, although solve and appoint
The repetition storage problem of unrelated data of being engaged in, but meet task in needs obtain a certain historical time section
When demand the task historical data relevant to task, this historical time section need to be obtained according to identification information
Interior updating maintenance and relevant to task history more new data；Simultaneously need to be from history overall data storehouse
Transfer the overall historical data in same historical time section, obtain relevant to task but be not updated
Historical data, all appoint relevant to task in so could the most intactly obtaining this historical time section
Business historical data.When needing the data obtaining different historical time section, then need in different history
More frequently access between new data and overall data, cause task historical data access speed slow.
Summary of the invention
Embodiments of the invention provide a kind of historical data archiving method, it is possible to increase task historical data
Access speed.
According to a further aspect in the invention, the embodiment of the present invention additionally provides a kind of historical data archiving dress
Put, it is possible to increase task historical data access speed.
For reaching above-mentioned purpose, a kind of historical data archiving method that the embodiment of the present invention provides, the party
Method includes:
Contain and the overall historical data base of each task related data to be edited from gather and store
In, extract the historical data matched with task to be edited；
Filing historical data is edited and formed to the historical data extracted；
Task identification is set for filing historical data, and the filing historical data of task identification will be provided with
Store in the task filing historical data base pre-set.
It is preferred that the historical data of described extraction includes: pre-operation data and described pre-operation data
The pre-operation subordinate data of association, condition data；Wherein,
Described pre-operation data are the data that current required by task to be edited is updated attended operation；
Described pre-operation subordinate data are relevant to current task to be edited, and with described pre-operation data
Change and the data that change；
Described condition data is relevant to current task to be edited, but without the data being updated.
It is preferred that before the historical data that described extraction and task to be edited match, simultaneously or it
After, described method farther includes:
For task to be edited, task identification and task edit session section are set；
Build comprise the pre-operation of task identification hurdle, pre-operation field and pre-operation data association from
Belong to field and the task data relation table on condition data hurdle；
Before the described historical data to extracting carries out editor's formation filing historical data, described method
Farther include:
By the task mark in the described task identification arranged for task to be edited write task data relation table
Know hurdle, and according to task to be edited, task identification and with the historical data that matches of task to be edited
Between corresponding relation, the historical data of described extraction is write the corresponding hurdle in task data relation table.
It is preferred that filing historical data is edited and formed to the described historical data to extracting, specifically
For,
In the edit session section of task to be edited, in task historical data table with for task to be edited
The pre-operation data that the task identification of setting is corresponding are updated safeguarding；
Change according to pre-operation data updates pre-operation subordinate data.
It is preferred that described filing historical data includes: task data relation table has completed updating maintenance
Pre-operation data, make the pre-operation subordinate data of corresponding renewal according to the change of pre-operation data,
And condition data.
It is preferred that after filing historical data is edited and formed to the described historical data to extracting,
Before described formation filing historical data, the method includes:
It is standby that historical data for having edited sets up pre-operation data backup table, pre-operation subordinate data respectively
Part table and condition data backup table；Wherein,
Described pre-operation data backup table pre-operation data in the historical data that storage has been edited,
And be provided with and the current corresponding task identification of task to be edited；
Described pre-operation subordinate data backup table pre-operation in the historical data edited of storage from
Belong to data, and be provided with and the current corresponding task identification of task to be edited；
Described condition data backup table condition data in the historical data that storage has been edited, and set
It is equipped with and the current corresponding task identification of task to be edited.
Further, by described pre-operation data backup table, described subordinate data backup table and described bar
Part data backup table stores in the task filing historical data base pre-set.
It is preferred that arrange task identification described for filing historical data, and task identification will be provided with
Filing history data store to pre-set task filing historical data base in after, the method is entered
One step includes:
Receive the task the inquiry of historical data request represented with task identification, and according to the task mark received
Know and filter out the filing historical data corresponding with task identification from task filing historical data base.
According to a further aspect in the invention, a kind of historical data archiving device, this device bag are additionally provided
Include: task data management module, filing data more new module, task history data store module；Its
In,
Described task data management module, for containing and each task to be edited from gather and store
In the overall historical data base of related data, extract the historical data matched with task to be edited；
Described filing data more new module, for the history extracted by described task data management module
Data carry out editing and formed filing historical data；
Described task history data store module, is used for being formed by described filing data more new module
Filing historical data arranges task identification, and the filing history data store being provided with task identification is arrived
In the task filing historical data base pre-set.
It is preferred that the historical data of described extraction includes: pre-operation data and pre-operation data association
Pre-operation subordinate data, condition data；Wherein,
Described pre-operation data are the data that current required by task to be edited is updated attended operation；
Described pre-operation subordinate data are relevant to current task to be edited, and with described pre-operation data
Change and the data that change；
Described condition data is relevant to current task to be edited, but without the data being updated.
It is preferred that described task data management module is further used for arranging task mark for task to be edited
Know and task edit session section；Structure comprises task identification hurdle, pre-operation field, pre-operation subordinate
The task data relation table on field and condition data hurdle；
Task identification in the task identification write task data relation table that will arrange for task to be edited
Hurdle, and according to task to be edited, task identification and the historical data that matches with task to be edited it
Between corresponding relation, the historical data of described extraction is write the corresponding hurdle in task data relation table.
As seen from the above technical solution, the embodiment of the present invention provide a kind of historical data archiving method with
And historical data archiving device, by relevant to task to be edited in the overall data that will prestore
All historical datas are deployed to this task to be edited, and to the historical data relevant to this task to be edited
It is updated safeguarding, forms filing historical data；Task identification is set for filing historical data, and makees
For, in task history data store to task filing historical data base, so, being achieved that overall data
Separate with task historical data.Task need are met in needs are inquired about or obtained a certain historical time section
Ask and during the task historical data relevant to task, task identification can be passed through, file history from task
Data base directly filters out the task historical data corresponding with this task, and without accessing overall history
Data base, access speed is fast.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below by right
In embodiment or description of the prior art, the required accompanying drawing used is briefly described.It should be evident that
Accompanying drawing in below describing is only some embodiments of the present invention, for those of ordinary skill in the art
For, it is also possible to other embodiment and accompanying drawing thereof is obtained according to these accompanying drawing illustrated embodiments.
Fig. 1 is embodiment of the present invention historical data archiving method flow schematic diagram.
Fig. 2 is embodiment of the present invention historical data archiving apparatus structure schematic diagram.
Detailed description of the invention
Below with reference to accompanying drawing, the technical scheme of various embodiments of the present invention is carried out clear, complete retouching
State, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole
Embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creativeness
All other embodiments obtained by the premise of work, broadly fall into the scope that the present invention is protected.
The existing overall data data relevant to task being updated after safeguarding is as overall history
Data store in overall historical data base, there is waste memory space and task historical data accesses speed
Spend slow problem；Even if using the technical scheme improved that the data relevant to task are updated safeguarding
After more new data individually store as history more new data, although solve waste of storage space
Problem, but owing to complete task history number need to could be obtained in conjunction with history more new data and overall data
According to, however it remains the problem that task historical data access speed is slow.
The historical data archiving method that the embodiment of the present invention provides, before task starts, will deposit in advance
In the overall data of storage, all historical datas relevant to task are deployed to this task.Then, treat at this
During editor's tasks carrying, can be updated historical data safeguarding, form filing historical data；
At the end of task, task identification is set for filing historical data, and returning of task identification will be provided with
Shelves historical data is filed in historical data base as task history data store to task, so, it is achieved
Overall data separates with task historical data.Meet in needs obtain a certain historical time section and appoint
When business demand the historical data relevant to task, can directly pass through task identification, file from task
Filtering out the task historical data corresponding with this task in historical data base, access speed is fast.
Fig. 1 is embodiment of the present invention historical data archiving method flow schematic diagram.According to mission requirements
Before being updated data relevant to task in the overall data prestored safeguarding, it is preferred that
Task list and task data relation table is built in advance in Database Systems；Wherein,
The task list built includes task identification hurdle, initial time hurdle and terminates time fences, is used for
Store the edit session section of the task identification corresponding with each task and task；It is of course also possible to will
Initial time hurdle and termination time fences are integrated into edit session section hurdle；
Structure task and the relation table of data, i.e. task data relation table, wherein, task data relation
Table includes task identification hurdle, field, for the task mark that storage is corresponding with every task to be edited
Know, and the data relevant to current task to be edited.
In the embodiment of the present invention, the overall data prestored can by different shared tables of data and altogether
Enjoy data relationship table composition, wherein, share the data stored in data relationship table with in shared tables of data
The change of data and change.
Such as, overall data is by sharing tables of data A, sharing tables of data B and shared data relationship table
C forms；Wherein, share in tables of data A by data Ai(i=1,2,3,4 ...) composition, altogether
Enjoy in tables of data B by data Bj(j=1,2,3,4 ...) composition；Share in data relationship table C
By data Cn(n=1,2,3,4 ...) composition.
Where it is assumed that when data A1 in shared tables of data A change, share data relationship
Change with data A1 is produced corresponding change by data C1 in table C；
When data B2 in shared tables of data B change, share the number in data relationship table C
According to C2, the change with data B2 produced corresponding change；
When adding in shared tables of data A or deleting data A3, then sharing data relationship table C will be corresponding
Add or delete data C3；
As data A2 in shared tables of data A, A4, and/or, share data B1 in tables of data B,
When B3 changes, the data shared in data relationship table C do not change.
In the embodiment of the present invention, the task of need to carry out data maintenance can represent with T, such as first task
Being expressed as T1, initial time is on August 1st, 2013, and the termination time is on August 5th, 2013；
Second task presentation is T2, and initial time is on August 8th, 2013, and the termination time is 2013 8
The moon 20.The corresponding task list then set up may include that the task identification T1 of first task with
And initial time 2013.08.01 of first task, and terminate time 2013.08.05, or first task
Edit session section 2013.08.01-2013.08.05；Rising of second task identification T2 and the second task
Time beginning 2013.08.08, and terminate time 2013.08.20, or the edit session section of the second task
2013.08.08-2013.08.20。
Further, it is assumed that data relevant to first task T1 in overall data include sharing data
A1, A2, A3, A4 in Table A, shares B1, B2, the B3 in tables of data B；Therefore share
Data C1, C2, C3 in data relationship table C are also relevant to first task T1, and in overall data,
Such as data A5 in shared tables of data A, A6 etc., share data B4 in tables of data, B5 etc. all
For the data unrelated with first task T1.So, permissible in the corresponding task data relation table of foundation
Including: the task identification T1 of first task and data A1 relevant to task, A2, A3, A4,
B1, B2, B3, C1, C2, C3, wherein, data A1, A3 and B2 are that first task T1 is pre-
Performing the data of updating maintenance, data A2, A4, B1, B3 are for relevant to first task T1 but be not required to
It is updated the data safeguarded.
As it is shown in figure 1, the historical data archiving method that the embodiment of the present invention provides includes:
Step 101, from the overall history number containing each task related data to be edited gathered and store
According in storehouse, extract the historical data matched with task to be edited；
In this step, extract from overall historical data base with going through that current task to be edited matches
History data include: the pre-operation subordinate data of pre-operation data and pre-operation data association, conditional number
According to；Wherein,
Pre-operation data are that current required by task to be edited carries out safeguarding or the updating maintenance operation such as deletion
Data；
Pre-operation subordinate data are relevant to current task to be edited, and with pre-operation data change and
The data of change；
Condition data is relevant to current task to be edited, but without the data being updated.
Such as, from the overall historical data base of storage, the data relevant to first task T1 are filtered out:
Share A1, A2, A3, the A4 in tables of data A, share B1, B2, B3 in tables of data B with
And data C1 in shared data relationship table C, C2, C3.Wherein, pre-operation data refer to data
A1, A3 and B2；Pre-operation subordinate data refer to data C1, C2, C3, and condition data is index
According to A2, A4, B1, B3.
It is preferred that in the embodiment of the present invention, extract and historical data that task to be edited matches it
Before, simultaneously or after, the method can also include further:
For task to be edited, task identification and task edit session section are set；
Build comprise the pre-operation of task identification hurdle, pre-operation field and pre-operation data association from
Belong to field and the task data relation table on condition data hurdle；
Before the historical data extracted carries out editor's formation filing historical data, the method is further
Including: the task identification in the task identification write task data relation table that will arrange for task to be edited
Hurdle, and according to task to be edited, task identification and with task to be edited match historical data it
Between corresponding relation, will extract historical data write task data relation table in corresponding hurdle.
Specifically, appoint corresponding with current task to be edited can be added in the task list built in advance
Business mark and task edit session section and by when pre-editing task initial time and terminate the time with editor
The mode of time period stores in edit session section hurdle.
In the embodiment of the present invention, it is movable that task refers to once, and this activity relates to the overall number prestored
Part data according to, and need to be updated some data in the part data related to safeguarding.Its
In, a movable corresponding task identification and the active edit time period each time, so, each task
Corresponding task identification, a task edit session section, such as first task is expressed as T1, initial time
Being on August 1st, 2013, the termination time is on August 5th, 2013, then by the task of first task
Edit session section 2013.08.01-2013.08.05 of mark T1 and first task is respectively written into task list
In corresponding hurdle.In actual application, by record in task list task to be edited task identification,
Task starting time and job end time, it is simple in subsequent applications, user can pass through task mark
Know or the task historical data relevant to performing of task is inquired about and obtained to edit session section.
In the embodiment of the present invention, the field in the task data relation table built in advance can be split as
Pre-operation field, the pre-operation data subordinate hurdle of pre-operation data association and condition data hurdle.This
Sample, just completes the task deployment of the data relevant to current task.
In the embodiment of the present invention, the data by relevant to first task T1: A1, A2, A3, A4,
B1, B2, B3, C1, C2, C3 add in task data relation table as filing data, and with
The task identification T1 of first task is associated storage；About how data being passed through task mark with task
Know and be associated technology known to those skilled in the art, do not repeat them here.
Step 102, edits and is formed filing historical data to the historical data extracted；
In this step, after the historical data extracted is added in task data relation table, permissible
In the edit session section of task to be edited, arrange with for task to be edited in task data relation table
Pre-operation data corresponding to task identification be updated safeguarding；Meanwhile, changing according to pre-operation data
Change new pre-operation subordinate data.So, in task data relation table with arrange for task to be edited
What task identification was corresponding completes the pre-operation data of updating maintenance, pre-operation subordinate data, and bar
Number of packages is according to constituting filing historical data.
In the embodiment of the present invention, as it was previously stated, in the initial time August 1 in 2013 of first task T1
Day to terminating within 5 days Augusts in 2013 of time, can to pre-operation data A1 in filing data,
A3 and B2 is updated safeguarding, correspondingly, pre-operation subordinate data C1, C2, C3 will be according in advance
Operation data A1, the change of A3, B2 and make corresponding renewal.It is assumed that when first task T1 is whole
Time only, pre-operation data A1, B2 are updated to data A1 ＇, B2 ＇；Data A3 are deleted, accordingly
Ground, pre-operation subordinate data C1, C2, C3 are updated to data C1 ＇, C2 ＇.So, completed more
New data A1 ＇, B2 ＇, data C1 ＇, C2 ＇ safeguarded, and condition data A2, A4, B1,
B3 constitutes the filing historical data corresponding with task identification T1.
In actual application, when the data volume needing updating maintenance to process in this task is bigger, processing
The regular hour will be expended, therefore, in order to ensure the smooth of host process during logical relation between data
Carry out, an asynchronous process will be opened and process these data renewal affairs；Data renewal will after having processed
One completion status of write-back, in order to notice host process data have processed, and result are fed back to
In task data relation table；If midway occurs abnormal, then one abnormality of write-back, in order to notice
Host process carries out other relevant treatment.When the data volume that this task needs updating maintenance to process is less,
Then can use synchronization process mechanism, directly synchronized update result in task data relationship table.
Step 103, arranges task identification for filing historical data, and will be provided with the filing of task identification
History data store is filed in historical data base to pre-setting of task.
In this step, for by task data relation table has completed the pre-operation data of updating maintenance, root
The pre-operation subordinate data of corresponding renewal, and condition data structure is made according to the change of pre-operation data
Become filing historical data task identification is set, this task identification with for current task to be edited arrange
Task identification is identical, and the filing historical data being provided with task identification is deposited as task historical data
Store up in the task filing historical data base pre-set.
In the embodiment of the present invention, as it was previously stated, when first task T1 terminates, pre-operation data A1,
B2 is updated to data A1 ＇, B2 ＇；Data A3 are deleted, correspondingly, pre-operation subordinate data C1,
C2, C3 are updated to data C1 ＇, C2 ＇, then will complete updating maintenance in task data relation table
Pre-operation data A1 ＇, B2 ＇, pre-operation subordinate data C1 ＇, C2 ＇ and condition data A2, A4,
B1, B3 file in historical data base to task as filing history data store, and with task identification
T1 is as the index information of this filing historical data.So, so that it may by task historical data and overall number
According to separating.When user need to obtain the task historical data of certain time period, only need to be according to task
Mark can obtain the complete task historical data relevant to task, pre-including through updating maintenance
Operation data, pre-operation subordinate data and condition data.
Alternatively, in the embodiment of the present invention, after the historical data extracted is edited, can
Think that the historical data completing editor sets up pre-operation data backup table, pre-operation subordinate data respectively
Backup table and condition data backup table；
Wherein, pre-operation data backup table pre-operation data in the historical data that storage has been edited,
And be provided with and the current corresponding task identification of task to be edited；
Pre-operation subordinate data backup table pre-operation subordinate number in the historical data that storage has been edited
According to, and be provided with and the current corresponding task identification of task to be edited；
Condition data backup table condition data in the historical data that storage has been edited, and be provided with
With the current corresponding task identification of task to be edited.
Further, pre-operation data backup table, subordinate data backup table and condition data are backed up
Table stores in task filing historical data base；Wherein, the described pre-behaviour of same task mark it is provided with
Make data backup table, described subordinate data backup table and described condition data backup table store respectively
Comprehensively being of pre-operation data, pre-operation subordinate data and condition data is corresponding with task identification
Filing historical data.So, inquiring about the historical data relevant to task and obtaining the most complete number
While according to, the pre-operation data of the renewal in task historical data can be fully understood by and do not update
Condition data, and the pre-operation subordinate data being associated with the data updated, it is simple in the task of acquisition
With other task historical datas or the relative analysis of current data after historical data.
In the embodiment of the present invention, task identification is being set for filing historical data, and is storing to setting in advance
After in the task filing historical data base put, the method can further include:
Receive the task the inquiry of historical data request represented with task identification, and according to the task mark received
Know and filter out the filing historical data corresponding with task identification from task filing historical data base.
In actual application, the different task performed for different time sections, said method can be used
It is updated the data relevant to task safeguarding, and is formed and the task mark arranged for task to be edited
Know corresponding task historical data.So, when the task historical data receiving user is asked, can
First to filter out the task identification corresponding with the request of task the inquiry of historical data and editor from task list
Time period；Then, according to task identification, filter out and task mark from task filing historical data base
Know corresponding filing historical data, including pre-operation data, pre-operation subordinate data and condition data,
Thus obtain the detailed complete real task history number corresponding with the request of task the inquiry of historical data
According to.
Therefore, the historical data archiving method that the embodiment of the present invention provides, by prestoring
Overall data in all historical datas of matching with task to be edited be deployed to this task to be edited,
And be updated safeguarding to the historical data matched with this task to be edited, form filing history number
According to, filing historical data is arranged task identification, and files as task history data store to task
In historical data base, so, it is achieved that overall data separates with task historical data.And needing
Mission requirements the task history number relevant to task is met in inquiring about or obtain a certain historical time section
According to time, task identification can be passed through, from task filing historical data base directly filter out and this task
Corresponding task historical data, and without accessing overall historical data base, access speed is fast.
Fig. 2 is embodiment of the present invention historical data archiving apparatus structure schematic diagram.As in figure 2 it is shown, should
Device includes: task data management module 21, filing data more new module 22, task historical data are deposited
Storage module 23；Wherein,
Task data management module 21, for containing and each task phase to be edited from gather and store
Close in the overall historical data base of data, extract the historical data matched with task to be edited；
In the embodiment of the present invention, that filter out with current task phase to be edited from overall historical data base
Coupling historical data, including pre-operation data and pre-operation data association pre-operation subordinate data,
Condition data；Wherein,
Pre-operation data are the data that current required by task to be edited is updated attended operation；
Pre-operation subordinate data are relevant to task to be edited, and change with the change of pre-operation data
Data；
Condition data is relevant to current task to be edited, but without the data being updated.
In the embodiment of the present invention, task data management module 21 is further used for arranging for task to be edited
Task identification and task edit session section；Structure comprises task identification hurdle, pre-operation field, grasps in advance
Make the task data relation table on subordinate field and condition data hurdle；
Task identification in the task identification write task data relation table that will arrange for task to be edited
Hurdle, and according to task to be edited, task identification and the historical data that matches with task to be edited it
Between corresponding relation, the historical data of described extraction is write the corresponding hurdle in task data relation table.
In the embodiment of the present invention, task list can be built, and add and current task in the task list built
Corresponding task identification, initial time and the time of termination, or by initial time and the time of termination with task
The mode of edit session section is added in task list.
In the embodiment of the present invention, the task list of structure includes task identification hurdle, task edit session section
Hurdle, for storing the task identification corresponding with every task to be edited and task edit session section.This
Sample, by the task performed by record, can be so that subsequent user be by task identification or edit session
The task historical data relevant to the task to be edited performed is inquired about and obtained to section.
Filing data more new module 22, for the history number extracted by described task data management module
Edit and formed filing historical data according to carrying out；
In the embodiment of the present invention, after the historical data extracted is added in task data relation table,
Can in the edit session section of task to be edited, in task data relation table with for task to be edited
The pre-operation data that the task identification of setting is corresponding are updated safeguarding；Meanwhile, according to pre-operation data
Change update pre-operation subordinate data.So, task data relation table sets with for task to be edited
What the task identification put was corresponding completes the pre-operation data of updating maintenance, pre-operation subordinate data, with
And condition data constitutes filing historical data.
In actual application, when the data volume needing updating maintenance to process in this task is bigger, processing
The regular hour will be expended, therefore, in order to ensure the smooth of host process during logical relation between data
Carry out, an asynchronous process will be opened and process these data renewal affairs；Data renewal will after having processed
One completion status of write-back, in order to notice host process data have processed, and result are fed back to
In task data relation table；If midway occurs abnormal, then one abnormality of write-back, in order to notice
Host process carries out other relevant treatment.When the data volume that this task needs updating maintenance to process is less,
Then can use synchronization process mechanism, directly synchronized update result in task data relationship table.
Task history data store module 23, is used for as by returning that described filing data more new module is formed
Shelves historical data arranges task identification, and will be provided with the filing history data store of task identification to pre-
In the task filing historical data base first arranged.
In the embodiment of the present invention, for by the pre-operation number having completed updating maintenance in task data relation table
According to, make the pre-operation subordinate data of corresponding renewal, and condition according to the change of pre-operation data
The filing historical data that data are constituted arranges task identification, this task identification with for current task to be edited
Arrange task identification identical, and using be provided with task identification filing historical data as task history
Data store in the task filing historical data base pre-set.
Alternatively, in the embodiment of the present invention, task history data store module 23 can also be the completeest
The pre-operation data of updating maintenance, pre-operation subordinate data and condition data is become to set up pre-operation respectively
Data backup table, subordinate data backup table and condition data backup table, by pre-operation data backup table,
Subordinate data backup table and condition data data backup table store in task filing historical data base；
Wherein, the described pre-operation data backup table of same task mark, described subordinate data backup it are provided with
The pre-operation data that store respectively in table and described condition data backup table, pre-operation subordinate data and
Condition data be comprehensively the filing historical data corresponding with task identification.As such, it is possible to according to appointing
The pre-operation data identifying the renewal in acquisition task historical data of being engaged in and the condition data not updated, with
And with the pre-operation subordinate data that are associated of data updated, it is simple to after obtaining task historical data
With other task historical datas or the relative analysis of current data.
In actual application, the different task performed for different time sections, said apparatus can be used
It is updated the data relevant to task safeguarding, and forms the task corresponding with the task identification of task
Historical data.So, when the task historical data receiving user is asked, can be from appointing of building
Business table filters out the task identification corresponding with the request of task historical data；According to task identification, from appointing
Business filing historical data base transfers the task historical data corresponding with task identification, including pre-operation number
According to the data of each storage in backup table, subordinate data backup table and condition data backup table, thus
Obtain the detailed complete real task historical data corresponding with inquiry request.
Further, in the embodiment of the present invention, task identification is being set for filing historical data, and is depositing
After storing up in the task filing historical data base pre-set, this device can also include: data please
Seek enquiry module, for receiving the task the inquiry of historical data request represented with task identification, and according to
The task identification received is from by task history data store module 23 store tasks filing historical data base
Filter out the filing historical data corresponding with task identification.
Therefore, the historical data archiving device that the embodiment of the present invention provides, by task data pipe
The all historical datas matched with task to be edited in overall historical data are deployed to by reason module 21
This task to be edited, and by the filing data more new module 22 history number to matching with this task
Form filing historical data according to being updated safeguarding, filing historical data is arranged task identification, and makees
For in task history data store to task history data store module 23, so, it is achieved that overall
Historical data separates with task historical data.In a certain historical time section is inquired about or obtained to needs completely
When foot mission requirements the task historical data relevant to task, task identification can be passed through, from task
History data store module 23 directly filters out the task historical data corresponding with this task.
Obviously, those skilled in the art can carry out various change and modification without deviating from this to the present invention
The spirit and scope of invention.So, if these amendments and modification to the present invention belong to present invention power
Profit requires and within the scope of equivalent technologies, then the present invention also comprises these change and modification.
Claims (8)
1. a historical data archiving method, it is characterised in that the method includes:
Contain with the overall historical data base of each task related data from gather and store, extract
The historical data matched with task to be edited；
Filing historical data is edited and formed to the historical data extracted；
Task identification is set for filing historical data, and the filing historical data of task identification will be provided with
Store in the task filing historical data base pre-set；
The historical data of described extraction includes: pre-operation data are pre-with described pre-operation data association
Operation subordinate data, condition data；Wherein,
Described pre-operation data are the data that current required by task to be edited is updated attended operation；
Described pre-operation subordinate data are relevant to current task to be edited, and with described pre-operation data
Change and the data that change；
Described condition data is relevant to current task to be edited, but without the data being updated.
Method the most according to claim 1, wherein, in described extraction and task to be edited phase
Before the historical data joined, simultaneously or after, described method farther includes:
For task to be edited, task identification and task edit session section are set；
Build comprise the pre-operation of task identification hurdle, pre-operation field and pre-operation data association from
Belong to field and the task data relation table on condition data hurdle；
Before the described historical data to extracting carries out editor's formation filing historical data, described method
Farther include:
By the task mark in the described task identification arranged for task to be edited write task data relation table
Know hurdle, and according to task to be edited, task identification and with the historical data that matches of task to be edited
Between corresponding relation, the historical data of described extraction is write the corresponding hurdle in task data relation table.
Method the most according to claim 2, wherein, the described historical data to extracting is compiled
Collect and formed filing historical data, specifically,
In the edit session section of task to be edited, in task historical data table with for task to be edited
The pre-operation data that the task identification of setting is corresponding are updated safeguarding；
Change according to pre-operation data updates pre-operation subordinate data.
Method the most according to claim 3, wherein, described filing historical data includes: task
Data relationship table completes the pre-operation data of updating maintenance, has made according to the change of pre-operation data
Go out the pre-operation subordinate data of corresponding renewal, and condition data.
Method the most according to claim 3, wherein, is carried out in the described historical data to extracting
After editing and formed filing historical data, the method includes:
It is standby that historical data for having edited sets up pre-operation data backup table, pre-operation subordinate data respectively
Part table and condition data backup table；Wherein,
Described pre-operation data backup table pre-operation data in the historical data that storage has been edited,
And be provided with and the current corresponding task identification of task to be edited；
Described pre-operation subordinate data backup table pre-operation in the historical data edited of storage from
Belong to data, and be provided with and the current corresponding task identification of task to be edited；
Described condition data backup table condition data in the historical data that storage has been edited, and set
It is equipped with and the current corresponding task identification of task to be edited；
Further, by described pre-operation data backup table, described subordinate data backup table and described bar
Part data backup table stores in the task filing historical data base pre-set.
Method the most according to claim 4, wherein, appoints for filing historical data setting described
Business mark, and the filing history data store of task identification will be provided with to the task filing pre-set
After in historical data base, the method farther includes:
Receive the task the inquiry of historical data request represented with task identification, and according to the task mark received
Know and filter out the filing historical data corresponding with task identification from task filing historical data base.
7. a historical data archiving device, it is characterised in that this device includes: task data manages
Module, filing data more new module, task history data store module；It is characterized in that,
Described task data management module, for containing and each task to be edited from gather and store
In the overall historical data base of related data, extract the historical data matched with task to be edited；
Described filing data more new module, for the history extracted by described task data management module
Data carry out editing and formed filing historical data；
Described task history data store module, is used for being formed by described filing data more new module
Filing historical data arranges task identification, and the filing history data store being provided with task identification is arrived
In the task filing historical data base pre-set；
The historical data of described extraction includes: pre-operation data are pre-with described pre-operation data association
Operation subordinate data, and condition data；Wherein,
Described pre-operation data are the data that current required by task to be edited is updated attended operation；
Described pre-operation subordinate data are relevant to current task to be edited, and with described pre-operation data
Change and the data that change；
Described condition data is relevant to current task to be edited, but without the data being updated.
Device the most according to claim 7, it is characterised in that described task data management module
It is further used for arranging task identification and task edit session section for task to be edited；Structure comprises task
The task data on identification field, pre-operation field, pre-operation subordinate field and condition data hurdle is closed
It it is table；
Task identification in the task identification write task data relation table that will arrange for task to be edited
Hurdle, and according to task to be edited, task identification and the historical data that matches with task to be edited it
Between corresponding relation, the historical data of described extraction is write the corresponding hurdle in task data relation table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310471385.5A CN103514295B (en) | 2013-10-10 | 2013-10-10 | historical data archiving method and historical data archiving device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310471385.5A CN103514295B (en) | 2013-10-10 | 2013-10-10 | historical data archiving method and historical data archiving device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103514295A CN103514295A (en) | 2014-01-15 |
| CN103514295B true CN103514295B (en) | 2016-09-28 |
Family
ID=49897019
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310471385.5A Active CN103514295B (en) | 2013-10-10 | 2013-10-10 | historical data archiving method and historical data archiving device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103514295B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104052804A (en) * | 2014-06-09 | 2014-09-17 | 深圳先进技术研究院 | Method, device and cluster for sharing data streams between different task topologies |
| CN105653560B (en) * | 2014-11-28 | 2019-05-14 | 华为软件技术有限公司 | Data archiving method and device |
| CN105279261B (en) * | 2015-10-23 | 2019-07-02 | 北京京东尚科信息技术有限公司 | Dynamic scalable database filing method and system |
| CN105243163A (en) * | 2015-11-05 | 2016-01-13 | 国家电网公司 | Archiving integration system and method of historical data |
| CN106126526A (en) * | 2016-06-13 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of data managing method and device |
| CN108733671B (en) * | 2017-04-14 | 2020-11-03 | 北京京东尚科信息技术有限公司 | Method and device for archiving data history |
| CN107870981B (en) * | 2017-09-30 | 2021-10-22 | 平安科技（深圳）有限公司 | Electronic device, data sheet filing method and storage medium |
| CN108446336B (en) * | 2018-02-27 | 2019-11-05 | 平安科技（深圳）有限公司 | Intelligent search method, device, equipment and the storage medium of organization names |
| CN109102228B (en) * | 2018-08-16 | 2022-04-29 | 郑州云海信息技术有限公司 | Freight train information management system based on cloud calculates |
| CN109684270B (en) * | 2018-12-11 | 2021-01-29 | 泰康保险集团股份有限公司 | Database archiving method, device, system, equipment and readable storage medium |
| CN110866006A (en) * | 2019-10-12 | 2020-03-06 | 苏宁云计算有限公司 | Method and device for archiving expired data |
| CN111679815B (en) * | 2020-06-04 | 2024-02-09 | 广州视源电子科技股份有限公司 | Asynchronous operation method and device, storage medium and related equipment |
| CN116257488B (en) * | 2023-02-21 | 2023-08-25 | 深圳市勘察测绘院(集团)有限公司 | Geotechnical engineering investigation big data archiving method, device, electronic equipment and medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN101639839A (en) * | 2008-07-30 | 2010-02-03 | 中兴通讯股份有限公司 | Method for searching multi-archive file based on temporary table |
| CN103106247A (en) * | 2012-12-31 | 2013-05-15 | 普天新能源有限责任公司 | Data dump method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7831317B2 (en) * | 2005-11-14 | 2010-11-09 | Rockwell Automation Technologies, Inc. | Distributed historian architecture |
-
2013
- 2013-10-10 CN CN201310471385.5A patent/CN103514295B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101639839A (en) * | 2008-07-30 | 2010-02-03 | 中兴通讯股份有限公司 | Method for searching multi-archive file based on temporary table |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN103106247A (en) * | 2012-12-31 | 2013-05-15 | 普天新能源有限责任公司 | Data dump method and system |
Non-Patent Citations (1)
| Title |
|---|
| 数据仓库历史数据归档与重构的策略研究;张岩;《中国优秀硕士学位论文全文数据库 信息科技辑》;20050831;I138-402 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103514295A (en) | 2014-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103514295B (en) | historical data archiving method and historical data archiving device | |
| CN104021145B (en) | The method and apparatus that a kind of mixed service concurrently accesses | |
| CN105243067B (en) | A kind of method and device for realizing real-time incremental synchrodata | |
| CN105938457B (en) | Filter method, device and the data reading system of data | |
| CN108536752A (en) | A kind of method of data synchronization, device and equipment | |
| CN106339408B (en) | Method of data synchronization, data synchronization unit and server | |
| CN108959400A (en) | Banking system data purge method and device | |
| CN102609520B (en) | Method for exporting model data of substation by filtering | |
| CN107562931A (en) | Data pick-up system and data abstracting method | |
| CN104317963B (en) | A kind of data processing method and device | |
| CN103399888B (en) | The differential synchronization method of grid model data and system | |
| CN103020169A (en) | Effectiveness and uniqueness processing method for electric data | |
| CN106021422B (en) | A kind of method and system forming Hive data warehouse based on relevant database | |
| CN102932195A (en) | Networking protocol analysis-based business analysis monitoring method and system | |
| CN104102652A (en) | Unstructured data storage system and method | |
| DE112018004008T5 (en) | SECURITY BASED ON FILE SYSTEM CONTENTS | |
| CN106802905A (en) | A kind of synergistic data exchange method of isomorphism PLM system | |
| CN108156030A (en) | The method and device that a kind of configuration strategy synchronizes | |
| CN101702219A (en) | Method for generating material information and device thereof | |
| CN106802928B (en) | Power grid historical data management method and system | |
| CN104298761B (en) | The implementation method that master data is matched between a kind of heterogeneous software system | |
| CN106326082A (en) | Method and device for recording log in network system | |
| CN103064908A (en) | Method for rapidly removing repeated list through a memory | |
| CN110019200A (en) | A kind of foundation of index, application method and device | |
| CN104199955A (en) | Information management system and information management method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |