CN103514295A - Method and device for archiving historical data - Google Patents
Method and device for archiving historical data Download PDFInfo
- Publication number
- CN103514295A CN103514295A CN201310471385.5A CN201310471385A CN103514295A CN 103514295 A CN103514295 A CN 103514295A CN 201310471385 A CN201310471385 A CN 201310471385A CN 103514295 A CN103514295 A CN 103514295A
- Authority
- CN
- China
- Prior art keywords
- data
- task
- historical data
- historical
- filing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
Abstract
The invention discloses a method for archiving historical data. The method for archiving the historical data comprises the steps of (1) extracting the historical data matched with a task to be edited from a whole historical database containing data which are collected, are stored and are related to tasks; (2) editing the extracted historical data, and forming archived historical data; (3) setting a task identification for the archived historical data, and storing the archived historical data with the task identification on a preset task archived historical database. When the method for archiving the historical data is applied, the access speed of the historical data of the task can be increased.
Description
Technical field
The present invention relates to areas of information technology, relate in particular to a kind of historical data archiving method and historical data archiving device.
Background technology
In practical application, the industries such as finance, communication need opening relationships database application system, carry out a large amount of data of real time record, simultaneously by whole historical data base, often, in order to meet a certain mission requirements, need to carry out updating maintenance to data relevant to task in pre-stored overall data.For example, for a large-scale function system module, when this function system module of operation, can carry out real time record to all properties index parameter of this function system module, and the performance index parameter of all real time record forms whole historical data; And in order to carry out the impact research for performance index Z about performance index Y under X condition, need to edit studying relevant data to this.
Existing, after treating that editor's task starts, current time has been comprised respectively to the data relevant to task in the overall data of task related data to be edited to be editted and updated, when task finishes, by the overall data of having edited as a whole historical data archiving store in whole historical data base, the overall data of wherein, having edited comprise the data relevant to task and with the irrelevant data of task.Because the time period different is to meet different mission requirements can produce different whole historical datas, therefore, can set up index information according to the edit session section of carrying out this task, in order to the different historical overall data producing is made to differentiation.
This historical data archiving method of upgrading based on task information, need to take larger storage space and store the whole historical data that these different time sections produce; And, in the whole historical data of generation, there is the problem of repeated storage with the irrelevant data of task, caused the waste of storage space.On the other hand, while meeting mission requirements the task historical data relevant to task in need to obtaining a certain historical time section, must be according to obtaining corresponding whole historical data with the corresponding index information of this historical time section from whole historical data base, then, seek the whole whole historical data of obtaining all over, therefrom filter out in this historical time section and meet mission requirements the task historical data relevant to task, have the slow problem of task historical data access speed.
For solving the problem of waste of storage space, existing proposition after the data relevant to task are carried out updating maintenance in to overall data, is filed separately storage by data relevant to task and that carry out updating maintenance, and history of forming is new data more; In different time sections, for meeting different mission requirements, can produce more new data of different history, therefore, can by add the identification informations such as timestamp or record number to different history more new data make differentiation.This improved technical scheme, although solved the repeated storage problem of the data irrelevant with task, but while meeting mission requirements the task historical data relevant to task in need to obtaining a certain historical time section, need obtain in this historical time section more new data of history updating maintenance and relevant to task according to identification information; Need from historical overall data storehouse, transfer the whole historical data in same historical time section simultaneously, obtain historical data relevant to task but that upgrade, could accurately intactly obtain all task historical datas relevant to task in this historical time section like this.When needs obtain the data of different historical time sections, need to, in the more frequently access between new data and overall data of different history, cause task historical data access speed slow.
Summary of the invention
Embodiments of the invention provide a kind of historical data archiving method, can improve task historical data access speed.
According to a further aspect in the invention, the embodiment of the present invention also provides a kind of historical data archiving device, can improve task historical data access speed.
For achieving the above object, a kind of historical data archiving method that the embodiment of the present invention provides, the method comprises:
From the whole historical data base of having comprised of gathering and store and task related data to be edited respectively, extract and the historical data for the treatment of that editor's task matches;
Filing historical data is edited and formed to the historical data of extracting;
For filing historical data arranges task identification, and the filing history data store that is provided with task identification is filed in historical data base to setting in advance of task.
Preferably, the historical data of described extraction comprises: pre-operation data, with pre-operation subordinate data, the condition data of described pre-operation data correlation; Wherein,
Described pre-operation data are the data that required by task current to be edited carries out updating maintenance operation;
Described pre-operation subordinate data are for to treat that to current editor's task is relevant, and the data that change with the change of described pre-operation data;
Described condition data is for to treat that to current editor's task is relevant, but without the data of upgrading.
Preferably, described extraction with treat historical data that editor's task matches before, simultaneously or afterwards, described method further comprises:
For treating that editor's task arranges task identification and task edit session section;
Structure comprise task identification hurdle, pre-operation field, with the pre-operation subordinate field of pre-operation data correlation and the task data relation table on condition data hurdle;
Before the described historical data to extraction is edited formation filing historical data, described method further comprises:
By described for to treat that the task identification of editor's task setting writes the task identification hurdle in task data relation table, and according to treat editor's task, task identification and and the corresponding relation matching between historical data of task to be edited, the historical data of described extraction is write to the corresponding hurdle in task data relation table.
Preferably, filing historical data is edited and formed to the described historical data to extraction, be specially,
In the edit session section of task to be edited, in task historical data table with for treating that the pre-operation data that the task identification of editor's task setting is corresponding carry out updating maintenance;
According to the change of pre-operation data, upgrade pre-operation subordinate data.
Preferably, described filing historical data comprises: in task data relation table, completed the pre-operation data of updating maintenance, the pre-operation subordinate data of making corresponding renewal according to the change of pre-operation data, and condition data.
Preferably, after filing historical data is edited and formed to the described historical data to extraction, before described formation filing historical data, the method comprises:
For the historical data of having edited is set up respectively pre-operation data backup table, pre-operation subordinate data backup table and condition data backup sheet; Wherein,
Described pre-operation data backup table is used for storing the pre-operation data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task;
Described pre-operation subordinate data backup table is used for storing the pre-operation subordinate data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task;
Described condition data backup sheet is used for storing the condition data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task.
Further, described pre-operation data backup table, described subordinate data backup table and described condition data backup sheet are stored in the task filing historical data base setting in advance.
Preferably, described, for filing historical data arranges task identification, and by after the filing history data store that is provided with task identification is in the task filing historical data base setting in advance, the method further comprises:
The task the inquiry of historical data request that reception represents with task identification, and from task filing historical data base, filter out the filing historical data corresponding with task identification according to the task identification receiving.
According to a further aspect in the invention, also provide a kind of historical data archiving device, this device comprises: task data administration module, filing data update module, task history data store module; Wherein,
Described task data administration module, for from having comprised of gathering and store and the whole historical data base of task related data to be edited respectively, extracts and the historical data for the treatment of that editor's task matches;
Described filing data update module, for editing and form filing historical data to the historical data of being extracted by described task data administration module;
Described task history data store module, is used to the filing historical data being formed by described filing data update module that task identification is set, and the filing history data store that is provided with task identification is filed in historical data base to setting in advance of task.
Preferably, the historical data of described extraction comprises: pre-operation data, with pre-operation subordinate data, the condition data of pre-operation data correlation; Wherein,
Described pre-operation data are the data that required by task current to be edited carries out updating maintenance operation;
Described pre-operation subordinate data are for to treat that to current editor's task is relevant, and the data that change with the change of described pre-operation data;
Described condition data is for to treat that to current editor's task is relevant, but without the data of upgrading.
Preferably, described task data administration module is further used for as treating that editor's task arranges task identification and task edit session section; The task data relation table that structure comprises task identification hurdle, pre-operation field, pre-operation subordinate field and condition data hurdle;
By for to treat that the task identification of editor's task setting writes the task identification hurdle in task data relation table, and according to treat editor's task, task identification and and treat the corresponding relation between historical data that editor's task matches, the historical data of described extraction is write to the corresponding hurdle in task data relation table.
As seen from the above technical solution, a kind of historical data archiving method and historical data archiving device that the embodiment of the present invention provides, by all historical datas relevant to treating editor's task in pre-stored overall data are disposed to this and are treated editor's task, and to carrying out updating maintenance to this historical data for the treatment of that editor's task is relevant, form filing historical data; For filing historical data arranges task identification, and as task history data store in task filing historical data base, like this, just realized the separated of overall data and task historical data.When needs inquiries or obtain while meeting mission requirements the task historical data relevant to task in a certain historical time section, can pass through task identification, from task filing historical data base, directly filter out the task historical data corresponding with this task, and without the whole historical data base of access, access speed is fast.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, below will the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described.Apparently, the accompanying drawing in below describing is only some embodiments of the present invention, for those of ordinary skills, can also obtain according to these accompanying drawing illustrated embodiments other embodiment and accompanying drawing thereof.
Fig. 1 is embodiment of the present invention historical data archiving method flow schematic diagram.
Fig. 2 is embodiment of the present invention historical data archiving apparatus structure schematic diagram.
Embodiment
Below with reference to accompanying drawing, the technical scheme of various embodiments of the present invention is carried out to clear, complete description, obviously, described embodiment is only a part of embodiment of the present invention, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills are resulting all other embodiment under the prerequisite of not making creative work, all belong to the scope that the present invention protects.
Existing by the data relevant to task carry out overall data after updating maintenance as a whole history data store in whole historical data base, there is waste storage space and the slow problem of task historical data access speed; Even adopt data that improved technical scheme handle is relevant to task carry out more new data after updating maintenance as history more new data store separately, although solved waste of storage space problem, but due to need in conjunction with history more new data and overall data just can obtain complete task historical data, still there is the slow problem of task historical data access speed.
The historical data archiving method that the embodiment of the present invention provides, before task starts, disposes all historical datas relevant to task in pre-stored overall data to this task.Then, during this tasks carrying to be edited, can carry out updating maintenance to historical data, form filing historical data; When task finishes, for filing historical data arranges task identification, and the filing historical data that is provided with task identification is filed as task history data store to task in historical data base, like this, realized the separated of overall data and task historical data.While meeting mission requirements the historical data relevant to task in need to obtaining a certain historical time section, can directly pass through task identification, from task filing historical data base, filter out the task historical data corresponding with this task, access speed is fast.
Fig. 1 is embodiment of the present invention historical data archiving method flow schematic diagram.Before the data relevant to task carry out updating maintenance in to pre-stored overall data according to mission requirements, preferably, in Database Systems, build in advance task list and task data relation table; Wherein,
The task list building comprises task identification hurdle, initial time hurdle and termination time hurdle, for storing the edit session section of the task identification corresponding with each task and task; Certainly, also initial time hurdle and termination time hurdle can be integrated into edit session section hurdle;
The relation table of structure task and data, i.e. task data relation table, wherein, task data relation table comprises task identification hurdle, field, for storing the task identification corresponding with the every editor's for the treatment of task, and to the current data for the treatment of that editor's task is relevant.
In the embodiment of the present invention, pre-stored overall data can be comprised of different shared tables of data and shared data relationship table, wherein, shares the data of storing in data relationship table and changes with the change of sharing data in tables of data.
For example, overall data forms by sharing tables of data A, shared tables of data B and shared data relationship table C; Wherein, share in tables of data A by data Ai(i=1,2,3,4 ...) form, share in tables of data B by data Bj(j=1,2,3,4 ...) form; Share in data relationship table C by data Cn(n=1,2,3,4 ...) form.
Wherein, while supposing that data A1 in sharing tables of data A changes, the data C1 sharing in data relationship table C produces corresponding change by the variation with data A1;
When the data B2 in sharing tables of data B changes, the data C2 sharing in data relationship table C produces corresponding change by the variation with data B2;
In shared tables of data A, add or delete data A3, sharing data relationship table C and will add accordingly or deletion data C3;
Data A2, A4 in sharing tables of data A, and/or when data B1, the B3 in shared tables of data B changes, the data of sharing in data relationship table C do not change.
In the embodiment of the present invention, the task of need carry out data maintenance can represent with T, and as first task is expressed as T1, initial time is on August 1st, 2013, and the termination time is on August 5th, 2013; The second task list is shown T2, and initial time is on August 8th, 2013, and the termination time is on August 20th, 2013.In the corresponding task list of setting up, can comprise: the task identification T1 of first task and the initial time 2013.08.01 of first task, and termination time 2013.08.05, or the edit session section 2013.08.01-2013.08.05 of first task; The initial time 2013.08.08 of the second task identification T2 and the second task, and termination time 2013.08.20, or the edit session section 2013.08.08-2013.08.20 of the second task.
Further, suppose that data relevant to first task T1 in overall data comprise A1, A2, A3, the A4 sharing in tables of data A, share B1, B2, B3 in tables of data B; Therefore data C1, the C2, the C3 that share in data relationship table C are also relevant to first task T1, and in overall data, as shared data A5, the A6 etc. in tables of data A, data B4, the B5 etc. that share in tables of data are the data irrelevant with first task T1.Like this, in the corresponding task data relation table of setting up, can comprise: the task identification T1 of first task and data A1, A2, A3, A4, B1, B2, B3, C1, C2, the C3 relevant to task, wherein, data A1, A3 and B2 are the data of first task T1 pre-execution updating maintenance, and data A2, A4, B1, B3 are data relevant to first task T1 but that do not need to carry out updating maintenance.
As shown in Figure 1, the historical data archiving method that the embodiment of the present invention provides comprises:
In this step, the historical data matching with the current editor's for the treatment of task of extracting from whole historical data base comprises: pre-operation data, with pre-operation subordinate data, the condition data of pre-operation data correlation; Wherein,
Pre-operation data are that required by task current to be edited is safeguarded or the data of the updating maintenance such as deletion operation;
Pre-operation subordinate data are for to treat that to current editor's task is relevant, and the data that change with the change of pre-operation data;
Condition data is for to treat that to current editor's task is relevant, but without the data of upgrading.
For example, from the whole historical data base of storage, filter out the data relevant to first task T1: share A1, A2, A3, A4 in tables of data A, share data C1, C2, C3 in B1, B2, B3 and the shared data relationship table C in tables of data B.Wherein, pre-operation data refer to data A1, A3 and B2; Pre-operation subordinate data refer to data C1, C2, C3, and condition data refers to data A2, A4, B1, B3.
Preferably, in the embodiment of the present invention, extract with treat historical data that editor's task matches before, simultaneously or afterwards, the method further can also comprise:
For treating that editor's task arranges task identification and task edit session section;
Structure comprise task identification hurdle, pre-operation field, with the pre-operation subordinate field of pre-operation data correlation and the task data relation table on condition data hurdle;
Before the historical data of extracting being edited to formation filing historical data, the method further comprises: by for to treat that the task identification of editor's task setting writes the task identification hurdle in task data relation table, and according to treat editor's task, task identification and and the corresponding relation matching between historical data of task to be edited, the historical data of extraction is write to the corresponding hurdle in task data relation table.
Particularly, can in the task list building in advance, add the task identification corresponding with the current editor's for the treatment of task and task edit session section and store in edit session section hurdle working as the initial time of pre-editing task and the termination time mode with edit session section.
In the embodiment of the present invention, it is movable that task refers to once, and this activity relates to the partial data in pre-stored overall data, and need carry out updating maintenance to some data in the partial data relating to.Wherein, a task identification of activity correspondence each time and movable edit session section, like this, the corresponding task identification of each task, task edit session section, for example first task is expressed as T1, initial time is on August 1st, 2013, and the termination time is on August 5th, 2013, the edit session section 2013.08.01-2013.08.05 of the task identification T1 of first task and first task is write respectively to the corresponding hurdle in task list.In practical application, by record task identification, task starting time and the task end time of task to be edited in task list, be convenient in subsequent applications, user can inquire about and obtain the task historical data relevant to carrying out of task by task identification or edit session section.
In the embodiment of the present invention, the field in the task data relation table building in advance can be split as pre-operation data subordinate hurdle and the condition data hurdle of pre-operation field, pre-operation data correlation.Like this, just completed the task deployment of the data relevant to current task.
In the embodiment of the present invention, using the data relevant to first task T1: A1, A2, A3, A4, B1, B2, B3, C1, C2, C3 add in task data relation table as filing data, and carry out association store with the task identification T1 of first task; About how data and task being associated as to technology known in those skilled in the art by task identification, do not repeat them here.
In this step, after in the historical data of extracting is added to task data relation table, can be in the edit session section of task to be edited, in task data relation table with for treating that the pre-operation data that the task identification of editor's task setting is corresponding carry out updating maintenance; Meanwhile, according to the change of pre-operation data, upgrade pre-operation subordinate data.Like this, in task data relation table, with the pre-operation data that complete updating maintenance, pre-operation subordinate data for treating that the task identification of editor's task setting is corresponding, and condition data forms filing historical data.
In the embodiment of the present invention, as previously mentioned, within 5 days Augusts in 2013 of initial time August 1 to termination time in 2013 of first task T1, can carry out updating maintenance to pre-operation data A1, A3 and the B2 in filing data, correspondingly, pre-operation subordinate data C1, C2, C3 will make corresponding renewal according to the variation of pre-operation data A1, A3, B2.Suppose, when first task T1 stops, pre-operation data A1, B2 are updated to data A1 ＇, B2 ＇; Data A3 is deleted, and correspondingly, pre-operation subordinate data C1, C2, C3 are updated to data C1 ＇, C2 ＇.Like this, completed data A1 ＇, the B2 ＇ of updating maintenance, data C1 ＇, C2 ＇, and condition data A2, A4, B1, B3 form the filing historical data corresponding with task identification T1.
In practical application, when the data volume that needs updating maintenance to process is larger, during logical relation between deal with data, the regular hour will be expended, therefore in this task, in order to guarantee carrying out smoothly of host process, will open an asynchronous process and process this Data Update affairs; Data Update finish dealing with after by completion status of write-back so that notice host process data processing completes, and result is fed back in task data relation table; If occur extremely midway, abnormality of write-back, so that notice host process is carried out other relevant treatment.When this task needs data volume that updating maintenance processes hour, can adopt synchronous processor system, directly the synchronous result of upgrading in task data relationship table.
In this step, for completed the pre-operation data of updating maintenance, the pre-operation subordinate data of making corresponding renewal according to the change of pre-operation data in task data relation table, and the filing historical data that condition data forms arranges task identification, this task identification with for the current task identification for the treatment of that editor's task arranges is identical, and using the filing historical data that is provided with task identification as task history data store in the task filing historical data base setting in advance.
In the embodiment of the present invention, as previously mentioned, when first task T1 stops, pre-operation data A1, B2 are updated to data A1 ＇, B2 ＇; Data A3 is deleted, correspondingly, pre-operation subordinate data C1, C2, C3 are updated to data C1 ＇, C2 ＇, pre-operation data A1 ＇, the B2 ＇ of updating maintenance will have been completed in task data relation table, pre-operation subordinate data C1 ＇, C2 ＇ and condition data A2, A4, B1, B3 in task filing historical data base, and are usingd the index information of task identification T1 as this filing historical data as filing history data store.Like this, just can task historical data be carried out separated with overall data.When user need obtain sometime the task historical data of section, only need can obtain the complete task historical data relevant to task according to task identification, comprise pre-operation data, pre-operation subordinate data and condition data through updating maintenance.
Alternatively, in the embodiment of the present invention, after the historical data of extracting is edited, can set up respectively pre-operation data backup table, pre-operation subordinate data backup table and condition data backup sheet for completing editor's historical data;
Wherein, pre-operation data backup table is used for storing the pre-operation data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task;
Pre-operation subordinate data backup table is used for storing the pre-operation subordinate data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task;
Condition data backup sheet is used for storing the condition data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task.
Further, pre-operation data backup table, subordinate data backup table and condition data backup sheet are stored in task filing historical data base; What wherein, be provided with in described pre-operation data backup table, described subordinate data backup table and the described condition data backup sheet of same task sign pre-operation data, pre-operation subordinate data and the condition data of storage respectively is comprehensively the filing historical data corresponding with task identification.Like this, in the inquiry historical data relevant to task and when obtaining accurately complete data, the condition data that can fully understand the pre-operation data of the renewal in task historical data and not upgrade, and the pre-operation subordinate data that are associated with the data of upgrading, be convenient to after obtaining task historical data the comparative analysis with other task historical datas or current data.
In the embodiment of the present invention, for filing historical data, task identification is being set, and after storing in the task filing historical data base setting in advance, the method can further include:
The task the inquiry of historical data request that reception represents with task identification, and from task filing historical data base, filter out the filing historical data corresponding with task identification according to the task identification receiving.
In practical application, the different task of carrying out for different time sections, can adopt the said method pair data relevant to task to carry out updating maintenance, and forms and be the task historical data for the treatment of that the task identification of editor's task setting is corresponding.Like this, when receiving user's task historical data request, can first from task list, filter out the task identification corresponding with the request of task the inquiry of historical data and edit session section; Then, according to task identification, from task filing historical data base, filter out the filing historical data corresponding with task identification, comprise pre-operation data, pre-operation subordinate data and condition data, thereby obtain the real task historical data of the detailed complete corresponding with the request of task the inquiry of historical data.
Therefore, the historical data archiving method that the embodiment of the present invention provides, by by pre-stored overall data with treat that all historical datas that editor's task matches are disposed to this and treat editor's task, and to carrying out updating maintenance with this historical data for the treatment of that editor's task matches, form filing historical data, filing historical data is arranged to task identification, and file in historical data base to task as task history data store, like this, just realized the separated of overall data and task historical data.And in needs inquiries or obtain while meeting mission requirements the task historical data relevant to task in a certain historical time section, can pass through task identification, from task filing historical data base, directly filter out the task historical data corresponding with this task, and without the whole historical data base of access, access speed is fast.
Fig. 2 is embodiment of the present invention historical data archiving apparatus structure schematic diagram.As shown in Figure 2, this device comprises: task data administration module 21, filing data update module 22, task history data store module 23; Wherein,
Task data administration module 21, for from having comprised of gathering and store and the whole historical data base of task related data to be edited respectively, extracts and the historical data for the treatment of that editor's task matches;
In the embodiment of the present invention, the historical data matching with the current editor's for the treatment of task filtering out from whole historical data base, comprise pre-operation data, with pre-operation subordinate data, the condition data of pre-operation data correlation; Wherein,
Pre-operation data are the data that required by task current to be edited carries out updating maintenance operation;
Pre-operation subordinate data for and treat that editor's task is relevant, and data that change with the change of pre-operation data;
Condition data is for to treat that to current editor's task is relevant, but without the data of upgrading.
In the embodiment of the present invention, task data administration module 21 is further used for as treating that editor's task arranges task identification and task edit session section; The task data relation table that structure comprises task identification hurdle, pre-operation field, pre-operation subordinate field and condition data hurdle;
By for to treat that the task identification of editor's task setting writes the task identification hurdle in task data relation table, and according to treat editor's task, task identification and and treat the corresponding relation between historical data that editor's task matches, the historical data of described extraction is write to the corresponding hurdle in task data relation table.In the embodiment of the present invention, can build task list, and add task identification, initial time and the termination time corresponding with current task in the task list building, or initial time and termination time are added in task list in the mode of task edit session section.
In the embodiment of the present invention, the task list of structure comprises task identification hurdle, task edit session section hurdle, for storing the task identification corresponding with the every editor's for the treatment of task and task edit session section.Like this, by recording performed task, can be so that the task historical data relevant to the editor's task for the treatment of of carrying out inquired about and obtained to subsequent user by task identification or edit session section.
Filing data update module 22, for editing and form filing historical data to the historical data of being extracted by described task data administration module;
In the embodiment of the present invention, after in the historical data of extracting is added to task data relation table, can be in the edit session section of task to be edited, in task data relation table with for treating that the pre-operation data that the task identification of editor's task setting is corresponding carry out updating maintenance; Meanwhile, according to the change of pre-operation data, upgrade pre-operation subordinate data.Like this, in task data relation table, with the pre-operation data that complete updating maintenance, pre-operation subordinate data for treating that the task identification of editor's task setting is corresponding, and condition data forms filing historical data.
In practical application, when the data volume that needs updating maintenance to process is larger, during logical relation between deal with data, the regular hour will be expended, therefore in this task, in order to guarantee carrying out smoothly of host process, will open an asynchronous process and process this Data Update affairs; Data Update finish dealing with after by completion status of write-back so that notice host process data processing completes, and result is fed back in task data relation table; If occur extremely midway, abnormality of write-back, so that notice host process is carried out other relevant treatment.When this task needs data volume that updating maintenance processes hour, can adopt synchronous processor system, directly the synchronous result of upgrading in task data relationship table.
Task history data store module 23, is used to the filing historical data being formed by described filing data update module that task identification is set, and the filing history data store that is provided with task identification is filed in historical data base to setting in advance of task.
In the embodiment of the present invention, for completed the pre-operation data of updating maintenance, the pre-operation subordinate data of making corresponding renewal according to the change of pre-operation data in task data relation table, and the filing historical data that condition data forms arranges task identification, this task identification with for the current task identification for the treatment of that editor's task arranges is identical, and using the filing historical data that is provided with task identification as task history data store in the task filing historical data base setting in advance.
Alternatively, in the embodiment of the present invention, task history data store module 23 can also be set up respectively pre-operation data backup table, subordinate data backup table and condition data backup sheet for completing pre-operation data, pre-operation subordinate data and the condition data of updating maintenance, and pre-operation data backup table, subordinate data backup table and condition data data backup table are stored in task filing historical data base; What wherein, be provided with in described pre-operation data backup table, described subordinate data backup table and the described condition data backup sheet of same task sign pre-operation data, pre-operation subordinate data and the condition data of storage respectively is comprehensively the filing historical data corresponding with task identification.Like this, the condition data that can obtain the pre-operation data of the renewal in task historical data and not upgrade according to task identification, and the pre-operation subordinate data that are associated with the data of upgrading, be convenient to after obtaining task historical data the comparative analysis with other task historical datas or current data.
In practical application, the different task of carrying out for different time sections, can adopt the said apparatus pair data relevant to task to carry out updating maintenance, and the formation task historical data corresponding with the task identification of task.Like this, when receiving user's task historical data request, can from the task list building, filter out the task identification corresponding with the request of task historical data; According to task identification, from task filing historical data base, transfer the task historical data corresponding with task identification, comprise the data of storing separately in pre-operation data backup table, subordinate data backup table and condition data backup sheet, thereby obtain the real task historical data of the detailed complete corresponding with inquiry request.
Further, in the embodiment of the present invention, for filing historical data, task identification is being set, and after storing in the task filing historical data base setting in advance, this device can also comprise: request of data enquiry module, for receiving the task the inquiry of historical data request representing with task identification, and according to the task identification receiving from filter out the filing historical data corresponding with task identification in task history data store module 23 store tasks filing historical data bases.
Therefore, the historical data archiving device that the embodiment of the present invention provides, by task data administration module 21 by whole historical data with treat that all historical datas that editor's task matches are disposed to this and treat editor's task, and carry out updating maintenance formation filing historical data by 22 pairs of historical datas that match with this task of filing data update module, filing historical data is arranged to task identification, and as task history data store in task history data store module 23, like this, realized the separated of whole historical data and task historical data.When needs inquiries or obtain while meeting mission requirements the task historical data relevant to task in a certain historical time section, can pass through task identification, from task history data store module 23, directly filter out the task historical data corresponding with this task.
Obviously, those skilled in the art can carry out various changes and modification and not depart from the spirit and scope of the present invention the present invention.Like this, if of the present invention these are revised and within modification belongs to the scope of the claims in the present invention and equivalent technologies thereof, the present invention also comprises these changes and modification interior.
Claims (10)
1. a historical data archiving method, the method comprises:
From the whole historical data base of having comprised of gathering and store and each task related data, extract and the historical data for the treatment of that editor's task matches;
Filing historical data is edited and formed to the historical data of extracting;
For filing historical data arranges task identification, and the filing history data store that is provided with task identification is filed in historical data base to setting in advance of task.
2. method according to claim 1, wherein, the historical data of described extraction comprises: pre-operation data, with pre-operation subordinate data, the condition data of described pre-operation data correlation; Wherein,
Described pre-operation data are the data that required by task current to be edited carries out updating maintenance operation;
Described pre-operation subordinate data are for to treat that to current editor's task is relevant, and the data that change with the change of described pre-operation data;
Described condition data is for to treat that to current editor's task is relevant, but without the data of upgrading.
3. method according to claim 2, wherein, described extraction with treat historical data that editor's task matches before, simultaneously or afterwards, described method further comprises:
For treating that editor's task arranges task identification and task edit session section;
Structure comprise task identification hurdle, pre-operation field, with the pre-operation subordinate field of pre-operation data correlation and the task data relation table on condition data hurdle;
Before the described historical data to extraction is edited formation filing historical data, described method further comprises:
By described for to treat that the task identification of editor's task setting writes the task identification hurdle in task data relation table, and according to treat editor's task, task identification and and the corresponding relation matching between historical data of task to be edited, the historical data of described extraction is write to the corresponding hurdle in task data relation table.
4. method according to claim 3, wherein, describedly edits and forms filing historical data to the historical data of extracting, is specially,
In the edit session section of task to be edited, in task historical data table with for treating that the pre-operation data that the task identification of editor's task setting is corresponding carry out updating maintenance;
According to the change of pre-operation data, upgrade pre-operation subordinate data.
5. method according to claim 4, wherein, described filing historical data comprises: in task data relation table, completed the pre-operation data of updating maintenance, the pre-operation subordinate data of making corresponding renewal according to the change of pre-operation data, and condition data.
6. method according to claim 4, wherein, described filing historical data is edited and formed to the historical data of extracting after, the method comprises:
For the historical data of having edited is set up respectively pre-operation data backup table, pre-operation subordinate data backup table and condition data backup sheet; Wherein,
Described pre-operation data backup table is used for storing the pre-operation data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task;
Described pre-operation subordinate data backup table is used for storing the pre-operation subordinate data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task;
Described condition data backup sheet is used for storing the condition data of the historical data of having edited, and is provided with and the corresponding task identification of the current editor's for the treatment of task.
Further, described pre-operation data backup table, described subordinate data backup table and described condition data backup sheet are stored in the task filing historical data base setting in advance.
7. method according to claim 5, wherein, described, for filing historical data arranges task identification, and by after the filing history data store that is provided with task identification is in the task filing historical data base setting in advance, the method further comprises:
The task the inquiry of historical data request that reception represents with task identification, and from task filing historical data base, filter out the filing historical data corresponding with task identification according to the task identification receiving.
8. a historical data archiving device, is characterized in that, this device comprises: task data administration module, filing data update module, task history data store module; It is characterized in that,
Described task data administration module, for from having comprised of gathering and store and the whole historical data base of task related data to be edited respectively, extracts and the historical data for the treatment of that editor's task matches;
Described filing data update module, for editing and form filing historical data to the historical data of being extracted by described task data administration module;
Described task history data store module, is used to the filing historical data being formed by described filing data update module that task identification is set, and the filing history data store that is provided with task identification is filed in historical data base to setting in advance of task.
9. device according to claim 8, is characterized in that, the historical data of described extraction comprises: pre-operation data, with the pre-operation subordinate data of described pre-operation data correlation, and condition data; Wherein,
Described pre-operation data are the data that required by task current to be edited carries out updating maintenance operation;
Described pre-operation subordinate data are for to treat that to current editor's task is relevant, and the data that change with the change of described pre-operation data;
Described condition data is for to treat that to current editor's task is relevant, but without the data of upgrading.
10. device according to claim 9, is characterized in that, described task data administration module is further used for as treating that editor's task arranges task identification and task edit session section; The task data relation table that structure comprises task identification hurdle, pre-operation field, pre-operation subordinate field and condition data hurdle;
By for to treat that the task identification of editor's task setting writes the task identification hurdle in task data relation table, and according to treat editor's task, task identification and and treat the corresponding relation between historical data that editor's task matches, the historical data of described extraction is write to the corresponding hurdle in task data relation table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310471385.5A CN103514295B (en) | 2013-10-10 | 2013-10-10 | historical data archiving method and historical data archiving device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310471385.5A CN103514295B (en) | 2013-10-10 | 2013-10-10 | historical data archiving method and historical data archiving device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103514295A true CN103514295A (en) | 2014-01-15 |
| CN103514295B CN103514295B (en) | 2016-09-28 |
Family
ID=49897019
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310471385.5A Active CN103514295B (en) | 2013-10-10 | 2013-10-10 | historical data archiving method and historical data archiving device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103514295B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104052804A (en) * | 2014-06-09 | 2014-09-17 | 深圳先进技术研究院 | Method, device and cluster for sharing data streams between different task topologies |
| CN105243163A (en) * | 2015-11-05 | 2016-01-13 | 国家电网公司 | Archiving integration system and method of historical data |
| CN105279261A (en) * | 2015-10-23 | 2016-01-27 | 北京京东尚科信息技术有限公司 | Dynamic extensible database filing method and system |
| CN105653560A (en) * | 2014-11-28 | 2016-06-08 | 华为软件技术有限公司 | Method and device for data filing |
| CN106126526A (en) * | 2016-06-13 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of data managing method and device |
| CN107870981A (en) * | 2017-09-30 | 2018-04-03 | 平安科技（深圳）有限公司 | Electronic installation, the method and storage medium of tables of data filing processing |
| CN108446336A (en) * | 2018-02-27 | 2018-08-24 | 平安科技（深圳）有限公司 | Intelligent search method, device, equipment and the storage medium of organization names |
| CN108733671A (en) * | 2017-04-14 | 2018-11-02 | 北京京东尚科信息技术有限公司 | The method and apparatus of data history filing |
| CN109102228A (en) * | 2018-08-16 | 2018-12-28 | 郑州云海信息技术有限公司 | A kind of Freight Transport information management system based on cloud computing |
| CN109684270A (en) * | 2018-12-11 | 2019-04-26 | 泰康保险集团股份有限公司 | Database filing method, apparatus, system, equipment and readable storage medium storing program for executing |
| CN111679815A (en) * | 2020-06-04 | 2020-09-18 | 广州视源电子科技股份有限公司 | Asynchronous operation method and device, storage medium and related equipment |
| WO2021068612A1 (en) * | 2019-10-12 | 2021-04-15 | 苏宁云计算有限公司 | Method and device for archiving outdated data |
| CN116257488A (en) * | 2023-02-21 | 2023-06-13 | 深圳市勘察测绘院(集团)有限公司 | Geotechnical engineering investigation big data archiving method, device, electronic equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070112801A1 (en) * | 2005-11-14 | 2007-05-17 | Rockwell Automation Technologies, Inc. | Distributed historian architecture |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN101639839A (en) * | 2008-07-30 | 2010-02-03 | 中兴通讯股份有限公司 | Method for searching multi-archive file based on temporary table |
| CN103106247A (en) * | 2012-12-31 | 2013-05-15 | 普天新能源有限责任公司 | Data dump method and system |
-
2013
- 2013-10-10 CN CN201310471385.5A patent/CN103514295B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070112801A1 (en) * | 2005-11-14 | 2007-05-17 | Rockwell Automation Technologies, Inc. | Distributed historian architecture |
| CN101639839A (en) * | 2008-07-30 | 2010-02-03 | 中兴通讯股份有限公司 | Method for searching multi-archive file based on temporary table |
| CN101364897A (en) * | 2008-09-17 | 2009-02-11 | 中兴通讯股份有限公司 | System for historical data archiving and implementing method |
| CN103106247A (en) * | 2012-12-31 | 2013-05-15 | 普天新能源有限责任公司 | Data dump method and system |
Non-Patent Citations (1)
| Title |
|---|
| 张岩: "数据仓库历史数据归档与重构的策略研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》, 31 August 2005 (2005-08-31), pages 138 - 402 * |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104052804A (en) * | 2014-06-09 | 2014-09-17 | 深圳先进技术研究院 | Method, device and cluster for sharing data streams between different task topologies |
| CN105653560B (en) * | 2014-11-28 | 2019-05-14 | 华为软件技术有限公司 | Data archiving method and device |
| CN105653560A (en) * | 2014-11-28 | 2016-06-08 | 华为软件技术有限公司 | Method and device for data filing |
| CN105279261A (en) * | 2015-10-23 | 2016-01-27 | 北京京东尚科信息技术有限公司 | Dynamic extensible database filing method and system |
| CN105279261B (en) * | 2015-10-23 | 2019-07-02 | 北京京东尚科信息技术有限公司 | Dynamic scalable database filing method and system |
| CN105243163A (en) * | 2015-11-05 | 2016-01-13 | 国家电网公司 | Archiving integration system and method of historical data |
| CN106126526A (en) * | 2016-06-13 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of data managing method and device |
| CN108733671B (en) * | 2017-04-14 | 2020-11-03 | 北京京东尚科信息技术有限公司 | Method and device for archiving data history |
| CN108733671A (en) * | 2017-04-14 | 2018-11-02 | 北京京东尚科信息技术有限公司 | The method and apparatus of data history filing |
| CN107870981A (en) * | 2017-09-30 | 2018-04-03 | 平安科技（深圳）有限公司 | Electronic installation, the method and storage medium of tables of data filing processing |
| CN107870981B (en) * | 2017-09-30 | 2021-10-22 | 平安科技（深圳）有限公司 | Electronic device, data sheet filing method and storage medium |
| CN108446336A (en) * | 2018-02-27 | 2018-08-24 | 平安科技（深圳）有限公司 | Intelligent search method, device, equipment and the storage medium of organization names |
| CN109102228A (en) * | 2018-08-16 | 2018-12-28 | 郑州云海信息技术有限公司 | A kind of Freight Transport information management system based on cloud computing |
| CN109684270A (en) * | 2018-12-11 | 2019-04-26 | 泰康保险集团股份有限公司 | Database filing method, apparatus, system, equipment and readable storage medium storing program for executing |
| CN109684270B (en) * | 2018-12-11 | 2021-01-29 | 泰康保险集团股份有限公司 | Database archiving method, device, system, equipment and readable storage medium |
| WO2021068612A1 (en) * | 2019-10-12 | 2021-04-15 | 苏宁云计算有限公司 | Method and device for archiving outdated data |
| CN111679815A (en) * | 2020-06-04 | 2020-09-18 | 广州视源电子科技股份有限公司 | Asynchronous operation method and device, storage medium and related equipment |
| CN111679815B (en) * | 2020-06-04 | 2024-02-09 | 广州视源电子科技股份有限公司 | Asynchronous operation method and device, storage medium and related equipment |
| CN116257488A (en) * | 2023-02-21 | 2023-06-13 | 深圳市勘察测绘院(集团)有限公司 | Geotechnical engineering investigation big data archiving method, device, electronic equipment and medium |
| CN116257488B (en) * | 2023-02-21 | 2023-08-25 | 深圳市勘察测绘院(集团)有限公司 | Geotechnical engineering investigation big data archiving method, device, electronic equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103514295B (en) | 2016-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103514295A (en) | Method and device for archiving historical data | |
| CN104021145B (en) | The method and apparatus that a kind of mixed service concurrently accesses | |
| CN105243067B (en) | A kind of method and device for realizing real-time incremental synchrodata | |
| CN104298760B (en) | A kind of data processing method and data processing equipment applied to data warehouse | |
| CN107832406B (en) | Method, device, equipment and storage medium for removing duplicate entries of mass log data | |
| DE112012005037B4 (en) | Manage redundant immutable files using deduplications in storage clouds | |
| CN109508355A (en) | A kind of data pick-up method, system and terminal device | |
| CN106446019B (en) | A kind of software function treating method and apparatus | |
| CN107918621A (en) | Daily record data processing method, device and operation system | |
| CN105787058B (en) | A kind of user tag system and the data delivery system based on user tag system | |
| CN102693169A (en) | Method and device for recovering lessee data under multi-lessee environment, and database system | |
| CN101576890A (en) | Novel method and system for sorting fragment | |
| CN109739828B (en) | Data processing method and device and computer readable storage medium | |
| CN104657387A (en) | Data query method and device | |
| WO2014058711A1 (en) | Creation of inverted index system, and data processing method and apparatus | |
| CN101727473A (en) | Method and system for monitoring and tracking video on internet | |
| CN108572789A (en) | Disk storage method and apparatus, information push method and device and electronic equipment | |
| CN109299083A (en) | A kind of data governing system | |
| CN103049355A (en) | Method and equipment for database system recovery | |
| CN111914066A (en) | Multi-source database global search method and system | |
| CN105045817B (en) | SQL Server database evidence-taking and analysis system and method based on transaction journal | |
| CN106155838A (en) | A kind of database back-up data restoration methods and device | |
| CN103942554A (en) | Image identifying method and device | |
| CN110209680A (en) | Data-updating method, device and electronic device based on Hive external table | |
| CN109408601B (en) | Data model conversion method based on graph data and graph data structure converter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |