CN103106247A - Data dump method and system - Google Patents
Data dump method and system Download PDFInfo
- Publication number
- CN103106247A CN103106247A CN2012105934210A CN201210593421A CN103106247A CN 103106247 A CN103106247 A CN 103106247A CN 2012105934210 A CN2012105934210 A CN 2012105934210A CN 201210593421 A CN201210593421 A CN 201210593421A CN 103106247 A CN103106247 A CN 103106247A
- Authority
- CN
- China
- Prior art keywords
- data
- filing
- image data
- dump
- dumped
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a data dump method and a system. The data dump method comprises the fowling steps: detecting the data size of the collected data on a collection device; ascertaining whether the data size meets a dump condition or not; and when the dump condition is met, generating a filing index table corresponding to the collected data and dumping the collected data to a filing data sheet in a background system. According to the technical scheme of the data dump method and the system, automatic filing of historical data can be achieved, the problem that system performance is reduced due to the constant increase of the data size of a collection system is effectively resolved and cost is saved.
Description
Technical field
The present invention relates to a kind of data storage technology, relate in particular to a kind of method of data transfer and system.
Background technology
In modern production, life process, need to carry out Real-Time Monitoring to a large amount of procedure parameters, this just requires related data is gathered, records and analyzes.
For instance, in order to analyze the quality of river water in a certain waters, the data messages such as pH value, nitrogen ammonia, phosphorus, mercury, petroleum-type that needs this river of monitoring, by the mass data that gathers in a period of time is analyzed, can understand this section in the period, the pollution condition of river and judgement primary pollution source.
Along with the variation of collection source and business, the data class of the required collection of various collecting devices and data volume all increase thereupon.A large amount of data are stored on collecting device, will inevitably affect the serviceability of this collecting device to its maintenance and storage.Prior art only has by the size of the storer on continuous increase collecting device and the ability of processor, could satisfy this demand, but cost is excessive.
Summary of the invention
For the defective that exists in prior art, the invention provides a kind of method of data transfer and system, in order to realize the automatic archiving of historical data, the data volume that solves due to acquisition system constantly increases the system performance decline problem that causes.
First aspect of the present invention has been to provide a kind of method of data transfer, comprising:
The data volume of the image data on the monitoring collecting device;
Determine whether described data volume satisfies the dump condition;
If satisfy the dump condition, generate the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system.
Another aspect of the present invention has been to provide a kind of data dump system, comprising:
Monitoring modular is for the data volume of the image data on the monitoring collecting device;
Judge module is used for determining whether described data volume satisfies the dump condition;
The dump module satisfies the dump condition if be used for described data volume, generates the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system.
Method of data transfer of the present invention and system, whether the data volume of determining the image data on collecting device by judge module satisfies the dump condition, if described data volume satisfies the dump condition, dump module generates the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system, thereby realized the automatic archiving of historical data, the data volume that efficiently solves due to acquisition system constantly increases the system performance decline problem that causes, and has saved cost.
Description of drawings
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in embodiment or description of the Prior Art, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the process flow diagram of method of data transfer embodiment one of the present invention;
Fig. 2 is the process flow diagram of method of data transfer embodiment two of the present invention;
Fig. 3 is the process flow diagram of method of data transfer embodiment three of the present invention;
Fig. 4 is the structural representation of data dump system embodiment one of the present invention;
Fig. 5 is the structural representation of data dump system embodiment two of the present invention;
Fig. 6 is the structural representation of data dump system embodiment three of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
Fig. 1 is the process flow diagram of method of data transfer embodiment one of the present invention, and as shown in Figure 1, the method for the present embodiment can comprise:
The data volume of the image data on step 101, monitoring collecting device;
In the present embodiment, the data volume of the image data on data dump system monitoring collecting device, this image data can be both the different types of image data on a collecting device, can be also the multiple image data on different acquisition equipment.Correspondingly, the source of this image data of data dump system log (SYSLOG) sign is such as collecting device sign, image data sign etc.
Step 102, determine whether described data volume satisfies the dump condition;
In the present embodiment, the data dump system determines whether the data volume of image data satisfies the dump condition.Specifically, the data volume of this image data of data dump system monitoring when this data volume surpasses predetermined threshold value, determines that the data volume of this image data satisfies the dump condition.In actual applications, this predetermined threshold value is set according to the maximum amount of data of the acquisition strategies of collecting device and the image data that can store.
If step 103 satisfies the dump condition, generate the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system.
In the present embodiment, if the data volume of the definite image data of data dump system satisfies the dump condition, generate the filing concordance list corresponding with this image data, and this image data is dumped in the filing data table of background system.specifically, the data dump system can be with the one piece of data amount that deposits in the earliest in image data, it is historical data, be dumped in the filing data table of background system, such as, the predetermined threshold value of current image data is 200,000, when the data volume of image data surpasses this predetermined threshold value, can the runnability of collecting device be impacted, according to actual conditions, the data dump system is with the one piece of data amount that deposits in the earliest in this image data, it is for example 50,000, be dumped in the filing data table of background system, and record the identification information of this segment data amount in concordance list in filing.
Need to prove, those skilled in the art can as required, set up the size of historical data described in this step on their own.
In the present embodiment, the data volume of data dump system monitoring image data, if this data volume satisfies the dump condition, generate the filing concordance list corresponding with this image data, and this image data is dumped in the filing data table of background system, thereby realized the automatic archiving of historical data, the data volume that efficiently solves due to acquisition system constantly increases the system performance decline problem that causes, and has saved cost.
Fig. 2 is the process flow diagram of method of data transfer embodiment two of the present invention, and as shown in Figure 2, the method for the present embodiment can comprise:
Step 201: the data volume of at least two kinds of image data on the monitoring collecting device;
Step 202: determine whether described data volume satisfies the dump condition, if satisfy execution in step 203, otherwise execution in step 201;
In the present embodiment, the data volume of at least two kinds of image data on data dump system monitoring collecting device, it can be for example the data volume of monitoring A1, A2, three kinds of image data of A3, when the data volume of any image data surpasses the corresponding predetermined threshold value of this arbitrary image data, determine that the data volume of this arbitrary image data satisfies the dump condition.In the present embodiment, suppose that the data volume of A1, A2, three kinds of image data of A3 all satisfies the dump condition.
Step 203: generate the dump task queue corresponding with various image data;
Specifically, the data dump system carries out the mission bit stream configuration to the historical data of the image data that satisfies the dump condition, forms the dump task queue.The mission bit stream of configuration can comprise: maximum dump amount, preset data amount, filing sign, running status sign, archive information etc.Wherein, maximum dump amount is can the walk abreast maximum amount of data of dump of data dump system; The preset data amount is when dump is carried out in any dump task queue, the data volume of each dump, and different dump task queues can have different preset data amounts; Whether the current dump task queue of filing sign expression starts dump operation, if filing is designated is, represents that current dump task queue starts dump operation, otherwise, do not start dump operation; Whether the current image data of running status sign expression is in running status, if current image data is in running status, does not carry out dump operation, if current image data is in idle condition, can carry out dump operation; Archive information can be the title of filing data table, and the title of this filing data table includes the image data identification information.
Need to prove, those skilled in the art can set up the value of maximum dump amount and the value of preset data amount on their own as required, as long as guarantee that the value of preset data amount is less than the value of maximum dump amount.
In the present embodiment, if A1, A2, three kinds of historical datas corresponding to image data of A3 are respectively A10, A20, A30, respectively these three kinds of historical datas are carried out the mission bit stream configuration, the filing sign of establishing A10, A20 is and is, the running status sign is the free time, and the preset data amount is respectively a, b; The filing of A30 is designated no, thereby has formed respectively and image data A1, A2, dump task queue A11, A21, A31 that A3 is corresponding.
Step 204: adopt the mode of task scheduling, dispatch respectively each dump task queue;
This adopts the mode of task scheduling, dispatches respectively each dump task queue, comprising:
According to maximum dump amount, but the quantity of the dump task queue of definite parallel processing;
Dump task queue to definite quantity is dispatched.
Specifically, at first the data dump system judges the filing sign of each dump task in the dump task queue and the condition whether the running status sign satisfies the executive dumping operation.Only have filing when the dump task queue to be designated to be and running status when being designated the free time, the condition of executive dumping operation is just satisfied in this dump task queue.And then the data dump system is according to the restriction relation between the preset data amount of maximum dump amount and each dump task queue, but determines the quantity of the dump task queue of parallel processing.Particularly, if the preset data amount sum of each dump task queue less than maximum dump amount, this each dump task queue can walk abreast and carry out dump operation; If the preset data amount sum of each dump task queue is greater than maximum dump amount, but arrives the clock order of data dump system or determine successively the quantity of the dump task queue of parallel processing according to the predefined priority orders of each dump task queue according to each dump task queue.
In the present embodiment, according to filing sign and running status sign, dump task queue A11, A21 satisfy the condition of executive dumping operation, and then according to preset data amount a, the b of this dump task queue A11, A21 and the restriction relation of maximum dump amount m, this dump task queue A11, A21 are dispatched, be specially: if a+b＜m, this dump task queue A11, A21 can walk abreast simultaneously and carry out dump.If a+b〉m, if arrive data dump system, the dump of preferential executive dumping task queue A11, otherwise the dump of preferential executive dumping task queue A21 prior to dump task queue A21 on dump task queue A11 sequential; Perhaps, if the priority of dump task queue A11 higher than the priority of dump task queue A21, the dump of preferential executive dumping task queue A11, otherwise the dump of preferential executive dumping task queue A21.
Step 205: according to described task scheduling, generate respectively the filing concordance list corresponding with various image data, and various image data correspondences are dumped in filing data table corresponding with various image data in background system.
Specifically, task scheduling according to step 204, generate respectively the filing concordance list of the archive information that comprise this various image data, zero-time and the concluding time corresponding with various image data, and various image data correspondences are dumped in filing data table corresponding with various image data in background system.This dump procedure comprises:
Take the preset data amount as the unit, successively various image data are dumped in the current filing data table corresponding with various image data;
If current filing data table capacity is full, auto chain is passed and is delivered a child into next filing data table.
In the present embodiment, suppose that filing data table corresponding to image data A1, A2 is respectively A1_B0001, A2_B0001.During take a+b＜m as example, dump task queue this moment A11, A21 can walk abreast simultaneously and carry out dump, the data dump system is respectively take preset data amount a, b as the unit, dump task queue A11, A21 are dumped to respectively in filing data Table A 1_B0001, A2_B0001, and with zero-time, the concluding time of the data volume of each dump and comprise the archive information that the filing data table name claims and be recorded in the filing concordance list.If current filing data table capacity is full, auto chain is passed and is delivered a child into next filing data table, if for example filing data Table A 1_B0001 is full, auto chain is passed and delivered a child into next filing data table, can be for example A1_B0002, the like, when practical application, can limit as required the length that the filing data watch chain connects, if such as reaching A1_B9999, no longer carry out dump, can regenerate the dump task queue, carry out new dump operation.
Further, the present embodiment can also comprise the authenticating user identification process, can also comprise before step 201:
Step 206: according to user ID and authentication sign judgement user's legitimacy.
User ID can specifically refer to user name, and the authentication sign can be encrypted message.Judge that according to user ID and authentication sign a kind of implementation of user's legitimacy is: check by the user profile of storing in the personal information database in username and password information and system, if the user profile in system is identical with this username and password information, illustrate that this user is legal, execution in step 201 ~ 205, otherwise finish.
Further, the present embodiment in completing image data and be dumped to the filing data table of background system after, can also comprise the data query process, can also comprise after step 205:
Step 207: the receive data query requests, carry out the filing data inquiry.
Particularly, if the user need to inquire about filed data, can send the data query request to the data dump system, comprise zero-time and the concluding time of required data query in this data query request.The data dump system receives this data query request, and inquiry filing concordance list is determined the archive information corresponding with this zero-time and concluding time, and according to this archive information, filing data is obtained in inquiry from the filing data table.
In the present embodiment, by at least two kinds of image data on collecting device are carried out data dump, the data volume that efficiently solves due to acquisition system constantly increases the system performance decline problem that causes, and has saved cost; By task scheduling is carried out in each dump task queue, make each dump task queue to walk abreast and carry out data dump, improved the work efficiency of data dump system; In the process of data dump, file concordance list by production, be convenient to the user to the inquiry of filing data.
Fig. 3 is the process flow diagram of method of data transfer embodiment three of the present invention, and as shown in Figure 3, the method for the present embodiment can comprise:
Step 301: the data volume of monitoring the image data at least two collecting devices;
Step 302: determine whether described data volume satisfies the dump condition, if satisfy execution in step 303, otherwise execution in step 301;
In the present embodiment, the data volume of the image data at least two collecting devices of data dump system monitoring, when the data volume of the image data on arbitrary collecting device surpasses predetermined threshold value corresponding to this image data, determine that the data volume of this image data satisfies the dump condition.
Step 303: generate the dump task queue corresponding with each collecting device;
Specifically, the data dump system carries out the mission bit stream configuration to the historical data of the image data on each collecting device that satisfies the dump condition, forms the dump task queue.The mission bit stream of configuration can also comprise on basis embodiment illustrated in fig. 2: device identification is used for each collecting device of sign.
Further, can have a kind of image data at least on each collecting device, the generation method of the dump task queue of the various image data on each collecting device is similar to step 203 embodiment illustrated in fig. 2, repeats no more.
Step 304: adopt the mode of task scheduling, dispatch respectively each dump task queue;
Specifically, this adopts the mode of task scheduling, dispatches respectively each dump task queue, comprising:
According to maximum dump amount, but the quantity of the dump task queue of definite parallel processing;
Dump task queue to definite quantity is dispatched.
In the present embodiment, this task scheduling mode both can be respectively for each collecting device, each dump task to its correspondence is dispatched, all dump tasks that also can each collecting device is corresponding are looked as a whole, dispatch, concrete scheduling process is similar to step 204 embodiment illustrated in fig. 2, repeats no more.
Step 305: according to described task scheduling, generate respectively the filing concordance list corresponding with each collecting device, and the image data correspondence of each collecting device is dumped in filing data table corresponding with each collecting device in background system.
Specifically, the data dump system is according to the task scheduling of step 304, generate respectively the filing concordance list of the archive information, zero-time and the concluding time that comprise image data this collecting device sign, this collecting device on corresponding with each collecting device, and the image data correspondence of each collecting device is dumped in filing data table corresponding with each collecting device in background system.The data dump system can divide different storage areas in Installed System Memory for each collecting device, be convenient to data management and inquiry.
Step 306: the receive data query requests, carry out the filing data inquiry.
Particularly, if the user need to inquire about filed data, can send the data query request to the data dump system, comprise zero-time and the concluding time of required data query in this data query request.The data dump system receives this data query request, and inquiry filing concordance list is determined the archive information corresponding with this zero-time and concluding time, and according to this archive information, filing data is obtained in inquiry from the filing data table.
In the present embodiment, the data dump system can carry out data dump to the image data at least two collecting devices, by task scheduling is carried out in each dump task queue, make each dump task queue to walk abreast and carry out data dump, improved the work efficiency of data dump system; In the process of data dump, file concordance list by production, be convenient to the user to the inquiry of filing data.
Fig. 4 is the structural representation of data dump system embodiment one of the present invention, and as shown in Figure 4, data dump provided by the invention system can comprise:
Monitoring modular 11 is for the data volume of the image data on the monitoring collecting device;
Judge module 12 is used for determining whether described data volume satisfies the dump condition;
Dump module 13 satisfies the dump condition if be used for described data volume, generates the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system.
The system of the present embodiment can be used for carrying out the technical scheme of embodiment of the method shown in Figure 1, its realize principle and technique effect similar, repeat no more herein.
Fig. 5 is the structural representation of data dump system embodiment two of the present invention, and as shown in Figure 5, on the basis of system shown in Figure 4, further, monitoring modular 11 comprises:
The first monitoring means 111 is for the data volume of monitoring at least two kinds of image data on described collecting device.
Described dump module 13 specifically is used for: according to described task scheduling, generate respectively the filing concordance list corresponding with various image data, and various image data correspondences are dumped in filing data table corresponding with various image data in background system.
Further, this dump module 13 comprises:
Processing unit 131 is used for take the preset data amount as the unit, described image data is dumped in current filing data table successively;
Comparing unit 132, if it is full to be used for current filing data table capacity, auto chain is passed and is delivered a child into next filing data table;
Generation unit 133 is used for the filing concordance list that generation comprises archive information, zero-time and the concluding time of described image data.
This system also comprises:
First task generation module 21 is used for the described generation filing concordance list corresponding with described image data, and before described image data being dumped in the filing data table of background system, generates the dump task queue corresponding with various image data.
Task scheduling modules 23 for the mode that adopts task scheduling, is dispatched respectively each dump task queue.
Further, this task scheduling modules 23 comprises:
Determining unit 231 is used for according to maximum dump amount, but determines the quantity of the dump task queue of parallel processing;
Performance element 232 is used for the dump task queue of definite quantity is dispatched.
Data query module 24, after being used for the described filing data table that described image data is dumped to background system, the receive data query requests comprises zero-time and the concluding time of required data query in described data query request;
According to described data query request, inquiry filing concordance list is determined the archive information corresponding with described zero-time and concluding time;
According to described archive information, filing data is obtained in inquiry from described filing data table.
Memory module 25 is arranged in Installed System Memory, is used for storing described filing data table.
The system of the present embodiment can be used for carrying out the technical scheme of embodiment of the method shown in Figure 2, its realize principle and technique effect similar, repeat no more herein.
Fig. 6 is the structural representation of data dump system embodiment three of the present invention, and as shown in Figure 6, on the basis of system shown in Figure 4, further, monitoring modular 11 comprises:
The second monitoring means 112 is for the data volume of the image data at least two collecting devices of monitoring.
Described dump module 13 specifically is used for: according to described task scheduling, generate respectively the filing concordance list corresponding with each collecting device, and the image data correspondence of each collecting device is dumped in filing data table corresponding with each collecting device in background system.
Further, this dump module 13 comprises:
Processing unit 131 is used for take the preset data amount as the unit, described image data is dumped in current filing data table successively;
Comparing unit 132, if it is full to be used for current filing data table capacity, auto chain is passed and is delivered a child into next filing data table;
Generation unit 133 is used for the filing concordance list that generation comprises archive information, zero-time and the concluding time of described image data.
This system also comprises:
The second task generation module 22 is used for the described generation filing concordance list corresponding with described image data, and before described image data being dumped in the filing data table of background system, generates the dump task queue corresponding with each collecting device.
Task scheduling modules 23 for the mode that adopts task scheduling, is dispatched respectively each dump task queue.
Further, this task scheduling modules 23 comprises:
Determining unit 231 is used for according to maximum dump amount, but determines the quantity of the dump task queue of parallel processing;
Performance element 232 is used for the dump task queue of definite quantity is dispatched.
Data query module 24, after being used for the described filing data table that described image data is dumped to background system, the receive data query requests comprises zero-time and the concluding time of required data query in described data query request;
According to described data query request, inquiry filing concordance list is determined the archive information corresponding with described zero-time and concluding time;
According to described archive information, filing data is obtained in inquiry from described filing data table.
Memory module 25 is arranged in Installed System Memory, is used for storing described filing data table.
The system of the present embodiment can be used for carrying out the technical scheme of embodiment of the method shown in Figure 3, its realize principle and technique effect similar, repeat no more herein.
It should be noted that at last: above each embodiment is not intended to limit only in order to technical scheme of the present invention to be described; Although with reference to aforementioned each embodiment, the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme that aforementioned each embodiment puts down in writing, and perhaps some or all of technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the scope of various embodiments of the present invention technical scheme.
Claims (15)
1. a method of data transfer, is characterized in that, comprising:
The data volume of the image data on the monitoring collecting device;
Determine whether described data volume satisfies the dump condition;
If satisfy the dump condition, generate the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system.
2. method according to claim 1, is characterized in that, whether the data volume of described definite described image data satisfies the dump condition, comprising:
If described data volume surpasses predetermined threshold value, determine to satisfy the dump condition.
3. method according to claim 1, is characterized in that, the data volume of the image data on described monitoring collecting device comprises:
Monitor the data volume of at least two kinds of image data on described collecting device;
The filing concordance list that described generation is corresponding with described image data, and before described image data being dumped in the filing data table of background system, also comprise:
Generate the dump task queue corresponding with various image data;
Adopt the mode of task scheduling, dispatch respectively each dump task queue;
The filing concordance list that described generation is corresponding with described image data, and described image data is dumped in the filing data table of background system, comprising:
According to described task scheduling, generate respectively the filing concordance list corresponding with various image data, and various image data correspondences are dumped in filing data table corresponding with various image data in background system.
4. method according to claim 1, is characterized in that, the data volume of the image data on described monitoring collecting device comprises:
Monitor the data volume of the image data at least two collecting devices;
The filing concordance list that described generation is corresponding with described image data, and before described image data being dumped in the filing data table of background system, also comprise:
Generate the dump task queue corresponding with each collecting device;
Adopt the mode of task scheduling, dispatch respectively each dump task queue;
The filing concordance list that described generation is corresponding with described image data, and described image data is dumped in the filing data table of background system, comprising:
According to described task scheduling, generate respectively the filing concordance list corresponding with each collecting device, and the image data correspondence of each collecting device is dumped in filing data table corresponding with each collecting device in background system.
5. according to claim 3 or 4 described methods, is characterized in that, image data is dumped to process in the filing data table, comprising:
Take the preset data amount as the unit, described image data is dumped in current filing data table successively;
If current filing data table capacity is full, auto chain is passed and is delivered a child into next filing data table.
6. according to claim 3 or 4 described methods, is characterized in that, the mode of described employing task scheduling is dispatched respectively each dump task queue, comprising:
According to maximum dump amount, but the quantity of the dump task queue of definite parallel processing;
Dump task queue to definite quantity is dispatched.
7. the described method of any one according to claim 1 ~ 4, is characterized in that, the filing concordance list that described generation is corresponding with described image data comprises:
Generation comprises the filing concordance list of archive information, zero-time and the concluding time of described image data;
After in the described filing data table that described image data is dumped to background system, also comprise:
The receive data query requests comprises zero-time and the concluding time of required data query in described data query request;
According to described data query request, inquiry filing concordance list is determined the archive information corresponding with described zero-time and concluding time;
According to described archive information, filing data is obtained in inquiry from described filing data table.
8. method according to claim 7, is characterized in that, described filing data table is stored in Installed System Memory.
9. a data dump system, is characterized in that, comprising:
Monitoring modular is for the data volume of the image data on the monitoring collecting device;
Judge module is used for determining whether described data volume satisfies the dump condition;
The dump module satisfies the dump condition if be used for described data volume, generates the filing concordance list corresponding with described image data, and described image data is dumped in the filing data table of background system.
10. system according to claim 9, is characterized in that, described monitoring modular comprises: the first monitoring means, for the data volume of monitoring at least two kinds of image data on described collecting device;
Described system also comprises:
The first task generation module is used for the described generation filing concordance list corresponding with described image data, and before described image data being dumped in the filing data table of background system, generates the dump task queue corresponding with various image data;
Task scheduling modules for the mode that adopts task scheduling, is dispatched respectively each dump task queue;
Described dump module specifically is used for: according to described task scheduling, generate respectively the filing concordance list corresponding with various image data, and various image data correspondences are dumped in filing data table corresponding with various image data in background system.
11. system according to claim 9 is characterized in that, described monitoring modular comprises: the second monitoring means, for the data volume of the image data at least two collecting devices of monitoring;
Described system also comprises:
The second task generation module is used for the described generation filing concordance list corresponding with described image data, and before described image data being dumped in the filing data table of background system, generates the dump task queue corresponding with each collecting device;
Task scheduling modules for the mode that adopts task scheduling, is dispatched respectively each dump task queue;
Described dump module specifically is used for: according to described task scheduling, generate respectively the filing concordance list corresponding with each collecting device, and the image data correspondence of each collecting device is dumped in filing data table corresponding with each collecting device in background system.
12. according to claim 10 or 11 described systems is characterized in that, described dump module comprises:
Processing unit is used for take the preset data amount as the unit, described image data is dumped in current filing data table successively;
Comparing unit, if it is full to be used for current filing data table capacity, auto chain is passed and is delivered a child into next filing data table.
13. according to claim 10 or 11 described systems is characterized in that, described task scheduling modules comprises:
Determining unit is used for according to maximum dump amount, but determines the quantity of the dump task queue of parallel processing;
Performance element is used for the dump task queue of definite quantity is dispatched.
14. any one described system according to claim 9 ~ 11 is characterized in that, described dump module comprises:
Generation unit is used for the filing concordance list that generation comprises archive information, zero-time and the concluding time of described image data;
Described system also comprises:
The data query module, after being used for the described filing data table that described image data is dumped to background system, the receive data query requests comprises zero-time and the concluding time of required data query in described data query request;
According to described data query request, inquiry filing concordance list is determined the archive information corresponding with described zero-time and concluding time;
According to described archive information, filing data is obtained in inquiry from described filing data table.
15. system according to claim 14 is characterized in that, also comprises:
Memory module is arranged in Installed System Memory, is used for storing described filing data table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012105934210A CN103106247A (en) | 2012-12-31 | 2012-12-31 | Data dump method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012105934210A CN103106247A (en) | 2012-12-31 | 2012-12-31 | Data dump method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103106247A true CN103106247A (en) | 2013-05-15 |
Family
ID=48314102
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012105934210A Pending CN103106247A (en) | 2012-12-31 | 2012-12-31 | Data dump method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103106247A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103514295A (en) * | 2013-10-10 | 2014-01-15 | 中国电子科技集团公司第十五研究所 | Method and device for archiving historical data |
| CN105302896A (en) * | 2015-10-22 | 2016-02-03 | 江苏国泰新点软件有限公司 | Method and apparatus for storing data in electronic bid evaluation system |
| CN106446172A (en) * | 2016-09-27 | 2017-02-22 | 浪潮软件集团有限公司 | Data dump method for big data comparison |
| CN107870981A (en) * | 2017-09-30 | 2018-04-03 | 平安科技（深圳）有限公司 | Electronic installation, the method and storage medium of tables of data filing processing |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1811489A (en) * | 2006-02-21 | 2006-08-02 | 中国科学院测量与地球物理研究所 | Portable gravity and environment parameter graphic display instrument |
| CN102073712A (en) * | 2010-12-31 | 2011-05-25 | 北京四方继保自动化股份有限公司 | Holographic process data archiving and inverting method based on dynamic change frame |
| CN102325156A (en) * | 2011-07-14 | 2012-01-18 | 北京联合大学 | Communication system for transmitting simulation data |
-
2012
- 2012-12-31 CN CN2012105934210A patent/CN103106247A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1811489A (en) * | 2006-02-21 | 2006-08-02 | 中国科学院测量与地球物理研究所 | Portable gravity and environment parameter graphic display instrument |
| CN102073712A (en) * | 2010-12-31 | 2011-05-25 | 北京四方继保自动化股份有限公司 | Holographic process data archiving and inverting method based on dynamic change frame |
| CN102325156A (en) * | 2011-07-14 | 2012-01-18 | 北京联合大学 | Communication system for transmitting simulation data |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103514295A (en) * | 2013-10-10 | 2014-01-15 | 中国电子科技集团公司第十五研究所 | Method and device for archiving historical data |
| CN103514295B (en) * | 2013-10-10 | 2016-09-28 | 中国电子科技集团公司第十五研究所 | historical data archiving method and historical data archiving device |
| CN105302896A (en) * | 2015-10-22 | 2016-02-03 | 江苏国泰新点软件有限公司 | Method and apparatus for storing data in electronic bid evaluation system |
| CN105302896B (en) * | 2015-10-22 | 2018-12-25 | 江苏国泰新点软件有限公司 | Date storage method and device in a kind of electronics bid evaluation system |
| CN106446172A (en) * | 2016-09-27 | 2017-02-22 | 浪潮软件集团有限公司 | Data dump method for big data comparison |
| CN107870981A (en) * | 2017-09-30 | 2018-04-03 | 平安科技（深圳）有限公司 | Electronic installation, the method and storage medium of tables of data filing processing |
| CN107870981B (en) * | 2017-09-30 | 2021-10-22 | 平安科技（深圳）有限公司 | Electronic device, data sheet filing method and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2741088C (en) | Methods of achieving cognizant power management | |
| CN103067297B (en) | A kind of dynamic load balancing method based on resource consumption prediction and device | |
| EP1918820A3 (en) | Method and apparatus for monitoring grid-based computing resources | |
| CN103164279A (en) | Method and system for distributing cloud computing resources | |
| CN103106247A (en) | Data dump method and system | |
| CN102821164A (en) | Efficient parallel-distribution type data processing system | |
| CN108804039A (en) | Adaptive data restore flow control method, device, electronic equipment and storage medium | |
| CN109241414A (en) | System message method for pushing and terminal device based on message template | |
| WO2019196427A1 (en) | Method and device for optimizing backup on the basis of supporting fault event constrained unit commitment | |
| CN112730938A (en) | Electricity stealing user judgment method based on electricity utilization collection big data | |
| CN108334556A (en) | A kind of method and system of analysis internet finance massive logs | |
| CN102693460A (en) | Tester management system and method thereof | |
| CN107357804A (en) | The analysis system and method for internet finance massive logs | |
| CN104820663A (en) | Method and device for discovering low performance structural query language (SQL) statements, and method and device for forecasting SQL statement performance | |
| CN104699529A (en) | Information acquisition method and device | |
| CN109376137B (en) | File processing method and device | |
| CN111585798A (en) | Network resource parameter configuration method, device and computer readable storage medium | |
| CN104281932A (en) | Intelligent shift acquisition device and method | |
| CN105242955A (en) | Virtual machine disk input and output scheduling method and system | |
| CN101387977B (en) | Server software regeneration method for maximizing task throughput | |
| CN102546235A (en) | Performance diagnosis method and system of web-oriented application under cloud computing environment | |
| CN108664322A (en) | Data processing method and system | |
| CN104735063A (en) | Security evaluating and detecting method used for cloud infrastructure | |
| CN111191296A (en) | Working ticket data processing method based on block chain | |
| CN106997310A (en) | The apparatus and method of load balancing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130515 |