CN104424182A - Workload emulation performance test method and workload emulation performance test device in data warehouse platform - Google Patents
Workload emulation performance test method and workload emulation performance test device in data warehouse platform Download PDFInfo
- Publication number
- CN104424182A CN104424182A CN201310360342.XA CN201310360342A CN104424182A CN 104424182 A CN104424182 A CN 104424182A CN 201310360342 A CN201310360342 A CN 201310360342A CN 104424182 A CN104424182 A CN 104424182A
- Authority
- CN
- China
- Prior art keywords
- operating load
- execution
- workload
- data warehouse
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3604—Software analysis for verifying properties of programs
- G06F11/3612—Software analysis for verifying properties of programs by runtime analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Abstract
The invention relates to a workload emulation performance test method and a workload emulation performance test device in a data warehouse platform. The method comprises the following steps that: simulated workload information generated by a user is received; a workload task executing queue is generated according to the received simulated workload information; executed confirmation information is sent after the workload task execution completion; and the execution result and the execution time of workload tasks are recorded. In some embodiments disclosed by the invention, the simulated workload information includes the load type, the execution sequence, the time span and the concurrent number. The method and the device can be used for simulating and comparing the executing conditions of the workload in real environment.
Description
Technical field
The disclosure relates to data warehouse field, especially, relates to operating load simulation performance method of testing and device in a kind of Data Warehouse Platform.
Background technology
The benchmark test index mainly TPC-H(TransactionProcessing Performance Council of current industry Data Warehouse Platform, Transaction Processing Performance Council), the performance being equipment in business intelligence calculates of its reflection is different from China Telecom typical data Stores Stressed Platform load module.
Although existing TPC-H benchmark test index has certain reference value, the product of existing manufacturer does not participate in the benchmark test of TPC substantially, to lectotype selection with reference to causing very large difficulty.The database software that the product of different vendor has larger difference on physical equipment framework, database software framework simultaneously, each manufacturer adopts is different, even if operate on identical physical equipment framework, the software performance difference due to each producer also can cause processing power there are differences; Moreover the server of physical structure Shang Ge producer, switch, clustering methods are also not necessarily identical, therefore, can not simply according to CPU, IO(Input Output of physical equipment, input and output) etc. carry out the overall performance of estimated data's Stores Stressed Platform.
The independent test of the current Data Warehouse Platform performance estimating method processing procedure of the operation such as data loading, calculating, inquiry, derivation often, indices is also all to be separated and isolated.And the operating load of Data Warehouse Platform is a mixing of various data processing in true environment, in real production environment, data handling procedure comprises: data loading, calculating, data query, derivation, they are that one or more data processing is carried out simultaneously, therefore, the work load model of existing appraisal procedure and true environment is not inconsistent.
Summary of the invention
The disclosure proposes new technical scheme in view of at least one in above problem.
The disclosure provides operating load simulation performance method of testing in a kind of Data Warehouse Platform in one, and it can simulate the implementation status of the operating load compared under true environment.
The disclosure on the other hand provides operating load simulation performance proving installation in a kind of Data Warehouse Platform at it, and it can simulate the implementation status of the operating load compared under true environment.
According to the disclosure, operating load simulation performance method of testing in a kind of Data Warehouse Platform is provided, comprises:
Receive the analog operation load information that user generates;
The queue of operating load tasks carrying is generated according to the analog operation load information received;
Executed confirmation is sent after operating load tasks carrying;
The execution result of writing task loading commissions and execution time.
In embodiments more of the present disclosure, analog operation load information comprises loadtype, execution sequence, time span and concurrent number.
In embodiments more of the present disclosure, loadtype comprises loading to data, calculating, inquiry and derivation.
In embodiments more of the present disclosure, perform execution sequence and execution priority that queue embodies operating load task.
According to the disclosure, additionally provide operating load simulation performance proving installation in a kind of Data Warehouse Platform, comprising:
User profile receiving element, for receiving the analog operation load information that user generates;
Perform queue generation unit, for generating the queue of operating load tasks carrying according to the analog operation load information received;
Be finished feedback unit, for sending executed confirmation after operating load tasks carrying;
Execution result record cell, for execution result and the execution time of writing task loading commissions.
In embodiments more of the present disclosure, analog operation load information comprises loadtype, execution sequence, time span and concurrent number.
In embodiments more of the present disclosure, loadtype comprises loading to data, calculating, inquiry and derivation.
In embodiments more of the present disclosure, perform execution sequence and execution priority that queue embodies operating load task.
In technical scheme of the present disclosure, the state of task when actual motion has been taken into full account in analog operation load information due to user's submission, the workload information provided based on user generates the tasks carrying queue substantially identical with actual task operation order, make the operation result of the result after test execution and authentic task closely, therefore, the test result of disclosure embodiment, compared with existing method of testing, has higher reliability and reference value.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide further understanding of the disclosure, forms a application's part.In the accompanying drawings:
Fig. 1 is the schematic flow sheet of operating load simulation performance method of testing in the Data Warehouse Platform of a disclosure embodiment.
Fig. 2 is the structural representation of operating load simulation performance proving installation in the Data Warehouse Platform of a disclosure embodiment.
Embodiment
Below with reference to accompanying drawings the disclosure is described.It should be noted that following being described in is only explanatory and exemplary in essence, never as any restriction to the disclosure and application or use.Unless stated otherwise, otherwise positioned opposite and numerical expression and the numerical value of the parts of setting forth in an embodiment and step do not limit the scope of the present disclosure.In addition, technology well known by persons skilled in the art, method and apparatus may not be discussed in detail, but are intended to the part becoming instructions in appropriate circumstances.
Can not according to the processing procedure of the operating load simulated data Stores Stressed Platform product of true environment in order to solve method of testing of the prior art, present disclose provides operating load simulation performance method of testing and device in a kind of Data Warehouse Platform, in the method: (1) user generates the analog operation load information needing test, and is sent to dispatching terminal; (2) dispatching terminal receives the information of input, generates the queue of operating load tasks carrying; (3), after each operating load is executed the task, confirmation is sent to dispatching terminal; (4) system log (SYSLOG) operating load execution result and the execution time, corresponding daily record can also be generated.The disclosure can realize the performance test of different pieces of information Stores Stressed Platform and total evaluation, scientifically can reflect the performance difference of different product.
Fig. 1 is the schematic flow sheet of operating load simulation performance method of testing in the Data Warehouse Platform of a disclosure embodiment.
As shown in Figure 1, this embodiment can comprise the following steps:
S102, receives the analog operation load information that user generates;
In order to running environment that is virtually reality like reality of trying one's best, the various information relevant to running environment are informed dispatching terminal by user as far as possible, also, and proving installation.
Wherein, analog operation load information can include but not limited to loadtype, execution sequence, time span and concurrent number.
Loadtype can include but not limited to loading to data, calculating, inquiry and derivation.
S104, generates the queue of operating load tasks carrying according to the analog operation load information received;
Because the execution sequence of various load is different, time span may be also different, therefore, can for different loadtypes, based on various execution sequences, execution time span with can the number of concurrence performance come together to generate final operating load tasks carrying queue.
Wherein, this execution queue embodies execution sequence and the execution priority of operating load task.Concrete priority can be set by the user.
S106, sends executed confirmation after operating load tasks carrying, so that proving installation can know that whole test process terminates, can start statistical test result.
S108, the execution result of writing task loading commissions and execution time.
In this embodiment, the state of task when actual motion has been taken into full account in analog operation load information due to user's submission, the workload information provided based on user generates the tasks carrying queue substantially identical with actual task operation order, make the operation result of the result after test execution and authentic task closely, therefore, the test result of disclosure embodiment, compared with existing method of testing, has higher reliability and reference value.
In the Data Warehouse Platform of another embodiment of the disclosure operating load simulation performance method of testing flow process in, can comprise the following steps:
Step 1, according to platform loads demand, user generates the analog operation load information needing test, wherein,
Platform loads demand refers to the loading condition of built system expectation in future, such as, every day load, inquiry, derive data volume, according to loading demand generate workload information, this is the process of a data acquisition, comprises and gathers the data volume of existed system and the estimation to Future Data amount.
Workload information can comprise loadtype, execution sequence, time span, concurrent number etc., it is pointed out that operating load has certain execution sequence, and time span determines the data volume size of process, the decisive pressure that can test of concurrent number;
Loadtype can comprise the data handling procedures such as loading, calculating, inquiry, derivation again.
Step 2, is sent to dispatching terminal by the analog operation load information of generation.
Step 3, dispatching terminal receives the workload information of input, generates the queue of operating load tasks carrying;
Example is treated to: (1) is with text mode input service load information with the ticket of certain company; (2) dispatching terminal analysis, this information is processed; (3) generate and perform queue, such as, first start data loading, in storehouse data to a certain extent in can perform the order of the operations such as inquiry, execution data insertion, statistical conversion.
Step 4, after each operating load is executed the task, system log (SYSLOG) task action result, sends confirmation to dispatching terminal and arranges next test assignment, and this acknowledge message is the information confirming that each loading commissions (data handling procedure) has been finished.
Further, this embodiment can also comprise:
Step 5, system log (SYSLOG) operating load execution result and total execution time, and generate corresponding daily record, this daily record, for filing and the confirmation of statistical information, also can be used as test evidence.
Step 6, the test job loading commissions that dispatching terminal is submitted to according to user, administer and maintain the queue of operating load task scheduling, wherein, administer and maintain the queue of operating load task scheduling and comprise the reception of workload information, the analysis of workload information, the generation of operating load task scheduling queue, the generation of test log and maintenance etc.
Step 7, dispatching terminal has task, and when task does not complete, is duty; When traveling through task list, all tasks are all finished, and are done state.
Further, above-mentioned steps 1 can also comprise:
Step 1A, according to platform loads testing requirement, configuration effort load information, particularly, configuration effort load information refers to and inputs various data handling procedure and parameter according to demand, comprises data volume, time span and execution order etc.;
Wherein, workload information comprises loadtype, execution sequence, time span, concurrent number etc.; Loadtype comprises the data handling procedures such as loading, calculating, inquiry, derivation; Operating load has certain execution sequence, and time span determines the data volume size of process; The decisive pressure that can test of concurrent number.
For the process such as the bill of certain company of telecommunications province, business revenue money, note number and statistics:
Scene description: while data warehouse service data loading and the task of derivation, operation comprises: the mass data that the inquiry of simple queries, re-scheduling, complex query, complex query generate inserts the test assignment of empty table and increment list, and records deadline and the T.T. of each test.
Implementation procedure:
(1) after loading, simple queries, re-scheduling inquiry, complex query, complex query being generated big data quantity, the empty table of insertion and increment list, derivation treatment progress etc. add task processing queue.
(2) to execute the task queue
(2a) " loading " task of all data files of circular flow, a set of object table all separately built by all loadings, loaded this table of rear DROP and continued to load again, ensured that loading task is run, in an uninterrupted manner to test larger pressure.
(2b) circulation performs appointment " derivation " task.
(2c) after above-mentioned " loading " and " derivation " task run certain hour, " simple queries " is performed (such as with the order of specifying, 20 concurrent numbers), " re-scheduling inquiry " (such as, 20 concurrent numbers), " complex query ", " complex query generates after big data quantity and inserts empty table and increment list " operating load task, and record each the time completing loading commissions and process daily record.
(2d) T.T. is recorded.
Step 1B, preserves configuration information to file, and completes the input of test job load information.
Step 1C, carries out School Affairs inspection to the input information of user, particularly, checks the rationality of user configuration information according to the standard information configured in database.
Step 1D, if verification is passed through, is then sent to dispatching terminal.
Step 1E, if verification is not passed through, then refuses this user task application, provides the descriptor of failure.
Further, above-mentioned steps 2 also comprises Task-decomposing process:
Step 2A, after dispatching terminal reception task, check the loadtype that user submits to, wherein, loadtype can include but not limited to the data handling procedures such as loading, calculating, inquiry, derivation.
Step 2B, analyzes the loadtype submitted to, according to the type of tested task, arranges tasks carrying order and priority;
Particularly, the task type of often kind of test submission is different, such as, loading may be comprised and also may not comprise loading, generally, loading performs before being bound to be arranged in inquiry, but not necessarily to by the time load all complete after just perform query task, can according to inquiry real time span determine.Such as, the just data in inquiry January, just need not wait for that other data loading complete in month, this priority arranges by testing the test performance of root according to optimum, and other data handling procedure is also so similar.
Step 2C, starts and performs test assignment.
One of ordinary skill in the art will appreciate that, realize the whole of said method embodiment to have been come by the hardware that programmed instruction is relevant with part steps, aforesaid program can be stored in a computing equipment read/write memory medium, this program is when performing, perform and comprise the step of said method embodiment, and aforesaid storage medium can comprise ROM, RAM, magnetic disc and CD etc. various can be program code stored medium.
Fig. 2 is the structural representation of operating load simulation performance proving installation in the Data Warehouse Platform of a disclosure embodiment.
As shown in Figure 2, the device 20 in this embodiment can comprise user profile receiving element 202, execution queue generation unit 204, be finished feedback unit 206 and execution result record cell 208.Wherein,
User profile receiving element 202, for receiving the analog operation load information that user generates;
Perform queue generation unit 204, for generating the queue of operating load tasks carrying according to the analog operation load information received;
Be finished feedback unit 206, for sending executed confirmation after operating load tasks carrying;
Execution result record cell 208, for execution result and the execution time of writing task loading commissions.
In this embodiment, the state of task when actual motion has been taken into full account in analog operation load information due to user's submission, the workload information provided based on user generates the tasks carrying queue substantially identical with actual task operation order, make the operation result of the result after test execution and authentic task closely, therefore, the test result of disclosure embodiment, compared with existing method of testing, has higher reliability and reference value.
Wherein, analog operation load information can include but not limited to loadtype, execution sequence, time span and concurrent number.
Further, loadtype can include but not limited to loading to data, calculating, inquiry and derivation.
In addition, execution sequence and execution priority that queue embodies operating load task is performed.
In this instructions, each embodiment all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, and part identical with similar between each embodiment can cross-reference.For device embodiment, due to itself and embodiment of the method basic simlarity, so description is fairly simple, relevant part can see the explanation of embodiment of the method part.
Although describe the disclosure with reference to exemplary embodiment, should be understood that the disclosure is not limited to above-mentioned exemplary embodiment.It will be obvious to those skilled in the art that and can revise above-mentioned exemplary embodiment under the condition not deviating from the scope of the present disclosure and spirit.The scope of appended claim should be endowed the widest explanation, to comprise all such amendments and equivalent 26S Proteasome Structure and Function.
Claims (8)
1. an operating load simulation performance method of testing in Data Warehouse Platform, is characterized in that, comprising:
Receive the analog operation load information that user generates;
The queue of operating load tasks carrying is generated according to the analog operation load information received;
Executed confirmation is sent after operating load tasks carrying;
The execution result of writing task loading commissions and execution time.
2. operating load simulation performance method of testing in Data Warehouse Platform according to claim 1, is characterized in that, described analog operation load information comprises loadtype, execution sequence, time span and concurrent number.
3. operating load simulation performance method of testing in Data Warehouse Platform according to claim 2, is characterized in that, described loadtype comprises loading to data, calculating, inquiry and derivation.
4. operating load simulation performance method of testing in Data Warehouse Platform according to claim 1, is characterized in that, described execution queue embodies execution sequence and the execution priority of operating load task.
5. an operating load simulation performance proving installation in Data Warehouse Platform, is characterized in that, comprising:
User profile receiving element, for receiving the analog operation load information that user generates;
Perform queue generation unit, for generating the queue of operating load tasks carrying according to the analog operation load information received;
Be finished feedback unit, for sending executed confirmation after operating load tasks carrying;
Execution result record cell, for execution result and the execution time of writing task loading commissions.
6. operating load simulation performance proving installation in Data Warehouse Platform according to claim 5, is characterized in that, described analog operation load information comprises loadtype, execution sequence, time span and concurrent number.
7. operating load simulation performance proving installation in Data Warehouse Platform according to claim 6, is characterized in that, described loadtype comprises loading to data, calculating, inquiry and derivation.
8. operating load simulation performance proving installation in Data Warehouse Platform according to claim 5, is characterized in that, described execution queue embodies execution sequence and the execution priority of operating load task.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310360342.XA CN104424182A (en) | 2013-08-19 | 2013-08-19 | Workload emulation performance test method and workload emulation performance test device in data warehouse platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310360342.XA CN104424182A (en) | 2013-08-19 | 2013-08-19 | Workload emulation performance test method and workload emulation performance test device in data warehouse platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104424182A true CN104424182A (en) | 2015-03-18 |
Family
ID=52973186
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310360342.XA Pending CN104424182A (en) | 2013-08-19 | 2013-08-19 | Workload emulation performance test method and workload emulation performance test device in data warehouse platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104424182A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6725211B1 (en) * | 2000-09-28 | 2004-04-20 | International Business Machines Corporation | Work load assessment heuristic for optimal task parallelism determination |
| CN101887465A (en) * | 2010-07-30 | 2010-11-17 | 南开大学 | Method for evaluating pure XML engine of relational database system |
| CN102968374A (en) * | 2012-11-29 | 2013-03-13 | 中国移动（深圳）有限公司 | Data warehouse testing method |
| CN103002490A (en) * | 2011-09-08 | 2013-03-27 | 中国移动通信集团公司 | Service simulation testing system and realizing method thereof |
| CN103150238A (en) * | 2011-12-07 | 2013-06-12 | 阿里巴巴集团控股有限公司 | Service request processing method, simulation performance test method and simulation performance test device |
| CN103176973A (en) * | 2011-12-20 | 2013-06-26 | 国际商业机器公司 | System and method used for generating test working load of data base |
-
2013
- 2013-08-19 CN CN201310360342.XA patent/CN104424182A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6725211B1 (en) * | 2000-09-28 | 2004-04-20 | International Business Machines Corporation | Work load assessment heuristic for optimal task parallelism determination |
| CN101887465A (en) * | 2010-07-30 | 2010-11-17 | 南开大学 | Method for evaluating pure XML engine of relational database system |
| CN103002490A (en) * | 2011-09-08 | 2013-03-27 | 中国移动通信集团公司 | Service simulation testing system and realizing method thereof |
| CN103150238A (en) * | 2011-12-07 | 2013-06-12 | 阿里巴巴集团控股有限公司 | Service request processing method, simulation performance test method and simulation performance test device |
| CN103176973A (en) * | 2011-12-20 | 2013-06-26 | 国际商业机器公司 | System and method used for generating test working load of data base |
| CN102968374A (en) * | 2012-11-29 | 2013-03-13 | 中国移动（深圳）有限公司 | Data warehouse testing method |
Non-Patent Citations (1)
| Title |
|---|
| 宋钦宇: "数据仓库TCP-H测试系统的设计与分析", 《长春大学学报》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105302721B (en) | The system and method for lumped modelling server integration testing is realized in cloud computing platform | |
| CN106777101B (en) | Data processing engine | |
| Aranha et al. | An estimation model for test execution effort | |
| EP2572294B1 (en) | System and method for sql performance assurance services | |
| CN102279766B (en) | Method and system for concurrently simulating processors and scheduler | |
| CN110516325A (en) | A kind of CAE automation simulation analysis method and system | |
| CN103164328A (en) | Method and device and system for regression testing of service function | |
| EP1825427A2 (en) | Systems and methods for production planning analysis using discrete event simulation | |
| WO2007099058A2 (en) | Software testing automation framework | |
| CN112783793B (en) | Automatic interface test system and method | |
| CN102542116B (en) | Method and device of DFM (Design for Manufacturability) analysis automation | |
| CN112395177A (en) | Interactive processing method, device and equipment of service data and storage medium | |
| van Hee et al. | Yasper: a tool for workflow modeling and analysis | |
| CN109784686B (en) | Product full life cycle management system and method | |
| CN110162365A (en) | A kind of method and system being automatically brought into operation SAP business software | |
| CN110471857A (en) | The automatic test approach and device of artificial intelligence model performance capability | |
| Liu | Research of performance test technology for big data applications | |
| CN104866402A (en) | Server testing method and apparatus | |
| CN110689238B (en) | Method and system for realizing MMS (multimedia message service) information simulation and point-to-point of intelligent substation | |
| Oliveira et al. | Quantitative analysis of resource-constrained business processes | |
| CN102055780A (en) | System and method for testing disk array | |
| US11750471B2 (en) | Method and apparatus for determining resource configuration of cloud service system | |
| CN104504491A (en) | Meter reading control method and system | |
| CN110516277A (en) | Quickly modeling, emulation mode and system, computer equipment, storage equipment | |
| CN104281584A (en) | XML database performance testing system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150318 |