WO2006099473A2 - System and method for monitoring and measuring end-to-end performance using wireless devices - Google Patents

System and method for monitoring and measuring end-to-end performance using wireless devices Download PDF

Info

Publication number
WO2006099473A2
WO2006099473A2 PCT/US2006/009290 US2006009290W WO2006099473A2 WO 2006099473 A2 WO2006099473 A2 WO 2006099473A2 US 2006009290 W US2006009290 W US 2006009290W WO 2006099473 A2 WO2006099473 A2 WO 2006099473A2
Authority
WO
WIPO (PCT)
Prior art keywords
wireless device
test
performance test
state
network
Prior art date
Application number
PCT/US2006/009290
Other languages
French (fr)
Other versions
WO2006099473A3 (en
Inventor
Rakesh Kushwaha
Badri Nath
Original Assignee
Mformation Technologies Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mformation Technologies Inc. filed Critical Mformation Technologies Inc.
Priority to JP2008501995A priority Critical patent/JP2008537859A/en
Priority to EP06738362A priority patent/EP1859552A4/en
Publication of WO2006099473A2 publication Critical patent/WO2006099473A2/en
Publication of WO2006099473A3 publication Critical patent/WO2006099473A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/08Testing, supervising or monitoring using real traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/50Testing arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/06Testing, supervising or monitoring using simulated traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B17/00Monitoring; Testing
    • H04B17/20Monitoring; Testing of receivers
    • H04B17/21Monitoring; Testing of receivers for calibration; for correcting measurements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2207/00Type of exchange or network, i.e. telephonic medium, in which the telephonic communication takes place
    • H04M2207/18Type of exchange or network, i.e. telephonic medium, in which the telephonic communication takes place wireless networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/22Arrangements for supervision, monitoring or testing
    • H04M3/2227Quality of service monitoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/22Arrangements for supervision, monitoring or testing
    • H04M3/24Arrangements for supervision, monitoring or testing with provision for checking the normal operation
    • H04M3/247Knowledge-based maintenance systems

Definitions

  • the present invention relates to a system and method for monitoring the performance of applications on wireless networks, and more particularly, to initiating performance test, monitoring performance and collecting performance data for applications running on mobile wireless devices so as to determine the user experience.
  • Existing performance tools for wired and wireless networks measure performance between two end points for a given duration or session.
  • the end-hosts are designated specifically for the purpose of measurement. For example, to measure throughput, a file of given size is transferred and the amount of time taken to complete the transfer is measured to derive the throughput. Other metrics of interest include delay, packet loss, coverage, jitter etc. Further, due to the nature of wireless connectivity, the device may be out of coverage during the performance session resulting in loss of performance data. This may lead to repeating the experiment resulting in waste of precious wireless resources such as mobile device battery and wireless bandwidth.
  • performance tests are conducted between two end hosts which are selected a priori. This is not adequate in mobile networks as performance of the network needs to be determined at various locations and connectivity and coverage varies with location. Devices have to be placed at explicit locations to collect performance data. This is an expensive proposition and does not scale. Thus, the performance end-points need to be dynamically determined based on location and specific network conditions by using existing user devices already connected to the network.
  • One aspect of the invention is a method by which the service manager informs the mobile device about the tests to be conducted, the conditions under which the test should be started (time, location, network condition) and when the results should be transmitted. Based on the size of the results generated by conducting performance tests, appropriate means of transport from a set is chosen.
  • Another aspect of the invention is the methodology of conducting the actual test from the device to a specific end host. Once the request is received, the method involves monitoring the device conditions and network conditions to determine the appropriate moment to start the test. Certain tests have to be performed when the device is in certain state. For example, battery level or available memory on the device may be the condition to start the test. In other cases, it can be network conditions such as type of coverage or if the device is roaming. Further, the conditions under which the test is conducted can be any combinations of device state and network state. Based on the conditions the appropriate tests are initiated and test data collected by the mobile device. [0010] Another aspect of the invention is determining the appropriate parameters to use in the performance test. The parameters depend on the particular application and the type of the test.
  • the type of test will determine the parameters. For real-time applications, the length of the session, the location of the content server is used to generate a synthetic transaction and the performance data is collected. Based on the network type, the appropriate destination naming (number or IP address) is chosen. For non real-time applications, the location or address of the end host is determined and a connection initiated to download specific payload. The status of the test as well as the location when it was initiated is recorded. The type of the test will determine additional parameters that will be needed to perform the test. A latency test will involve initiating a connection, and measuring the round trip time, where as throughput test will involve the size of the data to be used in the transfer.
  • Yet another aspect of the invention is a method to efficiently store the results of the performance on the device and send it to the performance manager. Since, a mobile device is resource constrained, a fixed amount of storage has to be allocated for performance related data. The method involves using a fixed buffer and storing the results in a compact form to accommodate the results of a maximum number of tests as possible. The method further includes a means to store only the most recent results if the allocated storage is exhausted before the test results can be transferred to the service manager.
  • Figure 1 is a diagram showing the architecture in which concepts underlying the described invention may be implemented.
  • Figure 2 is a diagram showing the test request sent by the service manager to the device
  • Figure 3 is a test request record that shows the details of the test type and parameters sent to the device
  • Figure 4 is a result state record that shows the details of the results obtained after conducting the specified tests
  • Figure 5 is a test request response flow diagram that illustrates an aspect of the invention
  • FIG. 1 An example of an architecture 100 in which concepts underlying the described invention may be implemented is shown in Fig. 1.
  • a plurality of wireless devices such as device 1 102 and device 2 104, are communicatively connected via wireless infrastructure 106 and 108 and telecommunications network 110 to a content server 112 and to a service manager 114.
  • device 1 102 and device 2 104 may communicate with each other via wireless infrastructure 108 and telecommunications network 110.
  • device 1 102 may communicate with content server 112 and telecommunications network 110.
  • device 1 102 may communicate with service manager 114 via wireless infrastructure 106.
  • Device 1 102 and device 2 104 may be any type of wireless device, such as a wireless telephone, personal digital assistant (PDA), mobile email device, etc.
  • content server 112 may be any type of server system that is capable of serving content upon request.
  • Service manager 114 is typically a server system that is used by manage the services provided by and to wireless (and other) devices, but may be any type of computer system capable of performing the necessary functions.
  • architecture 100 and the particular devices and communications arrangements shown in Fig. 1 are merely examples.
  • the present invention contemplates any and all architectures and communications arrangements.
  • the present invention includes a monitoring server sending commands to a wireless device, such as device 1 102, to initiate connection from the wireless device to a specified content server, such as content server 112, as well as from a wireless device, such as device 1 102, to another wireless device, such as device 2 104.
  • a wireless device such as device 1 102
  • the monitoring server functionality is shown combined with service manager 114.
  • the monitoring server functionality being implemented separately from service manager 114, the monitoring server functionality being partially combined with service manager 114 and partially separate from service manager 114, or any other combination or arrangement of functionality.
  • test measurement is shown in Fig. 2.
  • monitoring server 202 transmits commands 204 via wireless infrastructure 206 to wireless device 208.
  • the various measurement options are sent as command parameters 210.
  • command parameters 300 is shown in Fig. 3.
  • Such parameters include an identifier 302 of the test request, an indicator 304 of the type of test to be performed, an indicator 306 of whether the test is to be performed periodically, one time only, or based on a threshold condition, an indicator 308 of any threshold conditions, an indicator 310 of a start time of the test, an indicator 312 of the period at which the test is to be periodically performed (if applicable), an indicator 314 of a location of the test, an identifier 316 of an application to be used to perform the test, an indicator 318 of a destination of the test, parameters 320 to be used by the application to be used to perform the test, and other conditions 322 relating to the mobile device.
  • These parameters are merely examples of possible parameters; the present invention contemplates these and any other parameters that may be used.
  • the measurement procedure involves monitoring the performance of connections and sessions explicitly initiated for purposes of measurement.
  • the data collected includes performance parameters such as system availability, latency, throughput, spatial and temporal correlation of lost packets.
  • the performance test may initiated by the server by sending performance parameters to the device, and device can explicitly monitor connection performance, session performance or application performance and send back the results to monitoring server.
  • An example of a test response 400 is shown in Fig. 4.
  • Response 400 include information such as an identifier 402 of the test request, an identifier 404 of the test that was performed, an identifier 406 of the response to the test, an indicator 408 of any error status resulting from the test, an indicator 410 of a start time of the test, an indicator 412 of the transfer time for data transferred during the test, an indicator 414 of a size of the data transferred during the test, an indicator 416 of a state of the device that was tested, an indicator 418 of a state of the network that was used for the test, and an indicator 420 of a type of connection used for the test.
  • This information is merely an example of possible information that may included in the response; the present invention contemplates this and any other information that may be used.
  • the performance conduit may be either device to server, such as between device 1 102 and content server 112, shown in Fig. 1, or device to device, such as between device 1 102 and device 2 104, shown in Fig 1.
  • the performance test may be initiated on-demand (by request from the server), periodically at specified intervals, or based on a threshold condition.
  • the threshold condition can be a combination of device state and network state.
  • An example of a process 500 to monitor and measure connection, session and application performance from the wireless terminal is shown in Fig. 5. It is best viewed in conjunction with Figs. 3 and 4.
  • Process 500 begins with step 501, in which the device to be tested is sent a start command for performance monitoring with parameters such as those shown in Fig. 3.
  • the parameters may include when the test should start 310, how often to repeat monitoring 312, when to report back results, the return transport (SMS or HTTP) for sending the test results, and the type of test 304, such as whether the test is device to device or device to server measurement.
  • additional parameters may be sent as detailed below:
  • MMS Multimedia Messaging Service
  • additional parameters such as a destination number 318, a message size to generate, and a status of the test (sent/failed/success) may be used.
  • the device may report back both the transfer start time, and the received/current time in GMT back to the server (with the difference being the duration).
  • the current location in the from of the cell ID, the lai, and the GPS coordinates of the wireless device may be sent.
  • additional parameters such as a destination URL 318, connect and download pages at the URL, and a status of the test (success/failed) may be used. If successful, then additional data may include a connect time and download time, (where the sum of both times equals the total time of test), the start time 410 in GMT of the test and the end time GMT of the test, the cell ID, the lai, GPS coordinates of the wireless device, and the data size downloaded 414.
  • HTTP HyperText Transfer Protocol
  • additional parameters such as a destination URL 318, connect and download pages at the url, and a status of the test (success/failed) may be used. If successful, then additional data may include a connect time and download time, (where the sum of both times equals the total time of test), the start time 410 in GMT of the test and the end time GMT of the test, the cell ID, the lai, the GPS coordinates of the wireless device, and the data size downloaded 414.
  • Additional parameters such as a destination number, how long to hold the call, and a status of test (success/failed/busy) may be used. Additional data may include a start/end time in GMT, the cell ID, the lai, and the GPS coordinates of the wireless device.
  • Additional parameters such as a destination number, a length of the clip (size), and a status of test (success/failed/busy) may be used. Additional data may include a start/end time in GMT, the cell ID, the lai, and the GPS coordinates of the wireless device.
  • step 502 the device monitors its state and the state of the network over which the test is to be conducted.
  • the device and network states are compared to the conditions that were established for the test to start, as communicated by parameters in the test request.
  • the performance test component on the mobile device automatically conducts tests when the specified conditions are met.
  • the conditions can be combinations of device and network state.
  • step 503 the device determines that the conditions are true, and, in response, in step 504, the device initiates the performance tests.
  • the device stores the test results, and in step 506, the device transmits the test results to the destination device for the test results.
  • the collected results can be transferred to a service manager only when it is appropriate to do so. The local store and transfer of results will result in efficient use of limited resources on the mobile device.
  • This invention will provide the wireless application providers with vital information about the quality of service (QOS) for various applications provided to wireless users, different wireless networks, technologies, and independent operators.
  • QOS quality of service

Abstract

A system and method by which a mobile wireless device dynamically decides the other end host to initiate a session to automatically conduct a performance test. Results of the performance test are then transferred to a monitoring server under appropriate conditions. A method for conducting a performance test on a wireless device comprises receiving information indicating how and when a performance test is to be conducted by the wireless device, determining whether the conditions for the performance test to be started are met, conducting the specified performance test, and storing results of the performance test.

Description

SYSTEM AND METHOD FOR MONITORING AND MEASURING END-TO-END PERFORMANCE USING WIRELESS DEVICES
Cross-Reference to Related Applications
[0001] This application claims the benefit of Provisional Application No.
60/661,506, filed March 15, 2005.
Field of the Invention
[0002] The present invention relates to a system and method for monitoring the performance of applications on wireless networks, and more particularly, to initiating performance test, monitoring performance and collecting performance data for applications running on mobile wireless devices so as to determine the user experience.
Background of the Invention
[0003] Existing performance tools for wired and wireless networks measure performance between two end points for a given duration or session. The end-hosts are designated specifically for the purpose of measurement. For example, to measure throughput, a file of given size is transferred and the amount of time taken to complete the transfer is measured to derive the throughput. Other metrics of interest include delay, packet loss, coverage, jitter etc. Further, due to the nature of wireless connectivity, the device may be out of coverage during the performance session resulting in loss of performance data. This may lead to repeating the experiment resulting in waste of precious wireless resources such as mobile device battery and wireless bandwidth.
[0004] Typically, performance tests are conducted between two end hosts which are selected a priori. This is not adequate in mobile networks as performance of the network needs to be determined at various locations and connectivity and coverage varies with location. Devices have to be placed at explicit locations to collect performance data. This is an expensive proposition and does not scale. Thus, the performance end-points need to be dynamically determined based on location and specific network conditions by using existing user devices already connected to the network.
[0005] Another important consideration in mobile networks is when and how to send the results of performance data. Since, mobile device has to initiate, measure and collect performance data, the data has to be collected and stored and then transferred to a server when the network conditions are conducive for such a transfer. Since storage is a premium on mobile devices, a mechanism is needed to store the performance data in a small, fixed amount of storage and then communicate when the network conditions are right. In many cases, only the most recent performance data can be sent.
[0006] Thus, there is a need to conduct performance tests that dynamically determines the end hosts and more efficiently stores the performance data and sends the results of performance data on-demand, or at periodic intervals or based on a threshold condition using different transport protocols.
Summary of the Invention
[0007] A system and method by which a mobile wireless device dynamically decides the other end host to initiate a session to automatically conduct a performance test. Results of the performance test are then transferred to a monitoring server under appropriate conditions.
[0008] One aspect of the invention is a method by which the service manager informs the mobile device about the tests to be conducted, the conditions under which the test should be started (time, location, network condition) and when the results should be transmitted. Based on the size of the results generated by conducting performance tests, appropriate means of transport from a set is chosen.
[0009] Another aspect of the invention is the methodology of conducting the actual test from the device to a specific end host. Once the request is received, the method involves monitoring the device conditions and network conditions to determine the appropriate moment to start the test. Certain tests have to be performed when the device is in certain state. For example, battery level or available memory on the device may be the condition to start the test. In other cases, it can be network conditions such as type of coverage or if the device is roaming. Further, the conditions under which the test is conducted can be any combinations of device state and network state. Based on the conditions the appropriate tests are initiated and test data collected by the mobile device. [0010] Another aspect of the invention is determining the appropriate parameters to use in the performance test. The parameters depend on the particular application and the type of the test. Once the application whose performance is needed is chosen, the type of test will determine the parameters. For real-time applications, the length of the session, the location of the content server is used to generate a synthetic transaction and the performance data is collected. Based on the network type, the appropriate destination naming (number or IP address) is chosen. For non real-time applications, the location or address of the end host is determined and a connection initiated to download specific payload. The status of the test as well as the location when it was initiated is recorded. The type of the test will determine additional parameters that will be needed to perform the test. A latency test will involve initiating a connection, and measuring the round trip time, where as throughput test will involve the size of the data to be used in the transfer.
_ o _ [0011] Yet another aspect of the invention is a method to efficiently store the results of the performance on the device and send it to the performance manager. Since, a mobile device is resource constrained, a fixed amount of storage has to be allocated for performance related data. The method involves using a fixed buffer and storing the results in a compact form to accommodate the results of a maximum number of tests as possible. The method further includes a means to store only the most recent results if the allocated storage is exhausted before the test results can be transferred to the service manager.
Brief Description of the Drawings
[0012] The drawing shown here in, along with the description, illustrates the invention.
[0013] Figure 1 is a diagram showing the architecture in which concepts underlying the described invention may be implemented.
[0014] Figure 2 is a diagram showing the test request sent by the service manager to the device
[0015] Figure 3 is a test request record that shows the details of the test type and parameters sent to the device
[0016] Figure 4 is a result state record that shows the details of the results obtained after conducting the specified tests
[0017] Figure 5 is a test request response flow diagram that illustrates an aspect of the invention
Detailed Description
[0018] An example of an architecture 100 in which concepts underlying the described invention may be implemented is shown in Fig. 1. In architecture 100, a plurality of wireless devices, such as device 1 102 and device 2 104, are communicatively connected via wireless infrastructure 106 and 108 and telecommunications network 110 to a content server 112 and to a service manager 114. For example, device 1 102 and device 2 104 may communicate with each other via wireless infrastructure 108 and telecommunications network 110. Likewise, device 1 102 may communicate with content server 112 and telecommunications network 110. In addition, device 1 102 may communicate with service manager 114 via wireless infrastructure 106.
[0019] Device 1 102 and device 2 104 may be any type of wireless device, such as a wireless telephone, personal digital assistant (PDA), mobile email device, etc. Likewise, content server 112 may be any type of server system that is capable of serving content upon request. Service manager 114 is typically a server system that is used by manage the services provided by and to wireless (and other) devices, but may be any type of computer system capable of performing the necessary functions.
[0020] It is to be noted that architecture 100 and the particular devices and communications arrangements shown in Fig. 1 are merely examples. The present invention contemplates any and all architectures and communications arrangements.
[0021] In one embodiment, the present invention includes a monitoring server sending commands to a wireless device, such as device 1 102, to initiate connection from the wireless device to a specified content server, such as content server 112, as well as from a wireless device, such as device 1 102, to another wireless device, such as device 2 104. In the example shown in Fig. 1, the monitoring server functionality is shown combined with service manager 114. However, this is merely an example. The present invention contemplates the monitoring server functionality being combined with service manager 114, the monitoring server functionality being implemented separately from service manager 114, the monitoring server functionality being partially combined with service manager 114 and partially separate from service manager 114, or any other combination or arrangement of functionality.
[0022] An example of test measurement is shown in Fig. 2. In this example, monitoring server 202 transmits commands 204 via wireless infrastructure 206 to wireless device 208. The various measurement options are sent as command parameters 210. An example of command parameters 300 is shown in Fig. 3. Such parameters include an identifier 302 of the test request, an indicator 304 of the type of test to be performed, an indicator 306 of whether the test is to be performed periodically, one time only, or based on a threshold condition, an indicator 308 of any threshold conditions, an indicator 310 of a start time of the test, an indicator 312 of the period at which the test is to be periodically performed (if applicable), an indicator 314 of a location of the test, an identifier 316 of an application to be used to perform the test, an indicator 318 of a destination of the test, parameters 320 to be used by the application to be used to perform the test, and other conditions 322 relating to the mobile device. These parameters are merely examples of possible parameters; the present invention contemplates these and any other parameters that may be used. [0023] The measurement procedure involves monitoring the performance of connections and sessions explicitly initiated for purposes of measurement. The data collected includes performance parameters such as system availability, latency, throughput, spatial and temporal correlation of lost packets. The performance test may initiated by the server by sending performance parameters to the device, and device can explicitly monitor connection performance, session performance or application performance and send back the results to monitoring server. An example of a test response 400 is shown in Fig. 4. Response 400 include information such as an identifier 402 of the test request, an identifier 404 of the test that was performed, an identifier 406 of the response to the test, an indicator 408 of any error status resulting from the test, an indicator 410 of a start time of the test, an indicator 412 of the transfer time for data transferred during the test, an indicator 414 of a size of the data transferred during the test, an indicator 416 of a state of the device that was tested, an indicator 418 of a state of the network that was used for the test, and an indicator 420 of a type of connection used for the test. This information is merely an example of possible information that may included in the response; the present invention contemplates this and any other information that may be used.
[0024] The performance conduit may be either device to server, such as between device 1 102 and content server 112, shown in Fig. 1, or device to device, such as between device 1 102 and device 2 104, shown in Fig 1. [0025] The performance test may be initiated on-demand (by request from the server), periodically at specified intervals, or based on a threshold condition. The threshold condition can be a combination of device state and network state. [0026] An example of a process 500 to monitor and measure connection, session and application performance from the wireless terminal is shown in Fig. 5. It is best viewed in conjunction with Figs. 3 and 4. Process 500 begins with step 501, in which the device to be tested is sent a start command for performance monitoring with parameters such as those shown in Fig. 3. For example, the parameters may include when the test should start 310, how often to repeat monitoring 312, when to report back results, the return transport (SMS or HTTP) for sending the test results, and the type of test 304, such as whether the test is device to device or device to server measurement.
[0027] In addition to the above, depending on the type of application, additional parameters may be sent as detailed below: [0028] For Multimedia Messaging Service (MMS) tests, additional parameters such as a destination number 318, a message size to generate, and a status of the test (sent/failed/success) may be used. Upon success of the test, the device may report back both the transfer start time, and the received/current time in GMT back to the server (with the difference being the duration). In addition, the current location in the from of the cell ID, the lai, and the GPS coordinates of the wireless device may be sent.
[0029] For Wireless Access Protocol (WAP) tests, additional parameters such as a destination URL 318, connect and download pages at the URL, and a status of the test (success/failed) may be used. If successful, then additional data may include a connect time and download time, (where the sum of both times equals the total time of test), the start time 410 in GMT of the test and the end time GMT of the test, the cell ID, the lai, GPS coordinates of the wireless device, and the data size downloaded 414.
[0030] For HyperText Transfer Protocol (HTTP) tests, additional parameters such as a destination URL 318, connect and download pages at the url, and a status of the test (success/failed) may be used. If successful, then additional data may include a connect time and download time, (where the sum of both times equals the total time of test), the start time 410 in GMT of the test and the end time GMT of the test, the cell ID, the lai, the GPS coordinates of the wireless device, and the data size downloaded 414.
[0031] For VOICE tests, additional parameters such as a destination number, how long to hold the call, and a status of test (success/failed/busy) may be used. Additional data may include a start/end time in GMT, the cell ID, the lai, and the GPS coordinates of the wireless device.
[0032] For VIDEO tests, additional parameters such as a destination number, a length of the clip (size), and a status of test (success/failed/busy) may be used. Additional data may include a start/end time in GMT, the cell ID, the lai, and the GPS coordinates of the wireless device.
[0033] In step 502, the device monitors its state and the state of the network over which the test is to be conducted. The device and network states are compared to the conditions that were established for the test to start, as communicated by parameters in the test request. The performance test component on the mobile device automatically conducts tests when the specified conditions are met. The conditions can be combinations of device and network state. In step 503, the device determines that the conditions are true, and, in response, in step 504, the device initiates the performance tests. Upon completion of the performance tests, the device stores the test results, and in step 506, the device transmits the test results to the destination device for the test results. The collected results can be transferred to a service manager only when it is appropriate to do so. The local store and transfer of results will result in efficient use of limited resources on the mobile device.
[0034] This invention will provide the wireless application providers with vital information about the quality of service (QOS) for various applications provided to wireless users, different wireless networks, technologies, and independent operators.
[0035] Although specific embodiments of the present invention have been described, it will be understood by those of skill in the art that there are other embodiments that are equivalent to the described embodiments. Accordingly, it is to be understood that the invention is not to be limited by the specific illustrated embodiments, but only by the scope of the appended claims.

Claims

1. A method for conducting a performance test on a wireless device comprising: receiving information indicating how and when a performance test is to be conducted by the wireless device; determining whether the conditions for the performance test to be started are met; conducting the specified performance test; and storing results of the performance test.
2. The method of claim 1, wherein the wireless device accepts the performance request only after verifying a digest sent by the service manager and transmits an acknowledgement to the service manager after the performance test is conducted.
3. The method of claim 2, where in the digest for verifying the credentials of the service manager is generated by means of a shared private key stored in the wireless device and the service manager.
4. The method of claim 1, wherein the information indicating how the performance test is to be conducted includes information indicating a type of application to be used to conduct the performance test and the performance test to be conducted is determined by the type of the application.
5. The method of claim 4, wherein the application type comprises a voice application, a data application, a video application, a multimedia application, or a group application (application involving multiple participants such as teleconferencing) .
6. The method of claim 1, wherein the information indicating when a performance test is to be conducted by the wireless device comprises information indicating that the test is to be conducted periodically, information indicating that the test is to be conducted at a specific time, or information indicating that the test is to be conducted based on a threshold condition.
7. The method of claim 6, wherein the threshold condition includes the state of the wireless device, the state of the network, or a combination of the state of the wireless device and a state of the network.
8. The method of claim 6, wherein it is determined whether the conditions for the performance test to be started are met by monitoring the state of the wireless device, the state of the network or both.
9. The method of claim 6, wherein the threshold condition includes a location of the wireless device or a location of an other end-host.
10. The method of claim 9, wherein the end-host can be a fixed host or another wireless device.
11. The method of claim 9, wherein the location comprises a cell ID, a network ED, or Global Positioning System coordinates.
12. The method of claim 7, wherein the wireless device state comprises at least one of a device capability, a state of a battery of the wireless device, a state of a memory of the wireless device, and a processing power of the wireless device.
13. The method of claim 7, wherein the network state comprises at least one of a coverage area of the network, a type of coverage of the network, and a roaming status of the wireless device.
PCT/US2006/009290 2005-03-15 2006-03-15 System and method for monitoring and measuring end-to-end performance using wireless devices WO2006099473A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2008501995A JP2008537859A (en) 2005-03-15 2006-03-15 System and method for monitoring and measuring operation between terminals using wireless device
EP06738362A EP1859552A4 (en) 2005-03-15 2006-03-15 System and method for monitoring and measuring end-to-end performance using wireless devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US66150605P 2005-03-15 2005-03-15
US60/661,506 2005-03-15

Publications (2)

Publication Number Publication Date
WO2006099473A2 true WO2006099473A2 (en) 2006-09-21
WO2006099473A3 WO2006099473A3 (en) 2008-11-27

Family

ID=36992399

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/009290 WO2006099473A2 (en) 2005-03-15 2006-03-15 System and method for monitoring and measuring end-to-end performance using wireless devices

Country Status (4)

Country Link
US (1) US8010100B2 (en)
EP (1) EP1859552A4 (en)
JP (1) JP2008537859A (en)
WO (1) WO2006099473A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011115625A1 (en) * 2010-03-19 2011-09-22 Velocent Systems Incorporated Method and apparatus pertaining to assessing ordinary end-to-end performance of a mobile data network
US8467367B2 (en) 2007-08-06 2013-06-18 Qualcomm Incorporated Multiplexing and transmission of traffic data and control information in a wireless communication system
WO2016014323A1 (en) * 2014-07-22 2016-01-28 Microsoft Technology Licensing, Llc Synthetic transactions between communication endpoints
WO2018132901A1 (en) * 2017-01-17 2018-07-26 Tutela Technologies Ltd. System and method for evaluating wireless device and wireless network performance

Families Citing this family (111)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US10361802B1 (en) 1999-02-01 2019-07-23 Blanding Hovenweep, Llc Adaptive pattern recognition based control system and method
US7904187B2 (en) 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US8364136B2 (en) 1999-02-01 2013-01-29 Steven M Hoffberg Mobile system, a method of operating mobile system and a non-transitory computer readable medium for a programmable control of a mobile system
US8126889B2 (en) 2002-03-28 2012-02-28 Telecommunication Systems, Inc. Location fidelity adjustment based on mobile subscriber privacy profile
US8918073B2 (en) 2002-03-28 2014-12-23 Telecommunication Systems, Inc. Wireless telecommunications location based services scheme selection
US7426380B2 (en) 2002-03-28 2008-09-16 Telecommunication Systems, Inc. Location derived presence information
US8027697B2 (en) 2007-09-28 2011-09-27 Telecommunication Systems, Inc. Public safety access point (PSAP) selection for E911 wireless callers in a GSM type system
US9154906B2 (en) 2002-03-28 2015-10-06 Telecommunication Systems, Inc. Area watcher for wireless network
US8290505B2 (en) 2006-08-29 2012-10-16 Telecommunications Systems, Inc. Consequential location derived information
US7424293B2 (en) 2003-12-02 2008-09-09 Telecommunication Systems, Inc. User plane location based service using message tunneling to support roaming
US7260186B2 (en) 2004-03-23 2007-08-21 Telecommunication Systems, Inc. Solutions for voice over internet protocol (VoIP) 911 location services
US20080126535A1 (en) 2006-11-28 2008-05-29 Yinjun Zhu User plane location services over session initiation protocol (SIP)
US20080090546A1 (en) 2006-10-17 2008-04-17 Richard Dickinson Enhanced E911 network access for a call center using session initiation protocol (SIP) messaging
US6985105B1 (en) 2004-10-15 2006-01-10 Telecommunication Systems, Inc. Culled satellite ephemeris information based on limiting a span of an inverted cone for locating satellite in-range determinations
US7629926B2 (en) 2004-10-15 2009-12-08 Telecommunication Systems, Inc. Culled satellite ephemeris information for quick, accurate assisted locating satellite location determination for cell site antennas
US7353034B2 (en) 2005-04-04 2008-04-01 X One, Inc. Location sharing and tracking using mobile phones or other wireless devices
US8660573B2 (en) * 2005-07-19 2014-02-25 Telecommunications Systems, Inc. Location service requests throttling
WO2007016337A2 (en) * 2005-07-28 2007-02-08 Mformation Technologies, Inc. System and method for service quality management for wireless devices
US9282451B2 (en) 2005-09-26 2016-03-08 Telecommunication Systems, Inc. Automatic location identification (ALI) service requests steering, connection sharing and protocol translation
US7825780B2 (en) 2005-10-05 2010-11-02 Telecommunication Systems, Inc. Cellular augmented vehicle alarm notification together with location services for position of an alarming vehicle
US8467320B2 (en) 2005-10-06 2013-06-18 Telecommunication Systems, Inc. Voice over internet protocol (VoIP) multi-user conferencing
US7907551B2 (en) 2005-10-06 2011-03-15 Telecommunication Systems, Inc. Voice over internet protocol (VoIP) location based 911 conferencing
US8150363B2 (en) 2006-02-16 2012-04-03 Telecommunication Systems, Inc. Enhanced E911 network access for call centers
US8059789B2 (en) 2006-02-24 2011-11-15 Telecommunication Systems, Inc. Automatic location identification (ALI) emergency services pseudo key (ESPK)
US9167553B2 (en) 2006-03-01 2015-10-20 Telecommunication Systems, Inc. GeoNexus proximity detector network
US7899450B2 (en) 2006-03-01 2011-03-01 Telecommunication Systems, Inc. Cellular augmented radar/laser detection using local mobile network within cellular network
US7471236B1 (en) 2006-03-01 2008-12-30 Telecommunication Systems, Inc. Cellular augmented radar/laser detector
US8208605B2 (en) 2006-05-04 2012-06-26 Telecommunication Systems, Inc. Extended efficient usage of emergency services keys
US8717911B2 (en) 2006-06-30 2014-05-06 Centurylink Intellectual Property Llc System and method for collecting network performance information
US8184549B2 (en) 2006-06-30 2012-05-22 Embarq Holdings Company, LLP System and method for selecting network egress
US8289965B2 (en) 2006-10-19 2012-10-16 Embarq Holdings Company, Llc System and method for establishing a communications session with an end-user based on the state of a network connection
US9094257B2 (en) 2006-06-30 2015-07-28 Centurylink Intellectual Property Llc System and method for selecting a content delivery network
US8194643B2 (en) 2006-10-19 2012-06-05 Embarq Holdings Company, Llc System and method for monitoring the connection of an end-user to a remote network
US8488447B2 (en) 2006-06-30 2013-07-16 Centurylink Intellectual Property Llc System and method for adjusting code speed in a transmission path during call set-up due to reduced transmission performance
US7684332B2 (en) 2006-08-22 2010-03-23 Embarq Holdings Company, Llc System and method for adjusting the window size of a TCP packet through network elements
US8144587B2 (en) 2006-08-22 2012-03-27 Embarq Holdings Company, Llc System and method for load balancing network resources using a connection admission control engine
US8015294B2 (en) 2006-08-22 2011-09-06 Embarq Holdings Company, LP Pin-hole firewall for communicating data packets on a packet network
US8531954B2 (en) 2006-08-22 2013-09-10 Centurylink Intellectual Property Llc System and method for handling reservation requests with a connection admission control engine
US8307065B2 (en) 2006-08-22 2012-11-06 Centurylink Intellectual Property Llc System and method for remotely controlling network operators
US8274905B2 (en) 2006-08-22 2012-09-25 Embarq Holdings Company, Llc System and method for displaying a graph representative of network performance over a time period
US8224255B2 (en) 2006-08-22 2012-07-17 Embarq Holdings Company, Llc System and method for managing radio frequency windows
US8223655B2 (en) 2006-08-22 2012-07-17 Embarq Holdings Company, Llc System and method for provisioning resources of a packet network based on collected network performance information
US8238253B2 (en) 2006-08-22 2012-08-07 Embarq Holdings Company, Llc System and method for monitoring interlayer devices and optimizing network performance
US9479341B2 (en) * 2006-08-22 2016-10-25 Centurylink Intellectual Property Llc System and method for initiating diagnostics on a packet network node
US8743703B2 (en) 2006-08-22 2014-06-03 Centurylink Intellectual Property Llc System and method for tracking application resource usage
US7843831B2 (en) 2006-08-22 2010-11-30 Embarq Holdings Company Llc System and method for routing data on a packet network
US8064391B2 (en) 2006-08-22 2011-11-22 Embarq Holdings Company, Llc System and method for monitoring and optimizing network performance to a wireless device
US8537695B2 (en) 2006-08-22 2013-09-17 Centurylink Intellectual Property Llc System and method for establishing a call being received by a trunk on a packet network
US8189468B2 (en) 2006-10-25 2012-05-29 Embarq Holdings, Company, LLC System and method for regulating messages between networks
US8576722B2 (en) 2006-08-22 2013-11-05 Centurylink Intellectual Property Llc System and method for modifying connectivity fault management packets
US8619600B2 (en) 2006-08-22 2013-12-31 Centurylink Intellectual Property Llc System and method for establishing calls over a call path having best path metrics
US8407765B2 (en) 2006-08-22 2013-03-26 Centurylink Intellectual Property Llc System and method for restricting access to network performance information tables
US8750158B2 (en) 2006-08-22 2014-06-10 Centurylink Intellectual Property Llc System and method for differentiated billing
US8130793B2 (en) 2006-08-22 2012-03-06 Embarq Holdings Company, Llc System and method for enabling reciprocal billing for different types of communications over a packet network
US7966013B2 (en) 2006-11-03 2011-06-21 Telecommunication Systems, Inc. Roaming gateway enabling location based services (LBS) roaming for user plane in CDMA networks without requiring use of a mobile positioning center (MPC)
US8176167B2 (en) * 2006-12-05 2012-05-08 Qualcomm Incorporated Methods and apparaus for requesting wireless communication device performance data and providing the data in optimal file size
US8050386B2 (en) 2007-02-12 2011-11-01 Telecommunication Systems, Inc. Mobile automatic location identification (ALI) for first responders
WO2009038726A1 (en) 2007-09-17 2009-03-26 Telecommunication Systems, Inc. Emergency 911 data messaging
WO2009067057A1 (en) * 2007-11-20 2009-05-28 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for assessing service performance
US9130963B2 (en) 2011-04-06 2015-09-08 Telecommunication Systems, Inc. Ancillary data support in session initiation protocol (SIP) messaging
US7929530B2 (en) 2007-11-30 2011-04-19 Telecommunication Systems, Inc. Ancillary data support in session initiation protocol (SIP) messaging
US8068425B2 (en) 2008-04-09 2011-11-29 Embarq Holdings Company, Llc System and method for using network performance information to determine improved measures of path states
US8068587B2 (en) 2008-08-22 2011-11-29 Telecommunication Systems, Inc. Nationwide table routing of voice over internet protocol (VOIP) emergency calls
EP2347395A4 (en) 2008-10-14 2016-11-02 Telecomm Systems Inc Location based proximity alert
US8892128B2 (en) 2008-10-14 2014-11-18 Telecommunication Systems, Inc. Location based geo-reminders
US8667479B2 (en) * 2009-01-19 2014-03-04 Telefonaktiebolaget L M Ericsson (Publ) Mobile specialized software code updated
JP5287476B2 (en) * 2009-04-28 2013-09-11 パナソニック株式会社 Radio terminal reception sensitivity measurement system
US9301191B2 (en) 2013-09-20 2016-03-29 Telecommunication Systems, Inc. Quality of service to over the top applications used with VPN
US8867485B2 (en) 2009-05-05 2014-10-21 Telecommunication Systems, Inc. Multiple location retrieval function (LRF) network having location continuity
US8655371B2 (en) * 2010-01-15 2014-02-18 Apple Inc. Location determination using cached location area codes
US8433334B2 (en) 2010-01-15 2013-04-30 Apple Inc. Managing a location database for network-based positioning system
US8983845B1 (en) * 2010-03-26 2015-03-17 Google Inc. Third-party audio subsystem enhancement
US8620344B2 (en) 2010-04-07 2013-12-31 Apple Inc. Location-based application program management
US10447767B2 (en) * 2010-04-26 2019-10-15 Pure Storage, Inc. Resolving a performance issue within a dispersed storage network
JP5663965B2 (en) 2010-06-01 2015-02-04 日本電気株式会社 Wireless terminal, wireless communication system, and area quality information collection method
US8315599B2 (en) 2010-07-09 2012-11-20 Telecommunication Systems, Inc. Location privacy selector
US20120006610A1 (en) 2010-07-09 2012-01-12 Erik Wallace Telematics enhanced mobile device safety interlock
US9158650B2 (en) * 2010-08-04 2015-10-13 BoxTone, Inc. Mobile application performance management
EP2437435B1 (en) 2010-09-29 2016-06-15 BlackBerry Limited Method and device for providing system status information
US8942743B2 (en) 2010-12-17 2015-01-27 Telecommunication Systems, Inc. iALERT enhanced alert manager
US8688087B2 (en) 2010-12-17 2014-04-01 Telecommunication Systems, Inc. N-dimensional affinity confluencer
WO2012087353A1 (en) 2010-12-22 2012-06-28 Telecommunication Systems, Inc. Area event handling when current network does not cover target area
NL2005918C2 (en) * 2010-12-23 2012-06-27 Geobrand B V Method and system for executing an application on a pda terminal.
WO2012141762A1 (en) 2011-02-25 2012-10-18 Telecommunication Systems, Inc. Mobile internet protocol (ip) location
US9348735B1 (en) * 2011-05-08 2016-05-24 Panaya Ltd. Selecting transactions based on similarity of profiles of users belonging to different organizations
US8649806B2 (en) 2011-09-02 2014-02-11 Telecommunication Systems, Inc. Aggregate location dynometer (ALD)
US9479344B2 (en) 2011-09-16 2016-10-25 Telecommunication Systems, Inc. Anonymous voice conversation
US8831556B2 (en) 2011-09-30 2014-09-09 Telecommunication Systems, Inc. Unique global identifier header for minimizing prank emergency 911 calls
US9313637B2 (en) 2011-12-05 2016-04-12 Telecommunication Systems, Inc. Wireless emergency caller profile data delivery over a legacy interface
US9264537B2 (en) 2011-12-05 2016-02-16 Telecommunication Systems, Inc. Special emergency call treatment based on the caller
US8984591B2 (en) 2011-12-16 2015-03-17 Telecommunications Systems, Inc. Authentication via motion of wireless device movement
US9384339B2 (en) 2012-01-13 2016-07-05 Telecommunication Systems, Inc. Authenticating cloud computing enabling secure services
US8688174B2 (en) 2012-03-13 2014-04-01 Telecommunication Systems, Inc. Integrated, detachable ear bud device for a wireless phone
US9544260B2 (en) 2012-03-26 2017-01-10 Telecommunication Systems, Inc. Rapid assignment dynamic ownership queue
US9307372B2 (en) 2012-03-26 2016-04-05 Telecommunication Systems, Inc. No responders online
US9338153B2 (en) 2012-04-11 2016-05-10 Telecommunication Systems, Inc. Secure distribution of non-privileged authentication credentials
US9549333B2 (en) 2012-06-01 2017-01-17 Turk Telekomunikasyon A.S. Method and device for monitoring and measurement of Wi-Fi internet services
US9313638B2 (en) 2012-08-15 2016-04-12 Telecommunication Systems, Inc. Device independent caller data access for emergency calls
US9208346B2 (en) 2012-09-05 2015-12-08 Telecommunication Systems, Inc. Persona-notitia intellection codifier
US10521288B2 (en) * 2012-11-07 2019-12-31 International Business Machines Corporation Collaborative application testing
US9456301B2 (en) 2012-12-11 2016-09-27 Telecommunication Systems, Inc. Efficient prisoner tracking
US8983047B2 (en) 2013-03-20 2015-03-17 Telecommunication Systems, Inc. Index of suspicion determination for communications request
US9408034B2 (en) 2013-09-09 2016-08-02 Telecommunication Systems, Inc. Extended area event for network based proximity discovery
US9516104B2 (en) 2013-09-11 2016-12-06 Telecommunication Systems, Inc. Intelligent load balancer enhanced routing
US9479897B2 (en) 2013-10-03 2016-10-25 Telecommunication Systems, Inc. SUPL-WiFi access point controller location based services for WiFi enabled mobile devices
US9608875B2 (en) 2013-11-15 2017-03-28 At&T Intellectual Property I, L.P. Individually unique key performance indicator management
US9730085B2 (en) 2014-06-30 2017-08-08 At&T Intellectual Property I, L.P. Method and apparatus for managing wireless probe devices
US20180316741A1 (en) * 2017-05-01 2018-11-01 Microsoft Technology Licensing, Llc Synthetic Transaction based on Network Condition
WO2019214830A1 (en) 2018-05-11 2019-11-14 Huawei Technologies Co., Ltd. Control plane entity and management plane entity for exchaning network slice instance data for analytics
US10841399B2 (en) * 2019-01-24 2020-11-17 Tambora Systems Singapore Pte. Ltd. System and method for guaranteeing quality of experience of a user in an online environment by implementing a required change in the mobile network based on quality of experience requirements and received quality of experience parameters

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998043455A2 (en) 1997-03-25 1998-10-01 Northern Telecom Limited Method and wireless terminal for monitoring communications and providing network with terminal operation information
US20020069037A1 (en) 2000-09-01 2002-06-06 Keith Hendrickson System and method for measuring wireless device and network usage and performance metrics
US20030066064A1 (en) 2001-07-26 2003-04-03 Gowri Rajaram System and method for field diagnosis of wireless communications device system software

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6308061B1 (en) * 1996-08-07 2001-10-23 Telxon Corporation Wireless software upgrades with version control
JP3590595B2 (en) * 2001-05-08 2004-11-17 東芝ソリューション株式会社 Radio wave quality measuring device, radio wave quality measuring system and radio wave quality measuring method for mobile phone
US7006820B1 (en) * 2001-10-05 2006-02-28 At Road, Inc. Method for determining preferred conditions for wireless programming of mobile devices
JP4370170B2 (en) * 2002-01-18 2009-11-25 テレフオンアクチーボラゲット エル エム エリクソン(パブル) How to load data on a mobile terminal
EP1639435A4 (en) * 2003-06-27 2009-12-30 Hewlett Packard Development Co System and method for downloading update packages into a mobile handset in a carrier network
EP1517570B1 (en) * 2003-09-16 2007-04-25 Research In Motion Limited Method for conducting radiated performance tests of a wireless device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998043455A2 (en) 1997-03-25 1998-10-01 Northern Telecom Limited Method and wireless terminal for monitoring communications and providing network with terminal operation information
US20020069037A1 (en) 2000-09-01 2002-06-06 Keith Hendrickson System and method for measuring wireless device and network usage and performance metrics
US20030066064A1 (en) 2001-07-26 2003-04-03 Gowri Rajaram System and method for field diagnosis of wireless communications device system software

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1859552A4

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8467367B2 (en) 2007-08-06 2013-06-18 Qualcomm Incorporated Multiplexing and transmission of traffic data and control information in a wireless communication system
TWI452881B (en) * 2007-08-06 2014-09-11 Qualcomm Inc Multiplexing and transmission of traffic data and control information in a wireless communication system
US9306795B2 (en) 2007-08-06 2016-04-05 Qualcomm Incorporated Multiplexing and transmission of traffic data and control information in a wireless communication system
WO2011115625A1 (en) * 2010-03-19 2011-09-22 Velocent Systems Incorporated Method and apparatus pertaining to assessing ordinary end-to-end performance of a mobile data network
WO2016014323A1 (en) * 2014-07-22 2016-01-28 Microsoft Technology Licensing, Llc Synthetic transactions between communication endpoints
US10021214B2 (en) 2014-07-22 2018-07-10 Microsoft Technology Licensing, Llc Synthetic transactions between communication endpoints
WO2018132901A1 (en) * 2017-01-17 2018-07-26 Tutela Technologies Ltd. System and method for evaluating wireless device and wireless network performance
US10667154B2 (en) 2017-01-17 2020-05-26 Tutela Technologies Ltd. System and method for evaluating wireless device and wireless network performance

Also Published As

Publication number Publication date
EP1859552A4 (en) 2009-07-29
US20060234639A1 (en) 2006-10-19
EP1859552A2 (en) 2007-11-28
US8010100B2 (en) 2011-08-30
JP2008537859A (en) 2008-09-25
WO2006099473A3 (en) 2008-11-27

Similar Documents

Publication Publication Date Title
US8010100B2 (en) System and method for monitoring and measuring end-to-end performance using wireless devices
US7620383B2 (en) Client-based context-based billing for wireless networks
US8737243B2 (en) Methods and apparatus for monitoring network link quality
US20100020717A1 (en) Method and system for Quality of Service (QoS) monitoring for wireless devices
US20080070603A1 (en) Idle Mode Notification
RU2438177C2 (en) Method and system for service billing, network access server and protocol information analysing device
CN102136920B (en) Method and device for web conference
JP2014502459A (en) System and method for measuring available capacity and narrow link capacity of an IP path from a single endpoint
US9008682B2 (en) Performance monitoring of location-based service in a mobile telecommunications network
US8493876B2 (en) Method and apparatus for realizing a test
KR100862188B1 (en) Method and System for processing billing based on QoS
CN106101468B (en) Method and device for determining transmission link
DK1902580T3 (en) QUALITY OF A REAL TIME SERVICE
JP4931969B2 (en) Network quality measurement system and method and program
JP2010067015A (en) File transmission device, file reception device, file transmission and reception system, and program thereof
CN101355465A (en) Unified system and method for measuring service quality
JPWO2007074679A1 (en) Communication control method, communication monitoring method, communication system, access point, and program
JP4724761B2 (en) Communication control device and program
JP5524114B2 (en) COMMUNICATION DEVICE, COMMUNICATION SYSTEM, AND COMPUTER PROGRAM
KR20070120257A (en) Performance analysis system and method for realtime services in ngn
CN116847412A (en) Slice load evaluation method, device, management data analysis function network element and medium
KR101082751B1 (en) Method and apparatus for charging management of mobile communication system
Batalla et al. In-segment content server adaptation for dual adaptation mechanism in DASH
CN112543191A (en) Load balancing method and device
Bethalam et al. Causes of TCP Reset in Mobile Web Browsing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006738362

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2008501995

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU