WO2001035252A2 - Reporting and analyzing data from a multi-region research survey - Google Patents

Reporting and analyzing data from a multi-region research survey Download PDF

Info

Publication number
WO2001035252A2
WO2001035252A2 PCT/US2000/030652 US0030652W WO0135252A2 WO 2001035252 A2 WO2001035252 A2 WO 2001035252A2 US 0030652 W US0030652 W US 0030652W WO 0135252 A2 WO0135252 A2 WO 0135252A2
Authority
WO
WIPO (PCT)
Prior art keywords
survey
data
analysis
client
communication mode
Prior art date
Application number
PCT/US2000/030652
Other languages
French (fr)
Other versions
WO2001035252A8 (en
Inventor
Robert W. Monster
Original Assignee
Global Market Insite, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Global Market Insite, Inc. filed Critical Global Market Insite, Inc.
Priority to AU14734/01A priority Critical patent/AU1473401A/en
Publication of WO2001035252A2 publication Critical patent/WO2001035252A2/en
Publication of WO2001035252A8 publication Critical patent/WO2001035252A8/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/107Computer-aided management of electronic mailing [e-mailing]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/454Multi-language systems; Localisation; Internationalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • G06Q30/0203Market surveys; Market polls
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • G06Q30/0204Market segmentation
    • G06Q30/0205Location or geographical consideration

Definitions

  • the present invention relates to the field of data processing. More particularly, the present invention relates to reporting and analyzing data from a multi-region research survey. Background
  • a research service includes a number of functions for reporting and analyzing data from a multi-region research survey.
  • the service provides an analysis interface to a research client to receive client input using a regional communication mode corresponding to the research client. Based on the client input, the service analyzes data from an on-line survey of a panelist. The online survey uses a second, distinct regional communication mode corresponding to the panelist. Analysis results are provided to the client in the analysis interface, again using the regional communication mode corresponding to the research client.
  • the analysis service similarly provides for analysis of survey data from multiple panelists using multiple regional communication modes.
  • FIG. 1 illustrates one embodiment of the present invention.
  • Figure 2 demonstrates one embodiment of the present invention.
  • Figure 3 illustrates one embodiment of an identification window.
  • Figure 4 illustrates one embodiment of a survey list.
  • Figure 5 illustrates one embodiment of a survey summary.
  • Figure 6 illustrates one embodiment of an analysis report for a particular response variable.
  • Figure 7 illustrates one embodiment of an analysis report for demographic information.
  • Figure 8 illustrates one embodiment of an analysis report for semantic differential questions.
  • Figure 9 illustrates one embodiment of a three dimensional analysis report.
  • Figure 10 illustrates one embodiment of a price point analysis report.
  • Figure 11 illustrates one embodiment of a computer system to perform various operations of the present invention.
  • Figure 12 illustrates one embodiment of a machine readable medium to store instructions to implement various operations of the present invention.
  • Figure 13 illustrates one embodiment of a text coding analysis report.
  • Figure 14 illustrates one embodiment of a configuration window tor a text coding analysis report.
  • a survey collects better data when it is administered in the panelist's native mode of communication including, for instance, the panelist's native language, currency, and cultural customs.
  • the best data can be obtained by translating the survey into the various modes of communication native to panelists in the various regions.
  • coordinating multiple versions of a survey presents a number of challenges for a researcher.
  • Creating a multi-region survey is the subject of co-pending U.S. Patent Application ⁇ number to be inserted>, entitled “Multi-Region Market Research Study Creation” (Docket # P003).
  • the administration of a multi-region survey is the subject of co-pending U.S.
  • the present invention is drawn to analyzing survey data created and collected by the processes of these related applications.
  • the present invention advantageously allows a researcher to access, analyze, and report on multi- region survey data using his or her native mode of communication without any need whatsoever to understand the diverse modes of communication used by the panelists.
  • FIG. 1 illustrates one embodiment of the present invention.
  • a multi- region research service provider 102 is connected to multi-region research clients 104 and multi-region survey panelists 106 through a networking fabric 108.
  • Research clients use service provider 102 to conduct on-line, multi-region surveys of the diverse pool of survey panelists 106.
  • Surveys can focus on virtually any concept including, for instance, market research for a product or service, marketability of a political candidate or issue, sociological studies, health studies, and the like. Surveys can also take virtually any form including, for instance, text-based, graphics-based, audio-based, or multimedia interactions (called “response variables”) designed to illicit responses.
  • the service provider 102 includes a multi-region survey reporting and analysis service 110.
  • Analysis service 110 includes analysis interface 114 for interacting with research clients 104 and has access to survey data 112.
  • Survey data 112 may include data representing the surveys themselves as well as data representing any responses that have already been collected.
  • a researcher wants to analyze survey data 112 to determine some objective statistical issue. For instance, the researcher may want to know what percentage of a pool of panelists are interested in a particular product or service and the researcher may want to rank their level of interest within a predefined range.
  • surveys are often created using various forms of multiple choice questions rather than free form answers. Since the service provider 102 uniformly administers surveys, whether a question and set of possible answers is presented to a panelist in German, Japanese, Arabic, or some other language, the service provider 102 can uniformly record that the panelist selected a particular answer from the set of possible answers. In which case, the analysis service 110 can perform statistical analysis on the uniformly recorded data without regard to the mode of communication used to administer individual questions.
  • the analysis service 110 can display the questions in one particular language and match-up the uniformly recorded answers.
  • the same approach can be applied to currency conversions, measurement conversions, and the like.
  • the analysis service 110 takes advantage of the uniformly administered survey data provided by the multi-region research service provider 102 to allow a research client 104 using a single mode of communication to analyze multi- region survey data.
  • analysis can be performed in real-time on centralized data collected from multiple regions using multiple modes of communication. By collecting data from multiple time zones around the world, data processing loads for large surveys, or multiple simultaneous surveys, are likely to be distributed or balanced across a 24 hour operating clock.
  • a researcher can select his or her native mode of communication from a number of supported modes and analyze data from surveys created and/or administered in different modes of communication.
  • any number of data mining techniques and statistical analysis can be performed.
  • the analysis service 110 are described below in more detail.
  • the various equipment used by the service provider 102, the research clients 104, the survey panelists 106, and the networking fabric 108 are intended to represent a broad range of these elements known in the art.
  • Examples of computing and networking equipment suitable for practicing the present invention include, but are not limited to, various palm-sized, notebook sized, or desktop computers available from, for instance, IBM of Armonk, New York, servers available from Sun Microsystems of Mountain View, California, and routers/switches available from CISCO Systems of San Jose, California.
  • the analysis service provides the analysis interface to a research client, receives client input through the analysis interface in one mode of communication, analyzes data from the multi-region, on-line survey based on the client input, and provides analysis results through the analysis interface.
  • the analysis interface could be, for instance, provided as a web page on-line or as an installed software application on the client's machine.
  • Figure 2 demonstrates one embodiment of the present invention including a number of implementation specific details. Other embodiments may not include all of the illustrated elements, may include additional elements, and/or may perform various elements in a different order.
  • the illustrated process is basically several iterations of the general process. That is, the illustrated process repeatedly provides some form of analysis interface, receives client input, analyzes survey data based on the input, and provides results through the analysis interface.
  • the process begins by prompting the research client in his or her native mode of communication to provide identification and authentication at block 210.
  • This is the first analysis interface.
  • any number of approaches can be used by the client to indicate his or her native mode of communication. For instance, a one-click pick list could be used to select from a list of supported modes of communication.
  • Identification and authentication could be a login and password, an encryption key, biometric data, or the like.
  • the analysis service then waits to receive client input at block 215.
  • the analysis service analyzes survey data based on the input at block 220. For instances, the analysis service filters survey data to identify any surveys that the client is authorized to access. In other words, survey data can include more than just the questions and answers. Survey data may also include supporting information such as who created the survey, who has authority to access the survey, what mode of communication was used to create the survey, purpose statements for the survey, and the like.
  • the analysis service displays summary information for the surveys in a list.
  • Summary information may include a title or number for the survey or some other identifying information, as well as the number of panelists in the survey, regions of administration for the survey, and just about anything else that a client might want to know.
  • Listed surveys may have already completed, may be currently in progress, or may be waiting to start.
  • the type of information to be displayed in the summary may depend on the stage the survey is currently in and may depend on the availability of data. That is, if a survey has not started, no response data will be available for statistical analysis.
  • the client can configure the fields in the summary list to display information of particular interest to the client.
  • the surveys can include data in diverse modes of communication.
  • the analysis service takes advantage of the uniformly administered data provided by the multi-region research survey provider to display information in the client's mode of communication.
  • the summary list also includes at least one mechanism to select and act upon one or more of the surveys. Any number of mechanisms can be used. A number of examples are illustrated with respect to Figures 3 through 10 below, and may include, for instance, hyper-links, check boxes and window buttons, pop-up menus, drop-down menus, single-click icons, double-click icons, pick lists, and a window or a series of windows including various configuration options.
  • the process returns to block 210 to prompt the client again.
  • various security measures could be used to prevent an un-authorized user from repeatedly trying input combinations until he or she gains access. For instance, the analysis interface could lockup after a certain number of failed attempts.
  • the process waits for client input at block 230.
  • client input indicates that the client wishes to exit at block 235
  • the process returns to block 210. If the client does not wish to exit, the process performs another iteration of analysis on the survey data at block 240.
  • the analysis is based on the client input and can include any number of data mining and/or statistical analysis operations including, for instance, data filtering such as identifying a particular group of panelists who gave a particular response to a question or identifying related data such as other surveys in which a particular panelist participated, data calculations such as calculating an average response to a particular question, generating mechanisms to configure further analysis such as links to demographic information about particular panelists identified by filtering the survey data, and displaying an analysis report such as a table, graph, or chart.
  • data filtering such as identifying a particular group of panelists who gave a particular response to a question or identifying related data such as other surveys in which a particular panelist participated
  • data calculations such as calculating an average response to a particular question
  • generating mechanisms to configure further analysis such as links to demographic information about particular panelists identified by filtering the survey data
  • displaying an analysis report such as a table, graph, or chart.
  • the process After analyzing data in block 240, the process returns to block 230 to wait for client input. The process will continue to go through iteration after iteration of blocks 230, 235, and 240, until the client exits, repeatedly analyzing data, presenting analysis results in the analysis interface including at least one mechanism for further analysis, and waiting for further client input. Using this iterative process, the client can move up and down through various levels of detailed analysis of the survey data, viewing analysis reports in a wide variety of formats.
  • FIGS 3 through 10, 13, and 14 illustrate a number of embodiments of analysis interfaces, input mechanisms, and analysis reports. Any number of alternate embodiments can be used to provide an analysis interface, receive client input, and provide analysis results.
  • FIG. 3 illustrates one embodiment of an identification window 300.
  • the illustrated window may be the first step to access survey data using the analysis service of the present invention.
  • the client is prompted to supply a login and password.
  • the "continue" button submits the supplied information.
  • any number of alternate approaches can be used to identify and authenticate a client.
  • Figure 4 illustrates one embodiment of a survey list window 400.
  • the client Assuming, for instance, that the client successfully gained access to the analysis service through the interface of Figure 3, the client is presented with a list of summary information for surveys to which the client has access.
  • a client may have access only to surveys that the client created, or the client may have been granted access to surveys, or parts of surveys, created by others.
  • Various forms of security could be used to limit a client's access to certain data. For instance, a client may not be given access to specific names and addresses of panelists, or other personal or proprietary information.
  • the summary information includes a survey identification number, a study type, the number of panelists, the geographic regions for administering the survey, and a concept identifier and status for each survey.
  • the underlined entries in each summary illustrate one example of an input mechanism. That is, each underlined entry is a hyper-link to related or supporting data. For instance, if a client wants to know more about the make-up of a particular survey, he or she may click on the survey identification number to, for instance, see a title of the survey, who created it, the questions presented, etc. Clicking on the concept identification number may lead to information on the purpose for the survey and what information the creator hopes to glean from it.
  • the first two surveys are either complete or in progress because results are available for analysis as indicated by the hyper-link "Analyze Results.”
  • the third survey has not yet been initiated or has not yet received any results.
  • the "Analyze Results” hyperlink can lead to more detailed information about those results, including some form of overall survey summary.
  • Figure 5 illustrates one embodiment of a survey summary window 500.
  • the survey summary includes a list of question identifiers, number of responses to each question, average responses, and a check box for each question to select one or more questions for further analysis.
  • An average response can be calculated by assigning a weighted valued to each possible response, adding the weighted values from all the received responses, and dividing the total by the maximum possible weighted value.
  • the data can be updated in real time. For instance, were the client is analyzing data on-line, the analysis service can update the numbers whenever new responses are received by incrementing the response count and recalculating the average response. Furthermore, the centralized database allows real-time analysis of data from multiple regions collected using multiple modes of communication.
  • the exemplary input mechanism in the illustrated embodiment is the combination of the check boxes and the "Continue Analysis" button.
  • the client can select one or more questions for further analysis by checking the boxes and pressing the button. Any number of alternate embodiments may be used, of course, such as making the question identifiers hyper-links and browser controls to return to previous pages.
  • Figure 6 illustrates one embodiment of an analysis report window 600 providing further details about a question presented, for instance, in the overall survey summary of Figure 5.
  • the window includes the wording of the actual question, the number of responses received, the list of possible answers, and the percentage of responses received for each possible answer. The percentages are also illustrated using bar graphs. In alternate embodiments, a pie chart, histogram, linear or area function, or the like could be used to display the distribution of responses. If the client had selected more than one check box in the summary window of Figure 5, multiple reports such as the one illustrated in Figure 6 could be generated in a single window or in multiple windows. The data could also be updated in real time as new responses are received.
  • the input mechanisms in Figure 6 include hyper-links leading from each of the possible responses. For instance, selecting one of the responses in Figure 6 could lead to the analysis report window 700 shown in Figure 7, which details demographic information about panelists who selected the corresponding response.
  • Demographic information in the illustrated embodiment includes gender, marital status, educational level, age, employment status, and household composition. In alternate embodiments, any number of demographic factors could be used.
  • Figure 7 also illustrates another example of an input mechanism, menu/tool bar 710.
  • a client can select a variety of analysis reports and report formats including graphics, related questions, related surveys, information on individual panelists, and a survey specification.
  • a user may select a field from the window by, for instance, highlighting it, and then select a menu option related to that field.
  • a pop-up window of menu options may pop-up when the client passes a cursor over the field in the window.
  • fields may be hyper-links so that, for instance, a client can select the "male" hyper-link and view an analysis report of responses from all male panelists.
  • Figure 8 illustrates one embodiment of an analysis report window 800 for a particular type of response variable, semantic differential questions.
  • semantic differential questions are listed with weighted average responses for each. Any number of input mechanisms can be used to delve into more or different details.
  • Figure 9 illustrates one embodiment of a particular type of analysis report.
  • the table in window 900 includes three axes, a horizontal axis 905, a vertical axis 910, and a Z axis 920.
  • a user can specify various filter criteria for each axis to identify particular data.
  • the horizontal axis filter criteria is education level so that each column corresponds to a different level of education.
  • the vertical axis filter criteria is income so that each row corresponds to a different level of income.
  • the Z axis filter criteria is age so that each table in the Z axis corresponds to a different age category.
  • the data that is being filtered is intent to buy.
  • the each cell in each table is a weighted average response to the intent to buy question for respondents of a particular education, income, and age category.
  • Figure 10 illustrates one embodiment of another type of analysis report.
  • window 1000 subcategories of panelists were presented with different price points for a product and asked about their intent to buy.
  • the table includes the number of responses, illustrates the distribution of responses in graphical form, and specifies the average weighted response for each subcategory.
  • the illustrated embodiment presents a good example of analyzing multi- region data. That is, the price points would have been presented to the panelists in their respective native currencies. The table, however, reports the price points using the native currency and language of the researcher.
  • Figure 13 illustrates one embodiment on an analysis report that can be used to assign codes to open-ended questions.
  • the illustrated embodiment includes two windows. In the window on the right, a client as configured the report to list open-ended responses to a particular question in English.
  • translation services can be used to present results in any number of supported modes of communication. The question is displayed at the top of the window and the first five responses are listed below.
  • each response is a code field.
  • the client can select from codes listed in the window on the left. That is, after reading a particular response, the client can assign a code to the response for statistical analysis purposes. For instance, the first response indicates that the panelist is interested in wireless networking because the panelist is generally interested in cutting edge technology and wireless networking is new to the panelist. Therefore, the client codes the response with the "New" code, indicating that the panelist was interested in wireless networking because it is new.
  • each listed code has next to it a number of configuration buttons.
  • the configuration buttons can be used to add new codes if, for instance, the client begins to see a number of similar responses and wants to create a new code for those types of responses, to delete codes if, for instance, no responses receive a particular code number and the client wants to eliminate the code to shorten the list of possibilities, and to configure various aspects of a code.
  • a code figuration window can be used to specify text to identify a particular code number, as well as key words typically found in responses that receive this particular code number.
  • the key words can be used to perform an automatic coding of responses. For instance, if a client selects the "Autocode" button in Figure 13, the analysis service can scan open-ended responses for key words and automatically assign codes accordingly. Once the responses are coded, any kind of data mining or statistical analysis can be performed based on the codes.
  • Figure 11 illustrates one embodiment of a hardware system intended to represent a broad category of computer systems such as personal computers, workstations, and/or embedded systems.
  • the hardware system includes processor 1110 coupled to high speed bus 1105, which is coupled to input/output (I/O) bus 1115 through bus bridge 1130.
  • Temporary memory 1120 is coupled to bus 1105.
  • Permanent memory 1140 is coupled to bus 1115.
  • I/O device(s) 1150 is also coupled to bus 1115.
  • I/O device(s) 1150 may include a display device, a keyboard, one or more external network interfaces, etc.
  • temporary memory 1120 may be on-chip with processor 1110.
  • permanent memory 1140 may be eliminated and temporary memory 1120 may be replaced with an electrically erasable programmable read only memory (EEPROM), wherein software routines are executed in place from the EEPROM.
  • EEPROM electrically erasable programmable read only memory
  • Some implementations may employ a single bus, to which all of the components are coupled, or one or more additional buses and bus bridges to which various additional components can be coupled.
  • Those skilled in the art will be familiar with a variety of alternate internal networks including, for instance, an internal network based on a high speed system bus with a memory controller hub and an I/O controller hub.
  • Additional components may include additional processors, a CD ROM drive, additional memories, and other peripheral components known in the art.
  • the various elements of the present invention described above are each implemented using one or more computers such as the hardware system of Figure 11. Where more than one computer is used, the systems can be coupled to communicate over an external network, such as a local area network (LAN), an internet protocol (IP) network, etc.
  • the present invention is implemented as software routines executed by one or more execution units within the computer(s). For a given computer, the software routines can be stored on a storage device, such as permanent memory 1140.
  • the software routines can be machine executable instructions 1210 stored using any machine readable storage medium 1220, such as a diskette, CD-ROM, magnetic tape, digital video or versatile disk (DVD), laser disk, ROM, Flash memory, etc.
  • the series of instructions need not be stored locally, and could be received from a remote storage device, such as a server on a network, a CD ROM device, a floppy disk, etc., through, for instance, I/O device(s) 1150 of Figure 11. From whatever source, the instructions may be copied from the storage device into temporary memory 1120 and then accessed and executed by processor 1110.
  • these software routines are written in the C programming language. It is to be appreciated, however, that these routines may be implemented in any of a wide variety of programming languages.
  • the present invention is implemented in discrete hardware or firmware.
  • one or more application specific integrated circuits ASICs
  • one or more functions of the present invention could be implemented in one or more ASICs on additional circuit boards and the circuit boards could be inserted into the computer(s) described above.
  • field programmable gate arrays FPGAs
  • SPGA static programmable gate arrays
  • a combination of hardware and software could be used to implement one or more functions of the present invention.

Abstract

A research service includes a number of functions for reporting and analyzing data from a multi-region research survey. The service provides an analysis interface to a research client to receive client input using a regional communication mode corresponding to the research client. Based on the client input, the service analyzes data from an on-line survey of a panelist. The on-line survey uses a second, distinct regional communication mode corresponding to the panelist. Analysis results are provided to the client in the analysis interface, again using the regional communication mode corresponding to the research client. In various embodiments, the analysis service similarly provides for analysis of survey data from multiple panelists using multiple regional communication modes.

Description

REPORTING AND ANALYZING DATA FROM A MULTI-REGION
RESEARCH SURVEY
Related Application
This application claims priority to U.S. Provisional Application number 60/164,585, entitled "System and Method for Obtaining and Collating Survey Information in Real Time for Multiple Languages and Multiple Character Encodings," filed on November 10, 1999, which is hereby fully incorporated by reference. Field of the Invention
The present invention relates to the field of data processing. More particularly, the present invention relates to reporting and analyzing data from a multi-region research survey. Background
With increased globalization of commerce, market researchers increasingly have to conduct market research that involves multiple regions of the globe. Creating and conducting such a survey, and collecting, analyzing, and reporting data from such a survey present a number of challenges that otherwise do not exist in the case of single region market research studies. That is, multi-region surveys necessarily involve diverse panelists who may speak different languages, have cultural differences, different price point sensitivity, and so forth.
Historically, market researchers would develop and implement a survey in one region, like the United States, and then work with local counterparts in the various regions to have the survey translated and conducted. Under the prior art, it was often difficult to coordinate the creation of the survey so as to ensure consistency in the collected data for consolidation, analysis, an reporting.
Thus, an improved approach to the creation and administration of a multi-region survey, as well as data collection, analysis, and reporting from such a survey is desired.
SUMMARY OF THE INVENTION
A research service includes a number of functions for reporting and analyzing data from a multi-region research survey. The service provides an analysis interface to a research client to receive client input using a regional communication mode corresponding to the research client. Based on the client input, the service analyzes data from an on-line survey of a panelist. The online survey uses a second, distinct regional communication mode corresponding to the panelist. Analysis results are provided to the client in the analysis interface, again using the regional communication mode corresponding to the research client. In various embodiments, the analysis service similarly provides for analysis of survey data from multiple panelists using multiple regional communication modes.
BRIEF DESCRIPTION OF THE DRAWINGS
Examples of the present invention are illustrated in the accompanying drawings. The accompanying drawings, however, do not limit the scope of the present invention. Similar references in the drawings indicate similar elements.
Figure 1 illustrates one embodiment of the present invention.
Figure 2 demonstrates one embodiment of the present invention.
Figure 3 illustrates one embodiment of an identification window.
Figure 4 illustrates one embodiment of a survey list.
Figure 5 illustrates one embodiment of a survey summary.
Figure 6 illustrates one embodiment of an analysis report for a particular response variable.
Figure 7 illustrates one embodiment of an analysis report for demographic information.
Figure 8 illustrates one embodiment of an analysis report for semantic differential questions.
Figure 9 illustrates one embodiment of a three dimensional analysis report.
Figure 10 illustrates one embodiment of a price point analysis report.
Figure 11 illustrates one embodiment of a computer system to perform various operations of the present invention.
Figure 12 illustrates one embodiment of a machine readable medium to store instructions to implement various operations of the present invention.
Figure 13 illustrates one embodiment of a text coding analysis report. Figure 14 illustrates one embodiment of a configuration window tor a text coding analysis report.
DETAILED DESCRIPTION
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, those skilled in the art will understand that the present invention may be practiced without these specific details, that the present invention is not limited to the depicted embodiments, and that the present invention may be practiced in a variety of alternate embodiments. In other instances, well known methods, procedures, components, and circuits have not been described in detail.
Parts of the description will be presented using terminology commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. Also, parts of the description will be presented in terms of the execution of operations. As well understood by those skilled in the art, these operations often take the form of electrical, magnetic, or optical signals capable of being stored, transferred, combined, and otherwise manipulated through, for instance, electrical components.
Various operations will be described as multiple discrete steps performed in turn in a manner that is helpful in understanding the present invention. However, the order of description should not be construed as to imply that these operations are necessarily performed in the order they are presented, or even order dependent. Lastly, repeated usage of the phrase "in one embodiment" does not necessarily refer to the same embodiment, although it may.
Overview
Generally, a survey collects better data when it is administered in the panelist's native mode of communication including, for instance, the panelist's native language, currency, and cultural customs. In which case, to administer a survey across multiple regions, the best data can be obtained by translating the survey into the various modes of communication native to panelists in the various regions. As discussed above however, coordinating multiple versions of a survey presents a number of challenges for a researcher. Creating a multi-region survey is the subject of co-pending U.S. Patent Application <number to be inserted>, entitled "Multi-Region Market Research Study Creation" (Docket # P003). The administration of a multi-region survey is the subject of co-pending U.S. Applications <number to be inserted>, entitled "Multi-Region Market Research Study Processing" (Docket # P004), <number to be inserted>, entitled "Content Delivery In A Preferred Language For A Large Number Of Languages" (Docket # P002), and <number to be inserted>, entitled "Language Sensitive Electronic Mail Generation And Associated Applications" (Docket # P006). Each application has been filed contemporaneously, and has common inventorship, with the present invention. Except for any circular incorporation, the applications are hereby fully incorporated by reference.
The present invention is drawn to analyzing survey data created and collected by the processes of these related applications. The present invention advantageously allows a researcher to access, analyze, and report on multi- region survey data using his or her native mode of communication without any need whatsoever to understand the diverse modes of communication used by the panelists.
Figure 1 illustrates one embodiment of the present invention. A multi- region research service provider 102 is connected to multi-region research clients 104 and multi-region survey panelists 106 through a networking fabric 108. Research clients use service provider 102 to conduct on-line, multi-region surveys of the diverse pool of survey panelists 106. Surveys can focus on virtually any concept including, for instance, market research for a product or service, marketability of a political candidate or issue, sociological studies, health studies, and the like. Surveys can also take virtually any form including, for instance, text-based, graphics-based, audio-based, or multimedia interactions (called "response variables") designed to illicit responses.
As described in the incorporated applications referred to above, research clients create a survey using one particular mode of communication, such as the United States version of the English language and U.S. dollars, and specify multiple regions in which the survey is to be administered. The service provider 102 interacts with translation services (not shown) to translate the response variables into the various modes of communication used in the specified survey regions. The multi-region survey is then administered to the diverse set of panelists 106 on-line through networking fabric 108.
The service provider 102 includes a multi-region survey reporting and analysis service 110. Analysis service 110 includes analysis interface 114 for interacting with research clients 104 and has access to survey data 112. Survey data 112 may include data representing the surveys themselves as well as data representing any responses that have already been collected.
Typically, a researcher wants to analyze survey data 112 to determine some objective statistical issue. For instance, the researcher may want to know what percentage of a pool of panelists are interested in a particular product or service and the researcher may want to rank their level of interest within a predefined range. To obtain survey data that can be statistically analyzed, surveys are often created using various forms of multiple choice questions rather than free form answers. Since the service provider 102 uniformly administers surveys, whether a question and set of possible answers is presented to a panelist in German, Japanese, Arabic, or some other language, the service provider 102 can uniformly record that the panelist selected a particular answer from the set of possible answers. In which case, the analysis service 110 can perform statistical analysis on the uniformly recorded data without regard to the mode of communication used to administer individual questions.
Furthermore, under various circumstances, a researcher may be interested to see the responses from a particular panelists. Again, since the service provider 102 uniformly administers surveys, whether a question and set of possible answers is presented to a panelist in German, Japanese, Arabic, or some other language, the analysis service 110 can display the questions in one particular language and match-up the uniformly recorded answers. The same approach can be applied to currency conversions, measurement conversions, and the like.
In other words, according to the teachings of the present invention, the analysis service 110 takes advantage of the uniformly administered survey data provided by the multi-region research service provider 102 to allow a research client 104 using a single mode of communication to analyze multi- region survey data. In various embodiments, analysis can be performed in real-time on centralized data collected from multiple regions using multiple modes of communication. By collecting data from multiple time zones around the world, data processing loads for large surveys, or multiple simultaneous surveys, are likely to be distributed or balanced across a 24 hour operating clock. By supporting multiple modes of communication, a researcher can select his or her native mode of communication from a number of supported modes and analyze data from surveys created and/or administered in different modes of communication. Furthermore, any number of data mining techniques and statistical analysis can be performed. Various examples of the analysis service 110 are described below in more detail.
Except for the novel aspects of the research service provider 102, the various equipment used by the service provider 102, the research clients 104, the survey panelists 106, and the networking fabric 108 are intended to represent a broad range of these elements known in the art. Examples of computing and networking equipment suitable for practicing the present invention include, but are not limited to, various palm-sized, notebook sized, or desktop computers available from, for instance, IBM of Armonk, New York, servers available from Sun Microsystems of Mountain View, California, and routers/switches available from CISCO Systems of San Jose, California.
Method
In general, the analysis service provides the analysis interface to a research client, receives client input through the analysis interface in one mode of communication, analyzes data from the multi-region, on-line survey based on the client input, and provides analysis results through the analysis interface. The analysis interface could be, for instance, provided as a web page on-line or as an installed software application on the client's machine.
Figure 2 demonstrates one embodiment of the present invention including a number of implementation specific details. Other embodiments may not include all of the illustrated elements, may include additional elements, and/or may perform various elements in a different order. The illustrated process is basically several iterations of the general process. That is, the illustrated process repeatedly provides some form of analysis interface, receives client input, analyzes survey data based on the input, and provides results through the analysis interface.
In the illustrated embodiment, the process begins by prompting the research client in his or her native mode of communication to provide identification and authentication at block 210. This is the first analysis interface. As discussed in the incorporated patent applications, any number of approaches can be used by the client to indicate his or her native mode of communication. For instance, a one-click pick list could be used to select from a list of supported modes of communication. Identification and authentication could be a login and password, an encryption key, biometric data, or the like. The analysis service then waits to receive client input at block 215.
When input is received, the analysis service analyzes survey data based on the input at block 220. For instances, the analysis service filters survey data to identify any surveys that the client is authorized to access. In other words, survey data can include more than just the questions and answers. Survey data may also include supporting information such as who created the survey, who has authority to access the survey, what mode of communication was used to create the survey, purpose statements for the survey, and the like.
If one or more surveys are found, the analysis service displays summary information for the surveys in a list. Summary information may include a title or number for the survey or some other identifying information, as well as the number of panelists in the survey, regions of administration for the survey, and just about anything else that a client might want to know. Listed surveys may have already completed, may be currently in progress, or may be waiting to start. The type of information to be displayed in the summary may depend on the stage the survey is currently in and may depend on the availability of data. That is, if a survey has not started, no response data will be available for statistical analysis. In certain embodiments, the client can configure the fields in the summary list to display information of particular interest to the client.
Of course, the surveys can include data in diverse modes of communication. As discussed above, the analysis service takes advantage of the uniformly administered data provided by the multi-region research survey provider to display information in the client's mode of communication.
The summary list also includes at least one mechanism to select and act upon one or more of the surveys. Any number of mechanisms can be used. A number of examples are illustrated with respect to Figures 3 through 10 below, and may include, for instance, hyper-links, check boxes and window buttons, pop-up menus, drop-down menus, single-click icons, double-click icons, pick lists, and a window or a series of windows including various configuration options.
At block 225, if no surveys are listed, the process returns to block 210 to prompt the client again. In alternate embodiments, various security measures could be used to prevent an un-authorized user from repeatedly trying input combinations until he or she gains access. For instance, the analysis interface could lockup after a certain number of failed attempts.
If one or more surveys are listed, the process waits for client input at block 230. When client input is received, if the client input indicates that the client wishes to exit at block 235, the process returns to block 210. If the client does not wish to exit, the process performs another iteration of analysis on the survey data at block 240. The analysis is based on the client input and can include any number of data mining and/or statistical analysis operations including, for instance, data filtering such as identifying a particular group of panelists who gave a particular response to a question or identifying related data such as other surveys in which a particular panelist participated, data calculations such as calculating an average response to a particular question, generating mechanisms to configure further analysis such as links to demographic information about particular panelists identified by filtering the survey data, and displaying an analysis report such as a table, graph, or chart.
After analyzing data in block 240, the process returns to block 230 to wait for client input. The process will continue to go through iteration after iteration of blocks 230, 235, and 240, until the client exits, repeatedly analyzing data, presenting analysis results in the analysis interface including at least one mechanism for further analysis, and waiting for further client input. Using this iterative process, the client can move up and down through various levels of detailed analysis of the survey data, viewing analysis reports in a wide variety of formats.
Examples
Figures 3 through 10, 13, and 14 illustrate a number of embodiments of analysis interfaces, input mechanisms, and analysis reports. Any number of alternate embodiments can be used to provide an analysis interface, receive client input, and provide analysis results.
Figure 3 illustrates one embodiment of an identification window 300. The illustrated window may be the first step to access survey data using the analysis service of the present invention. In the illustrated embodiment, the client is prompted to supply a login and password. The "continue" button submits the supplied information. As discussed above, any number of alternate approaches can be used to identify and authenticate a client.
Figure 4 illustrates one embodiment of a survey list window 400. Assuming, for instance, that the client successfully gained access to the analysis service through the interface of Figure 3, the client is presented with a list of summary information for surveys to which the client has access. A client may have access only to surveys that the client created, or the client may have been granted access to surveys, or parts of surveys, created by others. Various forms of security could be used to limit a client's access to certain data. For instance, a client may not be given access to specific names and addresses of panelists, or other personal or proprietary information.
In the illustrated embodiment, the summary information includes a survey identification number, a study type, the number of panelists, the geographic regions for administering the survey, and a concept identifier and status for each survey. The underlined entries in each summary illustrate one example of an input mechanism. That is, each underlined entry is a hyper-link to related or supporting data. For instance, if a client wants to know more about the make-up of a particular survey, he or she may click on the survey identification number to, for instance, see a title of the survey, who created it, the questions presented, etc. Clicking on the concept identification number may lead to information on the purpose for the survey and what information the creator hopes to glean from it. Clicking on the countries or cities entries may lead to more detailed information about the target pool of panelists for the survey, including demographic information, modes of communication used for different groups of panelists, and the like. In alternate embodiments, any number of input mechanisms, such as those discussed above, could be used in place of hyperlinks to lead to more detailed information from a summary page. Various browser functions could also be used to exit the analysis service, return to a previous screen, etc.
In the illustrated embodiment, the first two surveys are either complete or in progress because results are available for analysis as indicated by the hyper-link "Analyze Results." The third survey has not yet been initiated or has not yet received any results. For the surveys that have received results, the "Analyze Results" hyperlink can lead to more detailed information about those results, including some form of overall survey summary.
Figure 5 illustrates one embodiment of a survey summary window 500. The survey summary includes a list of question identifiers, number of responses to each question, average responses, and a check box for each question to select one or more questions for further analysis. An average response can be calculated by assigning a weighted valued to each possible response, adding the weighted values from all the received responses, and dividing the total by the maximum possible weighted value.
In one embodiment, the data can be updated in real time. For instance, were the client is analyzing data on-line, the analysis service can update the numbers whenever new responses are received by incrementing the response count and recalculating the average response. Furthermore, the centralized database allows real-time analysis of data from multiple regions collected using multiple modes of communication.
The exemplary input mechanism in the illustrated embodiment is the combination of the check boxes and the "Continue Analysis" button. The client can select one or more questions for further analysis by checking the boxes and pressing the button. Any number of alternate embodiments may be used, of course, such as making the question identifiers hyper-links and browser controls to return to previous pages. Figure 6 illustrates one embodiment of an analysis report window 600 providing further details about a question presented, for instance, in the overall survey summary of Figure 5. The window includes the wording of the actual question, the number of responses received, the list of possible answers, and the percentage of responses received for each possible answer. The percentages are also illustrated using bar graphs. In alternate embodiments, a pie chart, histogram, linear or area function, or the like could be used to display the distribution of responses. If the client had selected more than one check box in the summary window of Figure 5, multiple reports such as the one illustrated in Figure 6 could be generated in a single window or in multiple windows. The data could also be updated in real time as new responses are received.
The input mechanisms in Figure 6 include hyper-links leading from each of the possible responses. For instance, selecting one of the responses in Figure 6 could lead to the analysis report window 700 shown in Figure 7, which details demographic information about panelists who selected the corresponding response. Demographic information in the illustrated embodiment includes gender, marital status, educational level, age, employment status, and household composition. In alternate embodiments, any number of demographic factors could be used.
Figure 7 also illustrates another example of an input mechanism, menu/tool bar 710. From the bar 710, a client can select a variety of analysis reports and report formats including graphics, related questions, related surveys, information on individual panelists, and a survey specification. In one embodiment, a user may select a field from the window by, for instance, highlighting it, and then select a menu option related to that field. In an alternate embodiment, a pop-up window of menu options may pop-up when the client passes a cursor over the field in the window. In yet another alternate embodiment, fields may be hyper-links so that, for instance, a client can select the "male" hyper-link and view an analysis report of responses from all male panelists. Any number of alternate input mechanisms can be used, including browser commands to return to previous windows. Figure 8 illustrates one embodiment of an analysis report window 800 for a particular type of response variable, semantic differential questions. In the illustrated embodiment, semantic differential questions are listed with weighted average responses for each. Any number of input mechanisms can be used to delve into more or different details.
Figure 9 illustrates one embodiment of a particular type of analysis report. The table in window 900 includes three axes, a horizontal axis 905, a vertical axis 910, and a Z axis 920. Using various forms of configuration windows, a user can specify various filter criteria for each axis to identify particular data. In the illustrated embodiment, the horizontal axis filter criteria is education level so that each column corresponds to a different level of education. The vertical axis filter criteria is income so that each row corresponds to a different level of income. The Z axis filter criteria is age so that each table in the Z axis corresponds to a different age category. The data that is being filtered is intent to buy. The each cell in each table is a weighted average response to the intent to buy question for respondents of a particular education, income, and age category.
Figure 10 illustrates one embodiment of another type of analysis report. In window 1000, subcategories of panelists were presented with different price points for a product and asked about their intent to buy. The table includes the number of responses, illustrates the distribution of responses in graphical form, and specifies the average weighted response for each subcategory.
The illustrated embodiment presents a good example of analyzing multi- region data. That is, the price points would have been presented to the panelists in their respective native currencies. The table, however, reports the price points using the native currency and language of the researcher.
Skipping to Figure 13, Figure 13 illustrates one embodiment on an analysis report that can be used to assign codes to open-ended questions. The illustrated embodiment includes two windows. In the window on the right, a client as configured the report to list open-ended responses to a particular question in English. As discussed in the related applications, translation services can be used to present results in any number of supported modes of communication. The question is displayed at the top of the window and the first five responses are listed below.
Next to each response is a code field. The client can select from codes listed in the window on the left. That is, after reading a particular response, the client can assign a code to the response for statistical analysis purposes. For instance, the first response indicates that the panelist is interested in wireless networking because the panelist is generally interested in cutting edge technology and wireless networking is new to the panelist. Therefore, the client codes the response with the "New" code, indicating that the panelist was interested in wireless networking because it is new.
In the window on the left, each listed code has next to it a number of configuration buttons. The configuration buttons can be used to add new codes if, for instance, the client begins to see a number of similar responses and wants to create a new code for those types of responses, to delete codes if, for instance, no responses receive a particular code number and the client wants to eliminate the code to shorten the list of possibilities, and to configure various aspects of a code.
For instance, as shown in Figure 14, a code figuration window can be used to specify text to identify a particular code number, as well as key words typically found in responses that receive this particular code number. The key words can be used to perform an automatic coding of responses. For instance, if a client selects the "Autocode" button in Figure 13, the analysis service can scan open-ended responses for key words and automatically assign codes accordingly. Once the responses are coded, any kind of data mining or statistical analysis can be performed based on the codes.
Example Computer System
Figure 11 illustrates one embodiment of a hardware system intended to represent a broad category of computer systems such as personal computers, workstations, and/or embedded systems. In the illustrated embodiment, the hardware system includes processor 1110 coupled to high speed bus 1105, which is coupled to input/output (I/O) bus 1115 through bus bridge 1130. Temporary memory 1120 is coupled to bus 1105. Permanent memory 1140 is coupled to bus 1115. I/O device(s) 1150 is also coupled to bus 1115. I/O device(s) 1150 may include a display device, a keyboard, one or more external network interfaces, etc.
Certain embodiments may include additional components, may not require all of the above components, or may combine one or more components. For instance, temporary memory 1120 may be on-chip with processor 1110. Alternately, permanent memory 1140 may be eliminated and temporary memory 1120 may be replaced with an electrically erasable programmable read only memory (EEPROM), wherein software routines are executed in place from the EEPROM. Some implementations may employ a single bus, to which all of the components are coupled, or one or more additional buses and bus bridges to which various additional components can be coupled. Those skilled in the art will be familiar with a variety of alternate internal networks including, for instance, an internal network based on a high speed system bus with a memory controller hub and an I/O controller hub. Additional components may include additional processors, a CD ROM drive, additional memories, and other peripheral components known in the art.
In one embodiment, the various elements of the present invention described above are each implemented using one or more computers such as the hardware system of Figure 11. Where more than one computer is used, the systems can be coupled to communicate over an external network, such as a local area network (LAN), an internet protocol (IP) network, etc. In one embodiment, the present invention is implemented as software routines executed by one or more execution units within the computer(s). For a given computer, the software routines can be stored on a storage device, such as permanent memory 1140.
Alternately, as shown in Figure 12, the software routines can be machine executable instructions 1210 stored using any machine readable storage medium 1220, such as a diskette, CD-ROM, magnetic tape, digital video or versatile disk (DVD), laser disk, ROM, Flash memory, etc. The series of instructions need not be stored locally, and could be received from a remote storage device, such as a server on a network, a CD ROM device, a floppy disk, etc., through, for instance, I/O device(s) 1150 of Figure 11. From whatever source, the instructions may be copied from the storage device into temporary memory 1120 and then accessed and executed by processor 1110. In one implementation, these software routines are written in the C programming language. It is to be appreciated, however, that these routines may be implemented in any of a wide variety of programming languages.
In alternate embodiments, the present invention is implemented in discrete hardware or firmware. For example, one or more application specific integrated circuits (ASICs) could be programmed with one or more of the above described functions of the present invention. In another example, one or more functions of the present invention could be implemented in one or more ASICs on additional circuit boards and the circuit boards could be inserted into the computer(s) described above. In another example, field programmable gate arrays (FPGAs) or static programmable gate arrays (SPGA) could be used to implement one or more functions of the present invention. In yet another example, a combination of hardware and software could be used to implement one or more functions of the present invention.
Thus, reporting and analyzing data from a multi-region survey is described. Whereas many alterations and modifications of the present invention will be comprehended by a person skilled in the art after having read the foregoing description, it is to be understood that the particular embodiments shown and described by way of illustration are in no way intended to be considered limiting. Therefore, references to details of particular embodiments are not intended to limit the scope of the claims.

Claims

CLAIMS What is claimed is:
1. A method comprising: providing an analysis interface to a research client; receiving client input through the analysis interface using a first regional communication mode corresponding to the research client; analyzing data based at least in part on the client input, said data comprising an on-line survey of a panelist using a second regional communication mode corresponding to the panelist, said second regional communication mode being different from the first regional communication mode; and providing analysis results through the analysis interface using the first regional communication mode.
2. The method of claim 1 wherein the data further comprises an on-line survey of a plurality of additional panelists using a plurality of regional communication modes, each of said plurality of regional communications modes corresponding to at least one of the panelists.
3. The method of claim 2 wherein the plurality of regional communication modes comprises at least one of the first regional communication mode and the second regional communication mode.
4. The method of claim 1 wherein each regional communication mode comprises at least one of a language and a currency native to a particular geographic region.
5. The method of claim 1 wherein the analysis interface comprises at least one input mechanism.
6. The method of claim 5 wherein the input mechanism comprises at least one of a hyper-link, a check box, a window button, a pop-up menu, a drop-down menu, a single-click on an icon, a double-click on an icon, a pick list, and an analysis configuration window.
7. The method of claim 1 wherein providing the analysis results comprises at least one of: displaying a listing of summary information for the on-line survey as well as any other surveys associated with the research client, said listing comprising at least one input mechanism for acting upon summarized surveys; displaying an overall summary of the on-line survey, said overall summary comprising at least one input mechanism for acting upon a summarized item in the overall summary; and displaying an analysis report generated based on the on-line survey, said analysis report comprising at least one input mechanism to access supporting and/or related data.
8. The method of claim 7 wherein acting upon summarized surveys comprises at least one of accessing a survey questionnaire, accessing survey concept documentation, accessing analysis options, and accessing an overall survey summary.
9. The method of claim 7 wherein the surveys associated with the research client include at least one of a survey yet to be administered, a completed survey, a survey in progress, a survey created by the research client, and a survey to which the research client has been granted access.
10. The method of claim 7 wherein the overall summary further comprises at least one of a question identifier, a number of responses to the on-line survey and/or a question in the on-line survey, an average weighted value of responses, and a plurality of semantic differential questions.
11. The method of claim 7 wherein the analysis report comprises at least one of a wording of a survey question, a wording of possible survey answers to the survey question, a total number of responses to the survey question, a percentage of the total number of responses selecting a particular possible answer to the survey question, demographic information for a subcategory of panelists who selected a particular possible answer to the survey question, particular responses to each survey question selected by a particular panelist, a graphical representation, and a multi-dimensional relational table.
12. The method of claim 11 wherein the graphical representation illustrates a relative portion of responses selecting each of all possible responses to a survey question.
13. The method of claim 11 wherein the graphical representation comprises at least one of a bar graph, a pie chart, a histogram, and a two-dimensional linear or area function.
14. The method of claim 11 wherein the graphical representation illustrates a price point sensitivity in which subcategories of panelists were presented with different price points for a product or service and a range of possible answers indicating a likelihood to buy at the respective price point.
15. The method of claim 11 wherein the multi-dimensional relational table comprises a first axis corresponding to a first data category, a second axis corresponding to a second data category, and a third axis corresponding to a third data category.
16. The method of claim 15 wherein the data categories comprise at least one of panelist demographic information, particular survey questions, and particular survey responses.
17. The method of claim 1 wherein the on-line survey is in progress and wherein providing the analysis interface comprises updating information regarding the on-line survey in the analysis interface as new data is received.
18. The method of claim 1 wherein providing the analysis interface is based at least in part on previous analysis results.
19. The method of claim 1 wherein: providing the analysis interface comprises prompting the research client to provide identification and/or authentication; and analyzing the data comprises determining that the on-line survey is available to the research client based on the identification and/or authorization.
20. The method of claim 1 wherein analyzing the data comprises at least one of: filtering the data to provide one or more subsets of the data; performing calculations on the data; generating one or more input mechanisms to configure further analysis of the data; providing links among related subsets of the data; and generating displays for the data.
21. The method of claim 1 further comprising: prompting the research for the first mode of communication; providing a list of a plurality of modes of communication from which to choose; and receiving a selection from the research client.
22. The method of claim 1 wherein the on-line survey comprises a real-time survey of a plurality of panelists in multiple regions having a plurality of diverse modes of communication, and wherein analyzing the data comprises analyzing responses from the plurality of panelists in real-time.
23. The method of claim 1 wherein the on-line survey was created in a third regional communication mode different from the first and the second regional communication modes.
24. A machine readable medium having stored thereon machine executable instructions to implement a method comprising: providing an analysis interface to a research client; receiving client input through the analysis interface using a first regional communication mode corresponding to the research client; analyzing data based at least in part on the client input, said data comprising an on-line survey of a panelist using a second regional communication mode corresponding to the panelist, said second regional communication mode being different from the first regional communication mode; and providing analysis results through the analysis interface using the first regional communication mode.
25. An apparatus comprising: a storage medium having stored thereon executable instructions to implement provision of an analysis interface to a research client, reception of client input through the analysis interface using a first regional communication mode corresponding to the research client, analysis of data based at least in part on the client input, said data comprising an on-line survey of a panelist using a second regional communication mode corresponding to the panelist, said second regional communication mode being different from the first regional communication mode, and provision of analysis results through the analysis interface using the first regional communication mode; and one or more processors coupled to the storage medium to execute the executable instructions.
PCT/US2000/030652 1999-11-10 2000-11-06 Reporting and analyzing data from a multi-region research survey WO2001035252A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU14734/01A AU1473401A (en) 1999-11-10 2000-11-06 Reporting and analyzing data from a multi-region research survey

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16458599P 1999-11-10 1999-11-10
US60/164,585 1999-11-10

Publications (2)

Publication Number Publication Date
WO2001035252A2 true WO2001035252A2 (en) 2001-05-17
WO2001035252A8 WO2001035252A8 (en) 2002-02-07

Family

ID=22595156

Family Applications (5)

Application Number Title Priority Date Filing Date
PCT/US2000/041972 WO2001044981A2 (en) 1999-11-10 2000-11-06 Multi-region market research study creation
PCT/US2000/030646 WO2001035215A2 (en) 1999-11-10 2000-11-06 Content delivery in a preferred language for a large number of languages
PCT/US2000/030652 WO2001035252A2 (en) 1999-11-10 2000-11-06 Reporting and analyzing data from a multi-region research survey
PCT/US2000/041973 WO2001046850A2 (en) 1999-11-10 2000-11-06 Language sensitive electronic mail generation and associated applications
PCT/US2000/030583 WO2001035295A2 (en) 1999-11-10 2000-11-06 Multi-region market research study processing

Family Applications Before (2)

Application Number Title Priority Date Filing Date
PCT/US2000/041972 WO2001044981A2 (en) 1999-11-10 2000-11-06 Multi-region market research study creation
PCT/US2000/030646 WO2001035215A2 (en) 1999-11-10 2000-11-06 Content delivery in a preferred language for a large number of languages

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/US2000/041973 WO2001046850A2 (en) 1999-11-10 2000-11-06 Language sensitive electronic mail generation and associated applications
PCT/US2000/030583 WO2001035295A2 (en) 1999-11-10 2000-11-06 Multi-region market research study processing

Country Status (3)

Country Link
US (3) US7548846B1 (en)
AU (5) AU1473401A (en)
WO (5) WO2001044981A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7398223B2 (en) 1998-03-02 2008-07-08 Insightexpress, L.L.C. Dynamically assigning a survey to a respondent
US7548846B1 (en) 1999-11-10 2009-06-16 Global Market Insite, Inc. Language sensitive electronic mail generation and associated applications
US20110066464A1 (en) * 2009-09-15 2011-03-17 Varughese George Method and system of automated correlation of data across distinct surveys

Families Citing this family (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7149964B1 (en) * 2000-02-09 2006-12-12 Microsoft Corporation Creation and delivery of customized content
JP2002123662A (en) * 2000-10-16 2002-04-26 Iis:Kk Method of multilanguage market research on computer two-way communication network, communication system therefor and information recording medium
US20020188435A1 (en) * 2001-06-07 2002-12-12 Microsoft Corporation Interface for submitting richly-formatted documents for remote processing
US7158988B1 (en) * 2001-11-07 2007-01-02 Bellsouth Intellectual Property Corporation Reusable online survey engine
US7178104B1 (en) * 2002-02-15 2007-02-13 Microsoft Corporation System and method for generating structured documents in a non-linear manner
US8306972B2 (en) 2003-03-31 2012-11-06 Google Inc. Ordering of search results based on language and/or country of the search results
US20050131837A1 (en) 2003-12-15 2005-06-16 Sanctis Jeanne D. Method, system and program product for communicating e-commerce content over-the-air to mobile devices
US8595051B2 (en) * 2003-12-24 2013-11-26 Hewlett-Packard Development Company, L.P. Metrics capability self assessment
US8370269B2 (en) 2004-06-02 2013-02-05 Overstock.Com, Inc. System and methods for electronic commerce using personal and business networks
US8271540B2 (en) * 2005-05-17 2012-09-18 The Rand Corporation Computer assisted data collection for surveys and the like
US20070192161A1 (en) * 2005-12-28 2007-08-16 International Business Machines Corporation On-demand customer satisfaction measurement
US8924194B2 (en) 2006-06-20 2014-12-30 At&T Intellectual Property Ii, L.P. Automatic translation of advertisements
CN1937664B (en) * 2006-09-30 2010-11-10 华为技术有限公司 System and method for realizing multi-language conference
US20080114748A1 (en) * 2006-11-13 2008-05-15 Richard Varner Peer review system and method therefor
US20080140534A1 (en) * 2006-12-11 2008-06-12 Touchtone Technologies, Inc. Method and system that provides an incentive for a consumer to participate in a marketing program
GB0702763D0 (en) * 2007-02-13 2007-03-21 Skype Ltd Messaging system and method
US8312086B2 (en) * 2007-06-29 2012-11-13 Verizon Patent And Licensing Inc. Method and apparatus for message customization
US20090043562A1 (en) * 2007-08-08 2009-02-12 Vinay Vishwas Peshave Method and apparatus for receiving and displaying a short message in a user preferred language
US8412537B1 (en) 2007-12-12 2013-04-02 Intuit Inc. System and method for episode service item cost estimation based on historical data
US8315456B2 (en) * 2008-04-10 2012-11-20 The Nielsen Company Methods and apparatus for auditing signage
US20090300126A1 (en) * 2008-05-30 2009-12-03 International Business Machines Corporation Message Handling
US8086483B1 (en) * 2008-10-07 2011-12-27 Accenture Global Services Limited Analysis and normalization of questionnaires
US20100217650A1 (en) * 2009-02-24 2010-08-26 Edwin Geoffrey Hartnell System and method for providing market simulation/optimization
US9747622B1 (en) 2009-03-24 2017-08-29 Overstock.Com, Inc. Point-and-shoot product lister
JP2011197511A (en) * 2010-03-23 2011-10-06 Seiko Epson Corp Voice output device, method for controlling the same, and printer and mounting board
US20120095796A1 (en) * 2010-04-29 2012-04-19 E Motive LLC System and method for mobile survey management
US9047642B2 (en) * 2011-03-24 2015-06-02 Overstock.Com, Inc. Social choice engine
US9282185B2 (en) 2011-10-17 2016-03-08 At&T Intellectual Property I, L.P. System and method for callee-caller specific greetings for voice mail
US8515029B2 (en) 2011-11-02 2013-08-20 At&T Intellectual Property I, L.P. System and method for visual voice mail in an LTE environment
US9025739B2 (en) 2011-10-20 2015-05-05 At&T Intellectual Property I, L.P. System and method for visual voice mail in a multi-screen environment
US8489075B2 (en) 2011-11-16 2013-07-16 At&T Intellectual Property I, L.P. System and method for augmenting features of visual voice mail
US9042527B2 (en) 2011-10-17 2015-05-26 At&T Intellectual Property I, L.P. Visual voice mail delivery mechanisms
KR101873750B1 (en) * 2012-02-02 2018-07-03 엘지전자 주식회사 Mobile terminal and method for controlling thereof
US10546262B2 (en) 2012-10-19 2020-01-28 Overstock.Com, Inc. Supply chain management system
US20140181854A1 (en) * 2012-12-26 2014-06-26 Shmuel Finkelstein System and a method for interpretating data via audience polling system
US9471567B2 (en) * 2013-01-31 2016-10-18 Ncr Corporation Automatic language recognition
US9262405B1 (en) * 2013-02-28 2016-02-16 Google Inc. Systems and methods of serving a content item to a user in a specific language
US20140244237A1 (en) * 2013-02-28 2014-08-28 Intuit Inc. Global product-survey
US11023947B1 (en) 2013-03-15 2021-06-01 Overstock.Com, Inc. Generating product recommendations using a blend of collaborative and content-based data
US11676192B1 (en) 2013-03-15 2023-06-13 Overstock.Com, Inc. Localized sort of ranked product recommendations based on predicted user intent
TWI505227B (en) * 2013-03-20 2015-10-21 Univ Nat United A method for designing and then assessing training courses for a professional organization with a supplementary method for observing and assessing the competence growth of its members through the courses and a learning system integrating computer devices
US9824369B1 (en) * 2013-04-11 2017-11-21 Lucid Holdings, LLC Method of correlating bid price to intrinsic value in a survey platform
US10810654B1 (en) 2013-05-06 2020-10-20 Overstock.Com, Inc. System and method of mapping product attributes between different schemas
US9430227B2 (en) 2013-06-13 2016-08-30 Intuit Inc. Automatic customization of a software application
US9483788B2 (en) 2013-06-25 2016-11-01 Overstock.Com, Inc. System and method for graphically building weighted search queries
US10929890B2 (en) 2013-08-15 2021-02-23 Overstock.Com, Inc. System and method of personalizing online marketing campaigns
US9922351B2 (en) 2013-08-29 2018-03-20 Intuit Inc. Location-based adaptation of financial management system
US10425365B2 (en) * 2013-11-22 2019-09-24 At&T Intellectual Property I, L.P. System and method for relaying messages
US10872350B1 (en) 2013-12-06 2020-12-22 Overstock.Com, Inc. System and method for optimizing online marketing based upon relative advertisement placement
US10515631B2 (en) * 2013-12-17 2019-12-24 Koninklijke Philips N.V. System and method for assessing the cognitive style of a person
US11743389B1 (en) 2013-12-30 2023-08-29 Massachusetts Mutual Life Insurance Company System and method for managing routing of customer calls
US11509771B1 (en) 2013-12-30 2022-11-22 Massachusetts Mutual Life Insurance Company System and method for managing routing of customer calls
US11151486B1 (en) 2013-12-30 2021-10-19 Massachusetts Mutual Life Insurance Company System and method for managing routing of leads
US10242068B1 (en) * 2013-12-31 2019-03-26 Massachusetts Mutual Life Insurance Company Methods and systems for ranking leads based on given characteristics
US9911131B1 (en) 2013-12-31 2018-03-06 Massachusetts Mutual Life Insurance Company Method and system for obtaining leads based on data derived from a variety of sources
US10394834B1 (en) * 2013-12-31 2019-08-27 Massachusetts Mutual Life Insurance Company Methods and systems for ranking leads based on given characteristics
US9924053B2 (en) 2014-06-20 2018-03-20 Kabushiki Kaisha Toshiba Setting method and setting apparatus of image forming apparatus
US10726376B2 (en) * 2014-11-04 2020-07-28 Energage, Llc Manager-employee communication
US10332052B2 (en) * 2014-11-04 2019-06-25 Workplace Dynamics, LLC Interactive meeting agenda
US20160232544A1 (en) * 2015-02-05 2016-08-11 Arthur Andrew Scotson Social Network that Groups Users into Political Constituencies
US20170352047A1 (en) * 2016-06-07 2017-12-07 Matchstick, LLC Research Kit and Methods for Completing Remote Ethnographic Research
US10362362B2 (en) 2015-07-08 2019-07-23 Verizon Patent And Licensing Inc. Multi-dimensional hierarchical content navigation
US10534845B2 (en) 2016-05-11 2020-01-14 Overstock.Com, Inc. System and method for optimizing electronic document layouts
US10162819B2 (en) * 2016-08-17 2018-12-25 Netflix, Inc. Change detection in a string repository for translated content
US20190065458A1 (en) * 2017-08-22 2019-02-28 Linkedin Corporation Determination of languages spoken by a member of a social network
US11176461B1 (en) 2017-08-29 2021-11-16 Massachusetts Mutual Life Insurance Company System and method for managing routing of customer calls to agents
US10235628B1 (en) 2017-08-29 2019-03-19 Massachusetts Mutual Life Insurance Company System and method for managing routing of customer calls to agents
US10599761B2 (en) * 2017-09-07 2020-03-24 Qualtrics, Llc Digitally converting physical document forms to electronic surveys
CN108170660B (en) * 2018-01-22 2021-08-06 北京百度网讯科技有限公司 Multi-language typesetting display method, device, browser, terminal and medium
US11514493B1 (en) 2019-03-25 2022-11-29 Overstock.Com, Inc. System and method for conversational commerce online
US11205179B1 (en) 2019-04-26 2021-12-21 Overstock.Com, Inc. System, method, and program product for recognizing and rejecting fraudulent purchase attempts in e-commerce
US11948153B1 (en) 2019-07-29 2024-04-02 Massachusetts Mutual Life Insurance Company System and method for managing customer call-backs
US11734368B1 (en) 2019-09-26 2023-08-22 Overstock.Com, Inc. System and method for creating a consistent personalized web experience across multiple platforms and channels

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4816904A (en) 1983-06-09 1989-03-28 Control Data Corporation Television and market research data collection system and method
DE3751518T2 (en) 1986-08-01 1996-03-28 Ikegami Tsushinki Kk ARRANGEMENT FOR COLLECTING TELEVISION CHANNEL DATA AND MARKET RESEARCH DATA.
US5041972A (en) 1988-04-15 1991-08-20 Frost W Alan Method of measuring and evaluating consumer response for the development of consumer products
US5497319A (en) * 1990-12-31 1996-03-05 Trans-Link International Corp. Machine translation and telecommunications system
US5740035A (en) * 1991-07-23 1998-04-14 Control Data Corporation Self-administered survey systems, methods and devices
US5416903A (en) 1991-08-19 1995-05-16 International Business Machines Corporation System and method for supporting multilingual translations of a windowed user interface
US5999908A (en) 1992-08-06 1999-12-07 Abelow; Daniel H. Customer-based product design module
WO1994003865A1 (en) 1992-08-06 1994-02-17 Abelow, Daniel, H. Customer-based product design module
GB9222884D0 (en) 1992-10-30 1992-12-16 Massachusetts Inst Technology System for administration of privatization in newly democratic nations
US5568383A (en) 1992-11-30 1996-10-22 International Business Machines Corporation Natural language translation system and document transmission network with translation loss information and restrictions
US5442782A (en) 1993-08-13 1995-08-15 Peoplesoft, Inc. Providing information from a multilingual database of language-independent and language-dependent items
US5715466A (en) * 1995-02-14 1998-02-03 Compuserve Incorporated System for parallel foreign language communication over a computer network
US5987401A (en) 1995-12-08 1999-11-16 Apple Computer, Inc. Language translation for real-time text-based conversations
US5835712A (en) 1996-05-03 1998-11-10 Webmate Technologies, Inc. Client-server system using embedded hypertext tags for application and database development
GB2313933B (en) 1996-06-07 2000-06-28 Edward Henry Mathews A method of assisting the conducting of a research project
US6513014B1 (en) 1996-07-24 2003-01-28 Walker Digital, Llc Method and apparatus for administering a survey via a television transmission network
EP0853788A1 (en) 1996-08-08 1998-07-22 Agranat Systems, Inc. Embedded web server
US5884246A (en) 1996-12-04 1999-03-16 Transgate Intellectual Properties Ltd. System and method for transparent translation of electronically transmitted messages
DE19706419A1 (en) 1997-02-19 1998-08-27 Ibm Speech-controlled business process control method
US6035121A (en) 1997-07-07 2000-03-07 Netscape Communication Corporation Method and system for localizing a computer program
JPH11110480A (en) * 1997-07-25 1999-04-23 Kuraritec Corp Method and device for displaying text
US6161082A (en) 1997-11-18 2000-12-12 At&T Corp Network based language translation system
US6233317B1 (en) * 1997-12-11 2001-05-15 Unisys Corporation Multiple language electronic mail notification of received voice and/or fax messages
US6477504B1 (en) 1998-03-02 2002-11-05 Ix, Inc. Method and apparatus for automating the conduct of surveys over a network system
US6993495B2 (en) 1998-03-02 2006-01-31 Insightexpress, L.L.C. Dynamically assigning a survey to a respondent
US6044357A (en) 1998-05-05 2000-03-28 International Business Machines Corporation Modeling a multifunctional firm operating in a competitive market with multiple brands
US6741967B1 (en) 1998-11-02 2004-05-25 Vividence Corporation Full service research bureau and test center method and apparatus
US6219638B1 (en) * 1998-11-03 2001-04-17 International Business Machines Corporation Telephone messaging and editing system
US6275789B1 (en) 1998-12-18 2001-08-14 Leo Moser Method and apparatus for performing full bidirectional translation between a source language and a linked alternative language
US6256663B1 (en) 1999-01-22 2001-07-03 Greenfield Online, Inc. System and method for conducting focus groups using remotely loaded participants over a computer network
US6901367B1 (en) * 1999-01-28 2005-05-31 International Business Machines Corporation Front end translation mechanism for received communication
US6311190B1 (en) 1999-02-02 2001-10-30 Harris Interactive Inc. System for conducting surveys in different languages over a network with survey voter registration
AU6932200A (en) * 1999-08-23 2001-03-19 Webmiles.Com Corporation On-line registration system and method
US6792399B1 (en) 1999-09-08 2004-09-14 C4Cast.Com, Inc. Combination forecasting using clusterization
US7171348B2 (en) * 1999-09-10 2007-01-30 Worldlingo.Com Pty Ltd Communication processing system
US6859784B1 (en) 1999-09-28 2005-02-22 Keynote Systems, Inc. Automated research tool
WO2001044981A2 (en) 1999-11-10 2001-06-21 Global Market Insite, Inc. Multi-region market research study creation
US6564190B1 (en) 1999-12-30 2003-05-13 General Electric Capital Corporaton Method and formulating an investment strategy for real estate investment
US6745136B2 (en) * 2002-07-02 2004-06-01 Varco I/P, Inc. Pipe inspection systems and methods

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
No Search *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7398223B2 (en) 1998-03-02 2008-07-08 Insightexpress, L.L.C. Dynamically assigning a survey to a respondent
US7548846B1 (en) 1999-11-10 2009-06-16 Global Market Insite, Inc. Language sensitive electronic mail generation and associated applications
US20110066464A1 (en) * 2009-09-15 2011-03-17 Varughese George Method and system of automated correlation of data across distinct surveys

Also Published As

Publication number Publication date
US20070282664A1 (en) 2007-12-06
US7548846B1 (en) 2009-06-16
WO2001035295A2 (en) 2001-05-17
AU1473201A (en) 2001-06-06
AU4902701A (en) 2001-07-03
AU1362401A (en) 2001-06-06
WO2001044981A2 (en) 2001-06-21
WO2001035215A3 (en) 2002-05-23
WO2001046850A8 (en) 2001-10-04
WO2001046850A3 (en) 2003-10-30
WO2001035295A8 (en) 2001-12-20
AU1473401A (en) 2001-06-06
US20070174108A1 (en) 2007-07-26
WO2001035215A2 (en) 2001-05-17
WO2001046850A2 (en) 2001-06-28
WO2001044981A8 (en) 2003-09-12
AU4902601A (en) 2001-06-25
WO2001035252A8 (en) 2002-02-07

Similar Documents

Publication Publication Date Title
WO2001035252A2 (en) Reporting and analyzing data from a multi-region research survey
US9064021B2 (en) Data source attribution system
Schilling Technology success and failure in winner-take-all markets: The impact of learning orientation, timing, and network externalities
Earl et al. Changing the world one webpage at a time: Conceptualizing and explaining Internet activism
Katz et al. Effects of scent and breadth on use of site-specific search on e-commerce Web sites
Kim et al. Technology adoption and use theory review for studying scientists' continued use of cyber‐infrastructure
US20080082568A1 (en) System and method for managing and utilizing information
US20030154232A1 (en) Facilitating improved workflow
US20130091436A1 (en) Content visualization
US20080235339A1 (en) Subject matter resource website
US20100041482A1 (en) Recommendation generator and method for determining affinities to participate in a venture exchange
US20090132933A1 (en) Method and apparatus for social networking
Kules et al. Influence of training and stage of search on gaze behavior in a library catalog faceted search interface
CN101281539A (en) Collaborative workspace
CA2662410A1 (en) Convergence of terms within a collaborative tagging environment
WO2009055712A1 (en) Apparatuses, methods and systems for a forum ferreting system
US20080016022A1 (en) Systems and methods for providing information about patent examiners
US20030126160A1 (en) Method, system, and computer program product for generating custom databases
JP7106086B1 (en) Matching device, matching method, computer program
Hoeber et al. HotMap: Supporting visual exploration of Web search results
Beran et al. Exploratory analysis of file system metadata for rapid investigation of security incidents
Baro et al. An evaluation of institutional repository development in African universities
US20110041069A1 (en) User interface for aggregating services in a data processing system
Umit Solar panels and political attitudes
French et al. The journal of organizational computing and electronic commerce: An analysis of its impact on the information systems field in the 21st century

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 09744775

Country of ref document: US

AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: C1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

D17 Declaration under article 17(2)a
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase