US20040193479A1 - Method and apparatus for automating the conduct of surveys over a network system - Google Patents
Method and apparatus for automating the conduct of surveys over a network system Download PDFInfo
- Publication number
- US20040193479A1 US20040193479A1 US10/818,796 US81879604A US2004193479A1 US 20040193479 A1 US20040193479 A1 US 20040193479A1 US 81879604 A US81879604 A US 81879604A US 2004193479 A1 US2004193479 A1 US 2004193479A1
- Authority
- US
- United States
- Prior art keywords
- survey
- client
- network
- interface
- surveys
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0203—Market surveys; Market polls
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0204—Market segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0204—Market segmentation
- G06Q30/0205—Location or geographical consideration
Definitions
- the present invention relates to a method and apparatus for automating the conduct of surveys over a network system.
- a client In defining the business problem, a client generally specifies a set of parameters that defines the information the client needs to know, a particular target group of interest, a time frame, and a cost for the conduct of the research. For example, a client may want to know within three weeks, the flavor of toothpaste that is most liked by kids between the ages of six and thirteen.
- the research solution typically involves a series of steps that may include creating a survey instruments and fielding to several hundred people by phone or mail to better understand the needs, behaviors, attitudes and opinions of the client's targeted group.
- the research group mails surveys to a predetermined number of people who fall within the target group.
- This method of surveying includes such steps as printing surveys, addressing envelopes, stuffing envelopes with the survey, depositing surveys into a mail system, and then waiting for the target group to mail back responses. Once the responses are received, they are processed, coded, and entered into a computer to be analyzed. The analyzed data is then interpreted and reported back to the client.
- a drawback associated with conducting research using mail is that it generally takes eight to twelve weeks from the time a project is initiated to its completion. In many cases, this delay is prohibitively long and unacceptable in today's competitive market where business decisions often have to be made in days—not weeks. In addition, the cost of producing, printing, and mailing surveys as well as analyzing the results of the survey can impose a substantial financial burden on many clients.
- a third medium used for collecting survey data is in-person interviewing. As with telephone, the cost of in-person interviewing can be extremely costly, thus imposing an even higher financial burden on many clients.
- a fourth and emerging medium for conducting research is the Internet and other networks. While they offer advantages of speed and lower costs, they reach a small percentage of the consumer and business public (approximately 25% of households and 30% of business) making it difficult to cost effectively find and interview targeted consumers and customers.
- a method and apparatus for automating the conduct of surveys over a network system is provided.
- an automated survey mechanism causes an interface to be displayed to a client which allows the particular client to define a survey.
- a sequence of steps is automatically performed. The sequence of steps includes generating a survey based on information received over said network system from said interface; fielding the survey to a group of target users on the network system; gathering results of the survey; and providing the particular client with data that reflects the results over said network system.
- FIG. 1 is a block diagram of a computer system upon which an embodiment of the invention may be implemented
- FIG. 2A is a block diagram of a computer system context
- FIG. 2B is an example of a top-level interface page in accordance with the present invention.
- FIG. 3 is an example of an interface page that can be used by the user to generate questions and responses in defining a survey
- FIG. 4 is an example of different response types that may be associated with a particular question in accordance with the present invention.
- FIG. 5 is an example of the real-time pricing capability associated with the invention.
- FIG. 6 illustrates a flow diagram for automating a survey over a network system in accordance with the present invention.
- FIG. 1 is a block diagram that illustrates a computer system 100 upon which an embodiment of the invention may be implemented.
- Computer system 100 includes a bus 102 or other communication mechanism for communicating information, and a processor 104 coupled with bus 102 for processing information.
- Computer system 100 also includes a main memory 106 , such as a random access memory (RAM) or other dynamic storage device, coupled to bus 102 for storing information and instructions to be executed by processor 104 .
- Main memory 106 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 104 .
- Computer system 100 further includes a read only memory (ROM) 108 or other static storage device coupled to bus 102 for storing static information and instructions for processor 104 .
- ROM read only memory
- a storage device 110 such as a magnetic disk or optical disk, is provided and coupled to bus 102 for storing information and instructions.
- Computer system 100 may be coupled via bus 102 to a display 112 , such as a cathode ray tube (CRT), for displaying information to a computer user.
- a display 112 such as a cathode ray tube (CRT)
- An input device 114 is coupled to bus 102 for communicating information and command selections to processor 104 .
- cursor control 116 is Another type of user input device
- cursor control 116 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 104 and for controlling cursor movement on display 112 .
- This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
- the invention is related to the use of computer system 100 for automating surveys over a network system.
- the automation of surveys over a network system is provided by computer system 100 in response to processor 104 executing one or more sequences of one or more instructions contained in main memory 106 .
- Such instructions may be read into main memory 106 from another computer-readable medium, such as storage device 110 .
- Execution of the sequences of instructions contained in main memory 106 causes processor 104 to perform the process steps described herein.
- hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention.
- embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
- Non-volatile media includes, for example, optical or magnetic disks, such as storage device 110 .
- Volatile media includes dynamic memory, such as main memory 106 .
- Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 102 . Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
- Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to processor 104 for execution.
- the instructions may initially be carried on a magnetic disk of a remote computer.
- the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
- a modem local to computer system 100 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
- An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 102 .
- Bus 102 carries the data to main memory 106 , from which processor 104 retrieves and executes the instructions.
- the instructions received by main memory 106 may optionally be stored on storage device 110 either before or after execution by processor 104 .
- Computer system 100 also includes a communication interface 118 coupled to bus 102 .
- Communication interface 118 provides a two-way data communication coupling to a network link 120 that is connected to a local network 122 .
- communication interface 118 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line.
- ISDN integrated services digital network
- communication interface 118 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
- LAN local area network
- Wireless links may also be implemented.
- communication interface 118 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
- Network link 120 typically provides data communication through one or more networks to other data devices.
- network link 120 may provide a connection through local network 122 to a host computer 124 or to data equipment operated by an Internet Service Provider (ISP) 126 .
- ISP 126 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 128 .
- Internet 128 uses electrical, electromagnetic or optical signals that carry digital data streams.
- the signals through the various networks and the signals on network link 120 and through communication interface 118 , which carry the digital data to and from computer system 100 are exemplary forms of carrier waves transporting the information.
- Computer system 100 can send messages and receive data, including program code, through the network(s), network link 120 and communication interface 118 .
- a server 130 might transmit a requested code for an application program through Internet 128 , ISP 126 , local network 122 and communication interface 118 .
- one such downloaded application provides for automating surveys over the network system as described herein.
- the received code may be executed by processor 104 as it is received, and/or stored in storage device 110 , or other non-volatile storage for later execution. In this manner, computer system 100 may obtain application code in the form of a carrier wave.
- an automated survey mechanism provides an interface that enables a client to define, target, field, and receive results from a particular survey.
- This interface typically consists of one or more individual interfaces that are provided to the client over the network system.
- the interfaces are provided using HTML page formats and are provided to the client via the Internet or other networks.
- the interface is presented to the client via Java Script, Applets, Word processors, or other software programs. By interacting with the interface, the client has the ability to define a particular survey, select the target audience for the survey, learn the price of the survey, and define other pertinent parameters.
- the survey is automatically created and fielded to a particular group of network users (target group or respondents) who are connected to the network system.
- Results from the survey are quickly and automatically gathered as network users (or respondents) complete the survey.
- the gathered results are automatically processed, analyzed, and data and charts that reflect the survey results are sent to the client.
- FIG. 2A illustrates in block form an example of the parties and systems involved in this context.
- a client 280 is coupled either directly or indirectly to the Internet 252 .
- a client 280 may be connected to Internet 252 through a local area network, an Internet Service Provider, an Online Service Provider such as AOL, a proprietary server, or any combination thereof.
- the user client 280 , and the other clients referenced in this description, are end station devices such as a personal computer, workstation, network computer, etc.
- the client 280 and other clients have a processor that executes an operating system and a browser program under control of the operating system.
- the browser program is an industry-standard World Wide Web browser, such as Microsoft Internet Explorer®, Netscape Navigator® or NCSA Mosaic.
- network user clients 274 , 276 and 278 Connected to the Internet 252 is a plurality of network user clients 274 , 276 and 278 .
- network users can access, display and interact with Web pages that are contained on servers that are coupled to Internet 252 .
- user client 280 and network user clients 274 , 276 and 278 can connect to the survey conductor server 254 .
- client 280 and network user clients 274 , 276 and 278 communicate with the survey conductor server 254 using industry-standard protocols such as Transmission Control Protocol (TCP), Internet Protocol (IP), and Hypertext Transfer Protocol (HTTP).
- TCP Transmission Control Protocol
- IP Internet Protocol
- HTTP Hypertext Transfer Protocol
- the survey conductor server 254 contains a survey builder 294 , a storage unit 296 and a plurality of surveys 256 , 258 and 260 .
- Survey builder 294 contains interface data that defines an interface that can be used to create a survey. For example, if a client requests to define a survey, the survey builder 294 automatically sends interface data over Internet 252 to cause an interface to be displayed on the browser executing on user client 280 . The client then interacts with the interface to create a survey.
- the plurality of surveys 256 , 258 and 260 represent surveys that have previously been created using survey builder 294 .
- Storage unit 256 is used to store survey results. As network users participate in the surveys, the results are automatically stored in the storage unit 296 .
- network severs 262 , 264 and 266 each respectively storing data that defines a set of Web pages 286 , 288 and 290 .
- the Web pages 286 , 288 and 290 may be defined using a variety of methods and formats such as HTML, Java Script, Applets, Word processors, or other software programs.
- banners 268 , 270 and 272 Contained within the set of Web pages 286 , 288 and 290 are banners 268 , 270 and 272 which may also be defined using a variety of methods and formats.
- the banners 268 , 270 and 272 contain hypertext links to surveys 256 , 258 and 260 . By selecting a banner, a network user client is automatically provided with a corresponding survey.
- the client When a client requests a survey be built, the client is provided with interface data that causes an interface to be displayed on the client's display unit (i.e. computer monitor, television set, etc.).
- the client may execute a locally-stored program that generates the interface, or a dynamically delivered JAVA Applet that generates the interface.
- the interface is delivered to the client in the form of one or more HTML pages.
- the present invention is not limited to any particular mechanism for presenting the interface to the user.
- the client may interact with the interface to perform the steps of:
- FIG. 2B illustrates an example of a top-level interface page 200 in accordance with an embodiment of the present invention.
- the top-level interface contains six buttons 202 , 204 , 206 , 208 , 210 , and 212 .
- Each of the six buttons is linked to other interfaces which can be accessed by the client to cause the automation of a survey over the network system.
- selecting button 202 causes an interface to be displayed that allows the client to enter/select questions and responses for defining a survey
- selecting button 204 causes an interface to be displayed that allows the client to select a particular target group or respondents for fielding the survey
- selecting button 206 causes the price of the survey to be displayed to the client, facilitating the alteration of study and pricing parameters
- selecting button 208 causes an interface to be displayed that allows the client to enter a destination to which the results of the survey are to be sent
- selecting button 210 causes an interface to be displayed that allows the client to enter payment information for the automated processing of the survey as defined
- selecting button 212 enables the user to execute a process that “walks” clients through the interfaces so that they may easily use the automated survey mechanism.
- FIG. 3 illustrates an example of an interface 300 that is displayed when the client selects button 202 , in accordance with an embodiment of the invention.
- interface 300 includes a question entry box 320 that allows a client to complete a phrase or enter a question that is to be used in defining a survey.
- exemplary response buttons 302 - 318 are also included in interface 300 .
- the response buttons 302 - 318 correspond to a particular question type that may be selected for the question that is entered in question entry box 320 .
- the client is provided with helpful hints, guidelines, and examples. These helpful hints and guidelines are typically provided through the use of suggested question types that are frequently used in the field of market research. For example, in defining the survey the client may be provided with hints and guidelines for the phrasing of questions to limit bias and minimize the risk of offending network users, the proper ordering of questions to create a logical and easy-to-answer survey, etc.
- the client By selecting a particular question type button, the client begins the question definition process. For example, in certain embodiments when the client selects the question type button 308 (question type of “Agreement”), the client is presented with the introductory phrase:
- the client may then enter text to complete the question as desired.
- the client has the option to overwrite the entire introductory phrase to create their own custom question.
- the client After the client has completed the question, they are then presented with appropriate responses relevant to the selected question type. For example, in selecting the response button 308 for the response type “Agreement,” the client is presented with the following default responses:
- the client can add, delete, or change one or more of the default responses associated with a particular question type as deemed appropriate by the client. For example, the client may decide to change the response (iii) from “Neither Agree nor Disagree” to “Neutral,” or simply delete the response (vi) “Don't Know.”
- clients can select the structure and presentation of questions to network users.
- Box 322 enables the client to interact with the interface to create a single question or a “table” of questions. If the client enters a value of 1 for “Number of Items” in box 322 , a single question is created. For example, if the client selects the question type of “Agreement” and enters a value of 1 in box 324 , the following question can be generated.
- a “table” with the specified number of items can be created and presented to network users. For example, if the client entered a value of 4 in box 322 , the following table can produced. Using the scale to the right, please indicate how strongly you agree Neither agree or disagree with the following Strongly Agree nor Strongly statements: I enjoy Agree Agree Disagree Disagree Disagree Reading ⁇ ⁇ ⁇ ⁇ ⁇ Sleeping ⁇ ⁇ ⁇ ⁇ ⁇ Working ⁇ ⁇ ⁇ ⁇ ⁇ Exercising ⁇ ⁇ ⁇ ⁇ ⁇ ⁇
- Tables enable network users to efficiently review and answer multiple items, reducing the amount of time and effort required to complete a set of questions or survey.
- clients may choose the presentation format of a question. For example, selecting a value of “Radio Button” in box 324 , the following question format is presented to the network user.
- the client may include “branching” in defining the survey.
- branching in the survey allows for a different survey question to be presented based on previous response(s).
- FIG. 4 illustrates example questions ( 402 , 406 , 410 and 414 ) that are associated with responses ( 404 , 408 , 412 and 416 ) respectively.
- branching if in responding to question 402 a network user taking the survey selects the response option of “I do not read any newspapers” in response 404 , then network user may next be presented with question 410 and with response 412 . However, if the network user selects a response other than “I do not read any newspapers” then the network user may instead be presented with question 406 and response 408 .
- the client has the option of editing, changing, adding, deleting, or reordering any of the previously entered questions, question types, or responses. Reordering enables the client to alter the sequence of questions within the survey, potentially providing a more logical flow within the survey or improving the quality of data provided by network users to eliminate bias or other influences that may adversely affect the survey results.
- Clients have the ability to add multiple questions, one after the other, to define the survey.
- a “View Survey” option is contained on an interface that is provided to the client which allows the client to view how the completed survey will appear to a network user.
- the client can include graphical representations in defining the survey.
- the client may include pictures, drawings, sound, and animations.
- clients may include sound, video, or other “objects” that may engage network users or facilitate communication and interaction with network users.
- Clients may develop and save multiple surveys. Each survey may be identified and named by the client. The definition and content of each survey may be maintained persistently across client invocations or log-ins. Furthermore, existing surveys or parts of surveys may be copied, renamed, or modified to create new surveys-expediting the survey development process for experienced clients.
- a target group of network users must be selected for fielding the survey.
- the client is provided with a list of predefined target or network user groups.
- a list of predefined target groups may include:
- demographic, lifestyle, behavioral, and interest groups are provided to clients for selection and survey targeting.
- Clients may also define their own target group or select a representative sample from a myriad of populations.
- the client For the survey to be fielded, the client must specify the number of completed surveys they require (i.e. the number of network users who complete the survey) and the timeframe for obtaining those completed surveys. In certain embodiments, the client is provided with a default or suggested number of completed surveys and timeframes. In one embodiment, the default or suggested number of completed surveys is based on the number of completed surveys that is typically requested or required in the field of market research.
- the client is able to define a particular duration that the survey is to be “in the field.” For example, the client may specify that the survey is to be fielded for two weeks. In another embodiment, the client may use a combination of completed surveys and duration to define how long the survey is to field. For example, the client may request that the survey field for six months or until 10,000 responses are received.
- the interface allows the client to specify an address for receiving the survey data.
- the survey data may be provided to the client in a variety of formats.
- the survey data is provided to the client as a comma separated value file (CSVF) that is attached to an e-mail message and sent over the network system to the specified email addressee.
- CSVF comma separated value file
- the survey results are provided to the client in spreadsheet formats that include automated data processing, analyzing, and charting scripts, software, or computer instructions.
- the client is provided with or allowed to access real-time results (i.e. information about the completed surveys received thus far).
- real-time survey data is posted on a site connected to the network system that is accessible by the client.
- FIG. 5 illustrates sample interface 500 that may be presented to a client.
- interface 500 contains a survey price field 502 which indicates the price of the survey as currently defined.
- Interface 500 also contains a change question button 504 , a change target button 506 , a change complete button 508 and a survey wizard button 510 .
- the change button 504 By selecting the change button 504 , the client is presented with an interface that allows them to add, delete and modify questions that are used in defining the survey.
- Selecting the change button 506 provides the client with an interface that allows them to change or modify the target group that has been associated with the survey.
- Selecting the change complete button 508 provides the client with an interface that allows them to change the number of completed surveys previously requested by the client.
- Selecting the survey wizard button 510 provides the client with a guided, step-by-step sequence that can be used to create a survey.
- the interface provides the client with the ability to securely enter payment information. Once the client defines the survey, selects a target group and determines the number of completed surveys and/or a duration for fielding the survey, a survey price is calculated and provided to the client through the interface.
- a client accepts the price of the survey, the client selects a “pay for survey” button and enters pertinent payment information. For example, when a client chooses to proceed with the survey, an interface is provided to the client allowing the client to select a particular form of payment (i.e. credit card, debt card, etc.). In certain embodiments, a client is allowed to enter a customer account number that corresponds to an account or credit line that was previously established.
- the automatic survey mechanism Prior to launching a survey, the automatic survey mechanism has the ability to review and screen surveys to ensure their appropriateness for fielding to network users.
- an automated review of the survey is conducted by comparing components of the survey with a database of prohibited words, phrases, pictures, sounds, or themes.
- surveys are automatically provided to an individual who is responsible for reviewing the appropriateness of the survey contents. Once a survey is approved, banners are launched and the survey is fielded.
- the automated survey mechanism determines the particular location (controlled by the automated survey system) where the survey will reside on the network. The automated survey mechanism then generates a survey based on the information (survey definition) supplied by the client and places it at the identified location.
- the generated survey consists of one or more HTML pages that are accessible over the Internet or Intranets to network users wanting to take the survey.
- the automated survey mechanism In addition to generating and storing the survey, the automated survey mechanism generates response validation rules that are automatically enforced. These rules provide a mechanism for validating the responses from network users input as they participate in a survey.
- the response validation rules are linked to the survey to ensure the data provided by a network user is logically valid and consistent with questions in the survey.
- the response validation rules can be used to increase the quality of the survey data that is provided to the client.
- errors or logical inconsistencies that are identified are reported to the network user thus enabling them to take correct action (i.e. enter valid information).
- the automated survey mechanism identifies and designates a specific storage unit for storing survey results.
- a storage unit is linked to each survey and is used to automatically capture survey results from network users who participate in the survey.
- a unique storage unit is used to store the results for a particular survey. For example, when a survey is generated, a unique storage unit is identified and attached to the survey such that the results from a network user completing the survey are automatically stored into the unique storage unit.
- the storage unit is a database that can be used to store the survey results that were generated by participating network users.
- the automated survey mechanism causes a banner or other recruitment device to be placed, launched, or made available for viewing on a one or more sites on the network system.
- the particular sites for viewing a banner associated with a particular survey are selected based on the target group information that was previously supplied by the client. For example, if the client specified that the target group for a particular survey would be kids 13-18 years of age, then sites associated with this target group are selected as banner locations for the particular survey.
- the automated survey mechanism maintains a static mapping between banner locations and targeted groups.
- the automated survey mechanism uses this static mapping to identify one or more locations for launching a banner on the network system.
- a static mapping may exist between a target group of kids 13-18 years of age and specific portions of the Yahoo! site or other “kid-related” locations. Based on this static mapping, those specific portions of the Yahoo! site may be selected as banner locations for a survey targeted for kids 13-18 years of age.
- a dynamic mapping between target groups and network users is performed by (1) acquiring data that identifies a network user (i.e., name, social security number, etc.), (2) locating within an information repository or database prior information that was obtain about the network user, (3) determining a target group to which the network user belongs based on the information in the repository, and (4) delivering to the network user a Web page that has a banner for a survey targeted to a group to which the network user belongs.
- a network user i.e., name, social security number, etc.
- the request may contain data (e.g. from a cookie) that identifies the user as John Smith.
- the host or a process that is linked to the Web page may respond by searching a database for previously gathered information about John Smith. Assume that the database contains information indicating that John Smith is male and 47 years old. Based on this information, it is determined that John Smith falls into the target group of a survey for men over the age of 45. Therefore, a banner for that particular survey is placed in the Web page that is returned to John Smith in response to his request.
- Banners can either be statically or dynamically created.
- the automatic survey mechanism dynamically creates a particular banner using the target group information that was supplied by the client while defining the survey.
- the automated survey mechanism then requests the owner of the identified site(s) to launch the dynamically created banner.
- the automated survey mechanism causes a static or predefined banner to be launched at the identified site(s).
- the static or predefined banner may be maintained by either the site owner(s) or by the automatic survey mechanism.
- banners are launched by sending a message to the owner or representative of the identified site(s), requesting that a banner be launched.
- Each banner that is launched contains a reference (e.g. hypertext link) to a corresponding survey.
- a reference e.g. hypertext link
- network users are automatically presented with a corresponding survey.
- a network user may be presented with the sample survey as previously described in FIG. 4.
- network users are requested to enter information about themselves (i.e., age, occupation, etc.) within the banner or recruiting document itself.
- a survey is dynamically identified and presented to the network user.
- an appropriate survey can be presented to the network user, thus potentially increasing the efficiency of the overall system. For example, if a network user “Tom” selects a particular banner, Tom is prompted to enter certain information about himself (i.e. age and gender). If Tom enters an age of 25 and a gender of male, he is requested to complete a survey that requires males that are 25 or older.
- banners for a survey that correspond to a specific target group are placed on a general-purpose site (i.e. Yahoo!, AOL, Excite, USA Today, etc.). These banners contain information that specifies the desired target group of network users that are requested to complete the survey. (e.g. “if you are a male over 45, click here”)
- the banner contains information that attempts to attract users of the network system to participate in the survey. For example, a particular banner may state that by participating in the survey, network users are automatically entered into a drawing or sweepstakes for a vacation to Hawaii. Similarly, the banner may also state that network users who complete the survey may receive cash or other forms of incentives.
- the network user may be required to enter certain pertinent information (participant information). For example, if a banner offers Internet account credits for completing a survey, the network user may be required to provide their Internet account number so that they may be credited for participating in the survey.
- the automatic survey mechanism attempts to prohibit network users from participating in a particular survey multiple times.
- the automatic survey mechanism uses cookie information to identify computers that were previously used to complete a particular survey. For example, when a network user completes a survey, cookie information is stored on the computer that identifies the computer as one that has previously been used to participate in the particular survey. Thereafter, when a network user attempts to participate in a particular survey using the same computer, the network user is denied access to the survey.
- the automatic survey mechanism maintains previously entered participant information that can be used to identify network users who have previously completed a particular survey.
- a counter for that particular survey is incremented. If the counter for the survey equals the number of responses requested by the client, the owner of the site on which the banner was launched is notified that the banner should be removed.
- the results are then processed and analyzed to generate survey data and charts reflecting the gathered survey results. Processing and analysis of the collected data may include, for example, the extraction of the survey data from the database and the creation of cross-tabulations and graphical charts. Once the processing is complete, the survey data is sent to the address that was previously specified by the client while defining the survey.
- survey results are analyzed on a periodic basis to generate real-time survey data.
- the automated survey mechanism generates real-time survey data by causing the survey results for a particular survey to be analyzed on a daily basis.
- the real-time survey data is then posted at a particular site on the network that can be accessed by the client. This allows the client to obtain survey data while the survey is still being fielded to users of the network system.
- FIG. 6 illustrates a flow diagram for automating a survey over a network in accordance with an embodiment of the invention.
- an automatic survey system generates interface data that defines an interface.
- the automatic survey system then causes the interface to be displayed on a client's display unit.
- the client interacts with the interface to define a survey. By interacting with the interface, the client can define questions, select responses, edit, reorder, and view the survey.
- the client selects a target group of network users who are to take and complete the survey. During this step, the client also specifies the number of desired completed surveys and/or the duration the survey is to field.
- the client interacts with the interface to identify the price of the survey based upon the parameters provided by the client in previous steps.
- the client has the capability of returning to steps 602 through 606 to modify the requested survey parameters to produce a survey price that is acceptable to the client.
- the client uses the interface to provide an address to define where the survey results are to be delivered.
- the client uses the interface to securely provide billing information and to provide final approval to proceed with survey fielding.
- the survey created by the client is reviewed and screened for propriety.
- the automated survey system generates a survey based on the parameters and data provided by the client.
- response validation rules and insertion commands are created and attached to the survey.
- an information repository such as a database is created to store survey results from network users.
- quotas or the number of completed surveys requested by the client are attached to the database.
- the automatic survey mechanism then fields the survey by causing one or more banners to be launched, activated, or displayed on one or more sites on the network system.
- step 622 survey responses from network users participating in the survey are captured and inserted into the information repository or storage unit.
- step 624 compensation or incentives are managed for network users who complete the survey.
- the banners are removed from the sites on the network system once the number of desired completed surveys has been achieved.
- the automatic survey system sends messages to all appropriate sites indicating the banner should no longer be displayed.
- the survey results provided by network users are extracted from the storage device.
- the extracted survey results are processed, analyzed, and formatted using common file formats.
- graphical representations of the survey results are generated and inserted into the survey data file.
- the file containing the results of the survey are sent to the address that was previously provided by the client.
- a receipt confirmation is received from the client indicating the file containing the survey results has been received.
Abstract
A method and apparatus for automating surveys over a network system causes an interface to be displayed to a particular client of the network system. This interface can be used by the particular client to define a survey. In response to the client interacting with the interface, a sequence of steps is automatically performed. The sequence of steps includes generating a survey based on information received over the network system from the particular client interacting with the interface; fielding the survey to a group of target users on the network system; gathering results of from network users participating in the survey; and providing the particular client, over said network system, with data that reflects the results of the survey.
Description
- This application is a continuation of prior patent application Ser. No. 09/439,382, filed by Charles B. Hamlin and Leroy Smith, Jr., on Nov. 15, 1999, entitled “Method and Apparatus for Automating the Conduct of Surveys over a Network System,” which is a continuation of prior patent application Ser. No. 09/034,774, filed by Charles B. Hamlin and Leroy Smith, Jr., on Mar. 2, 1998, entitled “Method and Apparatus for Automating the Conduct of Surveys over a Network System,” which are hereby incorporated by reference in their entirety.
- The present invention relates to a method and apparatus for automating the conduct of surveys over a network system.
- Before proceeding with a particular product, service, strategy, or tactic, it is often desirable to obtain information about the behaviors, opinions, and attitudes of the marketplace. These data will often help predict if potential customers will be interested in acquiring the product or service or how they may react to a given strategy or tactic.
- Research plays an important role in understanding the current and future wants, needs, and behaviors of the marketplace. It is often applied in business-to-business and business-to-consumer applications. As a result, many companies invest a significant amount of money, time, and resources in market research programs.
- Typically, if someone (a “client”) requires a better understanding of the market place, they will obtain information using an in-house market research department, an out-of-house third party market research firm, or both.
- To obtain the requested information, individuals within research groups typically perform a series of linked steps. For example, these steps may include:
- (1) working with the client to define the problem;
- (2) designing a research instrument (i.e. a survey);
- (3) creating the research instrument (writing/producing the survey);
- (4) fielding the instrument using mail, telephone, in-person or Internet-based media;
- (5) processing the data obtained and analyzing the results; and
- (6) generating a report of findings for the client.
- In defining the business problem, a client generally specifies a set of parameters that defines the information the client needs to know, a particular target group of interest, a time frame, and a cost for the conduct of the research. For example, a client may want to know within three weeks, the flavor of toothpaste that is most liked by kids between the ages of six and thirteen.
- Understanding the needs of the client, the market research professional or company develops a research solution to obtain the necessary information within the client's given constraints. The research solution typically involves a series of steps that may include creating a survey instruments and fielding to several hundred people by phone or mail to better understand the needs, behaviors, attitudes and opinions of the client's targeted group.
- In general, market research is conducted using one or more of the following communication media:
- (1) Mail
- (2) Telephone
- (3) In-person
- (4) Networks including the Internet, e-mail and the World Wide Web
- Using the first method, the research group mails surveys to a predetermined number of people who fall within the target group. This method of surveying includes such steps as printing surveys, addressing envelopes, stuffing envelopes with the survey, depositing surveys into a mail system, and then waiting for the target group to mail back responses. Once the responses are received, they are processed, coded, and entered into a computer to be analyzed. The analyzed data is then interpreted and reported back to the client.
- A drawback associated with conducting research using mail is that it generally takes eight to twelve weeks from the time a project is initiated to its completion. In many cases, this delay is prohibitively long and unacceptable in today's competitive market where business decisions often have to be made in days—not weeks. In addition, the cost of producing, printing, and mailing surveys as well as analyzing the results of the survey can impose a substantial financial burden on many clients.
- One approach to reducing the excessive delays that are inherent with mail surveys is to conduct surveys using telephone services. Conducting surveys via the telephone service minimizes the delays associated with mail, but the cost of hiring quality interviewers makes telephone surveying very expensive, thus imposing a substantial financial burden on many clients.
- A third medium used for collecting survey data is in-person interviewing. As with telephone, the cost of in-person interviewing can be extremely costly, thus imposing an even higher financial burden on many clients.
- A fourth and emerging medium for conducting research is the Internet and other networks. While they offer advantages of speed and lower costs, they reach a small percentage of the consumer and business public (approximately 25% of households and 30% of business) making it difficult to cost effectively find and interview targeted consumers and customers.
- Finally, the time and cost of conducting research are often increased by the number of people and steps involved in the traditional research processes. Clients must often work through time consuming and expensive research bureaucracies; engage outside specialists or resources; find targeted respondents; and then wait for surveys to be created, fielded, and processed. The long sought after ideal of having business decision makers be in close and timely contact with their markets is thwarted by traditional systems, methods, organizations and norms.
- It is clearly desirable to provide mechanisms and processes that decision makers and researchers alike can use to both quickly and economically reach out and understand the behaviors, opinions and attitudes of consumers and customers in today's competitive and fast moving market place.
- According to one aspect of the invention, a method and apparatus for automating the conduct of surveys over a network system is provided.
- According to the method, an automated survey mechanism causes an interface to be displayed to a client which allows the particular client to define a survey. In response to the client interacting with the interface, a sequence of steps is automatically performed. The sequence of steps includes generating a survey based on information received over said network system from said interface; fielding the survey to a group of target users on the network system; gathering results of the survey; and providing the particular client with data that reflects the results over said network system.
- The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings in which like reference numerals refer to similar elements and in which:
- FIG. 1 is a block diagram of a computer system upon which an embodiment of the invention may be implemented;
- FIG. 2A is a block diagram of a computer system context;
- FIG. 2B is an example of a top-level interface page in accordance with the present invention;
- FIG. 3 is an example of an interface page that can be used by the user to generate questions and responses in defining a survey;
- FIG. 4 is an example of different response types that may be associated with a particular question in accordance with the present invention; and
- FIG. 5 is an example of the real-time pricing capability associated with the invention.
- FIG. 6 illustrates a flow diagram for automating a survey over a network system in accordance with the present invention.
- A method and apparatus for automating surveys over a network system is described. In the following description, for the purposes of explanation, numerous specific details are set forth to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form to avoid unnecessarily obscuring the present invention.
- FIG. 1 is a block diagram that illustrates a
computer system 100 upon which an embodiment of the invention may be implemented.Computer system 100 includes abus 102 or other communication mechanism for communicating information, and aprocessor 104 coupled withbus 102 for processing information.Computer system 100 also includes amain memory 106, such as a random access memory (RAM) or other dynamic storage device, coupled tobus 102 for storing information and instructions to be executed byprocessor 104.Main memory 106 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed byprocessor 104.Computer system 100 further includes a read only memory (ROM) 108 or other static storage device coupled tobus 102 for storing static information and instructions forprocessor 104. Astorage device 110, such as a magnetic disk or optical disk, is provided and coupled tobus 102 for storing information and instructions. -
Computer system 100 may be coupled viabus 102 to adisplay 112, such as a cathode ray tube (CRT), for displaying information to a computer user. Aninput device 114, including alphanumeric and other keys, is coupled tobus 102 for communicating information and command selections toprocessor 104. Another type of user input device iscursor control 116, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections toprocessor 104 and for controlling cursor movement ondisplay 112. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane. - The invention is related to the use of
computer system 100 for automating surveys over a network system. According to one embodiment of the invention, the automation of surveys over a network system is provided bycomputer system 100 in response toprocessor 104 executing one or more sequences of one or more instructions contained inmain memory 106. Such instructions may be read intomain memory 106 from another computer-readable medium, such asstorage device 110. Execution of the sequences of instructions contained inmain memory 106 causesprocessor 104 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software. - The term “computer-readable medium” as used herein refers to any medium that participates in providing instructions to
processor 104 for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such asstorage device 110. Volatile media includes dynamic memory, such asmain memory 106. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprisebus 102. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. - Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to
processor 104 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local tocomputer system 100 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data onbus 102.Bus 102 carries the data tomain memory 106, from whichprocessor 104 retrieves and executes the instructions. The instructions received bymain memory 106 may optionally be stored onstorage device 110 either before or after execution byprocessor 104. -
Computer system 100 also includes acommunication interface 118 coupled tobus 102.Communication interface 118 provides a two-way data communication coupling to anetwork link 120 that is connected to alocal network 122. For example,communication interface 118 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example,communication interface 118 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation,communication interface 118 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information. - Network link120 typically provides data communication through one or more networks to other data devices. For example,
network link 120 may provide a connection throughlocal network 122 to ahost computer 124 or to data equipment operated by an Internet Service Provider (ISP) 126.ISP 126 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 128.Local network 122 andInternet 128 both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals onnetwork link 120 and throughcommunication interface 118, which carry the digital data to and fromcomputer system 100, are exemplary forms of carrier waves transporting the information. -
Computer system 100 can send messages and receive data, including program code, through the network(s),network link 120 andcommunication interface 118. In the Internet example, aserver 130 might transmit a requested code for an application program throughInternet 128,ISP 126,local network 122 andcommunication interface 118. In accordance with the invention, one such downloaded application provides for automating surveys over the network system as described herein. - The received code may be executed by
processor 104 as it is received, and/or stored instorage device 110, or other non-volatile storage for later execution. In this manner,computer system 100 may obtain application code in the form of a carrier wave. - Functional Overview
- In accordance with the present invention, an automated survey mechanism provides an interface that enables a client to define, target, field, and receive results from a particular survey. This interface typically consists of one or more individual interfaces that are provided to the client over the network system. In certain embodiments, the interfaces are provided using HTML page formats and are provided to the client via the Internet or other networks. In certain embodiments, the interface is presented to the client via Java Script, Applets, Word processors, or other software programs. By interacting with the interface, the client has the ability to define a particular survey, select the target audience for the survey, learn the price of the survey, and define other pertinent parameters. Once completed, the survey is automatically created and fielded to a particular group of network users (target group or respondents) who are connected to the network system. Results from the survey are quickly and automatically gathered as network users (or respondents) complete the survey. The gathered results are automatically processed, analyzed, and data and charts that reflect the survey results are sent to the client.
- FIG. 2A illustrates in block form an example of the parties and systems involved in this context. In FIG. 2A, a
client 280 is coupled either directly or indirectly to theInternet 252. For example, aclient 280 may be connected toInternet 252 through a local area network, an Internet Service Provider, an Online Service Provider such as AOL, a proprietary server, or any combination thereof. Theuser client 280, and the other clients referenced in this description, are end station devices such as a personal computer, workstation, network computer, etc. In the preferred embodiment, theclient 280 and other clients have a processor that executes an operating system and a browser program under control of the operating system. The browser program is an industry-standard World Wide Web browser, such as Microsoft Internet Explorer®, Netscape Navigator® or NCSA Mosaic. - Connected to the
Internet 252 is a plurality ofnetwork user clients network user clients Internet 252. - Through
Internet 318,user client 280 andnetwork user clients survey conductor server 254. Preferably,client 280 andnetwork user clients survey conductor server 254 using industry-standard protocols such as Transmission Control Protocol (TCP), Internet Protocol (IP), and Hypertext Transfer Protocol (HTTP). - The
survey conductor server 254 contains asurvey builder 294, a storage unit 296 and a plurality ofsurveys Survey builder 294 contains interface data that defines an interface that can be used to create a survey. For example, if a client requests to define a survey, thesurvey builder 294 automatically sends interface data overInternet 252 to cause an interface to be displayed on the browser executing onuser client 280. The client then interacts with the interface to create a survey. The plurality ofsurveys survey builder 294.Storage unit 256 is used to store survey results. As network users participate in the surveys, the results are automatically stored in the storage unit 296. - Also coupled to
Internet 252 are network severs 262, 264 and 266 each respectively storing data that defines a set ofWeb pages Web pages Web pages banners banners surveys - Defining a Survey
- When a client requests a survey be built, the client is provided with interface data that causes an interface to be displayed on the client's display unit (i.e. computer monitor, television set, etc.). Various mechanisms may be used to present the interface to the client. For example, the client may execute a locally-stored program that generates the interface, or a dynamically delivered JAVA Applet that generates the interface. For the purpose of explanation, embodiments of the invention shall be described in which the interface is delivered to the client in the form of one or more HTML pages. However, the present invention is not limited to any particular mechanism for presenting the interface to the user.
- Once the client is presented with the interface, the client may interact with the interface to perform the steps of:
- (1) defining a survey
- (2) identifying a target group of network users or respondents for fielding the survey, the number of required responses, and the timeframe for their response);
- (3) calculating the price for the survey;
- (4) indicating where the survey result data is to be sent;
- (5) confirming the request and entering pertinent payment information.
- FIG. 2B illustrates an example of a top-
level interface page 200 in accordance with an embodiment of the present invention. As depicted in FIG. 2B, the top-level interface contains sixbuttons button 202 causes an interface to be displayed that allows the client to enter/select questions and responses for defining a survey; selectingbutton 204 causes an interface to be displayed that allows the client to select a particular target group or respondents for fielding the survey; selectingbutton 206 causes the price of the survey to be displayed to the client, facilitating the alteration of study and pricing parameters; selectingbutton 208 causes an interface to be displayed that allows the client to enter a destination to which the results of the survey are to be sent; selectingbutton 210 causes an interface to be displayed that allows the client to enter payment information for the automated processing of the survey as defined; and selecting button 212 enables the user to execute a process that “walks” clients through the interfaces so that they may easily use the automated survey mechanism. - FIG. 3 illustrates an example of an
interface 300 that is displayed when the client selectsbutton 202, in accordance with an embodiment of the invention. In this example,interface 300 includes aquestion entry box 320 that allows a client to complete a phrase or enter a question that is to be used in defining a survey. Also included ininterface 300 are exemplary response buttons 302-318. The response buttons 302-318 correspond to a particular question type that may be selected for the question that is entered inquestion entry box 320. - To aid the client in developing questions (i.e., choose the appropriate question type for the particular issue to be addressed, etc.), the client is provided with helpful hints, guidelines, and examples. These helpful hints and guidelines are typically provided through the use of suggested question types that are frequently used in the field of market research. For example, in defining the survey the client may be provided with hints and guidelines for the phrasing of questions to limit bias and minimize the risk of offending network users, the proper ordering of questions to create a logical and easy-to-answer survey, etc.
- By selecting a particular question type button, the client begins the question definition process. For example, in certain embodiments when the client selects the question type button308 (question type of “Agreement”), the client is presented with the introductory phrase:
- “Using the scale below, please indicate how strongly you agree or disagree with the following statement: . . . ”
- The client may then enter text to complete the question as desired. In certain embodiments, the client has the option to overwrite the entire introductory phrase to create their own custom question.
- After the client has completed the question, they are then presented with appropriate responses relevant to the selected question type. For example, in selecting the
response button 308 for the response type “Agreement,” the client is presented with the following default responses: - (i) Strongly Agree
- (ii) Agree
- (iii) Neither Agree nor Disagree
- (iv) Disagree
- (v) Strongly Disagree
- (vi) Don't Know
- In certain embodiments, the client can add, delete, or change one or more of the default responses associated with a particular question type as deemed appropriate by the client. For example, the client may decide to change the response (iii) from “Neither Agree nor Disagree” to “Neutral,” or simply delete the response (vi) “Don't Know.”
- In certain embodiments, clients can select the structure and presentation of questions to network users.
Box 322 enables the client to interact with the interface to create a single question or a “table” of questions. If the client enters a value of 1 for “Number of Items” inbox 322, a single question is created. For example, if the client selects the question type of “Agreement” and enters a value of 1 inbox 324, the following question can be generated. - Using the scale below, please indicate how strongly you agree or disagree with the following statement: I enjoy sports.
- Strongly Agree
- Agree
- Neither Agree nor Disagree
- Disagree
- Strongly Disagree
- If the client enters a value greater than 1 in
box 322, a “table” with the specified number of items can be created and presented to network users. For example, if the client entered a value of 4 inbox 322, the following table can produced.Using the scale to the right, please indicate how strongly you agree Neither agree or disagree with the following Strongly Agree nor Strongly statements: I enjoy Agree Agree Disagree Disagree Disagree Reading ◯ ◯ ◯ ◯ ◯ Sleeping ◯ ◯ ◯ ◯ ◯ Working ◯ ◯ ◯ ◯ ◯ Exercising ◯ ◯ ◯ ◯ ◯ - Tables enable network users to efficiently review and answer multiple items, reducing the amount of time and effort required to complete a set of questions or survey.
- By selecting the value in
box 324, clients may choose the presentation format of a question. For example, selecting a value of “Radio Button” inbox 324, the following question format is presented to the network user. - Using the scale below, do you enjoy reading?
- Yes
- No
- The same question is presented to network users in the following format if the client selected
box 324 to be “Drop Down.” -
- Enabling clients to select presentation formats makes surveys more versatile, user-friendly, and interesting for network users.
- In certain embodiments, the client may include “branching” in defining the survey. The inclusion of branching in the survey allows for a different survey question to be presented based on previous response(s). For example, FIG. 4 illustrates example questions (402, 406, 410 and 414) that are associated with responses (404, 408, 412 and 416) respectively. By including branching in the survey, if in responding to question 402 a network user taking the survey selects the response option of “I do not read any newspapers” in
response 404, then network user may next be presented withquestion 410 and withresponse 412. However, if the network user selects a response other than “I do not read any newspapers” then the network user may instead be presented withquestion 406 andresponse 408. - At any point while the client is defining the survey, the client has the option of editing, changing, adding, deleting, or reordering any of the previously entered questions, question types, or responses. Reordering enables the client to alter the sequence of questions within the survey, potentially providing a more logical flow within the survey or improving the quality of data provided by network users to eliminate bias or other influences that may adversely affect the survey results.
- Clients have the ability to add multiple questions, one after the other, to define the survey. To help the client correctly define the survey, a “View Survey” option is contained on an interface that is provided to the client which allows the client to view how the completed survey will appear to a network user. In certain embodiments, the client can include graphical representations in defining the survey. For example, to enhance the appearance of the survey, the client may include pictures, drawings, sound, and animations. In certain embodiments, clients may include sound, video, or other “objects” that may engage network users or facilitate communication and interaction with network users.
- Clients may develop and save multiple surveys. Each survey may be identified and named by the client. The definition and content of each survey may be maintained persistently across client invocations or log-ins. Furthermore, existing surveys or parts of surveys may be copied, renamed, or modified to create new surveys-expediting the survey development process for experienced clients.
- Selecting a Target Group
- Once the client is satisfied with the developed survey, a target group of network users must be selected for fielding the survey. In one embodiment, to aid the client in selecting the appropriate target group, the client is provided with a list of predefined target or network user groups. For example, a list of predefined target groups may include:
- (i) children between the ages of 13 and 16
- (ii) bicyclists
- (iii) women who are pregnant
- (iv) men over 45
- (v) people who own computers
- In addition to the above examples, demographic, lifestyle, behavioral, and interest groups are provided to clients for selection and survey targeting. Clients may also define their own target group or select a representative sample from a myriad of populations.
- For the survey to be fielded, the client must specify the number of completed surveys they require (i.e. the number of network users who complete the survey) and the timeframe for obtaining those completed surveys. In certain embodiments, the client is provided with a default or suggested number of completed surveys and timeframes. In one embodiment, the default or suggested number of completed surveys is based on the number of completed surveys that is typically requested or required in the field of market research.
- In certain embodiments, the client is able to define a particular duration that the survey is to be “in the field.” For example, the client may specify that the survey is to be fielded for two weeks. In another embodiment, the client may use a combination of completed surveys and duration to define how long the survey is to field. For example, the client may request that the survey field for six months or until 10,000 responses are received.
- As described in detail below, the number of completed surveys requested and/or the duration that the survey is required to field (among other factors), will typically affect the price of the survey.
- Providing Survey Result Data to the Client
- When a survey is fielded to a particular target group, the results are gathered, processed, and analyzed to generate survey data that reflects the survey results. To enable the delivery of the survey data, the interface allows the client to specify an address for receiving the survey data. Using the specified address, the survey data may be provided to the client in a variety of formats. For example, in certain embodiments the survey data is provided to the client as a comma separated value file (CSVF) that is attached to an e-mail message and sent over the network system to the specified email addressee. In another embodiment, the survey results are provided to the client in spreadsheet formats that include automated data processing, analyzing, and charting scripts, software, or computer instructions.
- In addition to delivering results, in certain embodiments, the client is provided with or allowed to access real-time results (i.e. information about the completed surveys received thus far). In one embodiment, real-time survey data is posted on a site connected to the network system that is accessible by the client.
- Pricing Information
- Prior to launching a survey, the client is presented with an interface indicating a price for fielding the survey and performing the requested service. Should the price be unacceptable, the client has the ability to iteratively alter the parameters of the survey to obtain an acceptable price. For example, FIG. 5 illustrates
sample interface 500 that may be presented to a client. In this example,interface 500 contains asurvey price field 502 which indicates the price of the survey as currently defined.Interface 500 also contains achange question button 504, achange target button 506, a changecomplete button 508 and asurvey wizard button 510. By selecting thechange button 504, the client is presented with an interface that allows them to add, delete and modify questions that are used in defining the survey. Selecting thechange button 506 provides the client with an interface that allows them to change or modify the target group that has been associated with the survey. Selecting the changecomplete button 508 provides the client with an interface that allows them to change the number of completed surveys previously requested by the client. Selecting thesurvey wizard button 510 provides the client with a guided, step-by-step sequence that can be used to create a survey. - Payment Information
- As previously stated, the interface provides the client with the ability to securely enter payment information. Once the client defines the survey, selects a target group and determines the number of completed surveys and/or a duration for fielding the survey, a survey price is calculated and provided to the client through the interface.
- Once a client accepts the price of the survey, the client selects a “pay for survey” button and enters pertinent payment information. For example, when a client chooses to proceed with the survey, an interface is provided to the client allowing the client to select a particular form of payment (i.e. credit card, debt card, etc.). In certain embodiments, a client is allowed to enter a customer account number that corresponds to an account or credit line that was previously established.
- Screening Requested Surveys
- Prior to launching a survey, the automatic survey mechanism has the ability to review and screen surveys to ensure their appropriateness for fielding to network users. In certain embodiments, an automated review of the survey is conducted by comparing components of the survey with a database of prohibited words, phrases, pictures, sounds, or themes. In one embodiment, surveys are automatically provided to an individual who is responsible for reviewing the appropriateness of the survey contents. Once a survey is approved, banners are launched and the survey is fielded.
- Generating the Survey
- After a client selects the pay button, enters valid payment information, and agrees to the terms and conditions associated with using the automatic survey mechanism, the automated survey mechanism determines the particular location (controlled by the automated survey system) where the survey will reside on the network. The automated survey mechanism then generates a survey based on the information (survey definition) supplied by the client and places it at the identified location. In certain embodiments, the generated survey consists of one or more HTML pages that are accessible over the Internet or Intranets to network users wanting to take the survey.
- In addition to generating and storing the survey, the automated survey mechanism generates response validation rules that are automatically enforced. These rules provide a mechanism for validating the responses from network users input as they participate in a survey. In certain embodiments, the response validation rules are linked to the survey to ensure the data provided by a network user is logically valid and consistent with questions in the survey. The response validation rules can be used to increase the quality of the survey data that is provided to the client. In certain embodiments, errors or logical inconsistencies that are identified are reported to the network user thus enabling them to take correct action (i.e. enter valid information).
- Additionally, the automated survey mechanism identifies and designates a specific storage unit for storing survey results. A storage unit is linked to each survey and is used to automatically capture survey results from network users who participate in the survey. In certain embodiments a unique storage unit is used to store the results for a particular survey. For example, when a survey is generated, a unique storage unit is identified and attached to the survey such that the results from a network user completing the survey are automatically stored into the unique storage unit. In certain embodiments, the storage unit is a database that can be used to store the survey results that were generated by participating network users.
- Fielding the Survey and Launching a Banner
- To attract network users of the desired target group to participate in the survey, the automated survey mechanism causes a banner or other recruitment device to be placed, launched, or made available for viewing on a one or more sites on the network system. In certain embodiments, the particular sites for viewing a banner associated with a particular survey are selected based on the target group information that was previously supplied by the client. For example, if the client specified that the target group for a particular survey would be kids 13-18 years of age, then sites associated with this target group are selected as banner locations for the particular survey.
- In one embodiment, the automated survey mechanism maintains a static mapping between banner locations and targeted groups. The automated survey mechanism uses this static mapping to identify one or more locations for launching a banner on the network system. For example, a static mapping may exist between a target group of kids 13-18 years of age and specific portions of the Yahoo! site or other “kid-related” locations. Based on this static mapping, those specific portions of the Yahoo! site may be selected as banner locations for a survey targeted for kids 13-18 years of age.
- In certain embodiments, a dynamic mapping between target groups and network users is performed by (1) acquiring data that identifies a network user (i.e., name, social security number, etc.), (2) locating within an information repository or database prior information that was obtain about the network user, (3) determining a target group to which the network user belongs based on the information in the repository, and (4) delivering to the network user a Web page that has a banner for a survey targeted to a group to which the network user belongs.
- For example, when a network user requests a Web page, the request may contain data (e.g. from a cookie) that identifies the user as John Smith. The host or a process that is linked to the Web page may respond by searching a database for previously gathered information about John Smith. Assume that the database contains information indicating that John Smith is male and 47 years old. Based on this information, it is determined that John Smith falls into the target group of a survey for men over the age of 45. Therefore, a banner for that particular survey is placed in the Web page that is returned to John Smith in response to his request.
- Banners can either be statically or dynamically created. In one embodiment, the automatic survey mechanism dynamically creates a particular banner using the target group information that was supplied by the client while defining the survey. The automated survey mechanism then requests the owner of the identified site(s) to launch the dynamically created banner.
- In one embodiment, the automated survey mechanism causes a static or predefined banner to be launched at the identified site(s). The static or predefined banner may be maintained by either the site owner(s) or by the automatic survey mechanism. In other embodiments, banners are launched by sending a message to the owner or representative of the identified site(s), requesting that a banner be launched.
- Each banner that is launched contains a reference (e.g. hypertext link) to a corresponding survey. Thus, by selecting a particular banner, network users are automatically presented with a corresponding survey. For example, by selecting a particular banner, a network user may be presented with the sample survey as previously described in FIG. 4.
- In certain embodiments, network users are requested to enter information about themselves (i.e., age, occupation, etc.) within the banner or recruiting document itself. Using this information, a survey is dynamically identified and presented to the network user. By dynamically identifying a particular survey based on the attributes of a network user, an appropriate survey can be presented to the network user, thus potentially increasing the efficiency of the overall system. For example, if a network user “Tom” selects a particular banner, Tom is prompted to enter certain information about himself (i.e. age and gender). If Tom enters an age of 25 and a gender of male, he is requested to complete a survey that requires males that are 25 or older.
- In certain embodiments, banners for a survey that correspond to a specific target group are placed on a general-purpose site (i.e. Yahoo!, AOL, Excite, USA Today, etc.). These banners contain information that specifies the desired target group of network users that are requested to complete the survey. (e.g. “if you are a male over 45, click here”)
- In certain embodiments, the banner contains information that attempts to attract users of the network system to participate in the survey. For example, a particular banner may state that by participating in the survey, network users are automatically entered into a drawing or sweepstakes for a vacation to Hawaii. Similarly, the banner may also state that network users who complete the survey may receive cash or other forms of incentives.
- To reward a network user for completing a survey, the network user may be required to enter certain pertinent information (participant information). For example, if a banner offers Internet account credits for completing a survey, the network user may be required to provide their Internet account number so that they may be credited for participating in the survey.
- Because meaningful survey results typically require opinions from a non-biased population, the automatic survey mechanism attempts to prohibit network users from participating in a particular survey multiple times. In one embodiment, the automatic survey mechanism uses cookie information to identify computers that were previously used to complete a particular survey. For example, when a network user completes a survey, cookie information is stored on the computer that identifies the computer as one that has previously been used to participate in the particular survey. Thereafter, when a network user attempts to participate in a particular survey using the same computer, the network user is denied access to the survey. In an alternative embodiment, the automatic survey mechanism maintains previously entered participant information that can be used to identify network users who have previously completed a particular survey.
- After the required number of completed surveys is obtained, or the duration for fielding the survey has expired, access to the survey is disabled. The owners of the sites where the corresponding banner was launched are notified that the banner should be removed. Upon receiving the notice, the owner removes the banner from the site or prevents the banner from being displayed, thus eliminating access to the survey by network users.
- Gathering and Analyzing Survey Results
- After a banner is launched, network users may click on the banner to participate in the survey. When a network user completes a survey, the results are automatically sent over the network system where they are validated and stored in a corresponding storage unit (e.g. database) using the validation and insertion commands that are attached to the survey.
- After each response for a particular survey is inserted into the appropriate database, a counter for that particular survey is incremented. If the counter for the survey equals the number of responses requested by the client, the owner of the site on which the banner was launched is notified that the banner should be removed. The results are then processed and analyzed to generate survey data and charts reflecting the gathered survey results. Processing and analysis of the collected data may include, for example, the extraction of the survey data from the database and the creation of cross-tabulations and graphical charts. Once the processing is complete, the survey data is sent to the address that was previously specified by the client while defining the survey.
- In certain embodiments, survey results are analyzed on a periodic basis to generate real-time survey data. For example, in one embodiment, the automated survey mechanism generates real-time survey data by causing the survey results for a particular survey to be analyzed on a daily basis. The real-time survey data is then posted at a particular site on the network that can be accessed by the client. This allows the client to obtain survey data while the survey is still being fielded to users of the network system.
- The Automated Survey Process
- FIG. 6 illustrates a flow diagram for automating a survey over a network in accordance with an embodiment of the invention. At
step 602, an automatic survey system generates interface data that defines an interface. The automatic survey system then causes the interface to be displayed on a client's display unit. Atstep 604, the client interacts with the interface to define a survey. By interacting with the interface, the client can define questions, select responses, edit, reorder, and view the survey. - At
step 606, the client selects a target group of network users who are to take and complete the survey. During this step, the client also specifies the number of desired completed surveys and/or the duration the survey is to field. At step 608, the client interacts with the interface to identify the price of the survey based upon the parameters provided by the client in previous steps. At step 608, the client has the capability of returning tosteps 602 through 606 to modify the requested survey parameters to produce a survey price that is acceptable to the client. - At
step 610, the client uses the interface to provide an address to define where the survey results are to be delivered. Atstep 612, the client uses the interface to securely provide billing information and to provide final approval to proceed with survey fielding. - At step614, the survey created by the client is reviewed and screened for propriety. At
step 616, the automated survey system generates a survey based on the parameters and data provided by the client. At this step, response validation rules and insertion commands are created and attached to the survey. At step 618, an information repository such as a database is created to store survey results from network users. - At
step 620, quotas or the number of completed surveys requested by the client are attached to the database. The automatic survey mechanism then fields the survey by causing one or more banners to be launched, activated, or displayed on one or more sites on the network system. - At
step 622, survey responses from network users participating in the survey are captured and inserted into the information repository or storage unit. Atstep 624, compensation or incentives are managed for network users who complete the survey. - At
step 626, the banners are removed from the sites on the network system once the number of desired completed surveys has been achieved. At this step, the automatic survey system sends messages to all appropriate sites indicating the banner should no longer be displayed. - At
step 628, the survey results provided by network users are extracted from the storage device. Atstep 630, the extracted survey results are processed, analyzed, and formatted using common file formats. Atstep 632, graphical representations of the survey results are generated and inserted into the survey data file. - At
step 634, the file containing the results of the survey are sent to the address that was previously provided by the client. Atstep 636, a receipt confirmation is received from the client indicating the file containing the survey results has been received. - In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (8)
1. A method for assigning a survey to a respondent, the method comprising the steps of:
an automated survey mechanism generating a set of one or more screening questions;
receiving input data at the automated survey mechanism in response to said respondent answering said set of one or more screening questions; and
the automated survey mechanism selecting a particular survey from a plurality of surveys to present to said respondent based on how said respondent answered said set of one or more screening questions.
2. The method of claim 1 , further comprising the steps of:
receiving a request to participate in a survey; and
generating said set of one or more screening questions in response to receiving said request.
3. The method of claim 1 , wherein the step of generating a set of one or more screening questions comprises the step of generating said set of one or more screening questions based on target participation criteria that is associated with one or more active surveys.
4. The method of claim 1 , further comprising the steps the automated survey mechanism sending the set of one or more screening questions to the respondent over a network, wherein the step of receiving input data includes receiving input data over the network.
5. A computer-readable medium carrying one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform the method recited in claim 1 .
6. A computer-readable medium carrying one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform the method recited in claim 2 .
7. A computer-readable medium carrying one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform the method recited in claim 3 .
8. A computer-readable medium carrying one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform the method recited in claim 4.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/818,796 US20040193479A1 (en) | 1998-03-02 | 2004-04-05 | Method and apparatus for automating the conduct of surveys over a network system |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/034,774 US6477504B1 (en) | 1998-03-02 | 1998-03-02 | Method and apparatus for automating the conduct of surveys over a network system |
US09/439,382 US6754635B1 (en) | 1998-03-02 | 1999-11-15 | Method and apparatus for automating the conduct of surveys over a network system |
US10/818,796 US20040193479A1 (en) | 1998-03-02 | 2004-04-05 | Method and apparatus for automating the conduct of surveys over a network system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/439,382 Continuation US6754635B1 (en) | 1998-03-02 | 1999-11-15 | Method and apparatus for automating the conduct of surveys over a network system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040193479A1 true US20040193479A1 (en) | 2004-09-30 |
Family
ID=21878519
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/034,774 Expired - Lifetime US6477504B1 (en) | 1998-03-02 | 1998-03-02 | Method and apparatus for automating the conduct of surveys over a network system |
US09/439,382 Expired - Lifetime US6754635B1 (en) | 1998-03-02 | 1999-11-15 | Method and apparatus for automating the conduct of surveys over a network system |
US10/818,796 Abandoned US20040193479A1 (en) | 1998-03-02 | 2004-04-05 | Method and apparatus for automating the conduct of surveys over a network system |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/034,774 Expired - Lifetime US6477504B1 (en) | 1998-03-02 | 1998-03-02 | Method and apparatus for automating the conduct of surveys over a network system |
US09/439,382 Expired - Lifetime US6754635B1 (en) | 1998-03-02 | 1999-11-15 | Method and apparatus for automating the conduct of surveys over a network system |
Country Status (4)
Country | Link |
---|---|
US (3) | US6477504B1 (en) |
EP (1) | EP1058901A1 (en) |
CA (1) | CA2322470C (en) |
WO (1) | WO1999045489A1 (en) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030009372A1 (en) * | 2001-07-06 | 2003-01-09 | Nick Nyhan | Method and system for conducting an on-line survey |
US20030200161A1 (en) * | 2001-06-15 | 2003-10-23 | Bayer Leonard R. | System and method for conducting product configuration research over a computer-based network |
US20060089918A1 (en) * | 2004-10-07 | 2006-04-27 | Umberto Avanzi | System and method for performing real-time market researches |
US20060282275A1 (en) * | 2005-06-08 | 2006-12-14 | Pineda Douglass D | Survey Method for Facilitating Real Estate Transactions |
US7194448B2 (en) | 2000-07-31 | 2007-03-20 | Roseanne Luth | Multi-layer surveying systems and methods with multi-layer incentives |
US20070233503A1 (en) * | 2006-03-31 | 2007-10-04 | Meyer Michael M | Bidding for on-line survey placement |
US7310350B1 (en) * | 2000-12-29 | 2007-12-18 | Oracle International Corporation | Mobile surveys and polling |
US20080021763A1 (en) * | 2006-07-06 | 2008-01-24 | Michael Merchant | Method for incentivized collective perception assessment |
US7398233B1 (en) * | 2001-06-15 | 2008-07-08 | Harris Interactive, Inc. | System and method for conducting product configuration research over a computer-based network |
US20080243586A1 (en) * | 2007-03-27 | 2008-10-02 | Doug Carl Dohring | Recruiting online survey panel members utilizing a survey tool |
US7693541B1 (en) | 2001-07-20 | 2010-04-06 | Oracle International Corporation | Multimodal session support on distinct multi channel protocol |
US20110066464A1 (en) * | 2009-09-15 | 2011-03-17 | Varughese George | Method and system of automated correlation of data across distinct surveys |
US20110178857A1 (en) * | 2010-01-15 | 2011-07-21 | Delvecchio Thomas | Methods and Systems for Incentivizing Survey Participation |
US20130096985A1 (en) * | 2011-04-05 | 2013-04-18 | Georgia Tech Research Corporation | Survey systems and methods useable with mobile devices and media presentation environments |
US20130339091A1 (en) * | 2012-06-15 | 2013-12-19 | Anthony W. Humay | Intelligent social polling platform |
US20140100918A1 (en) * | 2012-10-05 | 2014-04-10 | Lightspeed Online Research, Inc. | Analyzing market research survey results using social networking activity information |
WO2014078721A1 (en) * | 2012-11-16 | 2014-05-22 | 24/7 Customer, Inc. | Proactive surveys based on customer information |
US20160071127A1 (en) * | 2013-10-12 | 2016-03-10 | Chian Chiu Li | Systems And Methods for Conducting Survey to Get Opinions on People |
WO2018223026A1 (en) * | 2017-06-01 | 2018-12-06 | Melete Inc. | Analysis platform system and method |
US20210035132A1 (en) * | 2019-08-01 | 2021-02-04 | Qualtrics, Llc | Predicting digital survey response quality and generating suggestions to digital surveys |
US11734701B2 (en) | 2019-09-11 | 2023-08-22 | International Business Machines Corporation | Cognitive dynamic goal survey |
Families Citing this family (177)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6993495B2 (en) | 1998-03-02 | 2006-01-31 | Insightexpress, L.L.C. | Dynamically assigning a survey to a respondent |
US6314573B1 (en) * | 1998-05-29 | 2001-11-06 | Diva Systems Corporation | Method and apparatus for providing subscription-on-demand services for an interactive information distribution system |
US6311190B1 (en) * | 1999-02-02 | 2001-10-30 | Harris Interactive Inc. | System for conducting surveys in different languages over a network with survey voter registration |
US8095413B1 (en) * | 1999-05-07 | 2012-01-10 | VirtualAgility, Inc. | Processing management information |
US7171567B1 (en) * | 1999-08-02 | 2007-01-30 | Harris Interactive, Inc. | System for protecting information over the internet |
US20020124247A1 (en) * | 1999-08-03 | 2002-09-05 | Houghton William C. | Polling interactive television viewers |
US7085820B1 (en) | 1999-08-30 | 2006-08-01 | Opinionlab, Inc. | System and method for reporting to a website owner user reactions to particular web pages of a website |
US6606581B1 (en) * | 2000-06-14 | 2003-08-12 | Opinionlab, Inc. | System and method for measuring and reporting user reactions to particular web pages of a website |
US8041805B2 (en) * | 1999-08-30 | 2011-10-18 | Opinionlab, Inc. | System and method for reporting to a website owner user reactions to particular web pages of a website |
US6421724B1 (en) | 1999-08-30 | 2002-07-16 | Opinionlab, Inc. | Web site response measurement tool |
US20080097830A1 (en) * | 1999-09-21 | 2008-04-24 | Interpols Network Incorporated | Systems and methods for interactively delivering self-contained advertisement units to a web browser |
WO2001022261A2 (en) * | 1999-09-21 | 2001-03-29 | Kim Peter H I | Method and apparatus for delivery of targeted advertising and content based on user interaction with online queries on a wide area network |
US6859784B1 (en) * | 1999-09-28 | 2005-02-22 | Keynote Systems, Inc. | Automated research tool |
AU7731300A (en) * | 1999-09-28 | 2001-04-30 | Netraker Corporation | Automated research tool including proxy server |
AU4902601A (en) | 1999-11-10 | 2001-06-25 | Global Market Insite, Inc. | Multi-region market research study creation |
US20020069086A1 (en) * | 1999-12-06 | 2002-06-06 | Fracek Stephen P. | Web linked database for tracking clinical activities and competencies and evaluation of program resources and program outcomes |
US6801900B1 (en) * | 1999-12-22 | 2004-10-05 | Samuel H. Lloyd | System and method for online dispute resolution |
CA2331429A1 (en) * | 2000-01-18 | 2001-07-18 | James Stein | System and method for real-time updating service provider ratings |
US20030036943A1 (en) * | 2000-01-20 | 2003-02-20 | Grant Alan W. H. | Constituency value exchange optimization method |
US20040205065A1 (en) * | 2000-02-10 | 2004-10-14 | Petras Gregory J. | System for creating and maintaining a database of information utilizing user opinions |
WO2001067333A1 (en) * | 2000-03-06 | 2001-09-13 | Benderev Theodore V | On-line survey method |
US20010034639A1 (en) * | 2000-03-10 | 2001-10-25 | Jacoby Jennifer B. | System and method for matching aggregated user experience data to a user profile |
JP4529056B2 (en) * | 2000-03-21 | 2010-08-25 | ソニー株式会社 | Information processing apparatus and method, recording medium, and information processing system |
NL1014969C2 (en) * | 2000-04-18 | 2001-10-19 | Comm B V M | Keeping database of personal details up to date by regular random selection of individuals with prize offers |
KR20000072272A (en) * | 2000-04-24 | 2000-12-05 | 김창섭 | Research method for internet site evaluation |
US7092821B2 (en) * | 2000-05-01 | 2006-08-15 | Invoke Solutions, Inc. | Large group interactions via mass communication network |
US6862596B2 (en) * | 2000-05-09 | 2005-03-01 | Eri Economic Research Institute, Inc. | System and method for retrieving and displaying data, such as economic data relating to salaries, cost of living and employee benefits |
JP2001333069A (en) * | 2000-05-18 | 2001-11-30 | Koto Jimusho:Kk | Information transmission system and server equipment |
EP1285355A4 (en) * | 2000-05-26 | 2003-11-12 | Abova | Method and system for internet sampling |
US7509266B2 (en) * | 2000-05-31 | 2009-03-24 | Quality Data Management Inc. | Integrated communication system and method |
US7606726B2 (en) * | 2000-05-31 | 2009-10-20 | Quality Data Management Inc. | Interactive survey and data management method and apparatus |
US7526440B2 (en) * | 2000-06-12 | 2009-04-28 | Walker Digital, Llc | Method, computer product, and apparatus for facilitating the provision of opinions to a shopper from a panel of peers |
US20020120504A1 (en) * | 2000-07-31 | 2002-08-29 | Intermedia Advertising Group | Computerized system and method for increasing the effectiveness of advertising |
KR100371662B1 (en) * | 2000-08-23 | 2003-03-28 | 김정욱 | Method for real time survey on the internet |
GB2382438A (en) * | 2000-09-06 | 2003-05-28 | Advantage Interactive Corp Ltd | A system and method for providing an automated interview |
US7703611B1 (en) | 2000-09-29 | 2010-04-27 | Aol Inc. | Targeted geographical condition notification of users based on a geographic location and device types or software of the users |
US8650064B2 (en) * | 2000-10-03 | 2014-02-11 | Louis J. Morsberger | System and method for collecting survey information from targeted consumers |
US6901424B1 (en) * | 2000-10-10 | 2005-05-31 | Markettools, Inc. | System and method for creating a sample pool for a web-based survey |
JP2002123662A (en) * | 2000-10-16 | 2002-04-26 | Iis:Kk | Method of multilanguage market research on computer two-way communication network, communication system therefor and information recording medium |
FI20010597A0 (en) * | 2000-10-18 | 2001-03-23 | Kirsti Vilkuna | Inquiry procedure in the telecommunications network |
US6999987B1 (en) * | 2000-10-25 | 2006-02-14 | America Online, Inc. | Screening and survey selection system and method of operating the same |
US6766319B1 (en) | 2000-10-31 | 2004-07-20 | Robert J. Might | Method and apparatus for gathering and evaluating information |
US7313622B2 (en) * | 2000-11-08 | 2007-12-25 | [X+1] Solutions, Inc. | Online system and method for dynamic segmentation and content presentation |
JP2004529406A (en) | 2000-11-10 | 2004-09-24 | アフィノバ, インコーポレイテッド | Method and apparatus for dynamic real-time market segmentation |
GB2369207A (en) * | 2000-11-20 | 2002-05-22 | John Ruben Wagner | Data generation, processing and presentation over a network |
US7302463B1 (en) | 2000-12-04 | 2007-11-27 | Oracle International Corporation | Sharing information across wireless content providers |
US7269570B2 (en) * | 2000-12-18 | 2007-09-11 | Knowledge Networks, Inc. | Survey assignment method |
US7054828B2 (en) * | 2000-12-20 | 2006-05-30 | International Business Machines Corporation | Computer method for using sample data to predict future population and domain behaviors |
AU2002231146A1 (en) * | 2000-12-22 | 2002-07-08 | William M. Tomlinson | Collecting user responses over a network |
US20030018525A1 (en) * | 2001-01-09 | 2003-01-23 | Joao Raymond Anthony | Apparatus and method for providing compensation-based telemarketing information |
US20020095431A1 (en) * | 2001-01-16 | 2002-07-18 | Mc George Vernon E. | Generic system and method for collecting survey data |
US20030088452A1 (en) * | 2001-01-19 | 2003-05-08 | Kelly Kevin James | Survey methods for handheld computers |
US20030094489A1 (en) * | 2001-04-16 | 2003-05-22 | Stephanie Wald | Voting system and method |
US20020152110A1 (en) * | 2001-04-16 | 2002-10-17 | Stewart Betsy J. | Method and system for collecting market research data |
EP1253538A1 (en) * | 2001-04-27 | 2002-10-30 | Unilever N.V. | Test design |
US20030065554A1 (en) * | 2001-04-27 | 2003-04-03 | Ogi Bataveljic | Test design |
US20020184041A1 (en) * | 2001-05-31 | 2002-12-05 | International Business Machines Corporation | Automated customer survey using the web |
AUPR541601A0 (en) * | 2001-06-01 | 2001-06-28 | Evalu8 Pty Limited | Evaluation system and method |
US20030004779A1 (en) * | 2001-06-13 | 2003-01-02 | Arvind Rangaswamy | Method and system for online benchmarking and comparative analyses |
US20030050994A1 (en) * | 2001-07-27 | 2003-03-13 | Robert Pollack | Method of aggregating, classifying, reporting and cross-tabbing data in real time |
US7874841B1 (en) | 2001-08-08 | 2011-01-25 | Lycas Geoffrey S | Method and apparatus for personal awareness and growth |
US6754676B2 (en) * | 2001-09-13 | 2004-06-22 | International Business Machines Corporation | Apparatus and method for providing selective views of on-line surveys |
US7873551B2 (en) | 2001-10-19 | 2011-01-18 | U-Haul International, Inc. | Method and apparatus for payment retrieval and review collection |
US7487111B2 (en) * | 2001-10-19 | 2009-02-03 | U-Haul International, Inc. | Online marketplace for moving and relocation services |
US7593861B2 (en) * | 2001-10-24 | 2009-09-22 | Employee Motivation & Performance Assessment, Inc. | Employee assessment tool |
US7158988B1 (en) * | 2001-11-07 | 2007-01-02 | Bellsouth Intellectual Property Corporation | Reusable online survey engine |
JP2003173385A (en) * | 2001-12-05 | 2003-06-20 | Fukui Computer Kk | Investigation method |
JP3918697B2 (en) * | 2001-12-27 | 2007-05-23 | 日本電気株式会社 | Server construction support system, server construction support method, and program |
US7620654B2 (en) * | 2002-01-25 | 2009-11-17 | Theodore Turnasella | System and method providing user definable on-line wage and salary reports |
US20030200137A1 (en) * | 2002-03-05 | 2003-10-23 | Drummond Jill A. | Novel system and method for polling a group |
US20030177488A1 (en) * | 2002-03-12 | 2003-09-18 | Smith Geoff S. | Systems and methods for media audience measurement |
BR0215664A (en) * | 2002-03-28 | 2005-01-11 | Telefonaktiebolaget Km Ericsso | Arrangement and method for controlling / supporting process control of a system |
US20040153360A1 (en) * | 2002-03-28 | 2004-08-05 | Schumann Douglas F. | System and method of message selection and target audience optimization |
US7022604B2 (en) | 2002-04-09 | 2006-04-04 | Micron Technology, Inc. | Method of forming spatial regions of a second material in a first material |
US7281218B1 (en) | 2002-04-18 | 2007-10-09 | Sap Ag | Manipulating a data source using a graphical user interface |
US20030204436A1 (en) * | 2002-04-30 | 2003-10-30 | Joerg Flender | Survey data gathering |
US10102486B1 (en) * | 2002-05-08 | 2018-10-16 | Thomson Licensing | Implementing ETV with multiple presentment, response and communication techniques |
US20030236692A1 (en) * | 2002-05-29 | 2003-12-25 | Martin Hertel-Szabadi | Project workforce management |
US20030229533A1 (en) * | 2002-06-06 | 2003-12-11 | Mack Mary E. | System and method for creating compiled marketing research data over a computer network |
US7013109B2 (en) * | 2002-07-12 | 2006-03-14 | The United States Of America As Represented By The Secretary Of The Navy | Assessment tool for training analysis |
US7478121B1 (en) | 2002-07-31 | 2009-01-13 | Opinionlab, Inc. | Receiving and reporting page-specific user feedback concerning one or more particular web pages of a website |
US7370285B1 (en) * | 2002-07-31 | 2008-05-06 | Opinionlab, Inc. | Receiving and reporting page-specific user feedback concerning one or more particular web pages of a website |
US20040059624A1 (en) * | 2002-08-27 | 2004-03-25 | John Wantulok | Systems and methods for analyzing customer surveys |
US20040088208A1 (en) * | 2002-10-30 | 2004-05-06 | H. Runge Bernhard M. | Creating and monitoring automated interaction sequences using a graphical user interface |
US20040088212A1 (en) * | 2002-10-31 | 2004-05-06 | Hill Clarke R. | Dynamic audience analysis for computer content |
EP1565831A4 (en) * | 2002-11-07 | 2009-08-26 | Invoke Solutions Inc | Survey system |
WO2004061740A1 (en) * | 2002-12-27 | 2004-07-22 | Payscale, Inc. | A surveying apparatus and method for compensation reports |
US20040128183A1 (en) * | 2002-12-30 | 2004-07-01 | Challey Darren W. | Methods and apparatus for facilitating creation and use of a survey |
US7921447B1 (en) | 2003-03-14 | 2011-04-05 | Thomson Licensing | Enhanced television metadata processor for efficient broadcast operations |
US7664670B1 (en) | 2003-04-14 | 2010-02-16 | LD Weiss, Inc. | Product development and assessment system |
WO2004102341A2 (en) * | 2003-05-07 | 2004-11-25 | Ncqa | Automated accreditation system |
US7827487B1 (en) | 2003-06-16 | 2010-11-02 | Opinionlab, Inc. | Soliciting user feedback regarding one or more web pages of a website without obscuring visual content |
US8301482B2 (en) * | 2003-08-25 | 2012-10-30 | Tom Reynolds | Determining strategies for increasing loyalty of a population to an entity |
US7769626B2 (en) * | 2003-08-25 | 2010-08-03 | Tom Reynolds | Determining strategies for increasing loyalty of a population to an entity |
US7191144B2 (en) * | 2003-09-17 | 2007-03-13 | Mentor Marketing, Llc | Method for estimating respondent rank order of a set stimuli |
US7487435B2 (en) * | 2003-12-12 | 2009-02-03 | Dynamic Logic, Inc. | Method and system for conducting an on-line survey |
AU2005213629B2 (en) * | 2004-02-04 | 2010-08-26 | Press Ganey Associates LLC | Web-based data submission for nursing quality indicators |
US7302475B2 (en) * | 2004-02-20 | 2007-11-27 | Harris Interactive, Inc. | System and method for measuring reactions to product packaging, advertising, or product features over a computer-based network |
US7788336B2 (en) * | 2004-02-27 | 2010-08-31 | Sap Ag | Feedback system for visual content |
US20050193001A1 (en) * | 2004-02-27 | 2005-09-01 | Sap Ag | Client-side wizard framework |
US7756970B2 (en) * | 2004-02-27 | 2010-07-13 | Sap Aktiengesellschaft | Feedback system for visual content with enhanced navigation features |
US7565615B2 (en) * | 2004-02-27 | 2009-07-21 | Sap Aktiengesellschaft | Survey generation system |
EP1634225A4 (en) * | 2004-03-10 | 2008-01-16 | Nice Systems Ltd | Apparatus and method for generating a content-based follow up |
US8155977B2 (en) * | 2004-04-15 | 2012-04-10 | The Trizetto Group, Inc. | Rule management method and system |
US7958001B2 (en) * | 2004-04-28 | 2011-06-07 | Swiss Reinsurance Company | Computer-based method for assessing competence of an organization |
US20060004621A1 (en) * | 2004-06-30 | 2006-01-05 | Malek Kamal M | Real-time selection of survey candidates |
US20060015755A1 (en) * | 2004-07-16 | 2006-01-19 | Uptake Systems, Inc. | Data collector systems and methods |
US20060026240A1 (en) * | 2004-07-28 | 2006-02-02 | Unilever Home & Personal Care Usa, Division Of Conopco, Inc. | Method of collecting data from one or multiple respondents using spreadsheet based tool with programmed wizard utility deployed by e-mail |
US20060026501A1 (en) * | 2004-07-28 | 2006-02-02 | Unilever Home & Personal Care Usa, Division Of Conopco, Inc. | Method of Collecting data from one or multiple respondents using spreadsheet based tool with programmed wizard utility deployed by direct activation |
US8270893B2 (en) * | 2006-10-04 | 2012-09-18 | Bindu Rama Rao | Mobile device and server capable of supporting adhoc questionnaires |
EP1657655A3 (en) * | 2004-11-12 | 2007-02-28 | Trialstat Corporation | Method, system and computer program product for reference categorization and/or reference particulars mining |
US20060167971A1 (en) * | 2004-12-30 | 2006-07-27 | Sheldon Breiner | System and method for collecting and disseminating human-observable data |
BRPI0500426A (en) * | 2005-02-11 | 2006-09-26 | Ricardo Capucio Borges | ptec - technological process for creating and conducting collaborative events |
US8515790B2 (en) * | 2005-03-05 | 2013-08-20 | Jeb C Griebat | Computer program and method for jury selection |
US20060265368A1 (en) * | 2005-05-23 | 2006-11-23 | Opinionlab, Inc. | Measuring subjective user reaction concerning a particular document |
US7673017B2 (en) | 2005-09-06 | 2010-03-02 | Interpolls Network Inc. | Systems and methods for integrating XML syndication feeds into online advertisement |
CA2524527A1 (en) * | 2005-10-26 | 2007-04-26 | Ibm Canada Limited - Ibm Canada Limitee | Systems, methods and tools for facilitating group collaborations |
CA2525267A1 (en) * | 2005-10-28 | 2007-04-28 | Ibm Canada Limited - Ibm Canada Limitee | Systems, methods and tools for aggregating subsets of opinions from group collaborations |
US8781899B2 (en) * | 2005-11-28 | 2014-07-15 | Voiceport, Llc | Advertising a pharmaceutical product to a third party |
US8819083B2 (en) | 2005-12-29 | 2014-08-26 | Sap Ag | Creating new database objects from existing objects |
US20070168880A1 (en) * | 2006-01-19 | 2007-07-19 | Hoberman Gary A | Method and system for question tracking and information presentation |
US20090070200A1 (en) * | 2006-02-03 | 2009-03-12 | August Steven H | Online qualitative research system |
EP1984887A4 (en) * | 2006-02-08 | 2011-08-10 | Beaton Consulting Pty Ltd | Method and system for evaluating one or more attributes of an organization |
US20070288246A1 (en) * | 2006-06-08 | 2007-12-13 | Peter Ebert | In-line report generator |
US20080027819A1 (en) * | 2006-07-29 | 2008-01-31 | John Ruckart | Methods, systems, and products for purchasing products |
US7831473B2 (en) * | 2006-07-29 | 2010-11-09 | At&T Intellectual Property I, L.P. | Methods, systems, and products for crediting accounts |
US7965827B2 (en) * | 2006-07-29 | 2011-06-21 | At&T Intellectual Property I, L. P. | Methods, systems, and products for purchasing pre-paid services |
US7941751B2 (en) * | 2006-07-31 | 2011-05-10 | Sap Ag | Generation and implementation of dynamic surveys |
US8775237B2 (en) | 2006-08-02 | 2014-07-08 | Opinionlab, Inc. | System and method for measuring and reporting user reactions to advertisements on a web page |
US20080077468A1 (en) * | 2006-08-10 | 2008-03-27 | Yahoo! Inc. | Managing responses to extended interviews to enable profiling of mobile device users |
US7809602B2 (en) * | 2006-08-31 | 2010-10-05 | Opinionlab, Inc. | Computer-implemented system and method for measuring and reporting business intelligence based on comments collected from web page users using software associated with accessed web pages |
US8726169B2 (en) * | 2006-09-05 | 2014-05-13 | Circleup, Inc. | Online system and method for enabling social search and structured communications among social networks |
US8635099B1 (en) | 2006-09-26 | 2014-01-21 | Gfk Custom Research, Llc | Method and system for providing surveys |
US7899700B2 (en) * | 2006-09-29 | 2011-03-01 | Knowledge Networks, Inc. | Method and system for providing multi-dimensional feedback |
US8082301B2 (en) | 2006-11-10 | 2011-12-20 | Virtual Agility, Inc. | System for supporting collaborative activity |
US10803474B2 (en) | 2006-11-22 | 2020-10-13 | Qualtrics, Llc | System for creating and distributing interactive advertisements to mobile devices |
US11256386B2 (en) | 2006-11-22 | 2022-02-22 | Qualtrics, Llc | Media management system supporting a plurality of mobile devices |
US8478250B2 (en) | 2007-07-30 | 2013-07-02 | Bindu Rama Rao | Interactive media management server |
US8700014B2 (en) | 2006-11-22 | 2014-04-15 | Bindu Rama Rao | Audio guided system for providing guidance to user of mobile device on multi-step activities |
US7734246B2 (en) * | 2007-03-29 | 2010-06-08 | Echostar Technologies L.L.C. | Broadcast communication system and method for providing users with information associated with a geographical area |
US20080281678A1 (en) * | 2007-05-09 | 2008-11-13 | Mclagan Partners, Inc. | Practice management analysis tool for financial advisors |
US8249943B2 (en) * | 2007-05-31 | 2012-08-21 | Facebook, Inc. | Auction based polling |
US8244568B2 (en) * | 2007-07-12 | 2012-08-14 | International Business Machines Corporation | Method and apparatus for gathering participant free time to schedule events on an electronic calendar |
US8234627B2 (en) * | 2007-09-21 | 2012-07-31 | Knowledge Networks, Inc. | System and method for expediting information display |
US20090150217A1 (en) | 2007-11-02 | 2009-06-11 | Luff Robert A | Methods and apparatus to perform consumer surveys |
US7865455B2 (en) * | 2008-03-13 | 2011-01-04 | Opinionlab, Inc. | System and method for providing intelligent support |
US8332232B2 (en) * | 2009-11-05 | 2012-12-11 | Opinionlab, Inc. | System and method for mobile interaction |
US20110137808A1 (en) | 2009-12-04 | 2011-06-09 | 3Pd | Analyzing survey results |
US20110153387A1 (en) * | 2009-12-17 | 2011-06-23 | Google Inc. | Customizing surveys |
US9294623B2 (en) | 2010-09-16 | 2016-03-22 | SurveyMonkey.com, LLC | Systems and methods for self-service automated dial-out and call-in surveys |
JP6042337B2 (en) * | 2010-09-27 | 2016-12-14 | フル・エルエルシー | Method and apparatus for providing user information to improve advertising experience |
US20120166253A1 (en) * | 2010-12-28 | 2012-06-28 | Pinnion, Inc. | No-dial cell phone interviewing system and method |
US8868446B2 (en) | 2011-03-08 | 2014-10-21 | Affinnova, Inc. | System and method for concept development |
US9208132B2 (en) | 2011-03-08 | 2015-12-08 | The Nielsen Company (Us), Llc | System and method for concept development with content aware text editor |
US20120240206A1 (en) * | 2011-03-17 | 2012-09-20 | Carrier Iq, Inc. | Configuration of a Data Collection Agent and Its Distribution System |
US20120259676A1 (en) | 2011-04-07 | 2012-10-11 | Wagner John G | Methods and apparatus to model consumer choice sourcing |
US9311383B1 (en) | 2012-01-13 | 2016-04-12 | The Nielsen Company (Us), Llc | Optimal solution identification system and method |
US9875488B2 (en) | 2012-03-30 | 2018-01-23 | Rewardstyle, Inc. | Targeted marketing based on social media interaction |
AU2013228057A1 (en) * | 2012-09-17 | 2014-04-03 | Noble, Steven Edward MR | Software System for Breaking Online Benchmarking Methodologies into Discrete Tasks |
WO2014055568A1 (en) * | 2012-10-01 | 2014-04-10 | Cadio, Inc. | Consumer analytics system that determines, offers, and monitors use of rewards incentivizing consumers to perform tasks |
US20140278783A1 (en) * | 2013-03-15 | 2014-09-18 | Benbria Corporation | Real-time customer engagement system |
WO2014143729A1 (en) | 2013-03-15 | 2014-09-18 | Affinnova, Inc. | Method and apparatus for interactive evolutionary optimization of concepts |
WO2014152010A1 (en) | 2013-03-15 | 2014-09-25 | Affinnova, Inc. | Method and apparatus for interactive evolutionary algorithms with respondent directed breeding |
US20140324542A1 (en) * | 2013-04-24 | 2014-10-30 | Mobilyzer LLC | Media feedback system and method |
US9972025B2 (en) * | 2013-05-30 | 2018-05-15 | Facebook, Inc. | Survey segmentation |
US20150073869A1 (en) * | 2013-09-09 | 2015-03-12 | Mastercard International Incorporated | Systems and methods for predicting consumer behavior |
US10083459B2 (en) | 2014-02-11 | 2018-09-25 | The Nielsen Company (Us), Llc | Methods and apparatus to generate a media rank |
US20180197427A9 (en) * | 2014-02-12 | 2018-07-12 | Pearson Education, Inc. | Dynamic content manipulation engine |
US10909601B2 (en) * | 2014-12-11 | 2021-02-02 | Facebook, Inc. | Providing product advice recommendation |
US10147108B2 (en) | 2015-04-02 | 2018-12-04 | The Nielsen Company (Us), Llc | Methods and apparatus to identify affinity between segment attributes and product characteristics |
US10657479B2 (en) | 2015-10-22 | 2020-05-19 | Jamie Griffin | System and method for integrating employee feedback with an electronic time clock or computer login |
US10726432B2 (en) * | 2016-05-09 | 2020-07-28 | International Business Machines Corporation | Survey based on user behavior pattern |
US10327043B2 (en) * | 2016-07-09 | 2019-06-18 | N. Dilip Venkatraman | Method and system for displaying interactive questions during streaming of real-time and adaptively assembled video |
US20180096369A1 (en) * | 2016-09-30 | 2018-04-05 | Bradley Kayton | Systems and methods for automating the presentation of data and content |
US11500909B1 (en) * | 2018-06-28 | 2022-11-15 | Coupa Software Incorporated | Non-structured data oriented communication with a database |
US10740536B2 (en) * | 2018-08-06 | 2020-08-11 | International Business Machines Corporation | Dynamic survey generation and verification |
US11457059B2 (en) * | 2020-08-20 | 2022-09-27 | Rewardstyle, Inc. | System and method for ingesting and presenting a video with associated linked products and metadata as a unified actionable shopping experience |
Citations (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2482A (en) * | 1842-03-09 | Improvement in the manner of rendering chairs, stools, settees | ||
US16731A (en) * | 1857-03-03 | Hanb-stamp | ||
US32600A (en) * | 1861-06-18 | Improvement in machines for paring and pulverizing the soil | ||
US49621A (en) * | 1865-08-29 | Improvement in horse hay-forks | ||
US754635A (en) * | 1903-04-23 | 1904-03-15 | Joseph-Cajetan Berube | Self-propelled vehicle. |
US5297250A (en) * | 1989-05-22 | 1994-03-22 | Bull, S.A. | Method of generating interfaces for use applications that are displayable on the screen of a data processing system, and apparatus for performing the method |
US5619558A (en) * | 1995-11-13 | 1997-04-08 | Ncr Corporation | ATM segment of one marketing method |
US5701400A (en) * | 1995-03-08 | 1997-12-23 | Amado; Carlos Armando | Method and apparatus for applying if-then-else rules to data sets in a relational data base and generating from the results of application of said rules a database of diagnostics linked to said data sets to aid executive analysis of financial data |
US5802502A (en) * | 1993-05-24 | 1998-09-01 | British Telecommunications Public Limited Company | System for selective communication connection based on transaction pricing signals |
US5819282A (en) * | 1994-02-14 | 1998-10-06 | Digital Equipment Corporation | Database generator |
US5848397A (en) * | 1996-04-19 | 1998-12-08 | Juno Online Services, L.P. | Method and apparatus for scheduling the presentation of messages to computer users |
US5862325A (en) * | 1996-02-29 | 1999-01-19 | Intermind Corporation | Computer-based communication system and method using metadata defining a control structure |
US5893098A (en) * | 1994-09-14 | 1999-04-06 | Dolphin Software Pty Ltd | System and method for obtaining and collating survey information from a plurality of computer users |
US5948061A (en) * | 1996-10-29 | 1999-09-07 | Double Click, Inc. | Method of delivery, targeting, and measuring advertising over networks |
US5957520A (en) * | 1994-12-28 | 1999-09-28 | Canon Kabushiki Kaisha | Information processing system for completing or resolving ambiguity of input information and method therefor |
US5995941A (en) * | 1996-09-16 | 1999-11-30 | Maquire; John | Data correlation and analysis tool |
US6070145A (en) * | 1996-07-12 | 2000-05-30 | The Npd Group, Inc. | Respondent selection method for network-based survey |
US6093026A (en) * | 1996-07-24 | 2000-07-25 | Walker Digital, Llc | Method and apparatus for administering a survey |
US6161059A (en) * | 1998-09-14 | 2000-12-12 | Walker Digital, Llc | Vending machine method and apparatus for encouraging participation in a marketing effort |
US6189029B1 (en) * | 1996-09-20 | 2001-02-13 | Silicon Graphics, Inc. | Web survey tool builder and result compiler |
US20010027410A1 (en) * | 2000-03-30 | 2001-10-04 | Satoru Ueda | Contents market research system, contents market research apparatus, contents polling apparatus, contents market research method, and recording medium |
US20010052122A1 (en) * | 1998-01-06 | 2001-12-13 | Nikita J. Nanos | Automated survey kiosk |
US20010056374A1 (en) * | 2000-06-22 | 2001-12-27 | Joao Raymond Anthony | Apparatus and method for providing compensation for advertisement viewing and/or participation and/or for survey participation |
US20020002482A1 (en) * | 1996-07-03 | 2002-01-03 | C. Douglas Thomas | Method and apparatus for performing surveys electronically over a network |
US20020002595A1 (en) * | 1998-09-01 | 2002-01-03 | Trevor Blumenau | Collection of images in web use reporting system |
US20020016731A1 (en) * | 2000-05-26 | 2002-02-07 | Benjamin Kupersmit | Method and system for internet sampling |
US20020072955A1 (en) * | 2000-09-01 | 2002-06-13 | Brock Stephen P. | System and method for performing market research studies on online content |
US20020077881A1 (en) * | 2000-12-18 | 2002-06-20 | Krotki Karol P. | Survey assignment method |
US20020095431A1 (en) * | 2001-01-16 | 2002-07-18 | Mc George Vernon E. | Generic system and method for collecting survey data |
US20020107726A1 (en) * | 2000-12-22 | 2002-08-08 | Torrance Andrew W. | Collecting user responses over a network |
US20020120504A1 (en) * | 2000-07-31 | 2002-08-29 | Intermedia Advertising Group | Computerized system and method for increasing the effectiveness of advertising |
US20020133816A1 (en) * | 1994-06-21 | 2002-09-19 | Greene Steven Bradford | System for collecting data concerning received transmitted material |
US20020152110A1 (en) * | 2001-04-16 | 2002-10-17 | Stewart Betsy J. | Method and system for collecting market research data |
US6477505B2 (en) * | 1998-07-08 | 2002-11-05 | Ward, Ii Seth | Electronic parking meter locking system |
US20020173934A1 (en) * | 2001-04-11 | 2002-11-21 | Potenza John J. | Automated survey and report system |
US20020188464A1 (en) * | 2001-06-06 | 2002-12-12 | Marc Hodgins | Method and system for marketing and conducting a survey |
US6513014B1 (en) * | 1996-07-24 | 2003-01-28 | Walker Digital, Llc | Method and apparatus for administering a survey via a television transmission network |
US20030033193A1 (en) * | 2001-08-09 | 2003-02-13 | International Business Machines Corporation | Method apparatus and computer program product for interactive surveying |
US20030046140A1 (en) * | 2001-09-05 | 2003-03-06 | Professor Mac, Llc | Methods and systems for delivering market research services via a network |
US20030050928A1 (en) * | 2001-09-04 | 2003-03-13 | Hays Wesley Joseph | Method and apparatus for the design and analysis of market research studies |
US20030050939A1 (en) * | 2001-09-13 | 2003-03-13 | International Business Machines Corporation | Apparatus and method for providing selective views of on-line surveys |
US20030120687A1 (en) * | 2000-01-03 | 2003-06-26 | Solomon G. Douglas | System and method of providing customized marketing data |
US20030126010A1 (en) * | 2001-11-09 | 2003-07-03 | Ileana Barns-Slavin | Method and system for generating and deploying a market research tool |
US6618746B2 (en) * | 1998-03-30 | 2003-09-09 | Markettools, Inc. | Survey communication across a network |
US20030229533A1 (en) * | 2002-06-06 | 2003-12-11 | Mack Mary E. | System and method for creating compiled marketing research data over a computer network |
US20040080514A1 (en) * | 2002-10-24 | 2004-04-29 | Dorwart Richard Wilson | System and method for automated data extraction, manipulation and charting |
US20040117239A1 (en) * | 2002-12-17 | 2004-06-17 | Mittal Parul A. | Method and system for conducting online marketing research in a controlled manner |
US20040133463A1 (en) * | 2000-03-06 | 2004-07-08 | Theodore Benderev | On-line survey method |
US20040254837A1 (en) * | 2003-06-11 | 2004-12-16 | Roshkoff Kenneth S. | Consumer marketing research method and system |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0148457A3 (en) | 1983-12-26 | 1987-03-25 | Takeda Chemical Industries, Ltd. | Process for producing cross-linked resins |
JPH04372080A (en) * | 1991-06-20 | 1992-12-25 | Matsushita Electric Ind Co Ltd | Device for questionnaire utilizing electronic mail |
DE4343365A1 (en) | 1993-12-18 | 1995-07-13 | Bosch Gmbh Robert | Drift-free avalanche breakdown diode |
CA2158897A1 (en) | 1994-09-26 | 1996-03-27 | James B. Sanders | Survey tool for email |
US5701451A (en) * | 1995-06-07 | 1997-12-23 | International Business Machines Corporation | Method for fulfilling requests of a web browser |
US5970467A (en) | 1997-07-31 | 1999-10-19 | Enviro Ec Ag | Accurate market survey collection method |
US20010049621A1 (en) | 2000-05-08 | 2001-12-06 | Paul Raposo | Benchmarking surveys |
US7451094B2 (en) | 2000-05-22 | 2008-11-11 | Royall & Company | Method for electronically surveying prospective candidates for admission to educational institutions and encouraging interest in attending |
-
1998
- 1998-03-02 US US09/034,774 patent/US6477504B1/en not_active Expired - Lifetime
-
1999
- 1999-03-02 EP EP99911060A patent/EP1058901A1/en not_active Ceased
- 1999-03-02 WO PCT/US1999/004606 patent/WO1999045489A1/en active Application Filing
- 1999-03-02 CA CA2322470A patent/CA2322470C/en not_active Expired - Lifetime
- 1999-11-15 US US09/439,382 patent/US6754635B1/en not_active Expired - Lifetime
-
2004
- 2004-04-05 US US10/818,796 patent/US20040193479A1/en not_active Abandoned
Patent Citations (52)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US16731A (en) * | 1857-03-03 | Hanb-stamp | ||
US32600A (en) * | 1861-06-18 | Improvement in machines for paring and pulverizing the soil | ||
US49621A (en) * | 1865-08-29 | Improvement in horse hay-forks | ||
US2482A (en) * | 1842-03-09 | Improvement in the manner of rendering chairs, stools, settees | ||
US754635A (en) * | 1903-04-23 | 1904-03-15 | Joseph-Cajetan Berube | Self-propelled vehicle. |
US5297250A (en) * | 1989-05-22 | 1994-03-22 | Bull, S.A. | Method of generating interfaces for use applications that are displayable on the screen of a data processing system, and apparatus for performing the method |
US5802502A (en) * | 1993-05-24 | 1998-09-01 | British Telecommunications Public Limited Company | System for selective communication connection based on transaction pricing signals |
US5819282A (en) * | 1994-02-14 | 1998-10-06 | Digital Equipment Corporation | Database generator |
US20020133816A1 (en) * | 1994-06-21 | 2002-09-19 | Greene Steven Bradford | System for collecting data concerning received transmitted material |
US5893098A (en) * | 1994-09-14 | 1999-04-06 | Dolphin Software Pty Ltd | System and method for obtaining and collating survey information from a plurality of computer users |
US5957520A (en) * | 1994-12-28 | 1999-09-28 | Canon Kabushiki Kaisha | Information processing system for completing or resolving ambiguity of input information and method therefor |
US5701400A (en) * | 1995-03-08 | 1997-12-23 | Amado; Carlos Armando | Method and apparatus for applying if-then-else rules to data sets in a relational data base and generating from the results of application of said rules a database of diagnostics linked to said data sets to aid executive analysis of financial data |
US5619558A (en) * | 1995-11-13 | 1997-04-08 | Ncr Corporation | ATM segment of one marketing method |
US5862325A (en) * | 1996-02-29 | 1999-01-19 | Intermind Corporation | Computer-based communication system and method using metadata defining a control structure |
US5848397A (en) * | 1996-04-19 | 1998-12-08 | Juno Online Services, L.P. | Method and apparatus for scheduling the presentation of messages to computer users |
US20020002482A1 (en) * | 1996-07-03 | 2002-01-03 | C. Douglas Thomas | Method and apparatus for performing surveys electronically over a network |
US6070145A (en) * | 1996-07-12 | 2000-05-30 | The Npd Group, Inc. | Respondent selection method for network-based survey |
US6513014B1 (en) * | 1996-07-24 | 2003-01-28 | Walker Digital, Llc | Method and apparatus for administering a survey via a television transmission network |
US6093026A (en) * | 1996-07-24 | 2000-07-25 | Walker Digital, Llc | Method and apparatus for administering a survey |
US6616458B1 (en) * | 1996-07-24 | 2003-09-09 | Jay S. Walker | Method and apparatus for administering a survey |
US5995941A (en) * | 1996-09-16 | 1999-11-30 | Maquire; John | Data correlation and analysis tool |
US6189029B1 (en) * | 1996-09-20 | 2001-02-13 | Silicon Graphics, Inc. | Web survey tool builder and result compiler |
US5948061A (en) * | 1996-10-29 | 1999-09-07 | Double Click, Inc. | Method of delivery, targeting, and measuring advertising over networks |
US20010052122A1 (en) * | 1998-01-06 | 2001-12-13 | Nikita J. Nanos | Automated survey kiosk |
US6381744B2 (en) * | 1998-01-06 | 2002-04-30 | Ses Canada Research Inc. | Automated survey kiosk |
US6618746B2 (en) * | 1998-03-30 | 2003-09-09 | Markettools, Inc. | Survey communication across a network |
US6477505B2 (en) * | 1998-07-08 | 2002-11-05 | Ward, Ii Seth | Electronic parking meter locking system |
US20020002595A1 (en) * | 1998-09-01 | 2002-01-03 | Trevor Blumenau | Collection of images in web use reporting system |
US6161059A (en) * | 1998-09-14 | 2000-12-12 | Walker Digital, Llc | Vending machine method and apparatus for encouraging participation in a marketing effort |
US6317649B1 (en) * | 1998-09-14 | 2001-11-13 | Walker Digital, Llc | Vending machine method and apparatus for encouraging participation in a marketing effort |
US20030120687A1 (en) * | 2000-01-03 | 2003-06-26 | Solomon G. Douglas | System and method of providing customized marketing data |
US20040133463A1 (en) * | 2000-03-06 | 2004-07-08 | Theodore Benderev | On-line survey method |
US20010027410A1 (en) * | 2000-03-30 | 2001-10-04 | Satoru Ueda | Contents market research system, contents market research apparatus, contents polling apparatus, contents market research method, and recording medium |
US20020016731A1 (en) * | 2000-05-26 | 2002-02-07 | Benjamin Kupersmit | Method and system for internet sampling |
US20010056374A1 (en) * | 2000-06-22 | 2001-12-27 | Joao Raymond Anthony | Apparatus and method for providing compensation for advertisement viewing and/or participation and/or for survey participation |
US20020120504A1 (en) * | 2000-07-31 | 2002-08-29 | Intermedia Advertising Group | Computerized system and method for increasing the effectiveness of advertising |
US20020072955A1 (en) * | 2000-09-01 | 2002-06-13 | Brock Stephen P. | System and method for performing market research studies on online content |
US20020077881A1 (en) * | 2000-12-18 | 2002-06-20 | Krotki Karol P. | Survey assignment method |
US20020107726A1 (en) * | 2000-12-22 | 2002-08-08 | Torrance Andrew W. | Collecting user responses over a network |
US20020095431A1 (en) * | 2001-01-16 | 2002-07-18 | Mc George Vernon E. | Generic system and method for collecting survey data |
US20020173934A1 (en) * | 2001-04-11 | 2002-11-21 | Potenza John J. | Automated survey and report system |
US20020152110A1 (en) * | 2001-04-16 | 2002-10-17 | Stewart Betsy J. | Method and system for collecting market research data |
US20020188464A1 (en) * | 2001-06-06 | 2002-12-12 | Marc Hodgins | Method and system for marketing and conducting a survey |
US20030033193A1 (en) * | 2001-08-09 | 2003-02-13 | International Business Machines Corporation | Method apparatus and computer program product for interactive surveying |
US20030050928A1 (en) * | 2001-09-04 | 2003-03-13 | Hays Wesley Joseph | Method and apparatus for the design and analysis of market research studies |
US20030046140A1 (en) * | 2001-09-05 | 2003-03-06 | Professor Mac, Llc | Methods and systems for delivering market research services via a network |
US20030050939A1 (en) * | 2001-09-13 | 2003-03-13 | International Business Machines Corporation | Apparatus and method for providing selective views of on-line surveys |
US20030126010A1 (en) * | 2001-11-09 | 2003-07-03 | Ileana Barns-Slavin | Method and system for generating and deploying a market research tool |
US20030229533A1 (en) * | 2002-06-06 | 2003-12-11 | Mack Mary E. | System and method for creating compiled marketing research data over a computer network |
US20040080514A1 (en) * | 2002-10-24 | 2004-04-29 | Dorwart Richard Wilson | System and method for automated data extraction, manipulation and charting |
US20040117239A1 (en) * | 2002-12-17 | 2004-06-17 | Mittal Parul A. | Method and system for conducting online marketing research in a controlled manner |
US20040254837A1 (en) * | 2003-06-11 | 2004-12-16 | Roshkoff Kenneth S. | Consumer marketing research method and system |
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7194448B2 (en) | 2000-07-31 | 2007-03-20 | Roseanne Luth | Multi-layer surveying systems and methods with multi-layer incentives |
US7310350B1 (en) * | 2000-12-29 | 2007-12-18 | Oracle International Corporation | Mobile surveys and polling |
US20080243645A1 (en) * | 2001-06-15 | 2008-10-02 | Bayer Leonard R | System and method for conducting product configuration research over a computer-based network |
US20030200161A1 (en) * | 2001-06-15 | 2003-10-23 | Bayer Leonard R. | System and method for conducting product configuration research over a computer-based network |
US7890387B2 (en) | 2001-06-15 | 2011-02-15 | Harris Interactive Inc. | System and method for conducting product configuration research over a computer-based network |
US7822632B2 (en) | 2001-06-15 | 2010-10-26 | Harris Interactive Inc. | System and method for conducting product configuration research over a computer-based network |
US7398233B1 (en) * | 2001-06-15 | 2008-07-08 | Harris Interactive, Inc. | System and method for conducting product configuration research over a computer-based network |
US10497007B2 (en) * | 2001-07-06 | 2019-12-03 | Kantar Llc | Method and system for conducting an on-line survey |
US20030009372A1 (en) * | 2001-07-06 | 2003-01-09 | Nick Nyhan | Method and system for conducting an on-line survey |
US7693541B1 (en) | 2001-07-20 | 2010-04-06 | Oracle International Corporation | Multimodal session support on distinct multi channel protocol |
US20060089918A1 (en) * | 2004-10-07 | 2006-04-27 | Umberto Avanzi | System and method for performing real-time market researches |
US20060282275A1 (en) * | 2005-06-08 | 2006-12-14 | Pineda Douglass D | Survey Method for Facilitating Real Estate Transactions |
WO2007115061A3 (en) * | 2006-03-31 | 2007-11-29 | Google Inc | Bidding for on-line survey placement |
US20070233503A1 (en) * | 2006-03-31 | 2007-10-04 | Meyer Michael M | Bidding for on-line survey placement |
WO2007115061A2 (en) * | 2006-03-31 | 2007-10-11 | Google Inc. | Bidding for on-line survey placement |
US20080021763A1 (en) * | 2006-07-06 | 2008-01-24 | Michael Merchant | Method for incentivized collective perception assessment |
US20080243586A1 (en) * | 2007-03-27 | 2008-10-02 | Doug Carl Dohring | Recruiting online survey panel members utilizing a survey tool |
US20110066464A1 (en) * | 2009-09-15 | 2011-03-17 | Varughese George | Method and system of automated correlation of data across distinct surveys |
US20110178857A1 (en) * | 2010-01-15 | 2011-07-21 | Delvecchio Thomas | Methods and Systems for Incentivizing Survey Participation |
US20130096985A1 (en) * | 2011-04-05 | 2013-04-18 | Georgia Tech Research Corporation | Survey systems and methods useable with mobile devices and media presentation environments |
US20130339091A1 (en) * | 2012-06-15 | 2013-12-19 | Anthony W. Humay | Intelligent social polling platform |
US20140100918A1 (en) * | 2012-10-05 | 2014-04-10 | Lightspeed Online Research, Inc. | Analyzing market research survey results using social networking activity information |
WO2014078721A1 (en) * | 2012-11-16 | 2014-05-22 | 24/7 Customer, Inc. | Proactive surveys based on customer information |
AU2017200838B2 (en) * | 2012-11-16 | 2019-01-17 | [24]7.ai, Inc. | Proactive surveys based on customer information |
US10515380B2 (en) | 2012-11-16 | 2019-12-24 | [24]7.ai, Inc. | Proactive surveys based on customer information |
US20160071127A1 (en) * | 2013-10-12 | 2016-03-10 | Chian Chiu Li | Systems And Methods for Conducting Survey to Get Opinions on People |
WO2018223026A1 (en) * | 2017-06-01 | 2018-12-06 | Melete Inc. | Analysis platform system and method |
WO2018223021A1 (en) * | 2017-06-01 | 2018-12-06 | Melete Inc. | Analysis platform system and method |
US20210035132A1 (en) * | 2019-08-01 | 2021-02-04 | Qualtrics, Llc | Predicting digital survey response quality and generating suggestions to digital surveys |
US11734701B2 (en) | 2019-09-11 | 2023-08-22 | International Business Machines Corporation | Cognitive dynamic goal survey |
Also Published As
Publication number | Publication date |
---|---|
CA2322470C (en) | 2016-10-25 |
WO1999045489A1 (en) | 1999-09-10 |
US6477504B1 (en) | 2002-11-05 |
US6754635B1 (en) | 2004-06-22 |
EP1058901A1 (en) | 2000-12-13 |
CA2322470A1 (en) | 1999-09-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6754635B1 (en) | Method and apparatus for automating the conduct of surveys over a network system | |
US7398223B2 (en) | Dynamically assigning a survey to a respondent | |
US20030200137A1 (en) | Novel system and method for polling a group | |
US8494950B2 (en) | System for conducting an exchange of click-through traffic on internet web sites | |
US9514239B2 (en) | System and method for managing content on a network interface | |
EP2270731A1 (en) | Enhancing virally-marketed facilities | |
US20040039990A1 (en) | Automated form and data analysis tool | |
US20070174108A1 (en) | Multi-region market research study processing | |
US20050055306A1 (en) | User-defined dynamic collaborative environments | |
US20080021763A1 (en) | Method for incentivized collective perception assessment | |
US20050060283A1 (en) | Content management system for creating and maintaining a database of information utilizing user experiences | |
US20040153466A1 (en) | Content development management system and method | |
US20020169835A1 (en) | E-mail communications system, method and program | |
US20090024462A1 (en) | Method and system for providing targeted offers based on a credit attribute | |
WO2002011037A1 (en) | Strategic marketing planning processes, marketing effectiveness tools and systems, and marketing investment management | |
Bellotti et al. | Innovation in extremis: evolving an application for the critical work of email and information management | |
JP2002099671A (en) | Method and server for questionnaire | |
US20040199423A1 (en) | Integrated event management system, method, and program | |
EP1770617A1 (en) | User-defined dynamic collaborative environments | |
Viderisa et al. | Designing the prototype of personalized push notifications on E-commerce application with the user-centered design method | |
US6591256B1 (en) | Business focused interface for engaging applications that solve mathematical problems | |
US20020161663A1 (en) | Method for providing cyber fair through computer network system and medium for recording the same | |
JP2003323482A (en) | Real estate transaction system and computer readable recording medium | |
US20020039112A1 (en) | Collecting information from respondents to supply back to originators | |
WO2002017186A1 (en) | Online website market research system and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |