US20150040008A1 - Interactive overlay for video applications - Google Patents

Interactive overlay for video applications Download PDF

Info

Publication number
US20150040008A1
US20150040008A1 US13/963,595 US201313963595A US2015040008A1 US 20150040008 A1 US20150040008 A1 US 20150040008A1 US 201313963595 A US201313963595 A US 201313963595A US 2015040008 A1 US2015040008 A1 US 2015040008A1
Authority
US
United States
Prior art keywords
overlay
user
response
interactive
status
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/963,595
Inventor
Todd Redenshek
Vicky Lawrence
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GAMER PARENTS Inc
Original Assignee
GAMER PARENTS Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GAMER PARENTS Inc filed Critical GAMER PARENTS Inc
Priority to US13/963,595 priority Critical patent/US20150040008A1/en
Priority to CA 2823746 priority patent/CA2823746A1/en
Assigned to GAMER PARENTS INC. reassignment GAMER PARENTS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LAWRENCE, VICKY, REDENSHEK, TODD
Publication of US20150040008A1 publication Critical patent/US20150040008A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/4804Spatially selective measurement of temperature or pH
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A61B5/015By temperature mapping of body part
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/43Detecting, measuring or recording for evaluating the reproductive systems
    • A61B5/4375Detecting, measuring or recording for evaluating the reproductive systems for evaluating the male reproductive system
    • A61B5/4381Prostate evaluation or disorder diagnosis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N7/02Localised ultrasound hyperthermia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N7/02Localised ultrasound hyperthermia
    • A61N7/022Localised ultrasound hyperthermia intracavitary
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/28Details of apparatus provided for in groups G01R33/44 - G01R33/64
    • G01R33/285Invasive instruments, e.g. catheters or biopsy needles, specially adapted for tracking, guiding or visualization by NMR
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/443Assessment of an electric or a magnetic field, e.g. spatial mapping, determination of a B0 drift or dosimetry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/4808Multimodal MR, e.g. MR combined with positron emission tomography [PET], MR combined with ultrasound or MR combined with computed tomography [CT]
    • G01R33/4814MR combined with ultrasound
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B18/00Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
    • A61B2018/00315Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body for treatment of particular body parts
    • A61B2018/00547Prostate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B18/00Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
    • A61B2018/00636Sensing and controlling the application of energy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B18/00Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
    • A61B2018/00636Sensing and controlling the application of energy
    • A61B2018/00696Controlled or regulated parameters
    • A61B2018/00702Power or energy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B18/00Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
    • A61B2018/00636Sensing and controlling the application of energy
    • A61B2018/00773Sensed parameters
    • A61B2018/00791Temperature
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/374NMR or MRI
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/378Surgical systems with images on a monitor during operation using ultrasound
    • A61B2090/3782Surgical systems with images on a monitor during operation using ultrasound transmitter or receiver in catheter or minimal invasive instrument
    • A61B2090/3784Surgical systems with images on a monitor during operation using ultrasound transmitter or receiver in catheter or minimal invasive instrument both receiver and transmitter being in the instrument or receiver being also transmitter
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N2007/0004Applications of ultrasound therapy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N2007/0052Ultrasound therapy using the same transducer for therapy and imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N2007/0078Ultrasound therapy with multiple treatment transducers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/5608Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels

Definitions

  • the present invention relates generally to interactive overlay systems, and specifically to an interactive overlay that obscures a portion of a screen of video content while operating simultaneously and independently of the video content.
  • Video content including gaming, audio-visual programming, and computer centric media, is widely available and increasingly occupies the attention and time of many.
  • new and innovative ways to provide an interface with a computer are often developed to complement the changes in computer functionality and packaging.
  • a system and method is provided for an interactive overlay system.
  • the system comprises an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of the program content.
  • the interactive overlay also comprises at least one overlay status.
  • the system further comprises an input device capable of providing multiple inputs from a user.
  • the overlay component is configured to change the status of the interactive overlay on the display screen in response to user input in accordance with rules defined by the administrator.
  • the interactive overlay may be partially transparent, opaque, or any variation thereof.
  • Another embodiment of the present invention includes a method for providing an interactive overlay sequence. Included are the actions of displaying video content on a display screen. On the display, an overlay sequence in accordance with a set of interactive overlay rules is initiated.
  • the interactive overlay can begin with a notification status being displaying for a predetermined amount of time, the notification status providing information or instruction for the upcoming overlay sequence.
  • the notification status is followed by a text status requesting a response from the user.
  • the text status can provide a question and associated answers, or can provide alternative content, as described in greater detail below.
  • the user will submit, and the system will receive and process, a response from a user which prompts the system to provide feedback based on the response.
  • the feedback given is dependent on the character of the user's response, which is governed by the rules. For example, a first response may be accepted according to the rules and result in a first, favorable change in the text status, whereas a second, unaccepted response will result in a second, unfavorable change in the text status.
  • a minimized window may remain on the display.
  • the minimized window can provide limited information to the user, such as time remaining until the next question, the number of remaining questions, or that a message has been sent to the user.
  • the administrator can modify the rules to tailor the visual presentation of the minimized window and content displayed therein.
  • Yet another embodiment of the present invention includes a method of displaying program content simultaneously with and independently of an interactive overlay on a display screen.
  • the interactive overlay as considered by the present invention considers multiple possible modes. For example, an overlay may be presented simply to provide information. This could include notice that a sequence of overlays has been initiated, a timer, a score, a reference, and/or administrator identification information.
  • the interactive overlay can also provide interactive content, specifically a series of questions and answers, where the user has multiple answers from which to select. Additionally, the interactive overlay may contain hyperlinks to related content or be capable of communicating with one or more system administrators with the aid of a user input device.
  • FIG. 1 illustrates an example of an interactive overlay system in accordance with an aspect of the invention.
  • FIG. 2 illustrates an example of an overlay component in accordance with an aspect of the invention.
  • FIG. 3 illustrates an example of a method for providing an interactive overlay in accordance with an aspect of the invention.
  • FIG. 4 illustrates another example of a method for providing an interactive overlay in accordance with an aspect of the invention.
  • FIG. 5 is a schematic block diagram illustrating an exemplary system of hardware components capable of implementing examples of the present disclosed in FIGS. 1-4 , such as the interactive overlay system illustrated in FIG. 1
  • the present invention provides an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of a video source associated with the display.
  • the overlay is played over an existing audiovisual content source, which can be local to a user or remote (e.g., provided over a network connection).
  • the content source can include a media player, a game console, an Internet site, or broadcast/multicast video through an appropriate hardware connection.
  • the overlay is interactive, such that input provided by the user with an associated input device can affect the appearance and behavior of the overlay, with a discrete instance of a given appearance and behavior having being referred to herein as a “status” of the overlay.
  • one status might include a “text status”, that is, a block of text (e.g., a question) that remains on the screen until a response is provided by the user.
  • Another status might include a “notification status” that counts down a defined interval between text statuses.
  • the interactive overlay can include a large number of individual statuses, with transitions among the statuses governed by a set of rules stored with the overlay content.
  • the overlay is presented independently of underlying content, such that there is no interaction between the overlay and other programs that may be running simultaneously.
  • the overlay is interactive to the user, even as the user has a limited number of available responses when presented with an overlay.
  • the interactive overlay may also be used to encourage a response from the user.
  • a particular overlay status of the overlay sequence can be displayed over the program content such that a central portion (e.g., a portion encompassing a centroid of the screen) of the underlying content is obscured. This is typically a result of the user failing to respond to a question or repeated submission of unaccepted answers.
  • the overlay may include dynamic overlays that move, flash, or present a scene that substantially obscures the underlying video content.
  • a behavior of the overlay specifically a response of the overlay to various user inputs during the sequence can be defined by a rule set by an administrator prior to initiation of an interactive overlay sequence.
  • the overlay sequence is structured and initiated by the administrator without regard for or in response to the user's conduct, provided the user is logged into an authorized device running the interactive overlay system.
  • one administrator is a teacher and the user a student.
  • the teacher with administrator privileges, defines rules for an interactive overlay sequence.
  • the rules govern operation of the overlay sequence complete with content, acceptable and unacceptable responses, timing constraints, and appropriate reactions to various user input.
  • the teacher's role is that of monitor, as the sequence runs through the overlay component in accordance with the set of rules.
  • the sequence can begin with a translucent interactive overlay status providing notice that a series of questions is upcoming.
  • the initial overlay status is configured to expire after a predetermined amount of time, followed by an overlay status containing a question and multiple choices for a response.
  • the overlay status will change according to the rules as established by the teacher. For example, the overlay status might transition to a first status, representing positive feedback to the user, if an acceptable answer is received, or transition to a second status, representing negative feedback to the user, if an unacceptable answer is received.
  • the user employs an input device to provide a response to the question presented as part of the overlay.
  • a multiple choice question may be presented, wherein the user may choose from answers designated as “A, B, C,” etc., or “1, 2, 3,” etc.
  • the input device could be, for example, a remote control, game console controller, computer keyboard, mouse, smart phone, tablet computer, camera with gesture recognition software, microphone, or other suitable device.
  • the user has some ability to adjust the sequence progression. For example, when a student user is presented with an overlay containing a question, an acceptable response may remove the overlay or change an overlay status to be less obtrusive, until a predetermined period of time has elapsed. An unacceptable response may cause the overlay to be maintained in present form, changed to a more obtrusive status, or removed or made less obtrusive for a period of time less than the period of time following an acceptable response.
  • the overlay can be used to deliver questions to the user, which can be answered via the input device, with the response given by the user affecting some aspect of the overlay appearance and behavior, such as size, opacity, or frequency with which the overlay is displayed. Repeated unaccepted responses or failure to respond can result in changes to the overlay that obscure or distract from the underlying audiovisual content. These changes can be configured by an administrator to facilitate cooperation from the user in answering the questions provided. It is envisioned that a system in accordance with an aspect of the present invention could be employed as an educational tool to encourage a user, such as a student, to complete homework or supplementary educational material, either before or during recreational activities such as watching television, using a computer, tablet device, or smart phone, or playing console video games.
  • the user may be viewing video content that constitutes a lesson, webinar, or other task required by the administrator.
  • the user may have access to additional content or applications.
  • the computer may have a web browser, game software, an instant messaging application, video viewing software, or similar applications that would distract the user from the base, required task.
  • the administrator may set rules that restrict what other programs or applications are available while the user is engaged with the required task. The restriction may forbid access entirely or limit the amount of time such program or application may be accessed.
  • an overlay status may be triggered if the user violates the rules set by the administrator.
  • the overlay status may partially obscure the additional content, the display screen, or otherwise grab the attention of the user.
  • the overlay status may require the user to acknowledge the overlay status in order to have it removed, or simply discontinue use of the additional content that constituted the violation.
  • an administrator is an individual with privileges that allow him or her to define rules governing an interactive overlay sequence or initiate the sequence.
  • the present invention contemplates a variety of applications where the administrator's role would be defined in accordance with the relationship with the user as well as the desired goal for the particular sequence.
  • An administrator may be a parent, counselor, instructor, an administrator at an educational institution, or other individual or organization providing overlay content intended for the benefit of the user.
  • an administrator may be a teacher and the user a student. In this case, the administrator may present academic questions related to educational goals.
  • An administrator may also be a counselor, presenting questions or asking for feedback to aid in the user's development.
  • the user can also be an administrator.
  • the administrator may present a sequence in a trivia contest related to underlying content on the display, for example, where the administrator can be one of the participants.
  • the user can be given administrative privileges to more personally customize the overlay system for their individual use. Accordingly, a user can have control over when an overlay is presented, the amount of time it remains on the screen, the content provided, as well as control over the visual aspects of the overlay itself. If the user is watching a television program, for example, the user can choose to initiate an overlay during a commercial break in the program of interest.
  • the overlay may be chosen to cover all or a portion of the screen and the user can discontinue the overlay when the program resumes.
  • the overlay can contain any conceivable digital content, such as the lessons described herein, or can provide links to other types of information, such as an RSS feed, webpage, picture folder, or minor another connected device.
  • the relationship between administrator and user is important with respect to the type and content of the sequence.
  • a typical user may be a student or child, wherein the administrator seeks to introduce or reinforce a lesson.
  • a parent may also serve as an administrator, and tailor questions and responses for a variety of goals.
  • the invention described can also be used for entertainment purposes, for example, with the interactive overlay providing content associated with the base video content.
  • the administrator has authority to define a set of rules to govern one or more interactive overlay sequences.
  • Each interactive overlay sequence can be configured to respond to multiple user inputs.
  • an acceptable user input leads to a particular set of actions, wherein an unacceptable user input leads to a different set of actions.
  • the administrator can configure an interactive overlay sequence to meet a desired goal with respect to the user. For example, if the administrator is a teacher who wishes to reinforce, say, a history lesson, the administrator will load a series of history questions to be presented in the interactive overlay statuses. In such a case, the administrator can define rules such that an accepted response reduces a number of required questions or extends a time interval between questions, and an unaccepted response requires additional questions or decreases the time interval between questions.
  • the interactive overlay can be translucent or opaque, and may include both audio and video components.
  • the interactive overlay is displayed as translucent to ensure that the video content on the display screen is still partially visible, thereby attracting the attention of the user while allowing the user to maintain limited visibility of the video content.
  • an overlay is intended to obscure an insubstantial portion of the display screen unless or until the user provides an unaccepted response or fails to respond within a predetermined time period. For example, if an unaccepted response is given, the translucent overlay may become opaque or enlarged, in order to highlight an accepted response. As a further example, if the user fails to provide any response within a predetermined time period, additional overlay statuses may be presented.
  • overlay statuses may cover a substantial portion of the screen and/or may encompass the centroid of the viewing area of the video content. Further examples are contemplated, in which more than one overlay may be used to obscure the viewing area, the overlay may move about in the viewing area of the display screen, the overlay may flash brightly, or the overlay is otherwise dynamic to maintain the attention of the user.
  • the overlay can also employ other attention grabbing tools, such as animated characters, audio signals, or customized alerts.
  • Rules can be applied to the overlays such that the display is partially or fully obscured. Further, in a sequence of overlays, the shape, size and character of the overlay can change. For example, the first overlay can first be presented as substantially transparent, obscuring a minor portion of the display, and stationary. However, if the user ignores the overlay or fails to provide acceptable responses, the overlay can become increasing opaque, obscuring a larger portion of the screen, and move randomly across the display. The same modifications to the overlay can be made for future or additional overlays, as the administrator sees fit.
  • the administrator provides content for and rules to define the user experience, for example, on a server hosting software for providing the overlay content.
  • an overlay sequence may be structured as a history lesson presented with a video game playing concurrently. The sequence may start with an initial notification status presented in a portion of the display screen that does not significantly obscure or distract from the underlying content to alert the user that a sequence of questions has been initiated. This notification status may transition to a text status automatically at the end of a predetermined time or may require acknowledgment from the user. The text status can present a question and multiple answers from which the user must choose.
  • the overlay status would change according to the rules as defined by the administrator, as described above.
  • the status will update according to the set of rules defined by the administrator for the overlay sequence.
  • the administrator may initiate a sequence in advance. When the user attempts to access video content or games, the user is then prompted to log in to the interactive overlay system to gain access to both. By this action, access to the video content or game is allowed, and the sequence is presented concurrently to the user, who responds accordingly.
  • the interactive overlay further comprises a variety of overlay statuses.
  • An individual status represents a configuration of the appearance and behavior of the overlay having different properties from the other statuses in the sequence.
  • Each overlay status can be configured to respond to multiple user inputs.
  • the sequence will begin with a notification status. This may provide information to the user such as the number of questions in the sequence, the amount of time between questions, and the topic of the upcoming sequence. Again, typically but not necessarily, this notification status will be replaced with a text status after a predetermined time as a second status is presented. However, the notification could require the user to select from a catalogue of choices before the remainder of the sequence is presented.
  • the overlay may present a question as a text status displayed on a screen, through audio (e.g., a recording by an administrator or other content provider or machine rendered speech), or other available method.
  • the method could employ, for example, a vibrating hand held controller.
  • the user may then respond by use of any of multiple devices including, but not limited to, an input/output device, a microphone configured to receive an audio response, and a camera configured for gesture recognition.
  • the user inputs are then subject to the rules as defined by the administrator when the sequence was initiated. However, the administrator has the capability to modify the rules during an active overlay sequence if desired.
  • an acceptable response will lead to a change in the frequency of the sequence that favors the user. For example, if the user is playing a computer game, and the administrator initiates a sequence of educational questions in the interactive overlay, the user may desire the sequence to repeat less frequently. Alternatively, if the user is competing in a trivia contest related to the underlying video content, a favorable response may increase the frequency of questions in order to increase the user's score.
  • the rule set defined by the administrator is invoked to determine how the overlay will be changed. As described above, depending on the application, limiting or increasing the frequency of questions may challenge the user experience. An unaccepted response could prompt an accepted answer to be highlighted. Typically, this result would follow a predetermined number of unaccepted answers. This could also prompt an explanation for the accepted answer or a hyperlink to additional information regarding the question.
  • the rules may also invoke an overlay that obscures a significant portion of the video. Also, a central portion of the screen may be obscured by an opaque or partially transparent overlay in response to an unaccepted response.
  • an overlay component may invoke an overlay that obscures a significant portion of the screen or otherwise interferes with enjoyment of the underlying content to encourage a response.
  • the overlay could increase in size or opacity, begin moving or flashing, or begin providing audio unassociated with the underlying content.
  • An administrator has privileged access to the program engine that includes several features that aid the administrator in configuring an overlay sequence that guides the user experience.
  • the administrator gains access to the program engine, for example, by logging onto a server hosting the software that provides the overlay content.
  • the administrator may then create an account for a user, or select an existing account that the administrator is privileged to access.
  • Features available to the administrator include, but are not limited to, the subject matter of the overlay prompts, how the status is displayed, on which devices the overlay will appear, how progress is gauged, what constitutes an accepted or unaccepted response, what consequence results from an accepted or unaccepted response, what consequence results from a lack of response, the timing and frequency of overlay prompts, and similar configuration parameters for the overlay sequence provided to the user.
  • the administrator may set an academic goal for the user.
  • the goal may be providing a favorable response on 90% of a set of questions within a predetermined timeframe. For instance, a single history lesson may be due in one evening, with ten questions presented to the user.
  • the administrator may select the topic, specify questions to present to the user, and define the timeframe in which the user must complete the lesson.
  • a sequence of overlay statuses representing the defined questions is initiated. The ten questions may appear at six minute increments, for a goal of completing in an hour's time. Once begun, if a response is unaccepted, the time between questions may decrease, to allow for a greater number of questions. If the response is accepted, the time between questions may increase. This may result in only nine questions presented during the hour, while still achieving the initial goal.
  • the administrator may offer the user the option to log on to a computer program that provides a dedicated lesson where the student may answer questions uninterrupted in advance of turning to video content. This action could decrease the number or frequency of question prompts, or could satisfy the lesson requirement altogether.
  • the user if the user fails to cooperate with the lesson provided, the user can be locked out from utilizing authorized devices or be blocked from accessing audio-visual or other content altogether in accordance with the set of rules governing that user log in. At this point, the administrator would be required to reset the sequence in order to allow the user to access content in the future.
  • the system assigns each user a unique log in.
  • This log in can be used to tailor many of the features available from the system. For example, the log in identifies the user, such as a student, where an administrator, such as teacher or parent, can create rules for governing the particular user's device use. The administrator can further tailor lessons and provide content or messages for the particular user.
  • Each authorized device operating on the system can be configured to recognize an individual log in.
  • the log in is intended to follow the user on each device.
  • a user may have an authorized portable device (e.g., tablet, gaming console, or smart phone), a stationary computing platform (e.g., desktop computer, gaming system, or television), as well as an authorized shared device (e.g., a classroom computer).
  • the system recognizes the user as being active on the device, and can provide overlays and lessons as set by an administrator. This is particularly useful if the user is disrupted in the middle of a lesson (say, the end of class).
  • the system can also adapt to the situation where a user switches from one device to another, for example, at the end of a television program or a battery goes flat in a device. Additionally, this feature prohibits the user from attempting to avoid completing a lesson by switching from a first device where an overlay screen is obscuring the display to a second device were the lesson had not been initiated. Thus, the system can recognize that a user has switched devices, and the lesson in progress will reinitiate in the second device.
  • the system is further configured to recognize multiple authorized users active on a single authorized device. For example, two or more users can be engaged in a multiplayer game running on a single gaming device.
  • the device can be configured to dedicate a separate portion of the screen for each user.
  • that user's screen can be subject to the same lessons and associated overlays as if that user was using the device individually.
  • this feature advantageously follows a user when the user switches or attempts to access another device, even as the other device may belong to another authorized user.
  • a lesson can be provided allowing for immediate feedback from connected, authorized users.
  • a question can be provided with a multiple answers, and the users can input answers to be displayed on common screen. This allows for the instructor to receive instant feedback, to better identify challenging subject matter and guide the class through the lesson.
  • the multiple authorized users may be presented with the same overlay obscuring a shared portion of the display.
  • the overlay can present a lesson to the users as a competition where the provided questions can earn points to a user for answering questions quickly and correctly.
  • the multiple users can be collocated and viewing the same device or different devices, or may be located in different locations utilizing different devices when the lesson is presented.
  • the system is configured to provide feedback in a variety of ways to both the administrator and the user.
  • Feedback is structured to change the overlay sequence in a way that enhances the user experience.
  • an unobtrusive overlay may be present on the display screen between question prompts that shows number of questions presented or remaining, number of responses accepted or unaccepted, the time until the next question, and progress in reaching the assigned goal.
  • the administrator may set rules that govern what is displayed, in what format, and for what duration.
  • the administrator has a separate set of tools to gauge user performance.
  • the administrator has access to view the user responses, including not only accepted and unaccepted responses, but the time taken to answer as well as the number of overlays displayed before a response was given.
  • the administrator has the authority to modify the sequence in response to the user's performance as the sequence plays out. If a user is particularly slow to respond, the frequency and/or size of the overlay may be increased, for example. Additionally, the administrator and user may both have access to historical data and statistics, including number of sequences initiated, the user's performance, the types of lessons completed, the user's performance relative to peers, and similar information. Access to some information and configuration options may be limited according to a level of privilege provided to a given administrator.
  • FIG. 1 illustrates an example of an interactive overlay system 100 in accordance with an aspect of the invention.
  • the interactive overlay system 100 includes an overlay component 200 , a video component 110 , a user input/output component 130 , a display 140 and a server 150 .
  • the overlay component 200 can be configured to display an interactive overlay on a display screen simultaneously with and independent of video or other programming provided by the video component 110 .
  • video as used herein, is intended to encompass both the visible and audible content (if any) provided from the video component.
  • the overlay component 200 as pertaining to an embodiment of the present invention, is described with greater detail with respect to FIG. 2 .
  • the overlay component 200 is configured to allow video content from the video component 110 to be displayed as a base content, while presenting interactive overlays thereon.
  • the video component 110 may include a video game console, television component, DVD player, Internet browser, or other device or software configured to provide video content.
  • the user input/output component 130 may include, for example, a remote control, a game console controller, a computer keyboard, a mouse, a smartphone, a microphone, a sensor configured to detect visible, infrared, and ultraviolet light radiating or reflected from the user, a speaker, a tablet computer, or other suitable device. Accordingly, a response can be provided by the user via pressing a button representing one of a plurality of available responses, typing a response, touching or clicking on an object on one of the display 140 or a screen of the user input/output component 130 , verbalizing the desired response, or making a gesture representing the desired response. To this end, the user input/output component 130 can include appropriate pattern recognition software for recognizing responses in detected speech or gestures.
  • the user input/output component 130 is intended primarily for the user to provide answers to the interactive overlay status questions, the present invention contemplates that the user input/output component 130 can be configured to receive information from the overlay component 200 as well. For example, feedback can be provided in response to a question, such as a green light for an accepted answer, or a red light or vibration for an unaccepted answer. Further, if the user input/output component 130 is capable of displaying information, such as a smartphone or tablet computer, additional features are possible. For example, explanations for accepted and unaccepted responses and/or hyperlinks to related information may be displayed, as well as scores displayed and messages shared with the administrator.
  • FIG. 2 illustrates an example of an overlay component 200 in accordance with an aspect of the invention.
  • the overlay component 200 comprises a software or firmware overlay application 230 that combines content from a player component 250 and an overlay generator 220 .
  • the overlay application 230 can be implemented as machine readable instructions stored on a non-transitory computer readable medium 260 and executable by an associated processor 240 .
  • the combined content is presented to a display 242 .
  • the display 242 can be a visual display of a computer output, television, or viewing device associated with a content providing device.
  • the display 242 comprises a display screen on which content is displayed, including the interactive overlay as described herein.
  • the overlay component 200 comprises a video interface 252 that collects content from a player component 250 that is operatively connected to a video source 256 and contains a storage component 254 .
  • the video source 256 can provide content from any of a variety of sources, including streaming content, computer readable media storing audio-visual content, and game consoles.
  • the storage component 254 can be a non-transitory computer readable medium.
  • the content is then outputted by the player component 250 through the video interface 252 to the overlay application 230 .
  • the overlay generator 220 is connected to a network interface 210 , which further connected to a server 212 and one or more input devices 214 .
  • the server 212 may be used by the administrator to configure the rules and initiate a sequence that meets the desired goal for the user.
  • the input device 214 is intended for collecting user input in response to overlay status questions.
  • the overlay application 230 combines video output from the player component 250 and the overlay generator 220 to be configured by the processor 240 for the display 242 .
  • the system described in FIGS. 1 and 2 can be a separate “stand alone” components can be implemented as software on a common non-transitory computer readable medium with the player component 250 .
  • FIG. 3 illustrates an example of an interactive overlay sequence 300 in accordance with an aspect of the invention.
  • the interactive overlay sequence 300 can be implemented in the interactive overlay system 100 of FIG. 1 .
  • an interactive overlay sequence 300 is outlined. The sequence begins with video content displayed on a screen, as shown in reference 310 .
  • an interactive overlay sequence defined by a set of rules is initiated.
  • Step 330 has an interactive overlay in a notification status displayed on the display screen for a predetermined amount of time, obscuring a portion of the video content.
  • an interactive overlay in a text status follows the notification status.
  • the text status presents a question and multiple answers to the user, requesting a response.
  • the user provides one of multiple responses in step 350 .
  • decision point 350 if the user provides a first response, then a first change to the text status will occur 370 . If the user provides a second response, a second change to the text status is provided in step 380 .
  • FIG. 4 is an expansion of the method of FIG. 3 .
  • an administrator initiates the interactive overlay sequence and attendant rules in step 420 .
  • a partially transparent interactive overlay status is displayed for a predetermined time in step 430 .
  • another overlay status is provided with questions and multiple responses, as shown in step 432 .
  • the user's response is considered at decision point 450 , to determine if the response is accepted (Y) or unaccepted (N).
  • Y accepted
  • N unaccepted
  • a first response can correspond to an accepted response
  • a second response can correspond to an unaccepted response.
  • the overlay component reacts with a favorable time adjustment in step 460 .
  • the overlay component provides unfavorable feedback at step 470 .
  • Unfavorable feedback options will vary with the application and can be specified by an administrator when configuring the overlay sequence. Accordingly, for a given overlay sequence, any of a number of types of feedback can be selected for presentation after an unaccepted response. In one implementation, an unaccepted response results in an unfavorable time adjustment. As described herein, some users may desire less frequent questions. For example, while the user is playing a video game he or she may considers frequently displaying overlay status a distraction. Accordingly, an unacceptable response would result in unfavorable feedback that increases the frequency with which the overlay statuses are presented.
  • an unaccepted response could elicit an accepted response to be highlighted.
  • the highlight could be opaque, or increase the area obscured by the interactive overlay.
  • the overlay can include an explanation of the correct response or can prompt a hyperlink to appear, which if selected could display a stored explanation of the accepted response or send the user to a webpage with additional information.
  • the system can react to an unaccepted response by substantially obscuring the video content in an area encompassing the centroid of the video screen for a set time period or until a desired response is achieved. Additionally or alternatively, the overlay may flash, bounce around the screen, or otherwise behave in a manner intended to distract from the underlying content.
  • Such a response might be used, for example, when the unaccepted response is a failure to respond.
  • Both favorable and unfavorable user responses yield to decision point 480 , where it is determined whether more questions are appropriate, thus repeating the sequence at start point 400 , or ending the sequence at endpoint 490 .
  • the interactive overlay sequence 300 is not limited to the examples of FIG. 3 and FIG. 4 , but that any suitable sequence may be implemented in accordance with varying rules and content as chosen by the administrator. Further, the sequence illustrated in FIG. 3 and FIG. 4 follow only one series of method steps in a particular order, whereas the sequence may be modified by the administrator according to the particular goal to be achieved.
  • FIG. 5 is a schematic block diagram illustrating an exemplary system 600 of hardware components capable of implementing examples of the present invention disclosed in FIGS. 1-4 , such as the interactive overlay system illustrated in FIG. 1 .
  • the system 600 can include various systems and subsystems.
  • the system 600 can be, for example, a personal computer, a laptop computer, a workstation, a computer system, an appliance, an application-specific integrated circuit (ASIC), a server, a server blade center, a server farm, or a similar device.
  • ASIC application-specific integrated circuit
  • the system 600 can include a system bus 602 , a processing unit 604 , a system memory 606 , memory devices 608 and 610 , a communication interface 612 (e.g., a network interface), a communication link 614 , a display 616 (e.g., a video screen), and an input device 618 (e.g., a keyboard and/or a mouse).
  • the system bus 602 can be in communication with the processing unit 604 and the system memory 606 .
  • the additional memory devices 608 and 610 such as a hard disk drive, server, stand alone database, or other non-volatile memory, can also be in communication with the system bus 602 .
  • the system bus 602 interconnects the processing unit 604 , the memory devices 606 - 610 , the communication interface 612 , the display 616 , and the input device 618 .
  • the system bus 602 also interconnects an additional port (not shown), such as a universal serial bus (USB) port.
  • the processing unit 604 can be a computing device and can include an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • the processing unit 604 executes a set of instructions to implement the operations of examples disclosed herein.
  • the processing unit 604 can include a processing core.
  • the additional memory devices 606 , 608 and 610 can store data, programs, instructions, database queries in text or compiled form, and any other information that can be needed to operate a computer.
  • the memories 606 , 608 and 610 can be implemented as non-transitory computer-readable media (integrated or removable) such as a memory card, disk drive, compact disk (CD), or server accessible over a network.
  • the memories 606 , 608 and 610 can store text, images, video, and/or audio, along with appropriate instructions to make the stored data available at an associated display 616 in a human comprehensible form.
  • the memory devices 608 and 610 can serve as databases or data storage for the interactive overlay system illustrated in FIG. 1 .
  • the system 600 can access an external data source through the communication interface 612 , which can communicate with the system bus 602 and the communication link 614 .
  • the system 600 can be used to implement a control system for an interactive overlay system that governs the interaction between the administrator and user.
  • Computer executable logic for implementing the interactive overlay system resides on one or more of the system memory 606 and the memory devices 608 , 610 in accordance with certain examples.
  • the processing unit 604 executes one or more computer executable instructions originating from the system memory 606 and the memory devices 608 and 610 .
  • the term “computer readable medium” as used herein refers to a medium that participates in providing instructions to the processing unit 604 for execution, and can include multiple physical memory components linked to the processor via appropriate data connections.

Abstract

Systems and methods are provided for an interactive overlay system. A player component is configured to display video content on a display screen of a display device. An overlay component is configured to display an interactive overlay sequence on the display screen simultaneously with and independent of the video content. An input device is configured to provide an input from a user. A status of the interactive overlay sequence is responsive to the input from the user such that a presentation of the interactive overlay is changed in response to the input from the user.

Description

    RELATED APPLICATION
  • The present application claims priority to U.S. Provisional Patent Application Ser. No. 61/681,801 filed Aug. 10, 2012 entitled INTERACTIVE OVERLAY FOR VIDEO APPLICATIONS under Attorney Docket Number GPI-021433 US PRO, the entire contents of which being incorporated herein by reference in its entirety for all purposes.
  • TECHNICAL FIELD
  • The present invention relates generally to interactive overlay systems, and specifically to an interactive overlay that obscures a portion of a screen of video content while operating simultaneously and independently of the video content.
  • BACKGROUND
  • Video content, including gaming, audio-visual programming, and computer centric media, is widely available and increasingly occupies the attention and time of many. As the range of activities accomplished with a computer increases, new and innovative ways to provide an interface with a computer are often developed to complement the changes in computer functionality and packaging.
  • SUMMARY
  • A system and method is provided for an interactive overlay system. The system comprises an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of the program content. The interactive overlay also comprises at least one overlay status. The system further comprises an input device capable of providing multiple inputs from a user. The overlay component is configured to change the status of the interactive overlay on the display screen in response to user input in accordance with rules defined by the administrator. The interactive overlay may be partially transparent, opaque, or any variation thereof.
  • Another embodiment of the present invention includes a method for providing an interactive overlay sequence. Included are the actions of displaying video content on a display screen. On the display, an overlay sequence in accordance with a set of interactive overlay rules is initiated. The interactive overlay can begin with a notification status being displaying for a predetermined amount of time, the notification status providing information or instruction for the upcoming overlay sequence. The notification status is followed by a text status requesting a response from the user. The text status can provide a question and associated answers, or can provide alternative content, as described in greater detail below. Following a text status, the user will submit, and the system will receive and process, a response from a user which prompts the system to provide feedback based on the response. The feedback given is dependent on the character of the user's response, which is governed by the rules. For example, a first response may be accepted according to the rules and result in a first, favorable change in the text status, whereas a second, unaccepted response will result in a second, unfavorable change in the text status.
  • Following either or both the notification and text statuses, a minimized window may remain on the display. The minimized window can provide limited information to the user, such as time remaining until the next question, the number of remaining questions, or that a message has been sent to the user. The administrator can modify the rules to tailor the visual presentation of the minimized window and content displayed therein.
  • Yet another embodiment of the present invention includes a method of displaying program content simultaneously with and independently of an interactive overlay on a display screen. The interactive overlay as considered by the present invention considers multiple possible modes. For example, an overlay may be presented simply to provide information. This could include notice that a sequence of overlays has been initiated, a timer, a score, a reference, and/or administrator identification information. The interactive overlay can also provide interactive content, specifically a series of questions and answers, where the user has multiple answers from which to select. Additionally, the interactive overlay may contain hyperlinks to related content or be capable of communicating with one or more system administrators with the aid of a user input device.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates an example of an interactive overlay system in accordance with an aspect of the invention.
  • FIG. 2 illustrates an example of an overlay component in accordance with an aspect of the invention.
  • FIG. 3 illustrates an example of a method for providing an interactive overlay in accordance with an aspect of the invention.
  • FIG. 4 illustrates another example of a method for providing an interactive overlay in accordance with an aspect of the invention.
  • FIG. 5 is a schematic block diagram illustrating an exemplary system of hardware components capable of implementing examples of the present disclosed in FIGS. 1-4, such as the interactive overlay system illustrated in FIG. 1
  • DETAILED DESCRIPTION
  • The present invention provides an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of a video source associated with the display. In accordance with an aspect of the present invention, the overlay is played over an existing audiovisual content source, which can be local to a user or remote (e.g., provided over a network connection). For example, the content source can include a media player, a game console, an Internet site, or broadcast/multicast video through an appropriate hardware connection. The overlay is interactive, such that input provided by the user with an associated input device can affect the appearance and behavior of the overlay, with a discrete instance of a given appearance and behavior having being referred to herein as a “status” of the overlay. For example, one status might include a “text status”, that is, a block of text (e.g., a question) that remains on the screen until a response is provided by the user. Another status might include a “notification status” that counts down a defined interval between text statuses. It will be appreciated that the interactive overlay can include a large number of individual statuses, with transitions among the statuses governed by a set of rules stored with the overlay content.
  • The overlay is presented independently of underlying content, such that there is no interaction between the overlay and other programs that may be running simultaneously. However, the overlay is interactive to the user, even as the user has a limited number of available responses when presented with an overlay. The interactive overlay may also be used to encourage a response from the user. A particular overlay status of the overlay sequence can be displayed over the program content such that a central portion (e.g., a portion encompassing a centroid of the screen) of the underlying content is obscured. This is typically a result of the user failing to respond to a question or repeated submission of unaccepted answers. Additionally the overlay may include dynamic overlays that move, flash, or present a scene that substantially obscures the underlying video content. A behavior of the overlay, specifically a response of the overlay to various user inputs during the sequence can be defined by a rule set by an administrator prior to initiation of an interactive overlay sequence. Thus, the overlay sequence is structured and initiated by the administrator without regard for or in response to the user's conduct, provided the user is logged into an authorized device running the interactive overlay system.
  • In one embodiment of the present invention, one administrator is a teacher and the user a student. The teacher, with administrator privileges, defines rules for an interactive overlay sequence. The rules govern operation of the overlay sequence complete with content, acceptable and unacceptable responses, timing constraints, and appropriate reactions to various user input. Upon initiation of the sequence, the teacher's role is that of monitor, as the sequence runs through the overlay component in accordance with the set of rules. For instance, the sequence can begin with a translucent interactive overlay status providing notice that a series of questions is upcoming. The initial overlay status is configured to expire after a predetermined amount of time, followed by an overlay status containing a question and multiple choices for a response. Depending on whether the user input is acceptable or unacceptable, the overlay status will change according to the rules as established by the teacher. For example, the overlay status might transition to a first status, representing positive feedback to the user, if an acceptable answer is received, or transition to a second status, representing negative feedback to the user, if an unacceptable answer is received.
  • The user employs an input device to provide a response to the question presented as part of the overlay. For example, a multiple choice question may be presented, wherein the user may choose from answers designated as “A, B, C,” etc., or “1, 2, 3,” etc. The input device could be, for example, a remote control, game console controller, computer keyboard, mouse, smart phone, tablet computer, camera with gesture recognition software, microphone, or other suitable device. During the interactive portion of the overlay sequence, the user has some ability to adjust the sequence progression. For example, when a student user is presented with an overlay containing a question, an acceptable response may remove the overlay or change an overlay status to be less obtrusive, until a predetermined period of time has elapsed. An unacceptable response may cause the overlay to be maintained in present form, changed to a more obtrusive status, or removed or made less obtrusive for a period of time less than the period of time following an acceptable response.
  • In one implementation, the overlay can be used to deliver questions to the user, which can be answered via the input device, with the response given by the user affecting some aspect of the overlay appearance and behavior, such as size, opacity, or frequency with which the overlay is displayed. Repeated unaccepted responses or failure to respond can result in changes to the overlay that obscure or distract from the underlying audiovisual content. These changes can be configured by an administrator to facilitate cooperation from the user in answering the questions provided. It is envisioned that a system in accordance with an aspect of the present invention could be employed as an educational tool to encourage a user, such as a student, to complete homework or supplementary educational material, either before or during recreational activities such as watching television, using a computer, tablet device, or smart phone, or playing console video games.
  • In another embodiment of the present invention, the user may be viewing video content that constitutes a lesson, webinar, or other task required by the administrator. In the example of a web based lecture viewed on a computing platform, the user may have access to additional content or applications. For example, the computer may have a web browser, game software, an instant messaging application, video viewing software, or similar applications that would distract the user from the base, required task. In accordance with other aspects of the invention, the administrator may set rules that restrict what other programs or applications are available while the user is engaged with the required task. The restriction may forbid access entirely or limit the amount of time such program or application may be accessed. Accordingly, an overlay status may be triggered if the user violates the rules set by the administrator. The overlay status may partially obscure the additional content, the display screen, or otherwise grab the attention of the user. The overlay status may require the user to acknowledge the overlay status in order to have it removed, or simply discontinue use of the additional content that constituted the violation.
  • As employed herein, an administrator is an individual with privileges that allow him or her to define rules governing an interactive overlay sequence or initiate the sequence. The present invention contemplates a variety of applications where the administrator's role would be defined in accordance with the relationship with the user as well as the desired goal for the particular sequence. An administrator may be a parent, counselor, instructor, an administrator at an educational institution, or other individual or organization providing overlay content intended for the benefit of the user. For example, an administrator may be a teacher and the user a student. In this case, the administrator may present academic questions related to educational goals. An administrator may also be a counselor, presenting questions or asking for feedback to aid in the user's development. Moreover, as the present invention is not limited to educational content, the user can also be an administrator. The administrator may present a sequence in a trivia contest related to underlying content on the display, for example, where the administrator can be one of the participants.
  • As such, the user can be given administrative privileges to more personally customize the overlay system for their individual use. Accordingly, a user can have control over when an overlay is presented, the amount of time it remains on the screen, the content provided, as well as control over the visual aspects of the overlay itself. If the user is watching a television program, for example, the user can choose to initiate an overlay during a commercial break in the program of interest. The overlay may be chosen to cover all or a portion of the screen and the user can discontinue the overlay when the program resumes. The overlay can contain any conceivable digital content, such as the lessons described herein, or can provide links to other types of information, such as an RSS feed, webpage, picture folder, or minor another connected device.
  • In another aspect of the present invention, the relationship between administrator and user is important with respect to the type and content of the sequence. A typical user may be a student or child, wherein the administrator seeks to introduce or reinforce a lesson. Thus, a parent may also serve as an administrator, and tailor questions and responses for a variety of goals. The invention described can also be used for entertainment purposes, for example, with the interactive overlay providing content associated with the base video content.
  • The administrator has authority to define a set of rules to govern one or more interactive overlay sequences. Each interactive overlay sequence can be configured to respond to multiple user inputs. According to the rules set by the administrator, an acceptable user input leads to a particular set of actions, wherein an unacceptable user input leads to a different set of actions. The administrator can configure an interactive overlay sequence to meet a desired goal with respect to the user. For example, if the administrator is a teacher who wishes to reinforce, say, a history lesson, the administrator will load a series of history questions to be presented in the interactive overlay statuses. In such a case, the administrator can define rules such that an accepted response reduces a number of required questions or extends a time interval between questions, and an unaccepted response requires additional questions or decreases the time interval between questions.
  • The interactive overlay can be translucent or opaque, and may include both audio and video components. In one implementation, the interactive overlay is displayed as translucent to ensure that the video content on the display screen is still partially visible, thereby attracting the attention of the user while allowing the user to maintain limited visibility of the video content. In accordance with one aspect of the invention, an overlay is intended to obscure an insubstantial portion of the display screen unless or until the user provides an unaccepted response or fails to respond within a predetermined time period. For example, if an unaccepted response is given, the translucent overlay may become opaque or enlarged, in order to highlight an accepted response. As a further example, if the user fails to provide any response within a predetermined time period, additional overlay statuses may be presented. These additional overlay statuses may cover a substantial portion of the screen and/or may encompass the centroid of the viewing area of the video content. Further examples are contemplated, in which more than one overlay may be used to obscure the viewing area, the overlay may move about in the viewing area of the display screen, the overlay may flash brightly, or the overlay is otherwise dynamic to maintain the attention of the user. The overlay can also employ other attention grabbing tools, such as animated characters, audio signals, or customized alerts.
  • Rules can be applied to the overlays such that the display is partially or fully obscured. Further, in a sequence of overlays, the shape, size and character of the overlay can change. For example, the first overlay can first be presented as substantially transparent, obscuring a minor portion of the display, and stationary. However, if the user ignores the overlay or fails to provide acceptable responses, the overlay can become increasing opaque, obscuring a larger portion of the screen, and move randomly across the display. The same modifications to the overlay can be made for future or additional overlays, as the administrator sees fit.
  • The administrator provides content for and rules to define the user experience, for example, on a server hosting software for providing the overlay content. For instance, an overlay sequence may be structured as a history lesson presented with a video game playing concurrently. The sequence may start with an initial notification status presented in a portion of the display screen that does not significantly obscure or distract from the underlying content to alert the user that a sequence of questions has been initiated. This notification status may transition to a text status automatically at the end of a predetermined time or may require acknowledgment from the user. The text status can present a question and multiple answers from which the user must choose. The overlay status would change according to the rules as defined by the administrator, as described above. Regardless of the response being accepted or unaccepted, the status will update according to the set of rules defined by the administrator for the overlay sequence. In one embodiment, the administrator may initiate a sequence in advance. When the user attempts to access video content or games, the user is then prompted to log in to the interactive overlay system to gain access to both. By this action, access to the video content or game is allowed, and the sequence is presented concurrently to the user, who responds accordingly.
  • The interactive overlay further comprises a variety of overlay statuses. An individual status, as used herein, represents a configuration of the appearance and behavior of the overlay having different properties from the other statuses in the sequence. Each overlay status can be configured to respond to multiple user inputs. Typically, but not necessarily, the sequence will begin with a notification status. This may provide information to the user such as the number of questions in the sequence, the amount of time between questions, and the topic of the upcoming sequence. Again, typically but not necessarily, this notification status will be replaced with a text status after a predetermined time as a second status is presented. However, the notification could require the user to select from a catalogue of choices before the remainder of the sequence is presented.
  • When the interactive overlay statuses present questions, the user is then encouraged to respond by inputting one of multiple available responses. The overlay may present a question as a text status displayed on a screen, through audio (e.g., a recording by an administrator or other content provider or machine rendered speech), or other available method. The method could employ, for example, a vibrating hand held controller. The user may then respond by use of any of multiple devices including, but not limited to, an input/output device, a microphone configured to receive an audio response, and a camera configured for gesture recognition. The user inputs are then subject to the rules as defined by the administrator when the sequence was initiated. However, the administrator has the capability to modify the rules during an active overlay sequence if desired.
  • In one embodiment of the invention, an acceptable response will lead to a change in the frequency of the sequence that favors the user. For example, if the user is playing a computer game, and the administrator initiates a sequence of educational questions in the interactive overlay, the user may desire the sequence to repeat less frequently. Alternatively, if the user is competing in a trivia contest related to the underlying video content, a favorable response may increase the frequency of questions in order to increase the user's score.
  • In the event that an unfavorable response is received, the rule set defined by the administrator is invoked to determine how the overlay will be changed. As described above, depending on the application, limiting or increasing the frequency of questions may challenge the user experience. An unaccepted response could prompt an accepted answer to be highlighted. Typically, this result would follow a predetermined number of unaccepted answers. This could also prompt an explanation for the accepted answer or a hyperlink to additional information regarding the question. The rules may also invoke an overlay that obscures a significant portion of the video. Also, a central portion of the screen may be obscured by an opaque or partially transparent overlay in response to an unaccepted response. In the event that no response is received, an overlay component may invoke an overlay that obscures a significant portion of the screen or otherwise interferes with enjoyment of the underlying content to encourage a response. For example, the overlay could increase in size or opacity, begin moving or flashing, or begin providing audio unassociated with the underlying content.
  • An administrator has privileged access to the program engine that includes several features that aid the administrator in configuring an overlay sequence that guides the user experience. The administrator gains access to the program engine, for example, by logging onto a server hosting the software that provides the overlay content. The administrator may then create an account for a user, or select an existing account that the administrator is privileged to access. Features available to the administrator include, but are not limited to, the subject matter of the overlay prompts, how the status is displayed, on which devices the overlay will appear, how progress is gauged, what constitutes an accepted or unaccepted response, what consequence results from an accepted or unaccepted response, what consequence results from a lack of response, the timing and frequency of overlay prompts, and similar configuration parameters for the overlay sequence provided to the user.
  • For example, if the administrator is a teacher and the user a student, the administrator may set an academic goal for the user. The goal may be providing a favorable response on 90% of a set of questions within a predetermined timeframe. For instance, a single history lesson may be due in one evening, with ten questions presented to the user. The administrator may select the topic, specify questions to present to the user, and define the timeframe in which the user must complete the lesson. When the user begins a video game or other audiovisual entertainment a sequence of overlay statuses representing the defined questions is initiated. The ten questions may appear at six minute increments, for a goal of completing in an hour's time. Once begun, if a response is unaccepted, the time between questions may decrease, to allow for a greater number of questions. If the response is accepted, the time between questions may increase. This may result in only nine questions presented during the hour, while still achieving the initial goal.
  • There may be multiple features available to the user to reach this goal. For instance, the administrator may offer the user the option to log on to a computer program that provides a dedicated lesson where the student may answer questions uninterrupted in advance of turning to video content. This action could decrease the number or frequency of question prompts, or could satisfy the lesson requirement altogether. Alternatively, if the user fails to cooperate with the lesson provided, the user can be locked out from utilizing authorized devices or be blocked from accessing audio-visual or other content altogether in accordance with the set of rules governing that user log in. At this point, the administrator would be required to reset the sequence in order to allow the user to access content in the future.
  • The system assigns each user a unique log in. This log in can be used to tailor many of the features available from the system. For example, the log in identifies the user, such as a student, where an administrator, such as teacher or parent, can create rules for governing the particular user's device use. The administrator can further tailor lessons and provide content or messages for the particular user.
  • Each authorized device operating on the system can be configured to recognize an individual log in. Thus, the log in is intended to follow the user on each device. For example, a user may have an authorized portable device (e.g., tablet, gaming console, or smart phone), a stationary computing platform (e.g., desktop computer, gaming system, or television), as well as an authorized shared device (e.g., a classroom computer). Accordingly, as the user accesses each device, the system recognizes the user as being active on the device, and can provide overlays and lessons as set by an administrator. This is particularly useful if the user is disrupted in the middle of a lesson (say, the end of class). However, the system can also adapt to the situation where a user switches from one device to another, for example, at the end of a television program or a battery goes flat in a device. Additionally, this feature prohibits the user from attempting to avoid completing a lesson by switching from a first device where an overlay screen is obscuring the display to a second device were the lesson had not been initiated. Thus, the system can recognize that a user has switched devices, and the lesson in progress will reinitiate in the second device.
  • The system is further configured to recognize multiple authorized users active on a single authorized device. For example, two or more users can be engaged in a multiplayer game running on a single gaming device. The device can be configured to dedicate a separate portion of the screen for each user. Thus, as the system operates according to the rules as applied to the individual user, that user's screen can be subject to the same lessons and associated overlays as if that user was using the device individually. As noted previously, this feature advantageously follows a user when the user switches or attempts to access another device, even as the other device may belong to another authorized user.
  • In a classroom setting, for example, a lesson can be provided allowing for immediate feedback from connected, authorized users. Thus, a question can be provided with a multiple answers, and the users can input answers to be displayed on common screen. This allows for the instructor to receive instant feedback, to better identify challenging subject matter and guide the class through the lesson.
  • Additionally, the multiple authorized users may be presented with the same overlay obscuring a shared portion of the display. For example, the overlay can present a lesson to the users as a competition where the provided questions can earn points to a user for answering questions quickly and correctly. In this implementation, the multiple users can be collocated and viewing the same device or different devices, or may be located in different locations utilizing different devices when the lesson is presented.
  • The system is configured to provide feedback in a variety of ways to both the administrator and the user. Feedback is structured to change the overlay sequence in a way that enhances the user experience. To continue with our example, an unobtrusive overlay may be present on the display screen between question prompts that shows number of questions presented or remaining, number of responses accepted or unaccepted, the time until the next question, and progress in reaching the assigned goal. The administrator may set rules that govern what is displayed, in what format, and for what duration. The administrator has a separate set of tools to gauge user performance. The administrator has access to view the user responses, including not only accepted and unaccepted responses, but the time taken to answer as well as the number of overlays displayed before a response was given. Further, the administrator has the authority to modify the sequence in response to the user's performance as the sequence plays out. If a user is particularly slow to respond, the frequency and/or size of the overlay may be increased, for example. Additionally, the administrator and user may both have access to historical data and statistics, including number of sequences initiated, the user's performance, the types of lessons completed, the user's performance relative to peers, and similar information. Access to some information and configuration options may be limited according to a level of privilege provided to a given administrator.
  • FIG. 1 illustrates an example of an interactive overlay system 100 in accordance with an aspect of the invention. The interactive overlay system 100 includes an overlay component 200, a video component 110, a user input/output component 130, a display 140 and a server 150. The overlay component 200 can be configured to display an interactive overlay on a display screen simultaneously with and independent of video or other programming provided by the video component 110. It will be appreciated that the term “video” as used herein, is intended to encompass both the visible and audible content (if any) provided from the video component. The overlay component 200, as pertaining to an embodiment of the present invention, is described with greater detail with respect to FIG. 2. As described herein, the overlay component 200 is configured to allow video content from the video component 110 to be displayed as a base content, while presenting interactive overlays thereon. The video component 110 may include a video game console, television component, DVD player, Internet browser, or other device or software configured to provide video content.
  • The user input/output component 130 may include, for example, a remote control, a game console controller, a computer keyboard, a mouse, a smartphone, a microphone, a sensor configured to detect visible, infrared, and ultraviolet light radiating or reflected from the user, a speaker, a tablet computer, or other suitable device. Accordingly, a response can be provided by the user via pressing a button representing one of a plurality of available responses, typing a response, touching or clicking on an object on one of the display 140 or a screen of the user input/output component 130, verbalizing the desired response, or making a gesture representing the desired response. To this end, the user input/output component 130 can include appropriate pattern recognition software for recognizing responses in detected speech or gestures.
  • Although the user input/output component 130 is intended primarily for the user to provide answers to the interactive overlay status questions, the present invention contemplates that the user input/output component 130 can be configured to receive information from the overlay component 200 as well. For example, feedback can be provided in response to a question, such as a green light for an accepted answer, or a red light or vibration for an unaccepted answer. Further, if the user input/output component 130 is capable of displaying information, such as a smartphone or tablet computer, additional features are possible. For example, explanations for accepted and unaccepted responses and/or hyperlinks to related information may be displayed, as well as scores displayed and messages shared with the administrator.
  • FIG. 2 illustrates an example of an overlay component 200 in accordance with an aspect of the invention. The overlay component 200 comprises a software or firmware overlay application 230 that combines content from a player component 250 and an overlay generator 220. The overlay application 230 can be implemented as machine readable instructions stored on a non-transitory computer readable medium 260 and executable by an associated processor 240. The combined content is presented to a display 242. The display 242 can be a visual display of a computer output, television, or viewing device associated with a content providing device. The display 242 comprises a display screen on which content is displayed, including the interactive overlay as described herein. The overlay component 200 comprises a video interface 252 that collects content from a player component 250 that is operatively connected to a video source 256 and contains a storage component 254. The video source 256 can provide content from any of a variety of sources, including streaming content, computer readable media storing audio-visual content, and game consoles. The storage component 254 can be a non-transitory computer readable medium. The content is then outputted by the player component 250 through the video interface 252 to the overlay application 230. The overlay generator 220 is connected to a network interface 210, which further connected to a server 212 and one or more input devices 214. The server 212 may be used by the administrator to configure the rules and initiate a sequence that meets the desired goal for the user. The input device 214 is intended for collecting user input in response to overlay status questions. As described herein, the overlay application 230 combines video output from the player component 250 and the overlay generator 220 to be configured by the processor 240 for the display 242. The system described in FIGS. 1 and 2 can be a separate “stand alone” components can be implemented as software on a common non-transitory computer readable medium with the player component 250.
  • FIG. 3 illustrates an example of an interactive overlay sequence 300 in accordance with an aspect of the invention. The interactive overlay sequence 300 can be implemented in the interactive overlay system 100 of FIG. 1. As such, reference is to be made to the example of FIG. 1 in the following discussion of the example of FIG. 3.
  • In the example of FIG. 3, an interactive overlay sequence 300 is outlined. The sequence begins with video content displayed on a screen, as shown in reference 310. In step 320, an interactive overlay sequence defined by a set of rules is initiated. Step 330 has an interactive overlay in a notification status displayed on the display screen for a predetermined amount of time, obscuring a portion of the video content. In step 340 an interactive overlay in a text status follows the notification status. The text status presents a question and multiple answers to the user, requesting a response. The user provides one of multiple responses in step 350. At decision point 350, if the user provides a first response, then a first change to the text status will occur 370. If the user provides a second response, a second change to the text status is provided in step 380.
  • FIG. 4 is an expansion of the method of FIG. 3. Following the display of video content 410, an administrator initiates the interactive overlay sequence and attendant rules in step 420. A partially transparent interactive overlay status is displayed for a predetermined time in step 430. Upon expiration of the predetermined time, another overlay status is provided with questions and multiple responses, as shown in step 432. The user's response, as shown in step 440, is considered at decision point 450, to determine if the response is accepted (Y) or unaccepted (N). As explained with respect to FIG. 3, a first response can correspond to an accepted response, and a second response can correspond to an unaccepted response. Thus, if the response is accepted, the overlay component reacts with a favorable time adjustment in step 460. If the response is not accepted, which can include a failure to respond, the overlay component provides unfavorable feedback at step 470.
  • Unfavorable feedback options will vary with the application and can be specified by an administrator when configuring the overlay sequence. Accordingly, for a given overlay sequence, any of a number of types of feedback can be selected for presentation after an unaccepted response. In one implementation, an unaccepted response results in an unfavorable time adjustment. As described herein, some users may desire less frequent questions. For example, while the user is playing a video game he or she may considers frequently displaying overlay status a distraction. Accordingly, an unacceptable response would result in unfavorable feedback that increases the frequency with which the overlay statuses are presented.
  • In another implementation, an unaccepted response could elicit an accepted response to be highlighted. The highlight could be opaque, or increase the area obscured by the interactive overlay. In one implementation, the overlay can include an explanation of the correct response or can prompt a hyperlink to appear, which if selected could display a stored explanation of the accepted response or send the user to a webpage with additional information. In yet another implementation, the system can react to an unaccepted response by substantially obscuring the video content in an area encompassing the centroid of the video screen for a set time period or until a desired response is achieved. Additionally or alternatively, the overlay may flash, bounce around the screen, or otherwise behave in a manner intended to distract from the underlying content. Such a response might be used, for example, when the unaccepted response is a failure to respond. Both favorable and unfavorable user responses yield to decision point 480, where it is determined whether more questions are appropriate, thus repeating the sequence at start point 400, or ending the sequence at endpoint 490.
  • It is to be understood, however, that the interactive overlay sequence 300 is not limited to the examples of FIG. 3 and FIG. 4, but that any suitable sequence may be implemented in accordance with varying rules and content as chosen by the administrator. Further, the sequence illustrated in FIG. 3 and FIG. 4 follow only one series of method steps in a particular order, whereas the sequence may be modified by the administrator according to the particular goal to be achieved.
  • FIG. 5 is a schematic block diagram illustrating an exemplary system 600 of hardware components capable of implementing examples of the present invention disclosed in FIGS. 1-4, such as the interactive overlay system illustrated in FIG. 1. The system 600 can include various systems and subsystems. The system 600 can be, for example, a personal computer, a laptop computer, a workstation, a computer system, an appliance, an application-specific integrated circuit (ASIC), a server, a server blade center, a server farm, or a similar device.
  • The system 600 can include a system bus 602, a processing unit 604, a system memory 606, memory devices 608 and 610, a communication interface 612 (e.g., a network interface), a communication link 614, a display 616 (e.g., a video screen), and an input device 618 (e.g., a keyboard and/or a mouse). The system bus 602 can be in communication with the processing unit 604 and the system memory 606. The additional memory devices 608 and 610, such as a hard disk drive, server, stand alone database, or other non-volatile memory, can also be in communication with the system bus 602. The system bus 602 interconnects the processing unit 604, the memory devices 606-610, the communication interface 612, the display 616, and the input device 618. In some examples, the system bus 602 also interconnects an additional port (not shown), such as a universal serial bus (USB) port. The processing unit 604 can be a computing device and can include an application-specific integrated circuit (ASIC). The processing unit 604 executes a set of instructions to implement the operations of examples disclosed herein. The processing unit 604 can include a processing core.
  • The additional memory devices 606, 608 and 610 can store data, programs, instructions, database queries in text or compiled form, and any other information that can be needed to operate a computer. The memories 606, 608 and 610 can be implemented as non-transitory computer-readable media (integrated or removable) such as a memory card, disk drive, compact disk (CD), or server accessible over a network. In certain examples, the memories 606, 608 and 610 can store text, images, video, and/or audio, along with appropriate instructions to make the stored data available at an associated display 616 in a human comprehensible form. Additionally, the memory devices 608 and 610 can serve as databases or data storage for the interactive overlay system illustrated in FIG. 1. Additionally or alternatively, the system 600 can access an external data source through the communication interface 612, which can communicate with the system bus 602 and the communication link 614.
  • In operation, the system 600 can be used to implement a control system for an interactive overlay system that governs the interaction between the administrator and user. Computer executable logic for implementing the interactive overlay system resides on one or more of the system memory 606 and the memory devices 608, 610 in accordance with certain examples. The processing unit 604 executes one or more computer executable instructions originating from the system memory 606 and the memory devices 608 and 610. The term “computer readable medium” as used herein refers to a medium that participates in providing instructions to the processing unit 604 for execution, and can include multiple physical memory components linked to the processor via appropriate data connections.
  • What have been described above are examples of the present invention. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the present invention, but one of ordinary skill in the art will recognize that many further combinations and permutations of the present invention are possible. Accordingly, the present invention is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims.

Claims (20)

What is claimed is:
1. An interactive overlay system comprising:
a server to store a set of rules selected by an administrator to govern presentation and content of an interactive overlay sequence;
an overlay component configured to display the interactive overlay sequence on a display screen simultaneously with video content provided from a player component independent of the server; and
an input device configured to provide an input from a user, the overlay component being responsive to the input from the user such that the status of the interactive overlay is changed in response to the input from the user according to the stored set of rules.
2. A system as recited in claim 1, wherein the overlay component further comprises:
a network interface configured to communicate with an administrator over the server or the user through the input device;
an overlay generator to generate the interactive overlay sequence in accordance with the set of rules; and
an overlay application to provide the interactive overlay sequence to the display.
3. A system as recited in claim 1, the set of rules defining a predetermined period after which, if no acceptable input from the user has been received, the overlay component changes the status of the interactive overlay to a status designed to substantially interfere with enjoyment of the underlying video content.
4. A system as recited in claim 3, wherein the set of rules defines, for a given status of the interactive overlay, a first response and a second response, and the overlay component being configured to change the associated status of the interactive overlay to a first status when the first response is received and to a second status when the second response is received.
5. A system as recited in claim 4, wherein the predetermined period is increased when the first response is received and decreased when the second response is received.
6. A system as recited in claim 1, wherein the status is a text status representing a question asked of the user, the question having at least one acceptable response and at least one unacceptable response.
7. A system as recited in claim 6, wherein the overlay component is configured to increase the defined interval when an acceptable response is received and decrease the defined interval when an unacceptable response is received.
8. A system as recited in claim 6, wherein when a number of unacceptable responses exceeds a predetermined threshold, the user is locked out from associated log ins and devices.
9. A system as recited in claim 1, wherein the user has a single log in that provides access to a plurality of authorized display devices, such that an associated status of the interactive overlay is substantially identical across the plurality of display devices.
10. A system as recited in claim 1, wherein the system is configured to recognize a plurality of users and allow access for the plurality of users to one or more display devices simultaneously.
11. A system as recited in claim 10, wherein an unaccepted response from one of the plurality of users prompts an overlay to selectively obscure a portion of the display associated with the individual user's screen of interest.
12. A system as recited in claim 1, wherein the set of rules governing the overlay sequence can be edited by an administrator via a remote computer.
13. A method for providing an interactive overlay sequence, comprising:
displaying video content on a display screen;
initiating the interactive overlay sequence in accordance with a set of interactive overlay rules;
displaying an interactive overlay in a notification status on the display screen for a predetermined amount of time;
displaying an interactive overlay in a text status following the predetermined amount of time, the text status requesting a response from the user;
receiving a response from a user; and
providing feedback to the user based on the response, wherein a first response from the user will result in a first change in the text status and a second response will result in a second change in the text status, the first change and the second change in the text status being different.
14. The method of claim 13 wherein a source of the video content is independent of a server storing the set of interactive overlay rules.
15. The method of claim 13 wherein the first response is an accepted response resulting in the first change providing favorable feedback, and the second response is an unaccepted response resulting in the second change providing unfavorable feedback.
16. The method of claim 13 wherein initiating the interactive overlay sequence is performed through a server.
17. The method of claim 16 wherein unfavorable feedback is one of enlarging the interactive overlay, moving the interactive overlay around the display, making the interactive overlay opaque, and locating the interactive overlay in the centroid of the display.
18. The method of claim 13 wherein the first change is an increase in time between displaying subsequent statuses in the overlay sequence and the second change is a decrease in time between displaying subsequent statuses in the overlay sequence.
19. The method of claim 13 further comprising accepting an administrative log in allowing an administrator to modify the set of interactive overlay rules during the interactive overlay sequence.
20. A method for providing an interactive overlay sequence, comprising:
displaying video content on a display screen;
initiating the interactive overlay sequence in accordance with a set of interactive overlay rules;
displaying a question for a user as part of the interactive overlay sequence after a period of time defined by the set of interactive overlay rules; and
providing feedback to the user, such that a correct response from the user results in positive feedback and an increase in the period of time before a next question in the interactive overlay sequence, a incorrect response from the user results in negative feedback and an decrease in the period of time before the next question, and a failure of the user to respond results in a change to the interactive overlay sequence to substantially obscure the video content.
US13/963,595 2012-08-10 2013-08-09 Interactive overlay for video applications Abandoned US20150040008A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/963,595 US20150040008A1 (en) 2013-08-02 2013-08-09 Interactive overlay for video applications
CA 2823746 CA2823746A1 (en) 2012-08-10 2013-08-12 Interactive overlay for video applications

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201361861801P 2013-08-02 2013-08-02
US13/963,595 US20150040008A1 (en) 2013-08-02 2013-08-09 Interactive overlay for video applications

Publications (1)

Publication Number Publication Date
US20150040008A1 true US20150040008A1 (en) 2015-02-05

Family

ID=52428297

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/963,595 Abandoned US20150040008A1 (en) 2012-08-10 2013-08-09 Interactive overlay for video applications
US14/450,805 Active 2034-08-28 US9971004B2 (en) 2013-08-02 2014-08-04 Treatment planning and delivery using temperature uncertainty maps

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/450,805 Active 2034-08-28 US9971004B2 (en) 2013-08-02 2014-08-04 Treatment planning and delivery using temperature uncertainty maps

Country Status (6)

Country Link
US (2) US20150040008A1 (en)
EP (1) EP2869776B1 (en)
CA (1) CA2881596C (en)
DE (1) DE14814725T1 (en)
ES (1) ES2781763T3 (en)
WO (1) WO2015015307A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170371853A1 (en) * 2016-06-28 2017-12-28 Google Inc. Measurement of visibility of overlay content
WO2018213745A1 (en) * 2017-05-18 2018-11-22 Aiqudo, Inc. Optimizing display engagement in action automation
US10768425B2 (en) * 2017-02-14 2020-09-08 Securiport Llc Augmented reality monitoring of border control systems
US11531465B2 (en) * 2018-04-17 2022-12-20 Casio Computer Co., Ltd. Display control apparatus, non-transitory recording medium and display controlling method for creating first tag, second tag not overlapping other tags displayed, and indicator correlating second tag with first tag

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016211821A1 (en) * 2016-06-30 2018-01-04 Robert Bosch Gmbh Method for non-contact determination of a temperature and infrared measuring system
WO2019086921A1 (en) * 2017-10-30 2019-05-09 Profound Medical Inc. Thermal therapy with dynamic anatomical boundaries using mri-based temperature uncertainty maps
US11471053B2 (en) 2017-10-30 2022-10-18 Profound Medical Inc. Thermal therapy with dynamic anatomical boundaries using MRI-based temperature uncertainty maps
US10677866B1 (en) * 2018-11-28 2020-06-09 Insightec, Ltd. Systems and methods for correcting measurement artifacts in MR thermometry
US11442128B2 (en) * 2019-10-01 2022-09-13 Profound Medical Inc. Method for filtering erroneous pixels in a thermal therapy control system
US20210161588A1 (en) * 2019-11-29 2021-06-03 Canon Medical Systems Corporation Medical image processing apparatus
FR3121345A1 (en) * 2021-03-31 2022-10-07 Universite de Bordeaux Heat treatment set
DE102021123863A1 (en) 2021-09-15 2023-03-16 Medizinische Hochschule Hannover, Körperschaft des öffentlichen Rechts Method and evaluation device for evaluating acquisition data from an MRT system and computer program

Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5219291A (en) * 1987-10-28 1993-06-15 Video Technology Industries, Inc. Electronic educational video system apparatus
US5734853A (en) * 1992-12-09 1998-03-31 Discovery Communications, Inc. Set top terminal for cable television delivery systems
US6201538B1 (en) * 1998-01-05 2001-03-13 Amiga Development Llc Controlling the layout of graphics in a television environment
US20030077559A1 (en) * 2001-10-05 2003-04-24 Braunberger Alfred S. Method and apparatus for periodically questioning a user using a computer system or other device to facilitate memorization and learning of information
US20030165802A1 (en) * 2002-03-04 2003-09-04 Murphy Rick L. Method, device and system for providing educational services
US20030217166A1 (en) * 2002-05-17 2003-11-20 Mario Dal Canto System and method for provisioning universal stateless digital and computing services
US20040122898A1 (en) * 2002-12-20 2004-06-24 International Business Machines Corporation Collaborative review of distributed content
US20040241633A1 (en) * 2003-05-28 2004-12-02 Drozda William P. Professor pop-up & method
US20050028191A1 (en) * 1999-08-17 2005-02-03 Sullivan Gary E. Content control system
US20050089834A1 (en) * 2003-10-23 2005-04-28 Shapiro Jeffrey S. Educational computer program
US20060015580A1 (en) * 2004-07-01 2006-01-19 Home Box Office, A Delaware Corporation Multimedia content distribution
US20070037131A1 (en) * 2005-08-11 2007-02-15 Anderson Joseph M Incentivized educational device and method
US20070160969A1 (en) * 2006-01-11 2007-07-12 Barton Benny M Method and Apparatus for Associating User Evaluations with Independent Content Sources
US20080094413A1 (en) * 2006-10-24 2008-04-24 Autor Jeffrey S Display controller
US20080160974A1 (en) * 2006-12-29 2008-07-03 Nokia Corporation Transferring task completion to another device
US20090165033A1 (en) * 2007-12-19 2009-06-25 General Instrument Corporation Content Viewing as an Incentive for Educational Activities
US20090178114A1 (en) * 2008-01-09 2009-07-09 Aviva Susser Educational log-on method
US20090202968A1 (en) * 2008-02-13 2009-08-13 Popspring Llc Systems and Methods for Combining Electronic Educational and Entertainment Media
US7624355B2 (en) * 2004-05-27 2009-11-24 Baneth Robin C System and method for controlling a user interface
US20100325527A1 (en) * 2009-06-18 2010-12-23 Microsoft Corporation Overlay for digital annotations
US20110023063A1 (en) * 2009-07-23 2011-01-27 Fmr Llc Inserting Personalized Information into Digital Content
US20110167355A1 (en) * 2010-01-04 2011-07-07 Samsung Electronics Co., Ltd. Method and system for providing users login access to multiple devices via a communication system
US20120078720A1 (en) * 2010-09-28 2012-03-29 Startforce, Inc. Virtual desktop service with targeted advertisement
US20120172100A1 (en) * 2011-01-03 2012-07-05 International Business Machines Corporation Virtual Lesson Plan Integration
US20130212396A1 (en) * 2012-02-10 2013-08-15 Zynga Inc. Methods and Systems for State Synchronization Over a Non-Reliable Network Using Signature Processing
US20130244784A1 (en) * 2008-11-04 2013-09-19 Quado Media Inc. Multi-player, multi-screens, electronic gaming platform and system
US20140359637A1 (en) * 2013-06-03 2014-12-04 Microsoft Corporation Task continuance across devices

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US787920A (en) 1904-03-31 1905-04-25 Frederick Hofmann Medical apparatus.
US4844073A (en) 1986-12-01 1989-07-04 Jerzy Pohler Device for treatment of hemorroids and rectal tissue after surgery treatment
US4841970A (en) 1988-01-26 1989-06-27 Herbert Rand Cryogenic rectal insert
US5316000A (en) 1991-03-05 1994-05-31 Technomed International (Societe Anonyme) Use of at least one composite piezoelectric transducer in the manufacture of an ultrasonic therapy apparatus for applying therapy, in a body zone, in particular to concretions, to tissue, or to bones, of a living being and method of ultrasonic therapy
US5417721A (en) 1992-06-15 1995-05-23 Mallasch; Luther F. Prostate gland enlargement reducing device
EP0597463A3 (en) 1992-11-13 1996-11-06 Dornier Med Systems Inc Thermotherapiesonde.
IL108744A (en) 1994-02-22 1998-12-27 Trop Life Ltd Cooling cylindrical device for therapeutic treatment of hemorrhoids
US6056744A (en) 1994-06-24 2000-05-02 Conway Stuart Medical, Inc. Sphincter treatment apparatus
US5733316A (en) 1995-10-27 1998-03-31 Dornier Medical Systems, Inc. Organ separation for thermal therapy
FR2750340B1 (en) 1996-06-28 1999-01-15 Technomed Medical Systems THERAPY PROBE
US6009351A (en) 1997-07-14 1999-12-28 Urologix, Inc. System and method for transurethral heating with rectal cooling
US6159207A (en) 1997-07-31 2000-12-12 Yoon; Inbae Protected ablation method and apparatus
US6719779B2 (en) 2000-11-07 2004-04-13 Innercool Therapies, Inc. Circulation set for temperature-controlled catheter and method of using the same
US20020010502A1 (en) 1998-04-01 2002-01-24 Trachtenberg John R. Thermotherapy method
US6478793B1 (en) 1999-06-11 2002-11-12 Sherwood Services Ag Ablation treatment of bone metastases
EP1244392A1 (en) 1999-09-28 2002-10-02 Novasys Medical, Inc. Treatment of tissue by application of energy and drugs
GB0007145D0 (en) 2000-03-24 2000-05-17 Beehive Device for anal pain relief
US6726708B2 (en) 2000-06-14 2004-04-27 Innercool Therapies, Inc. Therapeutic heating and cooling via temperature management of a colon-inserted balloon
US6477426B1 (en) 2000-06-20 2002-11-05 Celsion Corporation System and method for heating the prostate gland to treat and prevent the growth and spread of prostate tumors
US6932771B2 (en) 2001-07-09 2005-08-23 Civco Medical Instruments Co., Inc. Tissue warming device and method
AU2002350313B2 (en) 2001-12-14 2005-12-01 Monteris Medical Inc. Hyperthermia treatment and probe therefor
US6746465B2 (en) 2001-12-14 2004-06-08 The Regents Of The University Of California Catheter based balloon for therapy modification and positioning of tissue
US20050177209A1 (en) 2002-03-05 2005-08-11 Baylis Medical Company Inc. Bipolar tissue treatment system
US7422568B2 (en) 2002-04-01 2008-09-09 The Johns Hopkins University Device, systems and methods for localized heating of a vessel and/or in combination with MR/NMR imaging of the vessel and surrounding tissue
US20040039430A1 (en) 2002-08-20 2004-02-26 Xanodyne Pharmacal, Inc. System and method using the rectal mucosal membrane for inducing hypothermia and warming
US20040215177A1 (en) 2003-04-24 2004-10-28 Scimed Life Systems, Inc. Therapeutic apparatus having insulated region at the insertion area
US7101387B2 (en) 2003-04-30 2006-09-05 Scimed Life Systems, Inc. Radio frequency ablation cooling shield
US20050065429A1 (en) 2003-09-18 2005-03-24 Ge Medical Systems Global Technology Company, Llc Method for three plane interleaved acquisition for three dimensional temperature monitoring with MRI
US7077858B2 (en) 2003-09-22 2006-07-18 Coolhead Technologies, Inc. Flexible heat exchangers for medical cooling and warming applications
US7326195B2 (en) 2003-11-18 2008-02-05 Boston Scientific Scimed, Inc. Targeted cooling of tissue within a body
ES2760995T3 (en) 2004-06-23 2020-05-18 Bioprotect Ltd Tissue displacement or separation device
WO2006013547A1 (en) 2004-08-02 2006-02-09 Koninklijke Philips Electronics N.V. Mri thermometry involing phase mapping and reference medium used as phase reference
US7771418B2 (en) * 2005-03-09 2010-08-10 Sunnybrook Health Sciences Centre Treatment of diseased tissue using controlled ultrasonic heating
US8801701B2 (en) 2005-03-09 2014-08-12 Sunnybrook Health Sciences Centre Method and apparatus for obtaining quantitative temperature measurements in prostate and other tissue undergoing thermal therapy treatment
US8016757B2 (en) * 2005-09-30 2011-09-13 University Of Washington Non-invasive temperature estimation technique for HIFU therapy monitoring using backscattered ultrasound
US8641707B2 (en) 2006-12-29 2014-02-04 St. Jude Medical, Atrial Fibrillation Division, Inc. Medical device having a bimaterial valve
EP2155333A4 (en) * 2007-06-08 2013-07-31 Cynosure Inc Coaxial suction system for laser lipolysis
US20090018446A1 (en) 2007-07-10 2009-01-15 Insightec, Ltd. Transrectal ultrasound ablation probe
US20090157070A1 (en) 2007-12-18 2009-06-18 Boston Scientific Scimed, Inc. Medical treatment using pulsed energy
WO2010038162A1 (en) 2008-09-30 2010-04-08 Koninklijke Philips Electronics, N.V. System and method for ultrasound therapy treatment
US10271889B2 (en) 2010-06-27 2019-04-30 Sunnybrook Health Sciences Centre Apparatus and method for cooling a tissue volume during thermal therapy treatment
US9981148B2 (en) 2010-10-22 2018-05-29 Insightec, Ltd. Adaptive active cooling during focused ultrasound treatment
EP2744570B1 (en) 2011-09-27 2016-08-17 Koninklijke Philips N.V. High intensity focused ultrasound enhanced by cavitation
CN108113762A (en) * 2012-06-27 2018-06-05 曼特瑞斯医药有限责任公司 The image guided therapy of tissue

Patent Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5219291A (en) * 1987-10-28 1993-06-15 Video Technology Industries, Inc. Electronic educational video system apparatus
US5734853A (en) * 1992-12-09 1998-03-31 Discovery Communications, Inc. Set top terminal for cable television delivery systems
US6201538B1 (en) * 1998-01-05 2001-03-13 Amiga Development Llc Controlling the layout of graphics in a television environment
US20050028191A1 (en) * 1999-08-17 2005-02-03 Sullivan Gary E. Content control system
US20030077559A1 (en) * 2001-10-05 2003-04-24 Braunberger Alfred S. Method and apparatus for periodically questioning a user using a computer system or other device to facilitate memorization and learning of information
US20030165802A1 (en) * 2002-03-04 2003-09-04 Murphy Rick L. Method, device and system for providing educational services
US20030217166A1 (en) * 2002-05-17 2003-11-20 Mario Dal Canto System and method for provisioning universal stateless digital and computing services
US20040122898A1 (en) * 2002-12-20 2004-06-24 International Business Machines Corporation Collaborative review of distributed content
US20040241633A1 (en) * 2003-05-28 2004-12-02 Drozda William P. Professor pop-up & method
US20050089834A1 (en) * 2003-10-23 2005-04-28 Shapiro Jeffrey S. Educational computer program
US7624355B2 (en) * 2004-05-27 2009-11-24 Baneth Robin C System and method for controlling a user interface
US20060015580A1 (en) * 2004-07-01 2006-01-19 Home Box Office, A Delaware Corporation Multimedia content distribution
US20070037131A1 (en) * 2005-08-11 2007-02-15 Anderson Joseph M Incentivized educational device and method
US20070160969A1 (en) * 2006-01-11 2007-07-12 Barton Benny M Method and Apparatus for Associating User Evaluations with Independent Content Sources
US20080094413A1 (en) * 2006-10-24 2008-04-24 Autor Jeffrey S Display controller
US20080160974A1 (en) * 2006-12-29 2008-07-03 Nokia Corporation Transferring task completion to another device
US20090165033A1 (en) * 2007-12-19 2009-06-25 General Instrument Corporation Content Viewing as an Incentive for Educational Activities
US20090178114A1 (en) * 2008-01-09 2009-07-09 Aviva Susser Educational log-on method
US20090202968A1 (en) * 2008-02-13 2009-08-13 Popspring Llc Systems and Methods for Combining Electronic Educational and Entertainment Media
US20130244784A1 (en) * 2008-11-04 2013-09-19 Quado Media Inc. Multi-player, multi-screens, electronic gaming platform and system
US20100325527A1 (en) * 2009-06-18 2010-12-23 Microsoft Corporation Overlay for digital annotations
US20110023063A1 (en) * 2009-07-23 2011-01-27 Fmr Llc Inserting Personalized Information into Digital Content
US20110167355A1 (en) * 2010-01-04 2011-07-07 Samsung Electronics Co., Ltd. Method and system for providing users login access to multiple devices via a communication system
US20120078720A1 (en) * 2010-09-28 2012-03-29 Startforce, Inc. Virtual desktop service with targeted advertisement
US20120172100A1 (en) * 2011-01-03 2012-07-05 International Business Machines Corporation Virtual Lesson Plan Integration
US20130212396A1 (en) * 2012-02-10 2013-08-15 Zynga Inc. Methods and Systems for State Synchronization Over a Non-Reliable Network Using Signature Processing
US20140359637A1 (en) * 2013-06-03 2014-12-04 Microsoft Corporation Task continuance across devices

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170371853A1 (en) * 2016-06-28 2017-12-28 Google Inc. Measurement of visibility of overlay content
US10042829B2 (en) * 2016-06-28 2018-08-07 Google Llc Measurement of visibility of overlay content
US10768425B2 (en) * 2017-02-14 2020-09-08 Securiport Llc Augmented reality monitoring of border control systems
US20200400959A1 (en) * 2017-02-14 2020-12-24 Securiport Llc Augmented reality monitoring of border control systems
WO2018213745A1 (en) * 2017-05-18 2018-11-22 Aiqudo, Inc. Optimizing display engagement in action automation
US11397558B2 (en) * 2017-05-18 2022-07-26 Peloton Interactive, Inc. Optimizing display engagement in action automation
US11900017B2 (en) 2017-05-18 2024-02-13 Peloton Interactive, Inc. Optimizing display engagement in action automation
US11531465B2 (en) * 2018-04-17 2022-12-20 Casio Computer Co., Ltd. Display control apparatus, non-transitory recording medium and display controlling method for creating first tag, second tag not overlapping other tags displayed, and indicator correlating second tag with first tag

Also Published As

Publication number Publication date
WO2015015307A3 (en) 2015-07-16
US20150038883A1 (en) 2015-02-05
CA2881596A1 (en) 2015-02-05
ES2781763T3 (en) 2020-09-07
DE14814725T1 (en) 2015-09-03
US9971004B2 (en) 2018-05-15
WO2015015307A2 (en) 2015-02-05
EP2869776A2 (en) 2015-05-13
EP2869776B1 (en) 2020-02-19
EP2869776A4 (en) 2017-10-11
CA2881596C (en) 2023-01-03

Similar Documents

Publication Publication Date Title
US20150040008A1 (en) Interactive overlay for video applications
US9940006B2 (en) Intuitive interfaces for real-time collaborative intelligence
CN107801101B (en) System and method for optimized and efficient interactive experience
US11771987B2 (en) Limbo spectating in a video game
US11623144B2 (en) Intervention server and intervention program
US8790172B2 (en) Game providing apparatus and recording medium
US11423795B2 (en) Cognitive training utilizing interaction simulations targeting stimulation of key cognitive functions
CN112527171B (en) Multimedia file playing method, device, equipment and medium
EP3155584A1 (en) Intuitive interfaces for real-time collaborative intelligence
EP3478381B1 (en) Communication methods, communication devices, and servers
US9526988B2 (en) Game for portable devices or other gaming devices
JP5586771B1 (en) Server and method for providing game
TWI765883B (en) Methods for facilitating game play, systems providing artificial intelligence game mentor for facilitating game play, and computer-readable media
US20170025035A1 (en) Method of generating a therapeutic game for treating a patient
CA2823746A1 (en) Interactive overlay for video applications
Centieiro et al. Enhancing remote live sports experiences through an eyes-free interaction
US20210370167A1 (en) System and method for peer-to-peep wireless gaming
JP6781780B2 (en) Game programs and game equipment
JP7365087B1 (en) Video control system
CN111481922A (en) Interaction method and device in game and electronic equipment
JP7069493B2 (en) Game programs and game equipment
JP5777835B1 (en) GAME PROGRAM, GAME PROCESSING METHOD, AND INFORMATION PROCESSING DEVICE
US20230370678A1 (en) Method for Configuring a Multimedia Entertainment System
Castro et al. Accessibility Strategies in a Mobile Card Game
Centieiro et al. Bet without looking: studying eyes-free interaction during live sports

Legal Events

Date Code Title Description
AS Assignment

Owner name: GAMER PARENTS INC., OHIO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REDENSHEK, TODD;LAWRENCE, VICKY;REEL/FRAME:031669/0747

Effective date: 20131114

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION