US20150040008A1 - Interactive overlay for video applications - Google Patents
Interactive overlay for video applications Download PDFInfo
- Publication number
- US20150040008A1 US20150040008A1 US13/963,595 US201313963595A US2015040008A1 US 20150040008 A1 US20150040008 A1 US 20150040008A1 US 201313963595 A US201313963595 A US 201313963595A US 2015040008 A1 US2015040008 A1 US 2015040008A1
- Authority
- US
- United States
- Prior art keywords
- overlay
- user
- response
- interactive
- status
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/4804—Spatially selective measurement of temperature or pH
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
- A61B5/015—By temperature mapping of body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/43—Detecting, measuring or recording for evaluating the reproductive systems
- A61B5/4375—Detecting, measuring or recording for evaluating the reproductive systems for evaluating the male reproductive system
- A61B5/4381—Prostate evaluation or disorder diagnosis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N7/00—Ultrasound therapy
- A61N7/02—Localised ultrasound hyperthermia
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N7/00—Ultrasound therapy
- A61N7/02—Localised ultrasound hyperthermia
- A61N7/022—Localised ultrasound hyperthermia intracavitary
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/28—Details of apparatus provided for in groups G01R33/44 - G01R33/64
- G01R33/285—Invasive instruments, e.g. catheters or biopsy needles, specially adapted for tracking, guiding or visualization by NMR
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/443—Assessment of an electric or a magnetic field, e.g. spatial mapping, determination of a B0 drift or dosimetry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/4808—Multimodal MR, e.g. MR combined with positron emission tomography [PET], MR combined with ultrasound or MR combined with computed tomography [CT]
- G01R33/4814—MR combined with ultrasound
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00315—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body for treatment of particular body parts
- A61B2018/00547—Prostate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
- A61B2018/00696—Controlled or regulated parameters
- A61B2018/00702—Power or energy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
- A61B2018/00773—Sensed parameters
- A61B2018/00791—Temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/374—NMR or MRI
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/378—Surgical systems with images on a monitor during operation using ultrasound
- A61B2090/3782—Surgical systems with images on a monitor during operation using ultrasound transmitter or receiver in catheter or minimal invasive instrument
- A61B2090/3784—Surgical systems with images on a monitor during operation using ultrasound transmitter or receiver in catheter or minimal invasive instrument both receiver and transmitter being in the instrument or receiver being also transmitter
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N7/00—Ultrasound therapy
- A61N2007/0004—Applications of ultrasound therapy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N7/00—Ultrasound therapy
- A61N2007/0052—Ultrasound therapy using the same transducer for therapy and imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N7/00—Ultrasound therapy
- A61N2007/0078—Ultrasound therapy with multiple treatment transducers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/5608—Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels
Definitions
- the present invention relates generally to interactive overlay systems, and specifically to an interactive overlay that obscures a portion of a screen of video content while operating simultaneously and independently of the video content.
- Video content including gaming, audio-visual programming, and computer centric media, is widely available and increasingly occupies the attention and time of many.
- new and innovative ways to provide an interface with a computer are often developed to complement the changes in computer functionality and packaging.
- a system and method is provided for an interactive overlay system.
- the system comprises an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of the program content.
- the interactive overlay also comprises at least one overlay status.
- the system further comprises an input device capable of providing multiple inputs from a user.
- the overlay component is configured to change the status of the interactive overlay on the display screen in response to user input in accordance with rules defined by the administrator.
- the interactive overlay may be partially transparent, opaque, or any variation thereof.
- Another embodiment of the present invention includes a method for providing an interactive overlay sequence. Included are the actions of displaying video content on a display screen. On the display, an overlay sequence in accordance with a set of interactive overlay rules is initiated.
- the interactive overlay can begin with a notification status being displaying for a predetermined amount of time, the notification status providing information or instruction for the upcoming overlay sequence.
- the notification status is followed by a text status requesting a response from the user.
- the text status can provide a question and associated answers, or can provide alternative content, as described in greater detail below.
- the user will submit, and the system will receive and process, a response from a user which prompts the system to provide feedback based on the response.
- the feedback given is dependent on the character of the user's response, which is governed by the rules. For example, a first response may be accepted according to the rules and result in a first, favorable change in the text status, whereas a second, unaccepted response will result in a second, unfavorable change in the text status.
- a minimized window may remain on the display.
- the minimized window can provide limited information to the user, such as time remaining until the next question, the number of remaining questions, or that a message has been sent to the user.
- the administrator can modify the rules to tailor the visual presentation of the minimized window and content displayed therein.
- Yet another embodiment of the present invention includes a method of displaying program content simultaneously with and independently of an interactive overlay on a display screen.
- the interactive overlay as considered by the present invention considers multiple possible modes. For example, an overlay may be presented simply to provide information. This could include notice that a sequence of overlays has been initiated, a timer, a score, a reference, and/or administrator identification information.
- the interactive overlay can also provide interactive content, specifically a series of questions and answers, where the user has multiple answers from which to select. Additionally, the interactive overlay may contain hyperlinks to related content or be capable of communicating with one or more system administrators with the aid of a user input device.
- FIG. 1 illustrates an example of an interactive overlay system in accordance with an aspect of the invention.
- FIG. 2 illustrates an example of an overlay component in accordance with an aspect of the invention.
- FIG. 3 illustrates an example of a method for providing an interactive overlay in accordance with an aspect of the invention.
- FIG. 4 illustrates another example of a method for providing an interactive overlay in accordance with an aspect of the invention.
- FIG. 5 is a schematic block diagram illustrating an exemplary system of hardware components capable of implementing examples of the present disclosed in FIGS. 1-4 , such as the interactive overlay system illustrated in FIG. 1
- the present invention provides an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of a video source associated with the display.
- the overlay is played over an existing audiovisual content source, which can be local to a user or remote (e.g., provided over a network connection).
- the content source can include a media player, a game console, an Internet site, or broadcast/multicast video through an appropriate hardware connection.
- the overlay is interactive, such that input provided by the user with an associated input device can affect the appearance and behavior of the overlay, with a discrete instance of a given appearance and behavior having being referred to herein as a “status” of the overlay.
- one status might include a “text status”, that is, a block of text (e.g., a question) that remains on the screen until a response is provided by the user.
- Another status might include a “notification status” that counts down a defined interval between text statuses.
- the interactive overlay can include a large number of individual statuses, with transitions among the statuses governed by a set of rules stored with the overlay content.
- the overlay is presented independently of underlying content, such that there is no interaction between the overlay and other programs that may be running simultaneously.
- the overlay is interactive to the user, even as the user has a limited number of available responses when presented with an overlay.
- the interactive overlay may also be used to encourage a response from the user.
- a particular overlay status of the overlay sequence can be displayed over the program content such that a central portion (e.g., a portion encompassing a centroid of the screen) of the underlying content is obscured. This is typically a result of the user failing to respond to a question or repeated submission of unaccepted answers.
- the overlay may include dynamic overlays that move, flash, or present a scene that substantially obscures the underlying video content.
- a behavior of the overlay specifically a response of the overlay to various user inputs during the sequence can be defined by a rule set by an administrator prior to initiation of an interactive overlay sequence.
- the overlay sequence is structured and initiated by the administrator without regard for or in response to the user's conduct, provided the user is logged into an authorized device running the interactive overlay system.
- one administrator is a teacher and the user a student.
- the teacher with administrator privileges, defines rules for an interactive overlay sequence.
- the rules govern operation of the overlay sequence complete with content, acceptable and unacceptable responses, timing constraints, and appropriate reactions to various user input.
- the teacher's role is that of monitor, as the sequence runs through the overlay component in accordance with the set of rules.
- the sequence can begin with a translucent interactive overlay status providing notice that a series of questions is upcoming.
- the initial overlay status is configured to expire after a predetermined amount of time, followed by an overlay status containing a question and multiple choices for a response.
- the overlay status will change according to the rules as established by the teacher. For example, the overlay status might transition to a first status, representing positive feedback to the user, if an acceptable answer is received, or transition to a second status, representing negative feedback to the user, if an unacceptable answer is received.
- the user employs an input device to provide a response to the question presented as part of the overlay.
- a multiple choice question may be presented, wherein the user may choose from answers designated as “A, B, C,” etc., or “1, 2, 3,” etc.
- the input device could be, for example, a remote control, game console controller, computer keyboard, mouse, smart phone, tablet computer, camera with gesture recognition software, microphone, or other suitable device.
- the user has some ability to adjust the sequence progression. For example, when a student user is presented with an overlay containing a question, an acceptable response may remove the overlay or change an overlay status to be less obtrusive, until a predetermined period of time has elapsed. An unacceptable response may cause the overlay to be maintained in present form, changed to a more obtrusive status, or removed or made less obtrusive for a period of time less than the period of time following an acceptable response.
- the overlay can be used to deliver questions to the user, which can be answered via the input device, with the response given by the user affecting some aspect of the overlay appearance and behavior, such as size, opacity, or frequency with which the overlay is displayed. Repeated unaccepted responses or failure to respond can result in changes to the overlay that obscure or distract from the underlying audiovisual content. These changes can be configured by an administrator to facilitate cooperation from the user in answering the questions provided. It is envisioned that a system in accordance with an aspect of the present invention could be employed as an educational tool to encourage a user, such as a student, to complete homework or supplementary educational material, either before or during recreational activities such as watching television, using a computer, tablet device, or smart phone, or playing console video games.
- the user may be viewing video content that constitutes a lesson, webinar, or other task required by the administrator.
- the user may have access to additional content or applications.
- the computer may have a web browser, game software, an instant messaging application, video viewing software, or similar applications that would distract the user from the base, required task.
- the administrator may set rules that restrict what other programs or applications are available while the user is engaged with the required task. The restriction may forbid access entirely or limit the amount of time such program or application may be accessed.
- an overlay status may be triggered if the user violates the rules set by the administrator.
- the overlay status may partially obscure the additional content, the display screen, or otherwise grab the attention of the user.
- the overlay status may require the user to acknowledge the overlay status in order to have it removed, or simply discontinue use of the additional content that constituted the violation.
- an administrator is an individual with privileges that allow him or her to define rules governing an interactive overlay sequence or initiate the sequence.
- the present invention contemplates a variety of applications where the administrator's role would be defined in accordance with the relationship with the user as well as the desired goal for the particular sequence.
- An administrator may be a parent, counselor, instructor, an administrator at an educational institution, or other individual or organization providing overlay content intended for the benefit of the user.
- an administrator may be a teacher and the user a student. In this case, the administrator may present academic questions related to educational goals.
- An administrator may also be a counselor, presenting questions or asking for feedback to aid in the user's development.
- the user can also be an administrator.
- the administrator may present a sequence in a trivia contest related to underlying content on the display, for example, where the administrator can be one of the participants.
- the user can be given administrative privileges to more personally customize the overlay system for their individual use. Accordingly, a user can have control over when an overlay is presented, the amount of time it remains on the screen, the content provided, as well as control over the visual aspects of the overlay itself. If the user is watching a television program, for example, the user can choose to initiate an overlay during a commercial break in the program of interest.
- the overlay may be chosen to cover all or a portion of the screen and the user can discontinue the overlay when the program resumes.
- the overlay can contain any conceivable digital content, such as the lessons described herein, or can provide links to other types of information, such as an RSS feed, webpage, picture folder, or minor another connected device.
- the relationship between administrator and user is important with respect to the type and content of the sequence.
- a typical user may be a student or child, wherein the administrator seeks to introduce or reinforce a lesson.
- a parent may also serve as an administrator, and tailor questions and responses for a variety of goals.
- the invention described can also be used for entertainment purposes, for example, with the interactive overlay providing content associated with the base video content.
- the administrator has authority to define a set of rules to govern one or more interactive overlay sequences.
- Each interactive overlay sequence can be configured to respond to multiple user inputs.
- an acceptable user input leads to a particular set of actions, wherein an unacceptable user input leads to a different set of actions.
- the administrator can configure an interactive overlay sequence to meet a desired goal with respect to the user. For example, if the administrator is a teacher who wishes to reinforce, say, a history lesson, the administrator will load a series of history questions to be presented in the interactive overlay statuses. In such a case, the administrator can define rules such that an accepted response reduces a number of required questions or extends a time interval between questions, and an unaccepted response requires additional questions or decreases the time interval between questions.
- the interactive overlay can be translucent or opaque, and may include both audio and video components.
- the interactive overlay is displayed as translucent to ensure that the video content on the display screen is still partially visible, thereby attracting the attention of the user while allowing the user to maintain limited visibility of the video content.
- an overlay is intended to obscure an insubstantial portion of the display screen unless or until the user provides an unaccepted response or fails to respond within a predetermined time period. For example, if an unaccepted response is given, the translucent overlay may become opaque or enlarged, in order to highlight an accepted response. As a further example, if the user fails to provide any response within a predetermined time period, additional overlay statuses may be presented.
- overlay statuses may cover a substantial portion of the screen and/or may encompass the centroid of the viewing area of the video content. Further examples are contemplated, in which more than one overlay may be used to obscure the viewing area, the overlay may move about in the viewing area of the display screen, the overlay may flash brightly, or the overlay is otherwise dynamic to maintain the attention of the user.
- the overlay can also employ other attention grabbing tools, such as animated characters, audio signals, or customized alerts.
- Rules can be applied to the overlays such that the display is partially or fully obscured. Further, in a sequence of overlays, the shape, size and character of the overlay can change. For example, the first overlay can first be presented as substantially transparent, obscuring a minor portion of the display, and stationary. However, if the user ignores the overlay or fails to provide acceptable responses, the overlay can become increasing opaque, obscuring a larger portion of the screen, and move randomly across the display. The same modifications to the overlay can be made for future or additional overlays, as the administrator sees fit.
- the administrator provides content for and rules to define the user experience, for example, on a server hosting software for providing the overlay content.
- an overlay sequence may be structured as a history lesson presented with a video game playing concurrently. The sequence may start with an initial notification status presented in a portion of the display screen that does not significantly obscure or distract from the underlying content to alert the user that a sequence of questions has been initiated. This notification status may transition to a text status automatically at the end of a predetermined time or may require acknowledgment from the user. The text status can present a question and multiple answers from which the user must choose.
- the overlay status would change according to the rules as defined by the administrator, as described above.
- the status will update according to the set of rules defined by the administrator for the overlay sequence.
- the administrator may initiate a sequence in advance. When the user attempts to access video content or games, the user is then prompted to log in to the interactive overlay system to gain access to both. By this action, access to the video content or game is allowed, and the sequence is presented concurrently to the user, who responds accordingly.
- the interactive overlay further comprises a variety of overlay statuses.
- An individual status represents a configuration of the appearance and behavior of the overlay having different properties from the other statuses in the sequence.
- Each overlay status can be configured to respond to multiple user inputs.
- the sequence will begin with a notification status. This may provide information to the user such as the number of questions in the sequence, the amount of time between questions, and the topic of the upcoming sequence. Again, typically but not necessarily, this notification status will be replaced with a text status after a predetermined time as a second status is presented. However, the notification could require the user to select from a catalogue of choices before the remainder of the sequence is presented.
- the overlay may present a question as a text status displayed on a screen, through audio (e.g., a recording by an administrator or other content provider or machine rendered speech), or other available method.
- the method could employ, for example, a vibrating hand held controller.
- the user may then respond by use of any of multiple devices including, but not limited to, an input/output device, a microphone configured to receive an audio response, and a camera configured for gesture recognition.
- the user inputs are then subject to the rules as defined by the administrator when the sequence was initiated. However, the administrator has the capability to modify the rules during an active overlay sequence if desired.
- an acceptable response will lead to a change in the frequency of the sequence that favors the user. For example, if the user is playing a computer game, and the administrator initiates a sequence of educational questions in the interactive overlay, the user may desire the sequence to repeat less frequently. Alternatively, if the user is competing in a trivia contest related to the underlying video content, a favorable response may increase the frequency of questions in order to increase the user's score.
- the rule set defined by the administrator is invoked to determine how the overlay will be changed. As described above, depending on the application, limiting or increasing the frequency of questions may challenge the user experience. An unaccepted response could prompt an accepted answer to be highlighted. Typically, this result would follow a predetermined number of unaccepted answers. This could also prompt an explanation for the accepted answer or a hyperlink to additional information regarding the question.
- the rules may also invoke an overlay that obscures a significant portion of the video. Also, a central portion of the screen may be obscured by an opaque or partially transparent overlay in response to an unaccepted response.
- an overlay component may invoke an overlay that obscures a significant portion of the screen or otherwise interferes with enjoyment of the underlying content to encourage a response.
- the overlay could increase in size or opacity, begin moving or flashing, or begin providing audio unassociated with the underlying content.
- An administrator has privileged access to the program engine that includes several features that aid the administrator in configuring an overlay sequence that guides the user experience.
- the administrator gains access to the program engine, for example, by logging onto a server hosting the software that provides the overlay content.
- the administrator may then create an account for a user, or select an existing account that the administrator is privileged to access.
- Features available to the administrator include, but are not limited to, the subject matter of the overlay prompts, how the status is displayed, on which devices the overlay will appear, how progress is gauged, what constitutes an accepted or unaccepted response, what consequence results from an accepted or unaccepted response, what consequence results from a lack of response, the timing and frequency of overlay prompts, and similar configuration parameters for the overlay sequence provided to the user.
- the administrator may set an academic goal for the user.
- the goal may be providing a favorable response on 90% of a set of questions within a predetermined timeframe. For instance, a single history lesson may be due in one evening, with ten questions presented to the user.
- the administrator may select the topic, specify questions to present to the user, and define the timeframe in which the user must complete the lesson.
- a sequence of overlay statuses representing the defined questions is initiated. The ten questions may appear at six minute increments, for a goal of completing in an hour's time. Once begun, if a response is unaccepted, the time between questions may decrease, to allow for a greater number of questions. If the response is accepted, the time between questions may increase. This may result in only nine questions presented during the hour, while still achieving the initial goal.
- the administrator may offer the user the option to log on to a computer program that provides a dedicated lesson where the student may answer questions uninterrupted in advance of turning to video content. This action could decrease the number or frequency of question prompts, or could satisfy the lesson requirement altogether.
- the user if the user fails to cooperate with the lesson provided, the user can be locked out from utilizing authorized devices or be blocked from accessing audio-visual or other content altogether in accordance with the set of rules governing that user log in. At this point, the administrator would be required to reset the sequence in order to allow the user to access content in the future.
- the system assigns each user a unique log in.
- This log in can be used to tailor many of the features available from the system. For example, the log in identifies the user, such as a student, where an administrator, such as teacher or parent, can create rules for governing the particular user's device use. The administrator can further tailor lessons and provide content or messages for the particular user.
- Each authorized device operating on the system can be configured to recognize an individual log in.
- the log in is intended to follow the user on each device.
- a user may have an authorized portable device (e.g., tablet, gaming console, or smart phone), a stationary computing platform (e.g., desktop computer, gaming system, or television), as well as an authorized shared device (e.g., a classroom computer).
- the system recognizes the user as being active on the device, and can provide overlays and lessons as set by an administrator. This is particularly useful if the user is disrupted in the middle of a lesson (say, the end of class).
- the system can also adapt to the situation where a user switches from one device to another, for example, at the end of a television program or a battery goes flat in a device. Additionally, this feature prohibits the user from attempting to avoid completing a lesson by switching from a first device where an overlay screen is obscuring the display to a second device were the lesson had not been initiated. Thus, the system can recognize that a user has switched devices, and the lesson in progress will reinitiate in the second device.
- the system is further configured to recognize multiple authorized users active on a single authorized device. For example, two or more users can be engaged in a multiplayer game running on a single gaming device.
- the device can be configured to dedicate a separate portion of the screen for each user.
- that user's screen can be subject to the same lessons and associated overlays as if that user was using the device individually.
- this feature advantageously follows a user when the user switches or attempts to access another device, even as the other device may belong to another authorized user.
- a lesson can be provided allowing for immediate feedback from connected, authorized users.
- a question can be provided with a multiple answers, and the users can input answers to be displayed on common screen. This allows for the instructor to receive instant feedback, to better identify challenging subject matter and guide the class through the lesson.
- the multiple authorized users may be presented with the same overlay obscuring a shared portion of the display.
- the overlay can present a lesson to the users as a competition where the provided questions can earn points to a user for answering questions quickly and correctly.
- the multiple users can be collocated and viewing the same device or different devices, or may be located in different locations utilizing different devices when the lesson is presented.
- the system is configured to provide feedback in a variety of ways to both the administrator and the user.
- Feedback is structured to change the overlay sequence in a way that enhances the user experience.
- an unobtrusive overlay may be present on the display screen between question prompts that shows number of questions presented or remaining, number of responses accepted or unaccepted, the time until the next question, and progress in reaching the assigned goal.
- the administrator may set rules that govern what is displayed, in what format, and for what duration.
- the administrator has a separate set of tools to gauge user performance.
- the administrator has access to view the user responses, including not only accepted and unaccepted responses, but the time taken to answer as well as the number of overlays displayed before a response was given.
- the administrator has the authority to modify the sequence in response to the user's performance as the sequence plays out. If a user is particularly slow to respond, the frequency and/or size of the overlay may be increased, for example. Additionally, the administrator and user may both have access to historical data and statistics, including number of sequences initiated, the user's performance, the types of lessons completed, the user's performance relative to peers, and similar information. Access to some information and configuration options may be limited according to a level of privilege provided to a given administrator.
- FIG. 1 illustrates an example of an interactive overlay system 100 in accordance with an aspect of the invention.
- the interactive overlay system 100 includes an overlay component 200 , a video component 110 , a user input/output component 130 , a display 140 and a server 150 .
- the overlay component 200 can be configured to display an interactive overlay on a display screen simultaneously with and independent of video or other programming provided by the video component 110 .
- video as used herein, is intended to encompass both the visible and audible content (if any) provided from the video component.
- the overlay component 200 as pertaining to an embodiment of the present invention, is described with greater detail with respect to FIG. 2 .
- the overlay component 200 is configured to allow video content from the video component 110 to be displayed as a base content, while presenting interactive overlays thereon.
- the video component 110 may include a video game console, television component, DVD player, Internet browser, or other device or software configured to provide video content.
- the user input/output component 130 may include, for example, a remote control, a game console controller, a computer keyboard, a mouse, a smartphone, a microphone, a sensor configured to detect visible, infrared, and ultraviolet light radiating or reflected from the user, a speaker, a tablet computer, or other suitable device. Accordingly, a response can be provided by the user via pressing a button representing one of a plurality of available responses, typing a response, touching or clicking on an object on one of the display 140 or a screen of the user input/output component 130 , verbalizing the desired response, or making a gesture representing the desired response. To this end, the user input/output component 130 can include appropriate pattern recognition software for recognizing responses in detected speech or gestures.
- the user input/output component 130 is intended primarily for the user to provide answers to the interactive overlay status questions, the present invention contemplates that the user input/output component 130 can be configured to receive information from the overlay component 200 as well. For example, feedback can be provided in response to a question, such as a green light for an accepted answer, or a red light or vibration for an unaccepted answer. Further, if the user input/output component 130 is capable of displaying information, such as a smartphone or tablet computer, additional features are possible. For example, explanations for accepted and unaccepted responses and/or hyperlinks to related information may be displayed, as well as scores displayed and messages shared with the administrator.
- FIG. 2 illustrates an example of an overlay component 200 in accordance with an aspect of the invention.
- the overlay component 200 comprises a software or firmware overlay application 230 that combines content from a player component 250 and an overlay generator 220 .
- the overlay application 230 can be implemented as machine readable instructions stored on a non-transitory computer readable medium 260 and executable by an associated processor 240 .
- the combined content is presented to a display 242 .
- the display 242 can be a visual display of a computer output, television, or viewing device associated with a content providing device.
- the display 242 comprises a display screen on which content is displayed, including the interactive overlay as described herein.
- the overlay component 200 comprises a video interface 252 that collects content from a player component 250 that is operatively connected to a video source 256 and contains a storage component 254 .
- the video source 256 can provide content from any of a variety of sources, including streaming content, computer readable media storing audio-visual content, and game consoles.
- the storage component 254 can be a non-transitory computer readable medium.
- the content is then outputted by the player component 250 through the video interface 252 to the overlay application 230 .
- the overlay generator 220 is connected to a network interface 210 , which further connected to a server 212 and one or more input devices 214 .
- the server 212 may be used by the administrator to configure the rules and initiate a sequence that meets the desired goal for the user.
- the input device 214 is intended for collecting user input in response to overlay status questions.
- the overlay application 230 combines video output from the player component 250 and the overlay generator 220 to be configured by the processor 240 for the display 242 .
- the system described in FIGS. 1 and 2 can be a separate “stand alone” components can be implemented as software on a common non-transitory computer readable medium with the player component 250 .
- FIG. 3 illustrates an example of an interactive overlay sequence 300 in accordance with an aspect of the invention.
- the interactive overlay sequence 300 can be implemented in the interactive overlay system 100 of FIG. 1 .
- an interactive overlay sequence 300 is outlined. The sequence begins with video content displayed on a screen, as shown in reference 310 .
- an interactive overlay sequence defined by a set of rules is initiated.
- Step 330 has an interactive overlay in a notification status displayed on the display screen for a predetermined amount of time, obscuring a portion of the video content.
- an interactive overlay in a text status follows the notification status.
- the text status presents a question and multiple answers to the user, requesting a response.
- the user provides one of multiple responses in step 350 .
- decision point 350 if the user provides a first response, then a first change to the text status will occur 370 . If the user provides a second response, a second change to the text status is provided in step 380 .
- FIG. 4 is an expansion of the method of FIG. 3 .
- an administrator initiates the interactive overlay sequence and attendant rules in step 420 .
- a partially transparent interactive overlay status is displayed for a predetermined time in step 430 .
- another overlay status is provided with questions and multiple responses, as shown in step 432 .
- the user's response is considered at decision point 450 , to determine if the response is accepted (Y) or unaccepted (N).
- Y accepted
- N unaccepted
- a first response can correspond to an accepted response
- a second response can correspond to an unaccepted response.
- the overlay component reacts with a favorable time adjustment in step 460 .
- the overlay component provides unfavorable feedback at step 470 .
- Unfavorable feedback options will vary with the application and can be specified by an administrator when configuring the overlay sequence. Accordingly, for a given overlay sequence, any of a number of types of feedback can be selected for presentation after an unaccepted response. In one implementation, an unaccepted response results in an unfavorable time adjustment. As described herein, some users may desire less frequent questions. For example, while the user is playing a video game he or she may considers frequently displaying overlay status a distraction. Accordingly, an unacceptable response would result in unfavorable feedback that increases the frequency with which the overlay statuses are presented.
- an unaccepted response could elicit an accepted response to be highlighted.
- the highlight could be opaque, or increase the area obscured by the interactive overlay.
- the overlay can include an explanation of the correct response or can prompt a hyperlink to appear, which if selected could display a stored explanation of the accepted response or send the user to a webpage with additional information.
- the system can react to an unaccepted response by substantially obscuring the video content in an area encompassing the centroid of the video screen for a set time period or until a desired response is achieved. Additionally or alternatively, the overlay may flash, bounce around the screen, or otherwise behave in a manner intended to distract from the underlying content.
- Such a response might be used, for example, when the unaccepted response is a failure to respond.
- Both favorable and unfavorable user responses yield to decision point 480 , where it is determined whether more questions are appropriate, thus repeating the sequence at start point 400 , or ending the sequence at endpoint 490 .
- the interactive overlay sequence 300 is not limited to the examples of FIG. 3 and FIG. 4 , but that any suitable sequence may be implemented in accordance with varying rules and content as chosen by the administrator. Further, the sequence illustrated in FIG. 3 and FIG. 4 follow only one series of method steps in a particular order, whereas the sequence may be modified by the administrator according to the particular goal to be achieved.
- FIG. 5 is a schematic block diagram illustrating an exemplary system 600 of hardware components capable of implementing examples of the present invention disclosed in FIGS. 1-4 , such as the interactive overlay system illustrated in FIG. 1 .
- the system 600 can include various systems and subsystems.
- the system 600 can be, for example, a personal computer, a laptop computer, a workstation, a computer system, an appliance, an application-specific integrated circuit (ASIC), a server, a server blade center, a server farm, or a similar device.
- ASIC application-specific integrated circuit
- the system 600 can include a system bus 602 , a processing unit 604 , a system memory 606 , memory devices 608 and 610 , a communication interface 612 (e.g., a network interface), a communication link 614 , a display 616 (e.g., a video screen), and an input device 618 (e.g., a keyboard and/or a mouse).
- the system bus 602 can be in communication with the processing unit 604 and the system memory 606 .
- the additional memory devices 608 and 610 such as a hard disk drive, server, stand alone database, or other non-volatile memory, can also be in communication with the system bus 602 .
- the system bus 602 interconnects the processing unit 604 , the memory devices 606 - 610 , the communication interface 612 , the display 616 , and the input device 618 .
- the system bus 602 also interconnects an additional port (not shown), such as a universal serial bus (USB) port.
- the processing unit 604 can be a computing device and can include an application-specific integrated circuit (ASIC).
- ASIC application-specific integrated circuit
- the processing unit 604 executes a set of instructions to implement the operations of examples disclosed herein.
- the processing unit 604 can include a processing core.
- the additional memory devices 606 , 608 and 610 can store data, programs, instructions, database queries in text or compiled form, and any other information that can be needed to operate a computer.
- the memories 606 , 608 and 610 can be implemented as non-transitory computer-readable media (integrated or removable) such as a memory card, disk drive, compact disk (CD), or server accessible over a network.
- the memories 606 , 608 and 610 can store text, images, video, and/or audio, along with appropriate instructions to make the stored data available at an associated display 616 in a human comprehensible form.
- the memory devices 608 and 610 can serve as databases or data storage for the interactive overlay system illustrated in FIG. 1 .
- the system 600 can access an external data source through the communication interface 612 , which can communicate with the system bus 602 and the communication link 614 .
- the system 600 can be used to implement a control system for an interactive overlay system that governs the interaction between the administrator and user.
- Computer executable logic for implementing the interactive overlay system resides on one or more of the system memory 606 and the memory devices 608 , 610 in accordance with certain examples.
- the processing unit 604 executes one or more computer executable instructions originating from the system memory 606 and the memory devices 608 and 610 .
- the term “computer readable medium” as used herein refers to a medium that participates in providing instructions to the processing unit 604 for execution, and can include multiple physical memory components linked to the processor via appropriate data connections.
Abstract
Systems and methods are provided for an interactive overlay system. A player component is configured to display video content on a display screen of a display device. An overlay component is configured to display an interactive overlay sequence on the display screen simultaneously with and independent of the video content. An input device is configured to provide an input from a user. A status of the interactive overlay sequence is responsive to the input from the user such that a presentation of the interactive overlay is changed in response to the input from the user.
Description
- The present application claims priority to U.S. Provisional Patent Application Ser. No. 61/681,801 filed Aug. 10, 2012 entitled INTERACTIVE OVERLAY FOR VIDEO APPLICATIONS under Attorney Docket Number GPI-021433 US PRO, the entire contents of which being incorporated herein by reference in its entirety for all purposes.
- The present invention relates generally to interactive overlay systems, and specifically to an interactive overlay that obscures a portion of a screen of video content while operating simultaneously and independently of the video content.
- Video content, including gaming, audio-visual programming, and computer centric media, is widely available and increasingly occupies the attention and time of many. As the range of activities accomplished with a computer increases, new and innovative ways to provide an interface with a computer are often developed to complement the changes in computer functionality and packaging.
- A system and method is provided for an interactive overlay system. The system comprises an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of the program content. The interactive overlay also comprises at least one overlay status. The system further comprises an input device capable of providing multiple inputs from a user. The overlay component is configured to change the status of the interactive overlay on the display screen in response to user input in accordance with rules defined by the administrator. The interactive overlay may be partially transparent, opaque, or any variation thereof.
- Another embodiment of the present invention includes a method for providing an interactive overlay sequence. Included are the actions of displaying video content on a display screen. On the display, an overlay sequence in accordance with a set of interactive overlay rules is initiated. The interactive overlay can begin with a notification status being displaying for a predetermined amount of time, the notification status providing information or instruction for the upcoming overlay sequence. The notification status is followed by a text status requesting a response from the user. The text status can provide a question and associated answers, or can provide alternative content, as described in greater detail below. Following a text status, the user will submit, and the system will receive and process, a response from a user which prompts the system to provide feedback based on the response. The feedback given is dependent on the character of the user's response, which is governed by the rules. For example, a first response may be accepted according to the rules and result in a first, favorable change in the text status, whereas a second, unaccepted response will result in a second, unfavorable change in the text status.
- Following either or both the notification and text statuses, a minimized window may remain on the display. The minimized window can provide limited information to the user, such as time remaining until the next question, the number of remaining questions, or that a message has been sent to the user. The administrator can modify the rules to tailor the visual presentation of the minimized window and content displayed therein.
- Yet another embodiment of the present invention includes a method of displaying program content simultaneously with and independently of an interactive overlay on a display screen. The interactive overlay as considered by the present invention considers multiple possible modes. For example, an overlay may be presented simply to provide information. This could include notice that a sequence of overlays has been initiated, a timer, a score, a reference, and/or administrator identification information. The interactive overlay can also provide interactive content, specifically a series of questions and answers, where the user has multiple answers from which to select. Additionally, the interactive overlay may contain hyperlinks to related content or be capable of communicating with one or more system administrators with the aid of a user input device.
-
FIG. 1 illustrates an example of an interactive overlay system in accordance with an aspect of the invention. -
FIG. 2 illustrates an example of an overlay component in accordance with an aspect of the invention. -
FIG. 3 illustrates an example of a method for providing an interactive overlay in accordance with an aspect of the invention. -
FIG. 4 illustrates another example of a method for providing an interactive overlay in accordance with an aspect of the invention. -
FIG. 5 is a schematic block diagram illustrating an exemplary system of hardware components capable of implementing examples of the present disclosed inFIGS. 1-4 , such as the interactive overlay system illustrated inFIG. 1 - The present invention provides an overlay component configured to display an interactive overlay on the display screen simultaneously with and independent of a video source associated with the display. In accordance with an aspect of the present invention, the overlay is played over an existing audiovisual content source, which can be local to a user or remote (e.g., provided over a network connection). For example, the content source can include a media player, a game console, an Internet site, or broadcast/multicast video through an appropriate hardware connection. The overlay is interactive, such that input provided by the user with an associated input device can affect the appearance and behavior of the overlay, with a discrete instance of a given appearance and behavior having being referred to herein as a “status” of the overlay. For example, one status might include a “text status”, that is, a block of text (e.g., a question) that remains on the screen until a response is provided by the user. Another status might include a “notification status” that counts down a defined interval between text statuses. It will be appreciated that the interactive overlay can include a large number of individual statuses, with transitions among the statuses governed by a set of rules stored with the overlay content.
- The overlay is presented independently of underlying content, such that there is no interaction between the overlay and other programs that may be running simultaneously. However, the overlay is interactive to the user, even as the user has a limited number of available responses when presented with an overlay. The interactive overlay may also be used to encourage a response from the user. A particular overlay status of the overlay sequence can be displayed over the program content such that a central portion (e.g., a portion encompassing a centroid of the screen) of the underlying content is obscured. This is typically a result of the user failing to respond to a question or repeated submission of unaccepted answers. Additionally the overlay may include dynamic overlays that move, flash, or present a scene that substantially obscures the underlying video content. A behavior of the overlay, specifically a response of the overlay to various user inputs during the sequence can be defined by a rule set by an administrator prior to initiation of an interactive overlay sequence. Thus, the overlay sequence is structured and initiated by the administrator without regard for or in response to the user's conduct, provided the user is logged into an authorized device running the interactive overlay system.
- In one embodiment of the present invention, one administrator is a teacher and the user a student. The teacher, with administrator privileges, defines rules for an interactive overlay sequence. The rules govern operation of the overlay sequence complete with content, acceptable and unacceptable responses, timing constraints, and appropriate reactions to various user input. Upon initiation of the sequence, the teacher's role is that of monitor, as the sequence runs through the overlay component in accordance with the set of rules. For instance, the sequence can begin with a translucent interactive overlay status providing notice that a series of questions is upcoming. The initial overlay status is configured to expire after a predetermined amount of time, followed by an overlay status containing a question and multiple choices for a response. Depending on whether the user input is acceptable or unacceptable, the overlay status will change according to the rules as established by the teacher. For example, the overlay status might transition to a first status, representing positive feedback to the user, if an acceptable answer is received, or transition to a second status, representing negative feedback to the user, if an unacceptable answer is received.
- The user employs an input device to provide a response to the question presented as part of the overlay. For example, a multiple choice question may be presented, wherein the user may choose from answers designated as “A, B, C,” etc., or “1, 2, 3,” etc. The input device could be, for example, a remote control, game console controller, computer keyboard, mouse, smart phone, tablet computer, camera with gesture recognition software, microphone, or other suitable device. During the interactive portion of the overlay sequence, the user has some ability to adjust the sequence progression. For example, when a student user is presented with an overlay containing a question, an acceptable response may remove the overlay or change an overlay status to be less obtrusive, until a predetermined period of time has elapsed. An unacceptable response may cause the overlay to be maintained in present form, changed to a more obtrusive status, or removed or made less obtrusive for a period of time less than the period of time following an acceptable response.
- In one implementation, the overlay can be used to deliver questions to the user, which can be answered via the input device, with the response given by the user affecting some aspect of the overlay appearance and behavior, such as size, opacity, or frequency with which the overlay is displayed. Repeated unaccepted responses or failure to respond can result in changes to the overlay that obscure or distract from the underlying audiovisual content. These changes can be configured by an administrator to facilitate cooperation from the user in answering the questions provided. It is envisioned that a system in accordance with an aspect of the present invention could be employed as an educational tool to encourage a user, such as a student, to complete homework or supplementary educational material, either before or during recreational activities such as watching television, using a computer, tablet device, or smart phone, or playing console video games.
- In another embodiment of the present invention, the user may be viewing video content that constitutes a lesson, webinar, or other task required by the administrator. In the example of a web based lecture viewed on a computing platform, the user may have access to additional content or applications. For example, the computer may have a web browser, game software, an instant messaging application, video viewing software, or similar applications that would distract the user from the base, required task. In accordance with other aspects of the invention, the administrator may set rules that restrict what other programs or applications are available while the user is engaged with the required task. The restriction may forbid access entirely or limit the amount of time such program or application may be accessed. Accordingly, an overlay status may be triggered if the user violates the rules set by the administrator. The overlay status may partially obscure the additional content, the display screen, or otherwise grab the attention of the user. The overlay status may require the user to acknowledge the overlay status in order to have it removed, or simply discontinue use of the additional content that constituted the violation.
- As employed herein, an administrator is an individual with privileges that allow him or her to define rules governing an interactive overlay sequence or initiate the sequence. The present invention contemplates a variety of applications where the administrator's role would be defined in accordance with the relationship with the user as well as the desired goal for the particular sequence. An administrator may be a parent, counselor, instructor, an administrator at an educational institution, or other individual or organization providing overlay content intended for the benefit of the user. For example, an administrator may be a teacher and the user a student. In this case, the administrator may present academic questions related to educational goals. An administrator may also be a counselor, presenting questions or asking for feedback to aid in the user's development. Moreover, as the present invention is not limited to educational content, the user can also be an administrator. The administrator may present a sequence in a trivia contest related to underlying content on the display, for example, where the administrator can be one of the participants.
- As such, the user can be given administrative privileges to more personally customize the overlay system for their individual use. Accordingly, a user can have control over when an overlay is presented, the amount of time it remains on the screen, the content provided, as well as control over the visual aspects of the overlay itself. If the user is watching a television program, for example, the user can choose to initiate an overlay during a commercial break in the program of interest. The overlay may be chosen to cover all or a portion of the screen and the user can discontinue the overlay when the program resumes. The overlay can contain any conceivable digital content, such as the lessons described herein, or can provide links to other types of information, such as an RSS feed, webpage, picture folder, or minor another connected device.
- In another aspect of the present invention, the relationship between administrator and user is important with respect to the type and content of the sequence. A typical user may be a student or child, wherein the administrator seeks to introduce or reinforce a lesson. Thus, a parent may also serve as an administrator, and tailor questions and responses for a variety of goals. The invention described can also be used for entertainment purposes, for example, with the interactive overlay providing content associated with the base video content.
- The administrator has authority to define a set of rules to govern one or more interactive overlay sequences. Each interactive overlay sequence can be configured to respond to multiple user inputs. According to the rules set by the administrator, an acceptable user input leads to a particular set of actions, wherein an unacceptable user input leads to a different set of actions. The administrator can configure an interactive overlay sequence to meet a desired goal with respect to the user. For example, if the administrator is a teacher who wishes to reinforce, say, a history lesson, the administrator will load a series of history questions to be presented in the interactive overlay statuses. In such a case, the administrator can define rules such that an accepted response reduces a number of required questions or extends a time interval between questions, and an unaccepted response requires additional questions or decreases the time interval between questions.
- The interactive overlay can be translucent or opaque, and may include both audio and video components. In one implementation, the interactive overlay is displayed as translucent to ensure that the video content on the display screen is still partially visible, thereby attracting the attention of the user while allowing the user to maintain limited visibility of the video content. In accordance with one aspect of the invention, an overlay is intended to obscure an insubstantial portion of the display screen unless or until the user provides an unaccepted response or fails to respond within a predetermined time period. For example, if an unaccepted response is given, the translucent overlay may become opaque or enlarged, in order to highlight an accepted response. As a further example, if the user fails to provide any response within a predetermined time period, additional overlay statuses may be presented. These additional overlay statuses may cover a substantial portion of the screen and/or may encompass the centroid of the viewing area of the video content. Further examples are contemplated, in which more than one overlay may be used to obscure the viewing area, the overlay may move about in the viewing area of the display screen, the overlay may flash brightly, or the overlay is otherwise dynamic to maintain the attention of the user. The overlay can also employ other attention grabbing tools, such as animated characters, audio signals, or customized alerts.
- Rules can be applied to the overlays such that the display is partially or fully obscured. Further, in a sequence of overlays, the shape, size and character of the overlay can change. For example, the first overlay can first be presented as substantially transparent, obscuring a minor portion of the display, and stationary. However, if the user ignores the overlay or fails to provide acceptable responses, the overlay can become increasing opaque, obscuring a larger portion of the screen, and move randomly across the display. The same modifications to the overlay can be made for future or additional overlays, as the administrator sees fit.
- The administrator provides content for and rules to define the user experience, for example, on a server hosting software for providing the overlay content. For instance, an overlay sequence may be structured as a history lesson presented with a video game playing concurrently. The sequence may start with an initial notification status presented in a portion of the display screen that does not significantly obscure or distract from the underlying content to alert the user that a sequence of questions has been initiated. This notification status may transition to a text status automatically at the end of a predetermined time or may require acknowledgment from the user. The text status can present a question and multiple answers from which the user must choose. The overlay status would change according to the rules as defined by the administrator, as described above. Regardless of the response being accepted or unaccepted, the status will update according to the set of rules defined by the administrator for the overlay sequence. In one embodiment, the administrator may initiate a sequence in advance. When the user attempts to access video content or games, the user is then prompted to log in to the interactive overlay system to gain access to both. By this action, access to the video content or game is allowed, and the sequence is presented concurrently to the user, who responds accordingly.
- The interactive overlay further comprises a variety of overlay statuses. An individual status, as used herein, represents a configuration of the appearance and behavior of the overlay having different properties from the other statuses in the sequence. Each overlay status can be configured to respond to multiple user inputs. Typically, but not necessarily, the sequence will begin with a notification status. This may provide information to the user such as the number of questions in the sequence, the amount of time between questions, and the topic of the upcoming sequence. Again, typically but not necessarily, this notification status will be replaced with a text status after a predetermined time as a second status is presented. However, the notification could require the user to select from a catalogue of choices before the remainder of the sequence is presented.
- When the interactive overlay statuses present questions, the user is then encouraged to respond by inputting one of multiple available responses. The overlay may present a question as a text status displayed on a screen, through audio (e.g., a recording by an administrator or other content provider or machine rendered speech), or other available method. The method could employ, for example, a vibrating hand held controller. The user may then respond by use of any of multiple devices including, but not limited to, an input/output device, a microphone configured to receive an audio response, and a camera configured for gesture recognition. The user inputs are then subject to the rules as defined by the administrator when the sequence was initiated. However, the administrator has the capability to modify the rules during an active overlay sequence if desired.
- In one embodiment of the invention, an acceptable response will lead to a change in the frequency of the sequence that favors the user. For example, if the user is playing a computer game, and the administrator initiates a sequence of educational questions in the interactive overlay, the user may desire the sequence to repeat less frequently. Alternatively, if the user is competing in a trivia contest related to the underlying video content, a favorable response may increase the frequency of questions in order to increase the user's score.
- In the event that an unfavorable response is received, the rule set defined by the administrator is invoked to determine how the overlay will be changed. As described above, depending on the application, limiting or increasing the frequency of questions may challenge the user experience. An unaccepted response could prompt an accepted answer to be highlighted. Typically, this result would follow a predetermined number of unaccepted answers. This could also prompt an explanation for the accepted answer or a hyperlink to additional information regarding the question. The rules may also invoke an overlay that obscures a significant portion of the video. Also, a central portion of the screen may be obscured by an opaque or partially transparent overlay in response to an unaccepted response. In the event that no response is received, an overlay component may invoke an overlay that obscures a significant portion of the screen or otherwise interferes with enjoyment of the underlying content to encourage a response. For example, the overlay could increase in size or opacity, begin moving or flashing, or begin providing audio unassociated with the underlying content.
- An administrator has privileged access to the program engine that includes several features that aid the administrator in configuring an overlay sequence that guides the user experience. The administrator gains access to the program engine, for example, by logging onto a server hosting the software that provides the overlay content. The administrator may then create an account for a user, or select an existing account that the administrator is privileged to access. Features available to the administrator include, but are not limited to, the subject matter of the overlay prompts, how the status is displayed, on which devices the overlay will appear, how progress is gauged, what constitutes an accepted or unaccepted response, what consequence results from an accepted or unaccepted response, what consequence results from a lack of response, the timing and frequency of overlay prompts, and similar configuration parameters for the overlay sequence provided to the user.
- For example, if the administrator is a teacher and the user a student, the administrator may set an academic goal for the user. The goal may be providing a favorable response on 90% of a set of questions within a predetermined timeframe. For instance, a single history lesson may be due in one evening, with ten questions presented to the user. The administrator may select the topic, specify questions to present to the user, and define the timeframe in which the user must complete the lesson. When the user begins a video game or other audiovisual entertainment a sequence of overlay statuses representing the defined questions is initiated. The ten questions may appear at six minute increments, for a goal of completing in an hour's time. Once begun, if a response is unaccepted, the time between questions may decrease, to allow for a greater number of questions. If the response is accepted, the time between questions may increase. This may result in only nine questions presented during the hour, while still achieving the initial goal.
- There may be multiple features available to the user to reach this goal. For instance, the administrator may offer the user the option to log on to a computer program that provides a dedicated lesson where the student may answer questions uninterrupted in advance of turning to video content. This action could decrease the number or frequency of question prompts, or could satisfy the lesson requirement altogether. Alternatively, if the user fails to cooperate with the lesson provided, the user can be locked out from utilizing authorized devices or be blocked from accessing audio-visual or other content altogether in accordance with the set of rules governing that user log in. At this point, the administrator would be required to reset the sequence in order to allow the user to access content in the future.
- The system assigns each user a unique log in. This log in can be used to tailor many of the features available from the system. For example, the log in identifies the user, such as a student, where an administrator, such as teacher or parent, can create rules for governing the particular user's device use. The administrator can further tailor lessons and provide content or messages for the particular user.
- Each authorized device operating on the system can be configured to recognize an individual log in. Thus, the log in is intended to follow the user on each device. For example, a user may have an authorized portable device (e.g., tablet, gaming console, or smart phone), a stationary computing platform (e.g., desktop computer, gaming system, or television), as well as an authorized shared device (e.g., a classroom computer). Accordingly, as the user accesses each device, the system recognizes the user as being active on the device, and can provide overlays and lessons as set by an administrator. This is particularly useful if the user is disrupted in the middle of a lesson (say, the end of class). However, the system can also adapt to the situation where a user switches from one device to another, for example, at the end of a television program or a battery goes flat in a device. Additionally, this feature prohibits the user from attempting to avoid completing a lesson by switching from a first device where an overlay screen is obscuring the display to a second device were the lesson had not been initiated. Thus, the system can recognize that a user has switched devices, and the lesson in progress will reinitiate in the second device.
- The system is further configured to recognize multiple authorized users active on a single authorized device. For example, two or more users can be engaged in a multiplayer game running on a single gaming device. The device can be configured to dedicate a separate portion of the screen for each user. Thus, as the system operates according to the rules as applied to the individual user, that user's screen can be subject to the same lessons and associated overlays as if that user was using the device individually. As noted previously, this feature advantageously follows a user when the user switches or attempts to access another device, even as the other device may belong to another authorized user.
- In a classroom setting, for example, a lesson can be provided allowing for immediate feedback from connected, authorized users. Thus, a question can be provided with a multiple answers, and the users can input answers to be displayed on common screen. This allows for the instructor to receive instant feedback, to better identify challenging subject matter and guide the class through the lesson.
- Additionally, the multiple authorized users may be presented with the same overlay obscuring a shared portion of the display. For example, the overlay can present a lesson to the users as a competition where the provided questions can earn points to a user for answering questions quickly and correctly. In this implementation, the multiple users can be collocated and viewing the same device or different devices, or may be located in different locations utilizing different devices when the lesson is presented.
- The system is configured to provide feedback in a variety of ways to both the administrator and the user. Feedback is structured to change the overlay sequence in a way that enhances the user experience. To continue with our example, an unobtrusive overlay may be present on the display screen between question prompts that shows number of questions presented or remaining, number of responses accepted or unaccepted, the time until the next question, and progress in reaching the assigned goal. The administrator may set rules that govern what is displayed, in what format, and for what duration. The administrator has a separate set of tools to gauge user performance. The administrator has access to view the user responses, including not only accepted and unaccepted responses, but the time taken to answer as well as the number of overlays displayed before a response was given. Further, the administrator has the authority to modify the sequence in response to the user's performance as the sequence plays out. If a user is particularly slow to respond, the frequency and/or size of the overlay may be increased, for example. Additionally, the administrator and user may both have access to historical data and statistics, including number of sequences initiated, the user's performance, the types of lessons completed, the user's performance relative to peers, and similar information. Access to some information and configuration options may be limited according to a level of privilege provided to a given administrator.
-
FIG. 1 illustrates an example of aninteractive overlay system 100 in accordance with an aspect of the invention. Theinteractive overlay system 100 includes anoverlay component 200, avideo component 110, a user input/output component 130, adisplay 140 and a server 150. Theoverlay component 200 can be configured to display an interactive overlay on a display screen simultaneously with and independent of video or other programming provided by thevideo component 110. It will be appreciated that the term “video” as used herein, is intended to encompass both the visible and audible content (if any) provided from the video component. Theoverlay component 200, as pertaining to an embodiment of the present invention, is described with greater detail with respect toFIG. 2 . As described herein, theoverlay component 200 is configured to allow video content from thevideo component 110 to be displayed as a base content, while presenting interactive overlays thereon. Thevideo component 110 may include a video game console, television component, DVD player, Internet browser, or other device or software configured to provide video content. - The user input/
output component 130 may include, for example, a remote control, a game console controller, a computer keyboard, a mouse, a smartphone, a microphone, a sensor configured to detect visible, infrared, and ultraviolet light radiating or reflected from the user, a speaker, a tablet computer, or other suitable device. Accordingly, a response can be provided by the user via pressing a button representing one of a plurality of available responses, typing a response, touching or clicking on an object on one of thedisplay 140 or a screen of the user input/output component 130, verbalizing the desired response, or making a gesture representing the desired response. To this end, the user input/output component 130 can include appropriate pattern recognition software for recognizing responses in detected speech or gestures. - Although the user input/
output component 130 is intended primarily for the user to provide answers to the interactive overlay status questions, the present invention contemplates that the user input/output component 130 can be configured to receive information from theoverlay component 200 as well. For example, feedback can be provided in response to a question, such as a green light for an accepted answer, or a red light or vibration for an unaccepted answer. Further, if the user input/output component 130 is capable of displaying information, such as a smartphone or tablet computer, additional features are possible. For example, explanations for accepted and unaccepted responses and/or hyperlinks to related information may be displayed, as well as scores displayed and messages shared with the administrator. -
FIG. 2 illustrates an example of anoverlay component 200 in accordance with an aspect of the invention. Theoverlay component 200 comprises a software orfirmware overlay application 230 that combines content from a player component 250 and an overlay generator 220. Theoverlay application 230 can be implemented as machine readable instructions stored on a non-transitory computer readable medium 260 and executable by an associatedprocessor 240. The combined content is presented to adisplay 242. Thedisplay 242 can be a visual display of a computer output, television, or viewing device associated with a content providing device. Thedisplay 242 comprises a display screen on which content is displayed, including the interactive overlay as described herein. Theoverlay component 200 comprises avideo interface 252 that collects content from a player component 250 that is operatively connected to avideo source 256 and contains astorage component 254. Thevideo source 256 can provide content from any of a variety of sources, including streaming content, computer readable media storing audio-visual content, and game consoles. Thestorage component 254 can be a non-transitory computer readable medium. The content is then outputted by the player component 250 through thevideo interface 252 to theoverlay application 230. The overlay generator 220 is connected to anetwork interface 210, which further connected to aserver 212 and one ormore input devices 214. Theserver 212 may be used by the administrator to configure the rules and initiate a sequence that meets the desired goal for the user. Theinput device 214 is intended for collecting user input in response to overlay status questions. As described herein, theoverlay application 230 combines video output from the player component 250 and the overlay generator 220 to be configured by theprocessor 240 for thedisplay 242. The system described inFIGS. 1 and 2 can be a separate “stand alone” components can be implemented as software on a common non-transitory computer readable medium with the player component 250. -
FIG. 3 illustrates an example of aninteractive overlay sequence 300 in accordance with an aspect of the invention. Theinteractive overlay sequence 300 can be implemented in theinteractive overlay system 100 ofFIG. 1 . As such, reference is to be made to the example ofFIG. 1 in the following discussion of the example ofFIG. 3 . - In the example of
FIG. 3 , aninteractive overlay sequence 300 is outlined. The sequence begins with video content displayed on a screen, as shown inreference 310. Instep 320, an interactive overlay sequence defined by a set of rules is initiated. Step 330 has an interactive overlay in a notification status displayed on the display screen for a predetermined amount of time, obscuring a portion of the video content. Instep 340 an interactive overlay in a text status follows the notification status. The text status presents a question and multiple answers to the user, requesting a response. The user provides one of multiple responses instep 350. Atdecision point 350, if the user provides a first response, then a first change to the text status will occur 370. If the user provides a second response, a second change to the text status is provided in step 380. -
FIG. 4 is an expansion of the method ofFIG. 3 . Following the display ofvideo content 410, an administrator initiates the interactive overlay sequence and attendant rules instep 420. A partially transparent interactive overlay status is displayed for a predetermined time instep 430. Upon expiration of the predetermined time, another overlay status is provided with questions and multiple responses, as shown instep 432. The user's response, as shown instep 440, is considered atdecision point 450, to determine if the response is accepted (Y) or unaccepted (N). As explained with respect toFIG. 3 , a first response can correspond to an accepted response, and a second response can correspond to an unaccepted response. Thus, if the response is accepted, the overlay component reacts with a favorable time adjustment instep 460. If the response is not accepted, which can include a failure to respond, the overlay component provides unfavorable feedback atstep 470. - Unfavorable feedback options will vary with the application and can be specified by an administrator when configuring the overlay sequence. Accordingly, for a given overlay sequence, any of a number of types of feedback can be selected for presentation after an unaccepted response. In one implementation, an unaccepted response results in an unfavorable time adjustment. As described herein, some users may desire less frequent questions. For example, while the user is playing a video game he or she may considers frequently displaying overlay status a distraction. Accordingly, an unacceptable response would result in unfavorable feedback that increases the frequency with which the overlay statuses are presented.
- In another implementation, an unaccepted response could elicit an accepted response to be highlighted. The highlight could be opaque, or increase the area obscured by the interactive overlay. In one implementation, the overlay can include an explanation of the correct response or can prompt a hyperlink to appear, which if selected could display a stored explanation of the accepted response or send the user to a webpage with additional information. In yet another implementation, the system can react to an unaccepted response by substantially obscuring the video content in an area encompassing the centroid of the video screen for a set time period or until a desired response is achieved. Additionally or alternatively, the overlay may flash, bounce around the screen, or otherwise behave in a manner intended to distract from the underlying content. Such a response might be used, for example, when the unaccepted response is a failure to respond. Both favorable and unfavorable user responses yield to
decision point 480, where it is determined whether more questions are appropriate, thus repeating the sequence atstart point 400, or ending the sequence atendpoint 490. - It is to be understood, however, that the
interactive overlay sequence 300 is not limited to the examples ofFIG. 3 andFIG. 4 , but that any suitable sequence may be implemented in accordance with varying rules and content as chosen by the administrator. Further, the sequence illustrated inFIG. 3 andFIG. 4 follow only one series of method steps in a particular order, whereas the sequence may be modified by the administrator according to the particular goal to be achieved. -
FIG. 5 is a schematic block diagram illustrating anexemplary system 600 of hardware components capable of implementing examples of the present invention disclosed inFIGS. 1-4 , such as the interactive overlay system illustrated inFIG. 1 . Thesystem 600 can include various systems and subsystems. Thesystem 600 can be, for example, a personal computer, a laptop computer, a workstation, a computer system, an appliance, an application-specific integrated circuit (ASIC), a server, a server blade center, a server farm, or a similar device. - The
system 600 can include asystem bus 602, aprocessing unit 604, asystem memory 606,memory devices communication link 614, a display 616 (e.g., a video screen), and an input device 618 (e.g., a keyboard and/or a mouse). Thesystem bus 602 can be in communication with theprocessing unit 604 and thesystem memory 606. Theadditional memory devices system bus 602. Thesystem bus 602 interconnects theprocessing unit 604, the memory devices 606-610, thecommunication interface 612, thedisplay 616, and theinput device 618. In some examples, thesystem bus 602 also interconnects an additional port (not shown), such as a universal serial bus (USB) port. Theprocessing unit 604 can be a computing device and can include an application-specific integrated circuit (ASIC). Theprocessing unit 604 executes a set of instructions to implement the operations of examples disclosed herein. Theprocessing unit 604 can include a processing core. - The
additional memory devices memories memories display 616 in a human comprehensible form. Additionally, thememory devices FIG. 1 . Additionally or alternatively, thesystem 600 can access an external data source through thecommunication interface 612, which can communicate with thesystem bus 602 and thecommunication link 614. - In operation, the
system 600 can be used to implement a control system for an interactive overlay system that governs the interaction between the administrator and user. Computer executable logic for implementing the interactive overlay system resides on one or more of thesystem memory 606 and thememory devices processing unit 604 executes one or more computer executable instructions originating from thesystem memory 606 and thememory devices processing unit 604 for execution, and can include multiple physical memory components linked to the processor via appropriate data connections. - What have been described above are examples of the present invention. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the present invention, but one of ordinary skill in the art will recognize that many further combinations and permutations of the present invention are possible. Accordingly, the present invention is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims.
Claims (20)
1. An interactive overlay system comprising:
a server to store a set of rules selected by an administrator to govern presentation and content of an interactive overlay sequence;
an overlay component configured to display the interactive overlay sequence on a display screen simultaneously with video content provided from a player component independent of the server; and
an input device configured to provide an input from a user, the overlay component being responsive to the input from the user such that the status of the interactive overlay is changed in response to the input from the user according to the stored set of rules.
2. A system as recited in claim 1 , wherein the overlay component further comprises:
a network interface configured to communicate with an administrator over the server or the user through the input device;
an overlay generator to generate the interactive overlay sequence in accordance with the set of rules; and
an overlay application to provide the interactive overlay sequence to the display.
3. A system as recited in claim 1 , the set of rules defining a predetermined period after which, if no acceptable input from the user has been received, the overlay component changes the status of the interactive overlay to a status designed to substantially interfere with enjoyment of the underlying video content.
4. A system as recited in claim 3 , wherein the set of rules defines, for a given status of the interactive overlay, a first response and a second response, and the overlay component being configured to change the associated status of the interactive overlay to a first status when the first response is received and to a second status when the second response is received.
5. A system as recited in claim 4 , wherein the predetermined period is increased when the first response is received and decreased when the second response is received.
6. A system as recited in claim 1 , wherein the status is a text status representing a question asked of the user, the question having at least one acceptable response and at least one unacceptable response.
7. A system as recited in claim 6 , wherein the overlay component is configured to increase the defined interval when an acceptable response is received and decrease the defined interval when an unacceptable response is received.
8. A system as recited in claim 6 , wherein when a number of unacceptable responses exceeds a predetermined threshold, the user is locked out from associated log ins and devices.
9. A system as recited in claim 1 , wherein the user has a single log in that provides access to a plurality of authorized display devices, such that an associated status of the interactive overlay is substantially identical across the plurality of display devices.
10. A system as recited in claim 1 , wherein the system is configured to recognize a plurality of users and allow access for the plurality of users to one or more display devices simultaneously.
11. A system as recited in claim 10 , wherein an unaccepted response from one of the plurality of users prompts an overlay to selectively obscure a portion of the display associated with the individual user's screen of interest.
12. A system as recited in claim 1 , wherein the set of rules governing the overlay sequence can be edited by an administrator via a remote computer.
13. A method for providing an interactive overlay sequence, comprising:
displaying video content on a display screen;
initiating the interactive overlay sequence in accordance with a set of interactive overlay rules;
displaying an interactive overlay in a notification status on the display screen for a predetermined amount of time;
displaying an interactive overlay in a text status following the predetermined amount of time, the text status requesting a response from the user;
receiving a response from a user; and
providing feedback to the user based on the response, wherein a first response from the user will result in a first change in the text status and a second response will result in a second change in the text status, the first change and the second change in the text status being different.
14. The method of claim 13 wherein a source of the video content is independent of a server storing the set of interactive overlay rules.
15. The method of claim 13 wherein the first response is an accepted response resulting in the first change providing favorable feedback, and the second response is an unaccepted response resulting in the second change providing unfavorable feedback.
16. The method of claim 13 wherein initiating the interactive overlay sequence is performed through a server.
17. The method of claim 16 wherein unfavorable feedback is one of enlarging the interactive overlay, moving the interactive overlay around the display, making the interactive overlay opaque, and locating the interactive overlay in the centroid of the display.
18. The method of claim 13 wherein the first change is an increase in time between displaying subsequent statuses in the overlay sequence and the second change is a decrease in time between displaying subsequent statuses in the overlay sequence.
19. The method of claim 13 further comprising accepting an administrative log in allowing an administrator to modify the set of interactive overlay rules during the interactive overlay sequence.
20. A method for providing an interactive overlay sequence, comprising:
displaying video content on a display screen;
initiating the interactive overlay sequence in accordance with a set of interactive overlay rules;
displaying a question for a user as part of the interactive overlay sequence after a period of time defined by the set of interactive overlay rules; and
providing feedback to the user, such that a correct response from the user results in positive feedback and an increase in the period of time before a next question in the interactive overlay sequence, a incorrect response from the user results in negative feedback and an decrease in the period of time before the next question, and a failure of the user to respond results in a change to the interactive overlay sequence to substantially obscure the video content.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/963,595 US20150040008A1 (en) | 2013-08-02 | 2013-08-09 | Interactive overlay for video applications |
CA 2823746 CA2823746A1 (en) | 2012-08-10 | 2013-08-12 | Interactive overlay for video applications |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361861801P | 2013-08-02 | 2013-08-02 | |
US13/963,595 US20150040008A1 (en) | 2013-08-02 | 2013-08-09 | Interactive overlay for video applications |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150040008A1 true US20150040008A1 (en) | 2015-02-05 |
Family
ID=52428297
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/963,595 Abandoned US20150040008A1 (en) | 2012-08-10 | 2013-08-09 | Interactive overlay for video applications |
US14/450,805 Active 2034-08-28 US9971004B2 (en) | 2013-08-02 | 2014-08-04 | Treatment planning and delivery using temperature uncertainty maps |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/450,805 Active 2034-08-28 US9971004B2 (en) | 2013-08-02 | 2014-08-04 | Treatment planning and delivery using temperature uncertainty maps |
Country Status (6)
Country | Link |
---|---|
US (2) | US20150040008A1 (en) |
EP (1) | EP2869776B1 (en) |
CA (1) | CA2881596C (en) |
DE (1) | DE14814725T1 (en) |
ES (1) | ES2781763T3 (en) |
WO (1) | WO2015015307A2 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170371853A1 (en) * | 2016-06-28 | 2017-12-28 | Google Inc. | Measurement of visibility of overlay content |
WO2018213745A1 (en) * | 2017-05-18 | 2018-11-22 | Aiqudo, Inc. | Optimizing display engagement in action automation |
US10768425B2 (en) * | 2017-02-14 | 2020-09-08 | Securiport Llc | Augmented reality monitoring of border control systems |
US11531465B2 (en) * | 2018-04-17 | 2022-12-20 | Casio Computer Co., Ltd. | Display control apparatus, non-transitory recording medium and display controlling method for creating first tag, second tag not overlapping other tags displayed, and indicator correlating second tag with first tag |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016211821A1 (en) * | 2016-06-30 | 2018-01-04 | Robert Bosch Gmbh | Method for non-contact determination of a temperature and infrared measuring system |
WO2019086921A1 (en) * | 2017-10-30 | 2019-05-09 | Profound Medical Inc. | Thermal therapy with dynamic anatomical boundaries using mri-based temperature uncertainty maps |
US11471053B2 (en) | 2017-10-30 | 2022-10-18 | Profound Medical Inc. | Thermal therapy with dynamic anatomical boundaries using MRI-based temperature uncertainty maps |
US10677866B1 (en) * | 2018-11-28 | 2020-06-09 | Insightec, Ltd. | Systems and methods for correcting measurement artifacts in MR thermometry |
US11442128B2 (en) * | 2019-10-01 | 2022-09-13 | Profound Medical Inc. | Method for filtering erroneous pixels in a thermal therapy control system |
US20210161588A1 (en) * | 2019-11-29 | 2021-06-03 | Canon Medical Systems Corporation | Medical image processing apparatus |
FR3121345A1 (en) * | 2021-03-31 | 2022-10-07 | Universite de Bordeaux | Heat treatment set |
DE102021123863A1 (en) | 2021-09-15 | 2023-03-16 | Medizinische Hochschule Hannover, Körperschaft des öffentlichen Rechts | Method and evaluation device for evaluating acquisition data from an MRT system and computer program |
Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5219291A (en) * | 1987-10-28 | 1993-06-15 | Video Technology Industries, Inc. | Electronic educational video system apparatus |
US5734853A (en) * | 1992-12-09 | 1998-03-31 | Discovery Communications, Inc. | Set top terminal for cable television delivery systems |
US6201538B1 (en) * | 1998-01-05 | 2001-03-13 | Amiga Development Llc | Controlling the layout of graphics in a television environment |
US20030077559A1 (en) * | 2001-10-05 | 2003-04-24 | Braunberger Alfred S. | Method and apparatus for periodically questioning a user using a computer system or other device to facilitate memorization and learning of information |
US20030165802A1 (en) * | 2002-03-04 | 2003-09-04 | Murphy Rick L. | Method, device and system for providing educational services |
US20030217166A1 (en) * | 2002-05-17 | 2003-11-20 | Mario Dal Canto | System and method for provisioning universal stateless digital and computing services |
US20040122898A1 (en) * | 2002-12-20 | 2004-06-24 | International Business Machines Corporation | Collaborative review of distributed content |
US20040241633A1 (en) * | 2003-05-28 | 2004-12-02 | Drozda William P. | Professor pop-up & method |
US20050028191A1 (en) * | 1999-08-17 | 2005-02-03 | Sullivan Gary E. | Content control system |
US20050089834A1 (en) * | 2003-10-23 | 2005-04-28 | Shapiro Jeffrey S. | Educational computer program |
US20060015580A1 (en) * | 2004-07-01 | 2006-01-19 | Home Box Office, A Delaware Corporation | Multimedia content distribution |
US20070037131A1 (en) * | 2005-08-11 | 2007-02-15 | Anderson Joseph M | Incentivized educational device and method |
US20070160969A1 (en) * | 2006-01-11 | 2007-07-12 | Barton Benny M | Method and Apparatus for Associating User Evaluations with Independent Content Sources |
US20080094413A1 (en) * | 2006-10-24 | 2008-04-24 | Autor Jeffrey S | Display controller |
US20080160974A1 (en) * | 2006-12-29 | 2008-07-03 | Nokia Corporation | Transferring task completion to another device |
US20090165033A1 (en) * | 2007-12-19 | 2009-06-25 | General Instrument Corporation | Content Viewing as an Incentive for Educational Activities |
US20090178114A1 (en) * | 2008-01-09 | 2009-07-09 | Aviva Susser | Educational log-on method |
US20090202968A1 (en) * | 2008-02-13 | 2009-08-13 | Popspring Llc | Systems and Methods for Combining Electronic Educational and Entertainment Media |
US7624355B2 (en) * | 2004-05-27 | 2009-11-24 | Baneth Robin C | System and method for controlling a user interface |
US20100325527A1 (en) * | 2009-06-18 | 2010-12-23 | Microsoft Corporation | Overlay for digital annotations |
US20110023063A1 (en) * | 2009-07-23 | 2011-01-27 | Fmr Llc | Inserting Personalized Information into Digital Content |
US20110167355A1 (en) * | 2010-01-04 | 2011-07-07 | Samsung Electronics Co., Ltd. | Method and system for providing users login access to multiple devices via a communication system |
US20120078720A1 (en) * | 2010-09-28 | 2012-03-29 | Startforce, Inc. | Virtual desktop service with targeted advertisement |
US20120172100A1 (en) * | 2011-01-03 | 2012-07-05 | International Business Machines Corporation | Virtual Lesson Plan Integration |
US20130212396A1 (en) * | 2012-02-10 | 2013-08-15 | Zynga Inc. | Methods and Systems for State Synchronization Over a Non-Reliable Network Using Signature Processing |
US20130244784A1 (en) * | 2008-11-04 | 2013-09-19 | Quado Media Inc. | Multi-player, multi-screens, electronic gaming platform and system |
US20140359637A1 (en) * | 2013-06-03 | 2014-12-04 | Microsoft Corporation | Task continuance across devices |
Family Cites Families (44)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US787920A (en) | 1904-03-31 | 1905-04-25 | Frederick Hofmann | Medical apparatus. |
US4844073A (en) | 1986-12-01 | 1989-07-04 | Jerzy Pohler | Device for treatment of hemorroids and rectal tissue after surgery treatment |
US4841970A (en) | 1988-01-26 | 1989-06-27 | Herbert Rand | Cryogenic rectal insert |
US5316000A (en) | 1991-03-05 | 1994-05-31 | Technomed International (Societe Anonyme) | Use of at least one composite piezoelectric transducer in the manufacture of an ultrasonic therapy apparatus for applying therapy, in a body zone, in particular to concretions, to tissue, or to bones, of a living being and method of ultrasonic therapy |
US5417721A (en) | 1992-06-15 | 1995-05-23 | Mallasch; Luther F. | Prostate gland enlargement reducing device |
EP0597463A3 (en) | 1992-11-13 | 1996-11-06 | Dornier Med Systems Inc | Thermotherapiesonde. |
IL108744A (en) | 1994-02-22 | 1998-12-27 | Trop Life Ltd | Cooling cylindrical device for therapeutic treatment of hemorrhoids |
US6056744A (en) | 1994-06-24 | 2000-05-02 | Conway Stuart Medical, Inc. | Sphincter treatment apparatus |
US5733316A (en) | 1995-10-27 | 1998-03-31 | Dornier Medical Systems, Inc. | Organ separation for thermal therapy |
FR2750340B1 (en) | 1996-06-28 | 1999-01-15 | Technomed Medical Systems | THERAPY PROBE |
US6009351A (en) | 1997-07-14 | 1999-12-28 | Urologix, Inc. | System and method for transurethral heating with rectal cooling |
US6159207A (en) | 1997-07-31 | 2000-12-12 | Yoon; Inbae | Protected ablation method and apparatus |
US6719779B2 (en) | 2000-11-07 | 2004-04-13 | Innercool Therapies, Inc. | Circulation set for temperature-controlled catheter and method of using the same |
US20020010502A1 (en) | 1998-04-01 | 2002-01-24 | Trachtenberg John R. | Thermotherapy method |
US6478793B1 (en) | 1999-06-11 | 2002-11-12 | Sherwood Services Ag | Ablation treatment of bone metastases |
EP1244392A1 (en) | 1999-09-28 | 2002-10-02 | Novasys Medical, Inc. | Treatment of tissue by application of energy and drugs |
GB0007145D0 (en) | 2000-03-24 | 2000-05-17 | Beehive | Device for anal pain relief |
US6726708B2 (en) | 2000-06-14 | 2004-04-27 | Innercool Therapies, Inc. | Therapeutic heating and cooling via temperature management of a colon-inserted balloon |
US6477426B1 (en) | 2000-06-20 | 2002-11-05 | Celsion Corporation | System and method for heating the prostate gland to treat and prevent the growth and spread of prostate tumors |
US6932771B2 (en) | 2001-07-09 | 2005-08-23 | Civco Medical Instruments Co., Inc. | Tissue warming device and method |
AU2002350313B2 (en) | 2001-12-14 | 2005-12-01 | Monteris Medical Inc. | Hyperthermia treatment and probe therefor |
US6746465B2 (en) | 2001-12-14 | 2004-06-08 | The Regents Of The University Of California | Catheter based balloon for therapy modification and positioning of tissue |
US20050177209A1 (en) | 2002-03-05 | 2005-08-11 | Baylis Medical Company Inc. | Bipolar tissue treatment system |
US7422568B2 (en) | 2002-04-01 | 2008-09-09 | The Johns Hopkins University | Device, systems and methods for localized heating of a vessel and/or in combination with MR/NMR imaging of the vessel and surrounding tissue |
US20040039430A1 (en) | 2002-08-20 | 2004-02-26 | Xanodyne Pharmacal, Inc. | System and method using the rectal mucosal membrane for inducing hypothermia and warming |
US20040215177A1 (en) | 2003-04-24 | 2004-10-28 | Scimed Life Systems, Inc. | Therapeutic apparatus having insulated region at the insertion area |
US7101387B2 (en) | 2003-04-30 | 2006-09-05 | Scimed Life Systems, Inc. | Radio frequency ablation cooling shield |
US20050065429A1 (en) | 2003-09-18 | 2005-03-24 | Ge Medical Systems Global Technology Company, Llc | Method for three plane interleaved acquisition for three dimensional temperature monitoring with MRI |
US7077858B2 (en) | 2003-09-22 | 2006-07-18 | Coolhead Technologies, Inc. | Flexible heat exchangers for medical cooling and warming applications |
US7326195B2 (en) | 2003-11-18 | 2008-02-05 | Boston Scientific Scimed, Inc. | Targeted cooling of tissue within a body |
ES2760995T3 (en) | 2004-06-23 | 2020-05-18 | Bioprotect Ltd | Tissue displacement or separation device |
WO2006013547A1 (en) | 2004-08-02 | 2006-02-09 | Koninklijke Philips Electronics N.V. | Mri thermometry involing phase mapping and reference medium used as phase reference |
US7771418B2 (en) * | 2005-03-09 | 2010-08-10 | Sunnybrook Health Sciences Centre | Treatment of diseased tissue using controlled ultrasonic heating |
US8801701B2 (en) | 2005-03-09 | 2014-08-12 | Sunnybrook Health Sciences Centre | Method and apparatus for obtaining quantitative temperature measurements in prostate and other tissue undergoing thermal therapy treatment |
US8016757B2 (en) * | 2005-09-30 | 2011-09-13 | University Of Washington | Non-invasive temperature estimation technique for HIFU therapy monitoring using backscattered ultrasound |
US8641707B2 (en) | 2006-12-29 | 2014-02-04 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Medical device having a bimaterial valve |
EP2155333A4 (en) * | 2007-06-08 | 2013-07-31 | Cynosure Inc | Coaxial suction system for laser lipolysis |
US20090018446A1 (en) | 2007-07-10 | 2009-01-15 | Insightec, Ltd. | Transrectal ultrasound ablation probe |
US20090157070A1 (en) | 2007-12-18 | 2009-06-18 | Boston Scientific Scimed, Inc. | Medical treatment using pulsed energy |
WO2010038162A1 (en) | 2008-09-30 | 2010-04-08 | Koninklijke Philips Electronics, N.V. | System and method for ultrasound therapy treatment |
US10271889B2 (en) | 2010-06-27 | 2019-04-30 | Sunnybrook Health Sciences Centre | Apparatus and method for cooling a tissue volume during thermal therapy treatment |
US9981148B2 (en) | 2010-10-22 | 2018-05-29 | Insightec, Ltd. | Adaptive active cooling during focused ultrasound treatment |
EP2744570B1 (en) | 2011-09-27 | 2016-08-17 | Koninklijke Philips N.V. | High intensity focused ultrasound enhanced by cavitation |
CN108113762A (en) * | 2012-06-27 | 2018-06-05 | 曼特瑞斯医药有限责任公司 | The image guided therapy of tissue |
-
2013
- 2013-08-09 US US13/963,595 patent/US20150040008A1/en not_active Abandoned
-
2014
- 2014-08-04 ES ES14814725T patent/ES2781763T3/en active Active
- 2014-08-04 WO PCT/IB2014/002321 patent/WO2015015307A2/en active Application Filing
- 2014-08-04 US US14/450,805 patent/US9971004B2/en active Active
- 2014-08-04 DE DE14814725.9T patent/DE14814725T1/en active Pending
- 2014-08-04 CA CA2881596A patent/CA2881596C/en active Active
- 2014-08-04 EP EP14814725.9A patent/EP2869776B1/en active Active
Patent Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5219291A (en) * | 1987-10-28 | 1993-06-15 | Video Technology Industries, Inc. | Electronic educational video system apparatus |
US5734853A (en) * | 1992-12-09 | 1998-03-31 | Discovery Communications, Inc. | Set top terminal for cable television delivery systems |
US6201538B1 (en) * | 1998-01-05 | 2001-03-13 | Amiga Development Llc | Controlling the layout of graphics in a television environment |
US20050028191A1 (en) * | 1999-08-17 | 2005-02-03 | Sullivan Gary E. | Content control system |
US20030077559A1 (en) * | 2001-10-05 | 2003-04-24 | Braunberger Alfred S. | Method and apparatus for periodically questioning a user using a computer system or other device to facilitate memorization and learning of information |
US20030165802A1 (en) * | 2002-03-04 | 2003-09-04 | Murphy Rick L. | Method, device and system for providing educational services |
US20030217166A1 (en) * | 2002-05-17 | 2003-11-20 | Mario Dal Canto | System and method for provisioning universal stateless digital and computing services |
US20040122898A1 (en) * | 2002-12-20 | 2004-06-24 | International Business Machines Corporation | Collaborative review of distributed content |
US20040241633A1 (en) * | 2003-05-28 | 2004-12-02 | Drozda William P. | Professor pop-up & method |
US20050089834A1 (en) * | 2003-10-23 | 2005-04-28 | Shapiro Jeffrey S. | Educational computer program |
US7624355B2 (en) * | 2004-05-27 | 2009-11-24 | Baneth Robin C | System and method for controlling a user interface |
US20060015580A1 (en) * | 2004-07-01 | 2006-01-19 | Home Box Office, A Delaware Corporation | Multimedia content distribution |
US20070037131A1 (en) * | 2005-08-11 | 2007-02-15 | Anderson Joseph M | Incentivized educational device and method |
US20070160969A1 (en) * | 2006-01-11 | 2007-07-12 | Barton Benny M | Method and Apparatus for Associating User Evaluations with Independent Content Sources |
US20080094413A1 (en) * | 2006-10-24 | 2008-04-24 | Autor Jeffrey S | Display controller |
US20080160974A1 (en) * | 2006-12-29 | 2008-07-03 | Nokia Corporation | Transferring task completion to another device |
US20090165033A1 (en) * | 2007-12-19 | 2009-06-25 | General Instrument Corporation | Content Viewing as an Incentive for Educational Activities |
US20090178114A1 (en) * | 2008-01-09 | 2009-07-09 | Aviva Susser | Educational log-on method |
US20090202968A1 (en) * | 2008-02-13 | 2009-08-13 | Popspring Llc | Systems and Methods for Combining Electronic Educational and Entertainment Media |
US20130244784A1 (en) * | 2008-11-04 | 2013-09-19 | Quado Media Inc. | Multi-player, multi-screens, electronic gaming platform and system |
US20100325527A1 (en) * | 2009-06-18 | 2010-12-23 | Microsoft Corporation | Overlay for digital annotations |
US20110023063A1 (en) * | 2009-07-23 | 2011-01-27 | Fmr Llc | Inserting Personalized Information into Digital Content |
US20110167355A1 (en) * | 2010-01-04 | 2011-07-07 | Samsung Electronics Co., Ltd. | Method and system for providing users login access to multiple devices via a communication system |
US20120078720A1 (en) * | 2010-09-28 | 2012-03-29 | Startforce, Inc. | Virtual desktop service with targeted advertisement |
US20120172100A1 (en) * | 2011-01-03 | 2012-07-05 | International Business Machines Corporation | Virtual Lesson Plan Integration |
US20130212396A1 (en) * | 2012-02-10 | 2013-08-15 | Zynga Inc. | Methods and Systems for State Synchronization Over a Non-Reliable Network Using Signature Processing |
US20140359637A1 (en) * | 2013-06-03 | 2014-12-04 | Microsoft Corporation | Task continuance across devices |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170371853A1 (en) * | 2016-06-28 | 2017-12-28 | Google Inc. | Measurement of visibility of overlay content |
US10042829B2 (en) * | 2016-06-28 | 2018-08-07 | Google Llc | Measurement of visibility of overlay content |
US10768425B2 (en) * | 2017-02-14 | 2020-09-08 | Securiport Llc | Augmented reality monitoring of border control systems |
US20200400959A1 (en) * | 2017-02-14 | 2020-12-24 | Securiport Llc | Augmented reality monitoring of border control systems |
WO2018213745A1 (en) * | 2017-05-18 | 2018-11-22 | Aiqudo, Inc. | Optimizing display engagement in action automation |
US11397558B2 (en) * | 2017-05-18 | 2022-07-26 | Peloton Interactive, Inc. | Optimizing display engagement in action automation |
US11900017B2 (en) | 2017-05-18 | 2024-02-13 | Peloton Interactive, Inc. | Optimizing display engagement in action automation |
US11531465B2 (en) * | 2018-04-17 | 2022-12-20 | Casio Computer Co., Ltd. | Display control apparatus, non-transitory recording medium and display controlling method for creating first tag, second tag not overlapping other tags displayed, and indicator correlating second tag with first tag |
Also Published As
Publication number | Publication date |
---|---|
WO2015015307A3 (en) | 2015-07-16 |
US20150038883A1 (en) | 2015-02-05 |
CA2881596A1 (en) | 2015-02-05 |
ES2781763T3 (en) | 2020-09-07 |
DE14814725T1 (en) | 2015-09-03 |
US9971004B2 (en) | 2018-05-15 |
WO2015015307A2 (en) | 2015-02-05 |
EP2869776A2 (en) | 2015-05-13 |
EP2869776B1 (en) | 2020-02-19 |
EP2869776A4 (en) | 2017-10-11 |
CA2881596C (en) | 2023-01-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20150040008A1 (en) | Interactive overlay for video applications | |
US9940006B2 (en) | Intuitive interfaces for real-time collaborative intelligence | |
CN107801101B (en) | System and method for optimized and efficient interactive experience | |
US11771987B2 (en) | Limbo spectating in a video game | |
US11623144B2 (en) | Intervention server and intervention program | |
US8790172B2 (en) | Game providing apparatus and recording medium | |
US11423795B2 (en) | Cognitive training utilizing interaction simulations targeting stimulation of key cognitive functions | |
CN112527171B (en) | Multimedia file playing method, device, equipment and medium | |
EP3155584A1 (en) | Intuitive interfaces for real-time collaborative intelligence | |
EP3478381B1 (en) | Communication methods, communication devices, and servers | |
US9526988B2 (en) | Game for portable devices or other gaming devices | |
JP5586771B1 (en) | Server and method for providing game | |
TWI765883B (en) | Methods for facilitating game play, systems providing artificial intelligence game mentor for facilitating game play, and computer-readable media | |
US20170025035A1 (en) | Method of generating a therapeutic game for treating a patient | |
CA2823746A1 (en) | Interactive overlay for video applications | |
Centieiro et al. | Enhancing remote live sports experiences through an eyes-free interaction | |
US20210370167A1 (en) | System and method for peer-to-peep wireless gaming | |
JP6781780B2 (en) | Game programs and game equipment | |
JP7365087B1 (en) | Video control system | |
CN111481922A (en) | Interaction method and device in game and electronic equipment | |
JP7069493B2 (en) | Game programs and game equipment | |
JP5777835B1 (en) | GAME PROGRAM, GAME PROCESSING METHOD, AND INFORMATION PROCESSING DEVICE | |
US20230370678A1 (en) | Method for Configuring a Multimedia Entertainment System | |
Castro et al. | Accessibility Strategies in a Mobile Card Game | |
Centieiro et al. | Bet without looking: studying eyes-free interaction during live sports |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: GAMER PARENTS INC., OHIO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REDENSHEK, TODD;LAWRENCE, VICKY;REEL/FRAME:031669/0747 Effective date: 20131114 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |