US20150128050A1 - User interface for internet of everything environment - Google Patents
User interface for internet of everything environment Download PDFInfo
- Publication number
- US20150128050A1 US20150128050A1 US14/324,174 US201414324174A US2015128050A1 US 20150128050 A1 US20150128050 A1 US 20150128050A1 US 201414324174 A US201414324174 A US 201414324174A US 2015128050 A1 US2015128050 A1 US 2015128050A1
- Authority
- US
- United States
- Prior art keywords
- appliance
- interface
- collection
- icons
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
- H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/4143—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a Personal Computer [PC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42208—Display device provided on the remote control
- H04N21/42209—Display device provided on the remote control for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42224—Touch pad or touch panel provided on the remote control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4227—Providing Remote input by a user located remotely from the client device, e.g. at work
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43079—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on multiple devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
- H04N21/44224—Monitoring of user activity on external systems, e.g. Internet browsing
- H04N21/44226—Monitoring of user activity on external systems, e.g. Internet browsing on social networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4784—Supplemental services, e.g. displaying phone caller identification, shopping application receiving rewards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
Definitions
- the present technology pertains to remotely-controlling devices, and more specifically to a universal interface for controlling any networked appliance.
- FIG. 1 is an example system embodiment of the present technology illustrating appliances, an appliance service, and a mobile device running applications for interacting with the appliances;
- FIG. 2A , 2 B, and 2 C illustrate an example graphical user interface of an Internet of Everything (IoE) application of the present technology
- FIG. 3A illustrates a further example of graphical user interface of an Internet of Everything application of the present technology
- FIG. 3B illustrates the graphical user interface of FIG. 3A rendered on an example mobile device
- FIG. 4 illustrates an example graphical user interface for an appliance
- FIG. 5A illustrates a first example interface for interacting with a television appliance
- FIG. 5B illustrates a second example interface for interacting with a television appliance
- FIG. 6A illustrates an IoE interface with two devices selected
- FIG. 6B illustrates an interface for interacting with the personal computing device and the digital picture frame selected in FIG. 6A ;
- FIG. 7 illustrates an example method embodiment wherein steps on the right are performed by the appliance service, steps on the left are performed by the IoE app, and a step in the middle could be performed by either entity;
- FIG. 8A and FIG. 8B illustrate exemplary possible system embodiments.
- the present technology pertains to presenting and interacting with any networked appliance in an environment.
- a device can be registered with an appliance service, represented in a graphical user interface that allows selection of the appliance through selection of an icon, and controlled using a graphical user interface that presents functions of the appliance.
- the term “configured” shall be considered interchangeable with configured and configurable, unless the term “configurable” is explicitly used to distinguish from “configured.”
- the term “transceiver” can mean a single device comprising a transmitter and receiver or can mean a separate transmitter and a separate receiver. The proper understanding of the term will be apparent to persons of ordinary skill in the art in the context in which the term is used.
- FIG. 1 is an example system embodiment of the present technology, illustrating appliances, an appliance service, and a mobile device running applications for interacting with the appliances.
- FIG. 1 illustrates example appliances 100 : automobile 101 , refrigerator 103 , television 105 , and lighting 107 .
- Each appliance is configured with a network interface for sending and receiving electronic messages over a network, and each appliance can include its own application programming interface 102 , 104 , 106 , 108 for making certain device functions available to other devices that wish to remotely control one of the appliances 101 , 103 , 105 , 107 , or work in concert with one of the appliances.
- the API is specific to the device type, but not necessarily the specific device model. It may be that the API conforms to an industry standard, whether it is an officially recognized or de facto standard. In some embodiments, the API is specific to the manufacturer or model of the specific appliance.
- FIG. 1 illustrates example appliances 100 that can be used with the present technology it will be understood by persons of ordinary skill in the art that these examples are not limiting. Any networked device can potentially be an appliance. Likewise, while the appliances are shown having their own API, this is not a requirement of the present technology.
- FIG. 1 also illustrates an appliance service 120 that is configured to register network connected appliances 100 in registered appliance database 124 .
- Appliances 100 can request to register with the appliance service 120 through a communication, using an appliance service application programming interface (API) 122 .
- API appliance service application programming interface
- the refrigerator could send a network message using a register device API, e.g., reg.device (refrigerator_model_XYZ).
- the application service 120 can run on any networked computing device. In some embodiments this could be any of the following: a dedicated computing device, a routing device, a set top box, laptop, or portable computing device. In embodiments wherein the application service 120 runs on a mostly stationary device, the application service 120 can be used with multiple portable computing devices, such as portable computing device 110 , allowing potentially multiple devices to interact with appliances through just one instance of the application service 120 . However, in embodiments wherein the application service 120 runs on a portable or personal device, separate instances of the application service 120 would be required on each device to compensate for the possibility that a portable device might leave the networked environment.
- FIG. 1 also illustrates portable computing device 110 .
- Portable computing device 110 can have an Internet of Everything (IoE) application 112 running thereon that is configured to provide a consistent interface for controlling any appliance that has registered with the appliance service 120 .
- the appliance service 120 is responsible for communicating to the IoE application 112 which devices are registered.
- IoE Internet of Everything
- the IoE application 112 upon learning of a registered device, can download an app 114 to interface with the appliance.
- the appliance app 114 can be an appliance-specific app that is specific to a particular registered model of the appliance.
- the appliance app can be a generic app for any appliance of the same type (e.g., app of refrigerators, app for televisions, etc.).
- FIG. 2A , 2 B, and 2 C illustrate an example graphical user interface of an Internet of Everything application of the present technology.
- the interface illustrated in FIG. 2 A, 2 B, and 2 C is a continuous interfaces that can be scrollable left and right to reveal appliances on a display of a computing device.
- Each appliance that is illustrated in interface 200 represents an appliance that has been registered with the appliance service 120 , and can be controlled by the IoE app 112 or appliance app 114 .
- Some example devices that can be presented in interface 200 include: a water meter 201 , power meter 202 , plumbing fixture 203 , a cleaning device 204 , a recycling or rubbish container 206 , wine cellar 207 , kitchen appliance 208 , refrigerator 209 , personal health device 210 , thermostat 211 , personal device 212 , television 213 , camera or photo collection 214 , sound system 215 , lights or lighting 216 , digital photo frames 217 , toys 218 , windows or shades 219 , plant condition monitor 220 , door/door lock 221 , security camera 222 , personal health monitoring appliances 223 , automobile 224 , etc.
- Interface 200 is configured to be horizontally scrollable to reveal the full list of appliances. A user can select one or more of the appliances through the interfaces to interact with the device.
- the icons in interface 200 which appear to represent a single appliance can represent multiple appliances fitting a category.
- the lighting icon 216 might represent all lighting in the environment or a particular light.
- health monitoring appliances 223 can include a variety of devices from pedometers to blood sugar meters, to smart watches with biometric sensors.
- selection of the icon can bring up a selection menu to choose the specific appliance, or an appliance app will be configured to allow for selection of a single appliance or coordinated interaction with two or more appliances in the category at once.
- FIG. 3A illustrates a further example of graphical user interface of an Internet of Everything application of the present technology.
- FIG. 3A illustrates device overview interface 250 , which displays appliances in the same scrollable interfaces as illustrated in FIGS. 2A-2C , along with notifications 252 .
- These notifications 252 can include data that is reported by the appliances 100 , or messages generated by the appliances 100 or the appliance apps 114 .
- FIG. 3B illustrates the graphical user interface of FIG. 3A rendered on an example mobile device.
- Device overview interface 250 can be rendered on a portable computing device and can be scrollable in a left or right direction.
- Each appliance icon and badge can be selected by entering a selection action into the graphical user interfaces.
- the selection action includes a tap on a touchscreen device or a click of the mouse.
- a selection action can launch an interface for interacting with the appliance.
- FIG. 4 illustrates an example graphical user interface for an appliance.
- graphical user interface 302 is an example interface for a thermostat.
- a user of the IoE App 112 browsed device overview interface 250 and selected icon 211 representing a thermostat, which launched interface 302 on portable computing device 110 .
- interface 302 is presented by a stand-alone appliance app that is specific to the particular make and model of the thermostat/climate control device.
- IoE App 112 contains a reference to the stand-alone appliance app, and when the icon—such as icon 211 —representing the appliance is selected, the IoE application launches the stand alone appliance app. In such embodiments it may be possible to launch the stand alone appliance app from other points within the portable computing device operating system as well from the IoE App 112 .
- interface 302 is presented by an add-on module to the IoE App 112 .
- the appliance app runs within, or at least appears to the user to run in, the same context as the IoE App 112 . In such embodiments, it may only be possible to launch the appliance interface from within the IoE App 112 .
- interface 302 is a generic interface illustrating generic controls for an appliance of a given type, e.g., a generic interface for thermostats.
- interface 302 can present information about the networked appliance, and one or more controls to adjust settings or to provide instructions to the networked appliance.
- a thermostat interface such as interface 302 might display a temperature 304 (current temperature or a set temperature), time day settings for turning the climate control system on or off, a virtual power switch 306 , etc.
- Interface 302 can also include an interface object for closing out of interface 302 and returning to the device overview interface 250 of the IoE app 112 .
- FIG. 5A illustrates a first example interface for interacting with a television appliance.
- FIG. 5B illustrates a second example interface for interacting with a television appliance.
- FIG. 5A illustrates a television appliance 105 and a portable computing device 110 having a graphical user interface 310 of a television appliance app for interacting with the television appliance 105 .
- FIG. 5B illustrates another interface 320 of the television appliance app for interacting with the television appliance 105 .
- Interfaces 310 and 320 can be considered different menus or screen of the television appliance app and can be used together to interact with the television appliance 105 .
- the television appliance app can be manufacture or model specific or generic.
- Interface 310 in FIG. 5A can include a portion of the interface that mirrors or previews content that can be displayed on the television appliance 105 .
- Interface 310 can also include sub-apps 312 for use with the television appliance.
- these sub-apps 312 may be apps that are used along with the appliance.
- Sub-apps 312 can include apps that provide a portion of the second screen experience.
- sub-apps 312 can provide additional interfaces for controlling the television appliance 105 .
- one of the sub-apps 312 when selected could open a content browsing interface such as a program guide that can be used to tune the television appliance to a new program or channel, or library of content (interface 320 ) that can be used to display recorded content, or cloud hosted content.
- a content browsing interface such as a program guide that can be used to tune the television appliance to a new program or channel, or library of content (interface 320 ) that can be used to display recorded content, or cloud hosted content.
- appliance apps can be launched by selection of an icon in device overview interface 250 that represents an appliance.
- device overview interface 250 can support the selection of more than one appliance.
- FIG. 6A illustrates an IoE interface with two devices selected.
- FIG. 6A illustrates device overview interface 250 displaying a collection of appliances as addressed above, having selections 350 and 352 selecting a personal computing device 212 and digital photo frames 217 , respectively.
- a long tap or a long click can be used to indicate that other devices are to be selected to prevent the IoE app 112 from immediately launching an interface or app that applies to the first appliance selected.
- the graphical user device overview interface 250 of the IoE app 112 can receive a long selection action on photo frame appliance 217 and then receive a selection of personal computing device 212 to launch an interface that is common for both appliances.
- IoE app 112 can present a collection of controls or options for selecting additional interfaces that makes use of, or are relevant to, both of the selected appliances. For example selection of any appliance and a power meter might present an interface for adjusting power consumption for that device, or presenting power consumption statistics. Another example might include selecting an input device—such as a camera, computing device, etc.—and a display device to bring up options for displaying content on the display device. Another example might include selecting an audio output device, such as personal computing device television and speakers, to bring up audio output options.
- FIG. 6B illustrates an interface for interacting with the personal computing device and the digital picture frame selected in FIG. 6A .
- the interface illustrated in FIG. 6B shows available digital picture frame appliances 405 and a collection of photos 410 stored on personal computing device 212 .
- a user can select a photo(s) from the collection and drag it to one of the digital picture frames 405 to cause the selected photo(s) to be transferred from the personal computing device 212 to the selected picture frames.
- the appliance apps 114 or the IoE app 112 can include device recipes, which are two or more control operations that to be used together to affect a result at an appliance.
- a recipe could include a lighting recipe configured to keep lighting in a room at a current level. Therefore the recipe would call for periodic sampling of the light level in the room and adjusting the lumens of the light output to maintain the light level in the room.
- these recipes can be preconfigured in an appliance specific application or in the IoE app 112 .
- a user can create their own recipes and save them for later selection.
- recipes can be used to control two or more appliances wherein a recipe might include one or more control operations for each of the two or more appliances.
- a recipe affecting two appliances could be a slide show recipe which displays photographs from a portable computing device on a television display.
- Such recipes can be selected from within the IoE app, appliance specific apps, or can be presented when a user selects two appliances to which a recipe pertains.
- FIG. 7 illustrates an example method embodiment wherein steps on the right are performed by the appliance service, steps on the left are performed by the IoE app, and a step in the middle could be performed by either entity.
- the method of FIG. 7 begins with registering an appliance 100 with the appliance service 120 .
- An appliance might broadcast its presence to network using a network discovery protocol such that the appliance can be detected ( 500 ) by the appliance service 120 , or an appliance service 120 might ping devices on a network to detect ( 500 ) the presence of an appliance. If the appliance service 120 detects ( 500 ) an unregistered appliance, the appliance service can send ( 502 ) an invitation message to the appliance inviting the appliance to register with the appliance service 120 .
- the method of FIG. 7 can skip directly to the appliance service 120 receiving a request to register a device ( 504 ).
- the appliance service 120 itself might broadcast its presence or make it detectable to networked appliances, or a user might inform an appliance of the existence of the appliance service 120 .
- the appliance can be registered at the appliance service ( 506 ).
- IoE app 112 can be notified ( 508 ) by appliance service 120 of the presence of a registered appliance, and the IoE app can display ( 510 ) an icon representing the appliance, and download ( 512 ) an interface, commands, and recipes, if applicable for interacting with the registered appliance.
- the IoE app 112 can provide and display ( 514 ) a device overview graphical user interface.
- the device overview graphical user interface includes at least a collection of appliance icons representing appliances that can be interacted with through the IoE app 112 .
- the device overview interface can also include one or more messages from the appliances, appliance apps, or IoE app.
- a user can navigate the device overview interface of the IoE app 112 using any input device,—including a keyboard, mouse, stylus, or touch input,—to locate and select ( 516 ) one or more appliances.
- the IoE app 112 can present an appliance interface ( 518 ) that is configured to interact with the appliance.
- the IoE app 112 can present the appliance interface.
- the IoE app 112 can cause a separate appliance app to launch ( 518 ) directly from the device overview screen on the IoE app 112 .
- the appliance interface can provide controls, recipes, and messages relevant to the appliance to which the appliance interface pertains.
- the appliance interface can be navigated using the same mechanisms as the device overview interface. A user can select a control from the appliance interface ( 520 ) which is received by the app.
- a message corresponding to the selected control can be sent ( 522 ) to the appliance either by an appliance specific app, the IoE app, or the appliance service.
- the app receiving a selected control 520 communicates the desired control to the appliance service 120 , which communicates ( 522 ) the desired control to the appliance.
- the appliance service 120 communicates ( 522 ) the desired control to the appliance.
- FIG. 8A and FIG. 8B illustrate exemplary possible system embodiments. The more appropriate embodiment will be apparent to those of ordinary skill in the art when practicing the present technology. Persons of ordinary skill in the art will also readily appreciate that other system embodiments are possible.
- FIG. 8A illustrates a conventional system bus computing system architecture 600 , wherein the components of the system are in electrical communication with each other using a bus 605 .
- Exemplary system 600 includes a processing unit (CPU or processor) 610 and a system bus 605 that couples various system components including the system memory 615 —such as read only memory (ROM) 620 and random access memory (RAM) 625 —to the processor 610 .
- the system 600 can include a cache of high-speed memory connected directly with, in close proximity to, or integrated as part of the processor 610 .
- the system 600 can copy data from the memory 615 and/or the storage device 630 to the cache 612 for quick access by the processor 610 .
- the cache can provide a performance boost that avoids processor 610 delays while waiting for data.
- These and other modules can control or be configured to control the processor 610 to perform various actions.
- Other system memory 615 may be available for use as well.
- the memory 615 can include multiple different types of memory with different performance characteristics.
- the processor 610 can include any general purpose processor and a hardware module or software module—such as module 1 632 , module 2 634 , and module 3 636 —stored in storage device 630 , configured to control the processor 610 , as well as a special-purpose processor where software instructions are incorporated into the actual processor design.
- the processor 610 may essentially be a completely self-contained computing system, containing: multiple cores or processors, a bus, memory controller, cache, etc.
- a multi-core processor may be symmetric or asymmetric.
- an input device 645 can represent any number of input mechanisms, such as: a microphone for speech, a touch-sensitive screen for gesture or graphical input, keyboard, mouse, motion input, speech and so forth.
- An output device 635 can also be one or more of a number of output mechanisms known to those of skill in the art.
- multimodal systems can enable a user to provide multiple types of input to communicate with the computing device 600 .
- the communications interface 640 can generally govern and manage the user input and system output. There is no restriction on operating on any particular hardware arrangement; therefore, the basic features here may easily be substituted for improved hardware or firmware arrangements as they are developed.
- Storage device 630 is a non-volatile memory and can be a hard disk or other types of computer readable media which can store data that are accessible by a computer, such as: magnetic cassettes, flash memory cards, solid state memory devices, digital versatile disks, cartridges, random access memories (RAMs) 625 , read only memory (ROM) 620 , and hybrids thereof.
- RAMs random access memories
- ROM read only memory
- the storage device 630 can include software modules 632 , 634 , and 636 for controlling the processor 610 . Other hardware or software modules are contemplated.
- the storage device 630 can be connected to the system bus 605 .
- a hardware module that performs a particular function can include the software component stored in a computer-readable medium in connection with the necessary hardware components, such as the processor 610 , bus 605 , display 635 , and so forth, to carry out the function.
- FIG. 8B illustrates a computer system 650 having a chipset architecture that can be used in executing the described method and generating and displaying a graphical user interface (GUI).
- Computer system 650 is an example of computer hardware, software, and firmware that can be used to implement the disclosed technology.
- System 650 can include a processor 655 , representative of any number of physically and/or logically distinct resources capable of executing software, firmware, and hardware configured to perform identified computations.
- Processor 655 can communicate with a chipset 660 that can control input-to and output-from processor 655 .
- chipset 660 outputs information to output 665 , such as a display, and can read and write information to storage device 670 , which can include magnetic media, and solid state media, for example.
- Chipset 660 can also read data from and write data to RAM 675 .
- a bridge 680 for interfacing with a variety of user interface components 685 can be provided for interfacing with chipset 660 .
- Such user interface components 685 can include: a keyboard, a microphone, touch detection and processing circuitry, a pointing device, such as a mouse, and so on.
- inputs to system 650 can come from any of a variety of sources, machine generated and/or human generated.
- Chipset 660 can also interface with one or more communication interfaces 690 that can have different physical interfaces.
- Such communication interfaces can include interfaces for wired and wireless local area networks, for broadband wireless networks, as well as personal area networks.
- Some applications of the methods for generating, displaying, and using the GUI disclosed herein can include receiving ordered datasets over the physical interface or generation by the machine itself by processor 655 analyzing data stored in storage 670 or 675 . Further, the machine can receive inputs from a user—via user interface components 685 —and execute appropriate functions, such as browsing functions by interpreting these inputs using processor 655 .
- exemplary systems 600 and 650 can have more than one processor 610 or be part of a group or cluster of computing devices networked together to provide greater processing capability.
- the present technology may be presented as including individual functional blocks including: functional blocks comprising devices, device components, steps or routines in a method embodied in software, or combinations of hardware and software.
- the computer-readable storage devices, mediums, and memories can include a cable or wireless signal containing a bit stream and the like.
- non-transitory computer-readable storage media expressly exclude media, such as: energy, carrier signals, electromagnetic waves, and signals per se.
- Such instructions can comprise, for example, instructions and data which cause or otherwise configure a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Portions of computer resources used can be accessible over a network.
- the computer-executable instructions may be, for example, binaries, intermediate format instructions, such as assembly language, firmware, or source code. Examples of computer-readable media that may be used to store instructions, information used, and/or information created during methods according to described examples include: magnetic or optical disks, flash memory, USB devices provided with non-volatile memory, networked storage devices, and so on.
- Devices implementing methods according to these disclosures can comprise hardware, firmware and/or software, and can take any of a variety of form factors. Typical examples of such form factors include: laptops, smart phones, small form factor personal computers, personal digital assistants, and so on. Functionality described herein can also be embodied in peripherals or add-in cards. Such functionality can also be implemented on a circuit board among different chips or different processes executing in a single device, by way of further example.
- the instructions, media for conveying such instructions, computing resources for executing them, and other structures for supporting such computing resources are means for providing the functions described in these disclosures.
Abstract
A graphical user interface is provided that intuitively presents a collection of icons, with each icon representing one or more networked appliances in an environment. The interface allows selection of an appliance(s) and presentation of an interface for interacting with the selected appliance(s).
Description
- This application claims priority to U.S. Provisional Patent Application No. 61/901,383, filed on Nov. 7, 2013, the content of which is incorporated herein by reference in its entirety.
- The present technology pertains to remotely-controlling devices, and more specifically to a universal interface for controlling any networked appliance.
- For some time, it has been predicted that all devices in the home will eventually be connected to the Internet; this concept is currently known as the Internet of Things. While the concept of the Internet of Things has been conceptualized, this scenario has yet to be realized. While some appliances, such as various televisions, thermostats, and automobiles, are connected to the Internet and can at least read diagnostics to a mobile application—if not able to be remotely controlled—such applications are rare. And when they do exist, each application provides its own look and feel. It can also be cumbersome to have to browse for a particular application to interact with a particular appliance.
- In order to describe the manner in which the above-recited and other advantages and features of the disclosure can be obtained, a more particular description of the principles briefly described above will be rendered by reference to specific embodiments thereof, which are illustrated in the appended drawings. Understanding that these drawings depict only exemplary embodiments of the disclosure and are not therefore to be considered to be limiting of its scope, the principles herein are described and explained with additional specificity and detail through the use of the accompanying drawings.
-
FIG. 1 is an example system embodiment of the present technology illustrating appliances, an appliance service, and a mobile device running applications for interacting with the appliances; -
FIG. 2A , 2B, and 2C illustrate an example graphical user interface of an Internet of Everything (IoE) application of the present technology; -
FIG. 3A illustrates a further example of graphical user interface of an Internet of Everything application of the present technology; -
FIG. 3B illustrates the graphical user interface ofFIG. 3A rendered on an example mobile device; -
FIG. 4 illustrates an example graphical user interface for an appliance; -
FIG. 5A illustrates a first example interface for interacting with a television appliance; -
FIG. 5B illustrates a second example interface for interacting with a television appliance; -
FIG. 6A illustrates an IoE interface with two devices selected; -
FIG. 6B illustrates an interface for interacting with the personal computing device and the digital picture frame selected inFIG. 6A ; -
FIG. 7 illustrates an example method embodiment wherein steps on the right are performed by the appliance service, steps on the left are performed by the IoE app, and a step in the middle could be performed by either entity; and -
FIG. 8A andFIG. 8B illustrate exemplary possible system embodiments. - Various embodiments of the disclosure are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations may be used without parting from the spirit and scope of the disclosure.
- The present technology pertains to presenting and interacting with any networked appliance in an environment. A device can be registered with an appliance service, represented in a graphical user interface that allows selection of the appliance through selection of an icon, and controlled using a graphical user interface that presents functions of the appliance.
- As used herein, the term “configured” shall be considered interchangeable with configured and configurable, unless the term “configurable” is explicitly used to distinguish from “configured.” As used herein the term “transceiver” can mean a single device comprising a transmitter and receiver or can mean a separate transmitter and a separate receiver. The proper understanding of the term will be apparent to persons of ordinary skill in the art in the context in which the term is used.
-
FIG. 1 is an example system embodiment of the present technology, illustrating appliances, an appliance service, and a mobile device running applications for interacting with the appliances. Specifically,FIG. 1 illustrates example appliances 100:automobile 101,refrigerator 103,television 105, andlighting 107. Each appliance is configured with a network interface for sending and receiving electronic messages over a network, and each appliance can include its ownapplication programming interface appliances - While
FIG. 1 illustratesexample appliances 100 that can be used with the present technology it will be understood by persons of ordinary skill in the art that these examples are not limiting. Any networked device can potentially be an appliance. Likewise, while the appliances are shown having their own API, this is not a requirement of the present technology. -
FIG. 1 also illustrates anappliance service 120 that is configured to register network connectedappliances 100 in registeredappliance database 124.Appliances 100 can request to register with theappliance service 120 through a communication, using an appliance service application programming interface (API) 122. For example, the refrigerator could send a network message using a register device API, e.g., reg.device (refrigerator_model_XYZ). - The
application service 120 can run on any networked computing device. In some embodiments this could be any of the following: a dedicated computing device, a routing device, a set top box, laptop, or portable computing device. In embodiments wherein theapplication service 120 runs on a mostly stationary device, theapplication service 120 can be used with multiple portable computing devices, such asportable computing device 110, allowing potentially multiple devices to interact with appliances through just one instance of theapplication service 120. However, in embodiments wherein theapplication service 120 runs on a portable or personal device, separate instances of theapplication service 120 would be required on each device to compensate for the possibility that a portable device might leave the networked environment. -
FIG. 1 also illustratesportable computing device 110.Portable computing device 110 can have an Internet of Everything (IoE)application 112 running thereon that is configured to provide a consistent interface for controlling any appliance that has registered with theappliance service 120. Theappliance service 120 is responsible for communicating to the IoEapplication 112 which devices are registered. - The IoE
application 112, upon learning of a registered device, can download anapp 114 to interface with the appliance. In some embodiments theappliance app 114 can be an appliance-specific app that is specific to a particular registered model of the appliance. In some embodiments the appliance app can be a generic app for any appliance of the same type (e.g., app of refrigerators, app for televisions, etc.). -
FIG. 2A , 2B, and 2C illustrate an example graphical user interface of an Internet of Everything application of the present technology. The interface illustrated in FIG. 2A, 2B, and 2C is a continuous interfaces that can be scrollable left and right to reveal appliances on a display of a computing device. Each appliance that is illustrated ininterface 200 represents an appliance that has been registered with theappliance service 120, and can be controlled by theIoE app 112 orappliance app 114. - Some example devices that can be presented in
interface 200 include: a water meter 201, power meter 202,plumbing fixture 203, acleaning device 204, a recycling orrubbish container 206, wine cellar 207, kitchen appliance 208,refrigerator 209, personal health device 210, thermostat 211,personal device 212, television 213, camera or photo collection 214, sound system 215, lights orlighting 216, digital photo frames 217, toys 218, windows orshades 219, plant condition monitor 220, door/door lock 221, security camera 222, personalhealth monitoring appliances 223,automobile 224, etc.Interface 200 is configured to be horizontally scrollable to reveal the full list of appliances. A user can select one or more of the appliances through the interfaces to interact with the device. - In some embodiments the icons in
interface 200 which appear to represent a single appliance can represent multiple appliances fitting a category. For example, thelighting icon 216 might represent all lighting in the environment or a particular light. In another example,health monitoring appliances 223 can include a variety of devices from pedometers to blood sugar meters, to smart watches with biometric sensors. In embodiments wherein an icon represents more than one appliance, selection of the icon can bring up a selection menu to choose the specific appliance, or an appliance app will be configured to allow for selection of a single appliance or coordinated interaction with two or more appliances in the category at once. -
FIG. 3A illustrates a further example of graphical user interface of an Internet of Everything application of the present technology.FIG. 3A illustratesdevice overview interface 250, which displays appliances in the same scrollable interfaces as illustrated inFIGS. 2A-2C , along withnotifications 252. Thesenotifications 252 can include data that is reported by theappliances 100, or messages generated by theappliances 100 or theappliance apps 114. -
FIG. 3B illustrates the graphical user interface ofFIG. 3A rendered on an example mobile device.Device overview interface 250 can be rendered on a portable computing device and can be scrollable in a left or right direction. Each appliance icon and badge can be selected by entering a selection action into the graphical user interfaces. In some embodiments, the selection action includes a tap on a touchscreen device or a click of the mouse. A selection action can launch an interface for interacting with the appliance. -
FIG. 4 illustrates an example graphical user interface for an appliance. For example,graphical user interface 302 is an example interface for a thermostat. A user of theIoE App 112 browseddevice overview interface 250 and selected icon 211 representing a thermostat, which launchedinterface 302 onportable computing device 110. - In some embodiments,
interface 302 is presented by a stand-alone appliance app that is specific to the particular make and model of the thermostat/climate control device. In suchembodiments IoE App 112 contains a reference to the stand-alone appliance app, and when the icon—such as icon 211—representing the appliance is selected, the IoE application launches the stand alone appliance app. In such embodiments it may be possible to launch the stand alone appliance app from other points within the portable computing device operating system as well from theIoE App 112. - In some embodiments,
interface 302 is presented by an add-on module to theIoE App 112. In such embodiments, the appliance app runs within, or at least appears to the user to run in, the same context as theIoE App 112. In such embodiments, it may only be possible to launch the appliance interface from within theIoE App 112. - In some embodiments,
interface 302 is a generic interface illustrating generic controls for an appliance of a given type, e.g., a generic interface for thermostats. - Regardless of whether
interface 302 is a generic interface or an interface specific to a given make and model,interface 302 can present information about the networked appliance, and one or more controls to adjust settings or to provide instructions to the networked appliance. For example, a thermostat interface such asinterface 302 might display a temperature 304 (current temperature or a set temperature), time day settings for turning the climate control system on or off, avirtual power switch 306, etc.Interface 302 can also include an interface object for closing out ofinterface 302 and returning to thedevice overview interface 250 of theIoE app 112. -
FIG. 5A illustrates a first example interface for interacting with a television appliance.FIG. 5B illustrates a second example interface for interacting with a television appliance.FIG. 5A illustrates atelevision appliance 105 and aportable computing device 110 having agraphical user interface 310 of a television appliance app for interacting with thetelevision appliance 105.FIG. 5B illustrates anotherinterface 320 of the television appliance app for interacting with thetelevision appliance 105.Interfaces television appliance 105. The television appliance app can be manufacture or model specific or generic. -
Interface 310 inFIG. 5A can include a portion of the interface that mirrors or previews content that can be displayed on thetelevision appliance 105.Interface 310 can also include sub-apps 312 for use with the television appliance. In some embodiments, thesesub-apps 312 may be apps that are used along with the appliance. For example, in the case of a television appliance, it is now common for many users to watch television programming with a second screen device and interact with social media or secondary content related to the programing on the television appliance.Sub-apps 312 can include apps that provide a portion of the second screen experience. - In some embodiments, sub-apps 312 can provide additional interfaces for controlling the
television appliance 105. For example one of the sub-apps 312, when selected could open a content browsing interface such as a program guide that can be used to tune the television appliance to a new program or channel, or library of content (interface 320) that can be used to display recorded content, or cloud hosted content. - As addressed above, appliance apps can be launched by selection of an icon in
device overview interface 250 that represents an appliance. In some embodiments, it can be desirable to have two or more appliances interact together and in such embodiments,device overview interface 250 can support the selection of more than one appliance. -
FIG. 6A illustrates an IoE interface with two devices selected. Specifically,FIG. 6A illustratesdevice overview interface 250 displaying a collection of appliances as addressed above, havingselections personal computing device 212 and digital photo frames 217, respectively. In some embodiments, a long tap or a long click can be used to indicate that other devices are to be selected to prevent theIoE app 112 from immediately launching an interface or app that applies to the first appliance selected. For example, the graphical userdevice overview interface 250 of theIoE app 112 can receive a long selection action onphoto frame appliance 217 and then receive a selection ofpersonal computing device 212 to launch an interface that is common for both appliances. In some embodiments,IoE app 112 can present a collection of controls or options for selecting additional interfaces that makes use of, or are relevant to, both of the selected appliances. For example selection of any appliance and a power meter might present an interface for adjusting power consumption for that device, or presenting power consumption statistics. Another example might include selecting an input device—such as a camera, computing device, etc.—and a display device to bring up options for displaying content on the display device. Another example might include selecting an audio output device, such as personal computing device television and speakers, to bring up audio output options. -
FIG. 6B illustrates an interface for interacting with the personal computing device and the digital picture frame selected inFIG. 6A . The interface illustrated inFIG. 6B shows available digitalpicture frame appliances 405 and a collection ofphotos 410 stored onpersonal computing device 212. A user can select a photo(s) from the collection and drag it to one of the digital picture frames 405 to cause the selected photo(s) to be transferred from thepersonal computing device 212 to the selected picture frames. - In addition to replicating traditional device controls in the
appliance apps 114, theappliance apps 114 or theIoE app 112 can include device recipes, which are two or more control operations that to be used together to affect a result at an appliance. For example, a recipe could include a lighting recipe configured to keep lighting in a room at a current level. Therefore the recipe would call for periodic sampling of the light level in the room and adjusting the lumens of the light output to maintain the light level in the room. - In some embodiments, these recipes can be preconfigured in an appliance specific application or in the
IoE app 112. In some embodiments, a user can create their own recipes and save them for later selection. - In some embodiments recipes can be used to control two or more appliances wherein a recipe might include one or more control operations for each of the two or more appliances. For example a recipe affecting two appliances could be a slide show recipe which displays photographs from a portable computing device on a television display. Such recipes can be selected from within the IoE app, appliance specific apps, or can be presented when a user selects two appliances to which a recipe pertains.
-
FIG. 7 illustrates an example method embodiment wherein steps on the right are performed by the appliance service, steps on the left are performed by the IoE app, and a step in the middle could be performed by either entity. The method ofFIG. 7 begins with registering anappliance 100 with theappliance service 120. An appliance might broadcast its presence to network using a network discovery protocol such that the appliance can be detected (500) by theappliance service 120, or anappliance service 120 might ping devices on a network to detect (500) the presence of an appliance. If theappliance service 120 detects (500) an unregistered appliance, the appliance service can send (502) an invitation message to the appliance inviting the appliance to register with theappliance service 120. - In some embodiments the method of
FIG. 7 can skip directly to theappliance service 120 receiving a request to register a device (504). In such embodiments, theappliance service 120 itself might broadcast its presence or make it detectable to networked appliances, or a user might inform an appliance of the existence of theappliance service 120. - Regardless of how the appliance service and appliance learn of each other, the appliance can be registered at the appliance service (506).
- Once an appliance is registered at the
appliance service 120,IoE app 112 can be notified (508) byappliance service 120 of the presence of a registered appliance, and the IoE app can display (510) an icon representing the appliance, and download (512) an interface, commands, and recipes, if applicable for interacting with the registered appliance. - The
IoE app 112 can provide and display (514) a device overview graphical user interface. In some embodiments the device overview graphical user interface includes at least a collection of appliance icons representing appliances that can be interacted with through theIoE app 112. In some embodiments the device overview interface can also include one or more messages from the appliances, appliance apps, or IoE app. - A user can navigate the device overview interface of the
IoE app 112 using any input device,—including a keyboard, mouse, stylus, or touch input,—to locate and select (516) one or more appliances. Upon selection of an appliance theIoE app 112 can present an appliance interface (518) that is configured to interact with the appliance. In some embodiments theIoE app 112 can present the appliance interface. In some embodiments theIoE app 112 can cause a separate appliance app to launch (518) directly from the device overview screen on theIoE app 112. - The appliance interface can provide controls, recipes, and messages relevant to the appliance to which the appliance interface pertains. The appliance interface can be navigated using the same mechanisms as the device overview interface. A user can select a control from the appliance interface (520) which is received by the app.
- A message corresponding to the selected control can be sent (522) to the appliance either by an appliance specific app, the IoE app, or the appliance service. In some embodiments, it is desirable from a security perspective to have messages/commands flow between the
appliance service 120 and the appliance so that a single, trusted party is attempting to communicate and control the appliance. In such embodiments, the app receiving a selectedcontrol 520 communicates the desired control to theappliance service 120, which communicates (522) the desired control to the appliance. Of course, it is possible to communicate (522) directly from the IoE app to the appliance. -
FIG. 8A andFIG. 8B illustrate exemplary possible system embodiments. The more appropriate embodiment will be apparent to those of ordinary skill in the art when practicing the present technology. Persons of ordinary skill in the art will also readily appreciate that other system embodiments are possible. -
FIG. 8A illustrates a conventional system buscomputing system architecture 600, wherein the components of the system are in electrical communication with each other using abus 605.Exemplary system 600 includes a processing unit (CPU or processor) 610 and asystem bus 605 that couples various system components including thesystem memory 615—such as read only memory (ROM) 620 and random access memory (RAM) 625—to theprocessor 610. Thesystem 600 can include a cache of high-speed memory connected directly with, in close proximity to, or integrated as part of theprocessor 610. Thesystem 600 can copy data from thememory 615 and/or thestorage device 630 to thecache 612 for quick access by theprocessor 610. In this way, the cache can provide a performance boost that avoidsprocessor 610 delays while waiting for data. These and other modules can control or be configured to control theprocessor 610 to perform various actions.Other system memory 615 may be available for use as well. Thememory 615 can include multiple different types of memory with different performance characteristics. Theprocessor 610 can include any general purpose processor and a hardware module or software module—such asmodule 1 632,module 2 634, andmodule 3 636—stored instorage device 630, configured to control theprocessor 610, as well as a special-purpose processor where software instructions are incorporated into the actual processor design. Theprocessor 610 may essentially be a completely self-contained computing system, containing: multiple cores or processors, a bus, memory controller, cache, etc. A multi-core processor may be symmetric or asymmetric. - To enable user interaction with the
computing device 600, aninput device 645 can represent any number of input mechanisms, such as: a microphone for speech, a touch-sensitive screen for gesture or graphical input, keyboard, mouse, motion input, speech and so forth. Anoutput device 635 can also be one or more of a number of output mechanisms known to those of skill in the art. In some instances, multimodal systems can enable a user to provide multiple types of input to communicate with thecomputing device 600. Thecommunications interface 640 can generally govern and manage the user input and system output. There is no restriction on operating on any particular hardware arrangement; therefore, the basic features here may easily be substituted for improved hardware or firmware arrangements as they are developed. -
Storage device 630 is a non-volatile memory and can be a hard disk or other types of computer readable media which can store data that are accessible by a computer, such as: magnetic cassettes, flash memory cards, solid state memory devices, digital versatile disks, cartridges, random access memories (RAMs) 625, read only memory (ROM) 620, and hybrids thereof. - The
storage device 630 can includesoftware modules processor 610. Other hardware or software modules are contemplated. Thestorage device 630 can be connected to thesystem bus 605. In one aspect, a hardware module that performs a particular function can include the software component stored in a computer-readable medium in connection with the necessary hardware components, such as theprocessor 610,bus 605,display 635, and so forth, to carry out the function. -
FIG. 8B illustrates acomputer system 650 having a chipset architecture that can be used in executing the described method and generating and displaying a graphical user interface (GUI).Computer system 650 is an example of computer hardware, software, and firmware that can be used to implement the disclosed technology.System 650 can include aprocessor 655, representative of any number of physically and/or logically distinct resources capable of executing software, firmware, and hardware configured to perform identified computations.Processor 655 can communicate with achipset 660 that can control input-to and output-fromprocessor 655. In this example,chipset 660 outputs information tooutput 665, such as a display, and can read and write information tostorage device 670, which can include magnetic media, and solid state media, for example.Chipset 660 can also read data from and write data to RAM 675. Abridge 680 for interfacing with a variety ofuser interface components 685 can be provided for interfacing withchipset 660. Suchuser interface components 685 can include: a keyboard, a microphone, touch detection and processing circuitry, a pointing device, such as a mouse, and so on. In general, inputs tosystem 650 can come from any of a variety of sources, machine generated and/or human generated. -
Chipset 660 can also interface with one ormore communication interfaces 690 that can have different physical interfaces. Such communication interfaces can include interfaces for wired and wireless local area networks, for broadband wireless networks, as well as personal area networks. Some applications of the methods for generating, displaying, and using the GUI disclosed herein can include receiving ordered datasets over the physical interface or generation by the machine itself byprocessor 655 analyzing data stored instorage user interface components 685—and execute appropriate functions, such as browsing functions by interpreting theseinputs using processor 655. - It can be appreciated that
exemplary systems processor 610 or be part of a group or cluster of computing devices networked together to provide greater processing capability. - For clarity of explanation, in some instances, the present technology may be presented as including individual functional blocks including: functional blocks comprising devices, device components, steps or routines in a method embodied in software, or combinations of hardware and software.
- In some embodiments the computer-readable storage devices, mediums, and memories can include a cable or wireless signal containing a bit stream and the like. However, when mentioned, non-transitory computer-readable storage media expressly exclude media, such as: energy, carrier signals, electromagnetic waves, and signals per se.
- Methods according to the above-described examples can be implemented using computer-executable instructions that are stored or otherwise available from computer readable media. Such instructions can comprise, for example, instructions and data which cause or otherwise configure a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Portions of computer resources used can be accessible over a network. The computer-executable instructions may be, for example, binaries, intermediate format instructions, such as assembly language, firmware, or source code. Examples of computer-readable media that may be used to store instructions, information used, and/or information created during methods according to described examples include: magnetic or optical disks, flash memory, USB devices provided with non-volatile memory, networked storage devices, and so on.
- Devices implementing methods according to these disclosures can comprise hardware, firmware and/or software, and can take any of a variety of form factors. Typical examples of such form factors include: laptops, smart phones, small form factor personal computers, personal digital assistants, and so on. Functionality described herein can also be embodied in peripherals or add-in cards. Such functionality can also be implemented on a circuit board among different chips or different processes executing in a single device, by way of further example.
- The instructions, media for conveying such instructions, computing resources for executing them, and other structures for supporting such computing resources are means for providing the functions described in these disclosures.
- Although a variety of examples and other information was used to explain aspects within the scope of the appended claims, no limitation of the claims should be implied based on particular features or arrangements in such examples, as one of ordinary skill would be able to use these examples to derive a wide variety of implementations. Furthermore, although some subject matter may have been described in language specific to examples of structural features and/or method steps, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to these described features or acts. For example, such functionality can be distributed differently or performed in components other than those identified herein. Rather, the described features and steps are disclosed as examples of components of systems and methods within the scope of the appended claims.
Claims (20)
1. A computer-implemented method comprising:
providing, a device overview graphical user interface (GUI) on a computing device, the device overview GUI including a collection of icons each representing an appliance having an available appliance interface;
receiving, by the computing device, a selection input in the GUI indicating a selection of one of the collection of icons; and
providing, by the computing device, the appliance interface pertaining to the appliance represented by the selected icon.
2. The computer-implemented method of claim 1 , wherein the device overview GUI also includes notifications from the at least one of the appliances represented by the collection of icons.
3. The computer-implemented method of claim 1 , wherein the appliance interface pertaining to the appliance represented by the selected icon provides controls specific an appliance type.
4. The computer-implemented method of claim 1 , further comprising:
registering the appliance at an appliance service, wherein the collection of icons corresponds to appliances registered at the appliance service.
5. The computer-implemented method of claim 4 , further comprising:
receiving a request at the appliance service to register the appliance.
6. The computer-implemented method of claim 4 , further comprising:
detecting by the appliance service the appliance; and
transmitting a registration invitation to the appliance.
7. The computer-implemented method of claim 3 , further comprising:
receiving an input effective to operate the controls specific to the appliance type;
sending a message to the appliance using an application programming interface for the appliance.
8. The computer-implemented method of claim 4 , further comprising:
receiving from the appliance an electronic message including an application programming interface of the appliance service.
9. The computer-implemented method of claim 3 , wherein the appliance interface pertaining to the appliance includes a graphical element that represents a recipe of two or more control operations to be used together to affect a result at the appliance.
10. The computer-implemented method of claim 1 ,
wherein the receiving a selection input in the GUI indicating a selection of one of the collection of icons includes receiving a selection input in the GUI indicating a selecting of at least two of the collection of icons, and
wherein the providing the appliance interface pertaining to the appliance represented by the selected icon comprises providing a recipe of two or more control operations to be used together to control all of the appliance represented by the at least of the collection of icons.
11. A computing device for interacting with a plurality of appliances comprising:
a display a storage device storing computer-readable instructions, the computer-readable instructions;
a processor configured to interpret and perform the computer-readable instructions, the computer-readable instructions are effective to cause the display to present a device overview graphical user interface (GUI) including a collection of icons each representing an appliance having an available appliance interface; and
an input device for receiving selection inputs selecting one or more of the collection of icons and passing the selection input to the processor.
12. The computing device of claim 11 , wherein the processor is further configured to cause the display to present the appliance interface pertaining to the appliance represented by the selected icon.
13. The computing device of claim 11 , wherein the device overview GUI also includes notifications from the at least one of the appliances represented by the collection of icons.
14. The computing device of claim 11 , wherein the appliance interface pertaining to the appliance represented by the selected icon provides controls specific an appliance type.
15. The computing device of claim 14 , wherein the appliance interface pertaining to the appliance includes a graphical element that represents a recipe of two or more control operations to be used together to affect a result at the appliance.
16. The computing device of claim 11 ,
wherein the receiving a selection input in the GUI indicating a selection of one of the collection of icons includes receiving a selection input in the GUI indicating a selecting of at least two of the collection of icons, and
wherein the providing the appliance interface pertaining to the appliance represented by the selected icon comprises providing a recipe of two or more control operations to be used together to control all of the appliance represented by the at least of the collection of icons.
17. An application for interfacing with appliances comprising:
a device overview graphical user interface (GUI) including a collection of icons each representing an appliance, the device overview GUI being configured to receive a selection input in the GUI indicating a selection of one of the collection of icons; and
appliance interfaces each pertaining to the appliance represented by the selected icon.
18. The application of claim 17 , wherein the device overview GUI also includes notifications from the at least one of the appliances represented by the collection of icons.
19. The application of claim 17 , wherein the appliance interface a graphical element that represents a recipe of two or more control operations to be used together to affect a result at the appliance.
20. The application of claim 17 further configured to receive a selection input in the GUI indicating a selection at least two of the collection of icons and in response to receiving a selection of at least two of the collection of icons, provide a recipe of two or more control operations to be used together to control all of the appliances represented by the at least of the collection of icons.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/324,174 US20150128050A1 (en) | 2013-11-07 | 2014-07-05 | User interface for internet of everything environment |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361901383P | 2013-11-07 | 2013-11-07 | |
US14/324,174 US20150128050A1 (en) | 2013-11-07 | 2014-07-05 | User interface for internet of everything environment |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150128050A1 true US20150128050A1 (en) | 2015-05-07 |
Family
ID=53008011
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/316,642 Expired - Fee Related US9686581B2 (en) | 2013-11-07 | 2014-06-26 | Second-screen TV bridge |
US14/324,175 Active 2034-10-09 US9516374B2 (en) | 2013-11-07 | 2014-07-05 | Coordinated second-screen advertisement |
US14/324,174 Abandoned US20150128050A1 (en) | 2013-11-07 | 2014-07-05 | User interface for internet of everything environment |
US14/324,171 Active 2036-07-29 US10397640B2 (en) | 2013-11-07 | 2014-07-05 | Interactive contextual panels for navigating a content stream |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/316,642 Expired - Fee Related US9686581B2 (en) | 2013-11-07 | 2014-06-26 | Second-screen TV bridge |
US14/324,175 Active 2034-10-09 US9516374B2 (en) | 2013-11-07 | 2014-07-05 | Coordinated second-screen advertisement |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/324,171 Active 2036-07-29 US10397640B2 (en) | 2013-11-07 | 2014-07-05 | Interactive contextual panels for navigating a content stream |
Country Status (1)
Country | Link |
---|---|
US (4) | US9686581B2 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USD752631S1 (en) * | 2014-01-03 | 2016-03-29 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
USD763308S1 (en) * | 2014-06-18 | 2016-08-09 | Beijing Qihoo Technology Co. Ltd | Display screen with an animated graphical user interface |
US20180173178A1 (en) * | 2015-08-18 | 2018-06-21 | Yamaha Corporation | Control apparatus, control method, and control system |
US10222935B2 (en) | 2014-04-23 | 2019-03-05 | Cisco Technology Inc. | Treemap-type user interface |
US10372520B2 (en) | 2016-11-22 | 2019-08-06 | Cisco Technology, Inc. | Graphical user interface for visualizing a plurality of issues with an infrastructure |
US10397640B2 (en) | 2013-11-07 | 2019-08-27 | Cisco Technology, Inc. | Interactive contextual panels for navigating a content stream |
US10488062B2 (en) | 2016-07-22 | 2019-11-26 | Ademco Inc. | Geofence plus schedule for a building controller |
US10534331B2 (en) | 2013-12-11 | 2020-01-14 | Ademco Inc. | Building automation system with geo-fencing |
US10691397B1 (en) * | 2014-04-22 | 2020-06-23 | sigmund lindsay clements | Mobile computing device used to operate different external devices |
US10739943B2 (en) | 2016-12-13 | 2020-08-11 | Cisco Technology, Inc. | Ordered list user interface |
US10862867B2 (en) | 2018-04-01 | 2020-12-08 | Cisco Technology, Inc. | Intelligent graphical user interface |
USD932511S1 (en) * | 2016-05-25 | 2021-10-05 | Weiss Technik Gmbh | Display screen or portion thereof with animated icon providing a measurement value display |
US11546664B2 (en) * | 2015-09-18 | 2023-01-03 | Lg Electronics Inc. | Digital device transmitting menu data to an external device, and control method thereof |
Families Citing this family (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USD763916S1 (en) * | 2013-02-23 | 2016-08-16 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with icon |
ES2725461T3 (en) | 2014-02-14 | 2019-09-24 | Pluto Inc | Procedures and systems to generate and provide program and content guides |
WO2015130875A1 (en) * | 2014-02-27 | 2015-09-03 | Keyless Systems Ltd. | Improved data entry systems |
JP2015176186A (en) * | 2014-03-13 | 2015-10-05 | ソニー株式会社 | Information processing apparatus, information processing method and information processing system |
US10397634B2 (en) * | 2014-03-25 | 2019-08-27 | Synamedia Limited | System and method for synchronized presentation of video timeline metadata |
KR20150124235A (en) * | 2014-04-28 | 2015-11-05 | 삼성전자주식회사 | User terminal device, and Method for controlling for User terminal device, and multimedia system thereof |
KR20150136316A (en) * | 2014-05-27 | 2015-12-07 | 삼성전자주식회사 | Electrical apparatus, method and system for providing information |
US20160073168A1 (en) * | 2014-09-09 | 2016-03-10 | Cisco Technology, Inc. | Channel of top socially-commented audio visual content |
US11146629B2 (en) * | 2014-09-26 | 2021-10-12 | Red Hat, Inc. | Process transfer between servers |
US10524013B2 (en) * | 2014-12-12 | 2019-12-31 | Huawei Technologies Co., Ltd. | Television program switching method and apparatus |
US9826277B2 (en) * | 2015-01-23 | 2017-11-21 | TCL Research America Inc. | Method and system for collaborative and scalable information presentation |
US20160216861A1 (en) * | 2015-01-27 | 2016-07-28 | I/O Interconnect Inc. | Method for Changing Touch Control Function for Smartphone and Touchscreen Computer |
US11818203B2 (en) * | 2015-02-05 | 2023-11-14 | Comcast Cable Communications, Llc | Methods for determining second screen content based on data events at primary content output device |
JP6643776B2 (en) * | 2015-06-11 | 2020-02-12 | 株式会社バンダイナムコエンターテインメント | Terminal device and program |
KR102430271B1 (en) * | 2015-07-14 | 2022-08-08 | 삼성전자주식회사 | Method for operating electronic apparatus and electronic apparatus |
US9948980B2 (en) * | 2015-07-20 | 2018-04-17 | Google Llc | Synchronizing audio content to audio and video devices |
CN106973322A (en) * | 2015-12-09 | 2017-07-21 | 财团法人工业技术研究院 | Multi-media content cross-screen synchronization device and method, playing device and server |
US10764343B2 (en) * | 2015-12-28 | 2020-09-01 | Google Llc | Methods, systems, and media for navigating through a stream of content items |
US20170195736A1 (en) | 2015-12-31 | 2017-07-06 | Opentv, Inc. | Systems and methods for enabling transitions between items of content |
US10841557B2 (en) | 2016-05-12 | 2020-11-17 | Samsung Electronics Co., Ltd. | Content navigation |
US10299007B2 (en) | 2016-06-02 | 2019-05-21 | John Senew | Apparatus and method for displaying video |
US10327037B2 (en) | 2016-07-05 | 2019-06-18 | Pluto Inc. | Methods and systems for generating and providing program guides and content |
KR102598082B1 (en) * | 2016-10-28 | 2023-11-03 | 삼성전자주식회사 | Image display apparatus, mobile device and operating method for the same |
CN108076379B (en) * | 2016-11-10 | 2021-04-30 | 阿里巴巴集团控股有限公司 | Multi-screen interaction realization method and device |
US11132212B2 (en) * | 2017-02-07 | 2021-09-28 | Samsung Electronics Co., Ltd | Platform and interface for providing user assistance in a computing system |
US10579685B2 (en) | 2017-02-28 | 2020-03-03 | Microsoft Technology Licensing, Llc | Content event insights |
US10158914B2 (en) | 2017-03-30 | 2018-12-18 | Intel Corporation | Aggregated stress monitoring to guide user interaction |
US11509944B2 (en) * | 2017-05-18 | 2022-11-22 | Nbcuniversal Media, Llc | System and method for presenting contextual clips for distributed content |
US10356447B2 (en) | 2017-09-25 | 2019-07-16 | Pluto Inc. | Methods and systems for determining a video player playback position |
CN107872712A (en) * | 2017-12-04 | 2018-04-03 | 苏州精濑光电有限公司 | A kind of more screen interface information synchronous method and device |
US11134312B2 (en) | 2017-12-14 | 2021-09-28 | Google Llc | Methods, systems, and media for presenting contextual information in connection with media content |
US10966001B2 (en) * | 2018-04-05 | 2021-03-30 | Tvu Networks Corporation | Remote cloud-based video production system in an environment where there is network delay |
US11463747B2 (en) | 2018-04-05 | 2022-10-04 | Tvu Networks Corporation | Systems and methods for real time control of a remote video production with multiple streams |
US11212431B2 (en) | 2018-04-06 | 2021-12-28 | Tvu Networks Corporation | Methods and apparatus for remotely controlling a camera in an environment with communication latency |
US11533527B2 (en) | 2018-05-09 | 2022-12-20 | Pluto Inc. | Methods and systems for generating and providing program guides and content |
US11303965B1 (en) * | 2018-06-13 | 2022-04-12 | Amazon Technologies, Inc. | Techniques for providing interactive video |
CN110662103B (en) * | 2019-09-26 | 2021-09-24 | 北京达佳互联信息技术有限公司 | Multimedia object reconstruction method and device, electronic equipment and readable storage medium |
CN113391775A (en) * | 2020-03-13 | 2021-09-14 | 华为技术有限公司 | Man-machine interaction method and equipment |
EP4022934A1 (en) * | 2020-04-01 | 2022-07-06 | Google LLC | Enabling media features provided on a first screen device to be presented on a second screen device |
WO2022086572A1 (en) * | 2020-10-23 | 2022-04-28 | Christopher Alsante | Consumer electronic entertainment and display system |
US11960716B2 (en) * | 2021-07-22 | 2024-04-16 | Hulu, LLC | Modeless interaction model for video interface |
Citations (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010048373A1 (en) * | 2000-01-19 | 2001-12-06 | David Sandelman | Home automation identification system |
US6529218B2 (en) * | 1998-07-13 | 2003-03-04 | Matsushita Electric Industrial Co., Ltd. | Display control with movable or updatable auxiliary information |
US20040010561A1 (en) * | 2002-07-11 | 2004-01-15 | Lg Electronics Inc. | System for remotely controlling home appliances and method for operating the same |
US20100023865A1 (en) * | 2005-03-16 | 2010-01-28 | Jim Fulker | Cross-Client Sensor User Interface in an Integrated Security Network |
US7730223B1 (en) * | 2004-07-30 | 2010-06-01 | Apple Inc. | Wireless home and office appliance management and integration |
US20100280637A1 (en) * | 2009-04-30 | 2010-11-04 | Alan Wade Cohn | Hardware configurable security, monitoring and automation controller having modular communication protocol interfaces |
US20110185303A1 (en) * | 2010-01-25 | 2011-07-28 | Masanobu Katagi | Power management apparatus, and display method |
US20110208541A1 (en) * | 2010-02-19 | 2011-08-25 | Wilson Bradley T | Patient room and bed management apparatus and system |
JP2011204656A (en) * | 2010-03-26 | 2011-10-13 | Toshiba Lighting & Technology Corp | Lighting control system |
US20110264286A1 (en) * | 2010-04-27 | 2011-10-27 | Jong Soo Park | Smart control device |
US20120005609A1 (en) * | 2010-02-16 | 2012-01-05 | Hitachi, Ltd. | Management system and management system control method |
US20120154138A1 (en) * | 2010-12-17 | 2012-06-21 | Alan Wade Cohn | Method and System For Logging Security Event Data |
US20120291068A1 (en) * | 2011-05-09 | 2012-11-15 | Verizon Patent And Licensing Inc. | Home device control on television |
US20130024799A1 (en) * | 2010-12-31 | 2013-01-24 | Nest Labs, Inc. | Dynamic device-associated feedback indicative of responsible device usage |
US8380359B2 (en) * | 2008-12-10 | 2013-02-19 | Somfy Sas | Method of operating a home automation system |
US8423163B2 (en) * | 2007-08-28 | 2013-04-16 | Samsung Electronics Co., Ltd. | Mobile terminal and device control method for the same |
US8442693B2 (en) * | 2008-10-27 | 2013-05-14 | Lennox Industries, Inc. | System and method of use for a user interface dashboard of a heating, ventilation and air conditioning network |
US8443289B2 (en) * | 2007-03-13 | 2013-05-14 | Ricoh Company, Limited | Display instruction apparatus, display instruction method, and computer program product |
US20140108985A1 (en) * | 2012-10-08 | 2014-04-17 | Fisher-Rosemount Systems, Inc. | Configurable User Displays in a Process Control System |
US8738158B2 (en) * | 2010-02-24 | 2014-05-27 | Schneider Electric USA, Inc. | Apparatus and method for remote configuration of common objects across lighting controllers |
US20140337747A1 (en) * | 2013-05-10 | 2014-11-13 | Successfactors, Inc. | Adaptive Tile Framework |
US20150006296A1 (en) * | 2013-06-26 | 2015-01-01 | Qualcomm Innovation Center, Inc. | NOTIFICATION DISMISSAL IN AN INTERNET OF THINGS (IoT) ENVIRONMENT |
US8977794B2 (en) * | 2008-10-27 | 2015-03-10 | Lennox Industries, Inc. | Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning network |
US8994539B2 (en) * | 2008-10-27 | 2015-03-31 | Lennox Industries, Inc. | Alarm and diagnostics system and method for a distributed-architecture heating, ventilation and air conditioning network |
US9112719B2 (en) * | 2013-02-20 | 2015-08-18 | Panasonic Intellectual Property Corporation Of America | Control method for information apparatus and computer-readable recording medium |
US9185002B2 (en) * | 2013-03-29 | 2015-11-10 | Panasonic Intellectual Property Corporation Of America | Method for controlling information apparatus, computer-readable recording medium, and method for providing information |
US9354798B2 (en) * | 2013-02-20 | 2016-05-31 | Panasonic Intellectual Property Corporation Of America | Information apparatus having an interface for a remote control |
US9462041B1 (en) * | 2013-03-15 | 2016-10-04 | SmartThings, Inc. | Distributed control scheme for remote control and monitoring of devices through a data network |
Family Cites Families (148)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6330231B1 (en) | 1995-10-16 | 2001-12-11 | Nec Corporation | Dynamic server allocation for load balancing wireless remote interface processing |
US5870559A (en) | 1996-10-15 | 1999-02-09 | Mercury Interactive | Software system and associated methods for facilitating the analysis and management of web sites |
US6453345B2 (en) | 1996-11-06 | 2002-09-17 | Datadirect Networks, Inc. | Network security and surveillance system |
US6415164B1 (en) | 1996-12-31 | 2002-07-02 | Lucent Technologies, Inc. | Arrangement for dynamic allocation of space on a small display of a telephone terminal |
US6992687B1 (en) | 1999-12-07 | 2006-01-31 | Microsoft Corporation | Bookmarking and placemarking a displayed document in a computer system |
US7216304B1 (en) | 2000-01-05 | 2007-05-08 | Apple Inc. | Graphical user interface for computers having variable size icons |
AU2001227857A1 (en) | 2000-01-14 | 2001-07-24 | Saba Software, Inc. | Method and apparatus for a business applications management system platform |
AU2001243270A1 (en) | 2000-02-25 | 2001-09-03 | Saba Software, Inc. | Method for enterprise workforce planning |
AU2001257400A1 (en) | 2000-04-28 | 2001-11-12 | Internet Security Systems, Inc. | System and method for managing security events on a network |
JP2004508775A (en) * | 2000-09-08 | 2004-03-18 | カーゴ インコーポレイテッド | Video conversation method |
US8161081B2 (en) | 2001-03-16 | 2012-04-17 | Michael Philip Kaufman | System and method for generating automatic user interface for arbitrarily complex or large databases |
US7036087B1 (en) | 2000-11-06 | 2006-04-25 | Gary Odom | Toolbar manipulations |
US20020087976A1 (en) | 2000-12-28 | 2002-07-04 | Kaplan Marc P. | System and method for distributing video with targeted advertising using switched communication networks |
US7051029B1 (en) | 2001-01-05 | 2006-05-23 | Revenue Science, Inc. | Identifying and reporting on frequent sequences of events in usage data |
US7043702B2 (en) | 2001-03-15 | 2006-05-09 | Xerox Corporation | Method for visualizing user path through a web site and a path's associated information scent |
US7027052B1 (en) | 2001-08-13 | 2006-04-11 | The Hive Group | Treemap display with minimum cell size |
US20030035075A1 (en) * | 2001-08-20 | 2003-02-20 | Butler Michelle A. | Method and system for providing improved user input capability for interactive television |
AU2001286374A1 (en) | 2001-09-04 | 2003-03-18 | E-Cop.Net Pte Ltd | Computer security event management system |
US7047496B2 (en) | 2002-03-20 | 2006-05-16 | Tropic Networks Inc. | Method for visualization of optical network topology |
JP2003339066A (en) | 2002-05-21 | 2003-11-28 | Nec Corp | Information terminal, information providing method for information terminal, and information providing processing program |
AU2003248767C1 (en) | 2002-06-28 | 2009-01-29 | Omniture, Inc. | Capturing and presenting site visitation path data |
US20040034614A1 (en) | 2002-08-02 | 2004-02-19 | Asher Michael L. | Network incident analyzer method and apparatus |
US7254778B2 (en) | 2002-08-27 | 2007-08-07 | Sun Microsystems, Inc. | System and method browsing a network topology using a character driven interface |
US10176476B2 (en) | 2005-10-06 | 2019-01-08 | Mastercard Mobile Transactions Solutions, Inc. | Secure ecosystem infrastructure enabling multiple types of electronic wallets in an ecosystem of issuers, service providers, and acquires of instruments |
US9312953B2 (en) | 2003-03-03 | 2016-04-12 | Alexander Ivan Soto | System and method for performing in-service optical network certification |
US7603373B2 (en) | 2003-03-04 | 2009-10-13 | Omniture, Inc. | Assigning value to elements contributing to business success |
US7644365B2 (en) | 2003-09-12 | 2010-01-05 | Cisco Technology, Inc. | Method and system for displaying network security incidents |
US7421656B2 (en) | 2004-01-05 | 2008-09-02 | Microsoft Corporation | Systems and methods for interacting with a user interface of a media player |
JP4379223B2 (en) | 2004-06-18 | 2009-12-09 | 日本電気株式会社 | Behavior model creation system, behavior model creation method and behavior model creation program |
US20110030013A1 (en) | 2004-07-30 | 2011-02-03 | Diaz Perez Milton | Converting, navigating and displaying video content uploaded from the internet to a digital TV video-on-demand platform |
GB2420438A (en) | 2004-11-18 | 2006-05-24 | Zootech Ltd | Remote controller and access control to restricted audiovisual content |
WO2007019770A1 (en) | 2005-08-12 | 2007-02-22 | Huawei Technologies Co., Ltd. | A method and system for the mobile terminal to download data and to share the data among mobile terminals |
US7509374B2 (en) | 2005-09-09 | 2009-03-24 | Alchemic Solutions Group, Inc. | Systems and methods for creating customized applications |
US8037421B2 (en) | 2005-10-11 | 2011-10-11 | Research In Motion Limited | System and method for organizing application indicators on an electronic device |
US20070226325A1 (en) | 2006-03-23 | 2007-09-27 | Alcatel | Virtual private network service status management |
US20070239854A1 (en) | 2006-04-11 | 2007-10-11 | Gopalakrishnan Janakiraman | Method of migrating process domain |
JP4953683B2 (en) | 2006-04-21 | 2012-06-13 | 株式会社東芝 | Display control apparatus, image processing apparatus, and display control method |
US7945620B2 (en) | 2006-06-13 | 2011-05-17 | International Business Machines Corporation | Chat tool for concurrently chatting over more than one interrelated chat channels |
US20080126930A1 (en) | 2006-06-28 | 2008-05-29 | Research In Motion Limited | Method and apparatus for dynamically varying one or more properties of a display element in response to variation in an associated characteristic |
KR100784971B1 (en) | 2006-07-06 | 2007-12-11 | 삼성전자주식회사 | Upgrade system and method using remote control between portable terminal |
US7900188B2 (en) | 2006-09-01 | 2011-03-01 | The Mathworks, Inc. | Specifying implementations of code for code generation from a model |
US7822027B2 (en) | 2006-10-05 | 2010-10-26 | Cisco Technology, Inc. | Network routing to the socket |
US20080101381A1 (en) | 2006-10-25 | 2008-05-01 | Mediatek Inc. | Address resolution protocol (arp) cache management methods and devices |
EP1926277A1 (en) | 2006-11-24 | 2008-05-28 | Matsushita Electric Industrial Co., Ltd. | Method for mitigating denial of service attacks against a home agent |
US8381209B2 (en) | 2007-01-03 | 2013-02-19 | International Business Machines Corporation | Moveable access control list (ACL) mechanisms for hypervisors and virtual machines and virtual port firewalls |
CN101601255B (en) | 2007-01-18 | 2013-07-17 | 艾利森电话股份有限公司 | Lightweight mobility architecture |
PL2119108T3 (en) | 2007-03-05 | 2019-06-28 | Calabrio, Inc. | Monitoring quality of customer service in customer/agent calls over a voip network |
US8751572B1 (en) | 2007-06-20 | 2014-06-10 | Google Inc. | Multi-user chat search and access to chat archive |
WO2009021208A1 (en) | 2007-08-08 | 2009-02-12 | Innopath Software, Inc. | Workflow-based user interface system for mobile devices management |
US9767681B2 (en) | 2007-12-12 | 2017-09-19 | Apple Inc. | Handheld electronic devices with remote control functionality and gesture recognition |
US8762475B2 (en) | 2008-04-08 | 2014-06-24 | Microsoft Corporation | Simultaneous instant messaging in single window |
US7958189B2 (en) | 2008-06-25 | 2011-06-07 | Ebay, Inc. | Systems and methods for mapping user experiences in network navigation |
US20100031202A1 (en) | 2008-08-04 | 2010-02-04 | Microsoft Corporation | User-defined gesture set for surface computing |
US8587515B2 (en) | 2008-08-05 | 2013-11-19 | Apple Inc. | Systems and methods for processing motion sensor generated data |
US10438166B2 (en) | 2008-12-05 | 2019-10-08 | Stereologic Inc. | Systems and methods for business process modelling |
US8510333B2 (en) | 2008-12-31 | 2013-08-13 | Verizon Patent And Licensing Inc. | Methods, systems, and apparatus for developing widgets |
US8704767B2 (en) | 2009-01-29 | 2014-04-22 | Microsoft Corporation | Environmental gesture recognition |
US10410223B2 (en) | 2009-04-08 | 2019-09-10 | Transform Sr Brands Llc | Online social networking system for conducting commerce |
US8448076B2 (en) | 2009-04-27 | 2013-05-21 | Fisher-Rosemount Systems, Inc. | Configuring animations and events for operator interface displays in a process control system |
US9262063B2 (en) | 2009-09-02 | 2016-02-16 | Amazon Technologies, Inc. | Touch-screen user interface |
JP2013509803A (en) * | 2009-10-29 | 2013-03-14 | トムソン ライセンシング | Multi-screen interactive screen architecture |
US8535133B2 (en) | 2009-11-16 | 2013-09-17 | Broadcom Corporation | Video game with controller sensing player inappropriate activity |
US8705513B2 (en) | 2009-12-15 | 2014-04-22 | At&T Intellectual Property I, L.P. | Methods and apparatus to communicatively couple virtual private networks to virtual machines within distributive computing networks |
US8576857B2 (en) | 2010-01-22 | 2013-11-05 | Cisco Technology, Inc. | Automatically identifying an edge-facing router |
US20110202270A1 (en) * | 2010-02-03 | 2011-08-18 | Sharma Sridar G | Delivery of advertisments over broadcasts to receivers with upstream connection and the associated compensation models |
WO2011094855A1 (en) | 2010-02-05 | 2011-08-11 | Smart Technologies Ulc | Interactive input system displaying an e-book graphic object and method of manipulating a e-book graphic object |
US8619958B2 (en) | 2010-02-09 | 2013-12-31 | Qualcomm Incorporated | Communication ranking and organization |
US8839150B2 (en) | 2010-02-10 | 2014-09-16 | Apple Inc. | Graphical objects that respond to touch or motion input |
US8396874B2 (en) * | 2010-02-17 | 2013-03-12 | Yahoo! Inc. | System and method for using topic messages to understand media relating to an event |
US20110209089A1 (en) | 2010-02-25 | 2011-08-25 | Hinckley Kenneth P | Multi-screen object-hold and page-change gesture |
US8751970B2 (en) | 2010-02-25 | 2014-06-10 | Microsoft Corporation | Multi-screen synchronous slide gesture |
CN101813982B (en) | 2010-03-10 | 2012-05-30 | 鸿富锦精密工业(深圳)有限公司 | Electronic device with motion response function and method for excusing input operation using same |
US20110239142A1 (en) * | 2010-03-25 | 2011-09-29 | Nokia Corporation | Method and apparatus for providing content over multiple displays |
GB201011146D0 (en) * | 2010-07-02 | 2010-08-18 | Vodafone Ip Licensing Ltd | Mobile computing device |
US8473557B2 (en) | 2010-08-24 | 2013-06-25 | At&T Intellectual Property I, L.P. | Methods and apparatus to migrate virtual machines between distributive computing networks across a wide area network |
US8898798B2 (en) | 2010-09-01 | 2014-11-25 | Apixio, Inc. | Systems and methods for medical information analysis with deidentification and reidentification |
US10108731B2 (en) | 2010-09-29 | 2018-10-23 | Open Text Sa Ulc | System and method for timeline management of objects |
US20120140255A1 (en) | 2010-12-02 | 2012-06-07 | Ricoh Company, Ltd. | Application launcher apparatus |
US8982045B2 (en) | 2010-12-17 | 2015-03-17 | Microsoft Corporation | Using movement of a computing device to enhance interpretation of input events produced when interacting with the computing device |
US20120185791A1 (en) | 2011-01-13 | 2012-07-19 | International Business Machines Corporation | Generation of user interfaces in the management of processes with associated data objects |
TW201232379A (en) | 2011-01-20 | 2012-08-01 | Chi Mei Comm Systems Inc | Menu icon adjustment system and method |
EP2686755B1 (en) | 2011-03-17 | 2020-10-14 | Laubach, Kevin | Input device enhanced interface |
US8806348B2 (en) | 2011-05-12 | 2014-08-12 | Google Inc. | Data model generation based on user interface specification |
US8839404B2 (en) | 2011-05-26 | 2014-09-16 | Blue Coat Systems, Inc. | System and method for building intelligent and distributed L2-L7 unified threat management infrastructure for IPv4 and IPv6 environments |
US9229867B2 (en) | 2011-06-16 | 2016-01-05 | International Business Machines Corporation | Shared network response cache |
EP2740242B8 (en) | 2011-08-04 | 2019-01-23 | Mido Holdings Ltd. | System and method for implementing and managing virtual networks |
BR112014002039B1 (en) * | 2011-08-05 | 2022-02-01 | Interdigital Ce Patent Holdings | User interface for a video player, and method for controlling a video player that has a touch-activated screen |
US8650509B2 (en) | 2011-08-19 | 2014-02-11 | International Business Machines Corporation | Touchscreen gestures for virtual bookmarking of pages |
KR101850821B1 (en) | 2011-09-15 | 2018-04-20 | 엘지전자 주식회사 | Mobile terminal and message display method for mobile terminal |
US8958318B1 (en) | 2011-09-21 | 2015-02-17 | Cisco Technology, Inc. | Event-based capture of packets from a network flow |
US8914502B2 (en) | 2011-09-27 | 2014-12-16 | Oracle International Corporation | System and method for dynamic discovery of origin servers in a traffic director environment |
CN102291320B (en) | 2011-09-29 | 2015-03-18 | 杭州华三通信技术有限公司 | MAC (media access control) address learning method and edge device |
US8650492B1 (en) | 2011-10-11 | 2014-02-11 | Google Inc. | System and method for page navigation visualization and analysis |
US8738756B2 (en) | 2011-12-01 | 2014-05-27 | International Business Machines Corporation | Enabling co-existence of hosts or virtual machines with identical addresses |
JP5984366B2 (en) | 2011-12-01 | 2016-09-06 | キヤノン株式会社 | Display device, control method therefor, and program |
FR2983600B1 (en) | 2011-12-01 | 2014-02-07 | Airbus Operations Sas | METHOD AND SYSTEM FOR MONITORING A GRAPHIC INTERFACE IN AN AIRCRAFT COCKPIT |
KR101408168B1 (en) | 2011-12-09 | 2014-06-17 | 도시바삼성스토리지테크놀러지코리아 주식회사 | Apparatus and method for providing graphic user interface |
US9355375B2 (en) | 2011-12-14 | 2016-05-31 | Holger Knospe | Launch of target user interface features based on specific business process instances |
WO2013088251A1 (en) | 2011-12-16 | 2013-06-20 | Marvell Israel (M.I.S.L) Ltd. | Scaling address resolution for massive data centers |
US20130174191A1 (en) * | 2011-12-29 | 2013-07-04 | United Video Properties, Inc. | Systems and methods for incentivizing user interaction with promotional content on a secondary device |
US20130201215A1 (en) * | 2012-02-03 | 2013-08-08 | John A. MARTELLARO | Accessing applications in a mobile augmented reality environment |
US9489657B2 (en) | 2012-02-21 | 2016-11-08 | Microsoft Technology Licensing, Llc | Aggregation and visualization of multiple chat room information |
US9106510B2 (en) | 2012-04-09 | 2015-08-11 | Cisco Technology, Inc. | Distributed demand matrix computations |
US8868736B2 (en) | 2012-04-27 | 2014-10-21 | Motorola Mobility Llc | Estimating a severity level of a network fault |
US8737821B2 (en) | 2012-05-31 | 2014-05-27 | Eric Qing Li | Automatic triggering of a zoomed-in scroll bar for a media program based on user input |
US9712559B2 (en) | 2012-05-31 | 2017-07-18 | Red Hat, Inc. | Identifying frames |
US20130347018A1 (en) * | 2012-06-21 | 2013-12-26 | Amazon Technologies, Inc. | Providing supplemental content with active media |
US20140002581A1 (en) | 2012-06-29 | 2014-01-02 | Monkeymedia, Inc. | Portable proprioceptive peripatetic polylinear video player |
US8997094B2 (en) | 2012-06-29 | 2015-03-31 | Pulse Secure, Llc | Migrating virtual machines between computing devices |
US20140013271A1 (en) | 2012-07-05 | 2014-01-09 | Research In Motion Limited | Prioritization of multitasking applications in a mobile device interface |
US8995823B2 (en) * | 2012-07-17 | 2015-03-31 | HighlightCam, Inc. | Method and system for content relevance score determination |
US9390055B2 (en) | 2012-07-17 | 2016-07-12 | Coho Data, Inc. | Systems, methods and devices for integrating end-host and network resources in distributed memory |
US20140033040A1 (en) * | 2012-07-24 | 2014-01-30 | Apple Inc. | Portable device with capability for note taking while outputting content |
US8918822B2 (en) * | 2012-09-26 | 2014-12-23 | Apple Inc. | Displaying a synchronized instance of content on a portable electronic device |
US9565475B2 (en) | 2012-10-11 | 2017-02-07 | Netflix, Inc. | System and method for managing playback of streaming digital content |
CN103491010B (en) | 2012-10-17 | 2016-12-07 | 华为技术有限公司 | The methods, devices and systems of message are sent in virtual network |
US9189884B2 (en) * | 2012-11-13 | 2015-11-17 | Google Inc. | Using video to encode assets for swivel/360-degree spinners |
US20140201681A1 (en) | 2013-01-16 | 2014-07-17 | Lookout, Inc. | Method and system for managing and displaying activity icons on a mobile device |
US10761673B2 (en) | 2013-03-12 | 2020-09-01 | Oracle International Corporation | Managing display of detachable windows in a GUI computing environment |
US20140280133A1 (en) | 2013-03-13 | 2014-09-18 | Google Inc. | Structured Data to Aggregate Analytics |
US9898537B2 (en) | 2013-03-14 | 2018-02-20 | Open Text Sa Ulc | Systems, methods and computer program products for information management across disparate information systems |
US9112801B2 (en) | 2013-03-15 | 2015-08-18 | International Business Machines Corporation | Quantized congestion notification in a virtual networking system |
GB2526495B (en) * | 2013-03-15 | 2021-12-01 | Ernest Troxler Robert | Systems and methods for identifying and separately presenting different portions of multimedia content |
KR102050814B1 (en) | 2013-04-02 | 2019-12-02 | 삼성전자주식회사 | Apparatus and method for private chatting in group chats |
US20140320387A1 (en) | 2013-04-24 | 2014-10-30 | Research In Motion Limited | Device, System and Method for Generating Display Data |
US9009693B2 (en) | 2013-05-08 | 2015-04-14 | Microsoft Corporation | Out-of-band framework libraries within applications |
US20140373064A1 (en) | 2013-06-14 | 2014-12-18 | Concurrent Computers Corporation | Method and Systems for Tiered Navigational Guide Creation |
KR20150006180A (en) | 2013-07-08 | 2015-01-16 | 삼성전자주식회사 | Method for controlling chatting window and electronic device implementing the same |
US10084650B2 (en) | 2013-07-09 | 2018-09-25 | Tail-f Systems AB | Graphical user interface for customizing graphical representations based on registry data |
US9231863B2 (en) | 2013-07-23 | 2016-01-05 | Dell Products L.P. | Systems and methods for a data center architecture facilitating layer 2 over layer 3 communication |
US9282033B2 (en) | 2013-08-06 | 2016-03-08 | Cisco Technology, Inc. | Intelligent handling of virtual machine mobility in large data center environments |
US20150074735A1 (en) * | 2013-09-06 | 2015-03-12 | Seespace Ltd. | Method and Apparatus for Rendering Video Content Including Secondary Digital Content |
WO2015039046A1 (en) | 2013-09-16 | 2015-03-19 | Metanautix, Inc. | Data flow exploration |
US9609373B2 (en) * | 2013-10-25 | 2017-03-28 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Presentation timeline synchronization across audio-video (AV) streams |
US9686581B2 (en) | 2013-11-07 | 2017-06-20 | Cisco Technology, Inc. | Second-screen TV bridge |
US9413713B2 (en) | 2013-12-05 | 2016-08-09 | Cisco Technology, Inc. | Detection of a misconfigured duplicate IP address in a distributed data center network fabric |
KR102208362B1 (en) | 2013-12-16 | 2021-01-28 | 삼성전자 주식회사 | Method and apparatus for managing message of electronic device |
US20150193549A1 (en) | 2014-01-08 | 2015-07-09 | Microsoft Corporation | History as a branching visualization |
US9177225B1 (en) * | 2014-07-03 | 2015-11-03 | Oim Squared Inc. | Interactive content generation |
US20160034051A1 (en) | 2014-07-31 | 2016-02-04 | Cisco Technology, Inc. | Audio-visual content navigation with movement of computing device |
US9613591B2 (en) * | 2014-08-29 | 2017-04-04 | Lg Electronics Inc. | Method for removing image sticking in display device |
US9904456B2 (en) | 2014-12-02 | 2018-02-27 | Business Objects Software Ltd. | Gesture-based visualization of data grid on mobile device |
US10528207B2 (en) * | 2015-01-12 | 2020-01-07 | Facebook, Inc. | Content-based interactive elements on online social networks |
US20160253046A1 (en) | 2015-02-27 | 2016-09-01 | Cisco Technology, Inc. | Recording system state data and presenting a navigable graphical user interface |
US20160364085A1 (en) | 2015-06-15 | 2016-12-15 | Cisco Technology, Inc. | Instant messaging user interface |
US9584853B2 (en) | 2015-06-16 | 2017-02-28 | Cisco Technology, Inc. | Visual representation of navigation flows within a user interface |
US9985837B2 (en) | 2015-07-23 | 2018-05-29 | Cisco Technology, Inc. | Refresh of the binding tables between data-link-layer and network-layer addresses on mobility in a data center environment |
US10372520B2 (en) | 2016-11-22 | 2019-08-06 | Cisco Technology, Inc. | Graphical user interface for visualizing a plurality of issues with an infrastructure |
-
2014
- 2014-06-26 US US14/316,642 patent/US9686581B2/en not_active Expired - Fee Related
- 2014-07-05 US US14/324,175 patent/US9516374B2/en active Active
- 2014-07-05 US US14/324,174 patent/US20150128050A1/en not_active Abandoned
- 2014-07-05 US US14/324,171 patent/US10397640B2/en active Active
Patent Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6529218B2 (en) * | 1998-07-13 | 2003-03-04 | Matsushita Electric Industrial Co., Ltd. | Display control with movable or updatable auxiliary information |
US20010048373A1 (en) * | 2000-01-19 | 2001-12-06 | David Sandelman | Home automation identification system |
US20040010561A1 (en) * | 2002-07-11 | 2004-01-15 | Lg Electronics Inc. | System for remotely controlling home appliances and method for operating the same |
US7730223B1 (en) * | 2004-07-30 | 2010-06-01 | Apple Inc. | Wireless home and office appliance management and integration |
US20100023865A1 (en) * | 2005-03-16 | 2010-01-28 | Jim Fulker | Cross-Client Sensor User Interface in an Integrated Security Network |
US8443289B2 (en) * | 2007-03-13 | 2013-05-14 | Ricoh Company, Limited | Display instruction apparatus, display instruction method, and computer program product |
US9318016B2 (en) * | 2007-08-28 | 2016-04-19 | Samsung Electronics Co., Ltd. | Mobile terminal and device control method for the same |
US8423163B2 (en) * | 2007-08-28 | 2013-04-16 | Samsung Electronics Co., Ltd. | Mobile terminal and device control method for the same |
US8994539B2 (en) * | 2008-10-27 | 2015-03-31 | Lennox Industries, Inc. | Alarm and diagnostics system and method for a distributed-architecture heating, ventilation and air conditioning network |
US8977794B2 (en) * | 2008-10-27 | 2015-03-10 | Lennox Industries, Inc. | Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning network |
US8442693B2 (en) * | 2008-10-27 | 2013-05-14 | Lennox Industries, Inc. | System and method of use for a user interface dashboard of a heating, ventilation and air conditioning network |
US8380359B2 (en) * | 2008-12-10 | 2013-02-19 | Somfy Sas | Method of operating a home automation system |
US20100280637A1 (en) * | 2009-04-30 | 2010-11-04 | Alan Wade Cohn | Hardware configurable security, monitoring and automation controller having modular communication protocol interfaces |
US20110185303A1 (en) * | 2010-01-25 | 2011-07-28 | Masanobu Katagi | Power management apparatus, and display method |
US20120005609A1 (en) * | 2010-02-16 | 2012-01-05 | Hitachi, Ltd. | Management system and management system control method |
US20110208541A1 (en) * | 2010-02-19 | 2011-08-25 | Wilson Bradley T | Patient room and bed management apparatus and system |
US8738158B2 (en) * | 2010-02-24 | 2014-05-27 | Schneider Electric USA, Inc. | Apparatus and method for remote configuration of common objects across lighting controllers |
JP2011204656A (en) * | 2010-03-26 | 2011-10-13 | Toshiba Lighting & Technology Corp | Lighting control system |
US20110264286A1 (en) * | 2010-04-27 | 2011-10-27 | Jong Soo Park | Smart control device |
US20120154138A1 (en) * | 2010-12-17 | 2012-06-21 | Alan Wade Cohn | Method and System For Logging Security Event Data |
US20130024799A1 (en) * | 2010-12-31 | 2013-01-24 | Nest Labs, Inc. | Dynamic device-associated feedback indicative of responsible device usage |
US20120291068A1 (en) * | 2011-05-09 | 2012-11-15 | Verizon Patent And Licensing Inc. | Home device control on television |
US20140108985A1 (en) * | 2012-10-08 | 2014-04-17 | Fisher-Rosemount Systems, Inc. | Configurable User Displays in a Process Control System |
US9112719B2 (en) * | 2013-02-20 | 2015-08-18 | Panasonic Intellectual Property Corporation Of America | Control method for information apparatus and computer-readable recording medium |
US9354798B2 (en) * | 2013-02-20 | 2016-05-31 | Panasonic Intellectual Property Corporation Of America | Information apparatus having an interface for a remote control |
US9462041B1 (en) * | 2013-03-15 | 2016-10-04 | SmartThings, Inc. | Distributed control scheme for remote control and monitoring of devices through a data network |
US9185002B2 (en) * | 2013-03-29 | 2015-11-10 | Panasonic Intellectual Property Corporation Of America | Method for controlling information apparatus, computer-readable recording medium, and method for providing information |
US20140337747A1 (en) * | 2013-05-10 | 2014-11-13 | Successfactors, Inc. | Adaptive Tile Framework |
US20150006296A1 (en) * | 2013-06-26 | 2015-01-01 | Qualcomm Innovation Center, Inc. | NOTIFICATION DISMISSAL IN AN INTERNET OF THINGS (IoT) ENVIRONMENT |
Non-Patent Citations (1)
Title |
---|
Galitz, "The Essential Guide to User Interface Design, second edition", published by Wiley on 2002, p. 477-478, ISBN: 0-471-084646. (Year: 2002) * |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10397640B2 (en) | 2013-11-07 | 2019-08-27 | Cisco Technology, Inc. | Interactive contextual panels for navigating a content stream |
US10649418B2 (en) | 2013-12-11 | 2020-05-12 | Ademco Inc. | Building automation controller with configurable audio/visual cues |
US10768589B2 (en) | 2013-12-11 | 2020-09-08 | Ademco Inc. | Building automation system with geo-fencing |
US10534331B2 (en) | 2013-12-11 | 2020-01-14 | Ademco Inc. | Building automation system with geo-fencing |
US10591877B2 (en) | 2013-12-11 | 2020-03-17 | Ademco Inc. | Building automation remote control device with an in-application tour |
US10712718B2 (en) | 2013-12-11 | 2020-07-14 | Ademco Inc. | Building automation remote control device with in-application messaging |
USD752631S1 (en) * | 2014-01-03 | 2016-03-29 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
US10691397B1 (en) * | 2014-04-22 | 2020-06-23 | sigmund lindsay clements | Mobile computing device used to operate different external devices |
US10222935B2 (en) | 2014-04-23 | 2019-03-05 | Cisco Technology Inc. | Treemap-type user interface |
USD763308S1 (en) * | 2014-06-18 | 2016-08-09 | Beijing Qihoo Technology Co. Ltd | Display screen with an animated graphical user interface |
US10642235B2 (en) * | 2015-08-18 | 2020-05-05 | Yamaha Corporation | Control apparatus, control method, and control system that provide display control to display images associated with master and slave devices |
US20180173178A1 (en) * | 2015-08-18 | 2018-06-21 | Yamaha Corporation | Control apparatus, control method, and control system |
US11949955B2 (en) | 2015-09-18 | 2024-04-02 | Lg Electronics Inc. | Digital device and method of processing data in said digital device |
US11546664B2 (en) * | 2015-09-18 | 2023-01-03 | Lg Electronics Inc. | Digital device transmitting menu data to an external device, and control method thereof |
USD932511S1 (en) * | 2016-05-25 | 2021-10-05 | Weiss Technik Gmbh | Display screen or portion thereof with animated icon providing a measurement value display |
US10488062B2 (en) | 2016-07-22 | 2019-11-26 | Ademco Inc. | Geofence plus schedule for a building controller |
US11016836B2 (en) | 2016-11-22 | 2021-05-25 | Cisco Technology, Inc. | Graphical user interface for visualizing a plurality of issues with an infrastructure |
US10372520B2 (en) | 2016-11-22 | 2019-08-06 | Cisco Technology, Inc. | Graphical user interface for visualizing a plurality of issues with an infrastructure |
US10739943B2 (en) | 2016-12-13 | 2020-08-11 | Cisco Technology, Inc. | Ordered list user interface |
US10862867B2 (en) | 2018-04-01 | 2020-12-08 | Cisco Technology, Inc. | Intelligent graphical user interface |
Also Published As
Publication number | Publication date |
---|---|
US9686581B2 (en) | 2017-06-20 |
US10397640B2 (en) | 2019-08-27 |
US20150128163A1 (en) | 2015-05-07 |
US20150128046A1 (en) | 2015-05-07 |
US9516374B2 (en) | 2016-12-06 |
US20150128179A1 (en) | 2015-05-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20150128050A1 (en) | User interface for internet of everything environment | |
US11487417B2 (en) | User terminal apparatus and control method for controlling internet of things devices | |
US10853979B2 (en) | Electronic device and method for displaying screen thereof | |
AU2014201856B2 (en) | APP operating method and device and app output device supporting the same | |
CN105589732B (en) | Apparatus and method for sharing information through virtual environment | |
CN105634881B (en) | Application scene recommendation method and device | |
JP6302599B2 (en) | Grouping method, grouping device, program, and recording medium for smart devices in smart home system | |
KR102311221B1 (en) | operating method and electronic device for object | |
KR101276846B1 (en) | Method and apparatus for streaming control of media data | |
JP6228676B2 (en) | Connection state prompting method and apparatus | |
US20140172123A1 (en) | User terminal apparatus, network apparatus, and control method thereof | |
KR102504201B1 (en) | Electronic device and method for controlling output of notification thereof | |
EP3358850B1 (en) | Content playing apparatus, method for providing ui of content playing apparatus, network server, and method for controlling by network server | |
EP2862362B1 (en) | Stream-based media management | |
US11609541B2 (en) | System and method of IOT device control using augmented reality | |
CN104508699B (en) | Content transmission method, and system, apparatus and computer-readable recording medium using the same | |
US9871710B2 (en) | Electronic device for operating application | |
US20150188776A1 (en) | Synchronizing user interface across multiple devices | |
US9690877B1 (en) | Systems and methods for electronic communications | |
CN107077778B (en) | Method and device for remote control | |
US20180331846A1 (en) | Activity based automation | |
KR20140009851A (en) | Electonic device and method for controlling of the same | |
TW201814515A (en) | Systems, methods, and devices for context-aware applications | |
US9734253B2 (en) | Method of providing a webpage using home device web browser and home device therefor | |
CN111279342A (en) | Electronic device and control method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CISCO TECHNOLOGY, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CORMICAN, NEIL;DAN, RONNIE;WALKER, JAMES;SIGNING DATES FROM 20140708 TO 20140813;REEL/FRAME:033557/0564 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |