CN105659179A - Devices and methods for interacting with an HVAC controller - Google Patents

Abstract

An HVAC controller may be controlled in response to a natural language audio message that is not recognizable by the HVAC controller as a command, where the natural language audio message is translated into a command recognizable by the HVAC controller. Voice recognition software identifies a trigger phrase included in the natural language audio message and in response the HVAC controller may perform an action. The voice recognition software may be used to create a natural language text based message from a recorded voice message or streamed voice message, where the natural language text based message is translated into the command recognizable by the HVAC controller. In response to the command, the HVAC controller may perform an action and/or respond with a natural language text based, audio, or video message. A user may communicate with the thermostat via the thermostat and/or a remote device.

Description

For the equipment that interacts with HVAC controller and method

Technical field

Disclosure relate generally to HVAC system or building automation system, and relate more particularly to regulate and/or be convenient to the HVAC controller of the control of HVAC system.

Background technology

Heating, ventilation and/or air-conditioning (HVAC) system are usually used to the comfort level level controlled in buildings or other structure. This type of HVAC system generally includes HVAC controller, its control HVAC system various HVAC portion part so as impact and/or control buildings in one or more envrionment conditionss. This type of HVAC controller has the user interface for allowing user and HVAC controller to interact usually. User interface usually becomes an entirety with HVAC controller shell, but in some cases can away from HVAC controller but directly or indirectly communicate with it, such as when using the user interface of smart phone, tablet PC, Personal Computer, laptop computer etc.

Summary of the invention

Disclosure relate generally to HVAC system or building automation system, and relate more particularly to controller, such as regulate and/or be convenient to the thermostatted of the control of HVAC system via Voice command. In an illustrative embodiment, it is possible to control thermostatted according to speech control system. Thermostatted can comprise the shell being configured to also hold temperature sensor, speaker and controller except other parts at least in part. The controller of thermostatted can be configured to the triggering phrase identified in the speech message being included in and receiving by the speaker of thermostatted. In response to recognizing this triggering phrase, controller can perform an action.

Operating via Voice command pattern and/or controlling in the illustrative method of thermostatted, thermostatted can receive speech message from user and is identified as by this speech message and comprise triggering phrase. Comprising triggering phrase in response to being identified as by speech message, thermostatted can be initiated Voice command pattern and be provided Voice command listened to the instruction that pattern has been initiated.

In some cases, operate via speech control system and/or the method that controls thermostatted can be included in thermostatted place and receives voice stream from user and identify the voice command this voice stream. In illustrative case, voice command can when there is no unit designated parameter value. The method also can comprise the thermostatted order being converted to by the voice command identified and comprising parameter value and unit, and wherein, the form that thermostatted can understand is taked in thermostatted order. Then the thermostatted order being associated with institute voice command recognition can be performed.

In some illustrative case, thermostatted can be controlled according to speech control system. Thermostatted can comprise the shell being configured to hold temperature sensor, speaker and controller at least in part. Illustratively, controller can be configured to the triggering phrase that identifies in the voice stream being included in and providing by the speaker of thermostatted. In response to recognizing triggering phrase, the process that controller can be configured to initiate audio frequency stream with triggering one identified after phrase in multiple difference order and generate thermostatted order, its can by controller it will be appreciated that and can order controller perform in audio frequency stream identify specific order. Controller can perform the thermostatted order generated.

In the illustrative method controlling HVAC system with thermostatted, thermostatted can receive audio frequency stream, and can identify the triggering phrase in audio frequency stream. The method can be included in the multiple difference orders being identified and triggering and identify after phrase in audio frequency stream one, and generate thermostatted order, it can be understood by thermostatted and order thermostatted performs the specific order that identifies in audio frequency stream. The thermostatted order generated can be performed by thermostatted.

Under some illustrative case, thermostat system can comprise the treater of storer and memory communication, speaker, loud speaker, speech recognition engine and transform engine. Such as, speaker can be used to record can listen stream, and wherein, this can listen stream to store in memory at least temporarily, and is the triggering phrase of voice command (order of the thermostatted order that can not performed by thermostatted) after can comprising. In some cases, speech recognition engine can be configured to processing audio stream at least partially to trigger phrase and voice command triggering detection after phrase, and provide the message based on text of the voice command detected. Transform engine can be configured to the message conversion based on text by speech recognition engine provides and become the thermostatted order that can be performed by thermostatted. Any appropriate format that useful thermostatted can be understood, to express this thermostatted order, comprises text form, scale-of-two form or other form.

In some illustrative case, thermostatted can be controlled according to speech control system. Thermostatted can comprise the shell being configured to hold control module, speaker, loud speaker, indicating meter and speech recognition module at least in part. The control module of thermostatted can be configured to provide one or more control signal to control, according to thermostatted, one or more HVAC portion parts that algorithm controls HVAC system. Speech recognition module can be configured to identify via speaker predetermined can listen triggering device, and responsively, provide one or more audio clips via loud speaker and/or via indicating meter to provide video clipping for the thermostatted that assists user in operation.

Under some illustrative case, it is configured to one or more HVAC portion part communication and the thermostatted that controls one or more HVAC portion part can comprise the shell being configured to hold control module, indicating meter at least in part and help module.Illustratively, control module can be configured to provide one or more control signal to control, according to thermostatted, one or more parts that algorithm controls HVAC system, and helps module can be configured to play one or more pre-recorded video clipping over the display with the thermostatted that assists user in operation.

Under some illustrative case, the thermostatted being configured to the one or more HVAC portion part communication with HVAC system and controlling this one or more HVAC portion part can comprise control module, temperature sensor and speech recognition module. Illustratively, control module can be configured to provide one or more control signal to control, according to thermostatted, one or more HVAC portion parts that algorithm controls HVAC system, and speech recognition module can be configured in response to detecting that user needs to play one or more pre-recorded editing about the help of operated thermostat.

There is provided aforementioned summary to be for the ease of the understanding of some in the character of innovation that the disclosure is exclusive and it is not intended to be describe completely. Can obtain of the present disclosure recognize completely by generally understanding whole specification sheets, claim, accompanying drawing and summary.

Accompanying drawing explanation

Consider that the following description of various illustrative embodiment can understand the disclosure more completely by reference to the accompanying drawings, in the drawing:

Fig. 1 is the schematic diagram of the explanation HVAC system serving buildings or structure;

Fig. 2 is the schematic block diagram of explanation property HVAC controller;

Fig. 3 is the schematic diagram of explanation property thermostatted interface network structure;

Fig. 4 shows the mutual interaction figure of the explanation sexual intercourse between user, thermostatted and cloud;

Fig. 5 is the indicative flowchart of the illustrative process using speech control system;

Fig. 6 is the illustrative screen view of the illustrative screen of thermostatted;

Fig. 7 is the illustrative screen view of the illustrative screen of thermostatted;

Fig. 8 is the illustrative screen view of the illustrative screen of thermostatted;

Fig. 9 shows the indicative flowchart improving and helping feature;

The interaction figure that explanation sexual intercourse between user between the first trial period that Figure 10 shows Fig. 9, thermostatted and cloud is mutual;

The interaction figure that explanation sexual intercourse between user between the 2nd trial period that Figure 11 shows Fig. 9, thermostatted and cloud is mutual;

The interaction figure that explanation sexual intercourse between user between the 3rd trial period that Figure 12 shows Fig. 9, thermostatted and cloud is mutual;

Figure 13 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 14 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 15 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 16 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 17 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 18 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 19 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 20 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 21 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 22 is the illustrative screen view of the illustrative screen of thermostatted;

Figure 23 is the exploded perspective figure of the explanation thermostatted comprising one or more speaker and one or more loud speaker;

Figure 24 a is the decomposition front perspective figure of the explanation thermostatted comprising one or more speaker and one or more loud speaker; And

Figure 24 b is the decomposition back side skeleton view of the explanation thermostatted comprising one or more speaker and one or more loud speaker.

Although the disclosure can be modified as various amendment and alternative form, but its specific detail is shown in the accompanying drawings in an illustrative manner, and will be described in detail.However, it is understood that be not intended to make each side of the present disclosure be confined to described certain illustrative embodiment. On the contrary, it is intended to contain all modifications, Equivalent and the replacement that drop in spirit and scope of the present disclosure.

Embodiment

Should reading following description with reference to accompanying drawing, wherein similar reference number indicates similar element throughout multiple figure. This description and accompanying drawing show multiple embodiments that intention is essentially explanation property.

Fig. 1 is the schematic diagram of the buildings 2 with explanation property building automation system 4. although the explanation building automation subsystem 12 that Fig. 1 will typically force air type HVAC system illustrated as building automation system 4, but imagine other building automation subsystem 12 of building automation system 4, according to expectation, include but not limited to security system, Lighting Control Assembly, water heater system is (such as, boiler systems), refrigerator chamber, washing machine, clothes-drying machine, baking oven, garage door, radiation heating system, electric heating system, cooling system, heat pump, any other suitable subsystem 12 and/or its each several part of building automation system 4. in some cases, building automation system 4 can comprise Internet gateway 20(such as, is convenient to the communicate modulator-demodulator unit of link or other equipment) or other equipment that the one or more Wide area networks (WAN) by such as such as Internet and so in HVAC portion part 6 as described herein can be allowed to carry out communicating and/or one or more HVAC portion part 6 can be allowed by other network any to be carried out the equipment 20 communicated.

The explanation HVAC system of Fig. 1 comprises one or more HVAC portion part 6, comprise the tubing system of air supply duct 10 and return air duct 14 and the system of ventilation opening and one or more building automation controller 18(such as, HVAC controller). One or more HVAC portion part 6 can include but not limited to stove, heat pump, electric heating pump, terrestrial heat pump, electricity heating unit, air-conditioning unit, humidifier, dehumidifier, air interchanger, air purifier, deoscillator, valve etc.

(multiple) building automation controller 18 can be imagined can be configured in a controlled manner to its (multiple) building automation subsystem 12(such as, HVAC portion part 6) such as, carry out activating, separating and activate and/or regulate in addition (with the comfort level level in control texture or buildings 2 and/or the electronic characteristic operating buildings 2 in addition). (multiple) building automation controller 18 can be configured to via wired and/or wireless communication link 20 to control building automation controller equiment or building automation subsystem 12.

In some cases, (multiple) building automation controller 18 can be thermostatted, such as such as can fill thermostatted or intelligent power switch (such as, for controlling to be unkitted the power switch of utensil and other utensil being furnished with communication capacity) by wall, but this is not all requirements in all cases. Exemplary thermostatted can comprise (such as in thermostatted shell) or may have access to for feel survey thermostatted place or near the temperature sensor of envrionment temperature. In some cases, (multiple) building automation controller 18 can be area controller (such as, it can embody in thermostatted or can not like this), or can be comprised each monitor and/or multiple area controllers of comfort level level in given zone in control buildings or other structure.

In explanation building automation system 4 shown in FIG, (multiple) HVAC portion part 6 can provide hot blast and/or cold wind via the tubing system 10,14 throughout whole buildings 2.As shown, (multiple) HVAC portion part 6 can via each room in tubing system 10 and 14 and buildings 2 and/or district's fluid communication, but this is not requirement. In operation, when providing heating calling or command signal by (multiple) building automation controller 18, HVAC portion part 6(such as, forces warm braw stove) can be activated to supply hot blast via air supply duct 10 to the one or more room in buildings 2 and/or district. Available gas blower or fan 21 force hot blast by air supply duct 10. In this example, the cold wind from each district can be made to return HVAC portion part 6 for heating via return air duct 14. Similarly, when providing refrigeration calling or command signal by (multiple) building automation controller 18, HVAC portion part 6(such as, air-conditioning unit) can be activated with via air supply duct 10 to the one or more room in buildings or other structure and/or district supply cold wind. Available gas blower or fan 21 force cold wind by air supply duct 10. In this example, the warmer wind from each district can be made to return HVAC system 6(such as air-conditioning unit via return air duct 14) for refrigeration.

In some cases, ventilation hole system or tubing system 10 and/or 14 can comprise one or more deoscillator 24 to regulate the flowing of air, but this is not requirement. Such as, one or more deoscillator 24 can be coupled to one or more HVAC controller 18, and can coordinate mutually with the operation of one or more HVAC portion part 6. Deoscillator 24 can be actuated to open position, make-position and/or partially open position to regulate from one or more HVAC portion part 6 to the air flow in the suitable room buildings or other structure and/or district by one or more HVAC controller 18. Deoscillator 24 can be particularly useful in subregion HVAC system, and can be used to control which (a bit) district and receive adjustment air from (multiple) HVAC portion part 6.

In many cases, one or more air filter 30 can be used from the air of buildings 2 inside to remove dust and/or other pollutent. In illustrated examples shown in FIG, (multiple) air filter 30 is installed in return air duct 14, and before air enters HVAC portion part 6, air can be filtered, but to be imagined and can use other the suitable position any for (multiple) air filter 30. The existence of (multiple) air filter 30 not only can improve IAQ (indoor air quality), but also HVAC portion part 6 can be protected to avoid otherwise will be allowed to enter dust and other particulate matter of HVAC portion part 6.

Depend on where application and/or building automation system user are positioned at, the first network (such as local WiFi network) can be passed through at least in part and/or the 2nd network is (such as, the Wide area network of such as Internet and so on) long-range access and/or the control of building automation controller 18 are provided, as shown in Figure 3. In some cases, the first network and/or the 2nd network can be considered as network jointly. On July 26th, 2012 submit to and by overall the incorporated herein by reference u.s. patent application serial number 13/559,470 being entitled as METHODOFASSOCIATINGANHVACCONTROLLERWITHANEXTERNALWEBSERV ICE in describe the non-limiting example of network connecting building thing automation system. On May 1st, 2013 submit to and by overall the incorporated herein by reference u.s. patent application serial number 13/875,213 being entitled as DEVICESANDMETHODSFORINTERFACINGWITHANHVACCONTROLLER in describe another non-limiting example of network connecting building thing automation system.In the US application serial No. 13/911 being entitled as INTERACTINGWITHACONTROLSYSTEMTHATISCONNECTEDTOANETWORK that on June 6th, 2013 submits to, describing a non-limiting example again of network connecting building thing automation system in 638, this application is by overall incorporated herein by reference.

In some cases, user can use building automation controller 18(such as, thermostatted 22) adjust building automation system 4 parameter or with without hand and/or need not eye mode to initiate the action of building automation system 4. User can not or may not may wish to interact with thermostatted 22 or the typical touch user interface of equipment (such as smart phone) that communicates with thermostatted 22 due to one or more reason. Such as, in some cases, user may due to its thing done (such as, be full of project in hand when it leaves), such as, the place (it is being arranged in different room, room wherein from thermostatted 22) at its place, inconvenience, incompetence and/or due to other reason any not physically user interface with thermostatted 22 interact.

In some cases, thermostatted 22 or other building automation controller 18 can comprise without hand and/or need not the user interface 26 of eye, such as, it utilizes Voice command, sometimes has and can listen confirmation (two-way listen communication). As shown in Figure 2, thermostatted 22 can comprise one or more embedded or connection speakers 28 and/or one or more embedded loud speaker or connect loud speaker 32, the support circuit 36 of the sound that receives together with permission thermostatted 22, record and/or reset. In addition, thermostatted 22 can comprise controller 47, and it comprises treater 40 and storer 44 with other function being convenient to receive, record and/or reset sound further and be convenient to thermostatted 22.

As for example shown in fig. 2, (multiple) speaker 28 and (multiple) loud speaker 32 can provide integrally with thermostatted 22 or be connected to thermostatted 22 in addition, and can communicate with the circuit 36 of thermostatted 22 with the further feature of thermostatted 22 (such as, storer 44, treater 40, first communication port 50, the 2nd communication port 52 and/or user interface) communication. In some cases, (multiple) loud speaker 32 and/or (multiple) speaker 28 can be overall with the user interface 26 one-tenth one of thermostatted 22, in some cases, and (multiple) speaker 28 can be separated with the user interface 26 of thermostatted 22 with (multiple) loud speaker 32.

Illustratively, multiple speaker 28 can be provided integrally or with it communicatedly with thermostatted 22, wherein, described multiple speaker 28 can be provided to increase the function of thermostatted 22 and/or to improve its performance. such as, it is arranged in thermostatted 22 or multiple speakers of communicating with thermostatted 22 in addition can allow thermostatted 22 place or the noise cancellation of cloud 56, echo cancel function in thermostatted 22 place or cloud 56, Wave beam forming in thermostatted 22 place or cloud 56 or space filtering function are (such as, determine that voice from which direction and removes the ability of undesired noise), increase reliably can obtain the region (e.g. particularly when speaker is in the face of different directions) of sound from it and/or increases the function of thermostatted 22 in any other suitable way and/or improve its performance.

In some cases, the timer realized with circuit 36 and/or treater 40 when thermostatted 22 can include.Thermostatted 22 also can comprise for receiving one or more signal and/or the I/O block (I/O block) 54 for providing one or more control signal to the parts of building automation system 4 from the parts of building automation system 4. Alternatively or in addition, I/O block 54 can communicate with another controller, this another controller can communicate with one or more HVAC portion parts of building automation system 4, district's control panel in such as subregion HVAC system, be usually located at away from thermostatted 22 place and/or one or more building system parts side or near equipment interface module or other building controls equipment any.

Explanation property thermostatted 22 can comprise internal temperature sensor 60, but this is not requirement. In some cases, thermostatted 22 can be positioned at throughout one or more remote temperature sensors, humidity sensor, speaker/audio sensor, loud speaker, the indicating meter of whole buildings or structure and/or take sensor communication. Further, thermostatted 22 can survey external temperature and/or humidity with being positioned at the temperature sensor of buildings or structural outer, humidity sensor and/or other sensor communication for the sense when expecting.

The treater 40 of controller 47 can operate according to the algorithm of control or the operation controlling thermostatted 22 at least in part. Treater 40 can such as operate according to the control algorithm controlling one or more building components, and can set or control temperature setting point, humidity set point, scheduling table, start and end time, window frost prevention, operator scheme etc. Can control being locally stored in the storer 44 of thermostatted 22 at least partially of algorithm, and upgrade and/or programming from External Web services by one or more in the first network and the 2nd network in some cases. According to expectation, such as, can upgrade according to predetermined scheduling table (every 24 hours, 48 hours, 72 hours, weekly, monthly etc. once), upgrade in response to the change to control algorithm announced, upgrade in response to the request of user and/or what its time in office upgrades the control algorithm (or its part) being locally stored in the storer 44 of building automation controller 18. Receive the renewal of a part of the control algorithm being stored in storer 44 or control algorithm from External Web services by one or more in the first network and the 2nd network. In some cases, the control algorithm part being updated can comprise the setting of such as setting point, scheduling table time and/or other setting and so on, but this is not requirement.

In some cases, treater 40 can according to having the first operator scheme of the first temperature set-point, the 2nd operator scheme with the 2nd temperature set-point, the 3rd operator scheme etc. with the 3rd temperature set-point operate, wherein, temperature set-point can be different value or identical value. In some cases, the first operator scheme may correspond in being taken pattern, and the 2nd operator scheme may correspond in vacant pattern. In some cases, the 3rd operator scheme may correspond in holiday or vacation pattern, wherein, building automation system 4 be positioned at buildings wherein or structure to be expected at the long-term time period unoccupied. In other cases, the 3rd operator scheme may correspond in wherein expecting that buildings occupant sleeps or inactive sleep pattern within for some time. These are only some examples. As required or expect, it will be appreciated that treater 40 may operation under additional or less pattern.

Can arrange locally through user interface and/or the number establishing operator scheme by External Web services and/or the operating parameters that is associated with each operator scheme, and it is delivered to thermostatted 22 via one or more in the first network and the 2nd network, in there, it can be stored in storer 44 for treater 40 reference.

In some cases, treater 40 can arrange according to the one or more predetermined operational parameters being associated with the user's configuration file (userprofile) being associated with specific individual consumer and operate. This user's configuration file can be stored in the storer 44 of building automation controller 18 and/or can by External Web services trustship and be stored on external web servers 58. This user's configuration file can comprise the one or more users for the one or more operator schemes can specified by user and select to arrange. Such as, treater 40 can according to having the first operator scheme of the first temperature set-point being associated with first user configuration file, there is the 2nd operator scheme of the 2nd temperature set-point being associated with first user configuration file, there is the 3rd operator scheme etc. of the 3rd temperature set-point being associated with first user configuration file operate, wherein, temperature set-point can be identical value or different value. In some cases, multiple user's configuration file can be associated with thermostatted 22. In some cases, wherein two or more user's configuration files are associated with thermostatted 22, can be programmed for by treater 40 and comprise for determining that when two user's configuration files are all movable which individual consumer's configuration file takies one group of rule of the right of priority for controlling HVAC system.

Such as, the storer 44 of thermostatted 22 can communicate with treater 40, as example shown in fig. 2 (by circuit 36). Storer 44 can be used to store any expectation information, such as above-mentioned control algorithm parameter, record speech message etc. Storer 44 can be the storing device of any suitable type, includes but not limited to RAM, ROM, EPROM, flash memory, hard disk drive etc. In some cases, information can be stored in storer 44 by treater 40, and can fetch the information of storage subsequently from storer 44. In some cases, storer 44 can be a part for treater 40.

In illustrated examples shown in fig. 2, user interface 26 can be allow thermostatted 22 to provide and/or request information and accept any suitable user interface of one or more user interactions when being provided. Such as, user interface 26 can allow user to input data in this locality, such as temperature set-point, humidity set point, the time opening, the end time, the scheduling table time, the diagnosis limit, response etc. to alarm. In some cases, user interface 26 can be at the addressable physical user interface in thermostatted 22 place, and can comprise indicating meter 48, speaker 28, loud speaker 32 and/or different key district. Indicating meter can be any suitable indicating meter. In some cases, indicating meter can comprise or can be liquid-crystal display (LCD), and is fixing segmented display or dot matrix LCD indicating meter in some cases. In other cases, user interface 26 can be the touch-screen LCD serving as indicating meter and key district. Touch-screen LCD can be suitable for request and for the value of multiple operating parameters and/or receive this type of value, but this is not requirement.In similar or other situation, user interface 26 can be dynamic graphical user interface. Alternatively, user interface can be do not have indicating meter and/or do not have the only speech interface of non-voice input capability.

In some cases, user interface 26 not only needs at thermostatted 22 place user-accessible. Additionally, or alternatively, user interface 26 can be other equipment of used in mobile wireless device or all long-range equipment as described herein and so on via the first network and/or the 2nd network addressable Virtual User interface 26.

In some cases, user interface 26 can comprise by speaker 28 and sometimes loud speaker 32 addressable without hand, need not eye user interface, indicating meter 48 has optional feedback. Such as, treater 40 can be configured to receive and accept via receiving (such as by speaker 28, mutual by with one or more speech recognition engine) user's input of audio frequency stream input, and can comprise arrange with temperature set-point, humidity set point, time opening, end time, scheduling table time, window frost prevention, the diagnosis limit, to the relevant user's input of the response of alarm and/or other suitable user any input.

Present disclose provides one wherein to use and be recorded in non-transitory computer readable medium (such as, storer 44) and/or such as, the speech message (being included in audio frequency stream) that is continuously streamed as the mechanism of the message transmission system system between user and Internet connection thermostatted 22. these speech messages that can comprise voice command can such as receive from user from user and/or via the long-range equipment near the user issuing voice command at thermostatted 22 place. in one example, available (multiple) speaker 28 and (multiple) loud speaker 32 are by the Voice command at thermostatted 22 place (such as, with without hand and/or need not eye mode) access and/or control and/or with any suitable long-range equipment 25 by the first network and/or the 2nd network from remote location (such as, away from thermostatted 22) access and/or control thermostatted 22, described long-range equipment 25 has speaker, include but not limited to comprise the mobile telephone of smart phone, PDA, tablet PC, laptop computer or Personal Computer, the enable telepilot of wireless network, electronics reader etc.

When long-range equipment 25 is used to accessed by Voice command and/or control thermostatted 22, to imagine and can download on long-range equipment 25 and run application program. This application program can be convenient to record and/or the process of the voice command from user.

As shown in Figure 2, explanation property thermostatted 22(is such as, building automation controller 18) can comprise for by the first network (such as, first wireless network, the first cable network, WLAN, wired LAN, WAN, Internet etc.) carry out communicating the first communication port 50, such as, for the 2nd communication port 52 that undertaken communicating by the 2nd network (second wireless network, the 2nd cable network, WLAN, wired LAN, WAN or Internet) and/or other communication port one or more. Such as, in one example, the first communication port 50 can be wired or wireless communication port, and can comprise for being sent in a wired or wireless fashion by the first network (wired and/or wireless network) and/or the transmitter-receiver of Received signal strength. Such as, 2nd communication port 52 can be wired or wireless communication port, and it can be comprised for being sent in a wired or wireless fashion by the 2nd network (the 2nd wired or wireless network) and/or the transmitter-receiver of Received signal strength.In some cases, the 2nd communication port 52 can with wired or wireless router or the gateway communication for being connected to the 2nd network, but this is not requirement. In some cases, router or gateway can be overall with thermostatted 22 one-tenth one or can be used as independent equipment and provide.

In many cases, thermostatted 22 can be configured to via one or more wireless communication protocol by the first network and/or the 2nd network (such as, to communicate with long-range equipment 25 and/or cloud 56) wirelessly communicate, according to expectation, described wireless communication protocol includes but not limited to cellular communication, ZigBee, REDLINK, bluetooth, WiFi, IrDA, dedicated short-range communications (DSRC), EnOcean and/or other suitably public or proprietary wireless protocol any. Such as, such as, in some cases, thermostatted 22 can utilize opening or proprietary protocol to come and other equipment (having the web server 58 of data cache) and/or long-range equipment (mobile equipment, phonetic incepting case etc.) communication.

In order to communication capacity is expanded to comprising the voice from remote location, touch, mouse, keyboard or other interface, it is possible to selection of land can comprise the basis instrument except typical long-range equipment 25, open or proprietary protocol and/or thermostatted 22 in networking Infrastructure. This type of additional infrastructure can comprise the web server 58 in the Infrastructure (such as, Internet) of such as cloud 56 and/or cloud, as shown in Figure 3.

Cloud or cloud Infrastructure 56(are also referred to as cloud computing) such as, can comprise can by the network service of transmitting and the calculating resource (hardware and/or software) that can keep or store data buffer memory. The data buffer memory being stored in cloud Infrastructure 56 can store the information about thermostatted 22. Such as, data buffer memory can store the current state of thermostatted 22 and/or setting, model, type and/or about the out of Memory of thermostatted 22 and/or user.

In some cases, thermostatted 22 can be programmed for by the first network and/or the 2nd network with by the outside web of one or more external web servers 58 trustship in cloud 56 or cloud service communication. The TOTALCONNECT web that the non-limiting example of this type of External Web services is Honeywell serves. Illustratively, thermostatted 22 can be configured to, via the 2nd network, selected data is uploaded to External Web services, and it can be collected in there and be stored on external web servers 58. In some cases, these data can indicate the record voice command that the performance of building automation system 4, building controls arrange and/or will be construed to the order that thermostatted 22 can be understood by the speech recognition engine 46 of External Web services. In addition, thermostatted 22 can be configured to be received from External Web services by the first network and/or the 2nd network and/or download selected data, arranges and/or comprise the service of software upgrading and/or order that thermostatted 22 can be understood. Can automatically from web service reception, periodically download according to programmed algorithm, in response to user request and download and/or receive these data, setting and/or service in any other suitable way.

In non-limiting example described in fig. 2, thermostatted 22 can be configured to receive and/or download HVAC operation scheduling table and/or operating parameters setting from cloud 56 or other source, and such as such as temperature set-point, humidity set point, time opening, end time, window frost prevention are arranged.In some cases, thermostatted 22 can be configured to receive one or more user's configuration file, and it has at least one operating parameters selected by user preference and reflect user preferences and arranges. In some cases, thermostatted 22 can be configured to by the local weather data of the 2nd network reception, radar data, weather alert and/or warning, main stock index telegraph receiver data (tickerdata) and/or headline. These are only some examples.

In some cases, external web servers 58 can receive and accept the user via speaker 28 inputs and input, and this user input is associated with the account of user on External Web services and/or on thermostatted 22. in some cases, if user's input comprises the change to the parameter being associated with existing control algorithm, comprise any temperature set-point, humidity set point, scheduling table, start and end time, window frost prevention is arranged, operator scheme, the change of the change of user's configuration file or other suitable parameter any, then external web servers 58 can identify relevant parameter when suitable, and by the first network and/or the 2nd network, undated parameter value is transmitted into thermostatted 22, in there, it is by receiving via the first communication port 50 of thermostatted 22 and/or the 2nd communication port 52 and is stored in storer 44 and performs for by treater 40.

Such as, when using speech message or record carrys out order thermostatted 22, it is contemplated that any suitable speech recognition software (VLINGO can be used^TM��DRAGON^TMDeng). Illustratively, the treater 40 of thermostatted 22 can be configured to realize to be not intended the limited speech recognition engine of all or most of word identifying in dictionary, but can be configured to identify limited word and expression, the triggering phrase that is such as included in speech message and limited command set in some cases. This type of configuration processor 40 can allow via Voice command with very limited resources to control thermostatted 22.

Can being included in speech recognition engine 46 at least partially in thermostatted 22. In figure 3, show the speech recognition engine 46 of the enclosure at the thermostatted 22 with indicating meter 48, (multiple) speaker 28, (multiple) loud speaker 32 and control module 47, described control module 47 can provide one or more control signal to control building automation subsystem 12(such as, HVAC system) one or more HVAC portion parts 6. Control module 47 can comprise storer 44 and the treater 40 of Fig. 2, and storer 44 can comprise the instruction that can perform to operate speech recognition engine 46/ by treater 40 and communicate with speech recognition engine 46. Additionally or alternatively, thermostatted 22 can via communication link 42(such as, wired or wireless communication link) and/or Internet gateway 20 and speech recognition engine 46(are such as, the speech recognition engine 46 on web server or other server) interact, as also figure 3 illustrates. In some cases, speech recognition engine 46 on thermostatted 22 and the speech recognition engine 46(provided by web server 58 when both be provided time) can cooperate with communicating and serve as single speech recognition engine 46 through in communication port 50,52, or independent speech recognition engine 46 can be served as in by the one or more intercommunications mutually carried out in communication port 50,52.

In some cases, speech recognition engine 46(is such as, comprise such as speech-to-text software and/or the text speech recognition software to voice software and so on) and switching software can by the storer 44 being stored in thermostatted 22 at least in part, thermostatted 22 can directly be received, identify speech message such as, (audio frequency or voice stream) and convert thereof into thermostatted 22 and can understand order.Order phrase speech message in the voice stream received by thermostatted 22 can take natural language form (such as, usually the form of order it is not interpreted as by thermostatted 22), the user view order of the such as triggering phrase of " hello for thermostatted ", the order of " temperature is increased by 3 degree " or the employing natural language form of such as " I feels cold " and so on.

To in an example of the thermostatted that natural language speech message responds, when user is near thermostatted 22, user can send one or more natural language speech message via speaker 28 to thermostatted 22. Thermostatted 22 can receive natural language speech message, this speech message is converted to the order can understood by thermostatted 22, performs an action in response to this order and/or by the message based on natural language text, respond such as the one or more speech messages to receiving in listened to the natural language message explained to voice speech recognition software with text and/or predetermined video message. In addition, if thermostatted 22 and one or more remote sensor communication or there is one or more remote sensor, then can additionally or alternatively store in those sensors and operation speech recognition and switching software. Such as, some thermostatted 22 can have the remote temperature sensor and/or remote-control equipment that can be placed in the different rooms in house, and can be embedded at least in part by (multiple) speech recognition engine 46 in one or all in these sensors and/or remote-control equipment.

Although thermostatted 22 may need to know that it will parameter setting at exact value, such as parameter value itself and parameter unit are (such as, when parameter is temperature, parameter unit can be F(Fahrenheit) degree or C(Celsius) degree), but thermostatted 22 can be optionally arranged to operate by specific parameter unit all the time. Therefore, it is contemplated that when user 62 says relevant with parameter (such as, temperature) order, user 62 is indicating the parameter to be set to be currently pass through the consistent parameter value of its unit operated with thermostatted 22. Such as, parameter unit for one or more special parameter (temperature, humidity etc.) can be preprogrammed in thermostatted 22 at place of manufacturers or being easily selected by a user property set. Additionally or alternatively, different voice commands can be applied different parameter units by thermostatted 22 and/or speech recognition engine 46, or when different users provides voice command, when thermostatted 22 and/or speech recognition engine 46 can infer the suitable parameter unit being applied to voice command when being with or without the parameter unit in fact recorded in the voice stream comprising voice command from the context of voice command.

In operation, thermostatted 22 can exchange its parameter unit via inner message and speech recognition engine 46 so that then speech recognition engine 46 is put up with and be concerned about that parameter unit is synchronous with thermostatted 22. Then, once user 62 says natural language speech order, speech recognition engine 46 can form audible feedback by correct parameter unit, and the voice command recognition not having unit converts to the thermostatted order comprising parameter value and parameter unit and/or the set point temperatures upgrading thermostatted when not requiring user to say unit in order. This has reduction data stream and improves Internet connection requirement, simultaneously minimizing and require that user 62 says the ability revising the number of words of temperature set-point.

When the speech recognition engine 46 of the controller 47 of thermostatted 22 recognizes triggering phrase in the natural language speech stream received, speech recognition engine 46 can initiate the process of natural language speech stream.During the process of natural language speech stream, speech recognition engine 46 can identify in multiple difference order after identifying triggering phrase. Recognizing in multiple predetermined command in response to after triggering phrase, speech recognition engine 46 can produce can be understood by controller and order controller 47 performs and/or carries out the thermostatted order of specific recognition command.

Illustratively, such as, trigger the one or more identification in the identification of phrase, multiple predetermined command and thermostatted can be understood in the generation of order one or more can perform by thermostatted 22 (via other parts of speech recognition engine 46 and/or thermostatted 22). Alternatively or in addition, such as, trigger the one or more identification in the identification of phrase, multiple predetermined command and thermostatted can be understood in the generation of order one or more can perform by remote server 58 (via the further feature of speech recognition engine 46 and/or remote server 58).

For the ease of process and/or explanation natural language speech stream, (multiple) speech recognition engine 46 can comprise natural language and explain device (such as, switching software or speech recognition module), the natural language speech stream translation received is become text via speech-to-text speech recognition engine by it. Natural language explains that device then can by text compared with predefine triggering phrase, and if finding coupling, then natural language explains that device can find subsequent commands in the text. Natural language explains that device can will trigger text after phrase compared with multiple predefine order identifying. If finding to mate and recognize order, and depending on recognition command, natural language explains that device can find the one or more parameters after recognition command. Such as, if natural language speech stream comprises " temperature is please become 74 degree by thermostatted ". Word " thermostatted " can be trigger phrase, and word " change " can be order, and 74 can order " parameter " for " change ". Natural language explains that " thermostatted " scan text also can be identified as triggering phrase by device. Natural language explains that device then can for the text of effective predetermined command scanning after word " thermostatted ". When natural language explains that device finds order " change ", natural language explains that then device can start to find the numerical parameter ordered for " change ". In this case, natural language explains that device finds " 74 ". Then speech recognition engine 46 can convert thereof into the order that can be identified by the controller 47 of thermostatted 22 and can perform, such as " SP=74F ". Then the controller 47 of thermostatted 22 can perform this order and setting point becomes 74 Fahrenheit degrees.

In some cases, such as, the controller 47 of thermostatted 22 by initiating the process of natural language speech stream via the output port of in communication port 50,52 to (natural language stream) after the triggering phrase detected at least partially that remote server 58 sends natural language speech stream. In response to natural language speech stream is sent to remote server 58 at least partially, thermostatted 22 can receive the thermostatted order corresponding with the natural language speech stream being sent to remote server 58 via the input port of in communication port 50,52.

Utilize comprise speech recognition engine 46 at least partially (such as, speech recognition module) remote server 58 illustrated examples in, remote server can be configured to process the part received of natural language speech stream, and then identifies in the multiple different predetermined command being used for thermostatted 22 in this natural language speech stream.Once recognize order by remote server 58, the input port that remote server 58 can generate thermostatted order and this thermostatted order sends back in the communication port 50,52 of thermostatted 22 performs for by the controller 47 of thermostatted 22.

Replace except receiving thermostatted order from remote server 58 or as it, such as, thermostatted 22 can receive natural language speech message (audio clips), video clipping or other audio/visual editing via the input port of in communication port 50,52 from the part of the long range positioning of speech recognition engine 46. Thermostatted 22 plays the natural language speech message received and/or broadcasting pictures or video on the indicating meter 48 of thermostatted 22 by the loud speaker 32 of thermostatted 22.

Illustratively, thermostatted can understand state that order can change thermostatted 22 (such as, change setting point, input Holdover mode temporarily or permanently, system model is turned off, heating or refrigeration mode, open fan etc.), the current state reading thermostatted 22 is (such as, request Current Temperatures, current humidity level, residue filter life etc.), by setting able to programme (such as scheduling table able to programme is arranged) programming, the indicating meter of thermostatted shows some information, such as Weather information, stock information and or any out of Memory and/or can according to expectation perform other suitable function any. in some cases, switching software can be performed on thermostatted 22, and in some other cases, can being separated with thermostatted 22 or independent equipment perform switching software, such as on remote server 58, long-range equipment 25 place and/or what its suitable equipment in office. in some cases, a part for switching software can perform (such as by thermostatted 22 or long-range equipment 25, speech message is to the conversion of text), and another part of switching software can perform (such as to explain message intention behind on remote server 58, and message conversion becomes the thermostatted 22 can understood by thermostatted 22 and perform specifically order), but these are only examples.

In some cases, when thermostatted 22 receive thermostatted can understand order time, such as, thermostatted 22 may not accept this order automatically, but more properly says that can arrange (thermostatted code) for it checks this order. Such as, thermostatted 22 can receive the thermostatted relevant with temperature set-point can understand order (such as, set point temperatures is become the order of asked set-point value or any other order relevant with temperature set-point), thermostatted 22 can check for preset limit is asked set point temperatures, and only just accepts this change when thermostatted can understand the change of command request in this preset limit. If the change of command request in the preset limit of thermostatted 22, the thermostatted then generated can understand order can become set point temperatures into set-point value by order controller 47, such as, and thermostatted 22 is reported from the new set point value (new temperature set-point) obtained in response to the action that can accept order and take by thermostatted 22 to audibly by loud speaker 32 in some cases. If being asked set-point value outside preset limit, the thermostatted then generated can understand order can order controller 47 set-point value that changes in the limit by set point temperatures, and in some cases, thermostatted 22 provides by loud speaker 32 can listen response (such as, spoken responses or certain can listen response), such as, its instruction order is not performed, orders and be not performed (temperature set-point is set in the value outside the preset temperature setting point limit by request) and/or new (if new words) set-point value why.This type of can listen response user 62 can be helped need not to go to thermostatted 22 check the possible problem about thermostatted 22. In some cases, can listen respond by work the preset limit changing thermostatted 22 with user 62 and/or find can accept temperature set-point or other action in the preset limit of thermostatted 22 be convenient to user 62 be similar to exchanging of meet.

In some cases, order can be made to be associated with the grand of number changing setting and/or parameter in response to this order. Such as, the voice command of " good night for thermostatted " can be converted to a series of two or more order that each can be identified by thermostatted 22, such as temperature set-point is reduced to sleep set point temperatures order, below be fan is placed in air-circulating fan pattern order, below be the outside light in house is turned off order, be the order of unlatching security system below.

In some cases, can limit intentionally and can identify and convert number and the type of the order of order to. Additionally or alternatively, can limit intentionally and can identify and convert the form of the order of order to. This can so that switching software more easily identifies the voice command received and converts thereof into the suitable action taked by thermostatted 22. This can help to increase the accuracy of voice command system and/or reliability and improve the time of response, especially when software resource has in limited time, such as in some thermostatted 22.

Such as, when expressing the order can understood by thermostatted 22 clearly, the speech recognition software of speech recognition engine 46 and/or switching software can consider the one or more parameters in the data buffer memory being stored in cloud Infrastructure 56 (current set point temperatures). Such as, when natural language message instruction " I am cold " received from user, speech recognition engine 46 can for the current set point temperatures of thermostatted 22 (such as, 72 degree) check data buffer memory, such as, and the order that set point temperatures is set in 74 degree (more twice warm than current set point temperatures) is provided to thermostatted 22. Once be converted into, from the natural language message of user, the order that thermostatted 22 can understand, such as, such as, by having network that is open or proprietary protocol (HVACweb Service interface protocol, such as web service API (API)), this order is sent to thermostatted 22. Owing to this conversion asks the space in storer 44 to store for it and require that the processing power of treater 40 operates for it possibly, so the switching software of speech recognition engine 46 being remained in cloud 56 or in addition away from thermostatted 22(such as, in the region of the family being separated with the specific position of thermostatted 22 or buildings) in some cases may reduce in the storer needed in the place of thermostatted 22 own and/or process resource useful. In some cases, thermostatted 22 can have sufficient storer and/or process resource, and if the words expected own, process can occur at thermostatted 22 place.

Although mainly describing speech recognition engine 46 relative to the speech recognition engine 46 on thermostatted 22, but a part for speech recognition engine 46 or speech recognition engine 46 can reside on the server 58 in cloud 56 or in addition away from the server of thermostatted 22 (such as, server in the buildings 2 identical from thermostatted 22 or in the buildings different with thermostatted 22), As mentioned above.The function of speech recognition engine 46 can be identical or to can be depending on speech recognition engine 46 different relative to the position of thermostatted 22. Can determine that the factor of the function of thermostatted includes but not limited to the size etc. of the storer that the ability of processor operations speech recognition engine 46 is associated with speech recognition engine 46.

The speech control system of thermostatted 22 can be initiated after it recognizes input by the speech recognition engine 46 of thermostatted 22, button on described input such as user interface 26 or the selection of selectable option, triggers phrase, order or any combination of phrase and order is selected, triggered to the user interface 26 that proposes together or individually. As used herein, " triggering phrase " is exclusive word, exclusive group of words and/or exclusive sound, and it allows thermostatted 22 know that user wants to provide order to thermostatted 22 via speech recognition engine 46. Trigger phrase and can comprise such as " thermostatted, hello ", ", thermostatted " etc. In some cases, triggering phrase can by user program. As used herein, " order " can want thermostatted 22 performs (multiple) what action by one or the other mode indicating user.

In some cases, the speech recognition engine 46 of thermostatted 22 can identify the triggering phrase in voice stream, such as " thermostatted ", " thermostatted, hello " or ", thermostatted ", and trigger phrase in response to recognizing and take specific action. In one example, if user says " thermostatted is waken up ", then can recognize and trigger phrase " thermostatted " and subsequent commands " waking up ". Order " waking up " does not have any relevant parameter, and therefore thermostatted can not find subsequent parameter. Alternatively, the order that " waking up " order will be converted into thermostatted and can understand, thus illuminate the indicating meter 48 of thermostatted 22. In another example, if user says " thermostatted illustrates outer surface temperature ", then thermostatted can illustrate on the indicating meter 48 of thermostatted 22 that the temperature of outside is (and if thermostatted 22 is in sleep pattern, then illuminating indicating meter, this to be performed the example being taked action that institute's request action may require). Thermostatted 22 can say the temperature of outside equally or alternatively. Other order causing other action can be imagined. In some cases, thermostatted can have mode of learning, and it can allow user that user defines voice " order " to be associated with the specific action taked by thermostatted 22.

In some cases, user's definable and/or thermostatted 22(such as, speech recognition engine 46 or further feature) can learn to trigger phrase or order. Such as, such as, when thermostatted 22 is in mode of learning or when being in different mode, user can say phrase or perform the action (press button and/or take other action one or more) that can be identified by thermostatted 22. Thermostatted 22 can record (such as, at thermostatted 22 place or at remote location place record) phrase that can identify of thermostatted 22 and/or action, and user can make one or more actions of taking by thermostatted 22 (such as, the action taked can be that thermostatted 22 is placed in one it is recognizing in the pattern triggering wait command after phrase, or other action one or more) the record phrase that can identify with thermostatted 22 and/or action be associated. In there, then thermostatted 22 can automatically start the action performed with the triggering phrase created or order are associated when recognizing and trigger phrase or order.Alternatively or in addition, one or more record phrase and/or operation of recording can be sent to remote location together with the relevant action taked by thermostatted 22 by thermostatted 22 for considering by third party and/or to be ratified.

In some cases, the multiple triggering phrase that can be identified by thermostatted 22 that thermostatted 22 can be supported from thermostatted 22 by user or action one or more (such as, " hello ", " thermostatted, hello ", physical button by inferior) in select phrase be associated with the one or more actions taked by thermostatted 22 thereupon. Illustratively, user can select on thermostatted 22 available (such as, by its support) multiple triggering phrases in one, and associate or thermostatted 22 is associated automatically, initiate and/or activate the Voice command of thermostatted 22, make to initiate Voice command, the wait command when recognizing selected triggering phrase by thermostatted 22.

Thermostatted 22 or other equipment can record has said but triggering phrase that at present thermostatted 22 is not supported and/or order, such as, and these triggering phrases recorded and/or order are preserved (at thermostatted 22 place and/or in the position away from thermostatted 22) for analyzing in the future. In some cases, and/or can order (such as to the triggering phrase of record, the triggering phrase of these records and/or the audio file of order) perform to resolve and/or other analysis, and this alanysis can be utilized to add, in response to the perception demand of some function for thermostatted 22 place, multiple triggering phrase and/or the order that thermostatted 22 is supported.

Alternatively or except using triggering except phrase, thermostatted 22 itself can be initiated Voice command in response to one or more different triggering or initiate certain other action. Such as, the triggering device that can initiate the Voice command of thermostatted 22 or certain other action of thermostatted 22 can include but not limited to the touch of button, survey (such as close to the activation of sensor, gesture sense, survey via the gesture sense such as surveyed by the commercially available gesture sense of LEAPMOTION), the detection of the pattern of user interactions (such as, user keeps (hold) for providing interim three mornings continuously, and thermostatted can ask whether user should change the scheduling table of programming for morning) and/or other suitably triggering and/or action any.

When motion detector and/or integrated infrared/optical sensing device has been included thermostatted 22 and/or has been connected to thermostatted 22(such as overall with thermostatted 22 one-tenth one or communicate with thermostatted 22) time, these detectors/sensors can feel one or more people, animal and/or the object surveyed in monitored region existence and/or via the sensor of infrared or optical sensing device or other type to the surface temperature of measuring in family and/or other condition. In one example, if the wall upper sensor of thermostatted 22 is by detecting, people is warm or cold, then thermostatted 22 can ask in user 62 or family occupant whether it wants to make it warmer or colder. In some cases, due to one or more sensing temperature of people one or more in monitored region, animal or object, thermostatted 22 can ask whether user 62 should increase or reduce temperature automatically to audibly, and user 62 can respond with the order that can be identified by the speech control system of thermostatted 22 to audibly. Alternatively or in addition, thermostatted 22 can in response to sense people, animal or object relative be configured to adjust in thermostatted 22 residing for such as, sense ambient temperature (threshold level) be in certain temperature level and automatically adjust the setting point of thermostatted 22.In some cases, thermostatted 22 can in response to one or more people, the temperature of one or more animal (such as pet) being detected and/or in use or do not use (such as at one or more object, baking oven, refrigerator etc.) when play tone or display message, indicate it to sense and should adjust set point temperatures.

In some cases, the Voice command of thermostatted 22 may need thermostatted 22 is connected to Internet to utilize the speech recognition engine 46 in cloud or to be used for other object via wired or wireless connection or communication link 42. Such as, when being provided like this, and in some cases, once the speech recognition engine 46 of thermostatted 22 or thermostatted 22 recognizes triggering phrase, then thermostatted 22 can set up and/or be checked through the suitable connection (server in cloud) of Internet 56. In some cases, the server of the service provider that thermostatted 22 may need to be connected in cloud is (such as, the web service of the TotalConnectTM server of such as Honeywell or the server of another service provider and so on), but this is not all requirements in all embodiments. Such as, when providing the speech recognition engine 46 can understood and trigger phrase and order in thermostatted 22, the Voice command of thermostatted 22 can not need the server of the service provider being connected in Internet 56 and/or cloud.

Fig. 4 shows the mutual interaction figure of the explanation sexual intercourse between the server in user, thermostatted and cloud. At first, user 62 can say and trigger phrase 64(such as, " hello for thermostatted "), such as, and the local speech recognition engine 46 at thermostatted 22 place can be identified and trigger phrase 64 and user 62 responded for the request (" please say your order " or other request) of order 66 or other audio clips or message by loud speaker 32. Responsively, user can say his/her order 68(such as, " warmer ", " I needs to help " or other order), and thermostatted 22 can comprise the speech message record of order 68 and/or transmit 70 as a stream to the remote speech recognition engine 46(in cloud 56 such as, on the server in cloud) for the identification ordered.

In the example shown, the speech control system of thermostatted 22 can stop record audio after meeting certain threshold value and/or audio streaming is transferred to cloud. Such as, thermostatted 22 can the speech control system in cloud recognize order and this order informed to thermostatted 22 after, since start record audio and/or stream transmission audio frequency since the speech control system of thermostatted 22, have passed through predetermined time amount after, after have passed through predetermined silent amount and/or after meeting certain other threshold value, stop record audio and/or audio streaming be transferred to cloud 56.

After receiving recording messages and/or stream transmission message, remote speech recognition engine 46 in cloud 56 can identify this order and order is become natural language based on text form from natural language audio frequency form, and then the natural language text-converted of the order 68 of user is become the order can understood by thermostatted 22. Then the command transfer 72 can understood by thermostatted can be arrived thermostatted 22 by the speech recognition engine 46 of cloud 56. Order is received in response to from cloud 56, the action that thermostatted 22 can take order defined is (such as, increase design temperature or reduce design temperature) and such as, the thermostatted of action (indicate thermostatted 22 set point temperatures added twice and to 72) that instruction is taked by thermostatted 22 feedback text can be understood send 74 to the speech recognition engine 46 in cloud 56.Then speech recognition engine 46 in cloud can send 76 message to thermostatted 22, tells listened to the nature speech message 78(that the action that instruction thermostatted 22 is taked play by thermostatted 22 and/or shows visual message on the indicating meter 48 of thermostatted 22). Then thermostatted 22 can be play can listen natural language message 78(such as, " temperature is set to 72 " or " temperature is set to 72 ") and/or on the indicating meter of thermostatted 22, show the message based on text. Such as, in some cases, message 76 can be the speech message (waveform file, MP3 or other file) directly can play by thermostatted 22. In other cases, message 76 can be the message based on text, and text can be in thermostatted 22 to speech conversion device, and the message conversion based on text was being become speech message by it before user's played voice message. In some cases, if initiated the Voice command of thermostatted 22 (such as via the triggering phrase previously identified) when saying order, then triggering phrase can be omitted.

Before utilizing the speech control system of thermostatted 22, it may be necessary to configure speech control system on thermostatted 22. This configuration can by the installation person of thermostatted 22, thermostatted 22 user perform and/or can thermostatted 22 terminal user use before assembling time arrange. In some cases, thermostatted 22 can automatically be initiated Voice command configuration and/or can initiate configuration by user when initial use. In order to be convenient to the Voice command that user configures thermostatted 22 when not needing to consult user manual, thermostatted 22 can provide audio frequency and/or vision to help editing.

In the configuration of speech control system and/or any time between the usage period, user 62 can to speech control system request " help ", and speech control system can be offered help. Such as, illustratively, speech recognition engine 46 can detect the voice command (" help ", " needing to help " etc.) that indicating user needs help with voice command in this locality. In response to the help order that this locality identifies, thermostatted 22 can play pre-recorded editing, provides prompting and/or the instruction of the speech control system of operated thermostat 22 and/or thermostatted 22 about how to user. Such as, when thermostatted 22 is not connected to Internet and user says and triggers phrase (such as, " hello for thermostatted " etc.) and/or voice command is (such as, " I needs help etc. ") time, such as " hello for thermostatted; I need help ", " hello for thermostatted; you can help me? ", " hello for thermostatted; please advise ", " hello for thermostatted; comprehensively help " etc., thermostatted can " in order to enable speech recognition, thermostatted must be connected to Wifi network by you with the first record statement. Once you complete connection, you can bring into use voice command to carry out operated thermostat " and/or record statement first, " you get well and wait one second to say thermostatted. Your order is said when being putd question to " respond. Likely order to list, it is contemplated that user can say " hello for thermostatted, lists order ". In another example, when thermostatted 22 be connected to Internet and user say such as " hello for thermostatted; I need help ", " hello for thermostatted; you can help me? ", " hello for thermostatted; please advise " etc. when triggering phrase and/or order, first, thermostatted 22 can play the record offered help, and such as " you get well and wait one second to say thermostatted.When being putd question to, say your order " or other suitable record any. In another example, when thermostatted 22 is connected to Internet and user says such as triggering phrases such as " hello for thermostatted; lists order " and/or order, thermostatted 22 can play record statement, such as: " you can say in these orders: warmer, colder, temperature is set to X degree, and weather how ... ". In another example, when thermostatted 22 is connected to Internet and user 62 says such as triggering phrase and/or the order of " hello for thermostatted, help " and so on comprehensively, thermostatted 22 can play these and/or other help editing. In an example again, when thermostatted 22 is connected to Internet and user 62 says triggering phrase and/or order " hello for thermostatted, troubleshooting ", " hello for thermostatted, deals with problems " etc., thermostatted 22 can play record, such as " guarantees that your thermostatted is connected to Wifi network. Slowly and clearly speak. Each order must start with " hello for thermostatted " phrase, such as " hello for thermostatted so that it is warmer ". These are only some exemplary record that some example of the help phrase command that user 62 can use and thermostatted can help order in response to user and provide. In some cases, if initiated the Voice command of thermostatted 22 (such as via the triggering phrase previously identified) when saying order, then triggering phrase can be omitted.

In some cases, replace except playing under initiating user or as it, the helping prompt of these records and instruction can such as enable on thermostatted 22 feature with allow user 62 know how to operate be activated feature and need not search subscriber guide or automatically play or show during other Guide Book. This is an example of context help. Can imagining in some cases, the selection of the specific help editing that play can based on the mutual context of specific user.

In some cases, by process 100, all as in the process shown in figure 5 after control thermostatted 22 with speech control system. In illustrative process 100, in order to activate the Voice command of thermostatted 22, user can say in the speaker 28 of thermostatted 22 and comprise the voice stream that Voice command triggers phrase, as shown in 101, and thermostatted 22 can use can constantly or once in a while intercept the Voice command engine 46 triggering phrase identify in the voice stream received as triggered phrase at the Voice command shown in 102. In some cases, thermostatted 22 can comprise speech recognition engine 46, its can process from (multiple) speaker 28 audio frequency data with identify (multiple) trigger phrase. In some cases, speech message can be recorded by thermostatted 22 and is sent to the speech recognition engine 46 being arranged in cloud 56 or is streamed to the speech recognition engine 46 being arranged in cloud 56 from thermostatted 22, in there, speech message can remotely be processed to identify that (multiple) trigger phrase.

When thermostatted 22 is unlocked or operates by any way, thermostatted 22 can intercept triggering phrase all the time, As mentioned above. In other cases, once open Voice command in thermostatted 22, thermostatted 22 can intercept triggering phrase all the time. Alternatively, thermostatted 22 can be set to according to expecting after certain action (its can without action), detect gesture or other move after, after certain time measures and/or intercept triggering phrase after what its suitable condition in office.In some cases, thermostatted 22 can intercept triggering phrase when it is in sleep state and when it is in wake-up states.

The triggering phrase chunking sensitivity factor of the speech control system of adjustable thermostatted 22 is (such as, adjustable scale) with for vacation negative (falsenegative) (such as, wherein not recognizing when speech control system has said triggering phrase actually and false negative occur when triggering phrase) balance false (falsepositive) certainly is (such as, wherein occur certainly false when speech control system is thought and heard triggering phrase but in fact do not said triggering phrase), to improve the accuracy of triggering phrase chunking. This type of balance is performed it is known that when occur certainly false and/or when occur false negative may be useful for speech control system in order to speech control system. In some cases, speech control system can have the order that false (or false negative has occurred) certainly has occurred to speech control system instruction when being said by user 62. When there is certainly false and/or false this type of order negating (such as in instruction, feedback) can be oral order (such as, in response to vacation certainly, user says " having no relations "), it is possible to such as, it is the electricity order provided by communication interface (serial, Ethernet etc.), can provide alternately (such as button down) by the physics with thermostatted 22, such as, (in response to vacation certainly, not following order) can be determined by context and/or can provide in any other suitable way. It is apprised of in response to when there is false affirmative (and/or when there is false negative), speech control system can determine or advise when the reequilibrate of triggering phrase sensitivity may improve the performance of system automatically, and automatically or can carry out those when ordering and change.

In thermostatted 22 processing audio data and after identifying triggering phrase, thermostatted 22 can perform an action, and such as sets up and/or test its connection (such as, test its connection to the server in cloud) to Internet, as shown in 104. If existed " without connecting ", and the speech recognition engine 46 on thermostatted 22 can not by natural language order (such as, the order that such as can not be identified by thermostatted 22) it is processed into the order can understood by thermostatted 22, then thermostatted 22 can indicate it not operate via Voice command, and thermostatted main screen 99(can be defaulted to such as, see Figure 19) or instruction unavailable other screen (such as, see Fig. 6) of Voice command. When the speech recognition engine 46 existed wherein on " without connecting " and thermostatted 22 is configured to natural language command process becomes the order can understood by thermostatted 22, the Voice command of thermostatted 22 can continue. The order that natural language command process one-tenth can be understood by the local speech recognition engine 46 of thermostatted 22 by thermostatted 22 wherein is in this case, speech control system can be configured to use remote speech recognition engine 46 when there is Internet connection, and is configured to when there is not Internet connection use local speech recognition engine 46. In some cases, when there is " without connecting ", natural language command process can be become the order can understood by thermostatted 22 by local speech recognition engine 46, but the function with minimizing for remote speech recognition engine 46, till connection recovers. Such as, local speech recognition engine 46 only can process the subset of order relative to remote speech recognition engine 46, such as better simply order.

Except checking its connection arriving Internet and/or cloud 56, thermostatted 22 can perform other operation one or more or take other action one or more in response to recognizing triggering phrase. thermostatted 22 can be able to include but not limited to initiate Voice command pattern in response to recognizing other action triggering phrase and take, audible messages is launched (such as by (multiple) loud speaker 32 of thermostatted 22, when audible messages comprises the instruction that Voice command pattern has been initiated), thermostatted 22 is made to be transformed into wake-up states from sleep state, initiate Voice command pattern, attempt identifying the voice command identifying and triggering after phrase, the indicating meter 48 of thermostatted shows main screen, perform other action one or more and/or perform any combination of described action or other action one or more.

As discussed, when thermostatted 22 has entered sleep pattern (such as, the pattern that wherein indicating meter 48 is de-energized or is not illuminated) time, such as after the period not used or in response to order, thermostatted 22 can when recognizing triggering phrase from sleep mode wakeup (such as, can become intercept triggering phrase all the time by thermostat set, even if under sleep or low-power mode). The indicating meter 48 illuminating thermostatted 22 in response to recognizing triggering phrase can allow user to check the action of the thermostatted taked with thermostatted 22 when interacting, such as, user can be allowed to check main screen or other default screen across room and/or be convenient to mutual (show that thermostatted 22 be with or without to recognize trigger phrase and/or it is with or without in response to having in the voice stream triggering phrase or take action with comprising in voice stream that the voice flow point triggering phrase opens the voice command provided) of user and thermostatted 22.

It is transformed into wake-up states from sleep state and can comprise the higher-power state that the lower power state from the sleep state for thermostatted 22 is transformed into the wake-up states for thermostatted 22. In one example, the indicating meter 48 of thermostatted 22 can comprise backlight and/or other lighting system and/or when thermostatted 22 is in sleep, backlight and/or other lighting system can be turned off or be dimmed. Then, when thermostatted 22 is in wake-up states, backlight or other lighting system can be opened or than smaller carrying out light modulation when thermostatted 22 is in sleep state, it can be the instruction that Voice command pattern has been activated by thermostatted 22. As the result entering wake-up states, thermostatted 22 can be in and be in sleep state and the higher-power state compared during lower power state with thermostatted 22. Additionally or alternatively, can being opened by other power system and/or energising when thermostatted 22 switches to wake-up states from sleep state, this can affect the power use level of thermostatted 22. In some cases, thermostatted can be powered battery.

As shown in reference 106 in Figure 5, if thermostatted 22 can not be connected to Internet or specific server is connected to Internet, then thermostatted 22 is spoken to audibly by loud speaker 32 and/or is shown message on indicating meter 48 intuitively, such as " without connecting. Sorry. Due to certain reason, I can not be connected to cloud. I wishes that I can help next time " or other suitable word any, phrase and/or noise. Figure 6 illustrates the explanation display 48 that thermostatted 22 shows " without the connecting " message based on text over the display.

If thermostatted 22 can be connected to Internet, then thermostatted 22 is said command request to audibly by loud speaker 32 and/or is shown 108 intuitively on indicating meter 48. Command request can be such as " how I can help? ", " how can I help? try to say ... ' make its warmer ' or ' make its cooler ' or ' temperature is arranged to _ _ _ _ degree ' " or other suitable message any. Show the explanation display 48 that thermostatted 22 shows the order based on text of request message in figures 7 and 8.

Once thermostatted 22 is by asking about how thermostatted 22 can help the information of user to indicate it to be ready to accept order to audibly and/or intuitively, then user can say order word or expression, as shown in 110 in Figure 5. Alternatively or in addition, thermostatted 22 can identify the voice command having in the same voice stream triggering phrase, and indicates it just in process voice commands.

When thermostatted 22 is from user's request command, thermostatted 22 can determine it within the distribution time (such as, in 5 seconds of request information, in 10 seconds of request information, in 20 seconds of request information, in 30 seconds of request information, in 45 seconds of request information) whether receive and changed order, as shown in 112. If failing in the setting-up time amount of user after information asked by thermostatted 22 to say can recognition command phrase, then thermostatted may be overtime, and thermostatted 22 can be said to audibly and/or shows 114 instruction Voice command intuitively terminates 71(such as, " time-out " and/or " goodbye ", see Figure 20) message and/or play time-out tone.

If user says recognition command phrase at the appointed time measuring, then before certain terminates threshold value, at project 116 place, thermostatted 22 can be attempted recognition command phrase is sent to Internet (such as, server with in the cloud 56 of Internet protocol (IP) Address Recognition), as shown in Figure 5. If thermostatted 22 order phrase can not be sent to be connected to Internet specific destination (such as, the cloud service of service provider), then thermostatted 22 can say and/or show intuitively 118 " cloud connection failures ", " without connect " or " sorry to audibly. Due to certain reason, I can not be connected to cloud. I wishes that I can help next time " or other suitable phrase (see Fig. 6) any. If order phrase is successfully sent to the specific destination (such as, the cloud service of service provider) being connected to Internet by thermostatted 22, then cloud service can be attempted processing 120 order phrases in cloud 56. In response to processing order phrase in cloud 56, according to expectation, thermostatted 22 can play audible sound adjust such as, (process tone) and/or display " please wait " (see Figure 15), " good; to allow me for you have a try that " (see Figure 21), " good, allow me for you have a try that. Connect slowly. Maintenance is attempted by I " (see Figure 22) or other similar phrase any. Such as, in some cases, in order to indicate order to be processed to user, thermostatted 22 can be play tone or display 122 processing messages or icon and reach setting-up time section (2 seconds, 4 seconds, 10 seconds). In some cases, can showing tone or message reaches setting-up time section, no matter processing order phrase need to how long, or alternatively, thermostatted 22 can play tone or display 122 processing messages reach the time area of a room of process needed for order phrase.

In some cases, cloud service may not understand the order provided by thermostatted 22 and/or long-range equipment 25 to it, and then can provide the help of raising to user, as discussed in this article (see Fig. 9). Can not recognition command phrase in response to first time cloud service, thermostatted 22(or long-range equipment 25) can say and/or show 124 to audibly " can not recognition command attempt for the 1st time " or " without identifying " or " sorry you can try again? " or other suitable phrase any, and user is asked to say 110 another or iterated command phrases (see Figure 10). For the second time in succession can not recognition command phrase in response to cloud service, thermostatted 22(or long-range equipment 25) can provide about how saying order (such as to user 62, " you it may be said that ... warmer, cooler ") listen (and/or vision) feed back, and ask user to say another or iterated command phrase (see Figure 11). In response to cloud service continuously third time can not recognition command phrase, thermostatted 22 can say and/or show 126 to audibly " can not recognition command attempt (finally) the 3rd time " or " without identification " or " Voice command termination " or " goodbye " or other suitable phrase any (see Figure 12 and 20). Although proposing to attempt presenting three levels that can process and maybe can understand order phrase before speech control system terminates, but the level of any number of three (3) individual levels can being greater than or less than before thermostatted 22 terminates speech control process. In some cases, after first, second and/or the 3rd are attempted, thermostatted 22(or long-range equipment 25) can automatically show vision help message, or provide audio frequency and/or video to help message, can recognition command to help user suitably to provide.

Upon receipt of, identify and process order phrase, thermostatted 22 can say and/or show intuitively 130 " confirmations " to audibly, or the result (" temperature arranges and has been increased to 74 degree " or " new temperature is set " (see Figure 16)) of the action that order or thermostatted 22 take can be indicated, if desired.

When speech recognition engine 46 in thermostatted 22 does not recognize or the order said may not be interpreted as order wherein, thermostatted 22 can say and/or show " how I can help? attempt saying ... ' make its warmer ' or ' make its cooler ' or ' set warmer/cooler temperature [1 ... 10] to spend ' " or other suitable message any. Figure 8 illustrates explanation display 48(that thermostatted 22 after the first time of order unsuccessfully identifies shows the message based on text wherein, can at first when request command and/or recognition command first time unsuccessfully after show the display of Fig. 8).

In some cases, oneself can recognize user at thermostatted 22 by it and provide the help from thermostatted 22 when saying and need to help in order, configuration thermostatted 22 and/or other operated thermostat 22. In some cases, thermostatted 22(such as, speech recognition engine 46) triggering can be listened to be identified as indicating user need to help or assistance by predetermined via speaker 28. Such as, such as, triggering can be listened can to comprise listening and trigger phrase (comprising the triggering phrase of term " help " or other word) and/or be multiple one or more listened to triggerings phrases listened in trigger command below. Alternatively or except identification can listen triggering, thermostatted 22 can in view of user with thermostatted 22 mutual time such as, one or more actions (comprising nothing action) and sense user and may need to help to help and/or help.Such as, thermostatted 22 can trigger phrase but do not detect after phrase to listen and determine during order that user may need assistance or help can listen to trigger detecting to listen. In some cases, user can manually one or more buttons with thermostatted 22 interact (such as, the touch region that wherein button of thermostatted 22 can comprise the one or more touch regions on indicating meter 48, one or more button and/or be separated with indicating meter 48), thermostatted 22 identifies that by it user interacted with thermostatted may need to help and/or assistance.

When thermostatted 22 recognize user need assistance or help time, such as, such as, thermostatted 22 can be provided assistance automatically via helpful visual message, helpful audio message (audio clips), helpful video message (video clipping) etc. no matter whether thermostatted 22 recognizes the action can listened and trigger or take by user, and speech recognition engine 46 can be listened the action of triggering and/or user in response to different identifying and provide identical and/or different vision editing, audio clips and/or video clipping. in some cases, thermostatted 22 can in response to and corresponding to previously disabled or separate activate thermostatted 22 feature activation (such as, when thermostatted 22 can have one or more disablement feature under any preset time that can be activated and/or activate) and/or when open thermostatted 22 time (such as, the one or more helpful visual message play, audio message and/or video message may correspond in helping user to arrange thermostatted 22 or one or more feature at first when) play one or more helpful visual message, audio message and/or video message.

Helping at thermostatted 22 in an example of user, thermostatted 22 can recognize user and have any problem in interacting with speech control system, and can be depending on situation and provide the help improved the standard, as shown in Fig. 9 12. In some cases, when thermostatted 22 recognize user attempt transmitting order with failing during 80 in first time time, such as, thermostatted 22 can provide audio frequency (and/or vision) feedback (" please try again " or " sorry. You can try again? ", as shown in Figure 13 all). Attempt transmitting order with failing during 82 if thermostatted 22 recognizes user in second time, thermostatted 22 can to user 62 provide about how to say order (such as, " you it may be said that ... warmer, cooler ") listen (and/or vision) feed back. If thermostatted 22 recognizes user and transmits order with failing during second time attempts 82, thermostatted 22 can to user 62 provide speech control system stopping and problem by be recorded listen (and/or vision) feedback such as, (" problem will be recorded "). But each trial that order is said in Fig. 9 instruction describes with user 62 and triggers phrase 64 and start. But, in some cases, after first attempts 80, it is possible to do not need to say and trigger or trigger phrase 64, because Voice command is initiated.

Figure 10 shows the user 62 during the first trial 80 saying order, the speech recognition engine 46 above thermostatted 22 and the mutual indicative flowchart between the speech recognition engine 46 in cloud 56. As discussed above, in order to initiate the Voice command of thermostatted 22, user 62 can say and trigger phrase 64, and the speech recognition engine 46 at thermostatted 22 place can identify triggering phrase 64.Phrase (or other triggers) is triggered in response to recognizing, thermostatted 22 can be play and can listen natural language message 66(such as, " your order please be say ") and/or such as, the display request user 62 as shown in Figure 14 natural language of saying order (" saying voice command ") recording 88 and/or the instruction of stream transmission audio frequency and the display of current set point temperatures 90 sometimes based on text message 86 and thermostatted 22. Such as, in some cases, then the order said by user 62 can be transmitted (record and/or stream transmission) and for processing and be identified as order in cloud 56 or in addition speech recognition engine 46 away from thermostatted 22. Figure 15 shows thermostatted 22 and shows and process 89 voice commands (such as, " just in process voice commands ") instruction and such as, allow the illustrative screen of the display 48 based on text message that user 62 waits while processing 91 orders (" please wait "). Say order if recognized from user 62, then can send order thermostatted 22 from cloud 54 to thermostatted 22 and perform an action in response to this order and play 78 and/or show the message of the instruction of the action that thermostatted 22 is taked intuitively to audibly. Figure 16 and Figure 17 shows thermostatted 22 Identification display to 92 voice commands (such as, " recognize voice command ", " information order ") instruction and take the action of 94 by thermostatted 22 message (such as, " set new temperature ", " broadcasting result feedback ") display 48 illustrative screen, such as, wherein Figure 16 is in response to temperature set-point and is correlated with the screen of order and Figure 17 is in response to the screen of the relevant order (information order) of non-temperature set-point.

If do not identified by the speech recognition engine 46 in cloud 56 from the order 68 of user 62, then remote speech recognition engine 46 can send the message 69 play and/or show intuitively instruction order 68 to audibly and be not understood to thermostatted 22, and allows user 62 attempt the message again saying order. Such as, Figure 13 shows thermostatted 22 and shows the message 69 indicating order 68 not to be understood and allow user 62 again attempt saying order (" sorry. You can attempt again? ") display 48 account for screen. Figure 18 depicts has exemplary command 98(such as in offer, " hello for thermostatted; makes that it is warmer/cooler ", " hello for thermostatted; makes that it is much warmer/cooler " and " hello for thermostatted so that it is warmer/cooler [1 10] are spent ") text message while, thermostatted 22 show the illustrative screen of replacement of display 48 of the message 96 that instruction order is not understood.

Figure 11 shows the user 62 during the 2nd trial 82 saying order, the speech recognition engine 46 on thermostatted 22 and the mutual indicative flowchart between the speech recognition engine 46 in cloud 56. If do not identified by the speech recognition engine 46 in cloud 56 between the first trial period from the order 68 of user 62, then remote speech recognition engine 46 can send message to thermostatted 22 and can provide the additional message 69 helped or help to play to audibly and/or to show intuitively. Such as, such as, thermostatted 22 can provide listen (and/or vision) about how saying order (" you can say ... warmer, cooler ") to feed back to user 62.

Figure 12 shows the user 62 during the 3rd trial 84 saying order, the speech recognition engine 46 on thermostatted 22 and the mutual indicative flowchart between the speech recognition engine 46 in cloud 56.If 68 do not identified by the speech recognition engine 46 in cloud 56 or away from thermostatted 22 between the 2nd trial period from the order of user 62, then remote speech recognition engine 46 can send message to thermostatted 22 and has any problem in order and this problem is being recorded the message 69 for troubleshooting object to play to audibly and/or to show thermostatted intuitively understanding.

Between the usage period of speech control system, the identical and/or different problem helping or helping is required assistance possibly to imagine other help level in response to user. Except thermostatted 22 can recognize user when need to help or assistance and except required help can be provided, help or user by saying " help " or can be used when needed by assistance by the help icon on selection thermostatted 22 or button. The help provided by thermostatted can thermostatted 22 and/or on and/or on long-range equipment 25 provide. Such as, in order to help user, thermostatted 22 can show a series of images of the step of the process of illustrating, thermostatted 22 can be said the step of process and/or be interacted with the basic reason of problem identificatioin with user to audibly. Thermostatted 22 and/or long-range equipment 25 can play the video of interpretation process, if thermostatted 22 is connected to Internet, and user can take to the website illustrating the feature how using thermostatted and/or service, and/or thermostatted 22 can offer help to user with other appropriate ways any as required.

Other time when having initiated to help or between the usage period of the speech control system of thermostatted 22, the server 58 in cloud 56 can collect the data helping inquiry about user while operated thermostat 22. The data collected can be performed statistical study to identify the region that can be modified or change the operability increasing specific thermostatted 22 or general the speech control system of the operability of speech control system. Like this, speech control system can be improved.

In some cases, thermostatted 22 interacts with user 62 by asking questions to user 62. Such as, if user 62 will tell that thermostatted user 62 has a holiday, then thermostatted 22 can with " good. You want setting pattern vacation? " reply. If user responds by "Yes", then thermostatted 22 can with " when you leave? " respond. If user responded with " this Friday ", then thermostatted can with " when you will return? " respond. If user responded with " next Tuesday ", then thermostatted 22 can with " you want to set what temperature while you have a holiday? " respond. If user responds by the temperature of such as " 68 " and so on, then thermostatted can use customer-furnished information the pattern of having a holiday of thermostatted to be programmed. This is only an example. More generally, the speech control system of thermostatted 22 can conversate alternately with the various patterns according to expectation setting thermostatted, setting and/or system with user.

Thermostatted 22 can may automatically learn the comfortable property of user with speech control system. Illustratively, thermostatted 22 comes automatically to learn or identify user 62 and the mutual of speech control system (and/or thermostatted 22) and the level of experience alternately by the speech control system of user and thermostatted 22. Various factors can be utilized to determine the experience level of user, include but not limited to that the amount of the successful order provided continuously by user, user and the mutual amount of speech control system, wherein user and speech control system carry out mutual continuous print number of days etc.Such as, in one example, the various some places that the experience user 62 is travelled, thermostatted 22 can recommend or advise to user 62 to move to the more senior Voice command pattern (expert mode) of operated thermostat 22. User then can confirm this recommendation or suggestion and select to improve the standard, decline level or remain on same level. Generally, thermostatted 22 can adjust it automatically and user 62 carries out mutual residing experience level, or it can be tested level based on the sensing body of user 62 and provide the recommendation in order to improve or to reduce experience level. In some cases, automatically study thermostatted 22 simplifies interactive voice and Voice command by the amount being in the Voice command option that the horizontal limit of low experience is supplied to the amount of Voice command option of user 62 and is supplied to user 62 by the increase when user 62 is in high experience level as user 62. Alternatively or in addition, the speech control system of thermostatted 22 can provide more assistance or help to the user being in low experience level and provide less help or assistance to the user being in high experience level.

Thermostatted 22 can allow the setting and the use that carry out user's configuration file of the mandate user of thermostatted 22. User 62 may arrange its oneself comfort level configuration file via speech control system on thermostatted 22, and thermostatted 22 can may automatically learn the speech control system comfortable property level of each user 62 and comfortable for that speech control system property level is stored in its user's configuration file. In some examples, the configuration file of user can comprise the preferable procedure pattern of user 62, speech control system comfortable property level, preferable temperature are arranged, preferably arrange vacation, be preferably in and leave in setting, calendar etc. one or more. Each configuration file can have the ability being subject to password protection so that speech control system may can identify its password. In similar or other situation, such as, thermostatted 22 can identify the voice of user and/or can have other sensor one or more (fingerprint sensing device, eye/retina scan instrument, facial recognition scan instrument etc.) to identify user and thermostatted 22 is arranged to the configuration file of the user identified.

In some cases, thermostatted 22 and/or cloud service can about how using Voice command feature user to be trained. Due to user may unwilling reading in conjunction with thermostatted 22 provide about the file how using speech control system, and owing to may be difficult to accurately describe how to use speech control system, so thermostatted 22 can provide about the audio frequency and/or the vision lecture that how to use speech control system to carry out operated thermostat 22. Such as, the training of thermostatted 22 and/or help feature can be available (when speech control system is switched to "ON" in any other way or opens) when thermostatted 22 starts and/or when the configuration of speech control system. Additionally or alternatively, the training of thermostatted 22 and/or help feature by say in the speaker 28 of thermostatted 22 " helps " or certain other phrase or by select to help from the user interface 26 of thermostatted 22 or other button and can use when request while utilizing speech control system, as discussed above. In some cases, context help information is provided when can have trouble understanding systematicly user, when such as when thermostatted 22 there is the trouble of voice command identifying user. ?ountain ? lot thread saddle cloth difficulty steal useless low one-tenth spoon shoot a glance at slightly criticize sb's faults frankly lot thread ? 2(and/or long-range equipment 25) place provides audio frequency and/or vision training/help, and does not sometimes make user consult away from thermostatted 22 website and/or not make user consult the user manual for thermostatted 22.

Thermostatted 22 may can make user 62 pass by (walkthrough) one group of audio frequency and/or video queue, and it is lectured or explains how to configure thermostatted 22 to control specific HVAC system. Pass by with this type of of speech control system and can shorten and/or simplify thermostatted 22 and configure process, with follow on-screen menu list in case study how to configure the time span needed for thermostatted 22 for specific HVAC system contrary with difficulty. In one example, user can trigger phrase (such as by saying, " thermostatted; hello " etc.) and say order (" how configuring thermostatted for humidifier ") and initiate speech control system, responsively, speech control system can say " you want configuration thermostatted to control humidifier? " Such as, if user responds by "Yes", then thermostatted 22 can be corresponding with user 62 in session mode while the response of the inquiry from thermostatted 22 being arranged thermostatted 22 for HVAC system (humidifier) based on user 62. This kind of technology can eliminate or reduce the needs of menu of passing by after the menu search for configuring the setting that thermostatted 2 needs usually, and therefore can reduce the configuration time.

Unless indicated clearly in addition, speech control system discussed in this article can be operated from both speech recognition engines 46 of the speech recognition engine 46 on the speech recognition engine 46 thermostatted 22, the speech recognition engine 46 on remote server 58, thermostatted 22 and remote server 58, or share between its speech recognition engine 46 on thermostatted 22 and the speech recognition engine 46 on remote server 58.

Figure 23 is the exploded perspective figure of explanation property thermostatted 22, it can comprise protecgulum 210(such as, front window assembly), indicating meter 212(such as, liquid-crystal display (LCD)), spacer 214, printed wiring assembly 216, bonnet 218, one or more speaker 28 and one or more loud speaker 32. In some cases, when being included in thermostatted 22, speaker 28 can be affixed to printed wiring assembly 216 and can in the face of protecgulum 120, and loud speaker 32 can be affixed to bonnet 218 and can have and carry out maybe carrying out the electrical contact 220 of telecommunication with the electrical contact 2222 on printed wiring assembly 216. These layouts of speaker 28 and loud speaker 32 are not requirement, and according to expectation, can utilize other layout of speaker 28 and loud speaker 32.

In the U.S. Provisional Patent Application sequence number 61/800 being entitled as ELECTRONICDEVICEANDMETHODS that on March 15th, 2013 submits to, disclosing exemplary thermostatted 22 structure that can use together with feature of the present disclosure and/or combine in 637, it is by overall incorporated herein by reference.

As discussed, speaker 28 can be positioned on thermostatted 22 in any position according to expectation. Such as, the first speaker 28a can locate towards the bottom of printed wiring assembly 216, and the 2nd speaker 28b can locate towards the bottom of printed wiring assembly 216, and and separate between the first speaker 28a, as shown in Figure 23 and 24A. In some cases, speaker 28 can be arranged on printed wiring assembly 216 and/or thermostatted 22 in the way of increasing the function of thermostatted 22 and/or speaker 28 and/or improving its performance.Such as, speaker 28a and 28b can be separated from each other at the bottom place of printed wiring assembly 216, make it can be used to provide the Wave beam forming in the echo cancel function in the noise cancellation in thermostatted 22 place or cloud 56, thermostatted 22 place or cloud 56, thermostatted 22 place or cloud 56 or space filtering function (such as, it is determined that voice is from which direction and removes the ability of undesired noise), increase and can reliably obtain the region of sound from it and/or increase the function of thermostatted 22 and/or speaker 28 in any other suitable way and/or improve its performance. Although not illustrating other position of speaker 28 in the drawings, but speaker 28 can relative to each other and/or printed wiring assembly 216 with other orientation positions, include but not limited in the face of different directions, facing with each other, be positioned at different heights place etc. when thermostatted 22 is erect on wall.

As described, speaker 28 can be positioned on printed wiring assembly 216 so that it is protecgulum 210 faced by when thermostatted 22 is assembled. In some cases, the speaker 28 on printed wiring assembly can be directed at the satchel (pocket) 224 of the protecgulum 210 in the face of printed wiring assembly 216. These satchels 224 can be configured to against or alternatively can be positioned to be adjacent to printed wiring assembly 216 so that one or more speaker 28 is partly surrounded or to be centered around in each satchel 224. In one example, satchel 224 can surround and/or around most of speaker 28, and can have the opening 226 that the opening 228 with bonnet 218 is directed at, and wherein, opening 226,228 leads to outside and/or surrounding environment. Opening 226,228 and satchel 224 can be configured to from thermostatted 22 surrounding reception sound and by (funnel) that sound set to speaker 28.

Figure 24 A is the exploded front perspective view of the thermostatted 22 of loud speaker 32 parts when being decomposed out from bonnet 218. In some cases, loud speaker 32 can be arranged in the loud speaker compartment 230 of bonnet 218, the electrical contact 220(making loud speaker 32 such as, spring contact (as shown) or other contact) can thermostatted 22 be connected and/or in operation time with the electrical contact 222(on printed wiring assembly 216 shown in Figure 24 B) be directed at and contact this electrical contact 222. In some cases, packing ring 244 can to guarantee closely cooperating between loud speaker 32 and bonnet 218 between loud speaker 32 and loud speaker compartment 230. Illustratively, useful binders, frictional fit or loud speaker 32 is attached to bonnet 218 with other additional or connection mechanism any. In some cases, loud speaker compartment 230 can form the passage 232 of the opening 234 being heard the sound from loud speaker by it extending to bonnet 218 from loud speaker 32. Passage 232 can be limited by edge 236, and this edge 236 carries out the speaker openings 234 of work to focus in bonnet 218 by the sound from loud speaker 32.

Figure 24 B is the exploded rear perspective view of the thermostatted 22 of loud speaker 32 parts when being decomposed out from bonnet 218. In some cases, loud speaker 32 can be arranged in around the compartment opening 238 of bonnet 218, and wherein, compartment opening 238 leads to the speaker chambers 240 surrounded by speaker cover 242. Besieged speaker chambers 240 can be provided for any object. Such as, can in order to improve through passage 232 and from the closed speaker chambers 240 of the providing from the sound quality of loud speaker 32 out of the speaker openings 234 bonnet 218.

Because being described herein multiple illustrative embodiment of the present disclosure, one of ordinary skill in the art will readily recognize that and can realize in the scope of this paper claims and uses other embodiment in addition. Previous description has been set forth of the present disclosure many advantages that contain herein. However, it will be appreciated that the disclosure is only explanation property in many. When being no more than the scope of the present disclosure, can change in details, particularly about the shape of each several part, size and layout. Certainly express wherein in the language of claims and limit the scope of the present disclosure.

Claims (30)

1. the thermostatted being configured to control one or more HVAC portion parts of HVAC system, this thermostatted comprises:

Shell, this shell is configured to hold:

Temperature sensor;

Speaker;

Controller;

Wherein, described controller is configured to the triggering phrase identified in the speech message being included in and receiving by the speaker of thermostatted, and responsively performs an action.

2. the thermostatted of claim 1,

Wherein, the action performed in response to recognizing triggering phrase by controller comprises makes thermostatted be transformed into wake-up states from sleep state.

3. the thermostatted of claim 1,

Wherein, by controller, in response to recognizing, the action triggering phrase and perform comprises initiation Voice command pattern.

4. the thermostatted of claim 1,

Wherein, the action performed in response to recognizing triggering phrase by controller is included in after identifying triggering phrase and attempts voice command recognition.

5. the thermostatted of claim 1,

Wherein, by controller, in response to recognizing, the action triggering phrase and perform is included on the indicating meter of thermostatted to show main screen.

6. the thermostatted of claim 1, also comprises loud speaker,

Wherein, described loud speaker recognizes in response to controller and triggers phrase and launch audible messages.

7. the thermostatted of claim 1,

Wherein, by controller, in response to recognizing, the action triggering phrase and perform comprises the connection being checked through Internet.

8. controlling a method for thermostatted, the method comprises:

Voice stream is received at thermostatted place;

Identify the voice command in voice stream, wherein, this voice command designated parameter value when not having unit;

Voice command recognition is converted to the thermostatted order comprising parameter value and the unit can understood by thermostatted; And

Thermostatted order is performed by thermostatted.

9. the method for claim 8,

Wherein, switch process is performed by thermostatted.

10. the method for claim 8,

Wherein, perform described conversion step by remote web service, and thermostatted order is returned to thermostatted for execution.

The method of 11. claims 8,

Wherein, described unit is pre-programmed, and pre-programmed unit is applied to the parameter value specified in voice command.

12. 1 kinds are configured to control the thermostatted of one or more HVAC portion parts of HVAC system, and this thermostatted comprises:

Shell, this shell is configured to hold:

Temperature sensor;

Speaker;

Controller;

Wherein, described controller is configured to the triggering phrase identified in the audio frequency stream being included in and providing by the speaker of thermostatted, and in response to recognizing triggering phrase, the process that described controller is configured to initiate audio frequency stream with:

One in multiple difference order is identified after triggering phrase; And

Generate and can be understood by controller and the thermostatted order of order controller execution specific order of identification in audio frequency stream;And

Wherein, described controller is configured to perform the thermostatted order of generation.

The thermostatted of 13. claims 12,

Wherein, described controller is by being sent to, by audio frequency stream, the process that remote web server initiates audio frequency stream via the output port of thermostatted at least partially.

The thermostatted of 14. claims 12,

Wherein, described controller comprises the speech recognition module of the triggering phrase for identifying in audio frequency stream.

The thermostatted of 15. claims 12,

Wherein, the process of audio frequency stream initiated by described controller, and then controller carries out in the described multiple different order of identification after triggering phrase and generates and can be understood by controller and the thermostatted order of order controller execution specific order of identification in audio frequency stream.

The thermostatted of 16. claims 12, also comprises loud speaker,

Wherein, described controller is configured to after recognizing triggering phrase by loud speaker playing audio clips.

The thermostatted of 17. claims 12,

Wherein, described controller be configured to controller incorrect recognize and trigger phrase time receive feedback from user, and responsively, controller is configured to adjust and is being identified, by controller, the triggering phrase sensitivity factor triggering in phrase and using.

18. 1 kinds control the method for HVAC system with thermostatted, and the method comprises:

Audio frequency stream is received at thermostatted place;

Identify the triggering phrase in audio frequency stream;

One in the multiple difference orders in audio frequency stream is identified after triggering phrase;

Generate and can be understood by thermostatted and the thermostatted order of order thermostatted execution specific order of identification in audio frequency stream; And

The thermostatted order generated is performed by thermostatted.

The method of 19. claims 18, wherein:

Identify that triggering phrase step is performed by thermostatted;

One identified in described multiple different commands steps is performed by remote web service; And

Generate thermostatted commands steps to perform by remote web service.

The method of 20. claims 18, wherein:

Identify that triggering phrase step is performed by thermostatted;

One identified in described multiple different commands steps is performed by thermostatted; And

Generate thermostatted commands steps to perform by thermostatted.

The method of 21. claims 18,

Wherein, identify that triggering phrase step is performed by thermostatted, and

Wherein, described thermostatted be configured to thermostatted incorrect recognize and trigger phrase time receive feedback from user, and responsively, thermostatted is configured to adjust and is being identified, by thermostatted, the triggering phrase sensitivity factor triggering in phrase and using.

22. 1 kinds are configured to control the thermostatted of one or more HVAC portion parts of HVAC system, and this thermostatted comprises:

Shell, this shell is configured to hold:

Control module, it is configured to provide one or more control signal to control, according to thermostatted, one or more HVAC portion parts that algorithm controls HVAC system;

Speaker;

Loud speaker;

Indicating meter; And

Speech recognition module, wherein, described speech recognition module is configured to identify via speaker predetermined can listen triggering, and responsively, provide one or more audio clips via loud speaker and/or via indicating meter to provide video clipping for the thermostatted that assists user in operation.

The thermostatted of 23. claims 22,

Wherein, described speech recognition module responds triggers in recognizing predetermined can listening and provides audio/video clips for the thermostatted that assists user in operation.

The thermostatted of 24. claims 22,

Wherein, described speech recognition module is configured to identify multiple different listened to triggering, and each in triggering can be listened to provide different audio frequency and/or video clipping in response to multiple difference.

The thermostatted of 25. claims 22,

Wherein, described shell also holds one or more touch button for manually interacting with thermostatted, wherein, it is possible to activate one or more audio frequency and/or video clipping via one or more touch button.

The thermostatted of 26. claims 22,

Wherein, one or more audio frequency and/or video clipping are activated automatically when thermostatted is unlocked.

The thermostatted of 27. claims 22,

Wherein, described predetermined can listen to trigger comprise multiple difference and can listen one triggered in phrase.

The thermostatted of 28. claims 22,

Wherein, described predetermined triggering can be listened to comprise can listen triggering phrase, be that multiple difference can listen in trigger command after it.

29. 1 kinds of thermostatteds being configured to the one or more HVAC portion part communication with HVAC system and it controlled, this thermostatted comprises:

Shell, this shell is configured to hold:

Control module, it is configured to provide one or more control signal to control, according to thermostatted, one or more HVAC portion parts that algorithm controls HVAC system;

Indicating meter; And

Helping module, it is for playing one or more pre-recorded video clipping over the display for the thermostatted that assists user in operation.

The thermostatted of 30. claims 29,

Wherein, described help module also comprises speech recognition module, and wherein, described speech recognition module is configured to identify and makes a reservation for listen triggering, and responsively, plays one or more pre-recorded video clipping.