WO2017101266A1 - Voice control method and system - Google Patents

Voice control method and system Download PDF

Info

Publication number
WO2017101266A1
WO2017101266A1 PCT/CN2016/084619 CN2016084619W WO2017101266A1 WO 2017101266 A1 WO2017101266 A1 WO 2017101266A1 CN 2016084619 W CN2016084619 W CN 2016084619W WO 2017101266 A1 WO2017101266 A1 WO 2017101266A1
Authority
WO
WIPO (PCT)
Prior art keywords
voice
current application
executable
smart
control
Prior art date
Application number
PCT/CN2016/084619
Other languages
French (fr)
Chinese (zh)
Inventor
王云华
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Publication of WO2017101266A1 publication Critical patent/WO2017101266A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone

Definitions

  • the present invention relates to the field of smart television technologies, and in particular, to a voice control method and system.
  • the voice control of smart TV is becoming more and more popular. Users only need to directly speak the favorite programs in front of the smart TV. Smart TV can return the user's needs to the page of the smart TV through semantic recognition. No need for users to find remote controls everywhere.
  • the semantic recognition is completed based on a cloud-sized database. After receiving the voice command of the user, the smart TV transmits the voice command of the user to the cloud, and the cloud performs a large number of search and match, and often needs to wait very much. For a long time, the smart TV end can present the result of semantic recognition for the user. In addition, semantic recognition will not be completed when the smart TV is not connected to the cloud server.
  • Xiao Zhang opened the video application of iQiyi, and said that the smart TV said that the 10th episode of Huaqian TV series, the smart TV waited for 3 minutes to display a bunch of information, such as news, TV series and movies, etc. Play a TV show with thousands of bones.
  • Xiaomei downloaded the first episode of the TV series that was spent on the smart TV local.
  • the cloud server was suspended.
  • Xiaomei said that the first episode of the flower bones, the smart TV prompts the current cloud server. Unable to connect, the first set of flowers and bones downloaded to the local can not be played, causing little beauty confusion.
  • voice control efficiency is low.
  • the main object of the present invention is to provide a voice control method and system aiming at improving the efficiency of voice control.
  • the present invention provides a voice control method applied to a smart television, the voice control method comprising the following steps:
  • the smart television Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
  • the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
  • the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information
  • the smart television outputs prompt information.
  • the invention also provides a voice control method, which is applied to a smart television, and the voice control method comprises the following steps:
  • the smart TV Upon receiving the voice instruction of the user, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
  • the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information.
  • the smart TV while performing the step of determining whether the current application stores the to-be-executed object information corresponding to the executable control, the smart TV further performs the following steps:
  • the smart television outputs prompt information.
  • the step of determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control comprises:
  • the smart television determines whether each of the current applications stores the to-be-executed object information
  • the method further includes:
  • the smart TV displays the current application of the current application that stores the to-be-executed object information in descending order according to the running time of the current application. Executable controls for the user to choose to execute.
  • the smart television before the step of acquiring, by the smart TV, an executable control that currently matches the voice instruction, the smart television further includes:
  • the smart television Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
  • the step of executing the smart TV to acquire an executable control that matches the current voice command is performed.
  • the smart TV acquiring the executable control that the current application matches the voice instruction comprises:
  • the smart television Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
  • the smart television compares the first text information with each of the second text information
  • the smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
  • the present invention further provides a voice control system, which is applied to a smart TV, and the voice control system includes:
  • An acquiring module configured to acquire, when the user's voice instruction is received, an executable control that matches a current application with the voice instruction, where the current application is an application running at the front end;
  • a determining module configured to determine whether the current application stores the to-be-executed object information corresponding to the executable control
  • an execution module configured to: when the current application stores the to-be-executed object information, invoke the executable control to execute an execution object corresponding to the to-be-executed object information.
  • the determining module is further configured to determine whether the cloud server corresponding to the current application stores the to-be-executed object information
  • the voice control system further includes a prompting module, configured to output prompt information when the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information.
  • the determining module is further configured to determine whether each of the current applications stores the to-be-executed object information
  • the voice control system further includes a display module, configured to display the to-be-executed object information in descending order according to the running time of the current application when at least two of the current applications store the to-be-executed object information
  • the executable control of the current application for the user to select to execute.
  • the voice control system further includes a verification module, configured to extract an acoustic feature of the voice command upon receiving a voice instruction of the user, and perform a verification operation on the user according to the acoustic feature;
  • a verification module configured to extract an acoustic feature of the voice command upon receiving a voice instruction of the user, and perform a verification operation on the user according to the acoustic feature;
  • the obtaining module is further configured to: when the verification passes, obtain an executable control that matches the current application with the voice instruction.
  • the obtaining module is further configured to: when receiving the voice instruction of the user, convert the voice instruction into first text information, and collect second text information of the currently applied executable control; and A text message is compared with each of the second text information; and an executable control corresponding to the matched second text information is used as an executable control that matches the voice instruction.
  • the invention When applied to the playback control of the smart TV, the invention completes the semantic recognition process locally in the smart TV and completes the response of the voice command. For example, Xiaomei downloaded the first episode of the TV series that was spent on the smart TV through iQiyi yesterday. After opening the iQiyi today, Xiaomei said to the smart TV, "Look at the first episode of the flower bones", love Qiyi will directly play the local storage “Flower 1000 First Set”, which does not require the network connection between Smart TV and iQiyi server. Compared with the prior art, it avoids the high latency based on cloud semantic recognition and can The smart TV completes the voice control without the network connection, and therefore, the present invention can achieve the purpose of improving the voice control efficiency.
  • FIG. 1 is a schematic flow chart of a first embodiment of a voice control method according to the present invention
  • FIG. 2 is a schematic diagram of functional modules of a first embodiment of a voice control system of the present invention.
  • the present invention provides a voice control method.
  • the voice control method includes:
  • Step S10 when receiving the voice instruction of the user, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
  • the voice control method provided in this embodiment can be applied to a smart TV, and further, is applied to a play control of a smart TV.
  • Xiaomei downloaded a well-funded TV drama through iQiyi yesterday. The first episode is in the local area of smart TV. After opening the iQiyi today, Xiaomei said to the smart TV that “the first episode of the flower and bones”, Iqiyi will directly play the “first collection of flowers and bones” in the local storage.
  • a network connection between Smart TV and iQiyi server is required.
  • the smart TV when receiving the voice instruction of the user, acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end.
  • the user can issue voice commands to the smart TV in various manners, for example, the user can directly speak the voice command “see the first set of flowers” to the smart TV; or the user touches the remote controller preset.
  • the voice control button for voice control after the user speaks the voice command "look at the first set of flowers", the remote controller transmits the voice command "the first set of flowers to the bones" to the smart TV.
  • the remote controller can perform data interaction with the smart TV in a plurality of manners, including at least one of Bluetooth, Wi-Fi, infrared, and ZigBee.
  • the remote controller can perform voice control. Adopt infrared communication.
  • the smart television when receiving the voice instruction of the user, the smart television first hands the received voice command to the local semantic recognition engine to convert the voice command into the text information that can be compared.
  • the received voice command can also be transmitted to the cloud semantic recognition engine for recognition; if the cloud semantic recognition engine feedback is received first, The text information is used as the recognition result of the voice instruction by the cloud semantic recognition engine; because the network semantic environment is not good, the recognition result of the cloud semantic recognition engine may have a considerable delay, if received first
  • the local semantic recognition engine feeds back the text information, and the confidence of the text information fed back by the local semantic recognition engine is greater than a preset threshold, the text information fed back by the local semantic recognition engine is used as the recognition result of the voice instruction.
  • the present embodiment does not limit the voice recognition technology used by the local semantic recognition engine and the cloud semantic recognition engine, and may be selected according to actual needs.
  • the smart television acquires the scene information of the current application while performing the semantic recognition of the voice instruction, where the acquired scene information includes the first type of scene information and the second type of scene information, where the A type of scene information is used to identify the type of the current application, such as a video application type ID of 1, a magazine application type ID of 2, and a game application type ID of 3; the second type of scene information is a keyword of various applications. , such as the TV drama name of the film and so on.
  • the smart TV After acquiring the scene information of the current application, the smart TV reads the package name of the current application, and associates the acquired scene information with the package name and stores the information in the preset storage area 11. At the same time, the smart TV also calls the interface control information collection algorithm to collect the control information of the interface where the current application is located, and saves the collected control information into the preset storage area 22 according to the type of the control, and then according to the storage area 22
  • the control information filters out the executable control of the current application, and constructs a classification control and a corresponding text information list (such as "play", "flowers").
  • the smart TV compares the text information corresponding to the voice instruction with the text information in the foregoing classification control and the corresponding text information list, and executes the executable control with the same text information as the executable of the voice instruction.
  • the text information is stored in the form of encoding in the smart television.
  • the English characters are stored in ASCII code and stored, and the Chinese characters are encoded and stored in the unicode code.
  • the voice command and the voice command can be performed in this embodiment.
  • the control is matched, the English characters are matched based on the ASCII code, and the Chinese characters are matched based on the unicode code.
  • the encoded Data_String(x1) ⁇ u82b1 ⁇ u5343 ⁇ u9aa8 ⁇ u000d ⁇ u000a, and its corresponding Chinese character is “Flower Thousand Bone”.
  • Step S20 The smart TV determines whether the current application stores the to-be-executed object information corresponding to the executable control.
  • the smart TV determines whether the current application stores the to-be-executed object information corresponding to the executable control. It should be noted that the smart TV is divided into different data storage areas for the installed applications.
  • the current application running on the front end of the smart TV is an example of iQiyi.
  • the smart TV obtains the current application package name “iqiyi”, and identifies the current application.
  • the smart TV For the iQiyi, and obtain the executable control that matches the voice command "Looking at the Thousand Bone", the play button corresponding to the "Flower Thousand Bone" currently in the interface of iQiyi, the smart TV further retrieves the data storage corresponding to iQiyi. Whether the area stores the name data (ie, the object to be executed) of the "flowers to be executed” (ie, the object to be executed).
  • Step S30 When the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information.
  • the smart TV when the to-be-executed object information corresponding to the executable control is stored, the executable object corresponding to the executable control exists locally, for example, the smart TV is retrieving the executable object information.
  • the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information, for example, the smart television is searching.
  • the executable object information "flowers and bones” is displayed, the video data of "Flower Thousand Bone" is directly played.
  • the voice control method proposed in this embodiment when applied to the play control of the smart TV, completes the semantic recognition process locally on the smart TV and completes the response of the voice command. For example, Xiaomei downloaded the first episode of the TV series that was spent on the smart TV through iQiyi yesterday. After opening the iQiyi today, Xiaomei said to the smart TV, "Look at the first episode of the flower bones", love Qiyi will directly play the local storage “Flower 1000 First Set”, which does not require the network connection between Smart TV and iQiyi server.
  • the present invention can achieve the purpose of improving the voice control efficiency.
  • the present invention performs semantic recognition locally on the smart TV, it can also avoid the occupation of network bandwidth by voice control.
  • a second embodiment of the voice control method of the present invention is proposed.
  • the following steps are also performed:
  • the smart television outputs prompt information.
  • the smart TV converts the user's voice command into text information, and obtains an executable control that matches the current voice command according to the text information. And determining whether the current application stores the to-be-executed object information corresponding to the executable control, and determining whether the cloud server corresponding to the current application stores the to-be-executed object information, so that the current application is not
  • the object to be executed can be acquired according to the to-be-executed object information stored by the cloud server corresponding to the current application.
  • the current application running on the front end of the smart TV is an example of iQiyi.
  • the smart TV obtains the current application package name “iqiyi”, and identifies the current application.
  • the smart TV obtains the executable control that matches the voice command "Looking at the Thousand Bone”
  • the smart TV further retrieves the data storage corresponding to iQiyi.
  • the name data of the object to be executed that is, the object to be executed
  • the smart TV sends the text information “Flower Thousand Bone” to the cloud server corresponding to iQiyi, and the cloud server searches according to the received text information “Hua Qian Bone”, and feeds back to the smart TV. result.
  • the smart TV determines, according to the search result, whether the cloud server stores the to-be-executed object information.
  • the search result returned by the cloud server is: a movie in which the cloud currently stores “flowers and bones", a television drama, etc., at this time, if the smart TV does not retrieve "flowers" in the data storage area corresponding to iQiyi
  • the smart TV output prompt message the TV series with the "Flower Thousand Bones” and the movie can be played in the cloud, is it played? The user confirms whether to play according to the display interface of the prompt information, and what to play.
  • step S20 includes:
  • the smart television determines whether each of the current applications stores the to-be-executed object information
  • the method further includes:
  • the smart TV displays the current application of the current application that stores the to-be-executed object information in descending order according to the running time of the current application. Executable controls for the user to choose to execute.
  • the smart TV based on the Android system has already supported running multiple applications at the front end, for example, the smart TV runs both iQiyi and Youku at the front end, the smart TV Divide the screen into different display areas, respectively display the iQiyi interface and Youku interface, users can operate at both iQiyi and Youku.
  • the smart TV determines whether each of the current applications stores the to-be-executed object information, that is, the smart television determines data storage corresponding to each current application.
  • the information about the to-be-executed object is stored in the area.
  • the smart TV acquires a running time of a current application that stores the to-be-executed object information, and displays the stored in descending order according to the acquired running time.
  • the executable control of the current application of the object information to be executed is selected for execution by a user. For example, when the user gives a voice command to the smart TV, the smart TV acquires the scene information of the current application, identifies the application currently running on the front end as iQiyi and Youku, and further identifies and finds the iQiyi.
  • the data storage area corresponding to each of Youku stores the name data of “Hua Qian Bone”.
  • the smart TV acquires the running time of iQiyi for 30 minutes, and the running time of Youku is 20 minutes. Then, the smart TV displays the play button of the iQiyi corresponding to the “Hua Qian Bone” in front of the play button of Youku corresponding to “Hua Qian Bone”, which is convenient for the user to select “IQian bone” by using iQiyi, or adopt Youku plays "Flower Thousands of Bone”.
  • a fourth embodiment of the voice control method of the present invention is provided.
  • the method before the step S10, the method further includes:
  • the smart television Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
  • step S10 is performed.
  • the smart television extracts an acoustic feature of the voice instruction when receiving a voice instruction of the user, wherein the extractable acoustic features include LPC (Linear Prediction Coefficient), MFCC (Mel Cepstrum Coefficient), and At least one of PLP (Perceptual Linear Prediction) can be selected according to actual needs.
  • LPC Linear Prediction Coefficient
  • MFCC Mel Cepstrum Coefficient
  • PLP Personal Linear Prediction
  • the embodiment is pre-set with an acoustic feature database, and the smart TV master can record its own acoustic features into the acoustic feature database in advance, and can also record the acoustic features of friends, relatives or others into the acoustic feature database. .
  • the smart television After extracting the acoustic features of the voice command, the smart television compares the extracted acoustic features with respective acoustic features in a preset acoustic feature database to complete a verification operation on the user, wherein If there is a match in the acoustic feature database, the verification passes, indicating that the user who issued the voice instruction is the user authorized by the owner or the owner, and the smart TV acquires the executable control that matches the current voice instruction, and starts the voice. For the control flow, refer to the foregoing embodiment, and details are not described herein. If there is no matching item in the acoustic feature database, the verification fails, indicating that the user who issued the voice command is an illegal user, and the received voice command is discarded at this time. Conduct a voice control process.
  • the security of the voice control can be improved by adding a verification operation to the user in the voice control flow.
  • the foregoing step S10 includes:
  • the smart television Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
  • the smart television compares the first text information with each of the second text information
  • the smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
  • the user can issue a voice instruction to the smart TV in multiple manners.
  • the user can directly speak the voice command “see the first set of flowers” to the smart TV; or the user touches the remote controller preset.
  • the voice control button for voice control after the user speaks the voice command "look at the first set of flowers", the remote controller transmits the voice command "the first set of flowers to the bones" to the smart TV.
  • the remote controller can perform data interaction with the smart TV in a plurality of manners, including at least one of Bluetooth, Wi-Fi, infrared, and ZigBee.
  • the implementation may be performed by using a remote controller for voice control.
  • the way of infrared communication may be performed by using a remote controller for voice control.
  • the smart television when receiving the voice instruction of the user, the smart television first hands the received voice command to the local semantic recognition engine for converting the voice command into the first text information that can be compared.
  • the received voice command can also be transmitted to the cloud semantic recognition engine for recognition; if the cloud semantic recognition engine feedback is received first, The text information is used as the recognition result of the voice instruction by the cloud semantic recognition engine; because the network semantic environment is not good, the recognition result of the cloud semantic recognition engine may have a considerable delay, if received first
  • the local semantic recognition engine feeds back the text information, and when the confidence of the text information fed back by the local semantic recognition engine is greater than a preset threshold, the text information fed back by the local semantic recognition engine is used as the recognition result of the voice instruction.
  • the present embodiment does not limit the voice recognition technology used by the local semantic recognition engine and the cloud semantic recognition engine, and may be selected according to actual needs.
  • the smart TV obtains the scene information of the current application while performing the semantic recognition of the voice instruction, where the acquired scene information includes the first type of scene information and the second type of scene information, the first type
  • the scenario information is used to identify the type of the current application, such as a video application type ID of 1, a magazine application type ID of 2, and a game application type ID of 3;
  • the second type of scene information is a keyword of various applications, such as TV drama names and so on.
  • the smart TV After acquiring the scene information of the current application, the smart TV reads the package name of the current application, and associates the acquired scene information with the package name and stores the information in the preset storage area 11. In addition, the smart TV also invokes an interface control information collection algorithm to collect control information of the interface where the current application is located, and saves the collected control information into the preset storage area 22 according to the type of the control, and then according to the storage area 22
  • the control information filters out the executable control of the current application, and constructs a classification control and a corresponding text information list (such as "play", "flowers").
  • the smart television compares the first text information corresponding to the voice instruction with the second text information in the foregoing classification control and the corresponding text information list, and matches the second text information with the first text information.
  • the execution control acts as an executable control that matches the voice instruction.
  • the text information is stored in the form of encoding in the smart television.
  • the English characters are stored in ASCII code and stored, and the Chinese characters are encoded and stored in the unicode code.
  • the voice command and the voice command can be performed in this embodiment.
  • the control is matched, the English characters are matched based on the ASCII code, and the Chinese characters are matched based on the unicode code.
  • the encoded Data_String(x1) ⁇ u82b1 ⁇ u5343 ⁇ u9aa8 ⁇ u000d ⁇ u000a, and its corresponding Chinese character is “Flower Thousand Bone”.
  • the matching in the foregoing embodiments of the present invention means that the two comparators are the same or the similarity reaches a preset threshold, wherein the preset threshold may be selected according to actual needs, for example, may be set to 85%.
  • the present invention also provides a voice control system.
  • the voice control system includes:
  • the obtaining module 10 is configured to: when receiving the voice instruction of the user, acquire an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
  • the determining module 20 is configured to determine whether the current application stores the to-be-executed object information corresponding to the executable control;
  • the execution module 30 is configured to invoke the executable control to execute an execution object corresponding to the to-be-executed object information when the current application stores the to-be-executed object information.
  • the determining module 20 is further configured to determine whether the cloud server corresponding to the current application stores the to-be-stored Execution object information;
  • the voice control system further includes a prompting module, configured to output prompt information when the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information.
  • a third embodiment of the voice control system of the present invention is proposed.
  • the determining module 20 is further configured to determine each of the current Whether the application stores the to-be-executed object information;
  • the voice control system further includes a display module, configured to display the to-be-executed object information in descending order according to the running time of the current application when at least two of the current applications store the to-be-executed object information
  • the executable control of the current application for the user to select to execute.
  • the voice control system further includes a verification module, configured to: when receiving the voice command of the user, extract An acoustic feature of the voice command, and performing a verification operation on the user according to the acoustic feature;
  • the obtaining module 10 is further configured to: when the verification passes, obtain an executable control that matches the current application with the voice instruction.
  • a fifth embodiment of the voice control system of the present invention is proposed.
  • the acquiring module 10 is further configured to: when receiving a voice command of a user, the voice command. Converting to the first text information, and collecting second text information of the currently applied executable control; and comparing the first text information with each of the second text information; and matching the matched second text information
  • the executable control acts as an executable control that matches the voice instruction.

Abstract

A voice control method and system for a smart television, the method comprising the following steps: upon receiving a voice instruction from a user, the smart television acquires an executable control of a current application that matches the voice instruction, wherein the current application is an application operating at a front end (S10); the smart television determines whether information pertaining to a to-be-executed object corresponding to the executable control is stored in the current application (S20); and when the information pertaining to the to-be-executed object is stored in the current application, the smart television invokes the executable control to execute an object corresponding to the information pertaining to the to-be-executed object (S30). The method could improve the efficiency of voice control.

Description

语音控制方法及系统  Voice control method and system
技术邻域Technical neighborhood
本发明涉及智能电视技术领域,尤其涉及一种语音控制方法及系统。The present invention relates to the field of smart television technologies, and in particular, to a voice control method and system.
背景技术Background technique
随着智能电视技术的飞速发展,智能电视的语音控制越来越流行,用户只需要在智能电视面前直接讲出喜欢的节目,智能电视就能通过语义识别将用户的需求返回到智能电视的页面,不需要用户到处找遥控器。然而在现有技术中,语义识别是基于云端庞大的数据库完成的,智能电视在接收到用户的语音指令后,将用户的语音指令传送到云端,由云端进行大量的查找匹配,往往需要等待很长的时间,智能电视端才能为用户呈现语义识别的结果。此外,当智能电视未连接到云端服务器时,语义识别将无法完成。例如,小张开启爱奇艺的视频应用,对智能电视说看花千骨电视剧第十集,智能电视等待3分钟显示花千骨的新闻、电视剧以及电影等等一堆的信息,并没有直接播放花千骨的电视剧。又例如,小美在昨天就下载好花千骨的电视剧第一集在智能电视本地,今天,云端服务器暂停服务,此时,小美说看花千骨第一集,智能电视提示当前云端服务器无法连接,下载到本地的花千骨第一集也无法播放,造成小美困惑。现有技术中,存在语音控制效率较低的问题。With the rapid development of smart TV technology, the voice control of smart TV is becoming more and more popular. Users only need to directly speak the favorite programs in front of the smart TV. Smart TV can return the user's needs to the page of the smart TV through semantic recognition. No need for users to find remote controls everywhere. However, in the prior art, the semantic recognition is completed based on a cloud-sized database. After receiving the voice command of the user, the smart TV transmits the voice command of the user to the cloud, and the cloud performs a large number of search and match, and often needs to wait very much. For a long time, the smart TV end can present the result of semantic recognition for the user. In addition, semantic recognition will not be completed when the smart TV is not connected to the cloud server. For example, Xiao Zhang opened the video application of iQiyi, and said that the smart TV said that the 10th episode of Huaqian TV series, the smart TV waited for 3 minutes to display a bunch of information, such as news, TV series and movies, etc. Play a TV show with thousands of bones. For another example, Xiaomei downloaded the first episode of the TV series that was spent on the smart TV local. Yesterday, the cloud server was suspended. At this time, Xiaomei said that the first episode of the flower bones, the smart TV prompts the current cloud server. Unable to connect, the first set of flowers and bones downloaded to the local can not be played, causing little beauty confusion. In the prior art, there is a problem that voice control efficiency is low.
发明内容Summary of the invention
本发明的主要目的在于提供一种语音控制方法及系统,旨在提高语音控制的效率。The main object of the present invention is to provide a voice control method and system aiming at improving the efficiency of voice control.
为实现上述目的,本发明提供一种语音控制方法,应用于智能电视,该语音控制方法包括以下步骤:To achieve the above object, the present invention provides a voice control method applied to a smart television, the voice control method comprising the following steps:
在接收到用户的语音指令时,所述智能电视提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
在验证通过时,所述智能电视获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;When the verification is passed, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息,并判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;Determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control, and determining whether the cloud server corresponding to the current application stores the to-be-executed object information;
在所述当前应用存储有所述待执行对象信息时,所述智能电视调用所述可执行控件执行所述待执行对象信息对应的执行对象;When the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information;
在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,所述智能电视输出提示信息。When the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information, the smart television outputs prompt information.
本发明还提供一种语音控制方法,应用于智能电视,该语音控制方法包括以下步骤:The invention also provides a voice control method, which is applied to a smart television, and the voice control method comprises the following steps:
在接收到用户的语音指令时,智能电视获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;Upon receiving the voice instruction of the user, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息;以及Determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control;
在所述当前应用存储有所述待执行对象信息时,所述智能电视调用所述可执行控件执行所述待执行对象信息对应的执行对象。When the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information.
优选地,在执行所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤同时,还执行以下步骤:Preferably, while performing the step of determining whether the current application stores the to-be-executed object information corresponding to the executable control, the smart TV further performs the following steps:
所述智能电视判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;Determining, by the smart TV, whether the cloud server corresponding to the current application stores the to-be-executed object information;
在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,所述智能电视输出提示信息。When the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information, the smart television outputs prompt information.
优选地,在所述当前应用为多个时,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤包括:Preferably, when the current application is multiple, the step of determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control comprises:
所述智能电视判断各所述当前应用是否存储有所述待执行对象信息;The smart television determines whether each of the current applications stores the to-be-executed object information;
对应的,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤之后,还包括:Correspondingly, after the step of determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control, the method further includes:
在至少有两个所述当前应用存储有所述待执行对象信息时,所述智能电视按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。When the at least two of the current applications store the to-be-executed object information, the smart TV displays the current application of the current application that stores the to-be-executed object information in descending order according to the running time of the current application. Executable controls for the user to choose to execute.
优选地,所述智能电视获取当前应用与所述语音指令匹配的可执行控件的步骤之前,还包括:Preferably, before the step of acquiring, by the smart TV, an executable control that currently matches the voice instruction, the smart television further includes:
在接收到用户的语音指令时,所述智能电视提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
在验证通过时,执行所述智能电视获取当前应用与所述语音指令匹配的可执行控件的步骤。When the verification is passed, the step of executing the smart TV to acquire an executable control that matches the current voice command is performed.
优选地,所述智能电视获取当前应用与所述语音指令匹配的可执行控件包括:Preferably, the smart TV acquiring the executable control that the current application matches the voice instruction comprises:
在接收到用户的语音指令时,所述智能电视将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
所述智能电视将所述第一文本信息与各所述第二文本信息进行比对;The smart television compares the first text information with each of the second text information;
所述智能电视将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
此外,为实现上述目的,本发明还提供一种语音控制系统,应用于智能电视,所述语音控制系统包括:In addition, in order to achieve the above object, the present invention further provides a voice control system, which is applied to a smart TV, and the voice control system includes:
获取模块,用于在接收到用户的语音指令时,获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;An acquiring module, configured to acquire, when the user's voice instruction is received, an executable control that matches a current application with the voice instruction, where the current application is an application running at the front end;
判断模块,用于判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息;a determining module, configured to determine whether the current application stores the to-be-executed object information corresponding to the executable control;
执行模块,用于在所述当前应用存储有所述待执行对象信息时,调用所述可执行控件执行所述待执行对象信息对应的执行对象。And an execution module, configured to: when the current application stores the to-be-executed object information, invoke the executable control to execute an execution object corresponding to the to-be-executed object information.
优选地,所述判断模块还用于判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;Preferably, the determining module is further configured to determine whether the cloud server corresponding to the current application stores the to-be-executed object information;
所述语音控制系统还包括提示模块,用于在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,输出提示信息。The voice control system further includes a prompting module, configured to output prompt information when the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information.
优选地,在所述当前应用为多个时,所述判断模块还用于判断各所述当前应用是否存储有所述待执行对象信息;Preferably, when the current application is multiple, the determining module is further configured to determine whether each of the current applications stores the to-be-executed object information;
所述语音控制系统还包括显示模块,用于在至少有两个所述当前应用存储有所述待执行对象信息时,按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。The voice control system further includes a display module, configured to display the to-be-executed object information in descending order according to the running time of the current application when at least two of the current applications store the to-be-executed object information The executable control of the current application for the user to select to execute.
优选地,所述语音控制系统还包括验证模块,用于在接收到用户的语音指令时,提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Preferably, the voice control system further includes a verification module, configured to extract an acoustic feature of the voice command upon receiving a voice instruction of the user, and perform a verification operation on the user according to the acoustic feature;
所述获取模块还用于在验证通过时,获取当前应用与所述语音指令匹配的可执行控件。The obtaining module is further configured to: when the verification passes, obtain an executable control that matches the current application with the voice instruction.
优选地,所述获取模块还用于在接收到用户的语音指令时,将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;以及将所述第一文本信息与各所述第二文本信息进行比对;以及将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。Preferably, the obtaining module is further configured to: when receiving the voice instruction of the user, convert the voice instruction into first text information, and collect second text information of the currently applied executable control; and A text message is compared with each of the second text information; and an executable control corresponding to the matched second text information is used as an executable control that matches the voice instruction.
本发明在应用于智能电视的播放控制时,在智能电视本地完成语义识别流程,并完成语音指令的响应。例如,小美在昨天就通过爱奇艺下载好花千骨的电视剧第一集在智能电视本地,今天开启爱奇艺后,小美对智能电视说“看花千骨第一集”,爱奇艺将直接播放本地存储的“花千骨第一集”,不需要智能电视与爱奇艺服务器的网络连接,相较于现有技术,避免了基于云端语义识别的高延迟,并能够在智能电视无网络连接的情况下完成语音控制,因此,本发明能够达到提高语音控制效率的目的。When applied to the playback control of the smart TV, the invention completes the semantic recognition process locally in the smart TV and completes the response of the voice command. For example, Xiaomei downloaded the first episode of the TV series that was spent on the smart TV through iQiyi yesterday. After opening the iQiyi today, Xiaomei said to the smart TV, "Look at the first episode of the flower bones", love Qiyi will directly play the local storage “Flower 1000 First Set”, which does not require the network connection between Smart TV and iQiyi server. Compared with the prior art, it avoids the high latency based on cloud semantic recognition and can The smart TV completes the voice control without the network connection, and therefore, the present invention can achieve the purpose of improving the voice control efficiency.
附图说明DRAWINGS
图1为本发明语音控制方法第一实施例的流程示意图;1 is a schematic flow chart of a first embodiment of a voice control method according to the present invention;
图2为本发明语音控制系统第一实施例的功能模块示意图。2 is a schematic diagram of functional modules of a first embodiment of a voice control system of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.
具体实施方式detailed description
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明提供一种语音控制方法,参照图1,在本发明语音控制方法的第一实施例中,该语音控制方法包括:The present invention provides a voice control method. Referring to FIG. 1, in a first embodiment of the voice control method of the present invention, the voice control method includes:
步骤S10,在接收到用户的语音指令时,智能电视获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;Step S10, when receiving the voice instruction of the user, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
需要说明的是,本实施例提供的语音控制方法可以应用于智能电视中,进一步的,应用于智能电视的播放控制中,例如,小美在昨天就通过爱奇艺下载好花千骨的电视剧第一集在智能电视本地,今天开启爱奇艺后,小美对智能电视说“看花千骨第一集”,爱奇艺将直接播放本地存储的“花千骨第一集”,不需要智能电视与爱奇艺服务器的网络连接。It should be noted that the voice control method provided in this embodiment can be applied to a smart TV, and further, is applied to a play control of a smart TV. For example, Xiaomei downloaded a well-funded TV drama through iQiyi yesterday. The first episode is in the local area of smart TV. After opening the iQiyi today, Xiaomei said to the smart TV that “the first episode of the flower and bones”, Iqiyi will directly play the “first collection of flowers and bones” in the local storage. A network connection between Smart TV and iQiyi server is required.
本实施例中,在接收到用户的语音指令时,智能电视获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用。需要说明的是,用户可通过多种方式向所述智能电视下达语音指令,例如,用户可以直接向智能电视说出语音指令“看花千骨第一集”;或者是用户触摸遥控器预设的用于语音控制的语音控制键,在用户说出语音指令“看花千骨第一集”后,遥控器将语音指令“看花千骨第一集”传输至智能电视。其中,在使用遥控器进行语音控制时,所述遥控器可与智能电视通过多种方式进行数据交互,至少包括蓝牙、Wi-Fi、红外以及ZigBee中的至少一种,例如,本实施例可采用红外通信的方式。In this embodiment, when receiving the voice instruction of the user, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end. It should be noted that the user can issue voice commands to the smart TV in various manners, for example, the user can directly speak the voice command “see the first set of flowers” to the smart TV; or the user touches the remote controller preset. The voice control button for voice control, after the user speaks the voice command "look at the first set of flowers", the remote controller transmits the voice command "the first set of flowers to the bones" to the smart TV. The remote controller can perform data interaction with the smart TV in a plurality of manners, including at least one of Bluetooth, Wi-Fi, infrared, and ZigBee. For example, in this embodiment, the remote controller can perform voice control. Adopt infrared communication.
具体的,智能电视在接收到用户的语音指令时,首先将接收的语音指令交由本地的语义识别引擎进行识别,以将语音指令转换为可供比对的文本信息。需要说明的是,智能电视在将接收的语音指令交由本地语义识别引擎进行识别的同时,还可将接收的语音指令传输至云端语义识别引擎进行识别;若先接收到云端语义识别引擎反馈的文本信息,则将云端语义识别引擎反馈的文本信息作为所述语音指令的识别结果;由于在网络环境不好的情况下,云端语义识别引擎的识别结果可能有相当大的延迟,若先接收到本地语义识别引擎反馈的文本信息,且本地语义识别引擎反馈的文本信息的置信度大于预设阈值时,则将本地语义识别引擎反馈的文本信息作为所述语音指令的识别结果。其中,本实施例并不限定本地语义识别引擎和云端语义识别引擎采用何种语音识别技术,具体可按实际需要选择。Specifically, when receiving the voice instruction of the user, the smart television first hands the received voice command to the local semantic recognition engine to convert the voice command into the text information that can be compared. It should be noted that, while the smart TV transmits the received voice command to the local semantic recognition engine for identification, the received voice command can also be transmitted to the cloud semantic recognition engine for recognition; if the cloud semantic recognition engine feedback is received first, The text information is used as the recognition result of the voice instruction by the cloud semantic recognition engine; because the network semantic environment is not good, the recognition result of the cloud semantic recognition engine may have a considerable delay, if received first When the local semantic recognition engine feeds back the text information, and the confidence of the text information fed back by the local semantic recognition engine is greater than a preset threshold, the text information fed back by the local semantic recognition engine is used as the recognition result of the voice instruction. The present embodiment does not limit the voice recognition technology used by the local semantic recognition engine and the cloud semantic recognition engine, and may be selected according to actual needs.
此外,所述智能电视在进行所述语音指令的语义识别的同时,还获取当前应用的场景信息,其中,获取的所述场景信息包括第一类场景信息和第二类场景信息,所述第一类场景信息用于标识当前应用的类型,如视频应用类型ID为1,杂志类应用类型ID为2,游戏类应用类型ID为3;所述第二类场景信息为各类应用的关键词,如影视类的电视剧名称等等。例如,智能电视获取到当前应用的第一类场景信息YU_1YI_Data(x1)=1,获取到当前应用的第二类场景信息YU_2YI_Data(x1)=yingshi。在获取到当前应用的场景信息之后,所述智能电视读取所述当前应用的包名,并将获取的所述场景信息与所述包名关联后存储至预设的存储区11中。同时,所述智能电视还调用界面控件信息收集算法,收集当前应用所在界面的控件信息,按照控件的类型将收集的控件信息分类保存至预设的存储区22中,再根据存储区22中的控件信息将所述当前应用的可执行控件筛选出来,并构建分类控件及对应的文本信息列表(如“播放”,“花千骨”)。In addition, the smart television acquires the scene information of the current application while performing the semantic recognition of the voice instruction, where the acquired scene information includes the first type of scene information and the second type of scene information, where the A type of scene information is used to identify the type of the current application, such as a video application type ID of 1, a magazine application type ID of 2, and a game application type ID of 3; the second type of scene information is a keyword of various applications. , such as the TV drama name of the film and so on. For example, the smart TV acquires the first type of scene information YU_1YI_Data(x1)=1 of the current application, and acquires the second type of scene information YU_2YI_Data(x1)=yingshi of the current application. After acquiring the scene information of the current application, the smart TV reads the package name of the current application, and associates the acquired scene information with the package name and stores the information in the preset storage area 11. At the same time, the smart TV also calls the interface control information collection algorithm to collect the control information of the interface where the current application is located, and saves the collected control information into the preset storage area 22 according to the type of the control, and then according to the storage area 22 The control information filters out the executable control of the current application, and constructs a classification control and a corresponding text information list (such as "play", "flowers").
然后,所述智能电视将所述语音指令对应的文本信息与前述分类控件及对应的文本信息列表中的文本信息进行比对,将文本信息相同的可执行控件作为所述语音指令匹配的可执行控件。需要说明的是,文本信息在智能电视本地是以编码的形式存储的,如英文字符使用ASCII码编码后存储,中文字符使用unicode码编码后存储,相应的,本实施例在进行语音指令与可执行控件的匹配时,基于ASCII码进行英文字符的匹配,基于unicode码进行中文字符的匹配。例如,编码后的Data_String(x1)=\u82b1\u5343\u9aa8\u000d\u000a,其对应的中文字符为“花千骨”。Then, the smart TV compares the text information corresponding to the voice instruction with the text information in the foregoing classification control and the corresponding text information list, and executes the executable control with the same text information as the executable of the voice instruction. Control. It should be noted that the text information is stored in the form of encoding in the smart television. For example, the English characters are stored in ASCII code and stored, and the Chinese characters are encoded and stored in the unicode code. Correspondingly, the voice command and the voice command can be performed in this embodiment. When the control is matched, the English characters are matched based on the ASCII code, and the Chinese characters are matched based on the unicode code. For example, the encoded Data_String(x1)=\u82b1\u5343\u9aa8\u000d\u000a, and its corresponding Chinese character is “Flower Thousand Bone”.
步骤S20,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息;Step S20: The smart TV determines whether the current application stores the to-be-executed object information corresponding to the executable control.
本实施例中,在获取到当前应用与所述语音指令匹配的可执行控件之后,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息。需要说明的是,所述智能电视预先为已安装的应用分别划分有不同的数据存储区。In this embodiment, after acquiring the executable control that matches the current voice command, the smart TV determines whether the current application stores the to-be-executed object information corresponding to the executable control. It should be noted that the smart TV is divided into different data storage areas for the installed applications.
具体的,以智能电视前端运行的当前应用为爱奇艺为例,当用户下达语音指令“看花千骨”时,所述智能电视获取到当前应用的包名为“iqiyi”,识别当前应用为爱奇艺,并获取到与语音指令“看花千骨”匹配的可执行控件为爱奇艺当前所在界面对应“花千骨”的播放按键,智能电视进一步检索爱奇艺对应的数据存储区是否存储有“花千骨”(即待执行对象)的名称数据(即待执行对象信息)。其中,所述智能电视在检索时,先读取爱奇艺对应的数据存储区中的名称数据到存储区33中,然后基于ASCII码进行英文字符的匹配,基于unicode码进行中文字符的匹配。例如,若检索到名称数据Data_String(x1)=\u82b1\u5343\u9aa8\u000d\u000a(Unicode对应中文字符“花千骨”),即爱奇艺(所述当前应用)存储有所述可执行控件(对应“花千骨”的播放按键)对应的待执行对象信息。Specifically, the current application running on the front end of the smart TV is an example of iQiyi. When the user issues a voice command “seeing a thousand bones”, the smart TV obtains the current application package name “iqiyi”, and identifies the current application. For the iQiyi, and obtain the executable control that matches the voice command "Looking at the Thousand Bone", the play button corresponding to the "Flower Thousand Bone" currently in the interface of iQiyi, the smart TV further retrieves the data storage corresponding to iQiyi. Whether the area stores the name data (ie, the object to be executed) of the "flowers to be executed" (ie, the object to be executed). The smart TV first reads the name data in the data storage area corresponding to the iQiyi to the storage area 33, and then matches the English characters based on the ASCII code, and matches the Chinese characters based on the unicode code. For example, if the name data Data_String(x1)=\u82b1\u5343\u9aa8\u000d\u000a is retrieved (Unicode corresponds to the Chinese character "Hua Qian Bone"), ie, iQiyi (the current application) stores the executable The object to be executed corresponding to the control (corresponding to the play button of "Flower Thousand Bone").
步骤S30,在所述当前应用存储有所述待执行对象信息时,所述智能电视调用所述可执行控件执行所述待执行对象信息对应的执行对象。Step S30: When the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information.
本领域技术人员可以理解的是,在存储有所述可执行控件对应的待执行对象信息时,说明本地存在所述可执行控件对应的可执行对象,例如,前述智能电视在检索可执行对象信息“花千骨”时,若检索到,则说明本地存储有“花千骨”的视频数据。本实施例中,在所述当前应用存储有所述待执行对象信息时,所述智能电视调用所述可执行控件执行所述待执行对象信息对应的执行对象,例如,所述智能电视在检索到可执行对象信息“花千骨”时,则直接播放“花千骨”的视频数据。It can be understood by those skilled in the art that when the to-be-executed object information corresponding to the executable control is stored, the executable object corresponding to the executable control exists locally, for example, the smart TV is retrieving the executable object information. When "flowers are spent", if it is retrieved, it means that the video data of "Flower Thousand Bone" is stored locally. In this embodiment, when the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information, for example, the smart television is searching. When the executable object information "flowers and bones" is displayed, the video data of "Flower Thousand Bone" is directly played.
本实施例提出的语音控制方法,在应用于智能电视的播放控制时,在智能电视本地完成语义识别流程,并完成语音指令的响应。例如,小美在昨天就通过爱奇艺下载好花千骨的电视剧第一集在智能电视本地,今天开启爱奇艺后,小美对智能电视说“看花千骨第一集”,爱奇艺将直接播放本地存储的“花千骨第一集”,不需要智能电视与爱奇艺服务器的网络连接,相较于现有技术,避免了基于云端语义识别的高延迟,并能够在智能电视无网络连接的情况下完成语音控制,因此,本发明能够达到提高语音控制效率的目的。同时,由于本发明在智能电视本地进行语义识别,还能够避免语音控制对网络带宽的占用。The voice control method proposed in this embodiment, when applied to the play control of the smart TV, completes the semantic recognition process locally on the smart TV and completes the response of the voice command. For example, Xiaomei downloaded the first episode of the TV series that was spent on the smart TV through iQiyi yesterday. After opening the iQiyi today, Xiaomei said to the smart TV, "Look at the first episode of the flower bones", love Qiyi will directly play the local storage “Flower 1000 First Set”, which does not require the network connection between Smart TV and iQiyi server. Compared with the prior art, it avoids the high latency based on cloud semantic recognition and can The smart TV completes the voice control without the network connection, and therefore, the present invention can achieve the purpose of improving the voice control efficiency. At the same time, since the present invention performs semantic recognition locally on the smart TV, it can also avoid the occupation of network bandwidth by voice control.
进一步的,基于第一实施例,提出本发明语音控制方法的第二实施例,在本实施例中,在执行所述步骤S20的同时,还执行以下步骤:Further, based on the first embodiment, a second embodiment of the voice control method of the present invention is proposed. In this embodiment, while performing the step S20, the following steps are also performed:
所述智能电视判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;Determining, by the smart TV, whether the cloud server corresponding to the current application stores the to-be-executed object information;
在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,所述智能电视输出提示信息。When the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information, the smart television outputs prompt information.
本实施例中,为确保正确响应用户的语音指令,所述智能电视在将用户的语音指令转换为文本信息,并根据所述文本信息获取到当前应用与所述语音指令匹配的可执行控件后,不仅判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息,还同时判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息,以在所述当前应用未存储有所述待执行对象信息时,能够根据所述当前应用对应的云端服务器存储的所述待执行对象信息获取到待执行对象。In this embodiment, in order to ensure correct response to the user's voice command, the smart TV converts the user's voice command into text information, and obtains an executable control that matches the current voice command according to the text information. And determining whether the current application stores the to-be-executed object information corresponding to the executable control, and determining whether the cloud server corresponding to the current application stores the to-be-executed object information, so that the current application is not When the to-be-executed object information is stored, the object to be executed can be acquired according to the to-be-executed object information stored by the cloud server corresponding to the current application.
具体的,以智能电视前端运行的当前应用为爱奇艺为例,当用户下达语音指令“看花千骨”时,所述智能电视获取到当前应用的包名为“iqiyi”,识别当前应用为爱奇艺,并获取到与语音指令“看花千骨”匹配的可执行控件为爱奇艺当前所在界面对应“花千骨”的播放按键,智能电视进一步检索爱奇艺对应的数据存储区是否存储有“花千骨”(即待执行对象)的名称数据(即待执行对象信息),具体可参照第一实施例,此处不再赘述。同时,所述智能电视将文本信息“花千骨”发送至爱奇艺对应的云端服务器,由所述云端服务器根据接收的文本信息“花千骨”进行检索,并向所述智能电视反馈检索结果。所述智能电视在接收到所述云端服务器反馈的检索结果时,根据所述检索结果判断所述云端服务器是否存储有所述待执行对象信息。例如,所述云端服务器返回的检索结果为:云端当前存储有“花千骨”的电影以及电视剧等,此时,若所述智能电视未在爱奇艺对应的数据存储区检索到“花千骨”的名称数据,则所述智能电视输出提示信息:云端有“花千骨”的电视剧以及电影等可供播放,是否播放?由用户根据所述提示信息的显示界面确认是否播放,以及播放什么。Specifically, the current application running on the front end of the smart TV is an example of iQiyi. When the user issues a voice command “seeing a thousand bones”, the smart TV obtains the current application package name “iqiyi”, and identifies the current application. For the iQiyi, and obtain the executable control that matches the voice command "Looking at the Thousand Bone", the play button corresponding to the "Flower Thousand Bone" currently in the interface of iQiyi, the smart TV further retrieves the data storage corresponding to iQiyi. For example, the name data of the object to be executed (that is, the object to be executed) is stored in the area. For details, refer to the first embodiment, and details are not described herein again. At the same time, the smart TV sends the text information “Flower Thousand Bone” to the cloud server corresponding to iQiyi, and the cloud server searches according to the received text information “Hua Qian Bone”, and feeds back to the smart TV. result. When receiving the search result fed back by the cloud server, the smart TV determines, according to the search result, whether the cloud server stores the to-be-executed object information. For example, the search result returned by the cloud server is: a movie in which the cloud currently stores "flowers and bones", a television drama, etc., at this time, if the smart TV does not retrieve "flowers" in the data storage area corresponding to iQiyi The name data of the bone, the smart TV output prompt message: the TV series with the "Flower Thousand Bones" and the movie can be played in the cloud, is it played? The user confirms whether to play according to the display interface of the prompt information, and what to play.
进一步的,基于第一实施例,提出本发明语音控制方法的第三实施例,在本实施例中,在所述当前应用为多个时,上述步骤S20包括:Further, based on the first embodiment, a third embodiment of the voice control method of the present invention is proposed. In this embodiment, when the current application is multiple, the foregoing step S20 includes:
所述智能电视判断各所述当前应用是否存储有所述待执行对象信息;The smart television determines whether each of the current applications stores the to-be-executed object information;
对应的,上述步骤S20之后,还包括:Correspondingly, after the step S20, the method further includes:
在至少有两个所述当前应用存储有所述待执行对象信息时,所述智能电视按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。When the at least two of the current applications store the to-be-executed object information, the smart TV displays the current application of the current application that stores the to-be-executed object information in descending order according to the running time of the current application. Executable controls for the user to choose to execute.
需要说明的是,随着多任务机制的不断发展,目前,基于安卓系统的智能电视已经支持同时在前端运行多个应用,例如,智能电视在前端同时运行爱奇艺以及优酷,所述智能电视将屏幕划分为不同的显示区域,分别显示爱奇艺界面以及优酷界面,用户可以同时在爱奇艺以及优酷进行操作。本实施例中,在所述当前应用为多个时,所述智能电视判断各所述当前应用是否存储有所述待执行对象信息,即所述智能电视判断各所述当前应用对应的数据存储区是否存储有所述待执行对象信息,具体可参照前述实施例,此处不再赘述。It should be noted that with the continuous development of the multi-tasking mechanism, at present, the smart TV based on the Android system has already supported running multiple applications at the front end, for example, the smart TV runs both iQiyi and Youku at the front end, the smart TV Divide the screen into different display areas, respectively display the iQiyi interface and Youku interface, users can operate at both iQiyi and Youku. In this embodiment, when the current application is multiple, the smart TV determines whether each of the current applications stores the to-be-executed object information, that is, the smart television determines data storage corresponding to each current application. The information about the to-be-executed object is stored in the area. For details, refer to the foregoing embodiment, and details are not described herein again.
在至少有两个所述当前应用存储有所述待执行对象信息时,所述智能电视获取存储有所述待执行对象信息的当前应用的运行时长,并按照获取的运行时长,降序显示存储有所述待执行对象信息的当前应用的所述可执行控件,以供用户选择执行。例如,当用户对智能电视下达语音指令“看花千骨”时,所述智能电视获取当前应用的场景信息,识别当前在前端运行的应用为爱奇艺和优酷,并进一步识别发现爱奇艺和优酷各自对应的数据存储区中均存储有“花千骨”的名称数据,此时,所述智能电视获取到爱奇艺的运行时长为30分钟,获取到优酷的运行时长为20分钟,则所述智能电视将爱奇艺对应“花千骨”的播放按键排在优酷对应“花千骨”的播放按键之前显示,方便用户选择是采用爱奇艺播放“花千骨”,还是采用优酷播放“花千骨”。When at least two of the current applications store the to-be-executed object information, the smart TV acquires a running time of a current application that stores the to-be-executed object information, and displays the stored in descending order according to the acquired running time. The executable control of the current application of the object information to be executed is selected for execution by a user. For example, when the user gives a voice command to the smart TV, the smart TV acquires the scene information of the current application, identifies the application currently running on the front end as iQiyi and Youku, and further identifies and finds the iQiyi. The data storage area corresponding to each of Youku stores the name data of “Hua Qian Bone”. At this time, the smart TV acquires the running time of iQiyi for 30 minutes, and the running time of Youku is 20 minutes. Then, the smart TV displays the play button of the iQiyi corresponding to the “Hua Qian Bone” in front of the play button of Youku corresponding to “Hua Qian Bone”, which is convenient for the user to select “IQian bone” by using iQiyi, or adopt Youku plays "Flower Thousands of Bone".
进一步的,基于前述任一实施例,提出本发明语音控制方法的第四实施例,在本实施例中,上述步骤S10之前,还包括:Further, based on any of the foregoing embodiments, a fourth embodiment of the voice control method of the present invention is provided. In the embodiment, before the step S10, the method further includes:
在接收到用户的语音指令时,所述智能电视提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
在验证通过时,执行步骤S10。When the verification is passed, step S10 is performed.
需要说明的是,本实施例与前述实施例的区别在于,本实施例在语音控制的过程中加入了用户认证操作,只有通过认证操作的使用者才能完成对智能电视的语音控制。本实施例中,所述智能电视在接收到用户的语音指令时,提取所述语音指令的声学特征,其中,可提取的声学特征包括LPC(线性预测系数)、MFCC(Mel倒谱系数)以及PLP(感知线性预测)中的至少一种,具体可按实际需要进行选择。It should be noted that the difference between this embodiment and the foregoing embodiment is that the user authentication operation is added in the process of voice control, and only the user who performs the authentication operation can complete the voice control of the smart TV. In this embodiment, the smart television extracts an acoustic feature of the voice instruction when receiving a voice instruction of the user, wherein the extractable acoustic features include LPC (Linear Prediction Coefficient), MFCC (Mel Cepstrum Coefficient), and At least one of PLP (Perceptual Linear Prediction) can be selected according to actual needs.
此外,本实施例预设有声学特征数据库,智能电视机主可以将预先将自己的声学特征录入所述声学特征数据库中,也可以将自己亲朋好友或者他人的声学特征录入所述声学特征数据库中。所述智能电视在提取到所述语音指令的声学特征之后,将提取的所述声学特征与预设的声学特征数据库中的各个声学特征进行比对,以完成对用户的验证操作,其中,若声学特征数据库中存在匹配项,则验证通过,说明发出语音指令的用户为机主或者机主许可的用户,此时所述智能电视获取当前应用与所述语音指令匹配的可执行控件,开始语音控制流程,具体可参照前述实施例,此处不再赘述;若声学特征数据库中不存在匹配项,则验证失败,说明发出语音指令的用户为非法用户,此时丢弃接收的的语音指令,不进行语音控制流程。In addition, the embodiment is pre-set with an acoustic feature database, and the smart TV master can record its own acoustic features into the acoustic feature database in advance, and can also record the acoustic features of friends, relatives or others into the acoustic feature database. . After extracting the acoustic features of the voice command, the smart television compares the extracted acoustic features with respective acoustic features in a preset acoustic feature database to complete a verification operation on the user, wherein If there is a match in the acoustic feature database, the verification passes, indicating that the user who issued the voice instruction is the user authorized by the owner or the owner, and the smart TV acquires the executable control that matches the current voice instruction, and starts the voice. For the control flow, refer to the foregoing embodiment, and details are not described herein. If there is no matching item in the acoustic feature database, the verification fails, indicating that the user who issued the voice command is an illegal user, and the received voice command is discarded at this time. Conduct a voice control process.
本实施例通过在语音控制流程中加入了对用户的验证操作,能够提高语音控制的安全性。In this embodiment, the security of the voice control can be improved by adding a verification operation to the user in the voice control flow.
进一步的,基于前述任一实施例,提出本发明语音控制方法的第五实施例,在本实施例中,上述步骤S10包括:Further, based on any of the foregoing embodiments, a fifth embodiment of the voice control method of the present invention is proposed. In this embodiment, the foregoing step S10 includes:
在接收到用户的语音指令时,所述智能电视将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
所述智能电视将所述第一文本信息与各所述第二文本信息进行比对;The smart television compares the first text information with each of the second text information;
所述智能电视将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
本实施例中,用户可通过多种方式向所述智能电视下达语音指令,例如,用户可以直接向智能电视说出语音指令“看花千骨第一集”;或者是用户触摸遥控器预设的用于语音控制的语音控制键,在用户说出语音指令“看花千骨第一集”后,遥控器将语音指令“看花千骨第一集”传输至智能电视。其中,在使用遥控器进行语音控制时,所述遥控器可与智能电视通过多种方式进行数据交互,至少包括蓝牙、Wi-Fi、红外以及ZigBee中的至少一种,例如,本实施可采用红外通信的方式。In this embodiment, the user can issue a voice instruction to the smart TV in multiple manners. For example, the user can directly speak the voice command “see the first set of flowers” to the smart TV; or the user touches the remote controller preset. The voice control button for voice control, after the user speaks the voice command "look at the first set of flowers", the remote controller transmits the voice command "the first set of flowers to the bones" to the smart TV. The remote controller can perform data interaction with the smart TV in a plurality of manners, including at least one of Bluetooth, Wi-Fi, infrared, and ZigBee. For example, the implementation may be performed by using a remote controller for voice control. The way of infrared communication.
具体的,智能电视在接收到用户的语音指令时,首先将接收的语音指令交由本地的语义识别引擎进行识别,以将语音指令转换为可供比对的第一文本信息。需要说明的是,智能电视在将接收的语音指令交由本地语义识别引擎进行识别的同时,还可将接收的语音指令传输至云端语义识别引擎进行识别;若先接收到云端语义识别引擎反馈的文本信息,则将云端语义识别引擎反馈的文本信息作为所述语音指令的识别结果;由于在网络环境不好的情况下,云端语义识别引擎的识别结果可能有相当大的延迟,若先接收到本地语义识别引擎反馈的文本信息,且本地语义识别引擎反馈的文本信息的置信度大于预设阈值时,将本地语义识别引擎反馈的文本信息作为所述语音指令的识别结果。其中,本实施例并不限定本地语义识别引擎和云端语义识别引擎采用何种语音识别技术,具体可按实际需要选择。Specifically, when receiving the voice instruction of the user, the smart television first hands the received voice command to the local semantic recognition engine for converting the voice command into the first text information that can be compared. It should be noted that, while the smart TV transmits the received voice command to the local semantic recognition engine for identification, the received voice command can also be transmitted to the cloud semantic recognition engine for recognition; if the cloud semantic recognition engine feedback is received first, The text information is used as the recognition result of the voice instruction by the cloud semantic recognition engine; because the network semantic environment is not good, the recognition result of the cloud semantic recognition engine may have a considerable delay, if received first The local semantic recognition engine feeds back the text information, and when the confidence of the text information fed back by the local semantic recognition engine is greater than a preset threshold, the text information fed back by the local semantic recognition engine is used as the recognition result of the voice instruction. The present embodiment does not limit the voice recognition technology used by the local semantic recognition engine and the cloud semantic recognition engine, and may be selected according to actual needs.
所述智能电视在进行所述语音指令的语义识别的同时,还获取当前应用的场景信息,其中,获取的所述场景信息包括第一类场景信息和第二类场景信息,所述第一类场景信息用于标识当前应用的类型,如视频应用类型ID为1,杂志类应用类型ID为2,游戏类应用类型ID为3;所述第二类场景信息为各类应用的关键词,如影视类的电视剧名称等等。例如,智能电视获取到当前应用的第一类场景信息YU_1YI_Data(x1)=1,获取到当前应用的第二类场景信息YU_2YI_Data(x1)=yingshi。在获取到当前应用的场景信息之后,所述智能电视读取所述当前应用的包名,并将获取的所述场景信息与所述包名关联后存储至预设的存储区11中。此外,所述智能电视还调用界面控件信息收集算法,收集当前应用所在界面的控件信息,按照控件的类型将收集的控件信息分类保存至预设的存储区22中,再根据存储区22中的控件信息将所述当前应用的可执行控件筛选出来,并构建分类控件及对应的文本信息列表(如“播放”,“花千骨”)。The smart TV obtains the scene information of the current application while performing the semantic recognition of the voice instruction, where the acquired scene information includes the first type of scene information and the second type of scene information, the first type The scenario information is used to identify the type of the current application, such as a video application type ID of 1, a magazine application type ID of 2, and a game application type ID of 3; the second type of scene information is a keyword of various applications, such as TV drama names and so on. For example, the smart TV acquires the first type of scene information YU_1YI_Data(x1)=1 of the current application, and acquires the second type of scene information YU_2YI_Data(x1)=yingshi of the current application. After acquiring the scene information of the current application, the smart TV reads the package name of the current application, and associates the acquired scene information with the package name and stores the information in the preset storage area 11. In addition, the smart TV also invokes an interface control information collection algorithm to collect control information of the interface where the current application is located, and saves the collected control information into the preset storage area 22 according to the type of the control, and then according to the storage area 22 The control information filters out the executable control of the current application, and constructs a classification control and a corresponding text information list (such as "play", "flowers").
然后,所述智能电视将所述语音指令对应的第一文本信息与前述分类控件及对应的文本信息列表中的第二文本信息进行比对,将第二文本信息与第一文本信息匹配的可执行控件作为所述语音指令匹配的可执行控件。需要说明的是,文本信息在智能电视本地是以编码的形式存储的,如英文字符使用ASCII码编码后存储,中文字符使用unicode码编码后存储,相应的,本实施例在进行语音指令与可执行控件的匹配时,基于ASCII码进行英文字符的匹配,基于unicode码进行中文字符的匹配。例如,编码后的Data_String(x1)=\u82b1\u5343\u9aa8\u000d\u000a,其对应的中文字符为“花千骨”。Then, the smart television compares the first text information corresponding to the voice instruction with the second text information in the foregoing classification control and the corresponding text information list, and matches the second text information with the first text information. The execution control acts as an executable control that matches the voice instruction. It should be noted that the text information is stored in the form of encoding in the smart television. For example, the English characters are stored in ASCII code and stored, and the Chinese characters are encoded and stored in the unicode code. Correspondingly, the voice command and the voice command can be performed in this embodiment. When the control is matched, the English characters are matched based on the ASCII code, and the Chinese characters are matched based on the unicode code. For example, the encoded Data_String(x1)=\u82b1\u5343\u9aa8\u000d\u000a, and its corresponding Chinese character is “Flower Thousand Bone”.
需要说明的是,本发明上述各实施例中匹配是指二比较者相同或者相似度达到预设阈值,其中,所述预设阈值可按实际需要进行选取,例如,可以设置为85%。It should be noted that the matching in the foregoing embodiments of the present invention means that the two comparators are the same or the similarity reaches a preset threshold, wherein the preset threshold may be selected according to actual needs, for example, may be set to 85%.
本发明还提供一种语音控制系统,参照图2,在本发明语音控制系统的第一实施例中,所述语音控制系统包括:The present invention also provides a voice control system. Referring to FIG. 2, in a first embodiment of the voice control system of the present invention, the voice control system includes:
获取模块10,用于在接收到用户的语音指令时,获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;The obtaining module 10 is configured to: when receiving the voice instruction of the user, acquire an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
判断模块20,用于判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息;The determining module 20 is configured to determine whether the current application stores the to-be-executed object information corresponding to the executable control;
执行模块30,用于在所述当前应用存储有所述待执行对象信息时,调用所述可执行控件执行所述待执行对象信息对应的执行对象。The execution module 30 is configured to invoke the executable control to execute an execution object corresponding to the to-be-executed object information when the current application stores the to-be-executed object information.
进一步的,基于第一实施例,提出本发明语音控制系统的第二实施例,在本实施例中,所述判断模块20还用于判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;Further, based on the first embodiment, a second embodiment of the voice control system of the present invention is proposed. In this embodiment, the determining module 20 is further configured to determine whether the cloud server corresponding to the current application stores the to-be-stored Execution object information;
所述语音控制系统还包括提示模块,用于在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,输出提示信息。The voice control system further includes a prompting module, configured to output prompt information when the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information.
进一步的,基于第一实施例,提出本发明语音控制系统的第三实施例,在本实施例中,在所述当前应用为多个时,所述判断模块20还用于判断各所述当前应用是否存储有所述待执行对象信息;Further, based on the first embodiment, a third embodiment of the voice control system of the present invention is proposed. In this embodiment, when the current application is multiple, the determining module 20 is further configured to determine each of the current Whether the application stores the to-be-executed object information;
所述语音控制系统还包括显示模块,用于在至少有两个所述当前应用存储有所述待执行对象信息时,按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。The voice control system further includes a display module, configured to display the to-be-executed object information in descending order according to the running time of the current application when at least two of the current applications store the to-be-executed object information The executable control of the current application for the user to select to execute.
进一步的,基于前述任一实施例,提出本发明语音控制系统的第四实施例,在本实施例中,所述语音控制系统还包括验证模块,用于在接收到用户的语音指令时,提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Further, based on any of the foregoing embodiments, a fourth embodiment of the voice control system of the present invention is provided. In this embodiment, the voice control system further includes a verification module, configured to: when receiving the voice command of the user, extract An acoustic feature of the voice command, and performing a verification operation on the user according to the acoustic feature;
所述获取模块10还用于在验证通过时,获取当前应用与所述语音指令匹配的可执行控件。The obtaining module 10 is further configured to: when the verification passes, obtain an executable control that matches the current application with the voice instruction.
进一步的,基于前述任一实施例,提出本发明语音控制系统的第五实施例,在本实施例中,所述获取模块10还用于在接收到用户的语音指令时,将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;以及将所述第一文本信息与各所述第二文本信息进行比对;以及将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。Further, based on any of the foregoing embodiments, a fifth embodiment of the voice control system of the present invention is proposed. In this embodiment, the acquiring module 10 is further configured to: when receiving a voice command of a user, the voice command. Converting to the first text information, and collecting second text information of the currently applied executable control; and comparing the first text information with each of the second text information; and matching the matched second text information The executable control acts as an executable control that matches the voice instruction.
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术邻域,均同理包括在本发明的专利保护范围内。The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technical neighbors. The domains are all included in the scope of patent protection of the present invention.

Claims (20)

  1. 一种语音控制方法,应用于智能电视,其特征在于,所述语音控制方法包括以下步骤: A voice control method is applied to a smart television, characterized in that the voice control method comprises the following steps:
    在接收到用户的语音指令时,所述智能电视提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
    在验证通过时,所述智能电视获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;When the verification is passed, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
    所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息,并判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息; Determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control, and determining whether the cloud server corresponding to the current application stores the to-be-executed object information;
    在所述当前应用存储有所述待执行对象信息时,所述智能电视调用所述可执行控件执行所述待执行对象信息对应的执行对象;When the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information;
    在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,所述智能电视输出提示信息。When the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information, the smart television outputs prompt information.
  2. 一种语音控制方法,应用于智能电视,其特征在于,所述语音控制方法包括以下步骤:A voice control method is applied to a smart television, characterized in that the voice control method comprises the following steps:
    在接收到用户的语音指令时,智能电视获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;Upon receiving the voice instruction of the user, the smart TV acquires an executable control that matches the current application with the voice instruction, where the current application is an application running at the front end;
    所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息;以及Determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control;
    在所述当前应用存储有所述待执行对象信息时,所述智能电视调用所述可执行控件执行所述待执行对象信息对应的执行对象。When the current application stores the to-be-executed object information, the smart TV invokes the executable control to execute an execution object corresponding to the to-be-executed object information.
  3. 如权利要求2所述的语音控制方法,其特征在于,在执行所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤同时,还执行以下步骤:The voice control method according to claim 2, wherein the step of performing the smart television to determine whether the current application stores the to-be-executed object information corresponding to the executable control, and performing the following steps:
    所述智能电视判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;Determining, by the smart TV, whether the cloud server corresponding to the current application stores the to-be-executed object information;
    在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,所述智能电视输出提示信息。When the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information, the smart television outputs prompt information.
  4. 如权利要求2所述的语音控制方法,其特征在于,在所述当前应用为多个时,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤包括:The voice control method according to claim 2, wherein when the current application is multiple, the smart television determines whether the current application stores the to-be-executed object information corresponding to the executable control. include:
    所述智能电视判断各所述当前应用是否存储有所述待执行对象信息;The smart television determines whether each of the current applications stores the to-be-executed object information;
    对应的,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤之后,还包括:Correspondingly, after the step of determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control, the method further includes:
    在至少有两个所述当前应用存储有所述待执行对象信息时,所述智能电视按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。When the at least two of the current applications store the to-be-executed object information, the smart TV displays the current application of the current application that stores the to-be-executed object information in descending order according to the running time of the current application. Executable controls for the user to choose to execute.
  5. 如权利要求2所述的语音控制方法,其特征在于,所述智能电视获取当前应用与所述语音指令匹配的可执行控件的步骤之前,还包括:The voice control method according to claim 2, further comprising: before the step of acquiring, by the smart TV, an executable control that matches the voice command;
    在接收到用户的语音指令时,所述智能电视提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
    在验证通过时,执行所述智能电视获取当前应用与所述语音指令匹配的可执行控件的步骤。When the verification is passed, the step of executing the smart TV to acquire an executable control that matches the current voice command is performed.
  6. 如权利要求4所述的语音控制方法,其特征在于,所述智能电视获取当前应用与所述语音指令匹配的可执行控件的步骤之前,还包括:The voice control method according to claim 4, further comprising: before the step of acquiring, by the smart TV, an executable control that matches the voice command;
    在接收到用户的语音指令时,所述智能电视提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;Upon receiving the voice command of the user, the smart television extracts an acoustic feature of the voice command and performs a verification operation on the user according to the acoustic feature;
    在验证通过时,执行所述智能电视获取当前应用与所述语音指令匹配的可执行控件的步骤。When the verification is passed, the step of executing the smart TV to acquire an executable control that matches the current voice command is performed.
  7. 如权利要求2所述的语音控制方法,其特征在于,所述智能电视获取当前应用与所述语音指令匹配的可执行控件包括:The voice control method according to claim 2, wherein the smart TV acquires executable controls that match the current application with the voice command, including:
    在接收到用户的语音指令时,所述智能电视将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
    所述智能电视将所述第一文本信息与各所述第二文本信息进行比对;The smart television compares the first text information with each of the second text information;
    所述智能电视将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
  8. 如权利要求3所述的语音控制方法,其特征在于,所述智能电视获取当前应用与所述语音指令匹配的可执行控件包括:The voice control method according to claim 3, wherein the smart TV acquires executable controls that match the current application with the voice command, including:
    在接收到用户的语音指令时,所述智能电视将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
    所述智能电视将所述第一文本信息与各所述第二文本信息进行比对;The smart television compares the first text information with each of the second text information;
    所述智能电视将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
  9. 如权利要求4所述的语音控制方法,其特征在于,所述智能电视获取当前应用与所述语音指令匹配的可执行控件包括:The voice control method according to claim 4, wherein the smart TV acquires executable controls that match the current application with the voice command, including:
    在接收到用户的语音指令时,所述智能电视将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
    所述智能电视将所述第一文本信息与各所述第二文本信息进行比对;The smart television compares the first text information with each of the second text information;
    所述智能电视将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
  10. 如权利要求5所述的语音控制方法,其特征在于,所述智能电视获取当前应用与所述语音指令匹配的可执行控件包括:The voice control method according to claim 5, wherein the smart TV acquires executable controls that match the current application with the voice command, including:
    在接收到用户的语音指令时,所述智能电视将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;Upon receiving the voice instruction of the user, the smart television converts the voice instruction into first text information, and collects second text information of the currently applied executable control;
    所述智能电视将所述第一文本信息与各所述第二文本信息进行比对;The smart television compares the first text information with each of the second text information;
    所述智能电视将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The smart television uses the executable control corresponding to the matched second text information as an executable control that matches the voice instruction.
  11. 如权利要求3所述的语音控制方法,其特征在于,在所述当前应用为多个时,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤包括:The voice control method according to claim 3, wherein the smart television determines whether the current application stores the to-be-executed object information corresponding to the executable control when the current application is multiple include:
    所述智能电视判断各所述当前应用是否存储有所述待执行对象信息;The smart television determines whether each of the current applications stores the to-be-executed object information;
    对应的,所述智能电视判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息的步骤之后,还包括:Correspondingly, after the step of determining, by the smart TV, whether the current application stores the to-be-executed object information corresponding to the executable control, the method further includes:
    在至少有两个所述当前应用存储有所述待执行对象信息时,所述智能电视按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。When the at least two of the current applications store the to-be-executed object information, the smart TV displays the current application of the current application that stores the to-be-executed object information in descending order according to the running time of the current application. Executable controls for the user to choose to execute.
  12. 一种语音控制系统,应用于智能电视,其特征在于,所述语音控制系统包括:A voice control system is applied to a smart television, wherein the voice control system comprises:
    获取模块,用于在接收到用户的语音指令时,获取当前应用与所述语音指令匹配的可执行控件,其中,所述当前应用为前端运行的应用;An acquiring module, configured to acquire, when the user's voice instruction is received, an executable control that matches a current application with the voice instruction, where the current application is an application running at the front end;
    判断模块,用于判断所述当前应用是否存储有所述可执行控件对应的待执行对象信息;a determining module, configured to determine whether the current application stores the to-be-executed object information corresponding to the executable control;
    执行模块,用于在所述当前应用存储有所述待执行对象信息时,调用所述可执行控件执行所述待执行对象信息对应的执行对象。And an execution module, configured to: when the current application stores the to-be-executed object information, invoke the executable control to execute an execution object corresponding to the to-be-executed object information.
  13. 如权利要求12所述的语音控制系统,其特征在于,所述判断模块还用于判断所述当前应用对应的云端服务器是否存储有所述待执行对象信息;The voice control system according to claim 12, wherein the determining module is further configured to determine whether the cloud server corresponding to the current application stores the to-be-executed object information;
    所述语音控制系统还包括提示模块,用于在所述当前应用未存储有所述待执行对象信息,且所述云端服务器存储有所述待执行对象信息时,输出提示信息。The voice control system further includes a prompting module, configured to output prompt information when the current application does not store the to-be-executed object information, and the cloud server stores the to-be-executed object information.
  14. 如权利要求12所述的语音控制系统,其特征在于,在所述当前应用为多个时,所述判断模块还用于判断各所述当前应用是否存储有所述待执行对象信息;The voice control system according to claim 12, wherein the determining module is further configured to determine whether each of the current applications stores the to-be-executed object information when the current application is multiple;
    所述语音控制系统还包括显示模块,用于在至少有两个所述当前应用存储有所述待执行对象信息时,按所述当前应用的运行时长,降序显示存储有所述待执行对象信息的所述当前应用的所述可执行控件,以供用户选择执行。The voice control system further includes a display module, configured to display the to-be-executed object information in descending order according to the running time of the current application when at least two of the current applications store the to-be-executed object information The executable control of the current application for the user to select to execute.
  15. 如权利要求12所述的语音控制系统,其特征在于,所述语音控制系统还包括验证模块,用于在接收到用户的语音指令时,提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;The voice control system according to claim 12, wherein said voice control system further comprises a verification module for extracting an acoustic feature of said voice command upon receiving a voice command of the user, and according to said acoustic The feature performs a verification operation on the user;
    所述获取模块还用于在验证通过时,获取当前应用与所述语音指令匹配的可执行控件。The obtaining module is further configured to: when the verification passes, obtain an executable control that matches the current application with the voice instruction.
  16. 如权利要求14所述的语音控制系统,其特征在于,所述语音控制系统还包括验证模块,用于在接收到用户的语音指令时,提取所述语音指令的声学特征,并根据所述声学特征对用户进行验证操作;A voice control system according to claim 14 wherein said voice control system further comprises a verification module for extracting an acoustic feature of said voice command upon receipt of a user's voice command, and based on said acoustic The feature performs a verification operation on the user;
    所述获取模块还用于在验证通过时,获取当前应用与所述语音指令匹配的可执行控件。The obtaining module is further configured to: when the verification passes, obtain an executable control that matches the current application with the voice instruction.
  17. 如权利要求12所述的语音控制系统,其特征在于,所述获取模块还用于在接收到用户的语音指令时,将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;以及将所述第一文本信息与各所述第二文本信息进行比对;以及将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The voice control system according to claim 12, wherein the obtaining module is further configured to: when receiving the voice instruction of the user, convert the voice instruction into the first text information, and collect the executable of the current application. a second text information of the control; and comparing the first text information with each of the second text information; and executing an executable control corresponding to the matched second text information as an executable that matches the voice instruction Control.
  18. 如权利要求13所述的语音控制系统,其特征在于,所述获取模块还用于在接收到用户的语音指令时,将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;以及将所述第一文本信息与各所述第二文本信息进行比对;以及将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The voice control system according to claim 13, wherein the obtaining module is further configured to: when receiving the voice instruction of the user, convert the voice instruction into the first text information, and collect the executable of the current application. a second text information of the control; and comparing the first text information with each of the second text information; and executing an executable control corresponding to the matched second text information as an executable that matches the voice instruction Control.
  19. 如权利要求14所述的语音控制系统,其特征在于,所述获取模块还用于在接收到用户的语音指令时,将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;以及将所述第一文本信息与各所述第二文本信息进行比对;以及将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The voice control system according to claim 14, wherein the obtaining module is further configured to: when receiving the voice instruction of the user, convert the voice instruction into the first text information, and collect the executable of the current application. a second text information of the control; and comparing the first text information with each of the second text information; and executing an executable control corresponding to the matched second text information as an executable that matches the voice instruction Control.
  20. 如权利要求15所述的语音控制系统,其特征在于,所述获取模块还用于在接收到用户的语音指令时,将所述语音指令转换为第一文本信息,并收集当前应用的可执行控件的第二文本信息;以及将所述第一文本信息与各所述第二文本信息进行比对;以及将匹配的第二文本信息对应的可执行控件作为与所述语音指令匹配的可执行控件。The voice control system according to claim 15, wherein the obtaining module is further configured to: when receiving the voice instruction of the user, convert the voice instruction into the first text information, and collect the executable of the current application. a second text information of the control; and comparing the first text information with each of the second text information; and executing an executable control corresponding to the matched second text information as an executable that matches the voice instruction Control.
PCT/CN2016/084619 2015-12-15 2016-06-03 Voice control method and system WO2017101266A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510936963.7 2015-12-15
CN201510936963.7A CN105551488A (en) 2015-12-15 2015-12-15 Voice control method and system

Publications (1)

Publication Number Publication Date
WO2017101266A1 true WO2017101266A1 (en) 2017-06-22

Family

ID=55830637

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084619 WO2017101266A1 (en) 2015-12-15 2016-06-03 Voice control method and system

Country Status (2)

Country Link
CN (1) CN105551488A (en)
WO (1) WO2017101266A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770157A (en) * 2020-12-17 2021-05-07 深圳创维-Rgb电子有限公司 Voice control method, device, equipment and medium for WEB front-end interface of television
CN113946810A (en) * 2021-12-07 2022-01-18 荣耀终端有限公司 Application program running method and electronic equipment

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551488A (en) * 2015-12-15 2016-05-04 深圳Tcl数字技术有限公司 Voice control method and system
CN106101789B (en) * 2016-07-06 2020-04-24 深圳Tcl数字技术有限公司 Voice interaction method and device for terminal
CN106357525A (en) * 2016-08-29 2017-01-25 珠海格力电器股份有限公司 Intelligent gateway control method and device and intelligent gateway
CN106484270A (en) * 2016-09-12 2017-03-08 深圳市金立通信设备有限公司 A kind of voice operating event adding method and terminal
CN108428450B (en) * 2017-02-15 2021-10-22 斑马智行网络(香港)有限公司 Operation instruction processing method and device
CN107948698A (en) * 2017-12-14 2018-04-20 深圳市雷鸟信息科技有限公司 Sound control method, system and the smart television of smart television
CN108470566B (en) * 2018-03-08 2020-09-15 腾讯科技(深圳)有限公司 Application operation method and device
CN108615527B (en) * 2018-05-10 2021-10-15 腾讯科技(北京)有限公司 Data processing method, device and storage medium based on simultaneous interpretation
CN110691160A (en) * 2018-07-04 2020-01-14 青岛海信移动通信技术股份有限公司 Voice control method and device and mobile phone
CN109979446A (en) * 2018-12-24 2019-07-05 北京奔流网络信息技术有限公司 Sound control method, storage medium and device
CN109920413A (en) * 2018-12-28 2019-06-21 广州索答信息科技有限公司 A kind of implementation method and storage medium of kitchen scene touch screen voice dialogue
CN112289320A (en) * 2019-07-25 2021-01-29 Tcl集团股份有限公司 Intelligent terminal voice control method, system and readable storage medium
CN110534097A (en) * 2019-09-04 2019-12-03 上海博泰悦臻电子设备制造有限公司 Sound control method and device
CN111263236B (en) * 2020-02-21 2022-04-12 广州欢网科技有限责任公司 Voice adaptation method and device for television application and voice control method
CN111309283B (en) * 2020-03-25 2023-12-05 北京百度网讯科技有限公司 Voice control method and device of user interface, electronic equipment and storage medium
CN112333532A (en) * 2020-07-30 2021-02-05 深圳Tcl新技术有限公司 Semantic-based program playing method and device, terminal and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050172319A1 (en) * 2000-03-31 2005-08-04 United Video Properties, Inc. User speech interfaces for interactive media guidance applications
US20080208589A1 (en) * 2007-02-27 2008-08-28 Cross Charles W Presenting Supplemental Content For Digital Media Using A Multimodal Application
CN101996195A (en) * 2009-08-28 2011-03-30 中国移动通信集团公司 Searching method and device of voice information in audio files and equipment
CN103885783A (en) * 2014-04-03 2014-06-25 深圳市三脚蛙科技有限公司 Voice control method and device of application program
CN204014020U (en) * 2014-03-28 2014-12-10 上海果壳电子有限公司 Audio amplifier
CN105551488A (en) * 2015-12-15 2016-05-04 深圳Tcl数字技术有限公司 Voice control method and system

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7137126B1 (en) * 1998-10-02 2006-11-14 International Business Machines Corporation Conversational computing via conversational virtual machine
CN1427394A (en) * 2002-04-09 2003-07-02 北京无限商机通信技术有限公司 Speech sound browsing network
US8515757B2 (en) * 2007-03-20 2013-08-20 Nuance Communications, Inc. Indexing digitized speech with words represented in the digitized speech
US20130144618A1 (en) * 2011-12-02 2013-06-06 Liang-Che Sun Methods and electronic devices for speech recognition
CN103257851A (en) * 2012-02-16 2013-08-21 深圳富泰宏精密工业有限公司 Method and system for arranging icons of application programs
CN102722369B (en) * 2012-05-21 2016-06-01 张伟明 The information processing terminal and treatment process thereof and the application on intelligent television or smart television set top box thereof
CN103577035A (en) * 2012-08-10 2014-02-12 上海博泰悦臻电子设备制造有限公司 Application interface processing device and method for electronic equipment, and electronic system
CN102929385A (en) * 2012-09-05 2013-02-13 四川长虹电器股份有限公司 Method for controlling application program by voice
CN103067766A (en) * 2012-12-30 2013-04-24 深圳市龙视传媒有限公司 Speech control method, system and terminal for digital television application business
CN103440867B (en) * 2013-08-02 2016-08-10 科大讯飞股份有限公司 Audio recognition method and system
CN103559290A (en) * 2013-11-08 2014-02-05 安徽科大讯飞信息科技股份有限公司 Method and system for searching POI (point of interest)
CN103730119B (en) * 2013-12-18 2017-01-11 惠州市车仆电子科技有限公司 Vehicle-mounted man-machine voice interaction system
CN104750503A (en) * 2013-12-27 2015-07-01 富泰华工业(深圳)有限公司 Desktop icon adjusting method and system
CN105045467B (en) * 2015-07-23 2018-06-12 小米科技有限责任公司 The display methods and device at task manager interface

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050172319A1 (en) * 2000-03-31 2005-08-04 United Video Properties, Inc. User speech interfaces for interactive media guidance applications
US20080208589A1 (en) * 2007-02-27 2008-08-28 Cross Charles W Presenting Supplemental Content For Digital Media Using A Multimodal Application
CN101996195A (en) * 2009-08-28 2011-03-30 中国移动通信集团公司 Searching method and device of voice information in audio files and equipment
CN204014020U (en) * 2014-03-28 2014-12-10 上海果壳电子有限公司 Audio amplifier
CN103885783A (en) * 2014-04-03 2014-06-25 深圳市三脚蛙科技有限公司 Voice control method and device of application program
CN105551488A (en) * 2015-12-15 2016-05-04 深圳Tcl数字技术有限公司 Voice control method and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770157A (en) * 2020-12-17 2021-05-07 深圳创维-Rgb电子有限公司 Voice control method, device, equipment and medium for WEB front-end interface of television
CN113946810A (en) * 2021-12-07 2022-01-18 荣耀终端有限公司 Application program running method and electronic equipment

Also Published As

Publication number Publication date
CN105551488A (en) 2016-05-04

Similar Documents

Publication Publication Date Title
WO2017101266A1 (en) Voice control method and system
WO2017028601A1 (en) Voice control method and device for intelligent terminal, and television system
WO2013187714A1 (en) Display apparatus, method for controlling the display apparatus, server and method for controlling the server
WO2014003283A1 (en) Display apparatus, method for controlling display apparatus, and interactive system
WO2015085765A1 (en) Information pushing method and intelligent terminal
WO2017201913A1 (en) Precise voice control method and device
WO2018043895A1 (en) Display device and method for controlling display device
WO2018006489A1 (en) Terminal voice interaction method and device
WO2019041856A1 (en) Home appliance control method, system and terminal, and storage medium
WO2020000621A1 (en) Air conditioner control method, air conditioner control apparatus, air conditioning device and storage medium
WO2019218444A1 (en) Test report generating method, apparatus and device, and storage medium
WO2013012107A1 (en) Electronic device and method for controlling same
WO2017126835A1 (en) Display apparatus and controlling method thereof
WO2017036209A1 (en) Audio data play method based on smart television, and smart television and system
WO2013187715A1 (en) Server and method of controlling the same
WO2021049795A1 (en) Electronic device and operating method thereof
WO2016175564A1 (en) Audio content recognition method and device
WO2018053964A1 (en) Android-based method and apparatus for voice input of punctuation mark
WO2015018185A1 (en) Method and device for realizing distributed remote control, and television terminal and mobile terminal thereof
WO2017054488A1 (en) Television play control method, server and television play control system
WO2017016310A1 (en) Method and apparatus for dynamically configuring remote control function data
WO2019182378A1 (en) Artificial intelligence server
WO2017146454A1 (en) Method and device for recognising content
WO2021060575A1 (en) Artificial intelligence server and operation method thereof
WO2016206223A1 (en) Screenshooting method and system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874330

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS (EPO FORM 1205A DATED 30.10.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16874330

Country of ref document: EP

Kind code of ref document: A1