CA2581902A1 - Methods and systems for selecting a language for text segmentation - Google Patents

Methods and systems for selecting a language for text segmentation Download PDF

Info

Publication number
CA2581902A1
CA2581902A1 CA002581902A CA2581902A CA2581902A1 CA 2581902 A1 CA2581902 A1 CA 2581902A1 CA 002581902 A CA002581902 A CA 002581902A CA 2581902 A CA2581902 A CA 2581902A CA 2581902 A1 CA2581902 A1 CA 2581902A1
Authority
CA
Canada
Prior art keywords
language
frequency
occurrence
segmented result
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002581902A
Other languages
French (fr)
Other versions
CA2581902C (en
Inventor
Gilad Israel Elbaz
Jacob Leon Mandelson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google Inc.
Gilad Israel Elbaz
Jacob Leon Mandelson
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Inc., Gilad Israel Elbaz, Jacob Leon Mandelson filed Critical Google Inc.
Publication of CA2581902A1 publication Critical patent/CA2581902A1/en
Application granted granted Critical
Publication of CA2581902C publication Critical patent/CA2581902C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/232—Orthographic correction, e.g. spell checking or vowelisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/263—Language identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates

Abstract

Methods and systems for selecting a language for text segmentation are disclosed. In one embodiment, at least a first candidate language and a second candidate language associated with a string of characters are identified, at least a first segmented result associated with the first candidate language and a second segmented result associated with the second candidate language are determined, a first frequency of occurrence for the first segmented result and a second frequency of occurrence for the second segmented result are determined, and an operable language is identified from the first candidate language and the second candidate language based at least in part on the first frequency of occurrence and the second frequency of occurrence.

Claims (35)

1. A method, comprising:
identifying at least a first candidate language and a second candidate language associated with a string of characters;
determining at least a first segmented result associated with the first candidate language from the string of characters and a second segmented result associated with the second candidate language from the string of characters;

determining a first frequency of occurrence for the first segmented result and a second frequency of occurrence for the second segmented result; and identifying an operable language from the first candidate language and the second candidate language based at least in part on the first frequency of occurrence and the second frequency of occurrence.
2. The method of claim 1, wherein identifying the operable language comprises identifying an operable segmented result from the first segmented result and the second segmented result based at least in part on the first frequency of occurrence and the second frequency of occurrence.
3. The method of claim 1, wherein identifying a first candidate language and a second candidate language is based in part on at least one language signal.
4. The method of claim 3, wherein the at least one language signal comprises at least one of linguistics associated with the string of characters, an IP address of a user associated with the string of characters, a character set associated with the string of characters, a browser setting of a browser application program associated with a user associated with the string of characters, and a top-level domain associated with the string of characters.
5. The method of claim 1, wherein identifying the operable language is based at least in part on at least one language signal.
6. The method of claim 1, wherein the first segmented result comprises a first combination of tokens and the second segmented result comprises a second combination of tokens.
7. The method of claim 1, wherein determining the first frequency of occurrence for the first segmented result comprises determining a number of articles in the first candidate language containing the first segmented result and normalizing the number of articles based on a total number of articles in the first candidate language.
8. The method of claim 7, wherein determining the number of articles in the first candidate language containing the first segmented result comprises determining a number of article identifiers in a search result set generated in response to a search query comprising the first segmented result.
9. The method of claim 7, wherein determining the number of articles containing the first segmented result comprises accessing an index of articles.
10. The method of claim 1, wherein determining the first frequency of occurrence for the first segmented result comprises determining a number of occurrences of the first segmented result in a plurality of search queries in the first candidate language and normalizing the number of occurrences based on a total number of search queries in the first candidate language.
11. The method of claim 1, wherein the string of characters comprises a domain name.
12. The method of claim 1, further comprising selecting an article based at least in part on the operable language.
13. The method of claim 12, wherein the article comprises at least one of an advertisement, a web page, and a status message.
14. The method of claim 1, wherein determining the first segmented result comprises:
determining a plurality of segmented results in the first candidate language from the string of characters; and identifying the first segmented result from the plurality of segmented results.
15. The method of claim 14, wherein identifying the first segmented result comprises calculating a probability value for each of the plurality of segmented results.
16. The method of claim 15, wherein a first probability value associated with the first segmented result is based at least in part on a frequency of each token within the first segmented result.
17. The method of claim 1, wherein identifying the operable language from the first candidate language and the second candidate language based at least in part on the first frequency of occurrence and the second frequency of occurrence comprises selecting the first candidate language if the first frequency of occurrence is greater than the second frequency of occurrence.
18. A computer-readable medium containing program code, comprising:
program code for identifying at least a first candidate language and a second candidate language associated with a string of characters;
program code for determining at least a first segmented result associated with the first candidate language from the string of characters and a second segmented result associated with the second candidate language from the string of characters;

program code for determining a first frequency of occurrence for the first segmented result and a second frequency of occurrence for the second segmented result;
and program code for identifying an operable language from the first candidate language and the second candidate language based at least in part on the first frequency of occurrence and the second frequency of occurrence.
19. The computer-readable medium of claim 18, wherein identifying the operable language comprises program code for identifying an operable segmented result from the first segmented result and the second segmented result based at least in part on the first frequency of occurrence and the second frequency of occurrence.
20. The computer-readable medium of claim 18, wherein identifying a first candidate language and a second candidate language is based in part on at least one language signal.
21. The computer-readable medium of claim 20, wherein the at least one language signal comprise at least one of linguistics associated with the string of characters, an IP address of a user associated with the string of characters, a character set associated with the string of characters, a browser setting of a browser application program associated with a user associated with the string of characters, and a top-level domain associated with the string of characters.
22. The computer-readable medium of claim 18, wherein identifying the operable language is based at least in part on at least one language signal.
23. The computer-readable medium of claim 18, wherein the first segmented result comprises a first combination of tokens and the second segmented result comprises a second combination of tokens.
24. The computer-readable medium of claim 18, wherein program code for determining the first frequency of occurrence for the first segmented result comprises program code for determining a number of articles in the first candidate language containing the first segmented result and normalizing the number of articles based on a total number of articles in the first candidate language.
25. The computer-readable medium of claim 24, wherein program code for determining the number of articles in the first candidate language containing the first segmented result comprises program code for determining a number of article identifiers in a search result set generated in response to a search query comprising the first segmented result.
26. The computer-readable medium of claim 25, wherein program code for determining the number of articles containing the first segmented result comprises program code for accessing an index of articles.
27. The computer-readable medium of claim 18, wherein program code for determining the first frequency of occurrence for the first segmented result comprises program code for determining a number of occurrences of the first segmented result in a plurality of search queries in the first candidate language and normalizing the number of occurrences based on a total number of search queries in the first candidate language.
28. The computer-readable medium of claim 18, wherein the string of characters comprises a domain name.
29. The computer-readable medium of claim 18, further comprising program code for selecting an article based at least in part on the operable language.
30. The computer-readable medium of claim 29, wherein the article comprises at least one of an advertisement, a web page, and a status message.
31. The computer-readable medium of claim 18, wherein program code for determining the first segmented result comprises:
program code for determining a plurality of segmented results from the string of characters; and program code for identifying the first segmented result from the plurality of segmented results.
32. The computer-readable medium of claim 31, wherein program code for identifying the first segmented result comprises program code for calculating a probability value for each of the plurality of segmented results.
33. The computer-readable medium of claim 32, wherein a first probability value associated with the first segmented result is based at least in part on a frequency of each token within the first segmented result.
34. The computer-readable medium of claim 18, wherein program code for identifying the operable language from the first candidate language and the second candidate language based at least in part on the first frequency of occurrence and the second frequency of occurrence comprises program code for selecting the first candidate language if the first frequency of occurrence is greater than the second frequency of occurrence.
35. A method, comprising:
determining at least a first segmented result in a first candidate language and at least a second segmented result in a second candidate language from a domain name;

determining at least a first frequency of occurrence for the first segmented result based at least in part on at least one of an article index, a text index, and a search result set;

determining a second frequency of occurrence for the second segmented result;

if the first frequency of occurrence is greater than the second frequency of occurrence, then selecting the first candidate language as an operable language;
if the second frequency of occurrence is greater than the first frequency of occurrence, then selecting the second candidate language as the operable language;
selecting an advertisement based at least in part on the operable language, wherein the advertisement includes text in the operable language; and causing a display of the advertisement in association with a web page associated with the domain name.
CA2581902A 2004-09-30 2005-09-28 Methods and systems for selecting a language for text segmentation Expired - Fee Related CA2581902C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/955,660 2004-09-30
US10/955,660 US7996208B2 (en) 2004-09-30 2004-09-30 Methods and systems for selecting a language for text segmentation
PCT/US2005/035010 WO2006039398A2 (en) 2004-09-30 2005-09-28 Methods and systems for selecting a language for text segmentation

Publications (2)

Publication Number Publication Date
CA2581902A1 true CA2581902A1 (en) 2006-04-13
CA2581902C CA2581902C (en) 2013-05-07

Family

ID=35985934

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2581902A Expired - Fee Related CA2581902C (en) 2004-09-30 2005-09-28 Methods and systems for selecting a language for text segmentation

Country Status (8)

Country Link
US (4) US7996208B2 (en)
EP (2) EP2511832B1 (en)
JP (1) JP5148278B2 (en)
CN (3) CN102708095B (en)
CA (1) CA2581902C (en)
DK (1) DK1800224T3 (en)
ES (1) ES2395168T3 (en)
WO (1) WO2006039398A2 (en)

Families Citing this family (141)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US7680648B2 (en) 2004-09-30 2010-03-16 Google Inc. Methods and systems for improving text segmentation
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8762358B2 (en) * 2006-04-19 2014-06-24 Google Inc. Query language determination using query terms and interface language
US8380488B1 (en) 2006-04-19 2013-02-19 Google Inc. Identifying a property of a document
US8255376B2 (en) 2006-04-19 2012-08-28 Google Inc. Augmenting queries with synonyms from synonyms map
US8442965B2 (en) 2006-04-19 2013-05-14 Google Inc. Query language identification
CA2661559C (en) * 2006-09-01 2013-07-16 Research In Motion Limited Method for identifying language of text in a handheld electronic device and a handheld electronic device incorporating the same
US7689408B2 (en) * 2006-09-01 2010-03-30 Microsoft Corporation Identifying language of origin for words using estimates of normalized appearance frequency
US8423908B2 (en) * 2006-09-08 2013-04-16 Research In Motion Limited Method for identifying language of text in a handheld electronic device and a handheld electronic device incorporating the same
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
ATE480090T1 (en) * 2006-09-18 2010-09-15 Lg Electronics Inc METHOD FOR MANAGING VOICE INFORMATION FOR TEXT ENTRY, METHOD FOR TEXT ENTRY AND MOBILE TERMINAL
US20100153569A1 (en) * 2007-03-09 2010-06-17 Ghost, Inc. System and Method for a Virtual Hosted Operating System
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US9754022B2 (en) * 2007-10-30 2017-09-05 At&T Intellectual Property I, L.P. System and method for language sensitive contextual searching
US8165869B2 (en) * 2007-12-10 2012-04-24 International Business Machines Corporation Learning word segmentation from non-white space languages corpora
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8464150B2 (en) * 2008-06-07 2013-06-11 Apple Inc. Automatic language identification for dynamic text processing
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US20120221962A1 (en) 2008-08-05 2012-08-30 Eugene Lee Lew Social messaging hub system
US9356907B2 (en) 2008-08-05 2016-05-31 HeyWire, Inc. Messaging system having multiple number, dual mode phone support
US11172067B1 (en) 2008-08-05 2021-11-09 HeyWire, Inc. Call center mobile messaging
US8561118B2 (en) 2008-08-05 2013-10-15 Mediafriends, Inc. Apparatus and methods for TV social applications
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10706373B2 (en) 2011-06-03 2020-07-07 Apple Inc. Performing actions associated with task items that represent tasks to perform
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
KR101083455B1 (en) * 2009-07-17 2011-11-16 엔에이치엔(주) System and method for correction user query based on statistical data
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US8635205B1 (en) * 2010-06-18 2014-01-21 Google Inc. Displaying local site name information with search results
CN101882226B (en) * 2010-06-24 2013-07-24 汉王科技股份有限公司 Method and device for improving language discrimination among characters
US20120004899A1 (en) * 2010-07-04 2012-01-05 Taymoor Arshi Dynamic ad selection for ad delivery systems
CN102455997A (en) * 2010-10-27 2012-05-16 鸿富锦精密工业（深圳）有限公司 Component name extraction system and method
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
CN103631802B (en) * 2012-08-24 2015-05-20 腾讯科技（深圳）有限公司 Song information searching method, device and corresponding server
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US9218335B2 (en) * 2012-10-10 2015-12-22 Verisign, Inc. Automated language detection for domain names
US8713433B1 (en) * 2012-10-16 2014-04-29 Google Inc. Feature-based autocorrection
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
AU2014233517B2 (en) 2013-03-15 2017-05-25 Apple Inc. Training an at least partial voice command system
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
DE112014002747T5 (en) 2013-06-09 2016-03-03 Apple Inc. Apparatus, method and graphical user interface for enabling conversation persistence over two or more instances of a digital assistant
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
KR101809808B1 (en) 2013-06-13 2017-12-15 애플 인크. System and method for emergency calls initiated by voice command
US9213910B2 (en) 2013-11-06 2015-12-15 Xerox Corporation Reinforcement learning approach to character level segmentation of license plate images
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
AU2015266863B2 (en) 2014-05-30 2018-03-15 Apple Inc. Multi-command single utterance input method
US9740687B2 (en) 2014-06-11 2017-08-22 Facebook, Inc. Classifying languages for objects and entities
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10360309B2 (en) * 2015-04-30 2019-07-23 Salesforce.Com, Inc. Call center SMS-MMS language router
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US9734142B2 (en) 2015-09-22 2017-08-15 Facebook, Inc. Universal translation
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
CN108776709B (en) * 2015-10-27 2020-05-19 上海智臻智能网络科技股份有限公司 Computer-readable storage medium and dictionary updating method
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10430485B2 (en) 2016-05-10 2019-10-01 Go Daddy Operating Company, LLC Verifying character sets in domain name requests
US10180930B2 (en) 2016-05-10 2019-01-15 Go Daddy Operating Company, Inc. Auto completing domain names comprising multiple languages
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US10348671B2 (en) 2016-07-11 2019-07-09 Salesforce.Com, Inc. System and method to use a mobile number in conjunction with a non-telephony internet connected device
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10380247B2 (en) 2016-10-28 2019-08-13 Microsoft Technology Licensing, Llc Language-based acronym generation for strings
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US10180935B2 (en) * 2016-12-30 2019-01-15 Facebook, Inc. Identifying multiple languages in a content item
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. Far-field extension for digital assistant services
CN109492225A (en) * 2018-11-08 2019-03-19 大连瀚闻资讯有限公司 A kind of public feelings information text handling method of rare foreign languages country
CN111079408B (en) * 2019-12-26 2023-05-30 北京锐安科技有限公司 Language identification method, device, equipment and storage medium
US11915167B2 (en) 2020-08-12 2024-02-27 State Farm Mutual Automobile Insurance Company Claim analysis based on candidate functions

Family Cites Families (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839853A (en) * 1988-09-15 1989-06-13 Bell Communications Research, Inc. Computer information retrieval using latent semantic structure
US5325298A (en) * 1990-11-07 1994-06-28 Hnc, Inc. Methods for generating or revising context vectors for a plurality of word stems
US5423032A (en) * 1991-10-31 1995-06-06 International Business Machines Corporation Method for extracting multi-word technical terms from text
CA2140891A1 (en) * 1992-07-24 1994-02-03 David C. Parmelee Peptides useful as internal standards for microsequencing and methods for their use
US5377280A (en) 1993-04-19 1994-12-27 Xerox Corporation Method and apparatus for automatic language determination of European script documents
US5454046A (en) * 1993-09-17 1995-09-26 Penkey Corporation Universal symbolic handwriting recognition system
US5619709A (en) 1993-09-20 1997-04-08 Hnc, Inc. System and method of context vector generation and retrieval
US5499360A (en) * 1994-02-28 1996-03-12 Panasonic Technolgies, Inc. Method for proximity searching with range testing and range adjustment
US5548507A (en) 1994-03-14 1996-08-20 International Business Machines Corporation Language identification process using coded language words
US5794177A (en) * 1995-07-19 1998-08-11 Inso Corporation Method and apparatus for morphological analysis and generation of natural language text
US6067552A (en) * 1995-08-21 2000-05-23 Cnet, Inc. User interface system and method for browsing a hypertext database
US5913040A (en) 1995-08-22 1999-06-15 Backweb Ltd. Method and apparatus for transmitting and displaying information between a remote network and a local computer
US5778364A (en) * 1996-01-02 1998-07-07 Verity, Inc. Evaluation of content of a data set using multiple and/or complex queries
US5966686A (en) * 1996-06-28 1999-10-12 Microsoft Corporation Method and system for computing semantic logical forms from syntax trees
EP0822502A1 (en) * 1996-07-31 1998-02-04 BRITISH TELECOMMUNICATIONS public limited company Data access system
US6009382A (en) * 1996-08-19 1999-12-28 International Business Machines Corporation Word storage table for natural language determination
US6002998A (en) * 1996-09-30 1999-12-14 International Business Machines Corporation Fast, efficient hardware mechanism for natural language determination
US5778363A (en) * 1996-12-30 1998-07-07 Intel Corporation Method for measuring thresholded relevance of a document to a specified topic
US6285999B1 (en) * 1997-01-10 2001-09-04 The Board Of Trustees Of The Leland Stanford Junior University Method for node ranking in a linked database
US7437351B2 (en) * 1997-01-10 2008-10-14 Google Inc. Method for searching media
US6076051A (en) * 1997-03-07 2000-06-13 Microsoft Corporation Information retrieval utilizing semantic representation of text
US6119164A (en) * 1997-04-15 2000-09-12 Full Circle Software, Inc. Method and apparatus for distributing over a network unsolicited information to a targeted audience
US6006222A (en) * 1997-04-25 1999-12-21 Culliss; Gary Method for organizing information
US6185559B1 (en) * 1997-05-09 2001-02-06 Hitachi America, Ltd. Method and apparatus for dynamically counting large itemsets
US6233575B1 (en) * 1997-06-24 2001-05-15 International Business Machines Corporation Multilevel taxonomy based on features derived from training documents classification using fisher values as discrimination values
US6505150B2 (en) * 1997-07-02 2003-01-07 Xerox Corporation Article and method of automatically filtering information retrieval results using test genre
US5933822A (en) * 1997-07-22 1999-08-03 Microsoft Corporation Apparatus and methods for an information retrieval system that employs natural language processing of search results to improve overall precision
US6760746B1 (en) * 1999-09-01 2004-07-06 Eric Schneider Method, product, and apparatus for processing a data request
US6182068B1 (en) * 1997-08-01 2001-01-30 Ask Jeeves, Inc. Personalized search methods
US6078916A (en) * 1997-08-01 2000-06-20 Culliss; Gary Method for organizing information
US6014665A (en) * 1997-08-01 2000-01-11 Culliss; Gary Method for organizing information
US5845278A (en) * 1997-09-12 1998-12-01 Inioseek Corporation Method for automatically selecting collections to search in full text searches
US5974412A (en) * 1997-09-24 1999-10-26 Sapient Health Network Intelligent query system for automatically indexing information in a database and automatically categorizing users
US6134532A (en) * 1997-11-14 2000-10-17 Aptex Software, Inc. System and method for optimal adaptive matching of users to most relevant entity and information in real-time
US6230168B1 (en) * 1997-11-26 2001-05-08 International Business Machines Corp. Method for automatically constructing contexts in a hypertext collection
US6289342B1 (en) * 1998-01-05 2001-09-11 Nec Research Institute, Inc. Autonomous citation indexing and literature browsing using citation context
US6640006B2 (en) * 1998-02-13 2003-10-28 Microsoft Corporation Word segmentation in chinese text
US6421675B1 (en) * 1998-03-16 2002-07-16 S. L. I. Systems, Inc. Search engine
US6272456B1 (en) * 1998-03-19 2001-08-07 Microsoft Corporation System and method for identifying the language of written text having a plurality of different length n-gram profiles
GB9806085D0 (en) * 1998-03-23 1998-05-20 Xerox Corp Text summarisation using light syntactic parsing
US6044375A (en) * 1998-04-30 2000-03-28 Hewlett-Packard Company Automatic extraction of metadata using a neural network
US6334131B2 (en) * 1998-08-29 2001-12-25 International Business Machines Corporation Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures
US6466901B1 (en) * 1998-11-30 2002-10-15 Apple Computer, Inc. Multi-language document search and retrieval system
US6298348B1 (en) * 1998-12-03 2001-10-02 Expanse Networks, Inc. Consumer profiling system
US6324519B1 (en) * 1999-03-12 2001-11-27 Expanse Networks, Inc. Advertisement auction system
US6167369A (en) 1998-12-23 2000-12-26 Xerox Company Automatic language identification using both N-gram and word information
US6269189B1 (en) * 1998-12-29 2001-07-31 Xerox Corporation Finding selected character strings in text and providing information relating to the selected character strings
US6678681B1 (en) * 1999-03-10 2004-01-13 Google Inc. Information extraction from a database
US6826559B1 (en) * 1999-03-31 2004-11-30 Verizon Laboratories Inc. Hybrid category mapping for on-line query tool
US6493702B1 (en) 1999-05-05 2002-12-10 Xerox Corporation System and method for searching and recommending documents in a collection using share bookmarks
US6493703B1 (en) * 1999-05-11 2002-12-10 Prophet Financial Systems System and method for implementing intelligent online community message board
US7065500B2 (en) * 1999-05-28 2006-06-20 Overture Services, Inc. Automatic advertiser notification for a system for providing place and price protection in a search result list generated by a computer network search engine
US6269361B1 (en) * 1999-05-28 2001-07-31 Goto.Com System and method for influencing a position on a search result list generated by a computer network search engine
US6314419B1 (en) * 1999-06-04 2001-11-06 Oracle Corporation Methods and apparatus for generating query feedback based on co-occurrence patterns
WO2000079436A2 (en) 1999-06-24 2000-12-28 Simpli.Com Search engine interface
US6601026B2 (en) * 1999-09-17 2003-07-29 Discern Communications, Inc. Information retrieval by natural language querying
US6754873B1 (en) 1999-09-20 2004-06-22 Google Inc. Techniques for finding related hyperlinked documents using link-based analysis
US6816857B1 (en) 1999-11-01 2004-11-09 Applied Semantics, Inc. Meaning-based advertising and document relevance determination
US6453315B1 (en) * 1999-09-22 2002-09-17 Applied Semantics, Inc. Meaning-based information organization and retrieval
JP2001101186A (en) * 1999-09-30 2001-04-13 Oki Electric Ind Co Ltd Machine translating device
AU1039301A (en) * 1999-10-29 2001-05-08 British Telecommunications Public Limited Company Method and apparatus for processing queries
US6968308B1 (en) * 1999-11-17 2005-11-22 Microsoft Corporation Method for segmenting non-segmented text using syntactic parse
US6691108B2 (en) * 1999-12-14 2004-02-10 Nec Corporation Focused search engine and method
JP3803219B2 (en) * 1999-12-14 2006-08-02 三菱電機株式会社 Full-text search device and full-text search method
US6678409B1 (en) * 2000-01-14 2004-01-13 Microsoft Corporation Parameterized word segmentation of unsegmented text
US6615209B1 (en) * 2000-02-22 2003-09-02 Google, Inc. Detecting query-specific duplicate documents
US20020002452A1 (en) * 2000-03-28 2002-01-03 Christy Samuel T. Network-based text composition, translation, and document searching
US6754872B2 (en) * 2000-05-22 2004-06-22 Sarnoff Corporation Method and apparatus for reducing channel distortion in a wireless communications network
GB2362971B (en) 2000-05-30 2004-03-24 Com Nation Ltd A method of searching the internet and an internet search engine
SE517005C2 (en) * 2000-05-31 2002-04-02 Hapax Information Systems Ab Segmentation of text
US6529903B2 (en) * 2000-07-06 2003-03-04 Google, Inc. Methods and apparatus for using a modified index to provide search results in response to an ambiguous search query
US7136854B2 (en) * 2000-07-06 2006-11-14 Google, Inc. Methods and apparatus for providing search results in response to an ambiguous search query
WO2002010264A1 (en) * 2000-07-28 2002-02-07 The Penn State Research Foundation A process for fabricating hollow electroactive devices
US6766320B1 (en) * 2000-08-24 2004-07-20 Microsoft Corporation Search engine with natural language-based robust parsing for user query and relevance feedback learning
CA2323883C (en) * 2000-10-19 2016-02-16 Patrick Ryan Morin Method and device for classifying internet objects and objects stored oncomputer-readable media
US6917937B1 (en) 2000-11-01 2005-07-12 Sas Institute Inc. Server-side object filtering
US7054803B2 (en) * 2000-12-19 2006-05-30 Xerox Corporation Extracting sentence translations from translated documents
US6714939B2 (en) * 2001-01-08 2004-03-30 Softface, Inc. Creation of structured data from plain text
US6658423B1 (en) * 2001-01-24 2003-12-02 Google, Inc. Detecting duplicate and near-duplicate files
US6526440B1 (en) * 2001-01-30 2003-02-25 Google, Inc. Ranking search results by reranking the results based on local inter-connectivity
JP3408525B2 (en) * 2001-02-08 2003-05-19 松下電器産業株式会社 SRAM device
JP2002245470A (en) * 2001-02-16 2002-08-30 Merukomu Service Kk Language specifying device, translating device, and language specifying method
US8001118B2 (en) * 2001-03-02 2011-08-16 Google Inc. Methods and apparatus for employing usage statistics in document retrieval
US7860706B2 (en) * 2001-03-16 2010-12-28 Eli Abir Knowledge system method and appparatus
US6738764B2 (en) * 2001-05-08 2004-05-18 Verity, Inc. Apparatus and method for adaptively ranking search results
WO2002095614A1 (en) * 2001-05-24 2002-11-28 Izumi Suzuki Method for identifying language/character code system
JP2003186789A (en) * 2001-12-18 2003-07-04 Logo Vista Corp Electronic mail translation system
US6978264B2 (en) * 2002-01-03 2005-12-20 Microsoft Corporation System and method for performing a search and a browse on a query
US7716161B2 (en) 2002-09-24 2010-05-11 Google, Inc, Methods and apparatus for serving relevant advertisements
JP4184344B2 (en) * 2002-11-06 2008-11-19 株式会社野村鍍金 Surface treatment method for vacuum member
US7249012B2 (en) * 2002-11-20 2007-07-24 Microsoft Corporation Statistical method and apparatus for learning translation relationships among phrases
FR2848688A1 (en) * 2002-12-17 2004-06-18 France Telecom Text language identifying device for linguistic analysis of text, has analyzing unit to analyze chain characters of words extracted from one text, where each chain is completed so that each time chains are found in word
US20040119740A1 (en) * 2002-12-24 2004-06-24 Google, Inc., A Corporation Of The State Of California Methods and apparatus for displaying and replying to electronic messages
US7536296B2 (en) * 2003-05-28 2009-05-19 Loquendo S.P.A. Automatic segmentation of texts comprising chunks without separators
US7493322B2 (en) * 2003-10-15 2009-02-17 Xerox Corporation System and method for computing a measure of similarity between documents
US20050086065A1 (en) * 2003-10-16 2005-04-21 Nokia Corporation Automatic field completion in capacity-constrained media
US20050131872A1 (en) * 2003-12-16 2005-06-16 Microsoft Corporation Query recognizer
US8392249B2 (en) * 2003-12-31 2013-03-05 Google Inc. Suggesting and/or providing targeting criteria for advertisements
US7359851B2 (en) * 2004-01-14 2008-04-15 Clairvoyance Corporation Method of identifying the language of a textual passage using short word and/or n-gram comparisons
US20050289473A1 (en) 2004-03-17 2005-12-29 Carl Gustafson Method and system for providing search information via a communications network
US7409334B1 (en) * 2004-07-22 2008-08-05 The United States Of America As Represented By The Director, National Security Agency Method of text processing
US7792814B2 (en) 2005-09-30 2010-09-07 Sap, Ag Apparatus and method for parsing unstructured data
US7761458B1 (en) 2006-02-01 2010-07-20 Hewlett-Packard Development Company, L.P. Segmentation of a data sequence
US7747633B2 (en) 2007-07-23 2010-06-29 Microsoft Corporation Incremental parsing of hierarchical files

Also Published As

Publication number Publication date
CN101095138B (en) 2012-08-29
WO2006039398A8 (en) 2007-03-22
JP5148278B2 (en) 2013-02-20
US20060074628A1 (en) 2006-04-06
US20110301939A1 (en) 2011-12-08
JP2008515107A (en) 2008-05-08
CN101095138A (en) 2007-12-26
ES2395168T3 (en) 2013-02-08
EP1800224B1 (en) 2012-08-29
US8306808B2 (en) 2012-11-06
CN102708095A (en) 2012-10-03
CN102708095B (en) 2015-09-30
EP1800224A2 (en) 2007-06-27
CA2581902C (en) 2013-05-07
WO2006039398A2 (en) 2006-04-13
US20130013288A1 (en) 2013-01-10
EP2511832B1 (en) 2014-05-14
EP2511832A2 (en) 2012-10-17
CN102831107B (en) 2016-01-20
US7996208B2 (en) 2011-08-09
EP2511832A3 (en) 2013-03-20
US8489387B2 (en) 2013-07-16
CN102831107A (en) 2012-12-19
US20130018648A1 (en) 2013-01-17
WO2006039398A3 (en) 2006-07-06
DK1800224T3 (en) 2012-11-19

Similar Documents

Publication Publication Date Title
CA2581902A1 (en) Methods and systems for selecting a language for text segmentation
CN103631948B (en) Identifying method of named entities
JP4633803B2 (en) Ambiguous geographic reference classification
US8645385B2 (en) System and method for automating categorization and aggregation of content from network sites
JP5226095B2 (en) Local item extraction
JP2008515107A5 (en)
CN101534306B (en) Detecting method and a device for fishing website
CN100478949C (en) Query rewriting with entity detection
JP4850845B2 (en) Method, system and memory device
CN102279875B (en) Method and device for identifying fishing website
CN103778151B (en) The method and device and searching method and device of a kind of identification feature colony
CN106302440B (en) Method for acquiring suspicious phishing websites through multiple channels
EP2557511B1 (en) Information processing device, information processing method, information processing programme, and recording medium
JP2009259252A (en) System, method and software for hyperlinking name
CN103294693A (en) Searching method, server and system
EP1934906A2 (en) Pay-per-click fraud protection
Chen et al. Template detection for large scale search engines
CN102446255A (en) Method and device for detecting page tamper
WO2014040521A1 (en) Searching method, system and storage medium
CN108038173A (en) A kind of Web page classification method, system and a kind of Web page classifying equipment
CN103778122A (en) Searching method and system
CN104239570B (en) The searching method and device of paper
CN106708932A (en) Abstract extraction method and apparatus for reply of question and answer website
CN105512335A (en) Abstract searching method and device
KR100742130B1 (en) Method and system for detecting spam based on keyword

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20170928