US20130191112A1

US20130191112A1 - Method for identifying language of text in a handheld electronic device and a handheld electronic device incorporating the same

Info

Publication number: US20130191112A1
Application number: US13/798,333
Authority: US
Inventors: Vadim Fux; Sergey Kolomiets
Original assignee: Research in Motion Ltd
Current assignee: 2012244 Ontario Inc; Malikie Innovations Ltd
Priority date: 2006-09-08
Filing date: 2013-03-13
Publication date: 2013-07-25
Also published as: US20080065369A1; US8423908B2

Abstract

Incoming e-mails, instant messages, SMS, and MMS, are analyzed by a handheld electronic device to identify the language of text.

Description

BACKGROUND

1. Technical Field
Aspects of the disclosure relate to identifying language of text in a handheld electronic device.
2. Background Information
Generating text in a handheld electronic device examples of which include, for instance, personal data assistants (PDA's), handheld computers, two-way pagers, cellular telephones, text messaging devices, and the like, has become a complex process. This is due at least partially to the trend to make these handheld electronic devices smaller and lighter in weight. A limitation in making them smaller has been the physical size of the keypad if the keys are to be actuated directly by human fingers. Generally, there have been two approaches to solving this problem. One is to adapt the ten digit keypad indigenous to mobile phones for text input. This requires each key to support input of multiple characters. The second approach seeks to shrink the traditional full keypad, such as the QWERTY keyboard by doubling up characters to reduce the number of keys. In both cases, the input generated by actuation of a key representing multiple characters is ambiguous. Various schemes have been devised to disambiguate inputs from these multi-character keys.
A problem exists with regard to handheld electronic devices that have a full keypad or a reduced keypad in that the device cannot always accurately identify language of received text since a number of languages share the same encoding. As such, the potential exists for processing errors in the handheld electronic device in determining the identity of the language of the e-mail. If the handheld electronic device cannot accurately identify the language of the e-mail, the characters of the e-mail may be improperly displayed to the end-user or the handheld electronic device may add linguistic objects of the e-mail to the wrong list of commonly used linguistic objects that are used from the list for disambiguation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a front view of an exemplary handheld electronic device incorporating aspects of the disclosed and claimed concepts;

FIG. 2 is a front view of an alternate exemplary handheld electronic device incorporating aspects of the disclosed and claimed concepts;

FIG. 3 is a functional diagram in block form illustrating aspects of the disclosed and claimed concepts; and

FIG. 4 is a flow chart illustrating operation of aspects of the disclosed and claimed concepts.

DESCRIPTION

An aspect of the disclosed and claimed concepts is to identify the language of text and to verify the encoding of the text to minimize processing errors in a handheld electronic device. An exemplary external source of text is e-mail messaging. Additional non-limiting examples include SMS (Short Message Service), MMS (Multi-Media Service) and instant messages.
More particularly, aspects of the disclosed and claimed concepts are directed to a method of identifying language of text in a handheld electronic device. The handheld electronic device has at least one application for receiving text from a source external to the handheld electronic device. The handheld electronic device also has available thereto a plurality of indicator lists with each indicator list comprising a number of linguistic objects which are indicative of a preselected language and which are in a different language from the linguistic objects of the other indicator lists. The general method of the disclosed and claimed concepts includes analyzing the text to at least preliminarily determine an encoding of the text, and comparing linguistic objects of the text to at least some of the linguistic objects of at least some of the indicator lists to identify the language of the text and to verify the encoding of the text.
Aspects of the disclosed and claimed concepts also embrace a handheld electronic device having a processing apparatus. The processing apparatus has a processor and a memory. Stored within the memory is at least one application for receiving text from a source external to the handheld electronic device. Stored within the memory also is a plurality of indicator lists with each indicator list comprising a number of linguistic objects which are indicative of a preselected language and which are in a different language from the linguistic objects of the other indicator lists. The memory has stored therein a number of routines which, when executed by the processor, cause the handheld electronic device to perform operations. The general nature of the operations can be stated as analyzing the text to at least preliminarily determine an encoding of the text, and comparing linguistic objects of the text to at least some of the linguistic objects of at least some of the indicator lists to identify the language of the text and to verify the encoding of the text.
FIG. 1 illustrates a wireless handheld electronic device 1, which is but an example of a type of a handheld electronic device to which aspects of the disclosed and claimed concepts can be applied. The exemplary handheld electronic device 1 includes an input device 3 in the form of a keypad 5 and a thumbwheel 7 that are used to control the functions of the handheld electronic device 1 and to generate text and other inputs. The keypad 5 constitutes a reduced QWERTY keyboard in which most of the keys 9 are used to input two letters of the alphabet. It is noted, however, that the keypad 5 may be of other configurations, such as an AZERTY keyboard, a QWERTZ keyboard, or other keyboard arrangement, whether presently known or unknown, and either reduced or not reduced. Thus, initially the input generated by depressing one of these keys is ambiguous in that it is undetermined as to which letter was intended. Various schemes have been devised for disambiguating the inputs generated by these keys 9 assigned multiple letters for input. The input provided through the keypad 5 and thumbwheel 7 are displayed on a display 11 as is well known.
FIG. 2 illustrates an alternate wireless handheld electronic device 1, which is but another example of a type of a handheld electronic device to which aspects of the disclosed and claimed concepts can be applied. Elements that are presented in FIG. 2 which are similar to the elements found in FIG. 1 are labeled with the same element number in FIG. 2. The exemplary handheld electronic device 1 includes an input device 3 in the form of a keypad 5 and a navigational tool 8 that is used to control the functions of the handheld electronic device 1 and to generate text and other inputs. The keypad 5 constitutes a reduced QWERTY keyboard in which most of the keys 9 are used to input two letters of the alphabet. It is noted, however, that the keypad 5 may be of other configurations, such as an AZERTY keyboard, a QWERTZ keyboard, or other keyboard arrangement, whether presently known or unknown, and either reduced or not reduced. Thus, initially the input generated by depressing one of these keys is ambiguous in that it is undetermined as to which letter was intended. Various schemes have been devised for disambiguating the inputs generated by these keys 9 assigned multiple letters for input. Continuing with FIG. 2, the handheld electronic device 1 also includes the navigational tool 8. In this particular embodiment, the navigational tool 8 is a trackball 10 that can be rotated thereby allowing for the navigation of a cursor which is displayed on a display 11 in various directions including up, down, left, right, and any combination thereof. Moreover, the trackball 10 can also be depressed. When the trackball 10 is depressed, a selection is made based upon the current location of the cursor. For example, if the cursor is located over a given program icon, that program will be launched when the trackball 10 is depressed. The input provided through the keypad 5 and trackball 10 is displayed on the display 11.
It should be noted, however, that despite FIG. 2 depicting the navigational tool 8 as being disposed on the front face of the handheld electronic device 1, the navigational tool 8 can also be disposed on a side of the handheld electronic device 1 in the form of the thumbwheel 7 as shown in FIG. 1. The thumbwheel 7 of FIG. 1, which is capable of being rotated and depressed, may be disposed on the side of the handheld electronic device 1 of FIG. 1 in lieu of the trackball 10. Rotation of the thumbwheel 7 can provide a navigation input, while depression of the thumbwheel 7 can provide a selection input. Accordingly, rotation of the thumbwheel 7 can navigate the cursor over a particular program icon, while depression of the thumbwheel 7 with the cursor located over a given program icon can launch the program.
Turning to FIG. 3, the input device 3 provides keystroke inputs to a processing apparatus 13 which may include, by way of example and not limitation, a memory, an operating system, a processor, a Java virtual machine, a run time environment or the like. The handheld electronic devices 1 of FIGS. 1-2 each implement a plurality of applications 17. These applications may include, by way of example and not limitation, an address book 19, e-mail 21, a calendar 23, a memo 25, and additional applications, such as, for example, spell check and a phone application. Generally these applications 17 require text input that is implemented by a text input process 27, which forms part of an input system 15.
Various types of text input processes 27 can be used that employ lists 29 to facilitate the generation of text. For example, in the exemplary handheld electronic device where the reduced QWERTY keyboard produces ambiguous inputs, the text input process 27 utilizes software to progressively narrow the possible combination of letters that could be intended by a specified sequence of keystrokes. Such “disambiguation” software is known. Typically, such systems employ a plurality of lists 29 of linguistic objects. By linguistic objects, it is meant words and in some languages ideograms. The keystrokes input linguistic elements, which in the case of words, are characters or letters in the alphabet, and in the case of ideograms, strokes that make up the ideogram. The lists 29 of language objects can also include abbreviations, and text shortcuts, which are becoming common with the growing use of various kinds of text messaging. Lists 29 that can be used by the exemplary disambiguation text input process 27 can include a generic list 31 and a new list 33. Additional lists 35 can include learned words and special word lists such as technical terms. Other types of text input processes 27 could include, by way of example and not limitation, prediction programs that anticipate a word intended by a user as it is typed in and thereby complete it, could also use word lists. Such a prediction program might be used with a full keypad.
Known disambiguation programs can assign frequencies of use to the linguistic objects, such as words or ideograms, in the lists 29 it uses to determine the linguistic object intended by the user. Frequencies of use can be initially assigned based on statistics of common usage and can then be modified through actual usage. It is known for disambiguation programs to incorporate “learned” linguistic objects such as words that were not in the initial lists 29, but were inserted by the user to drive the output 37 to the intended new word. It is known to assign such learned words an initial frequency of use that is near the high end of the range of frequencies of use. This initial frequency of use is then modified through actual use as with the initially inserted words.
One source for additional linguistic objects is by e-mail 21. Not only is it likely that new language objects contained in incoming e-mail 21 would be used by the user to generate a reply or other e-mail responses, such new linguistic objects could also be linguistic objects that the user might want to use in generating other text inputs.
A problem associated with using new linguistic objects received by e-mail 21 is that processing errors occur in the handheld electronic devices 1 of FIGS. 1-2 in identifying language of the text that is received. Typically, quantities of text in various languages are transmitted by e-mail with a preselected encoding which is then translated by the handheld electronic device 1 into the text that is shown on display 11 of the handheld electronic device 1. Encoding refers to the coding employed to transmit e-mail to the handheld electronic device 1. Encoding examples include, by way of example and not limitation, Unicode, ASCII and the like. Unfortunately, certain languages share the same encoding among characters, words or ideograms and the potential for processing errors exists in the handheld electronic device 1 in determining the identity of the language of the e-mail 21.
FIG. 4 illustrates a flow chart of a routine 39 for identifying language of text in the handheld electronic device 1. The processor apparatus 13 of the handheld electronic device 1 has a processor and a memory. Stored within the memory is at least one application for receiving text from a source external to the handheld electronic device 1. Stored within the memory also is a plurality of indicator lists 41 with each indicator list 41 comprising a number of linguistic objects which are indicative of a preselected language and which are in a different language from the linguistic objects of the other indicator lists 41. Each indicator list 41 may contain a set of most frequently found linguistic objects of the preselected language of the indicator list 41. For example, the indicator list 41 may have 20 or more linguistic objects stored within the memory. The linguistic objects may be, by way of example and not limitation, words or ideograms. Also, the different languages may consist of different dialects of a same language used in one or more countries.
The incoming e-mails 43 are placed in a queue 45 for processing as permitted by the processing burden on the handheld electronic device 1. Processing begins with scanning the e-mail to parse 47 the message into text. The parsed message is then filtered at 49 to remove unwanted components, such as numbers, dates, and the like. At least a portion of the message is then analyzed 51 for the frequency of use of characters in the text to at least preliminarily determine an encoding of the text. Encoding examples include, by way of example and not limitation, Unicode, ASCII and the like. The encoding of the text may dictate the language of the text but, in other circumstances, a plurality of languages will share the same encoding for various characters, words or ideograms which leads to processing problems in the handheld electronic device 1.
As such, in the routine 39, linguistic objects of the text are then compared 53 to at least some of the linguistic objects of indicator lists 41 to identify the language of the text and to verify the encoding of the text. In certain instances, the linguistic objects of the text may be compared 53 with at least some of the linguistic objects of all of the indicator lists 41. The handheld electronic device 1 then determines 55 if a proportion of the quantity of linguistic objects of the text that are also found in a given indicator list 41 to the total quantity of linguistic objects of text reaches a preselected threshold. If, for example, the linguistic objects of the text are also in a particular indicator list 41 at a proportion of 10% or more, the routine 39 determines 55 that the language of the text is the preselected language of a particular indicator list 41. The identification of a language would verify that the encoding of the text was correctly analyzed at 51. If, for example, the linguistic objects of the text are in a particular indicator list 41 at a proportion of less than 10%, the routine 39 determines that the language of the text has not yet been identified. If no language can be identified for the text, the routine 39 concludes that the encoding of the text has not been determined accurately so the linguistic objects of the text are routed to be analyzed 51 or compared 53 again.
Once the routine 39 determines that the language of the text is the preselected language of a particular indicator list 41, the routine 39 may end. Once the language has been determined properly, the linguistic objects of the text may be added to lists 29 that facilitate the generation of text in various disambiguation schemes. In certain circumstances, once the language has been determined properly, the linguistic objects of the text may be shown on display 11. For example, in certain languages, the encoding of certain letters or ideograms are the same. A user of the handheld electronic device 1 in Japan may not enjoy viewing Chinese characters appearing on display 11 because the processor did not have the ability to differentiate between the encoding of a Japanese and Chinese ideogram.
The above method identifies the language in a received e-mail. In addition to identifying the language of e-mails, other text received from sources outside the handheld electronic device 1 can also be scanned for new words. This can include identifying the language used in instant messages, SMS (short message service), MMS (multimedia service), and the like.
While specific embodiments of the disclosed and claimed concepts have been described in detail, it will be appreciated by those skilled in the art that various modifications and alternatives to those details could be developed in light of the overall teachings of the disclosure. Accordingly, the particular arrangements disclosed are meant to be illustrative only and not limiting as to the scope of the disclosed and claimed concepts which is to be given the full breadth of the claims appended and any and all equivalents thereof.

Claims

1-24. (canceled)

25. A method of identifying a language of text in an electronic device, the method comprising:

comparing, using a processor of the electronic device, linguistic objects associated with the text to a first set of linguistic objects to determine if a proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds a threshold, wherein the first set of linguistic objects is associated with a predetermined language; and

identifying the predetermined language as the language of the text based, at least in part, on a determination that the proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds the threshold.

26. The method of claim 25, further comprising:

determining an encoding associated with the text;

determining the linguistic objects associated with the text based, at least in part, on the determined encoding;

confirming the encoding associated with the text based, at least in part, on the determination that the proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds the threshold; and

displaying at least some of the linguistic objects associated with the text using the confirmed encoding.

27. The method of claim 25, further comprising:

adding new words to a word list associated with the identified language based on the linguistic objects associated with the text.

28. The method of claim 27, further comprising:

processing input from a keyboard to generate additional text in the identified language using the word list associated with the identified language.

29. The method of claim 25, further comprising:

comparing linguistic objects associated with the text to a second set of linguistic objects to determine if a proportion of the linguistic objects associated with the text that are found in the second set of linguistic objects reaches or exceeds a threshold, wherein the second set of linguistic objects is associated with a second predetermined language, wherein the second predetermined language is different from the predetermined language.

30. The method of claim 29, wherein predetermined language and the second predetermined language are different dialects of a same language.

31. A device comprising.

a processor;

a memory having instructions for identifying a language of text which, when executed by the processor, cause the device to:

compare linguistic objects associated with the text to a first set of linguistic objects to determine if a proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds a threshold, wherein the first set of linguistic objects is associated with a predetermined language; and

identify the predetermined language as the language of the text based, at least in part, on a determination that the proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds the threshold.

32. The device of claim 31, wherein the instructions, when executed by the processor, further cause the device to:

determine an encoding associated with the text;

determine the linguistic objects associated with the text based, at feast in part, on the determined encoding;

confirm the encoding associated with the text based, at least in part, on the determination that the proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds the threshold; and

display at least some of the linguistic objects associated with the text using the confirmed encoding.

33. The device of claim 31, wherein the instructions, when executed by the processor, further cause the device to:

add new words to a word list associated with the identified language based on the linguistic objects associated with the text.

34. The device of claim 33, wherein the instructions, when executed by the processor, further cause the device to:

process input from a keyboard to generate additional text in the identified language using the word list associated with the identified language.

35. The device of claim 31, wherein the instructions, when executed by the processor, further cause the device to:

compare linguistic objects associated with the text to a second set of linguistic objects to determine if a proportion of the linguistic objects associated with the text that are found in the second set of linguistic objects reaches or exceeds a threshold, wherein the second set of linguistic objects is associated with a second predetermined language, wherein the second predetermined language is different from the predetermined language.

36. The device of claim 35, wherein predetermined language and the second predetermined language are different dialects of a same language,

37. A non-transitory computer-readable medium comprising instructions for an electronic device for identifying a language of text, the instructions, when executed by a processor, cause the electronic device to perform operations comprising:

comparing linguistic objects associated with the text to a first set of linguistic objects to determine if a proportion of the linguistic objects associated with the text that are found in the first set of linguistic objects reaches or exceeds a threshold, wherein the first set of linguistic objects is associated with a predetermined language; and

38. The non-transitory computer-readable medium of claim 37, wherein the instructions, when executed by the processor, further cause the electronic device to perform operations comprising:

determining an encoding associated with the text;

39. The non-transitory computer-readable medium of claim 37, wherein the instructions, when executed by the processor, further cause the electronic device to perform operations comprising:

40. The non-transitory computer-readable medium of claim 39, wherein the instructions, when executed by the processor, further cause the electronic device to perform operations comprising:

41. The non-transitory computer-readable medium of claim 37, wherein the instructions, when executed by the processor, further cause the electronic device to perform operations comprising:

42. The non-transitory computer-readable medium of claim 41, wherein predetermined language and the second predetermined language are different dialects of a same language.