WO2002080087A1

WO2002080087A1 - Two-dimensional code, method for converting two-dimensional code into speech, method for converting text document into speech, braille data creation apparatus

Info

Publication number: WO2002080087A1
Application number: PCT/JP2002/003207
Authority: WO
Inventors: Naoyuki Okochi; Takuo Obata; Kouzo Kuroiwa; Tsutomu Fujita; Satoshi Mizoguchi
Original assignee: Kosaido Co., Ltd.; Original Design Inc.
Priority date: 2001-03-29
Filing date: 2002-03-29
Publication date: 2002-10-10
Also published as: WO2002080087A8; AU2002244953A1

Abstract

A two-dimensional code (3) consists of a first figure including line segments (LS11-LS14, LS31-LS34, LS51-LS54, LS71-LS74) arranged at pitches corresponding to a small region size around a data block (2) and index lines (R21-R24, R41-R44, R61-R64, R81-R84) orthogonally extending from substantially the center of each segment and an L-shaped second figure (LC) having ends continuous with ends of the segments (LS54 and LS74). The index lines (R21-R24, R41-R44) are arranged to face the outside of the data block (2) while the index lines (R61-R64, R81-R84) are arranged to face the data block (2). In accordance with these index lines, data density information and positioning information are fetched during decoding.

Description

Description Two-dimensional code, two-dimensional code reading method, two-dimensional code speech device, two-dimensional code speech method, two-dimensional code encoder, two-dimensional code encoding method, text document speech method, braille data creation device , Braille data creation method, program, and computer-readable recording medium

Technical field

The present invention relates to a two-dimensional code, a two-dimensional code reading method, a two-dimensional code sounding device, a two-dimensional code sounding method, a two-dimensional code encoder, a two-dimensional code encoding method, a text document sounding method, and a sentence. The present invention relates to an apparatus, a method, a program, and a recording medium readable from a computer for performing a transliteration. In particular, the present invention relates to a two-dimensional code capable of improving data density, a method of reading the two-dimensional code, and processing of information encoded in a two-dimensional dot matrix type two-dimensional code to process data in various forms including audio output. 2D code speech output device, 2D code speech conversion method, 2D code encoder, 2D code encoding method, Text document displayed on the screen of the combi- A text document voice method for voice conversion using sound quality elements, a Braille data generation device that generates Braille data from an intermediate language for voice generated by text-to-speech synthesis processing, a Braille data generation method, and these methods The present invention relates to a program to be executed and a recording medium which can be read overnight. Landscape technology

Since two-dimensional codes can encode multiple types of characters and have an error correction function, they have been used in fields such as distribution and product management, and various forms of two-dimensional codes have been developed. .

Conventional two-dimensional codes are used only to replace one-dimensional barcodes.Therefore, the required specifications, such as management codes and accompanying information, are limited to small volumes. It was enough to store the information. In recent years, there has been increasing momentum to support the independence of people with disabilities and actively promote social participation. In such a movement, the inventor of the present application examined the use of a two-dimensional code in developing a text-to-speech apparatus for the visually impaired. As a specification of the utility aspect Karaso, 1 page text information, specifically, can be stored in 8 0 0 of about characters for example 2 cm ² symbols in Japanese, and printed in evening commercial laser purine It was required to be able to do it.

However, if the above-mentioned required specifications were to be realized with conventional two-dimensional codes, printing at a desired density would not provide a sufficient reading rate, while printing at a readable density would increase the size too much. Problem has occurred.

One of the causes of such a problem is that conventional two-dimensional codes are not designed to store the above-mentioned large-capacity information. That is, the head becomes larger. Another problem with the read rate is that it is not possible to ensure sufficient positioning accuracy when sampling data cells. Conventionally, as one method of indicating the print pitch of a data cell, there has been an attempt to alternately arrange light and dark figures having the same size as the data cell for each cell. However, with this method, when printing at high density with the current laser printer, it was difficult to increase the accuracy due to printer-specific characteristics, such as toner particles being scattered or blurred. On the other hand, if the positioning can be performed with sufficient accuracy, it is possible to sufficiently combine the reading and image reading by image processing or error correction code processing even if there is some toner scattering or fading in printing. There was found.

Conventionally, as a symbol information device, for example, as described in Japanese Patent Application Laid-Open No. Hei 7-214939, storage information is recorded in a host device in advance and recorded in a one-dimensional code. A system that outputs the stored information by voice by providing the function of a calling function, or, as described in Japanese Patent Application Laid-Open No. 7-182379, converts data read from a bar code into voice. Mobile terminal devices for transmitting data have been known.

Further, as described in Japanese Patent Application Laid-Open No. 7-175883, an apparatus and a method for reading a matrix type two-dimensional code and converting symbol data into text document data are also known. . However, the dot-matrix two-dimensional code must be read and decoded by the single device itself, output as voice from the built-in speaker via the regular voice synthesis processor, and output data for Braille printing. It was not possible until now.

Conventionally, as a two-dimensional code sounding device and a two-dimensional code sounding method, a text document is converted into a two-dimensional code and printed, and the two-dimensional code symbol is decoded by a reading device and output from a voice synthesizing device. Many attempts have been made to do so. There are also many text-to-speech software products on the market. In these softwares, the sound quality elements of the entire document are set first, and the sound quality elements are fixed from the beginning to the end of the text document. It was voiced.

Therefore, it is difficult for a conventional two-dimensional code sounding device and two-dimensional code sounding method to include a plurality of sound quality elements in a single text document. Had been voiced.

However, when the entire text document was vocalized with a single sound quality element, it was very monotonous, and had a problem that the listener was bored. In particular, when multiple sentences that compose a document are described on the assumption that there are a plurality of different speakers, the current situation in which such a text document is transcribed from the beginning to the end with the same sound quality element is not suitable. There was the problem of being natural and of little change.

In the past, computer braille translation was used to perform Japanese parsing on kanji and kana mixed sentences while referring to a dictionary and output braille data.

On the other hand, as a text-to-speech synthesizer, for example, as described in Japanese Patent Application Laid-Open No. H11-3338673, Japanese-language analysis processing is performed on sentences mixed with kanji and kana, and speech synthesis parameters are obtained. In some cases, it was converted to an intermediate language with an overnight message and output as speech synthesis. That is, in the conventional text-to-speech synthesizing apparatus, the intermediate language is used only for outputting speech data.

However, there is a case where one sentence is desired to be selectively output in Braille and voice. In such a case, Braille is converted by text-to-Braille conversion, while voice is converted by text-to-speech conversion and synthesis. Two methods had to be used. For this reason, twice Japanese analysis is required, which is inefficient. was there. Disclosure of the invention

A first object of the present invention is to provide a large-capacity and small-sized two-dimensional code which can be printed by a general-purpose laser printer and secure sufficient positioning accuracy, a reading method thereof, a program, and a computer-readable recording medium. It is in.

A second object of the present invention is to provide a two-dimensional code speech device that can read a dot matrix type two-dimensional code, process the read code information, and output data in a form usable from any of visual, auditory, and tactile senses Another object of the present invention is to provide a two-dimensional code speech conversion method, a program, and a computer-readable recording medium.

A third object of the present invention is to provide a two-dimensional code encoder, a two-dimensional code speech conversion device, a two-dimensional code encoding method, and a two-dimensional code encoding device, which enable a plurality of sentences in a text document to be vocalized by a plurality of different sound quality elements. It is an object of the present invention to provide a two-dimensional code conversion method, a text document conversion method, a program, and a recording medium readable by a computer.

A fourth object of the present invention is to provide a braille data generating apparatus and a braille data generating apparatus that perform braille translation along an actual spoken language from an intermediate language analyzed for text-to-speech conversion and synthesis without causing the problems described above. An object of the present invention is to provide a method, a program, and a computer-readable recording medium.

According to a first aspect of the present invention,

A data area in which binary data is encoded into cells and arranged to form a two-dimensional matrix; and a data area arranged to surround the first data area, and information on data density in the data area. A two-dimensional code comprising: a pattern that provides positioning information; and a pattern in which the adjacent first and second sides are close to the first data area; A substantially rectangular solid line in which the third side and the fourth side respectively opposed to the first side and the second side are separated from the first overnight area; A first projection and a second projection each arranged at a predetermined bit so as to extend outward from the second side, and the data area from the third side and the fourth side. Are arranged at a predetermined pitch so as to extend inward toward A third protrusion, a fourth protrusion, and the first side and the second side extending from the first end point which is the intersection of the first side and the second side. The fifth side and the sixth side, and the fourth side is extended from a second end point that is an end point of the first side different from the first end point. The arranged seventh protrusion and an eighth protrusion arranged so as to extend the third side from a third end point which is an end point of the second side different from the first end point. A two-dimensional code is provided, comprising: a protrusion; and a fourth end point, which is an intersection of the third side and the fourth side, wherein no protrusion is arranged.

According to the two-dimensional code, since the above-described pattern for providing the data density and the positioning information is provided, even if the occupation area of the data area is increased by increasing the number of the binary data, The cells can be positioned in one pattern. As a result, the area occupied by the entire two-dimensional code can be made much smaller than a simple multiple of the amount of information stored in the data area. As a result, a two-dimensional code that stores a large amount of information at a high density is provided.

The first to eighth projections function as a headline for acquiring the data density and the positioning information in the read image. That is, the fifth and sixth protrusions are arranged at the first end point, and the seventh and eighth protrusions are arranged at the second and third end points, respectively. Since no projection is provided at the fourth end point, the fourth end point can be selected as a reference point for specifying the position coordinates of the cell in the read image. In addition, since the first to fourth protrusions are arranged on the rectangular solid line at predetermined pitches respectively, by calculating the number of these protrusions, the binary symbol encoded in the data area is calculated. The quantity of data can be calculated. This makes it possible to acquire information on the data density in the data area. Further, by providing straight lines connecting the projections in the read image, it is possible to specify the position coordinates of the cell based on the coordinates of the intersection of these straight lines.

It is desirable that the line widths of the first to fourth sides and the widths of the first to eighth protrusions are set in accordance with the size of the cell.

The first protrusion has a first length from the first end point toward the second end point. N (where N is a natural number) are arranged at a pitch of a second length from the first end point to the third end point at a pitch of a second length from the first end point to the third end point. ), The N third protrusions are arranged at a pitch of the first length from the third end point toward the fourth end point, and the fourth protrusion is It is preferable that the M pieces are arranged at a pitch of the second length from the second end point to the fourth end point. The data capacity of the data area can be easily calculated by recognizing the first to fourth protrusions and specifying the specific quantities of N and M.

According to the two-dimensional code, the data area is provided so as to surround the data area, and has a substantially rectangular pattern provided with a plurality of protrusions for providing the data density and the positioning information of the data area. Regardless of the amount of data stored in the area, each cell can be positioned in a single pattern. This provides a two-dimensional code that stores a large amount of information and has high reading accuracy.

According to a second aspect of the present invention,

A data part in which the binarized data bits are encoded as a square data cell of a bright part or a dark part and arranged so as to form a two-dimensional matrix; and a data part arranged around the data part, and A two-dimensional code, comprising: a first figure that provides information on a print pitch; and a second figure that is arranged around the data section and that provides information on the rotation direction of the cell. The part is a square small area in which the N cells (N is a natural number) are arranged adjacent to each other in the first and second directions orthogonal to each other. (L is a natural number) and M (M is a natural number) are arranged adjacent to each other in the above two directions, and the shape of the periphery of the data part is the first side in the second direction. And a second side orthogonal to the first side and orthogonal to each other And a third and fourth side respectively opposed to the first and second sides, and the first figure is arranged close to the data section along the first side. (M + 1) first lines spaced apart from each other at a pitch corresponding to the size of the small area starting from the vicinity of the intersection of the first side and the second side And (M + 1) second line segments provided so as to protrude from the center of the first line segment toward the outside of the data section in the first direction. Are arranged in close proximity to the data section along the second side, and are spaced apart from each other at a pitch corresponding to the size of the small area with a vertex of the first line segment as a starting point. The (L + 1) third line segments arranged, and the third line segments are provided so as to protrude from the center of the second line segments in the second direction toward the outside of the data portion. The (L + 1) fourth line segments and a line connecting the vertices of the fourth line segment are separated from each other along the line parallel to the third side in the data section. (M + 1) fifth line segments spaced apart from each other at a pitch corresponding to the size of the above small area starting from one point, and deviate from the extension line of the corresponding second line segment (M + 1) sixth line segments arranged so as to extend from substantially the center of the fifth line segment toward the de-night area, and It is arranged at a distance from the data section along a line parallel to the fourth side, and is spaced apart from each other at a pitch corresponding to the size of the small area starting from a point on a line connecting the vertices of the second line segment. (L + 1) 7th line segments and corresponding 4th line segments are respectively arranged on the extension lines, and from the approximate center of the 7th line segment to the data section An eighth line segment provided so as to protrude, and the second figure has the (M + 1) -th fifth line segment at both ends thereof.

It is an L-shaped figure provided so as to be continuous with the (L + 1) th seventh line segment, and the fifth line segment and the seventh line segment are the sixth line segment. A two-dimensional code is provided, wherein a vertex and a vertex of the eighth line segment are spaced apart from the data portion so as to be spaced apart from the third side and the fourth side, respectively. .

According to a third aspect of the present invention,

The method for reading a two-dimensional code according to the first aspect of the present invention described above, comprising: a procedure for acquiring an image of the two-dimensional code; A step of cutting out a rectangular area surrounding the pattern so as to be in contact with the end point and to include at least a part of the seventh protrusion and at least a part of the eighth protrusion; The end points, the seventh projecting portion, the eighth projecting portion, and the respective contacts of the periphery of the rectangular area are specified as a first contact, a second contact, and a third contact, respectively. A step of recognizing a contact point between the fifth or sixth protrusion and the periphery of the rectangular area as a fourth contact point, and a step of connecting the first contact point and the second contact point.

Set the first line segment and set the second line segment connecting the first contact and the third contact And setting a first virtual line parallel to the first line segment and moving the first virtual line from the fourth contact point to the third contact point. A step of recognizing a third protrusion and the second side; and setting a second virtual line parallel to the second line segment to direct the direction from the fourth contact to the second contact. By moving the second projection, the fourth projection, and the first side, based on the number of the recognized first to fourth projections. A procedure for calculating the capacity of the binary data in the data area; and a coordinate system using the first line segment and the second line segment as an X axis or a Y axis, or a side forming a periphery of the rectangular area. A procedure of setting a coordinate system in which two sides orthogonal to each other are set as an X axis or a Y axis and specifying the coordinates of each cell in the data area; Reading how the two-dimensional code and a procedure for converting the binary data the symbolized on the basis of the cell coordinate to bit Retsude Isseki is provided.

According to the two-dimensional code reading method, the position coordinates of each cell in the read image are specified based on the plurality of protrusions, so that the symbolized binary data can be restored with high accuracy. . Further, since the capacity of the binary data in the data area is calculated based on the recognized number of the first to fourth protrusions, the data density of the data area can be easily and quickly obtained. Can be. According to a fourth aspect of the present invention,

The method for reading a two-dimensional code according to the second aspect of the present invention described above, comprising: a step of acquiring an image of the two-dimensional code; and a step in which the periphery of the second graphic is acquired in the acquired image. A rectangle surrounding the pattern so as to be in contact with the corner portion and to include at least a part of the first fifth line segment and at least a part of the first seventh line segment. A step of cutting out an area, a contact point with the corner portion, a contact point between the first seventh line segment and the periphery of the rectangular area, and the first fifth line segment and the rectangular area The first contact point, the second contact point, and the third contact point are identified as the first contact point, the second contact point, and the third contact point, respectively. A step of recognizing a contact point with the periphery of the rectangular area as a fourth contact point; and a step of recognizing the first contact point and the second contact point. Setting a ninth segment connecting the first contact and the third contact, and setting a 10th segment connecting the third contact and the first contact parallel to the ninth segment. By setting a virtual line and moving it from the second contact point to the fourth contact point, the seventh line segment, the second line segment, the sixth line segment, and the third line segment are moved. And a second virtual line parallel to the 10th line segment is set and moved in the direction from the third contact point to the fourth contact point. Recognizing the fifth line segment, the fourth line segment, the eighth line segment, and the first line segment, and recognizing the second, fourth, sixth, and eighth line segments. Calculating the capacity of the above data in the data section based on the quantity of the above, and setting a coordinate system in which two sides orthogonal to each other among the sides forming the periphery of the rectangular area are set as the X axis or the Y axis. A procedure for specifying the coordinates of each cell in the data section, and converting the encoded data into a bit string based on the cell coordinates. According to a fifth aspect of the present invention method for reading two-dimensional codes having a forward, a is provided,

A program is provided for executing the method of reading a two-dimensional code according to the third aspect of the present invention in the evening.

According to a sixth aspect of the present invention,

There is provided a recording medium readable by a computer which records a program for executing the method for reading a two-dimensional code according to the third aspect of the present invention in the evening.

According to a seventh aspect of the present invention,

There is provided a program for executing the above-described method for reading a two-dimensional code according to the fourth aspect of the present invention all at once on a computer.

According to an eighth aspect of the present invention,

There is provided a recording medium readable by a computer which stores a program for executing the method for reading a two-dimensional code according to the fourth aspect of the present invention.

According to a ninth aspect of the present invention,

Upon receiving input of decoded processing data obtained by decoding image data of a first two-dimensional code in which first information including a text document is encoded and recorded, the decoding processing is performed. Intermediate data for creating an audio waveform signal from the night A phoneme code string data generating unit for generating a certain phoneme code string data; a rule speech synthesis processing unit for processing the phoneme code data to generate a speech waveform data; and processing the phoneme code string data. A two-dimensional code conversion device, comprising: a braille translation unit that generates Braille data by using a voice translation unit; and an output control unit that selectively outputs at least one of the audio waveform data and the Braille data.

According to the two-dimensional code speech conversion device, a braille translation unit that processes the phoneme code string data to generate Braille data, and selectively outputs at least one of the speech waveform data and the Braille data And an output control unit that performs the above operation, so that the information encoded in the two-dimensional code can be selectively obtained through the auditory or tactile sense or the auditory and tactile senses.

The two-dimensional code speech conversion device further includes a text data creation unit for creating text data from the decoded data, and the output control unit includes the text data, the audio waveform data, and the braille data. It is good to selectively output at least one of the evenings. Thereby, the information of the two-dimensional code can be obtained through any combination of the auditory, tactile, and visual senses.

The output control unit encodes second information including connection control data for adapting the data format of the audio waveform data, the Braille data, or the text data to the specifications of each output device. An input of an output control signal obtained by decoding image data of the second two-dimensional code is received, and based on the output control signal, the audio waveform data, the braille data, or the data of the text data is received It is desirable to change the format. This makes it very easy to set and adjust the data format.

The two-dimensional code audio device may further include a storage unit having a plurality of storage areas for storing the data to be decoded. This makes it possible to collectively process the decoded data obtained from a plurality of two-dimensional codes. _T The two-dimensional code sound conversion device decodes the image data It is preferable that the apparatus further comprises a decoding unit for outputting the decoded data after the decoding process, and an audio output unit for receiving the input of the audio waveform data and outputting the text document as audio. Further, the two-dimensional code speech conversion device may be configured such that the first two-dimensional code or the second It is preferable to further include an imaging unit that captures the two two-dimensional codes and outputs the image data.

In a preferred embodiment of the two-dimensional code audio device according to the present invention, the imaging section is provided with an opening for receiving the two-dimensional code, and a light source disposed at a position close to the opening; An illumination mechanism having a light diffusion lens disposed so as to cover the light source; and an imaging element provided at a position facing the opening of the illumination mechanism and imaging the two-dimensional code, The surface of the diffusion lens is processed so as to form frosted glass, and the illumination mechanism is provided so as to extend from at least the light source to a position where the imaging element is mounted, and opens the light from the light source. The image display device further includes a cylindrical diffuse reflection member provided on the inner peripheral surface with a diffuse reflection material for uniformly irradiating the mouth. The image sensor is, for example, an image sensor such as a CCD element or a CMOS.

According to a tenth aspect of the present invention,

A two-dimensional code imaging step of imaging a first two-dimensional code in which first information including a text document is encoded and recorded and outputting first image data; and the first image data A decoding process of decoding the decoded data and outputting decoded data; a phoneme code sequence data generating process of generating phoneme code sequence data which is intermediate data for generating an audio waveform signal from the decoded data. A rule speech synthesis process for creating the speech waveform data by processing the phoneme sequence code data; a braille translation process for creating the Braille data by processing the phoneme code sequence data; A two-dimensional code conversion method comprising: an output control process for selectively outputting at least one of the Braille data.

According to the two-dimensional code speech conversion method, a braille translation process of processing the phoneme code string data to generate Braille data, and selectively selecting at least one of the speech waveform data and the Braille data And an output control step of outputting the information to the two-dimensional code, so that the information encoded in the two-dimensional code can be selectively acquired through the auditory or tactile sense or the auditory and tactile senses.

The two-dimensional code speech conversion method further includes a text data creation step of creating a text data from the decoded data, and the output control step includes: It is desirable to selectively output at least one of the text data, the audio waveform data, and the Braille data. Thereby, the information of the two-dimensional code can be obtained through any combination of hearing, touch, and vision.

The two-dimensional code imaging process includes a second process including connection control data for adapting the audio waveform data, the braille data, or the text data format described above to the specifications of each output device. And outputting a second image data by imaging a second two-dimensional code in which the information of the second image data is symbolized. The decoding process decodes the second image data and outputs a connection control signal. Preferably, the output control step includes a step of changing the audio waveform data, the Braille data, or the text / data format based on the output control signal. This makes it very easy to set and adjust the data format.

According to a eleventh aspect of the present invention,

There is provided a program for causing a computer to execute the above-described two-dimensional code conversion method. Thus, the two-dimensional code speech conversion method according to the present invention can be realized using a general-purpose combination.

According to a first and second aspect of the present invention,

A recording medium which stores a program for causing a computer to execute the above-described two-dimensional code conversion method is provided.

According to a thirteenth aspect of the present invention,

A display unit for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis; and allowing the user to select an arbitrary sentence from the displayed document and to correspond to the selected sentence. A selection unit that allows a user to select the sound quality element from the plurality of sound quality elements; and a sound quality element attribute switching control signal for causing the sentence to be subjected to speech synthesis processing using the selected sound quality element. A control signal adding section to be added in the evening, and the text data of the text is converted into a two-dimensional code together with the sound quality element attribute switching control signal, and the sound quality is obtained by encoding the sound quality element attribute switching control signal. And a two-dimensional code encoder for generating a two-dimensional code including a control symbol for element attribute switching.

According to the above-described two-dimensional code encoder, the selection unit is configured to perform the task based on the text document. The user is allowed to select a desired sentence, and the user is allowed to select a sound quality element corresponding to the selected sentence from the plurality of sound quality elements, and the encode section converts the text data of the sentence into the sound quality element attribute. Since it is encoded into a two-dimensional code together with the switching control signal, it is possible to create a two-dimensional code that enables speech by a plurality of sound quality elements in the two-dimensional code speech processing.

According to a fifteenth aspect of the present invention,

A storage unit for storing a plurality of different sound quality elements for regular speech synthesis, a symbol in which the text of the text is coded, and a symbol selected corresponding to the text and added to the text of the text. A two-dimensional code reading unit for reading a two-dimensional code including a sound quality element attribute switching control signal coded with a sound quality element attribute switching control signal for causing the above-mentioned text to be subjected to speech synthesis processing with the sound quality element; A decoding unit for decoding the two-dimensional code and outputting the text data of the sentence and the control signal for switching the sound quality element attribute added to the text data; and the control for switching the sound quality element attribute. Based on the signal, the sound quality element corresponding to the selected sound quality element is extracted from the storage unit, and the sentence is converted into a speech using the extracted sound quality element. And a two-dimensional code audio device comprising:

According to the two-dimensional code speech conversion device according to the fourteenth aspect of the present invention, the two-dimensional code image data including the sound quality element attribute switching control symbol added to the symbolized text is converted to the deco-coded data. And the voice synthesis unit decodes the sentence with a sound quality element that matches the selected sound quality element based on the sound quality element attribute switching control signal. Can be converted into speech with different sound quality elements for each sentence.

According to a fifteenth aspect of the present invention,

A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis, and allowing the user to select an arbitrary sentence from the displayed document, A selection procedure for causing a user to select the corresponding sound quality element from the plurality of sound quality elements, and a sound quality element attribute switching control signal for causing the text to be subjected to speech synthesis processing using the selected sound quality element; A control signal adding procedure to be added to the text data and the text quality attribute of the text An encoding procedure for coding into a two-dimensional code together with the switching control signal and creating a two-dimensional code including a sound quality element attribute switching control symbol in which the sound quality element attribute switching control signal is coded; A two-dimensional code encoding method comprising: According to the encoding method described above, a user is allowed to select an arbitrary sentence from a text document, and the user is allowed to select a sound quality element corresponding to the selected sentence from the plurality of sound quality elements. And an encoding procedure for encoding the text data of the text into a two-dimensional code together with the control signal for switching the sound quality element attribute. A two-dimensional code can be created. According to a sixteenth aspect of the present invention,

A symbol in which the text of the text is coded, and a sound quality element attribute for causing the text to be subjected to speech synthesis processing with the sound quality element selected corresponding to the text and added to the text of the text. A two-dimensional code reading procedure for reading a two-dimensional code including a sound quality element attribute switching control symbol in which a switching control signal is coded; and decoding the read two-dimensional code to read the text data of the text. A decoding procedure for outputting the sound quality element attribute switching control signal added to the text data, and matching the selected sound quality element based on the sound quality element attribute switching control signal. A speech synthesis procedure for extracting a sound quality element from a plurality of pre-registered sound quality elements, and converting the sentence into a speech using the extracted sound quality element. A method is provided.

According to the two-dimensional code speech conversion method according to the sixteenth aspect of the present invention, the two-dimensional code including the sound quality element attribute switching control symbol added to the symbolized text is decoded and decoded. Based on the sound quality element attribute switching control signal, the sentence is voice-processed with a sound quality element that matches the selected sound quality element, so that a document including a plurality of texts is voiced with a different sound quality element for each text. According to a seventeenth aspect of the present invention,

A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis, and allowing the user to select an arbitrary sentence from the displayed document, The corresponding sound quality element is set from the plurality of sound quality elements. A control signal adding procedure for adding a sound quality element attribute switching control signal for causing the sentence to be subjected to speech synthesis processing with the selected sound quality element to the text data of the sentence, The text data of the text is converted into a two-dimensional code together with the sound quality element attribute switching control signal, and the sound quality element attribute switching control signal includes a coded sound quality element attribute switching control symbol. An encoding procedure for creating a two-dimensional code, a two-dimensional code reading procedure for reading the two-dimensional code, a decoding of the two-dimensional code that has been read, the text data of the text, and the sound quality element. A decoding procedure for outputting an attribute switching control signal, and a tone element that matches the selected tone element based on the tone element attribute switching control signal are registered in advance. Removed from the plurality of the sound elements, text document-speech method and a speech synthesis procedure for handling audio of the upper Symbol sentence above retrieved sound element is provide.

According to an eighteenth aspect of the present invention,

A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis, and allowing the user to select an arbitrary sentence from the displayed document, A selection procedure for causing a user to select the corresponding sound quality element from the plurality of sound quality elements, and a sound quality element attribute switching control signal for causing the text to be subjected to speech synthesis processing using the selected sound quality element; A control signal adding procedure to be added to the text data of the above, and the text data of the text are converted into a two-dimensional code together with the sound quality element attribute switching control signal, and the sound quality element attribute switching control is performed. A code encoding procedure for creating a two-dimensional code including a signal-coded sound quality element attribute switching control symbol, and an encoding method for a two-dimensional code comprising: Program is provided.

Thus, the above-described encoding method can be realized using a general-purpose computer.

According to a nineteenth aspect of the present invention,

For switching sound quality element attributes for causing the text to be subjected to speech synthesis processing with a symbol in which the text of the text is encoded and a sound quality element selected corresponding to the text and added to the text data of the text. Control system for switching sound quality element attributes with coded control signals A two-dimensional code reading procedure for reading a two-dimensional code including a symbol, and the read two-dimensional code is decoded to read the text data and the text data of the text. A decoding procedure for outputting the added sound quality element attribute switching control signal, and a plurality of sound quality elements that match the selected sound quality element are registered in advance based on the sound quality element attribute switching control signal. And a voice synthesis procedure for converting the sentence into a voice using the extracted voice quality element, and a program for executing a two-dimensional code voice conversion method including the following.

Thus, the two-dimensional code speech conversion method according to the sixteenth aspect of the present invention can be realized using a general-purpose computer.

According to a 20th aspect of the present invention,

A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis, and allowing the user to select an arbitrary sentence from the displayed document, A selection procedure for causing a user to select the corresponding sound quality element from the plurality of sound quality elements, and a sound quality element attribute switching control signal for causing the text to be subjected to speech synthesis processing using the selected sound quality element; A control signal adding procedure to be added to the text data of the above, and converting the text data of the text into a two-dimensional code together with the sound quality element attribute switching control signal, wherein the sound quality element attribute switching control signal is An encod- ing procedure for creating a two-dimensional code including a coded sound quality element attribute switching control symbol, and a computer executing a two-dimensional code encod- ing method comprising: Provided is a recording medium readable by a convenience store storing a program to be read.

According to a twenty-first aspect of the present invention,

For switching a sound quality element attribute for performing a speech synthesis process on the above-mentioned sentence with a symbol in which the text data of the sentence is coded and a sound quality element selected corresponding to the above-mentioned sentence and added to the text data of the above-mentioned sentence A two-dimensional code reading procedure for reading a two-dimensional code including a sound quality element attribute switching control symbol in which a control signal is coded; decoding the read two-dimensional code to read the text data of the text; A decoding procedure for outputting the sound quality element attribute switching control signal added to the text data overnight; and the selected sound quality element switching based on the sound quality element attribute switching control signal. Executing a two-dimensional code speech conversion method comprising: extracting a sound quality element that matches the element from a plurality of pre-registered sound quality elements and converting the sentence into a speech using the extracted sound quality element. A storage medium that stores a program for storing the program to be read is provided.

It is preferable that the above-described two-dimensional code encoding method further includes a confirmation step of switching the display mode of the above-mentioned document selected in the selection step to inform the user that the selection of the sound quality element has been received.

Further, the selecting step is a step of causing the user to select a plurality of sentences from the displayed document and allowing the user to select the sound quality element so that a plurality of different sound quality elements correspond to the plurality of sentences. Good to be. The selection of the sound quality element is not limited to each sentence, and one sound quality element may be selected for a plurality of sentences.

The two-dimensional code described above includes at least one of a matrix-type two-dimensional code and a stack-type two-dimensional code.

According to a twenty-second aspect of the present invention,

Provided is a braille data generating apparatus including a braille translator for receiving an intermediate language, which is intermediate data for generating a speech waveform signal from text data, and processing the intermediate language to generate braille data. You.

Since the above-mentioned braille data creation device is provided with the above-mentioned braille translator, it is possible to create a braille data different from speech using an intermediate language for speech conversion synthesis. As a result, data for information transmission via tactile sensation can be created using an intermediate language originally formed for information transmission via hearing.

It is preferable that the above-mentioned braille data creating apparatus further comprises a condition setting section for setting conditions for creating the above-mentioned braille data.

According to a preferred embodiment of the present invention, the braille translation unit includes a Braille conversion unit that converts the intermediate language into the Braille code with reference to a conversion table that associates the intermediate language with the Braille code.

When the intermediate language includes segment break information indicating a segment break of the text converted into the text data, the braille data creating device may include the segment break data. It is preferable that the system further includes a separating unit that performs a separating process based on the cut information, and further performs a word wrap process on the Braille code converted by the Braille converting unit based on the segment break information. It is more preferable to provide one drap portion.

Further, it is preferable that the Braille data creating apparatus further includes a Braille data output unit that adjusts the format of the Braille data so as to conform to the output format of the output destination and outputs the Braille data. As a result, it is possible to output the braille code data together with the data for controlling the output destination braille output device.

The above-described condition setting unit sets at least one of the processing conditions of the intermediate language, the type of the conversion table, the number of characters of the word wrapping process, and the format of the braille data. When the type of the conversion table is set, a desired conversion table can be selected from a plurality of conversion tables. When the number of characters for the word wrap process is set, the word wrap mode can be easily changed according to the mode of the document to be reproduced as Braille and the type of the Braille output device.

According to a twenty-third aspect of the present invention,

There is provided a Braille data creation method including a Braille translation procedure for creating an Braille data by processing an intermediate language, which is intermediate data for creating an audio waveform signal from a text data.

According to a twenty-fourth aspect of the present invention,

Provided is a program for causing a computer to execute a braille data creation method including a braille translation procedure for creating an Braille data by processing an intermediate language, which is intermediate data for creating an audio waveform signal from text data. .

According to a twenty-fifth aspect of the present invention,

A program storing a program for causing a computer to execute a braille data creation method including a braille translation procedure for creating an Braille data by processing an intermediate language, which is intermediate data for creating an audio waveform signal from text data. An evening-readable recording medium is provided.

According to a preferred embodiment of the braille data creation method according to the present invention, the braille translation procedure includes the step of referring to the conversion table in which the intermediate language and the braille code are associated with each other. It includes a Braille conversion procedure for converting a language into the Braille code.

If the intermediate language includes segment break information indicating the segment break information of the text converted to the text data, the braille translation procedure includes a segmentation processing procedure for performing a segmentation process based on the segment break information. Preferably, the method for creating braille data further includes a word wrap processing procedure for performing word wrap processing on the braille code obtained by the braille conversion procedure on the basis of the phrase separation information. It is more preferable to provide.

It is preferable that the Braille conversion procedure and the break processing procedure included in the above-described Braille data creation method be performed simultaneously. This simultaneous processing is made possible by allocating a second braille code corresponding to the phrase delimiter to the conversion table in addition to the first braille code corresponding to the reading information of the text. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a schematic diagram showing a first embodiment of a two-dimensional code according to the present invention. C FIG. 2 is a diagram illustrating a two-dimensional code reading method according to a first embodiment of the present invention. FIG.

FIG. 3 is a flowchart illustrating a schematic procedure of the reading method illustrated in FIG. 2 _c FIG. 4 is a schematic diagram illustrating a second embodiment of the two-dimensional code according to the present invention _c FIG. FIG. 9 is an explanatory diagram of a second embodiment of a two-dimensional code reading method according to the present invention.

FIG. 6 is a flowchart for explaining the schematic procedure of the reading method shown in FIG. 5. c FIG. 7 is a block diagram showing a first embodiment of the two-dimensional code audio device according to the present invention. .

FIG. 8 is a side view of an imaging unit included in the two-dimensional code audio device illustrated in FIG. FIG. 9 is a top view of the imaging unit shown in FIG. 8 when cut along the line JJ in FIG.

FIG. 10 is a block diagram showing a specific configuration of a microcontroller included in the two-dimensional code audio device shown in FIG.

FIG. 11 is a schematic diagram of a first embodiment of a two-dimensional code speech conversion method according to the present invention. 5 is a flowchart showing a procedure.

FIG. 12 is a flowchart showing a schematic procedure of the first embodiment of the two-dimensional code speech conversion method according to the present invention.

FIG. 13 is a block diagram showing an embodiment of a two-dimensional code encoder according to the present invention and a second embodiment of a two-dimensional code audio device according to the present invention. FIG. 14 is a flowchart illustrating a schematic procedure of an embodiment of a two-dimensional code encoding method according to the present invention.

FIG. 15 is an explanatory diagram of a specific procedure of the two-dimensional code encoding method shown in FIG.

FIG. 16 is an explanatory diagram of a specific procedure of the two-dimensional code encoding method shown in FIG.

FIG. 17 is an explanatory diagram of a specific procedure of the encoding method of the two-dimensional code shown in FIG.

FIG. 18 is an explanatory diagram of a specific procedure of the encoding method of the two-dimensional code shown in FIG.

FIG. 19 is a flowchart illustrating a schematic procedure of an embodiment of the text document speech conversion method according to the present invention.

FIG. 20 is a block diagram including an embodiment of the braille data creation device of the present invention.

FIG. 21 is an explanatory diagram of an embodiment of a braille data creation method according to the present invention. _C FIG. 22 is a flowchart showing a schematic procedure of the braille data creation method shown in FIG. 21. BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, some embodiments of the present invention will be described with reference to the drawings. (1) First embodiment of two-dimensional code

Figure 1, as shown in _c figure is a schematic diagram showing a first embodiment of a two-dimensional co-one de according to the present invention, the two-dimensional code 1 of the present embodiment, binarized data is dark Matrix data part 2 stored in the form of square cells A square arranged to surround the evening part 2 and a heading line (projection) consisting of a solid line extending vertically from each side al to d 1 of each of the squares al to d 1 (projections) R11 to: R14, R91 to R93, R31 to R33, R51 to R53, and R71 to R73. The rectangle and the heading lines R11 to R93 are patterns in the present embodiment, whereby data density information and positioning information are given using a reading method described later. The width of the rectangle and each header line is equal to the length of one side of the data cell.

The header lines R11 and R12 are arranged so as to extend from the point D along the sides b1 and a1, respectively. Heading line R13 is arranged to extend side d1 from point B, and heading line R14 is arranged to extend side c1 from point C. These headlines R11 to R14 correspond to the fifth to eighth protrusions in the present embodiment, respectively. Heading lines are not provided at only one point at point A (corresponding to the fourth end point) among the corners A to D of the rectangle. Thereby, as described later, the point A can be used as the origin of the two-dimensional code in the image processing to specify the position coordinates of each cell.

The header lines R 91 to R 93, R 31 to R 33, R 51 to R 53, and R 71 to R 73 each indicate the position of a particular cell in the row or column direction. The header lines R 91 to R 93 and R 51 to R 53 are arranged at a constant pitch P 1 on the sides a 1 and c 1 of the rectangle, respectively. This corresponds to the third projectile. Also, the header lines R31 to R33 and R71 to R73 are arranged at a constant pitch P2 on the sides bl and d1 of the rectangle, respectively. It corresponds to the projection of 4. The lengths of the pitches Pl and P2 are known constants, and have the same value in the present embodiment.

Heading lines R91-: R93, R31-R33 are arranged so as to extend outward from the sides a1, b1 of the rectangle. On the other hand, the header lines R51 to R53 and R71 to R73 are arranged so as to extend inward of the rectangle from the other adjacent two sides c1, d1. In the present embodiment, the lengths of the respective heading lines are all the same, but the sides c 1 and dl are set so that the inward heading lines R 51 to R 53 and R 71 to R 73 do not overlap with the matrix part 2. Are arranged apart from the periphery of the matrix data section 2. The number of header lines can be independently increased or decreased in each of the horizontal and vertical directions according to the number of data in the matrix data. Therefore, it is possible to configure a two-dimensional code of various sizes and shapes depending on uses such as a data capacity and a printing place. As described above, in the two-dimensional code 1 of the present embodiment, since there is no special print pattern for cutting out and positioning in the matrix data portion 2, more data can be obtained in a smaller area. Can be equipped with overnight. Furthermore, even if the data capacity is increased, since the cutout and positioning can be performed with a single pattern surrounding the matrix data section 2, the occupied area of the entire two-dimensional code is proportional to the increase in the data capacity. Much smaller than the size. As a result, a two-dimensional code that stores a large amount of information at a high density is provided.

(2) First embodiment of a two-dimensional code reading method

Next, a method for reading a two-dimensional code shown in FIG. 1 will be described as a first embodiment of a method for reading a two-dimensional code according to the present invention. Here, only the reading procedure specific to the two-dimensional code is shown, and detailed procedures and adjustments generally required in the reading process are omitted.

FIG. 2 is an explanatory diagram of the reading method according to the present embodiment. FIG. 3 is a flowchart showing a schematic procedure of the reading method shown in FIG.

1) First, digital image data of a two-dimensional code 1 is captured using an image sensor such as a CCD (step S 1).

2) Next, examine the distribution (histogram) of this image data in which the vertical and horizontal dark cells exist, and define a rectangular area A R 1 surrounding the two-dimensional code 1 as shown in Fig. 2.

(Step S2).

3) Next, a point that contacts each side of the periphery of the rectangular area AR1 is searched (step S3). In the case of Fig. 2, points A, E, F, and H are obtained.

4) Next, the dots on the line connecting the adjacent points of these points A, E, F, and H are examined, and the dark solid line corresponds to any line among the sides al to d1 of the rectangle. It is determined whether or not to perform (step S4). In the case shown in FIG. 2, it is determined that the line segment AE and the line segment AF respectively correspond to the solid lines of the sides dl and c1 of the rectangle. On the other hand, there is no corresponding solid line for line segment EH and line segment FH. Intersection A between line segment AE and line segment AF is quadratic Select as the origin of source code 1 (step S5).

5) Next, a line segment parallel to the line segment AF and having almost the same length is examined from point A to point E, line segment BH is specified, and point B and point H are specified from the end point. . Similarly, from the point A to the point F, a line segment CG which is parallel to the line segment AE and has almost the same length is examined, and the points C and G are obtained therefrom. Further, the line segment BH and the line segment CG are obtained. Identify the intersection D with (Step S6).

6) Next, a virtual dashed line (heading dashed line) which is parallel to the line segment AF and has the same length is set, and starting from point A, scanning in the direction of point E in the direction of bd1, bd2, etc. Then, the search is made for the entry lines R31 and R73, R32 and R72, and R33 and R71 (step S7). At this time, the distance from heading broken line bd1 connecting heading lines R31 and R73 to point A, and the length and pitch of each heading line are known constants in units of the data cell size. The position and length of each headline can be predicted on the basis of the positional relationship between the points A to D already specified in. Similarly, an imaginary dashed line which is parallel to the line segment AE and has the same length is set, and starting from the point A and scanning in the direction of the point F in the direction of ac l, ac 2. Search for R53, R92 and R52, and R91 and R51 (step S7). Here, the number of heading lines recognized as extending vertically inward from line segment AC (square side c 1) and vertically extending outward from line segment BD (square side a 1) The number of heading lines recognized as extending vertically inward from line segment AB (side dl of the rectangle) is also the same as the number of heading lines recognized as If the number of heading lines recognized to extend vertically outward from the line segment CD (side of the rectangle bl) is the same, it can be confirmed that the search for each heading line has been performed normally. Also, as described above, the number of heading lines is determined independently in each of the horizontal and vertical directions according to the number of data items in the matrix data area 2, so that the number of heading lines is recognized by each line segment (side). The size of the matrix data is determined according to the number of header lines.

7) Then, as shown by the dashed line in Fig. 2, line segments bd1 to bd3 that sequentially connect points on the headline recognized by two parallel , acl to ac3 are again assumed, and the intersection of these line segments n11 ~! The coordinates of ι33 are calculated (step S8). These coordinates are the data in the matrix data part 2. This is equivalent to extracting the coordinates of an overnight cell at equal intervals.

8) Further, from the coordinates of the intersection obtained in the above 7), the coordinate value of each cell is obtained from the known number of cells between the heading lines, and the binary value of each cell is sampled to be bit string data. (Step S9).

9) Finally, an error correction code is added to the bit string data of the two-dimensional code 1 in advance, and error correction is performed using this. As a result, the original data is restored (step S10).

As described above, according to the two-dimensional code reading method of the present embodiment, the data stored in the matrix data storage unit 2 can be restored with high accuracy by simple image processing, and the data capacity can be quickly reduced. Can be obtained.

(3) Second embodiment of two-dimensional code

FIG. 4 is a schematic diagram showing a two-dimensional code according to a second embodiment of the present invention. As shown in the figure, the two-dimensional code 3 of the present embodiment includes a matrix data section 2 in which binarized data is stored in the form of bright and dark square cells, and a matrix data section 2. Arranged line segments LN11 to LS14 (first line segment), LS31 to: LS34 (third line segment), LS51 to: LS54 (fifth line segment), LS71 to LS74 (7th line segment) Line segments) and heading lines R21 to R24 (second line segment), R41 to R44 (fourth line segment), R61 R64 (sixth line segment), R81 to R84 (eighth line segment), and L-shaped figures LC whose both ends are connected to the ends of LS54 and LS74.

The matrix data section 1 is composed of nine (L = M = 3) adjoining small areas (see Fig. 5) in each of the X and y directions. In the small area, N data cells (N is a natural number) are arranged adjacent to each other in both the X and y directions. In the present embodiment, the number of small regions is the same in both the X direction and the y direction. However, the number of small regions is not limited to this, and can be independently changed in the X direction and the y direction.

The above-described line segments constitute a first figure in the present embodiment, and the figure LC constitutes a second figure in the present embodiment. With these, the data density information (print pitch) and the rotation angle of the matrix data are given using the reading method described later. Can be The width of each line segment is the same as the length of one side of the data cell, and the length of each line segment is determined using the length of one side of the data cell as a basic unit.

The line segments LS11 to LS14 are respectively arranged at a pitch corresponding to the size of the small region along the side a2 of the square forming the periphery of the matrix portion 1. Similarly, the line segments L S31 to L S34 are arranged along the side b2 at pitches matching the size of the small area. On the other hand, the line segments LS51 to LS54 are arranged at a pitch corresponding to the size of the small region along a line parallel to the side c2 and separated from the side c2. Similarly, the line segments LS71 to 374 are also arranged at pitches corresponding to the size of the small area along a line parallel to the side (12) at a distance from the side (12).

The header lines R21-R24 each indicate the position of a particular cell in the row or column direction. The header lines R21 to R24 are arranged so as to extend outward from the matrix data section 2 from the line segments LS11 to LS14. Similarly, finding lines R41 to R44 are arranged so as to extend from line segments LS31 to LS34 toward the outside of matrix data section 2, respectively. On the other hand, headline R61 ~! 64 is disposed on each of the segments S51 to LS54 so as to extend from the line segments S51 to LS54 to the matrix data portion 2. Similarly, the heading lines R81 to R84 are respectively arranged so as to extend from the line segments LS71 to LS74 toward the matrix portion 2. In the present embodiment, the lengths of the heading lines are all the same, but the inward heading lines R61-: R64, R81-R84, so that the line segments S51-LS do not overlap with the matrix data section 2. 54, the line segments LS71 to LS74 are arranged apart from the periphery of the matrix data section 2.

The number of heading lines can be independently increased or decreased in each of the horizontal direction and the vertical direction according to the number of small regions included in the matrix data area 2 and the arrangement thereof. Therefore, it is possible to configure a two-dimensional code of various sizes and shapes depending on the application such as the capacity of the data and the printing place.

Since the L-shaped figure LC has a continuous orthogonal portion at the ends of the line segment LS 54 and the line segment LS 74, a rectangular area AR for cutting out so as to be in contact with the corner A in image processing at the time of reading described later. By setting 3, the rotation angle of the data cell can be obtained, and the corner A It can be used as the origin of the two-dimensional code 3 to specify a target.

As described above, in the two-dimensional code 3 of the present embodiment, since there is no special print pattern for cutting out, positioning, and the like in the matrix data section 2, more data can be obtained in a smaller area. Can be mounted. Also, even if the data capacity is increased, the cutout and positioning can be performed only with the first and second figures surrounding the matrix data section 2, so that the area occupied by the entire two-dimensional code increases with the data capacity. Much smaller than the proportional size. This enables printing with a general-purpose laser printer, and provides a two-dimensional code that stores a large amount of information at a high density.

(4) Second embodiment of the two-dimensional code reading method

Next, a method of reading a two-dimensional code shown in FIG. 4 will be described as a second embodiment of the method of reading a two-dimensional code according to the present invention. Here, only a reading procedure specific to the two-dimensional code according to the present invention is shown, and detailed procedures and adjustments generally required in the reading process are omitted.

FIG. 5 is an explanatory diagram of the reading method according to the present embodiment. FIG. 6 is a flowchart showing a schematic procedure of the reading method shown in FIG.

1) First, digital image data of a two-dimensional code 3 is captured using an image sensor such as a CCD (step S11).

2) Next, the distribution (histogram) of this image data in which the vertical and horizontal 喑 cells are present is examined, and a rectangular area AR3 surrounding the two-dimensional code 3 is defined as shown in FIG.

(Step S12).

3) Next, a point that contacts each side of the periphery of the rectangular area AR3 is searched (step S13). In the case of Fig. 2, points A, E, F, and H are obtained.

4) Next, examine the dots on the straight line connecting the points A, E, F, and H that are adjacent to each other, and determine where the dark line segment forms the corner. Yes (step S14). In the case shown in FIG. 5, it can be seen that such a line segment exists at and near the intersection of the straight line AE and the straight line AF. On the other hand, there are no dark areas on the straight lines EH and FH. The intersection A between the straight line AE and the straight line AF is selected as the origin of the two-dimensional code 3 (step S15). This gives a straight line By obtaining the angle S between the AE and the side of the rectangular area AR3, the rotation angle of each data cell can be obtained.

5) Next, a line segment parallel to the straight line AF and having a length substantially the same as the line segment LS 54 on the straight line AF is examined from point A to point E, line segment LS14 is identified, and its end point is determined. From this, point B is specified, and point H is specified on the extension of this line segment LS14. Similarly, from point A to point F, a line segment LS 61 and a line segment L which are parallel to the line AE and are approximately the same length as the line segments LS 74 and LS 71 on the line AE, respectively. S31 is examined, and the points C and G are determined from this, and the intersection D of the straight line BH and the straight line CG is specified (step S16).

6) Next, a virtual dashed line (heading dashed line) that is parallel to the line segment AF and has the same length is set, and starting from point A and scanning in the direction of point E as bd1, bd2, etc. Then, headlines R44 and R84, R43 and R83, and R42 and R82 are searched (step S17). At this time, the distance from heading dashed line bd1 connecting heading lines R44 and R84 to point A, and the length and pitch of each heading line are known constants in units of data cell size. The position of each headline can be predicted based on the positional relationship between points A to D already specified in the procedure. Similarly, a virtual dashed line parallel to the line segment AE and having the same length is set, and starting from point A and scanning in the direction of point F in the direction of ac l, ac 2. Search for R64, R23 and R63, and R22 and R62 (step S17). Here, the number of heading lines recognized as extending vertically from the line segment AC to the matrix data area 2

(In this embodiment, four lines of R61 to R64) and the number of headlines recognized as extending vertically from the line segment BD to the outside of the matrix portion 2 (in this embodiment, R21 to R24), and similarly, the number of heading lines recognized as extending vertically from the line segment AB to the matrix 2

(Four in this embodiment, R81 to R84) and the number of heading lines recognized to extend vertically outside the matrix data section 2 from the line segment CD (in this embodiment, R41 to R44). If (4) is the same, it can be confirmed that the search for each headline was performed normally. Also, as described above, the number of heading lines is determined independently in each of the horizontal and vertical directions according to the number of data lines in the matrix data section 2. Therefore, the capacity of the matrix data is determined according to the number of heading lines recognized in each line segment.

7) Subsequently, as shown by the dashed line in Fig. 5, the line segments bdl to bd 3 that connect the points on the headline recognized by the two parallel sides of the rectangle ABCD in order to form the grid shape , Acl to ac3 are again assumed, and the coordinates of the intersections n11 to n33 of these line segments are calculated (step S18). These coordinates correspond to the coordinates of the data cells in the matrix data area 2 extracted at equal intervals.

8) Further, from the coordinates of the intersection obtained in the above 7), the coordinate value of each cell is obtained from the number of cells between the known header lines, the binary value of each cell is sampled, and the data of the bit string is analyzed. (Step S 19).

9) Finally, an error correction code is added to the bit string data of the two-dimensional code 3 in advance, and error correction is performed using this. As a result, the original data is restored (step S20).

As described above, according to the two-dimensional code reading method of the present embodiment, the header line segment having the length determined by using the length of one side of the cell as a basic unit at a predetermined pitch is used for the matrix decoder 2. , And the position coordinates are obtained by equally dividing the data cells in the matrix data section 2 using this, so that the binarized data can be restored with high accuracy by simple image processing. Also, the data capacity can be obtained quickly.

(5) First embodiment of a two-dimensional code audio device

FIG. 7 is a block diagram showing a first embodiment of the two-dimensional code sound conversion device according to the present invention. The feature of the two-dimensional code speech conversion device of the present embodiment is that, in addition to decoding binary data coded into a two-dimensional code and outputting the voice, it can also output text data and Braille data. And makes the encoded information available in a variety of visual, auditory and tactile forms.

The two-dimensional code sounding device 20 shown in FIG. 7 includes an operation unit 62, a microcontroller 30, an imaging unit 70, an image memory 80, a memory Ml, and a D / A converter. It comprises an amplifier 82, a speaker 58, and an output port 84. The operation unit 62 is connected to the microcontroller 30, and the imaging unit 70 is connected to the microcontroller Controller 30 and the image memory 80. The speaker 58 is connected to the D / A converter and the amplifier 82. The microcontroller 30, the image memory 80, the memory M1, the D / A converter and the amplifier 82, and the output port 84 are commonly connected to the bus BUS.

The memory Ml stores various data such as a program for operating the two-dimensional code speech device 20 and the decoded two-dimensional code information, and the microcontroller 30 performs various data processing. It also provides a work area for executing The memory Ml has a plurality of storage areas, and is configured to store a plurality of pieces of decoded two-dimensional code information and perform batch processing. The program includes a program for causing the microcontroller 30 to execute the two-dimensional code speech conversion method according to the present invention. In addition, various types of data include data of a plurality of sound quality elements when outputting a text document coded into a two-dimensional code, and a braille code that associates a phoneme code string with a braille code. One-sided conversion table is included. Here, the sound quality elements are, for example, the type of voice (male or female), the pitch (high, medium, low) and the volume (large / medium / small).

The operation unit 62 includes various switches (not shown) for operating the two-dimensional code sounding device 20, so that various settings can be selected by the user. These settings include starting reading of the two-dimensional code, suspending, resuming, and fast-forwarding the audio output, requesting output of text data and Braille data, or a combination thereof. The state of the switch of the operation unit 62 is read by the microcontroller 30.

The microcontroller 30 operates the entire apparatus in accordance with the program stored in the memory M1 and the operation of the operation unit 62 by the user. A more specific configuration of the microcontroller 30 will be described later in detail.

The imaging unit 70 reads an image of a two-dimensional code according to a command from the microcontroller 30. The specific configuration of the imaging unit 70 will be described with reference to FIGS. FIG. 8 is a side view of the imaging unit 70, and FIG. 9 is a top view when the imaging unit 70 is cut along the line JJ in FIG. As shown in FIGS. 8 and 9, the imaging unit 70 includes an imaging device 72 such as a CCD camera and an illumination mechanism. Illumination of imaging unit 70 The mechanism consists of a cylinder 74 with a diffusion plate 75 adhered to the inner peripheral surface, a document insertion section 78 provided on the bottom of the cylinder 74, and a document insertion section 7 on each side of the cylinder 74. 8 includes a light source LS such as an LED, which is attached to the vicinity of 8 and illuminates the inside of the cylinder, and a power lens L2 that covers a light emitting portion of the light source LS. The original insertion section 78 is provided with a slit 76. In this embodiment, the position where the two-dimensional code is printed on the original: DC is predetermined, and when this original DC is inserted into the slit 76 in a specific manner, the part of the two-dimensional code is imaged. It is designed to fit within the field of view of element 72. The surface of the power lens L2 is frosted to prevent the light source image from being directly transferred to the document. In addition, the illumination light is diffused by the diffusion plate 75 attached to the inner peripheral surface of the cylinder, and the entire document is uniformly illuminated. Since the focus of the lens L1 of the image sensor 72 is adjusted in advance, the user can read the two-dimensional code without having to perform complicated focusing simply by inserting the document DC into the slit 76. .

Returning to FIG. 7, the image memory 80 stores the image data of the two-dimensional code imaged by the imaging unit 70.

The D / A converter and the amplifier 82 receive the digital voice waveform data generated by the regular voice synthesis processing of the microcontroller 30, convert this into an analog signal, amplify it, and output it to the speaker 58. . The speaker 58 receives this analog audio waveform signal and outputs audio. The D / A converter, the amplifier 82 and the speaker 58 constitute an audio output unit in the present embodiment.

The output port 84 is a port for connecting an external output device such as an image display, a braille printer, or a character string display.

Here, a more specific configuration of the microcontroller 30 will be described with reference to FIG. As shown in the figure, the microcontroller 30 includes a CPU 34, an imaging control unit 36, a decoding unit 54, a phoneme code string data conversion unit 32, a rule speech synthesis processing unit 56, It includes a Braille data creation unit 10 and an output control unit 38. The imaging control unit 36, decoding unit 54, phoneme code string data conversion unit 32, regular speech synthesis processing unit 56, Braille data creation unit 10, and output control unit 38 are connected via the bus BUS. And are commonly connected to CPU 34. The imaging control unit 36 generates a signal for controlling the imaging unit 70 and supplies the signal to the imaging unit 70. The decoding unit 54 retrieves the image data of the two-dimensional code captured by the imaging unit 70 from the image memory 80 (see FIG. 7), and restores the binary data symbolized into the two-dimensional code by a predetermined decoding process. And outputs the text data and the various control signals described above. Upon receiving the text data output from the decoding unit 54, the phoneme code string data converter 32 generates and outputs phoneme code string data, which is an intermediate language for speech synthesis. The rule speech synthesis processing unit 56 receives the phoneme code string data and the control signal for switching the sound quality element attribute, and switches the sound element corresponding to the sound quality element selected in advance when creating the two-dimensional code. The digital audio waveform is generated and output from the memory M 1 (see Fig. 7) in accordance with the control signal. The braille data generator 10 constitutes a braille translator in the present embodiment, receives phoneme code string data, and refers to a braille code conversion table stored in the memory M1 to generate a phoneme code string data. Evening is converted to Braille and output. The output control unit 38 supplies the speech waveform data supplied from the regular speech synthesis processing unit 56 to the D / A converter and the amplifier 82, and outputs the data read from a dedicated two-dimensional code card described later. According to the control signal, the text data supplied from the decoding unit 54 and the Braille data supplied from the Braille data generator 10 are adapted to the data format of the external connection device, and output port 8 4 (see Figure 7). Depending on the settings selected by the user via the operation unit 62, the data other than the voice waveform data can be output by the output control unit 38, such as text data only, braille data only, or both text data and braille data. Is output.

Next, the operation of the two-dimensional code speech device 20 shown in FIG. 7 will be described as a first embodiment of a two-dimensional code speech method according to the present invention with reference to the drawings. First embodiment of the voice conversion method

FIG. 11 and FIG. 12 are flowcharts showing a schematic procedure of the two-dimensional code speech conversion method of the present embodiment. The features of the present embodiment are that a text document coded into a two-dimensional code can be selectively output in three modes: visual, auditory, and tactile, and connection conditions for connecting an external device to the output port 84. The settings of the data format to be output and the like are coded in advance into a two-dimensional code in a dedicated card format, and this dedicated two-dimensional code This is to decode the code and execute these settings prior to processing such as speech synthesis. The two-dimensional code audio device 20 shown in FIG. 7 is set to output only audio in an initial state immediately after power-on. First, the user selects a two-dimensional code (corresponding to a second two-dimensional code; hereinafter, referred to as a setting two-dimensional code) of a dedicated card corresponding to a desired external device to be connected. The two-dimensional code includes connection conditions for connecting an external device selected by the user to the output port 84, and various output data of the two-dimensional code audio device 20 according to the specifications of the external device. Output control data to conform to the format is coded. External devices that can be connected include image display devices such as CRT (Cathode Ray Tube) and LCD (Liquid Crystal Display), and character string display devices such as Braille printers and Braille displays. When the user inserts the two-dimensional code for setting into the original insertion section 78 of the imaging section 70 (see FIG. 8) and presses the read start switch (not shown) of the operation section 62, the imaging section 70 is activated. According to the control signal sent from the imaging controller 36 of the microcontroller 30, the LED light source LS is turned on, the image of the two-dimensional code of the dedicated card is read (step S21 in FIG. 11), and the image is stored in the image memory 80. The image data is transferred and stored. Next, the decoding unit 54 of the memory microcontroller 30 extracts this image data from the image memory 80 and performs a decoding process (step S22). More specifically, two-dimensional code extraction, positioning, and other processing are performed, and each data cell on the code is read and extracted as bit string data. As a result, the output control data is restored and supplied to the output control unit 38 and the output port 84 as an output control signal. As a result, the output control unit 38 is set to conform to the specifications of the external device to be connected to the format of the data output from the two-dimensional code audio device 20 and conforms to the connection conditions of the selected external device. Thus, the connection conditions of the output port 84 are set (step S23). When the settings of the output control unit 38 and the output port 84 are completed, the two-dimensional code speech device 20 performs speech synthesis processing on the phoneme code string stored in the memory M1 in advance, and the setting is completed. To the user via speaker 5 8

Next, the information of the two-dimensional code (the first two-dimensional code) in which the text document to be processed is coded is converted into speech, and the Braille data and the text data are combined. The output procedure will be described with reference to FIGS.

First, when the user sets the two-dimensional code of the text document in the imaging unit 70 and reads it out and presses a switch (not shown), the imaging unit 70 reads out the image of this two-dimensional code and the image memory 70 It is stored in 80 (step S24). The two-dimensional code to be read may be a conventionally used two-dimensional code, but in the present embodiment, a two-dimensional code created by using dedicated software is used. In this two-dimensional code, in addition to the data of the text document and the error correction code, various control data for speech conversion are also symbolized. In particular, one or more texts in the text document are written. The control data for switching the attribute of the sound quality element is added to the text data of each sentence and encoded so that each sound is converted into a different sound quality element. The decoding unit 54 of the microcontroller 30 retrieves the image data of the read two-dimensional code from the image memory 80, cuts out, positions, etc., reads the data cells on the code, and decodes the bit string. By retrieving the data as one night, these data are restored (step S25), and error correction processing is further performed using an error correction code (step S26) o

Next, the microcontroller 30 checks whether or not a request for text data output has been made during the user's request read from the operation unit 62 (step S27). After the control signal for voice conversion is removed by the output control unit 38, the text data is output from the output port 84 (step S28). As a result, the text document is displayed on the external image display device connected to the output port 84, and the information encoded in the two-dimensional code is obtained through the visual sense. If there is no request for text data output, the process proceeds to the next step S29. Next, the phoneme code string data converter 32 of the microcontroller 30 converts the text data into phoneme code string data as preprocessing of the speech synthesis processing (step S29). At this time, the control data for sound quality element attribute switching, which has been encoded in the two-dimensional code, is added to the phoneme code string data in text units. Next, the microcontroller 30 confirms whether or not a request for braille output has been made during the user's request (step S30). When there is no output request for braille data, the rule speech synthesis processing unit 56 performs speech synthesis on the phoneme code string data in accordance with the rule speech synthesis procedure. Processing is performed (step S33), and the data is converted into audio waveform data and supplied to the D / A converter and the amplifier 82. At this time, the rule speech synthesis processing unit 56 fetches, from the memory M1, a sound quality element that matches the sound quality element selected when the two-dimensional code was created, based on the sound quality element attribute switching control data added for each document. Speech synthesis processing is performed by combining phoneme segments matching this. The D / A converter and the amplifier 82 perform D / A conversion of the supplied audio waveform data, amplify and output the audio from the speaker 58 (step S34). As a result, the text document coded into the two-dimensional code is vocalized using the sound quality element selected when the two-dimensional code was created, so that the document is read out with different types of voice for each sentence.

When a Braille data output request is received (step S30), the phoneme code string data generated in step S29 is converted into Braille data by the Braille data generator 20 (step S31). ). This processing focuses on the fact that in the case of Japanese and the like, braille is represented by phonetic characters corresponding to kana characters, and can be easily converted by referring to a braille code conversion table. Also, by using phoneme code string data, it is possible to ensure consistency between voice output and how to read kanji. For phonetic characters such as alphabetic characters that can be used as they are in Braille, there is no need to intervene in phoneme sequence code data, and they will be converted directly to Braille from text data. The generated Braille data is output from the output port 84 by the output control unit 38 in a data format suitable for the external device to be connected (step SS32).

As described above, according to the present embodiment, a text document coded into a two-dimensional code can be vocalized, and text data, braille data, or both can be selectively output. As a result, the data encoded in the two-dimensional code can be obtained by audio as audio information from the audio output speaker, and the text data can be output to an external image display device for visual confirmation as text information. In addition, by outputting to an external Braille printer or Braille display as a Braille display, tactile confirmation is possible. As described above, the above-described two-dimensional code speech conversion device is provided as multimedia that can be utilized in a variety of ways including visual, auditory, and tactile senses. (7) One embodiment of two-dimensional code encoder and second embodiment of two-dimensional code speech device

FIG. 13 is a block diagram showing both an embodiment of a two-dimensional code encoder according to the present invention and a second embodiment of a two-dimensional code audio device according to the present invention. Here, for convenience of explanation, one embodiment of each of the two-dimensional code encoder and the two-dimensional code sounding device will be described together.

The two-dimensional encoder 40 shown on the left side of FIG. 13 includes a display unit 46, a selection unit 44, a control unit 42, and a printer 48. The display unit 46 is composed of a CRT (Cathode Ray Tube), a liquid crystal display device, or the like, and displays a text document and a sound quality element selection button described later on a screen. The selection unit 44 includes a mouse, a trackball, a keyboard, and the like, and allows the user to select an arbitrary range of documents in the text document displayed on the display unit 46, and reads out the selected document aloud. The user selects the sound quality element at the time from the sound quality element selection button displayed on the display section 46. The control unit 2 adds a control signal for switching the attribute of the selected sound quality element to the text data of the selected document, and then encodes the data into a two-dimensional code. The printer 48 prints the encoded two-dimensional code.

The two-dimensional code speech device 90 shown on the right side of FIG. 13 includes a two-dimensional code reader 92, a decoding unit 54, a memory M2, a regular speech synthesis processing unit 56, and a speaker 58. . The two-dimensional code reader 92 reads the symbol of the two-dimensional code created by the printer 48 of the two-dimensional code encoder 40 and sends the obtained image data to the decoding unit 54. The decoding unit performs a decoding process on the received image data. At this time, the control symbol for sound quality element attribute switching is also decoded and becomes a control signal for sound quality element attribute switching. The decoded text data and sound quality element attribute switching control signal are sent to the regular speech synthesis processing unit 56. A plurality of sound quality elements including the same sound quality element as the sound quality element added to the text data of the document in the two-dimensional encoder 40 are stored in the memory M2 in advance. Based on the attribute switching control signal added to the received text data, the rule speech synthesis processing unit 56 retrieves from the memory M2 the same tone quality element as the tone quality element already selected by the two-dimensional code encoder 40, and retrieves it. Ruled speech synthesis processing of text data overnight Do. The audio signal generated by the audio synthesis processing is supplied to the speaker 58 and output as audio.

The more specific operations of the two-dimensional encoder 40 and the two-dimensional code sounding device 90 described above will be described in detail below. One embodiment of the two-dimensional code encoding method and one embodiment of the text document sounding method according to the present invention. An embodiment will be described below.

(8) One embodiment of a method for encoding a two-dimensional code

FIG. 14 is a flowchart illustrating a schematic procedure of the two-dimensional code encoding method according to the present embodiment. FIGS. 15 to 18 are explanatory diagrams showing specific procedures of the encoding method shown in FIG.

First, the display unit 46 displays a text document that has already been created or is being created (step S41). An example of the displayed text document is shown in the explanatory diagram of Fig. 15. The screen display shown in the figure is an example of a text document created by general-purpose document creation software. At the upper right of the display screen, an icon 100 for sound quality element selection processing to be described later is also displayed.

When the user opens the icon 100 using a mouse or the like, a dialog including various buttons B T1 to B T7 for selecting sound quality elements is displayed as shown in FIG. The button BT1 is a sound quality element setting button, and in this embodiment, three types of settings are possible. Voice type (male or female), pitch (high / medium / low) and volume (large / medium / small).

The user selects an arbitrary sentence in the document by dragging the mouse or operating the keyboard, for example, as shown in FIG. 16, a "multimedia document reading system" (step S42), and furthermore, a sound quality element. When the sound quality is set with the setting button BT1 and the setting button BT2 is pressed (step S43), the selected sound quality is set in the selected document. The selected text "Multimedia Document Speech System" is highlighted to inform the user of the setting.

The sound quality element described above in the present embodiment can be set for each sentence. However, one sound quality element may be set for a plurality of documents. As shown in the explanatory diagram of FIG. 17, the display unit 46 switches the font and display color for each sentence according to the set sound quality content. For example, if the voice type is male, the color is blue, if female, the color is red, In addition, the font of the document is switched to italic, bold, or thin style according to the pitch, and the volume level is displayed according to the font size (point). As a result, the user can instantly check the settings. Note that the batch button BT 3 in the dialog is a button for setting the selected sound quality element for the whole text, and the cancel button BT 7 is for canceling the above-described sound quality element selection processing in the middle. Button.

When the setting is completed for the whole sentence or the sentence in an arbitrary range, and the user presses the conversion button BT4, the control unit 42 sends a sound quality element attribute switching control signal for synthesizing each sentence with the selected sound quality element. Are added to the text data of each selected sentence (step S44), and are further encoded into code symbols by an encoding process (step S45). This encoding process is possible with existing encoding software. By pressing the sticking button BT5 on the code symbol created by encoding, the symbol image of the two-dimensional code 1 is displayed as shown in the lower right of FIG.

Further, when the user presses the lapel button BT6 (see FIG. 17), the two-dimensional code 1 is printed on the paper by the printer 48 (step S46). In the two-dimensional code, together with the encoded text data, the sound quality element attribute switching control signal added to each sentence is also encoded and stored as a sound quality element attribute switching control symbol.

(9) One embodiment of the text document speech conversion method

Next, a method of converting a text document stored in the two-dimensional code 1 created as described above into a speech will be described with reference to the flowchart in FIG.

First, the image of the two-dimensional code 1 is read by the two-dimensional code reader 92 of the two-dimensional code sounding device 90 (step S47). The image data of the two-dimensional code 1 is sent from the two-dimensional code reader 92 to the decoding unit 54, and the decoding unit 54 performs a decoding process on the sent image data (step S48). At this time, the image data of the sound quality element attribute switching symbol is also decoded and becomes a sound quality element attribute switching signal. The decoded text data of each text and the sound quality element attribute switching control signal added to the text data of each text are sent to the regular speech synthesis processing unit 56. The rule-based speech synthesis processing unit 5 6 On the other hand, the sound quality element corresponding to the selected sound quality element is fetched from the memory M2, and speech synthesis processing of the text sentence is performed using the fetched sound quality element. (Step S49) Finally, each text / sentence is read out by the speaker 58 using the voice of the sound quality selected for each sentence (Step S50).

(10) An embodiment of a device for creating a Braille data overnight

FIG. 20 is a block diagram including an embodiment of the braille data creation device of the present invention. The Braille data creation device 110 shown in the figure is composed of a condition setting unit 114, a Braille conversion table selection unit 118, a memory M3, an intermediate language acquisition unit 112, and a filtering unit 116. It has a Braille conversion unit 122, a word wrap unit 124 and an output unit 126. In this embodiment, the intermediate language acquisition unit 112, the filtering unit 116, the braille conversion table selection unit 118, and the braille conversion unit 122 constitute a braille translation unit, and a braille conversion unit. The unit 122 simultaneously constitutes a Braille conversion unit and a segmentation unit. The memory M3 stores a plurality of types of braille code conversion tables corresponding to the intermediate language and the braille data. The intermediate language generation processing unit 13 2 shown in the figure is provided in a text-to-speech conversion synthesis device (not shown), and the condition setting unit 1 14 that generates the intermediate language from the input text data is Set filter conditions, braille conversion conditions, editing processing conditions, output conditions, etc., and filter the command signals CS1 to CS4 so that each part operates under the set conditions. These are supplied to the selection section 118, the first drop section 124 and the output section 126, respectively. Here, the fill-in ring condition refers to the type of fill-in ring processing performed by the fill-in ring portion 1 16. The braille conversion condition is a braille code conversion table used when converting an intermediate language into a braille code. Type. The editing processing condition refers to the maximum number of characters when executing the word wrap processing described later. The output condition refers to the type of Braille printer or Braille display that is the output destination of Braille data.

The intermediate language acquisition unit 112 receives the intermediate language from the intermediate language generation processing unit 132 and supplies it to the filtering unit 116.

The filtering unit 1 16 receives the command signal CS 1 from the condition setting unit 1 14 and does not need to translate from the intermediate language supplied from the intermediate language acquisition unit 1 12 according to the filtering conditions set. Remove symbols. The braille conversion table selection unit 1 18 receives the command signal CS 2 from the condition setting unit 1 14 and extracts the set braille code conversion table from a plurality of types of braille code conversion tables stored in the memory M 3. Hold.

The braille conversion unit 122 refers to the braille code conversion table held by the braille conversion table selection unit 118, and refers to the data after the filtering process supplied from the filtering unit 116. To Braille code.

The word wrap section 124 executes the word wrap of the braille code data supplied from the braille conversion section 122 with the set number of characters in accordance with the command signal CS3 supplied from the condition setting section 114.

The output unit 126 outputs braille data to the set braille device according to the command signal CS4 supplied from the condition setting unit 114. Here, the braille device includes a braille printer, a braille display, and the like.

The procedure of outputting braille data from an intermediate language for speech synthesis using the braille data creation device 110 shown in FIG. 20 is an embodiment of the braille data creation method according to the present invention. A specific description will be given with reference to FIGS. 21 and 22.

(11) One embodiment of the method for creating Braille data

FIG. 21 is an explanatory diagram of an embodiment of a method for creating a Braille data file according to the present invention. The example of a sentence "System provided." FIG. 4 is an explanatory diagram specifically showing a process of converting a text document into Braille data and outputting the data. FIG. 22 is a flowchart showing a schematic procedure of the braille data creating method shown in FIG.

First, as shown in the setting condition SC of FIG. 21, the condition setting unit 114 sets the conditions for creating the Braille data overnight (FIG. 22, step S51). In this embodiment, the condition setting unit 114 sets the filtering method “FA”, the output device “Braille pudding A”, the braille code “NA BCC”, and the number of word wrap characters “10 characters” as the setting condition SC. You have set. Here, the filtering method “FA” refers to setting the data to be filtered to alphabets and numbers, and the output device “Braille pudding A” refers to a braille printer as an output device. A, which sets the conditions for processing braille pudding A under appropriate conditions. Is determined. More specifically, the output device control code is set to ~ A, as shown in DT6 of the output device of FIG.

Next, the Braille conversion table selection unit 118 draws out the Braille code conversion table T corresponding to the Braille code “NABCC” set by the condition setting unit 114 from the memory M3 and holds it (step S52). In the braille translation, one space is left after the phrase and the reading mark “,”, and two spaces are left after the punctuation marks “.”, “?” And “!”. The Braille code conversion table T according to the present embodiment includes a Braille code (first Braille code) corresponding to the reading information, and a space for emptying these squares. , ".", ",", "?", "!" Are allocated as braille codes (second braille codes).

Next, the intermediate language acquisition unit 112 acquires an intermediate language for speech synthesis (step S53). This intermediate language is generated by the intermediate language generation processing unit 132 (see FIG. 20) provided in the text-to-speech conversion / synthesizing apparatus (not shown). More specifically, as shown in FIG. 21, the input text DT 1 "Provides a system." Is generated for the intermediate language DT 2 "P 1 system", and the input text DT 1 "System I 0" is generated. The intermediate language is acquired by the intermediate language acquisition unit 112.

Next, the filtering unit 116 extracts phrase separation information and reading information necessary for braille from the intermediate language acquired by the intermediate language acquisition unit 112 (step S54). More specifically, as shown in FIG. 21, for the intermediate language DT2 “P 1 system”, Takeshima I-S P0., The filter unit 116 sets the filter set by the condition setting unit 114. In accordance with the evening ring method "FA", alphabetic characters and numbers are file-clipped to extract the phrase delimiters ",""." And the phonetic symbol "System @ 1". , テ, 3 ₃ (((((3 3 3 3 3

Next, the Braille converting unit 122 converts the filled intermediate language into the Braille code with reference to the selected Braille code conversion table T, and simultaneously performs the writing (step S55). As described above, in the Braille code conversion table T, the space for blank space is allocated at the same time as the Braille code corresponding to the reading information, as the Braille code corresponding to the part indicating the segment break. information Is converted to a braille code, and at the same time, it is possible to perform the segmentation processing. In other words, as shown in FIG. 21, the filtered intermediate language DT 3 "System I, Takeshima." Refers to the Braille code conversion table T, and the Braille code data DT4 "\? QY9DQ3 @ [3 ¥ Z? 4DD Is converted to " Here, the mouth is a space character representing a space.

Next, the word wrap unit 124 performs a single-draft process on the Braille code converted by the Braille conversion unit 122 (step S56). As a specific example of the word wrapping procedure, the number of characters in the braille code data is counted up in a county (not shown), and at the same time, the phrase separation part is recorded based on the space character. If the counted number of characters exceeds the number of word wrap characters set in the condition setting unit 114 before going to the phrase delimiter, the space character in the phrase is replaced with a line feed code. If the number of characters in one phrase exceeds the number of de-wrapped characters, insert a line feed code in the middle of the phrase. In any case, once a line feed code is entered, the count is reset and counting restarts from the character following the line feed code. For example, in the braille code data string DT 4 "\? QY9DQ3 @ [3 \ Z? 4dCI ,, the set word wrap number exceeds 10 characters in the second segment, so the braille code in FIG. One night As shown in DT 5, a line feed is performed at the segment break of the first clause before that.

Finally, the output unit 126 adapts the Braille data to the data format of the output destination Braille output device and outputs the data (step S57). More specifically, the connection device control code set by the condition setting unit 114 is added to the output braille data. In this embodiment shaped condition, the control code for setting the receiving braille data format of Braille purine evening A output devices NABCC, 1-line printing characters to 10 characters are set as ^lambda A, the output data DT 6 in FIG. 2 1 As shown in, " ^Λ A ¥? QY9—Line feed code 1 Q3 @ [3 \ Z? 4—Line feed code-" is output.

(12) Program and recording medium

The above-mentioned series of procedures for reading two-dimensional codes, two-dimensional code speech, two-dimensional code encoding, text document speech, and braille data creation are implemented by incorporating image data into programs. Read on a computer that can process You may let it be executed. As a result, the two-dimensional code reading method, the two-dimensional code speech method, the two-dimensional code encoding method, the text document speech method, and the braille decoding method according to the present invention can be implemented using a general-purpose view. That can be achieved. In addition, the above-described series of procedures for the two-dimensional code reading method, the two-dimensional code speech method, the two-dimensional code encoding method, the text document speech method, and the braille data creation method are described in a combination that can process image data. As a program to be executed, each program may be stored in a recording medium such as a flexible disk CD-HOM and read and executed by a combination program. The recording medium is not limited to a portable medium such as a magnetic disk or an optical disk, but may be a fixed recording medium such as a hard disk device or a memory. In addition, a program that incorporates the above-described series of procedures for the two-dimensional code reading method, the two-dimensional code conversion method, the two-dimensional code encoding method, the text document conversion method, and the braille data creation method is provided on the Internet. It may be distributed via communication lines (including wireless communication). In addition, a program that incorporates the above-described two-dimensional code reading method, two-dimensional code sounding method, two-dimensional code encoding method, text document sounding method, and braille data creation method is embedded in a program. In the state of being converted, modulated, or compressed, it may be distributed via a wired or wireless line such as an Internet connection network, or stored in a recording medium.

Although some of the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and can be applied with various modifications without departing from the technical scope thereof. For example, in the above-described first embodiment of the two-dimensional code speech conversion device, the imaging unit 70 including an imaging device 72 for acquiring image data of a two-dimensional code and a lighting mechanism, and a regular speech synthesis processing unit 56 And the speaker 58 and the data output port 84 for the text document data and the braille printer are all built-in. For example, the image data acquired by the external two-dimensional code reader is stored in the image memory. It is also possible to adopt a form that takes in the data. In addition, the two-dimensional code vocoder which can output text data and braille data in addition to voice output has been described. However, the present invention is not limited to this, and may output only voice output and braille data. Further, as an external device connected to the output port 84, an image display device, a braille printer, and a braille display are provided. However, the present invention is not limited to this, and a connection may be made to a communication device such as a mobile phone via a wired line or a wireless line via a modem or the like. Also, for example, in the example shown in Fig. 21, Braille device A is taken as a Braille device, and it is decided to output in Braille data format that is compatible with it, but the Braille data format that is suitable for Braille displays is also set. Of course, you can. Furthermore, in each of the above-described embodiments of the text document speech conversion method, the braille data creation device, and the braille data creation method, the description has been given by taking a Japanese sentence as an example of the text data. However, this is only an example, and Of course, the invention can be applied to any language.

Claims

The scope of the claims

1. A data area in which binary data is encoded in a cell and arranged to form a two-dimensional matrix;

A pattern which is arranged so as to surround the first data area, and which provides information on data density of the data area and positioning information,

The pattern is

An adjacent first side and a second side are close to the first data area, and a third side and a fourth side opposed to the first side and the second side respectively. A substantially rectangular solid line spaced apart from the data area;

A first projection and a second projection each arranged at a predetermined bit so as to extend outward from the first side and the second side;

A third protrusion and a fourth protrusion arranged at a predetermined pitch so as to extend inward from the third side and the fourth side toward the data area,

A fifth protrusion and a sixth protrusion arranged so as to extend the first side and the second side from a first end point which is an intersection of the first side and the second side. And the projection of

A seventh protrusion disposed so as to extend the fourth side from a second end point that is an end point of the first side different from the first end point;

An eighth protrusion arranged to extend the third side from a third end point that is an end point of the second side different from the first end point;

Including

A two-dimensional code, wherein no protrusion is disposed at a fourth end point which is an intersection of the third side and the fourth side.

2. The line width according to claim 1, wherein the line width of the first to fourth sides and the width of the first to eighth protrusions are set in accordance with the size of the cell. Dimensional code.

3. The first protrusions are arranged N (N is a natural number) at a pitch of a first length from the first end point toward the second end point,

M (M is a natural number) M pieces of the second protrusions are arranged at a pitch of a second length from the first end point to the third end point,

The N third protrusions are arranged at a pitch of the first length from the third end point to the fourth end point, and

The M protrusions are arranged at a pitch of the second length from the second end point toward the fourth end point, wherein the M protrusions are arranged. Two-dimensional code.

4. The two-dimensional code according to claim 3, wherein the first length and the second length are respectively set according to the size of the cell.

5. The binaries of the binarized data are symbolized as bright or dark squares ^^, and are arranged to form a two-dimensional matrix;

A first figure which is arranged in a peripheral portion of the data section and gives information on a print pitch of the cell;

A second figure which is arranged around the departure part and gives information on the direction of rotation of the cell;

A two-dimensional code comprising

The data portion includes a square small area in which N data cells (N is a natural number) are arranged adjacent to each other in first and second directions orthogonal to each other in the first direction. L (L is a natural number) and M (M is a natural number) are arranged adjacent to each other in the two directions, and the shape of the periphery of the data portion is the first side in the second direction. A second side orthogonal to the first side, and third and fourth sides orthogonal to each other and opposite to the first and second sides, respectively, The shape of

The first side and the second side are arranged close to each other at a distance from each other at a pitch corresponding to the size of the small area, starting from a point near an intersection of the first side and the second side; (M + 1) first line segments spaced apart from each other,

(M + 1) second line segments provided so as to protrude from the center of the first line segment toward the outside of the data portion in the first direction, respectively; The first line segment is arranged along the second side in close proximity to the data section, and is spaced apart from each other at a pitch corresponding to the size of the small area with a vertex of the first line segment as a starting point. (L + 1) third line segments,

(L + 1) fourth line segments provided so as to protrude from the center of the second line segment toward the outside of the data portion in the second direction, respectively. The data section is spaced apart from the data section along a line parallel to the third side, and is spaced apart from each other at a pitch corresponding to the size of the small area with a point on a line connecting vertices of the fourth line segment as a starting point. (M + 1) fifth line segments

(M + 1) pieces arranged so as to extend from the approximate center of the fifth line segment toward the data portion side, respectively, being arranged on the extension of the corresponding second line segment. The sixth line segment of

A line is arranged at a distance from the defocus portion along a line parallel to the fourth side, and at a pitch corresponding to the size of the small region, starting from a point on a line connecting the vertices of the second line segment. (L + 1) seventh line segments spaced apart from each other,

And an eighth line segment provided so as to protrude from substantially the center of the seventh line segment toward the data portion, each of which is arranged on an extension of the corresponding fourth line segment. See

The second figure is an L-shaped figure provided so that both ends thereof are continuous with the (M + 1) -th fifth line segment and the (L + 1) -th seventh line segment. And

The fifth line segment and the seventh line segment are arranged such that the vertices of the sixth line segment and the eighth line segment are separated from the third side and the fourth side, respectively. At a distance from the data section,

Two-dimensional code.

6. The method according to claim 5, wherein the lengths of the first to eighth line segments are determined based on the length of one side of the data cell as a basic unit. Dimension code.

7. The method for reading a two-dimensional code according to any one of claims 1 to 4, wherein

A procedure for acquiring an image of the two-dimensional code,

In the acquired image, the pattern is formed such that a peripheral edge contacts the fourth end point and includes at least a part of the seventh protrusion and at least a part of the eighth protrusion. Steps to cut out the surrounding rectangular area,

The fourth end point, the 突起 th projection, the eighth projection, and the respective contacts of the periphery of the rectangular area are respectively identified as a first contact, a second contact, and a third contact, Recognizing a contact point between the fifth or sixth protrusion and the periphery of the rectangular area as a fourth contact point;

Setting a first line segment connecting the first contact and the second contact, and setting a second line segment connecting the first contact and the third contact;

By setting a first virtual line parallel to the first line segment and moving it from the fourth contact point to the third contact point, the first protrusion and the third protrusion Recognizing the second side and

By setting a second virtual line parallel to the second line segment and moving it from the fourth contact point to the second contact point, the second protrusion and the fourth protrusion are formed. And recognizing the first side; and

Calculating the capacity of the binary data in the data area based on the recognized number of the first to fourth protrusions;

A step of setting a coordinate system in which two sides orthogonal to each other among the sides forming the periphery of the rectangular area are set as an X axis or a Y axis to specify the coordinates of each cell in the data area;

Converting the encoded binary data into a bit string based on the cell coordinates;

A method for reading a two-dimensional code comprising:

8. The method for reading a two-dimensional code according to claim 5 or 6, wherein Obtaining an image of the two-dimensional code;

In the acquired image, a peripheral edge is in contact with a corner of the second graphic, and at least a part of the first fifth line segment and at least a first seventh line segment are reduced. A step of cutting out a rectangular area surrounding the pattern so as to include a part thereof, a contact point with the corner part, a contact point between the first seventh line segment and a peripheral edge of the rectangular area, The first contact point between the fifth line segment and the periphery of the rectangular area is specified as a first contact point, a second contact point, and a third contact point, respectively. A step of recognizing, as a fourth contact point, a contact point between the third line segment or the first third line segment and the periphery of the rectangular area;

Setting a ninth segment connecting the first contact and the second contact, and setting a 10th segment connecting the first contact and the third contact;

By setting a first virtual line parallel to the ninth line segment and moving the virtual line from the second contact point to the fourth contact point, the seventh line segment and the second line segment are set. Recognizing the sixth line segment and the third line segment; and

By setting a second virtual line parallel to the 10th line segment and moving it from the third contact point to the fourth contact point, the fifth line segment and the fourth line A step of recognizing the minute and the eighth line and the first line;

Calculating a capacity of the data in the data section based on the recognized quantities of the second, fourth, sixth, and eighth line segments;

A step of setting a coordinate system in which two sides orthogonal to each other among the sides forming the periphery of the rectangular area are set as an X axis or a Y axis to specify the coordinates of each cell in the data section;

Converting the symbolized data into bit string data based on the cell coordinates;

A method for reading a two-dimensional code comprising:

9. A procedure for acquiring an image of the two-dimensional code according to any one of claims 1 to 4, and

In the acquired image, a peripheral edge is in contact with the fourth end point, and includes at least a part of the seventh protrusion and at least a part of the eighth protrusion. Cutting out a rectangular area surrounding the pattern;

The intersections of the fourth end point, the seventh protrusion, the eighth protrusion, and the periphery of the rectangular area are specified as a first contact, a second contact, and a third contact, respectively. Recognizing, as a fourth contact point, an intersection between the fifth or sixth protrusion and the periphery of the rectangular area;

By setting a first virtual line parallel to the first line segment and moving it in the direction of the third contact, the first protrusion, the third protrusion, and the second side And a procedure for recognizing

By setting a second virtual line parallel to the second line segment and moving it in the direction of the second contact point, the second protrusion, the fourth protrusion, and the first side are set. And the procedure for recognizing

Converting the encoded binary data into bit string data based on the cell coordinates;

A program for causing a computer to execute a two-dimensional code reading method comprising:

10. A procedure for acquiring an image of the two-dimensional code according to any one of claims 1 to 4,

The intersections of the fourth end point, the seventh protrusion, the eighth protrusion, and the periphery of the rectangular area are specified as a first contact, a second contact, and a third contact, respectively. The intersection of the fifth or sixth protrusion and the periphery of the rectangular area is referred to as a fourth contact point. Steps to recognize

By setting a second virtual line parallel to the second line segment and moving it in the direction of the second contact point, the second protrusion, the fourth protrusion, and the first side are set. And a procedure for recognizing

A procedure of setting a coordinate system in which two sides orthogonal to each other among the sides forming the periphery of the rectangular area are set as an X axis or a Y axis to specify the coordinates of each cell in the data area; and Converting the encoded binary data into a bit string data,

A recording medium readable by a computer which stores a program for causing a computer to execute a method for reading a two-dimensional code, the computer comprising:

11. A program for causing a computer to execute the method for reading a two-dimensional code according to claim 8.

12. A computer-readable recording medium recording a program for causing a computer to execute the two-dimensional code reading method according to claim 8.

1 3. Receiving input of decoded data obtained by decoding image data of a first two-dimensional code in which first information including a text document is encoded and recorded, and receiving the decoded data. A phoneme code sequence data generation unit that generates phoneme code sequence data that is intermediate data for generating a speech waveform signal from the data, and generates the speech waveform data by processing the phoneme sequence code data Rule speech synthesis With the department

A braille translation unit that processes the phoneme code string data to create braille data, an output control unit that selectively outputs at least one of the audio waveform data and the braille data,

A two-dimensional code conversion device comprising:

1 4. A text data creation unit for creating text data from the decoded data is further provided.

14. The two-dimensional code speech device according to claim 13, wherein the output control unit selectively outputs at least one of the text data, the speech waveform data, and the Braille data.

15. The output control unit transmits second information including connection control data for adapting the audio waveform data, the braille data, or the data format of the text data to the specifications of each output device. An input of an output control signal obtained by decoding the encoded image data of the second two-dimensional code is received, and based on the output control signal, the audio waveform data, the Braille data, or the text is received. 15. The two-dimensional chord sounding device according to claim 13, wherein a format of the data is changed.

16. The two-dimensional code speech device according to any one of claims 13 to 15, further comprising a speech output unit that receives the input of the speech waveform data and outputs the text document as speech. .

17. The two-dimensional code audio device according to any one of claims 13 to 16, further comprising a decoding unit that decodes the image data and outputs the decoded data.

18. The first two-dimensional code or the second two-dimensional code is imaged and 17. The two-dimensional code audio device according to claim 13, further comprising an imaging unit that outputs the image data.

19. The two-dimensional code audio device according to any one of claims 13 to 18, further comprising a storage unit having a plurality of storage areas for storing the data to be decoded.

20. The imaging unit comprises:

An illumination mechanism having an opening for receiving the two-dimensional code, a light source disposed at a position close to the opening, and a light diffusing lens disposed to cover the light source;

An imaging element provided at a position facing the opening of the illumination mechanism and imaging the two-dimensional code;

The two-dimensional code speech device c according to claim 18 or 19, comprising:

2 1. The surface of the light diffusion lens is processed so as to form frosted glass, and the illumination mechanism is

A cylindrical shape provided at least from the light source to a position where the image pickup device is attached, and a diffuse reflection material for uniformly irradiating the opening with light from the light source is provided on the inner peripheral surface. 21. The two-dimensional code sound generator according to claim 20, further comprising a diffuse reflection member.

2 2. A two-dimensional code image capturing step of capturing a first two-dimensional code in which first information including a text document is encoded and recorded and outputting first image data; A decoding process of decoding the image data and outputting decoded data.

A phoneme code string data generating step of generating a phoneme code string data which is intermediate data for generating an audio waveform signal from the decoded processing data;

Rule speech synthesis processing for processing the phoneme string code data to create a speech waveform data Process and

A braille translation process of processing the phoneme code string data to create braille data; an output control process of selectively outputting at least one of the audio waveform data and the braille data;

A two-dimensional code conversion method comprising:

23. The method further comprises a text data creation process for creating a text data from the decoded data.

The method according to claim 22, wherein the output control step selectively outputs at least one of the text data, the audio waveform data, and the Braille data. .

24. The two-dimensional code imaging step includes connection control data for adapting the audio waveform data, the Braille data, or the data format of the text data to the specifications of each output device. Imaging a second two-dimensional code in which the two pieces of information are symbolized and outputting a second image data,

The decoding step includes a step of decoding the second image data and outputting a connection control signal.

The method according to claim 22, wherein the output control step includes a step of changing a data format of the audio waveform data, the Braille data or the text data based on the output control signal. Dimensional code conversion method.

2 5. A two-dimensional code imaging procedure of imaging a first two-dimensional code in which first information including a text document is encoded and recorded and outputting a first image data; A decoding process for decoding the image data of

A phoneme code string data generation procedure for generating a phoneme code string data which is intermediate data for creating an audio waveform signal from the decoded data;

Rule speech synthesis processing for processing the phoneme string code data to create speech waveform data Process steps,

A braille translation procedure for processing the phoneme code string data to create braille data, an output control procedure for selectively outputting at least one of the voice waveform data and the braille data,

A program for causing a computer to execute a two-dimensional code conversion method including:

26. The two-dimensional code conversion method

Further comprising a text data creating procedure for creating a text data from the decoded data;

26. The program according to claim 25, wherein the output control step is a step of selectively outputting at least one of the text data, the audio waveform data, and the Braille data.

27. The two-dimensional code imaging procedure includes a connection control data for adapting the audio waveform data, the Braille data format or the text data format to the specifications of each output device. A step of imaging a second two-dimensional code in which the second information is symbolized and outputting second image data,

27. The output control procedure according to claim 25, further comprising a step of changing a data format of the audio waveform data, the Braille data or the text data based on the output control signal. The program described in.

2 8. A two-dimensional code imaging procedure of imaging a first two-dimensional code in which first information including a text document is encoded and recorded and outputting a first image data; A decoding process for decoding the image data of

A phoneme code string data generation procedure for generating phoneme code string data that is an intermediate data for creating an audio waveform signal from the decoded processing data; A rule speech synthesis processing procedure for processing the phoneme string code data to create speech waveform data;

A computer-readable recording medium storing a program for causing a computer to execute a two-dimensional code conversion method including:

2 9. The two-dimensional code sound conversion method is as follows:

Further comprising a text data creation process for creating a text data from the decoded data;

The recording medium according to claim 28, wherein the output control step is a step of selectively outputting at least one of the text data, the audio waveform data, and the Braille data. .

30. The two-dimensional code imaging procedure includes a connection control data for adapting the audio waveform data, the Braille data, or the data format of the text data to the specifications of each output device. Imaging the second two-dimensional code in which the two pieces of information are symbolized and outputting the second image data,

The decoding step includes a step of decoding the second image data and outputting a connection control signal,

The recording according to claim 28, wherein the output control procedure includes a procedure of changing a data format of the audio waveform data, the Braille data, or the text data based on the output control signal. Medium.

31. A display section for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis;

The user is allowed to select an arbitrary sentence from the displayed document, and the user selects the sound quality element corresponding to the selected sentence from the plurality of sound quality elements. A selection unit to

A control signal adding unit for adding a sound quality element attribute switching control signal for causing the sentence to perform speech synthesis processing on the sentence with the selected sound quality element, to the text data of the sentence, and the text data of the sentence A code for coding a two-dimensional code together with the sound quality element attribute switching control signal, and creating the two-dimensional code including the sound quality element attribute switching control symbol in which the sound quality element attribute switching control signal is coded. And a two-dimensional code encoder comprising:

3 2. A storage unit for storing a plurality of different sound quality elements for regular speech synthesis, a symbol in which the text of the text is encoded, and a symbol selected corresponding to the text and added to the text data of the text Two-dimensional code reading part for reading a two-dimensional code including a sound quality element attribute switching control symbol coded with a sound quality element attribute switching control signal for causing the sentence to be subjected to speech synthesis processing with the selected sound quality element When,

A decoding unit for decoding the read two-dimensional code to output text data of the text and the sound quality element attribute switching control signal added to the text data;

A voice synthesis unit that draws the sound quality element corresponding to the selected sound quality element from the storage unit based on the sound quality element attribute switching control signal, and voice-processes the text with the extracted sound quality element;

A two-dimensional code conversion device comprising:

33. A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis;

A selection step of causing the user to select an arbitrary sentence from the displayed document, and causing the user to select the sound quality element corresponding to the selected sentence from the plurality of sound quality elements;

A control signal adding step of adding a sound quality element attribute switching control signal for causing the sentence to perform speech synthesis processing on the sentence with the selected sound quality element, to the text data of the sentence; Together with the sound quality element attribute switching control signal. Encoding a two-dimensional code including a two-dimensional code which is converted into a two-dimensional code and includes a sound quality element attribute switching control symbol in which the sound quality element attribute switching control signal is encoded. Method.

34. The method according to claim 33, further comprising a confirmation step of notifying a user that the selection of the sound quality element has been received by switching a display mode of the document selected by the selection step. 2D code encoding method.

35. The selecting step is a step of prompting the user to select a plurality of sentences from the displayed document and allowing the user to select the sound quality element so that a plurality of different sound quality elements correspond to the plurality of sentences. 33. The two-dimensional code encoding method according to claim 33, wherein the encoding method comprises:

36. Sound quality element attribute switching for synthesizing the sentence with the symbol in which the text data of the sentence is coded and the sound quality element selected corresponding to the sentence and added to the text data of the sentence Two-dimensional code reading procedure for reading a two-dimensional code including a sound quality element attribute switching control symbol in which a control signal for use is encoded, and the text data of the text by decoding the read two-dimensional code. A decoding procedure for outputting the sound quality element attribute switching control signal added to the text data overnight;

Based on the sound quality element attribute switching control signal, a sound quality element that matches the selected sound quality element is extracted from a plurality of pre-registered sound quality elements, and the speech is processed to convert the sentence into speech using the extracted sound quality element. A synthesis procedure;

A two-dimensional code conversion method comprising:

37. A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis;

The user is allowed to select an arbitrary sentence from the displayed document, and the user selects the sound quality element corresponding to the selected sentence from the plurality of sound quality elements. And the selection procedure

A sound quality element attribute for causing the sentence to be subjected to speech synthesis processing with the selected sound quality element, a control signal adding step of adding a control signal for switching to the text data of the sentence, and the text data of the sentence being converted to the sound quality element. An encoding step of encoding a two-dimensional code together with the attribute switching control signal, and creating a two-dimensional code including a sound quality element attribute switching control symbol in which the sound quality element attribute switching control signal is encoded; A two-dimensional code reading procedure for reading the

A decoding step of decoding the read two-dimensional code and outputting the text data of the sentence and the sound quality element attribute switching control signal;

Based on the sound quality element attribute switching control signal, a sound quality element corresponding to the selected sound quality element is extracted from a plurality of the previously registered sound quality elements, and the sentence is converted into a speech by the extracted sound quality element. A speech synthesis procedure,

A text document speech conversion method comprising:

38. A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis;

A selection procedure for allowing the user to select an arbitrary sentence from the displayed document, and for allowing the user to select the sound quality element corresponding to the selected sentence from the plurality of sound quality elements;

A control signal adding step of adding a sound quality element attribute switching control signal for causing the sentence to be subjected to speech synthesis processing with the selected sound quality element to the text data of the sentence, and adding the text data of the sentence to the text data. Encoding procedure for coding into a two-dimensional code together with the sound quality element attribute switching control signal, and creating a two-dimensional code including the sound quality element attribute switching control symbol in which the sound quality element attribute switching control signal is encoded. And a program _c for executing the encoding method of the two-dimensional code including

39. A sound quality element for performing speech synthesis processing on the sentence with a symbol in which the text data of the sentence is encoded and a sound quality element selected corresponding to the sentence and added to the text data of the sentence. Sound quality element attribute with control signal for attribute switching coded A two-dimensional code reading procedure for reading a two-dimensional code including a switching control symbol; the text data of the text by decoding the read two-dimensional code; and the sound quality element added to the text data. A decoding procedure for outputting an attribute switching control signal,

40. A display procedure for visually displaying a text document and a plurality of different sound quality elements for regular speech synthesis,

A control signal adding step of adding a sound quality element attribute switching control signal for causing the sentence to perform speech synthesis processing on the sentence with the selected sound quality element, to the text data of the sentence; Encoding into a two-dimensional code together with the attribute switching control signal, and creating a two-dimensional code including the sound quality element attribute switching control symbol in which the sound quality element attribute switching control signal is coded. A recording medium readable by a convenience store, which stores a program for executing a two-dimensional code encoding method all over the convenience store.

4 1. A symbol for coding the text of the text and a sound quality element selected corresponding to the text and added to the text of the text for speech synthesis processing of the text. A two-dimensional code reading procedure for reading a two-dimensional code including a sound quality element attribute switching control symbol in which a sound quality element attribute switching control signal is coded; and decoding the read two-dimensional code to read the text of the text. A decoding procedure for outputting the sound quality element attribute switching control signal added to the text data; Based on the sound quality element attribute switching control signal, a sound quality element that matches the selected sound quality element is extracted from a plurality of pre-registered sound quality elements, and the speech is processed to convert the sentence into speech using the extracted sound quality element. A synthesis procedure;

4 2. A braille data creation device equipped with a braille translation unit that receives an intermediate language, which is intermediate data for creating a speech waveform signal from text data, and processes this intermediate language to create braille data.

43. The Braille data creating apparatus according to claim 42, further comprising a condition setting unit that sets conditions for creating the Braille data.

44. The Braille translation unit, comprising: a Braille conversion unit that converts the intermediate language into the Braille code with reference to a conversion table that associates the intermediate language with a Braille code. Or the device for creating Braille data described in 43.

45. The intermediate language includes segment break information indicating a segment break of a sentence converted into the text data,

The Braille data creation device according to any one of claims 42 to 44, further comprising a segmentation unit that performs a segmentation process based on the phrase segmentation information.

46. The intermediate language includes segment break information indicating a segment break of the sentence converted into the text data,

44. The system according to claim 43, further comprising a word wrap unit that performs a single drap process on the Braille code converted by the Braille conversion unit based on the phrase delimiter information. 2. A braille data creation device according to claim 1.

47. The system according to claim 42, further comprising a Braille data output unit configured to adjust the Braille data format so as to conform to a data format of an output destination and to output the Braille data. Braille data creation device.

4 8. A braille data creation method that includes a braille translation procedure that creates an Braille data by processing an intermediate language, which is intermediate data for creating a speech waveform signal from text data.

49. The Braille translation procedure includes a Braille conversion procedure of converting the intermediate language into the Braille code with reference to a conversion table that associates the intermediate language with a Braille code. The braille data creation method described in 8.

50. The intermediate language includes segment break information indicating the segment break information of the sentence converted into the text data,

The Braille data creation method according to claim 48 or 49, wherein the Braille translation procedure includes a text-to-speech processing procedure of performing text-to-speech processing based on the phrase segmentation information.

51. The intermediate language includes segment break information representing the segment break information of the text converted into the text data,

50. The method according to claim 49, further comprising a word wrapping procedure for performing a single wrapping process on the Braille code obtained by the Braille conversion procedure based on the phrase separation information. Braille data creation method.

5 2. Cause the computer to execute a Braille data creation method that includes a braille translation procedure that creates an Braille data by processing an intermediate language, which is an intermediate data file used to create an audio waveform signal from text data. program.

5 3. The braille translation procedure included in the braille data creation method includes the intermediate language and the braille The program according to claim 52, further comprising a Braille conversion procedure of converting the intermediate language into the Braille code with reference to a conversion table that associates the Braille code with the Braille code.

54. The braille translation procedure included in the braille data creating method further includes a segmentation processing procedure for performing a segmentation process based on the segment break information included in the intermediate language. The program described in.

55. The braille data creating method further includes a word wrap processing procedure of performing a word wrap process on the braille code obtained by the braille conversion procedure based on the phrase separation information of the intermediate language. The program according to claim 53, wherein the program is characterized in that:

5 6. A computer-readable program storing a program for causing a computer to execute a braille data creation method including a braille translation procedure for creating an Braille data by processing an intermediate language, which is intermediate data for creating an audio waveform signal from text data. Possible recording medium.

57. The braille translation procedure included in the braille data creation method includes a braille conversion procedure of converting the intermediate language into the braille code with reference to a conversion table that associates the intermediate language with the braille code. The recording medium according to claim 56, wherein the recording medium is readable by a user.

58. The braille translation procedure included in the braille data creating method further includes a separate writing processing procedure for performing a separate writing process based on the phrase segment information included in the intermediate language. The recording medium that can be read by the combination described in.

59. The braille data creation method includes the steps of: word-wrapping the braille code obtained by the braille conversion procedure based on the phrase separation information of the intermediate language. The recording medium readable by a combination according to claim 57 or 58, further comprising a word wrap processing procedure for performing processing.