WO2014189273A1

WO2014189273A1 - Apparatus and method for automatically generating/transmitting ussd charge code for mobile communication prepaid scratch card

Info

Publication number: WO2014189273A1
Application number: PCT/KR2014/004522
Authority: WO
Inventors: 한동관
Original assignee: Han Dong Kwan
Priority date: 2013-05-21
Filing date: 2014-05-21
Publication date: 2014-11-27
Also published as: KR101540772B1; KR20140136742A

Abstract

Disclosed are an apparatus and a method for automatically generating/transmitting a USSD charge code for a mobile communication prepaid scratch card. A smart phone comprises: a camera module for photographing a prepaid scratch card; an image recognition module for recognizing a 14 to 16 digit serial number marked within a white box in an image of the photographed prepaid scratch card; a code generation module for converting the recognized serial number into numeric data and inserting the converted numeric data into a transport format predetermined for each mobile communication company according to a unspecified supplementary service data (USSD) protocol, so as to generate a USSD charge code; and a code transmission module for transmitting the generated USSD charge code to a mobile communication company server by pressing a call button by a user to charge a voice call capacity or a data capacity of the smart phone, wherein the USSD charge code includes a prefix consisting of *, an identifier of the corresponding mobile communication company of a 3 digit number, and *, the inserted numeric data, and a suffix consisting of "#".

Description

[Correction by Rule 26.08.2014] [Automatic generation / transmitting device and method of USB charging code for mobile communication scratch prepaid card

The present invention relates to an apparatus and method for generating a code, and more particularly, to an apparatus and method for automatically generating and transmitting a USSD charging code for a mobile communication scratch prepaid card.

In the GSM type mobile communication service, a USIM chip for each carrier is inserted into a smart phone, and basic information such as user information and a mobile communication number is embedded in the SIM chip. Simply insert the SIM chip into any smartphone and use it like your own phone.

In the communication service market of the SM method, a method of using a prepaid charge of a voice call amount or a data call amount by using information of a SIM chip is widely used. If you purchase a prepaid card at a convenience store and send the serial number written on the prepaid card to the mobile carrier server, the prepaid card is automatically charged. This is further described with reference to FIG. 1.

1 is a physical example of a mobile communication scratch prepaid card.

Referring to FIG. 1, a serial number is displayed as a mobile communication scratch prepaid card while being scratched with a fingernail or a coin. And below that it says "* 134 * serial number #Send". This describes how to send a serial number. In other words, the user scratches the prepaid card, enters the number in the white box displayed after * 134 * and finally enters # to send it on the mobile phone. Provides data call volume or voice call amount equivalent to amount.

Here, "* 134 * serial number #" is a transmission format of an unspecified supplementary service data (USSD) protocol, * 134 * is a prefix of the protocol, and 134 is an identifier for identifying a mobile communication provider. And # is a suffix that is the terminator of the USSD protocol message.

However, as shown in Figure 1, the serial number is composed of approximately 14 to 16 digits, very long and difficult to identify. The user inputs and transmits serial numbers one by one to the determined USSD code format. At this time, it is not easy to input correctly without an error, and there is no way to correct again even when an error is inputted. If the acknowledgment message is not received, the USSD protocol message should be input again from the beginning.

As described above, even if the vision is poor or good vision, it is very inconvenient because it is not easy to input without error at once and is repeatedly input several times.

Therefore, there is a need for a method that can generate and transmit a USSD protocol message at one time without error.

An object of the present invention is to provide a USSD charging code automatic generation / transmission device for a mobile communication scratch prepaid card.

Another object of the present invention is to provide a method for automatically generating / transmitting a USSD charging code for a mobile communication scratch prepaid card.

The USSD charging code automatic generation / transmission device for a mobile communication scratch prepaid card according to the object of the present invention described above comprises: a camera module for photographing a scratch prepaid card; An image recognition module for recognizing a serial number of 14 to 16 digits written in a white box from the image of the scratch prepaid card; A code generation module for converting the recognized serial number into numeric data and inserting the converted numeric data into a predetermined transmission format for each mobile carrier according to an unspecified supplementary service data (USSD) protocol to generate a USSD charging code; It may be configured to include a code transmitting module for transmitting the generated USSD charging code to the mobile communication company server by pressing a call button to charge the voice call capacity or data capacity of the smart phone.

Here, the USSD charging code is a *, the identifier of the mobile carrier consisting of three digits, a prefix consisting of *, the inserted numeric data, and a suffix consisting of # Can be configured.

The camera module may be configured to be set automatically to turn off a flash.

Meanwhile, the camera module displays a rectangular plate for capturing the white box on the touch screen, and when the direction is adjusted so that the white box matches the rectangular plate by the user, the rectangular plate. The image recognition module recognizes and displays the serial number in the rectangular plate, and displays a region of the rectangular plate. The number may be configured to be identified by the user.

On the other hand, the image recognition module converts the image of the scratch prepaid card photographed by the camera module into an 8-bit grayscale image composed of 256 pixels from the RGB image, and converted In the grayscale image, four edges of the scratch prepaid card are detected by using an edge detection algorithm, and the intersections of the corners are rectangular by using a perspective correction algorithm from the detected four edges. The edges of the white box using edge detection algorighm and a bounding edge detection algorithm that checks whether the edge is closed seamlessly, and binarization / the 8-bit grayscale using a threshold algorithm Each unknown pixel is converted to a value of 0 or 255 based on a predetermined threshold, and when photographed under uneven lighting, an average threshold value in the grayscale image is obtained by using an adaptive threshold algorithm. After scanning in which direction it is changed, the size of a block having a value within a predetermined error range is calculated, the grayscale image is divided by the size of the block, each local threshold is set for each corresponding block, and the set local It may be configured to convert a value of 0 or 255 for each pixel based on the threshold value.

According to another aspect of the present invention, there is provided a method of automatically generating / transmitting a USSD charging code for a mobile communication scratch prepaid card, the camera module setting and photographing a scratch prepaid card to automatically turn off a flash; Recognizing, by the image recognition module, a serial number of 14 to 16 digits indicated in a white box in the image of the photographed scratch prepaid card; Generating a USSD charging code by converting the recognized serial number into numeric data and inserting the converted numeric data into a predetermined transmission format for each mobile carrier according to an unspecified supplementary service data (USSD) protocol; The code transmission module may be configured to include transmitting the generated USSD charging code to the mobile communication company server by pressing a call button by the user to charge the voice call capacity or data capacity of the smart phone.

At this time, the USSD charging code, *, the identifier of the mobile carrier consisting of three digits, a prefix consisting of *, the inserted numeric data, and a suffix consisting of # (suffix) Can be.

The image recognition module may recognize a serial number of 14 to 16 digits indicated in a white box in the image of the scratch prepaid card, wherein the image is received from the scratch prepaid card. The scratch prepaid card is converted from an RGB image to an 8-bit grayscale image consisting of 256 pixels and using an edge detection algorithm on the converted grayscale image. Detect the four edges of the edge, correct the intersection of each edge into a rectangular shape using a perspective correction algorithm from the detected four edges, and check whether the edge detection algorighm and the edge are closed seamlessly. By using the bounding edge detection algorithm The edges of the white box are detected, and each pixel of the 8-bit grayscale image is converted to a value of 0 or 255 based on a predetermined threshold by using a binarization / threshold algorithm. When the image is taken under poor lighting, an adaptive threshold algorithm is used to scan in which direction the average brightness value changes in the grayscale image, and then calculate the size of a block having a value within a predetermined error range. The grayscale image may be classified by size of the block to set a local threshold for each block and convert the grayscale image into a value of 0 or 255 for each pixel based on the set local threshold.

According to the apparatus and method for automatically generating / transmitting a USSD charging code for a mobile communication scratch prepaid card, the USSD protocol message is automatically generated and transmitted using the serial number of the scratch prepaid card with only one shot without repetitive input error. Repetitive input errors and inconveniences caused by transmission are eliminated. In addition, even if the lighting conditions are poor or photographed prepaid at an oblique angle, there is an effect that can be accurately identified and identified at once by using a perspective correction algorithm or an adaptive threshold algorithm.

1 is a physical example of a mobile communication scratch prepaid card.

2 is a block diagram of a USSD charging code automatic generation / transmission device for a mobile communication scratch prepaid card according to an embodiment of the present invention.

3A to 3E are images after processing of a serial number recognition algorithm according to an embodiment of the present invention.

4A and 4B are images of a photographing screen according to an embodiment of the present invention.

5 is a flowchart of a method for automatically generating / transmitting a USSD charging code for a mobile communication scratch prepaid card according to an embodiment of the present invention.

6 is a flowchart of an image recognition processing process of a mobile communication scratch prepaid card according to an embodiment of the present invention.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description.

However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

In describing the drawings, similar reference numerals are used for similar elements.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be.

On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art.

Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Referring to FIG. 2, the USSD charging code automatic generation / transmission device 100 for mobile communication scratch prepaid card 100 (hereinafter, referred to as an “USSD charging code automatic generation / transmission device”) according to an embodiment of the present invention is a camera module. 110, the image recognition module 120, the code generation module 130, and the code transmission module 140 may be configured to include.

The USSD charging code generation / transmission device 100 is configured to automatically photograph and recognize the serial number of the scratch prepaid card once and automatically generate and automatically transmit the USSD charging code using the recognized serial number. In addition, by applying a variety of algorithms, such as perspective correction algorithm, applied threshold algorithm, which is not applied in the past, it is possible to accurately recognize the serial number even in various situations such as photographing a scratch prepaid card at an angle or inconsistent lighting. In addition, by setting the camera module 110 to automatically turn off, the recognition rate is prevented from being lowered due to the reflection of light. The USSD charging code automatic generation / transmission device 100 may be implemented as an application on a smart phone.

Hereinafter, the detailed structure is demonstrated.

The camera module 110 is configured to photograph the scratch prepaid card. At this time, the flash is preferably set to automatically turn off. This is because the flash light is reflected from the scratch prepaid card made of plastic and the serial number may not be recognized properly.

The image recognition module 120 may be configured to recognize a 14 to 16 digit serial number indicated in a white box in the image of the scratch prepaid card photographed by the camera module 110.

As such, the image recognition module 120 may automatically detect and recognize a serial number on an image using various algorithms. Even if the automatic detection, the user can be implemented to facilitate the detection of the position of the serial number by touching the position of the serial number by hand in the captured image on the touch screen.

Hereinafter, image recognition will be described in more detail.

First, the image recognition module 120 converts an image of a scratch prepaid card taken by the camera module 110 into an 8-bit grayscale image composed of 256 pixels from a color RGB image. Can be configured.

In addition, the image recognition module 120 may be configured to detect four edges of the scratch prepaid card using an edge detection algorithm in the grayscale image. The edge detection algorithm detects the threshold as a corner when the brightness value changes abruptly in adjacent pixels. This is suitable for approximating the outline of an image using a kind of differential operator as an algorithm. Canny Edge Detector or Shen-Castan Edge Detector can be used.

In addition, the image recognition module 120 may be configured to correct the intersection of each corner into a rectangular shape using a perspective correction algorithm from the detected four corners. This is to correct the image taken at an oblique angle as if it was taken vertically to properly recognize the image.

The image recognition module 120 is configured to detect an edge of a white box marked with a serial number by using an edge detection algorithm and a bounding edge detection algorithm for checking whether the edge is closed. Can be. Here, the white box is detected by whether the border of the white box is broken or closed. Detect all bounding edges in the image.

Next, the image recognition module 120 may be configured to convert each pixel of the 8-bit grayscale image to a value of 0 or 255 based on a predetermined threshold using a binarization / threshold algorithm. Can be. In the gray scale image, since one pixel of data is composed of 8 bits, each pixel may have any one value of 0 to 255. The image recognition module 120 converts each pixel of the image represented by 256 values into two values of 0 or 255 based on a predetermined threshold using a dualization / threshold algorithm. In other words, it can be converted to a black and white image.

In this case, the brightness of each part of the image may be different according to the position of the illumination. In this case, it is necessary to apply different threshold values for each part to prevent the image from being incorrectly recognized and converted. Accordingly, the image recognition module 120 scans in which direction the average brightness value changes in the grayscale image using an adaptive threshold algorithm and calculates the size of the block having a value within a predetermined error range. And dividing the grayscale image by the size of the block to set each local threshold for each block and convert the grayscale image into a value of 0 or 255 for each pixel based on the set local threshold. That is, in the shadowed block, the threshold will be darker, and in the lighter block, the brighter value will be set as the threshold.

Next, the image recognition module 120 may be configured to recognize a connection area by using a connected region algorithm to recognize a serial number in a white box.

At this time, since mobile carriers use serial numbers of fixed lengths predetermined for each company, when a number other than the length determined by the user's mobile carrier is recognized, it may be determined that it is not the desired serial number and discarded. have. That is, since a number may be written and recognized on the scratch prepaid card, it may be configured to be immediately discarded when it is not a predetermined length. Thus, the recognition error for the serial number can be further reduced. And the automatic recognition rate can be increased without having to specify the location of the serial number on the touch screen.

Referring back to FIG. 2, the code generation module 130 converts the serial number recognized by the image recognition module 120 into numeric data, and converts the converted numeric data for each mobile carrier according to the unspecified supplementary service data (USSD) protocol. Insert into a predetermined transmission format to generate a USSD charging code.

Here, the USSD charging code may be composed of *, an identifier of a corresponding mobile carrier composed of three digits, a prefix composed of *, and a suffix composed of numeric data and #.

At this time, the identifier for each mobile carrier must be stored in advance.

The code transmission module 140 presses a call button or automatically transfers the USSD charging code generated by the code generation module 130 to the mobile communication server 200 to charge the voice call capacity or the data capacity of the smart phone. Configured to transmit.

3A to 3E show an image after processing of a serial number recognition algorithm according to an embodiment of the present invention.

3A is a photographed image of the scratch prepaid card, which is photographed at an oblique angle.

3B shows an image obtained by applying a perspective correction algorithm and rotating the image taken at an angle.

3C illustrates that a white box in which a serial number is indicated is detected by using a bounding edge detection algorithm or the like.

In addition, FIG. 3D shows a background and a number of white boxes separated using a dualization / threshold algorithm, and FIG. 3E shows a serial number recognized and outputted as numerical data using a connection area algorithm.

Referring to FIG. 4A, a white box marked with a serial number is photographed by matching a rectangular plate on a touch screen. Here, the user is configured to photograph by adjusting the direction of the camera module 111 so that the rectangular plate is matched with the white box of the prepaid card.

In this case, the camera module 110 focuses on a rectangular plate, that is, a white box, and is configured to display an area other than the rectangular plate as another alternative screen.

And when the user presses the capture button, the serial number in the rectangular plate is captured.

In this way, when using a rectangular plate, the user can recognize the serial number more conveniently and accurately.

Referring to FIG. 4B, the image recognition module 120 recognizes and displays a serial plate in a rectangular plate, that is, a white box. The user is configured to check the serial number recognized on the screen and determine whether to transmit. In this case, when the recognition of the serial number is wrong, the camera module 110 may be configured to photograph again.

Here, a problem may occur such that an image photographed by the camera module 110 is out of focus or shaken, and may be photographed several times consecutively using the camera module 110 and recognized by the image recognition module 120. It can be configured to be.

Then, focus is selected on the best photographed and correctly recognized serial number among the images properly captured and the images captured by the camera module 110 and the serial numbers recognized by the image recognition module 120. Can be sent.

Referring to FIG. 5, the camera module 110 sets and photographs a scratch prepaid card to automatically turn off a flash (S101).

Next, the image recognition module 120 recognizes a serial number of 14 to 16 digits indicated in a white box in the image of the scratch prepaid card photographed by the camera module 110 (S102).

Next, the code generation module 130 converts the previously recognized serial number into numeric data, and inserts the converted numeric data into a predetermined transmission format for each mobile carrier according to the unspecified supplementary service data (USSD) protocol to charge the USSD charging code. To generate (S103).

In this case, the USSD charging code may include *, an identifier of a corresponding mobile carrier composed of 3 digits, a prefix composed of *, the inserted numeric data, and a suffix composed of #. have.

Next, the code transmission module 140 transmits the previously generated USSD charging code to the mobile communication company server 200 by pressing the call button to charge the voice call capacity or data capacity of the smart phone (S104).

Referring to FIG. 6, in operation S102, the image recognition module 120 recognizes a serial number of 14 to 16 digits marked in a white box in an image of a scratch prepaid card. It may consist of steps.

First, the image of the scratch prepaid card photographed by the camera module 110 is converted into an 8-bit grayscale image composed of 256 pixels from the RGB image (S102a).

Next, four edges of the scratch prepaid card are detected using an edge detection algorithm in the grayscale image (S102b).

Next, the intersection of each corner is corrected to a rectangular shape by using a perspective correction algorithm from the detected four corners (S102c).

Next, the edge of the white box is detected using an edge detection algorithm and a bounding edge detection algorithm for checking whether the edge is closed seamlessly (S102d).

Next, each pixel of the 8-bit grayscale image is converted to a value of 0 or 255 based on a predetermined threshold using a binarization / threshold algorithm (S102e).

In this case, when the image is taken under uneven lighting, an adaptive threshold algorithm is used to scan in which direction the average brightness value changes in the grayscale image, and then determine the size of the block having a value within a predetermined error range. The grayscale image may be configured to calculate and divide the grayscale image by the size of the block, to set each local threshold for each block, and to convert the pixel to a value of 0 or 255 for each pixel based on the set local threshold.

Next, the serial number in the white box is recognized using a connected region algorithm (S102f).

Although described with reference to the above embodiments, those skilled in the art can understand that the present invention can be variously modified and changed without departing from the spirit and scope of the invention described in the claims below. There will be.

Description of Codes:

110: camera module

120: image recognition module

130: code generation module

140: code transmission module

The present invention serves to facilitate the spread and growth of the mobile communication service industry by playing a role of making the use of the mobile scratch scratch prepaid card, which is one of the sales methods of the existing GSM mobile communication prepaid mobile communication service, easier and more convenient.

Claims

In the smartphone,

A camera module for photographing scratch prepaid cards;

An image recognition module for recognizing a serial number of 14 to 16 digits written in a white box from the image of the scratch prepaid card;

A code generation module for converting the recognized serial number into numeric data and inserting the converted numeric data into a predetermined transmission format for each mobile carrier according to an unspecified supplementary service data (USSD) protocol to generate a USSD charging code;

And a code transmitting module for transmitting the generated USSD charging code to the mobile communication company server by pressing a call button to charge a voice call capacity or data capacity of the smart phone.

The USSD charging code is,

A prefix consisting of *, an identifier of the corresponding mobile carrier consisting of three digits, a prefix consisting of *, the inserted numeric data, and a suffix consisting of #,

The camera module,

USSD charging code automatic generation / transmission device for a mobile scratch prepaid card, characterized in that the flash is automatically set to turn off.
The camera module of claim 1, wherein the camera module displays a rectangular plate for capturing the white box on a touch screen, and adjusts a direction so that the white box matches the rectangular plate by a user. When the focus is focused on the rectangular plate and the area other than the rectangular plate is concealed and displayed on another screen,

The image recognition module, the USSD charging code automatic generation / transmission device for a mobile communication scratch prepaid card is configured to recognize and display the serial number in the rectangular plate, the user can confirm the displayed serial number.
The image recognition module of claim 1, wherein the image recognition module converts an image of the scratch prepaid card photographed by the camera module into an 8-bit grayscale image composed of 256 pixels from an RGB image. In the transformed grayscale image, four edges of the scratch prepaid card are detected by using an edge detection algorithm, and an intersection point of each corner is detected from the detected four corners by using a perspective correction algorithm. The edge of the white box is detected using a edge detection algorithm (edge detection algorighm) and a bounding edge detection algorithm that checks whether the edge is closed seamlessly, and binarization / threshold algorithm the 8-bit grace using a binarization / threshold algorithm Each pixel of an image is converted to a value of 0 or 255 in contrast to a predetermined threshold, and when photographed under uneven lighting, the average brightness in the grayscale image is applied by using an adaptive threshold algorithm. After scanning the direction in which the value changes, the size of a block having a value within a predetermined error range is calculated, the grayscale image is divided by the size of the block, and each local threshold is set for each block. A mobile communication scratch prepaid card, configured to convert a value of 0 or 255 for each pixel based on a local threshold, and recognize a serial number in the white box using a connected region algorithm. USSD charging code automatic generation / transmission device.
Setting and capturing the scratch prepaid card by the camera module to automatically turn off the flash;

Recognizing, by the image recognition module, a serial number of 14 to 16 digits indicated in a white box in the image of the photographed scratch prepaid card;

Generating a USSD charging code by converting the recognized serial number into numeric data and inserting the converted numeric data into a predetermined transmission format for each mobile carrier according to an unspecified supplementary service data (USSD) protocol;

Transmitting, by the code sending module, the generated USSD charging code to the mobile communication company server by pressing a call button by the user to charge the voice call capacity or the data capacity of the smart phone;

The USSD charging code is,

A mobile communication scratch comprising a *, an identifier of a corresponding mobile carrier consisting of three digits, a prefix consisting of *, the inserted numeric data, and a suffix consisting of # How to automatically generate / send USSD charge codes for prepaid cards.
The method of claim 4, wherein the image recognition module recognizes a serial number of 14 to 16 digits indicated in a white box in the image of the photographed scratch prepaid card.

The image of the scratch prepaid card photographed by the camera module is converted into an 8-bit grayscale image composed of 256 pixels in an RGB image, and an edge detection algorithm in the converted grayscale image Four edges of the scratch prepaid card are detected using a detection algorithm, a cross point of each corner is corrected into a rectangular shape using a perspective correction algorithm from the detected four corners, and an edge detection algorithm is used. detecting the edges of the white box using a detection algorighm) and a bounding edge detection algorithm that checks whether the edges are closed seamlessly, and using the binarization / threshold algorithm. Each pixel in the grayscale image has a predetermined threshold It is converted to a value of 0 or 255 in contrast with the quasi-area, and when taken under uneven lighting, an adaptive threshold algorithm is used to scan in which direction the average brightness value changes in the grayscale image. Afterwards, the size of a block having a value within a predetermined error range is calculated, the grayscale image is divided by the size of the block, each local threshold is set for each block, and each pixel is contrasted based on the set local threshold. Converting to a value of 0 or 255, and recognizing a serial number in the white box using a connected region algorithm; and automatically generating / transmitting a USSD charging code for a scratch scratch prepaid card.