WO2015105309A1

WO2015105309A1 - Image information processing device and method therefor

Info

Publication number: WO2015105309A1
Application number: PCT/KR2015/000092
Authority: WO
Inventors: 이동수
Original assignee: 이동수
Priority date: 2014-01-07
Filing date: 2015-01-06
Publication date: 2015-07-16
Also published as: KR101463102B1

Abstract

An information processing device comprises an external server, a storage system, an image search system, a communication system, a display panel, and an input member. The image search system compares a keyword and first and second identification names; generates, when the keyword is similar to the first identification name, a first thumbnail image by reducing the resolution and size of a first original image corresponding to the first identification name, and then stores the first identification name, the first original image and the first thumb nail image in the storage system as a new second identification name, a new second thumbnail image, and a new second original image; and outputs second thumbnail images corresponding to the identification names similar to the keyword among second identification names. Accordingly, the image search system can process external image information more conveniently and faster.

Description

Image information processing device and method

The present invention relates to an image information processing apparatus and a method thereof. More specifically, the present invention relates to an image information processing apparatus and method for easily using and processing external image information at high speed.

As high-end portable communication equipment such as laptops and smartphones are widely available, it is possible for a large number of users to exchange information in real time. High-performance portable communication equipment is capable of transmitting and receiving various types of information compared to a conventional mobile phone. Conventional mobile phones only transmit and receive voice information and simple text information, but when using a high-end portable communication equipment it is possible to transmit and receive video information. Recently, not only still images but also video information transmission and reception have become possible.

However, in the instant messaging service that sends and receives information in real time using high-end portable communication equipment, it is difficult to send and receive video information smoothly. Since the video information has a much larger amount of data than the text information, there is a delay in the transmission and reception process. In particular, when the communication line is not smooth, there is a problem that the conversation through the instant message is stopped. In addition, if the original data is a moving picture, the problem due to dialogue delay is greater.

Due to these problems, a technology for transmitting and receiving an emoticon image or a thumbnail image previously stored in a portable communication device has been developed. However, the above technique has the following problems.

First, transmission and reception of various image information is impossible by using only pre-stored data. Therefore, if you want to use the new image data, the user must perform the task of storing the new image information in the memory of their portable communication device in advance. Due to the nature of the instant message, such a task cannot be performed during a conversation, and thus the range of use of the image information is limited to a pre-stored memory, and various intentions cannot be displayed.

Second, when the number of pre-stored data increases, it is difficult to find a desired emoticon image or thumbnail image during a conversation. In particular, if the number of data exceeds the screen size, the screen must be scrolled until the desired image appears. This task is often time consuming and half the realm of real-time conversation using instant messages.

Third, in order to display the image information stored in the memory in the chat window, a task of converting the image information into thumbnail images every time is required. This task puts a strain on the information processing apparatus and causes a rapid drain on the battery.

Therefore, there is a need for image information processing technology that can solve these problems.

One object of the present invention is to provide an image information processing device which is easy to use and which processes external image information at a high speed.

Another object of the present invention is to provide an image information processing method which is easy to use and which processes upper image information at a high speed.

The problem to be solved by the present invention is not limited to the above-described objects, and may be variously expanded within a range without departing from the spirit and scope of the present invention.

In order to achieve the above object of the present invention, an image information processing apparatus according to exemplary embodiments of the present invention includes an external server, a storage system, an image retrieval system, a communication system, a display panel, and an input member. The external server stores a first identification name and a first original image corresponding to the first identification name. The storage system stores a second identification name, a second original image corresponding to the second identification name, and a second thumbnail image obtained by reducing the resolution and size of the second original image. The image search system compares the search word with the first and second identification names, and when the search word and the first identification name are similar, reduce the resolution and size of the first original image corresponding to the first identification name. Generate a first thumbnail image and store the first identification name, the first original image and the first thumbnail image in the storage system as a new second identification name, a new second thumbnail image, and a new second original image; And outputting the second thumbnail images corresponding to identification names similar to the search word among the second identification names. The communication system is disposed between the external server and the image retrieval system to transmit the first identification name and the first original image to the image retrieval system, wherein the second identification name, the second thumbnail image and The second original image is output. The display panel is connected to the image retrieval system and displays the second thumbnail images output from the image retrieval system. The input member inputs a search word and selects one of the displayed second thumbnail images.

In example embodiments, the image information processing apparatus may exchange a second terminal image, the second original image, and an instant message with a counterpart terminal in real time.

In example embodiments, the image retrieval system may separate the second identification code and the second original image corresponding to the selected second thumbnail image into a plurality of packets that are equal to or less than the maximum transmission unit of the communication line.

In example embodiments, the identification code may convert a portion of the binary data of the second thumbnail image into an ASCII value.

In example embodiments, the image retrieval system combines the packets with the identification code and serial number to generate packets for transmission and outputs the packets to the communication system. Can be sent to the terminal.

In example embodiments, the input member may include a touch panel and may be displayed in the form of a message input window on the display panel.

In example embodiments, the input member may be switched to an image search mode in which the search word is input in a message input mode by a touch of an icon displayed on the display panel or a click of a mouse connected to the input member.

In example embodiments, when any one of the first and second thumbnail images displayed on the display panel is touched, the communication system may be connected to the touched thumbnail image and the touched thumbnail image. The corresponding original image may be transmitted to the counterpart terminal.

The display panel may include the first and second thumbnails when the number of the first and second thumbnail images displayed on the display panel exceeds the number of thumbnail images displayed on the display panel at one time. Only some of the images may be displayed and the rest of the first and second thumbnail images may be browsed.

The image index frequency management system may further include an image index frequency management system connected to the storage system and measuring index frequency of each of the second thumbnail images.

In example embodiments, the storage system may include a high speed memory storing second thumbnail images having a high index frequency, and a main memory storing remaining second thumbnail images.

In example embodiments, the display panel may display the second thumbnail images in the order of high index frequency.

In example embodiments, the storage system may include an advertisement identification name, an advertisement original image corresponding to the advertisement identification name, and an advertisement thumbnail image obtained by reducing the resolution and size of the advertisement original image, wherein the search word is the advertisement. In response to the identification name, the display panel displays the advertisement thumbnail image at the highest priority, and the communication system may transmit information on which the advertisement thumbnail image is displayed to an advertiser terminal.

In order to achieve the above object of the present invention, in the image information processing method according to an exemplary embodiment of the present invention, first of the binary data of the thumbnail image of the reduced resolution and size of the original image corresponding to the identification name Extract some. Subsequently, the extracted binary data is converted into an ASCII value to generate an identification code. Thereafter, the original image is separated into a maximum transfer unit (MTU) or less of a communication line to generate a plurality of packets. Subsequently, the identification code and the serial number are combined with each packet to generate a packet for transmission. Then, the transmission packet is transmitted through the communication line.

In example embodiments, the image information processing method may include: searching an external image, receiving image information including an identification name and an original image according to the search result, and resolution and size of the original image The method may further include reducing the size of the thumbnail to generate a thumbnail image.

In example embodiments, the image information processing method may further include transmitting the thumbnail image through the communication line.

In example embodiments, the image information processing method may include extracting a portion of the binary data of the received thumbnail image and converting it into an ASCII value, and receiving the ASCII value converted from the binary data of the received thumbnail image. Comparing the identification codes included in the packets for transmission, and if the ASCII value of the received thumbnail image and the identification code included in the transmission packets are the same, the serial numbers of the transmission packets The method may further include reproducing the original image.

In example embodiments, the extracted binary data may include dummy data and ASCII value conversion data.

In example embodiments, the identification code may include ten or more ASCII values.

According to exemplary embodiments of the present invention, images stored in an external server such as an Internet portal server may be freely used in real time, and various image information may be transmitted and received. In particular, when a real-time conversation such as an instant message, it is useful for the transmission of large files including images, videos, and the like.

In addition, it is possible to search only images having an identification name similar to a search word including a search word function, so that it is easy to find a desired emoticon image or a thumbnail image during a conversation.

Furthermore, the thumbnail image and the original image are matched through a small identification code, and the original image is stored in the form of a plurality of transmission packets having a size less than or equal to the maximum transmission unit, thereby providing an image retrieval system, a storage system, and a communication system. The load on the communication line and the terminal on the other side is reduced. That is, when the thumbnail image is combined with the original image, the size of the image information is rather increased, causing delay in real-time transmission and occupying a large amount of memory, thereby causing a burden on the memory and the like. However, the use of such packets for transmission reduces the burden on the memory and the like.

In addition, the storage system includes a high speed memory and a main memory, and only the high index frequency images are stored in the high speed memory, thereby rapidly increasing the data input / output speed.

Furthermore, by changing the search function, it is possible to search for images under various conditions, and to effectively manage image data by updating the index frequency. It is possible to select more various images by displaying the retrieved image data according to various frequencies. In particular, technology using index frequency may provide accurate information to external server owners such as advertisers and paid content providers.

1 is a block diagram illustrating an image information processing apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating image information transmitted by the image information processing apparatus shown in FIG. 1.

3 and 4 are flowcharts illustrating a method of processing image information according to an embodiment of the present invention.

FIG. 5 is a block diagram illustrating the image information processing method illustrated in FIGS. 3 and 4.

6 is a flowchart illustrating a method of processing image information according to another embodiment of the present invention.

Hereinafter, a display device and a method of manufacturing the same according to exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments, and is commonly used in the art. Those skilled in the art will be able to implement the invention in various other forms without departing from the spirit of the invention.

In this specification, specific structural to functional descriptions are merely illustrated for the purpose of describing embodiments of the present invention, and embodiments of the present invention may be embodied in various forms and are limited to the embodiments described herein. It is not to be understood that the present invention is to be construed as including all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention. When a component is described as being "connected" or "contacted" to another component, it is to be understood that it may be directly connected to or in contact with another component, but there may be another component in between. something to do. In addition, when a component is described as being "directly connected" or "directly contacted" with another component, it may be understood that there is no other component in between. Other expressions describing the relationship between the components, such as "between" and "directly between" or "adjacent to" and "directly adjacent to", may be interpreted as well.

The terminology used herein is for the purpose of describing exemplary embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. As used herein, the terms "comprise", "comprise" or "have" are intended to designate that there is a feature, number, step, action, component, part, or combination thereof that is practiced, and that one or the same. It is to be understood that the present invention does not exclude in advance the possibility of the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof. Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Does not.

Terms such as first, second and third may be used to describe various components, but such components are not limited by the terms. The terms are used to distinguish one component from another component. For example, without departing from the scope of the present invention, the first component may be referred to as the second or third component, and similarly, the second or third component may be alternatively named.

Referring to FIG. 1, an image information processing apparatus includes an input member 500, an external server 100, a storage system 200, an image retrieval system 300, a communication system 400, and a display panel 600. . In the present embodiment, the image information processing apparatus may exchange instant messages, images, videos, and the like with the counterpart terminal 900 in real time.

The display panel 600 includes a flat panel display panel and displays an image and input information. The video includes a thumbnail image, an instant message, an original image, and the like. For example, the image may include a messaging window, a bulletin board, a mail window, an editor window, a thumbnail image list, and the input information may include a virtual keyboard, an emoticon image, a sticker image, an image search window, an image index window, a search word, a dictionary, and the like. Can be. The search term includes an image tag. The input information may include a virtual keyboard, an input icon, a search word input icon, an image search icon, a selection icon, and the like.

In the present embodiment, the display panel 600 displays a messaging window, a search window arranged adjacent to the messaging window, and a virtual keyboard disposed below the messaging window.

The input member 500 receives input information by a user's manipulation to generate an input signal. For example, the input member 500 includes a touch panel, a keyboard, a mouse, voice recognition, and the like. In the present embodiment, the input member 500 includes a touch panel integrally formed on the display panel 600. For example, when a user touches an icon displayed on the display panel 600, an input signal relating to an operation of the icon is generated.

In the present exemplary embodiment, the user touches the input member 500 corresponding to the virtual keyboard displayed on the display panel 600 to input a search word for searching for a thumbnail image, or to transmit a second among the searched second thumbnail images. Select the thumbnail image.

The external server 100 stores a first identification name and a first original image corresponding to the first identification name. The external server 100 includes all kinds of information processing devices existing on the Internet. For example, the external server 100 may include an external search engine such as Google, Flickr, Naver, Daum, and the like.

In the present embodiment, the first identification name and the first original image may include a text file and an image file of an internet website. For example, the website includes an internet article, a blog, a bulletin board post, an image gallery, and the like.

The storage system 200 stores a second identification name, a second original image corresponding to the second identification name, and a second thumbnail image obtained by reducing the resolution and size of the second original image. In the present embodiment, the storage system 200 processes and stores the second identification name, the second original image and the second thumbnail image into data having the form shown in FIG. 2. Data shown in FIG. 2 will be described later.

The storage system 200 includes a high speed memory 2021 and a main memory 2022. The high speed memory 2021 includes a memory device capable of high speed input / output. For example, the high speed memory 2021 may include a flash memory, a solid state drive (SSD) memory, and the like. The high speed memory 2021 selectively stores some of the second identification names, the second original images, and the second thumbnail images with a high frequency of use.

The main memory 2022 includes a memory device having a large storage capacity. For example, the main memory 2022 includes a hard disk drive and the like. The main memory 2022 stores all of the second identification names, the second original images and the second thumbnail images without distinction. For example, the main memory 2022 stores second identification names, the second original images, and the second thumbnail images that are not stored in the high speed memory 2021.

The image index frequency management system 700 is connected to the storage system 200 and measures index frequency for each of the second thumbnail images. The image index frequency management system 700 stores a second thumbnail image having a high index frequency among the second thumbnail images, a second identification name corresponding to the second thumbnail image, and a second original image in the high speed memory 2021. do.

The image index frequency management system 700 also checks the storage capacity of the high speed memory 2021. When the storage capacity of the high speed memory 2021 is insufficient, the image index frequency management system 700 may have a low index frequency among the second identification names, the second thumbnail images, and the second original images stored in the high speed memory 2021. The second identification names, the second thumbnail images and the second original images are deleted from the high speed memory 2021.

In the present embodiment, the display panel 600 displays the second thumbnail images in the order of high index frequency. In another embodiment, the display panel 600 compares the index frequency stored in the storage system 200 with the external index value multiplied by the weight of the external index frequency corresponding to the first thumbnail image stored in the external server 100, thereby increasing the value. You can also display them in order. For example, an index value of an external index frequency may be used as an external index value, and the external index value may be compared with the stored index frequency.

In another embodiment, the storage system 200 includes an advertisement identification name, an advertisement original image corresponding to the advertisement identification name, and an advertisement thumbnail image with reduced resolution and size of the advertisement original image. When the search word corresponds to the advertisement identification name, the display panel 600 displays the advertisement thumbnail image at the highest priority. In addition, the communication system 400 transmits the information on which the advertisement thumbnail image is displayed to an advertiser terminal (not shown).

The image search system 300 compares the search word with the first and second identification names. When the search word is similar to the search word and the first identification name, the image search system 300 generates a first thumbnail image by reducing the resolution and size of the first original image corresponding to the first identification name.

The first thumbnail image and the first identification name and the first original image corresponding to the first thumbnail image generated by the image retrieval system 300 are stored in the storage system 200. The first identification name, the first thumbnail image, and the first original image stored in the storage system 200 are respectively the new second identification name, the new second thumbnail image, and the new second original image. An image database is formed along with a second stored identification name, a second stored thumbnail image, and a second stored original image.

The image retrieval system 300 outputs the second thumbnail images corresponding to the identification names similar to the search word among the new second identification name and the previously stored second identification names to the display panel 600. That is, since the new second identification name corresponds to the first identification name authorized from the external server 100, the image search system 300 may display the first thumbnail image among the first identification name and the second identification names. And / or output the second thumbnail images to the display panel 600.

In the present embodiment, the image retrieval system 300 converts the second identification code and the second original image corresponding to the selected second thumbnail image by the input member 500 into a plurality of packets which are equal to or smaller than the maximum transmission unit of the communication line. Separate. In the present embodiment, the second identification name, the second thumbnail image and the second original image stored in the storage system 200 have the form of the packets. The packets correspond to pieces of the original image. The communication system 400 transmits the second identification name, the second thumbnail image, and the second original image in the form of packets to the counterpart terminal 900.

1 and 2, the image retrieval system 300 generates an index frequency table 710 corresponding to each second thumbnail image 701b 'and stores the index frequency table 710 in the storage system 200.

The index frequency table 710 includes a second identification name 701a and an index frequency 701d.

The index frequency table 710 corresponds to the respective second thumbnail image 701b and the image file table 701 through the second identification name 701a.

The image retrieval system 300 stores the retrieved second thumbnail images 701b 'according to the index frequency 701d of the index frequency table 710 corresponding to each second thumbnail image 701b'. Reading from the data is transmitted to the display panel 600.

The image file table 701 corresponding to the second thumbnail image 701b 'includes a second identification name 701a, binary data 701b of the second thumbnail image, an identification code 701c and an index frequency 701d. do.

The image file table 701 includes information about the packets for transmission 702 and the second thumbnail image 701b ', so that the second original image can be easily transmitted. That is, when the second original image is identified only by the second identification name 701a, the second original image may be broken or a transmission failure may occur when the second identification name 701a is accidentally identical. In order to overcome this problem, when the second original image is identified by combining the second thumbnail image 701b 'with the second identification name 701a, the data capacity for identification only becomes too large, which may cause traffic problems. In this embodiment, part of the binary data 701b of the second thumbnail image 701b 'is converted into an ASCII value to generate an identification code 701c corresponding to the second thumbnail image 701b'. For example, after extracting the first 8 x 16 binary data from the binary data 701b of the second thumbnail image 701b ', 16 ASCII values corresponding to the respective 8 binary data are identified by the identification code 701c. Set it. At this time, a part of each of the extracted eight binary data may be processed as dummy data, and only the rest may be converted into ASCII values. For example, the first binary data of the eight binary data may be dummy data, and the remaining seven binary data may be converted into ASCII values.

The image retrieval system 300 includes a plurality of second original images divided into a maximum transfer unit (MTU) or less of a communication line used to transmit data to the counterpart terminal 900 through the communication system 400. Split into two packets. If the size of the data transmitted through the communication line exceeds the maximum transmission unit, the traffic is interrupted and data transmission is delayed. However, in the present invention, the data is smoothly transmitted because the size of the data transmitted through the communication line is smaller than the maximum transmission unit.

The image retrieval system 300 combines the identification code 701c and the serial number 702a with the respective packets 702b to generate packets for transmission 702.

Each transmission packet 702 includes an identification code 701c, a serial number 702a, and a packet 702b.

The packet 702b means each data packet obtained by dividing the second original image into data of smaller size than the maximum transmission unit.

The serial number 702a is a number indicating how many data packets the packet 702b corresponds to in the second original image.

When the packets for transmission 702 are transmitted to the other terminal 900, the other terminal 900 transmits the packets for transmission 702 having the same identification code 701c in the order of their serial number 702a. In combination to reproduce the second original image.

At this time, each transmission packet 702 may further include an index frequency 701d.

The communication system 400 is disposed between the external server 100 and the image retrieval system 300 to transmit the first identification name and the first original image to the image retrieval system 300, and the second identification. The name, the second thumbnail image and the second original image are transmitted to the counterpart terminal 900. For example, the communication system 400 transmits the second original image to the counterpart terminal 900 in the unit of the packet 702 for transmission.

For example, the communication system 400 may include an application programming interface (API), the Internet, Wi-Fi, a code division access method (CDMA), a frequency division access method (FDMA), and a time division access method ( TDMA), European Standard Currency (GSM), Wibro, WCDMA, HSDPA, PCS, Modem, Ethernet, and the like. For example, the application program interface includes a technology based on the Simple Object Access Protocol (SOAP) based on the Web Services Description Language (WSDL).

3 and 4 are flowcharts illustrating an image information processing method according to an embodiment of the present invention, and FIG. 5 is a block diagram illustrating the image information processing method shown in FIGS. 3 and 4.

1 to 5, the external image stored in the external server 100 is searched using the image search system 300 (S90).

In the present embodiment, an image search icon 602 is displayed at the top of the display panel 600, and a messaging window 604 is displayed at the bottom. In another embodiment, instead of the messaging window 604, various windows such as a bulletin board window, a mail writing window, an editor window, and the like may be displayed.

Before the user touches the input member 500 corresponding to the image search icon 602, the cursor 601 is disposed in the messaging window 604 to allow a message to be input.

When the user touches the input member 500 corresponding to the image search icon 602, the image search system 300 displays a search term input window 606 and a search button 504 on the display panel 600. The cursor 601 is disposed in the search word input window 606 to allow a search word to be input. The user inputs a search word corresponding to a desired image in the search word input window 606. For example, when an exciting message is written in the messaging window 604, an image of exciting content may be inserted into the message. In order to insert an exciting image, a search term “exciting” may be input into the search term input window 606.

When the input of the search word 'exciting' is completed in the search term input window 606, the search button 504 is clicked to start searching for the image.

In the searching process, it is determined whether the search word is similar to the first identification name corresponding to the external image. In addition, the search process determines whether the search word and the second identification name stored in the storage system 200 are similar.

When the search word and the first identification name are similar, the image information including the first identification name and the first original image 722b is received from the external server 100 through the image search system 300 (S100).

The image retrieval system 300 generates a first thumbnail image 711b by reducing the resolution and size of the first original image 722b (S110). In another embodiment, when the external server 100 itself includes a thumbnail image, the external server 100 does not generate a first thumbnail image 711b, but instead generates a first thumbnail image owned by the external server 100. It may also be used as a thumbnail image 711b.

In another embodiment, the image search system 300 searches external images (S90), or instead of receiving the first identification name and the first original image 711b from the external server 100 (S100), the search term. And the second identification name stored in the storage system 200 may be compared. When the search word and the second identification name are similar, the image search system 300 may receive the second identification name, the second thumbnail image 701b ', and the second original image from the storage system 200.

In the image search window 608 through the search process, the first thumbnail image 711b generated using the first original image 722b received from the external server 100 and the first image stored in the storage system 200 are stored. Two thumbnail images 701b 'and an advertisement thumbnail image 731b are listed and displayed.

In another embodiment, when the user selects and clicks a thumbnail image 711b among the thumbnail images 711b, 701b ′, and 731b listed in the image search window 608, the display panel 600 may display the thumbnail image 711b. The original image 722b corresponding to) may be displayed.

The storage system 200 may further include an advertisement identification name, an advertisement original image corresponding to the advertisement identification name, and an advertisement thumbnail image 731b obtained by reducing the resolution and size of the advertisement original image. For example, when the search word corresponds to the advertisement identification name, the display panel 600 may display the advertisement thumbnail image 731b at the highest priority. The communication system 400 may transmit information on which the advertisement thumbnail image 731b is displayed to an advertiser terminal (not shown).

In a similar manner, the external server 100 may be a server of a paid content provider, using the first identification name and the first original image of the paid image content stored in the external server 100, and using the paid content. It may be transmitted to the external server 100 of the provider.

Hereinafter, a method of transmitting the original image corresponding to the selected thumbnail image will be described in detail.

1, 3, and 4 again, the image search system 300 extracts a part of the binary data 701b of the second thumbnail image (S120). In the present embodiment, the second thumbnail image, the second identification name, and the second original image refer to image data stored in the storage system 200, and a second thumbnail whose source is originally stored in the storage system 200. In addition to the image, the second identification name and the second original image, the first original image and the first identification name received from the external server 100 are processed through the image search system 300 and newly stored in the storage system 200. The thumbnail image, the identification name and the original image are also included in the second thumbnail image, the second identification name and the second original image. In another embodiment, a thumbnail image, an identification name, and an original image that the user directly produces and input to the storage system 200 are also included in the second thumbnail image, the second identification name, and the second original image.

For example, the image retrieval system 300 extracts 8x16 binary data from the binary data 701b of the first thumbnail image. There is no limit to the number of binary data extracted. However, if the number of extracted binary data is too small, the same identification code may be generated for duplicate thumbnail images. In addition, if the number of extracted binary data is too large, the image retrieval system 300 and the storage system 200 takes a lot of load. The number of binary data extracted may vary depending on the performance of the image retrieval system 300 and the storage system 200, but it is preferable to extract 8x10 to 8x20 binary data.

The image retrieval system 300 converts the extracted binary data 701b to an ASCII value to generate an identification code 701c (S130). The function of the identification code 701c serves to match the first original image pieces with the first thumbnail image. When there are a plurality of thumbnail images, it is easy to know which thumbnail image corresponds to a part of the binary data of the thumbnail images and the identification code 701c.

Combinations of binary data corresponding to ASCII code values can be varied. In this embodiment, the first two of the eight binary data become dummy data, and the identification code 701c is generated using alphabetic ASCII values corresponding to the remaining six data.

Table 1 compares the binary data used to generate the identification code in this embodiment with the ASCII values.

Table 1

Serial Number	Binary data	ASCII value
One	01 000000	@
2	01 000001	A
3	01 000010	B
4	01 000011	C
5	01 000100	D
6	01 000101	E
7	01 000110	F
8	01 000111	G
9	01 001000	H
10	01 001001	I
11	01 001010	J
12	01 001011	K
13	01 001100	L
14	01 001101	M
15	01 001110	N
16	01 001111	O
17	01 010000	P
18	01 010001	Q
19	01 010010	R
20	01 010011	S
21	01 010100	T
22	01 010101	U
23	01 010110	V
24	01 010111	W
25	01 011000	X
26	01 011001	Y
27	01 011010	Z
28	01 011011	[
29	01 011100	\
30	01 011101	]
31	01 011110	^
32	01 011111	_
33	01 100000	`
34	01 100001	a
35	01 100010	b
36	01 100011	c
37	01 100 100	d
38	01 100101	e
39	01 100110	f
40	01 100111	g
41	01 101000	h
42	01 101001	i
43	01 101010	j
44	01 101011	k
45	01 101 100	l
46	01 101101	m
47	01 101110	n
48	01 101111	o
49	01 110000	p
50	01 110001	q
51	01 110010	r
52	01 110011	s
53	01 110 100	t
54	01 110101	u
55	01 110110	v
56	01 110111	w
57	01 111000	x
58	01 111001	y
59	01 111010	z
60	01 111011	{
61	01 111100	\|
62	01 111101	}
63	01 111110	To
64	01 111111	space

Referring to [Table 1], the first two of the eight binary data are dummy data, and only the six data at the back are converted to ASCII values. That is, the two dummy data are recognized as '01' regardless of their kind.

For example, when the first part of the binary data of the first thumbnail image 701b 'is composed of 10100100 10010010 00010010 01001010 00111100 01000100 10010 ..., they are transformed into 01100100 01010010 01010010 01001010 01111100 01000100 01010 ..., respectively. The modified binary data correspond to ASCII values of 'dRRJ | D ...', respectively, according to [Table 1]. The ASCII value 'dRRJ | D ...' becomes the identification code 701c.

The image retrieval system 300 generates a plurality of packets 702b by dividing the first original image below a maximum transfer unit (MTU) of the communication line (S140). For example, when the maximum transmission unit of the communication line is 1,500 bytes and the first original image is 14,000 bytes, the image retrieval system 300 includes ten packets 702b having the first original image in units of 1,400 bytes. To separate. Preferably, the size of each packet has a value smaller than the maximum transmission unit minus the size of the identification code 701c and the serial number 702a.

The image retrieval system 300 generates the transmission packet 702 by combining the identification code 701c and the serial number 702a with each packet 702b (S150). The generated packet for transmission 702 is stored in the storage system 200 together with the index frequency table 710 and the image file table 701.

The image retrieval system 300 stores the first identification name, the first thumbnail image, and the first original image in the storage system 200. The first identification name, the first thumbnail image, and the first original image stored in the storage system 200 become a new second identification name, a new second thumbnail image, and a new second original image, so as to be image data of the storage system 200. The base is updated.

In the present embodiment, the second identification name, the second thumbnail image and the second original image are stored in the form of the index frequency table 710, the image file table 701 and the packets for transmission 702 shown in FIG. Stored in system 200.

The second thumbnail images according to the search result are displayed in the image search window 608. The second thumbnail images displayed in the image search window 608 may include a first thumbnail image applied from an external server as a new second thumbnail image stored in the storage system 200 as a new second thumbnail image, and a second stored in the storage system 200. Contains thumbnail images.

The user selects an object to be transmitted from among the second thumbnail images displayed on the image search window 608 through the input member 500. The selection may be performed by touching the input member 500 or by clicking a separate input member (not shown).

The user inputs a transmission command for the selected second thumbnail image through the input member 500. In another embodiment, the selection and transmission command of the selected second thumbnail image may be performed at the same time.

When the user inputs a transmission command through the input member 500, the image search system 300 transmits a second thumbnail image through the communication system 400 and the communication line (S155). In the present embodiment, the second thumbnail image is stored in the form of the transmission table 701. Therefore, the image retrieval system 300 may transmit the second thumbnail image by transmitting the transmission table 701.

The image retrieval system 300 has the communication system 400 and the other side of the transmission packets 702 including the identification code 701c generated by the second thumbnail image 701b 'through the communication line. It transmits to the terminal 900 (S160). In the present embodiment, the second thumbnail image 701b 'is a packet for transmission 702 including fragments 702b' to packets 702b of the second original image via a small identifier 701c. Tag), the load of the image retrieval system 300, the storage system 200, the communication system 400, the communication line, and the counterpart terminal 900 is reduced.

The process of reproducing the second original image in the counterpart terminal 900 is as follows.

The other terminal 900 extracts a part of the binary data of the second thumbnail image 701b 'of the received image file table 701 and converts it to an ASCII value (S170).

The other terminal 900 compares the ASCII value converted from the second thumbnail image 701b 'of the received image file table 701 with the identification code 701c included in the received packets 702. (S180).

If the converted ASCII value and the identification code 701c are the same, the other party's terminal 900 reproduces the original image according to the serial numbers of the packets 702 for transmission (S190).

According to the present embodiment as described above, it is possible to freely use images stored in the external server 100, such as an Internet portal server in real time, it is possible to transmit and receive a variety of image information. This is especially useful for real-time conversations, such as instant messages.

Furthermore, the thumbnail image and the original image are matched through a small identification code, and the original image is stored in the form of a plurality of transmission packets having a size less than or equal to the maximum transmission unit, thereby providing an image retrieval system, a storage system, and a communication system. The load on the communication line and the terminal on the other side is reduced.

6 is a flowchart illustrating a method of processing image information according to another embodiment of the present invention. In the present embodiment, except for the technology of touching the image search icon and the technology of setting the search function is the same as the embodiment shown in Figures 1 to 5, duplicate description of the same components are omitted do.

1, 2, 5, and 6, an image search icon 602 is displayed on the display panel 600.

The user touches the input member 500 disposed on the display panel 600 to touch the image search icon 602 (S200).

The touch search time of the image search icon 602 exceeds the reference time T_r through the image search system 300 (S210). The reference time T_r is a criterion for distinguishing a normal touch from a long touch. For example, the reference time T_r may be 3 seconds. That is, when the user touches the image search icon 602 for more than 3 seconds, the image search system 300 may recognize the touch as a long time. On the other hand, when the user touches the image search icon 602 within 3 seconds, the image search system 300 may recognize the normal touch.

If the touch time exceeds the reference time T_r, the image retrieval system 300 is converted to a mode for setting a retrieval function (S215). In the mode for setting the search function, the external search function ON / OFF, search database selection, user preference variable input, display order selection, etc. can be determined.

In the external search function OFF mode, the image search system 300 searches only images in the storage system 200 existing inside the image information processing apparatus. In the external search function ON mode, the image search system 300 may search not only the storage system 200 but also images stored in the external surger 100.

Search database selection performs a function of selecting a database to be searched in the external search function ON mode. For example, the use of external search engines such as Google, Flickr, Naver, Daum, peer to peer (P2P), etc., the use of file services shared between users, the use of data stored in the other party's terminal Various database choices such as whether it is possible.

User preference variable input allows the user to preferentially select image data that the user prefers individually. For example, the user may input various preference variables, such as whether the user prefers a recent image, a past image, an image in the same region, a specific country image, or the like.

The display order selection selects the order in which the retrieved image data is displayed in the image search window 608. The retrieved image data can be displayed in a particular order, for example, the highest frequency. Alternatively, image data may be displayed according to the lowest frequency or from the middle frequency. Typically, the order of the highest frequency images is almost unchanged. Therefore, when displaying the retrieved image data according to such various frequencies, it is possible to select more various images.

After the step of setting the search function (S215) is finished, the process returns to the step (S200) of touching the image search icon.

When the touch time is within the reference time T_r, the display panel 600 displays a search word input window 608. The search word is input through the search word input window 608 (S220).

It is checked whether the external search function of the image search system 300 is in an ON state (S230).

When the external search function of the image search system 300 is in an ON state, the image search system 300 searches for external images stored in the external server 100 (S240). Searching for external images (S240) is the same as step S90 of FIG. 3, and thus redundant descriptions thereof will be omitted.

The image retrieval system 300 stores the retrieved external image in the storage system 200 (S245). For example, the step S245 of storing the searched external image by the image search system 300 may use the same method as the steps S100 to S150. In another embodiment, the image retrieval system 300 may store external images retrieved in various ways.

The image retrieval system 300 searches for images stored in the fast memory 2021 whether there is an image corresponding to the search word (S250). For example, the image retrieval system 300 compares the search word with the second identification name stored in the fast memory 2021 to determine whether the image is similar.

The image retrieval system 300 searches for images stored in the main memory 2022 whether there is an image corresponding to the search word (S260). For example, the image retrieval system 300 compares the search word with the second identification name stored in the main memory 2022 to determine whether the image is similar.

In another embodiment, the image retrieval system 300 does not retrieve images stored in the high speed memory 2021 and the main memory 2022 separately, but rather all second identification names of the storage system 200 are stored in the high speed memory 2021. The search may be terminated if only a second similar name is stored after comparing the search word with the second identification name stored in the fast memory 2021.

The user selects an object to be transmitted from among the second thumbnail images displayed on the image search window 608 through the input member 500 (S270).

The image retrieval system 300 transmits a second thumbnail image through the communication system 400 and the communication line (S280). In the present embodiment, the step of selecting the thumbnail image for transmission (270) and the step of transmitting the selected thumbnail image (S280) is the same as the step (S155) of transmitting the thumbnail image through the communication line shown in FIG. Duplicate explanations are omitted.

The image search system 300 transmits a second original image corresponding to the second thumbnail image for transmission (S290). For example, transmitting the original image 290 may be the same as transmitting the transmission packet through the communication line illustrated in FIG. 4 (S160). In another embodiment, the step 290 of transmitting the original image may transmit a second original image corresponding to the second thumbnail image for transmission using various methods.

The image index frequency management system 700 updates the index frequency of the transmitted second thumbnail image (S300). In the present embodiment, the image index frequency management system 700 may also update the index frequency of the second identification name for the transmitted second thumbnail image. For example, the updating of the index frequency may be performed by updating the number of index frequencies to +1.

In the present embodiment, when the index frequency of the transmitted second thumbnail image exceeds a predetermined reference index frequency, the transmitted second thumbnail image, the transmitted second original image, and the corresponding second identification name are It is stored in the high speed memory 2021.

For example, the image index frequency management system 700 arranges the second identification names, the second thumbnail images, and the second original images stored in the storage system 200 in order of index frequency, and selects those having high index frequency. Can be stored in the high speed memory 2021. That is, a portion of the image data stored in the main memory 2022 having a high index frequency is stored in the high speed memory 2021.

In addition, the image index frequency management system 700 may delete image data having a low index frequency from the high speed memory 2012 when the storage capacity of the high speed memory 2021 is exceeded.

According to this embodiment as described above, it is possible to search the image under various conditions by setting the search function, and it is possible to effectively manage the image data by updating the index frequency.

In the above embodiments, a smart phone is taken as an example, but the technical concept of the present invention may be applied to various communication devices such as a notebook, a desktop, a PDA, a BlackBerry, and the like.

As described above, exemplary embodiments of the present invention have been described, but the present invention is not limited thereto, and a person of ordinary skill in the art does not depart from the concept and scope of the following claims. It will be understood that various changes and modifications are possible in the following.

Claims

An external server storing a first identification name and a first original image corresponding to the first identification name;

A storage system for storing a second identification name, a second original image corresponding to the second identification name, and a second thumbnail image obtained by reducing the resolution and size of the second original image;

Compare the search word with the first and second identification names, and when the search word and the first identification name are similar, the first thumbnail image by reducing the resolution and size of the first original image corresponding to the first identification name. Generate and store the first identification name, the first original image and the first thumbnail image in the storage system as a new second identification name, a new second thumbnail image and a new second original image, and identify the second identification image. An image retrieval system for outputting the second thumbnail images corresponding to identification names similar to the search word among names;

Disposed between the external server and the image retrieval system, and transmitting the first identification name and the first original image to the image retrieval system, wherein the second identification name, the second thumbnail image and the second original image A communication system for outputting an image;

A display panel connected to the image retrieval system to display the second thumbnail images output from the image retrieval system; And

And an input member for inputting a search word and selecting one of the displayed second thumbnail images.
The image information processing apparatus of claim 1, wherein the image information processing apparatus exchanges a second terminal image, the second original image, and an instant message with a counterpart terminal in real time.
The image information system as claimed in claim 1, wherein the image retrieval system separates the second identification code and the second original image corresponding to the selected second thumbnail image into a plurality of packets which are equal to or less than a maximum transmission unit of a communication line. Processing unit.
The video information processing apparatus according to claim 3, wherein the identification code converts a part of the binary data of the second thumbnail image into an ASCII value.
The image retrieval system of claim 4, wherein the image retrieval system combines the identification code and serial number with the packets to generate packets for transmission and outputs them to the communication system.

And the communication system transmits the transmission packets to a counterpart terminal.
The image information processing apparatus of claim 1, wherein the input member comprises a touch panel and is displayed in the form of a message input window on the display panel.
The image information of claim 6, wherein the input member is switched to an image search mode for receiving the search word in a message input mode by touching an icon displayed on the display panel or clicking a mouse connected to the input member. Processing unit.
7. The touch system of claim 6, wherein the input member corresponds to the touched thumbnail image and the touched thumbnail image when any one of the first and second thumbnail images displayed on the display panel is touched. Image information processing apparatus, characterized in that for transmitting the original image to the other terminal.
The display panel of claim 6, wherein when the number of the first and second thumbnail images displayed on the display panel exceeds the number of the thumbnail images displayed on the display panel at one time, the display panel includes the first and second thumbnail images. And a portion of the first and second thumbnail images are browsed.
The image information processing apparatus of claim 1, further comprising an image index frequency management system coupled to the storage system and configured to measure an index frequency for each of the second thumbnail images.
The image information processing apparatus of claim 10, wherein the storage system comprises a high speed memory for storing the second thumbnail images having a high index frequency, and a main memory for storing the remaining second thumbnail images.
The image information processing apparatus of claim 10, wherein the display panel displays the second thumbnail images in the order of high index frequency.
The system of claim 1, wherein the storage system includes an advertisement identification name, an advertisement original image corresponding to the advertisement identification name, and an advertisement thumbnail image with reduced resolution and size of the advertisement original image.

If the search term corresponds to the advertisement identification name, the display panel displays the advertisement thumbnail image in the highest order.

The communication system is a video information processing apparatus, characterized in that for transmitting the information displayed on the advertisement thumbnail image to the advertiser terminal.
Extracting a part of binary data of a thumbnail image having a reduced resolution and size of an original image corresponding to an identification name;

Generating an identification code by converting the extracted binary data into an ASCII value;

Generating a plurality of packets by dividing the original image into a maximum transfer unit (MTU) or less of a communication line;

Generating a packet for transmission by combining the identification code and the serial number with each packet; And

And transmitting the packet for transmission through the communication line.
The method of claim 14,

Retrieving an external image;

Receiving image information including an identification name and an original image according to the search result; And

And reducing the resolution and size of the original image to generate a thumbnail image.
15. The method of claim 14, wherein the image information processing method further comprises transmitting the thumbnail image through the communication line.
The method of claim 16, further comprising: extracting a part of the binary data of the received thumbnail image and converting the extracted binary data into an ASCII value;

Comparing the ASCII code converted from the binary data of the received thumbnail image with the identification code included in the received transmission packets; And

If the ASCII value of the received thumbnail image and the identification code included in the packets for transmission are the same, reproducing the original image according to the serial numbers of the packets for transmission. Information processing method.
15. The method of claim 14, wherein the extracted binary data includes dummy data and ASCII value conversion data.
19. The method of claim 18, wherein the identification code includes at least 10 ASCII values.