WO2005018212A1

WO2005018212A1 - Multimedia device with internet and phone function

Info

Publication number: WO2005018212A1
Application number: PCT/KR2003/001730
Authority: WO
Inventors: Yuji Takayama
Original assignee: Prestigecommunications Co., Ltd
Priority date: 2003-08-14
Filing date: 2003-08-27
Publication date: 2005-02-24
Also published as: KR20030076494A; AU2003256113A1

Abstract

The present invention discloses a multimedia device with Internet and phone function. The multimedia device with Internet and phone function includes a data storing portion for storing and deleting an operating system program, an application program based on the operating system program that provides an interface for performing predetermined functions including a telephone function, an Internet function, a remote monitoring function, a video conference function, a TV function, an e-mail function, a jotter function, a shopping mall function 0, a telephone directory function, a handwriting recognition function, and a counsel connection function, and other information, and a central control portion of processing and controlling data to perform the functions according to programs and information stored in the data storing portion.

Description

MULTIMEDIA DEVICE WITH INTERNET AND PHONE FUNCTION

BACKGROUND OF INVENTION

1. Field of the Invention The present invention relates to a multimedia device which performs a communication via a communication network such as a PSTN network or an Internet network, more particularly to a multimedia device with Internet and phone function which includes a data storing portion which stores an operating system program, an application program based on the operating system program that provides an interface for performing predetermined functions such as a telephone function, an Internet function, a remote monitoring function, a video conference function, a TV function, an e-mail function, a jotter function, a shopping mall functionO, a telephone directory function, a handwriting recognition function, and a counsel connection function, and other information, and a central control portion which processes and controls data to perform the predetermined functions according to programs and information stored in the data storing portion.

2. Description of Related Art A development of a high-speed communication network and a personal computer is promoting a spread of Internet, and Internet deeply takes part in daily life. Recently, software for talking over via Internet like a typical telephone has been developed. A computer includes a sound card, an Ethernet card, and a modem to receive or transmit data via Internet. A voice signal, which is an analog signal, is converted into a digital signal by an A/D converter and transmitted via Internet, and the digital signal is converted by a D/A converter and outputted as an analog signal, i.e., voice signal. However, in order to perform a conversation (i.e., call) between users of computers connected to Internet, software, i.e., communication application program should be installed in the computers of the users. This software is difficult to use and so complicated to users that are unfamiliar to computer. Also, a conventional Internet phone is generally installed in, for example, public places, and users who intend to use the Internet phone can use it for nothing via a monitor and a handset after seeing and hearing an advertisement during a predetermined time period. Except a call function and an advertisement function, only electronic games are provided, and there exist many difficulties in using the Internet phone. Therefore, the Internet phone is not widely spread except a telephone call. A call via computer connected to an information super-highway is not vigorously used. In spite that the Internet phone can provide various annexed services in addition to a telephone call, services other than advertisement and electronic games are hardly provided, and further the Internet phone possesses a problem to inter-working with the PSTN network. Meanwhile, in recent shopping malls on Internet have been rapidly increased, and their market size is also gradually greater. A fee payment for such an Internet shopping is mainly taken out of a credit card or user's account. However, in the case of a credit card, credit card information is inconvenient to input, and users who are unfamiliar to Internet are difficult to make a payment. Further, in order to cancel a payment after a user completes a payment, a user should directly contact a seller via a telephone. Such a cancel takes long, and when a cancel is not completed without a hitch, a consumer may suffer damage.

SUMMARY OF THE INVENTION To overcome the problems described above, a preferred embodiment of the present invention provide a multimedia device with Internet and phone function in which a main menu function is simple, and a handwriting recognition function is provided, and Internet and Internet image/voice phone are easy and convenient to use, and a PSTN network and an Internet network are simultaneously contacted to make a telephone call via both the PSTN network and the Internet network, and through a data storing portion which stores an application program for providing functions such as Internet function, a remote monitoring function, a video conference function, a TV function, an e-mail function, a jotter function, a shopping mall function, a telephone directory function, a handwriting recognition function, a counsel connection function, and other information, and a central control portion which processes and controls data to perform a predetermined function according to programs and information stored in the data storing portion, the functions are provided, and various contents and off-line payment are provided in various and safe methods through, for example, a PSTN telephone payment, a mobile phone payment, a my line telephone payment, an Internet provider fee payment, a convenient store payment, and a pre-paid credit card payment, and a card reader is provided to immediately make a payment via a credit card and a payment cancel is simply performed through the card reader. In order to achieve the above object, the preferred embodiments of the present invention provide a multimedia device with Internet and phone function, comprising: a data storing portion for storing and deleting an operating system program, an application program based on the operating system program that provides an interface for performing predetermined functions including a telephone function, an Internet function, a remote monitoring function, a video conference function, a TV function, an e-mail function, a jotter function, a shopping mall functionO, a telephone directory function, a handwriting recognition function, and a counsel connection function, and other information; a central control portion of processing and controlling data to perform the functions according to programs and information stored in the data storing portion; a monitor portion of outputting an image signal outputted from the central control portion; a touch panel attached to a front portion of the monitor portion and inputting a location information corresponding to a location selected on a screen of the monitor portion to the central control portion; a handset including a microphone of receiving a voice signal and a speaker of outputting the voice signal to talk with the other party; a cam portion of capturing an image and inputting the image converted to a digital signal to the central control portion; a function selecting portion including up and down and left and right buttons of selecting or moving a menu outputted on the screen of the monitor portion; a display portion of display a current status when a predetermined function is selected by the function selecting portion; a number input portion of inputting a desired telephone number; a card reader portion of receiving information from a magnetic type card; a signal I/O portion of being connected to a PSTN network and an Internet network and receiving and outputting a signal; and an external device connecting portion including ports for being connected to external peripheral devices. The multimedia device with Internet and phone function further includes a radio signal receiving portion of receiving a signal outputted from a wireless keyboard and a wireless mouse and outputting the signal to the central control portion, and an access point of being interworked with home electronics, automatic control devices and personal computers which have a radio signal receiver to control the home electronics, the automatic control devices and the personal computers.

BRIEF DESCRIPTION OF THE DRAWINGS For a more complete understanding of the present invention and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which like reference numerals denote like parts, and in which: FIG. 1 is a block diagram illustrating a multimedia device with Internet and phone function according to the present invention; FIG. 2 is a photograph illustrating the multimedia device with Internet and phone function according to the present invention; FIG. 3 is a view illustrating a communication system communicating the multimedia device with Internet and phone function according to the present invention; FIGs. 4A to 4C are photographs illustrating exemplary uses of the multimedia device with Internet and phone function according to the present invention; FIG. 5 is a view illustrating a main screen of the multimedia device with Internet and phone function according to the present invention; FIG. 6 is a flow chart illustrating processes of establishing a telephone call and an Internet phone call according to the present invention; FIG. 7 is a view illustrating a message window outputted on a screen according to the present invention; and FIG. 8 is a view illustrating a page linked according to categories according to the present invention.

DETAILED DESCRIPTION OF PREFFERED EMBODIMENTS Reference will now be made in detail to preferred embodiments of the present invention, example of which is illustrated in the accompanying drawings. FIG. 1 is a block diagram illustrating a multimedia device with Internet and phone function according to the present invention. The multimedia device with Internet and phone function of FIG. 1 includes a data storing portion 10, a central control portion 20, a monitor portion 30, a touch panel 40, a handset 50, a cam portion 60, a function selecting portion 70, a number input portion 80, a card reader portion 90, a signal I/O portion, and an external device connecting portion 110. The multimedia device with Internet and phone function of FIG. 1 further includes a radio signal receiving portion 120 which receives a signal outputted from a wireless keyboard or a wireless mouse and transmits the signal to the central control portion 20, and a display portion 130. The data storing portion 10 stores an operating system program, an application program based on the operating system program and other information. Window XP Home Edition available from Microsoft Corp. is preferably used as the operating system program. The operating system program includes (not limited to) a dedicated main web browser for a touch panel and a handwriting recognition system, a web browser, and a mail browser, and various system programs can be added according to user's need to provide an interface with a user. The data storing portion 10 is a typical data storing device and includes a main memory device called a hard disk and a memory. Preferably, the data storing portion 10 is comprised of a 20 giga-byte of hard disk and a 256 mega-byte of memory. The central control portion 20 processes data to perform a predetermined function according to programs stored in the data storing portion 10 and outputs a control signal for performing a predetermined function. That is, the central control portion 20 controls the whole operation based on the operating system program and the other application program, and control processes which receive and process information from various input devices and transmits resultant data to output devices. The central control portion 20 include a central processing unit (CPU) which is comprised of an arithmetic logic unit which performs a comparison, a decision and an operation, and a control unit which performs an interpretation and execution of command languages. The monitor portion 30 outputs a graphic signal such as an image and provides an interface screen to a user. The monitor portion 30 preferably includes a liquid crystal display (LCD). The touch panel 40 is a large-scale graphic input device in which a user can directly designate a location on a screen and is attached to a screen of the monitor portion 30. A user selects a section of image outputted on the screen to input a command. As the touch panel 40, a touch panel manufactured by an optical sensor (infrared ray) matrix method of a matrix switch method, a conductive film method (matrix switch), a capacity variation method, or a metal sensor reclamation method, or a touch panel manufactured by a conductive film method of analog method, a load partial pressure (pressure sensor) method, a surface wave (supersnic wave) reflection method, or a metal sensor reclamation method (decompression method), not limited to these, is used. The handset 50 includes a speaker which outputs a voice signal and a microphone which converts the voice signal to an electric signal. Preferably, the speaker and the microphone are integrally formed. The handset 50 has a similar shape to a handset of a typical telephone and ca be replaced with a headset. The cam portion 60 is a kind of camera which captures an image to establish a video call or hold a remote multilateral conference. The cam portion 60 is built in or removable from an outer case of the monitor case 30. The cam portion 60 converts an externally input image to an electric signal which is converted to a digital signal by an A/D converter. The function selecting portion 70 is to perform a hot key function or a directional key for moving or selecting functions on a screen. The function selecting portion 70 has four directional keys for moving up and down and left and right and one selection key positioned on a central portion for selection. The function selecting portion 70 is preferably positioned at a central portion of a front portion of a body of the multimedia device with Internet and phone function of the present invention. The number input portion 80 performs the same role as a digit pad and a key board of a typical telephone, and is used to input a telephone number or digits. The number input portion 80 is preferably placed on the front portion of the body. The number input portion 80 has digit buttons and function buttons. The card reader portion 90 is to read information from a card which is used as a payment means such as a credit card or a debit card having a card information in a magnetic portion thereof. The card reader portion 90 is a similar type to a typical credit card reader. When a user who uses an Internet shopping mall wants to make a payment, a user can easily make a payment by passing a credit card through the card reader 90. Card information read by the card reader 90 is transmitted via Internet network, and a payment is approved by a predetermined process of processing the transmitted information, and a payment cancel is also performed by the same method as the payment approval method. In particular, using a dedicated Internet payment solution, the card information read by the card reader 90 is safely transmitted before a payment is made by a predetermined process. The signal I/O portion 100 is connected to the PSTN network and the Internet network to transmit or receive data, and includes a port connected to the PSTN network and a modem or an Ethernet card connected to the Internet network. The modem is preferably a wireless modem. That is, the multimedia device with Internet and phone function is connected to communication networks through the signal I/O portion 100. The external device connecting portion 110 is connected to and interworked with peripheral devices such as a printer, a speaker system, a mouse, a keyboard, a digital camera, and the like to transmit or receive data. Therefore, the external device connecting portion 110 includes a printer port connected to a printer, and a PS2 port connected to a keyboard and a mouse, a Rs232 port, and a USB port. The radio signal receiving portion 120 receives a signal which is transmitted from a wireless keyboard or a wireless mouse using an infrared ray: That is, the keyboard or the mouse which are not often used are separately kept, and when the keyboard or the mouse is needed, the keyboard or the mouse can be used at a location that a data transmission between a transmitting portion of the wireless keyboard or the wireless mouse and the radio signal receiving portion 120 can be performed. The display portion 130 displays a telephone number of a caller or a called party and a status information such as a power on/off, an on-line, a date, and a time. Even though not shown in FIG. 1 , an access point for constituting a home network can be added to transmit/receive data to/from home electronics such as a refrigerator, a TV and a DVD player, house devices such as an electric window, an automatic door lock and a boiler, and a personal computer. The multimedia device with Internet and phone function having the access point can control the home electronics, the house devices and the personal computer by grasping their status. In particular, the multimedia device with Internet and phone function can externally accesses the Internet network and the PSTN network to thereby control the home electronics, the house devices and the personal computer. For example, in the case of a refrigerator having a wireless transceiver, a user grasps a power state and a temperature of a quickfreezer and a cool chamber by status information of the refrigerator received to the access point which is displayed on the monitor 30. Therefore, the user can turn on/off a power of the refrigerator or can control a temperature of the quickfreezer and the cool chamber. That is, when the user lowers a temperature of the quickfreezer by 2°C, a control signal is transmitted through the access point,

and so the refrigerator is set to lower a temperature of the quickfreezer by 2°C according to the control signal inputted through the wireless transceiver. FIG. 2 is a photograph illustrating the multimedia device with Internet and phone function according to the present invention. As described in FIG. 2, the multimedia device with Internet and phone function according to the present invention is comprised of the monitor portion 30 and a body 200. The monitor portion 30 is coupled to the body 200 through a neck 210, and an angle of the monitor portion 30 is adjustable so that a user can see the monitor portion 30 freely and conveniently. On the front portion of the body 200, the handset 60, the function selecting portion 70, the number input portion 80, the card reader portion 90,

the radio signal receiving portion 120, and the display portion 130 are placed.

Even though not shown, connection ports which are connected to the signal I/O

portion 100 and the external device connecting portion 110 are preferably

exposed out of a rear portion of the body 200. FIG. 3 is a view illustrating a communication system communicating the

multimedia device with Internet and phone function according to the present

invention. The multimedia device with Internet and phone function according to

the present invention is connected to both the PSTN network and the Internet

network through the signal I/O portion 100. That is, a telephone connection port

and an Internet connection port of the signal I/O portion 100 are connected to a

telephone line and an Internet. The multimedia device with Internet and phone function according to

the present invention is connected to a service provider including a service

providing server 310 and a database 320 via the Internet network. The service

provider provides various contents related to various services to users of the

multimedia device with Internet and phone function. The multimedia device with Internet and phone function is connected to

the PSTN network and thus can be used as a typical telephone. Therefore, a user can selectively use a telephone via the PSTN network or an Internet phone

via Internet network.

Further, since the multimedia device with Internet and phone function is interworked with the service providing server 31 in real time, the service provider can remotely control a system program and other application programs of the multimedia device with Internet and phone function. Therefore, the multimedia device with Internet and phone function can actively be managed like a program installation and restoration or a program upgrade by checking the status of the multimedia device with Internet and phone function. FIGs. 4A to 4C are photographs illustrating exemplary uses of the multimedia device with Internet and phone function according to the present invention. FIG. 4A shows that the multimedia device with Internet and phone function is used as a telephone or an Internet phone, FIG. 4B shows that the keyboard is used as an input device, and FIG. 4C shows that a fee payment is made by a credit card. In FIG. 4A, a called party number is inputted by the number input portion, and a user talks over the phone by using the handset. A user can selectively use a telephone via the PSTN network or an Internet phone via Internet network. In FIG. 4B, a user can make a document by using the keyboard. A user can use a mouse as well as the keyboard. The keyboard and the mouse are of wireless type and thus are separately kept. Thus, the multimedia device with Internet and phone function can be placed even in narrow space. In FIG. 4C, a user who bought products on an Internet shopping mall just pass his/her credit card through the card reader to make a payment. A user can buy a product, make a payment or cancel a payment in real time while talking over the phone with a person in charge of the shopping mall. FIG. 5 is a view illustrating a main screen of the multimedia device with Internet and phone function according to the present invention. As shown in FIG. 5, the multimedia device with Internet and phone function according to the present invention provides various functions and services such as a telephone function, an Internet function, a remote monitoring function, a video conference function via Internet, a TV function, a mail box function, a jotter function, a shopping mall function, a telephone directory function, a handwriting recognition function, a download function, and a counsel connection function. These functions and services are used by seelcting icons on a main screen. That is, when a user selects icons on the main screen, contents for the selected icon are provided. Of the functions and services described above, the telephone function establishes a telephone call by a process of FIG. 6. That is, a telephone call is established via both the Internet network using VoIP and the PSTN network. A process of establishing a telephone call via the PSTN network includes a step of being a hook on by a user holding up the handset (step S100), a step of inputting a desired telephone number through the number input portion (step S110), a step of being connected to the PSTN network (step S120), and a step of a voice call being established. That is, a telephone call via the PSTN network is established by the same process as that of a typical telephone. A process of establishing an Internet phone call via Internet network using the VoIP includes a step of a user selecting an Internet phone function on a main screen (step S10), a step of being provided with an Internet phone function page comprised of a number input window of outputting digit images used to input a telephone number and inputted numbers and image buttons of selecting various functions (step S20), a step of inputting a desired telephone number on the Internet phone function page or selecting a desired telephone number on a page having a telephone directory or a call list (step S30), a step of checking whether a network connection is established (step S40), a step of being contacted to Internet network when the network is connected (step S60), and a step of establishing a voice call or a video call (step S70). Here, in the step S40, when the network is in an off-line state, as shown in FIG. 7, a message window is outputted, showing a message "A network connection is not established. Would you make a phone call via a telephone mode? In this case, a general telephone fee is applied to the telephone mode." When a user selects "Connect" icon, a typical telephone call is tried via the PSTN network, and when "Cancel" icon is selected, tying to make a telephone call is canceled. Also, when "Retry" is selected, an Internet phone call is tried via the Internet network. The Internet function is for a user to use the Internet, and when a user selects an Internet icon on a main screen, the Internet is automatically connected. At this time, a general portal site or a web site that a user previously set can be contacted, but preferably a screen having link pages linked according to categories is provided as shown in FIG. 8, so that a user can easily search and use a desired web site. The remote monitoring function is to output an image captured by a CCD camera installed in the cam portion or separate places or to reproduce an image previously stored. In addition to capturing an image, the remote monitoring function sends a captured image to a previously set e-mail address or outputs a sound such as alarm or siren when an image change is sensed by a motion capture. The multilateral conference function via Internet is to provide a virtual conference room via Internet and provides a video conference. This function is performed by the communication system of FIG. 3, and the multilateral conference is performed via the service providing server 310 which communicates with the multimedia device with Internet and phone function. That is, a user can open a conference room through the service providing server 310 or attend the opened conference. In order to search a desired conference room, for example, a name of a person who opens a conference room or a conference title can be used. The TV function is for a user to watch TV by receiving a broadcasting signal through a TV card. A desired TV program can be searched and selected through contents provided by the service providing server 310. The mail box function is to receive or send an e-mail via Internet and is provided by contents provided from the service providing server 310 and application programs. That is, a user gets a mail address from the service providing server 310 or makes an e-mail address to send or receive an e-mail. Sent and received e-mails can be managed by the mail box function. As described herein before, the multimedia device with Internet and phone function includes both a personal computer function and a typical telephone function, is used as an Internet phone or a typical telephone by being interworked with the Internet network and the PSTN network, provides functions and services such as an Internet function, a remote monitoring function, a video conference function, a TV function, a mail function, a jotter function, a shopping mall function, a telephone directory function, and a handwriting recognition function, and helps a user who is unfamiliar to Internet search desired information or use e-mail and Internet shopping malls through a touch panel and a user interface screen, whereby Internet users are increased and Internet can be easily used in daily life. In particular, in case of using the Internet shopping malls, a fee payment or a payment cancel is made through the card reader portion, and thus paying is easy, convenient and safe. Further, a video conference or a remote multilateral conference is possible, and thus a conference can be held without time and space limitation, and a remote monitoring is possible through a CCD camera installed in the cam portion or a separate place to thereby provide a high security. Furthermore, when a keyboard or a mouse is needed for documentation such as e-mail or application programs, a wireless keyboard or a wireless mouse can be used, thereby increasing an efficiency of space use. While the invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form and details may be made therein without departing from the spirit and scope of the invention.

Claims

What is claimed is: 1 . A multimedia device with Internet and phone function, comprising: a data storing portion for storing and deleting an operating system

program, an application program based on the operating system program that

provides an interface for performing predetermined functions including a

telephone function, an Internet function, a remote monitoring function, a video

conference function, a TV function, an e-mail function, a jotter function, a

shopping mall functionO, a telephone directory function, a handwriting

recognition function, and a counsel connection function, and other information; a central control portion of processing and controlling data to perform

the functions according to programs and information stored in the data storing portion; a monitor portion of outputting an image signal outputted from the

central control portion; a touch panel attached to a front portion of the monitor portion and

inputting a location information corresponding to a location selected on a screen

of the monitor portion to the central control portion; a handset including a microphone of receiving a voice signal and a speaker of outputting the voice signal to talk with the other party; a cam portion of capturing an image and inputting the image converted

to a digital signal to the central control portion; a function selecting portion including up and down and left and right

buttons of selecting or moving a menu outputted on the screen of the monitor portion; a display portion of display a current status when a predetermined function is selected by the function selecting portion; a number input portion of inputting a desired telephone number; a card reader portion of receiving information from a magnetic type card; a signal I/O portion of being connected to a PSTN network and an Internet network and receiving and outputting a signal; and an external device connecting portion including ports for being connected to external peripheral devices. 2. The device of claim 1 , further comprising, a radio signal receiving portion of receiving a signal outputted from a wireless keyboard and a wireless mouse and outputting the signal to the central control portion. 3. The device of claim 1 , further comprising, an access point of being interworked with home electronics, automatic control devices and personal computers which have a radio signal receiver to control the home electronics, the automatic control devices and the personal computers.