US7522182B2 - Method and apparatus for image capture and transmission in a mobile communication device - Google Patents

Method and apparatus for image capture and transmission in a mobile communication device Download PDF

Info

Publication number
US7522182B2
US7522182B2 US11/066,053 US6605305A US7522182B2 US 7522182 B2 US7522182 B2 US 7522182B2 US 6605305 A US6605305 A US 6605305A US 7522182 B2 US7522182 B2 US 7522182B2
Authority
US
United States
Prior art keywords
capture
still images
unit
mobile communication
multimedia message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/066,053
Other versions
US20050213834A1 (en
Inventor
Joon-Sung Bang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Assigned to LG ELECTRONICS INC. reassignment LG ELECTRONICS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BANG, JOON-SUNG
Publication of US20050213834A1 publication Critical patent/US20050213834A1/en
Application granted granted Critical
Publication of US7522182B2 publication Critical patent/US7522182B2/en
Assigned to MICROSOFT TECHNOLOGY LICENSING, LLC reassignment MICROSOFT TECHNOLOGY LICENSING, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LG ELECTRONICS INC.
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/40Circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/58Message adaptation for wireless communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12Messaging; Mailboxes; Announcements

Definitions

  • the present invention relates to image capture and transmission by a mobile communication device, and more particularly, to a method and apparatus for capturing and transmitting consecutive still images that appear to be moving images.
  • a user having a mobile communication device, or user equipment, that is subscribed and registered in a communication system may communicate with another communication device in the system via a communication path set by a Mobile Switching Center (MSC) within a service area formed by a base station (BS).
  • MSC Mobile Switching Center
  • BS base station
  • the user equipment may be used for more than just communication with other user equipment.
  • mobile communication service providers have developed and offered a variety of supplementary services in order to increase the utilization rate of the user equipment and provide convenience for subscribers.
  • a mobile communication service provider may offer text messaging, multimedia messaging and radio on-line games as well as self-developed additional functions such as a phone-book, note taking, message writing, an organizer, games and a camera.
  • One such supplementary service is a multimedia messaging service that allows a user to display or transmit both still images and moving images that have been captured and stored using a camera function of the user equipment.
  • FIG. 1 illustrates a conventional mobile communication system 1 .
  • user equipment 10 moves freely in a service area formed by a base station 20 and in a service area formed by another base station (not shown) and communicates with other user equipment.
  • the types of communications are determined according to signals transmitted by the user equipment; voice communications, text messaging (using symbols, numbers and graphics) and multimedia (including image signals, audio signals and text signals).
  • Another user communicating with the user equipment 10 is connected to a communications network through a communication path set by a mobile switching center (MSC) 30 . If the other user equipment is subscribed to the current communications network, the connection to the communications network is via the self-set communication path. If the other user equipment is subscribed to a different communications network, the connection to the communications network is via a public network 40 .
  • MSC mobile switching center
  • Communication modes formed between two users are classified as a real-time communication mode, which allows the user equipment to communicate in real time, and a non-real-time communication mode, which allows a user to check received data at the user's convenience.
  • a real-time communication mode which allows the user equipment to communicate in real time
  • a non-real-time communication mode which allows a user to check received data at the user's convenience.
  • the cost according to communication channel occupation is higher in the real-time communication mode than in the non-real-time communication mode.
  • the longer communications are performed, the longer a channel is occupied and the higher the cost.
  • channel bandwidth is wider, thereby occupying a plurality of channels at the same time and increasing channel occupation time and cost.
  • FIG. 2 is a flowchart illustrating a conventional method for capturing and transmitting images with user equipment in a mobile communication system.
  • the user equipment 10 drives a capturing means, such as a camera, to capture one or more images of a subject (S 210 ). If a plurality of still images is captured, the images are sequentially stored in a designated storage region (S 220 ). Thereafter, if the user desires to transmit the stored images (S 230 ), the user equipment selects specific still images selected by the user (S 240 ), designates an ID of the recipient and transmits the selected still images (S 250 ). Accordingly, when a plurality of still images are transmitted, the processes (S 240 to S 260 ) will be performed repeatedly.
  • a capturing means such as a camera
  • the user equipment 10 limits files related to multimedia images, which are attached when transmitting an MMS (Multimedia Messaging Service) message, to a still image and a moving image. Accordingly, transmission of information related to a moving subject is limited. It takes a long time with associated high communication cost to transmit and receive a moving image due to the large size. On the other hand, when a plurality of still images is transmitted, the still images are transmitted individually; a process that is not only inconvenient but also takes a long time.
  • MMS Multimedia Messaging Service
  • the present invention is directed to a to a method and apparatus for capturing and transmitting consecutive still images that appear to be moving images.
  • the present invention is embodied in a mobile communication device that allows the user to capture a plurality of still images of a subject and transmit those images in a cost-effective and efficient manner such that the transmitted still images appear to be a moving image.
  • the user indicates whether to capture a single image or a plurality of consecutive still images and, if a plurality of images is selected, the mobile communication device captures a plurality of consecutive still images and generates a MMS message that is then transmitted to a recipient.
  • the invention is described herein with regard to a mobile communication device, it is contemplated that the invention may be utilized whenever it is desired to capture a plurality of consecutive still images and transmit the images such that they appear to be a moving image.
  • a mobile communication device for capturing and transmitting images.
  • the mobile communication device includes a control unit that controls the operation of the device, a capture unit that can capture either a single still image or a plurality of consecutive still images, an MMS generating unit that generates an MMS message from a plurality of consecutive still images and a radio unit that transmits the MMS message to a recipient.
  • the mobile communication device may also include a program unit that provides an SMIL (Synchronized Multimedia Integration Language) application to the MMS generating unit.
  • SMIL Synchronized Multimedia Integration Language
  • the MMS generating unit may process the plurality of consecutive still images in slide form using the SMIL application.
  • the mobile communication device may include an input/output device that displays the generated MMS message such that the message may be viewed before it is transmitted to a recipient. It is further contemplated that the capture unit may capture the plurality of consecutive still images and the input/output unit may display the MMS message according to units of time specified by a user. Moreover, it is contemplated that the capture unit captures either a single still image or a plurality of consecutive still images according to a user's selected mode.
  • a method for capturing and transmitting images in a mobile communication device.
  • the method includes capturing either a single still image or a plurality of consecutive still images, generating an MMS message if a plurality of still images is captured and transmitting the MMS message to a recipient.
  • the MMS message may be generated using an SMIL application. It is further contemplated that the MMS message may be generated in slide form.
  • the method may include processing a user input to select whether a single still image or a plurality of consecutive still images is captured. It is further contemplated the method may include processing a user input to determine the units of time used to capture a plurality of consecutive still images.
  • the method may include displaying the MMS message on a display unit. It is further contemplated the method may include processing a user input to determine the units of time used to display the MMS message. Moreover, it is contemplated that the method may be performed in a control unit.
  • a mobile terminal for capturing and transmitting images.
  • the mobile terminal includes a control unit that controls the operation of the mobile terminal, a capture unit that can capture either a single still image or a plurality of consecutive still images, an MMS generating unit that generates an MMS message from a plurality of consecutive still images using a SMIL application, a program unit that provides the SMIL application to the MMS generating unit, an input/output unit that displays the MMS message, and a radio unit that transmits the MMS message to a recipient.
  • the MMS generating unit may process the plurality of consecutive still images in slide form. It is further contemplated that a user may indicate the units of time used to capture the plurality of still images and display the MMS message. Moreover, it is contemplated that the user may set a capture mode used to determine whether a single still image or a plurality of consecutive still images is captured.
  • FIG. 1 illustrates a conventional mobile communication system.
  • FIG. 2 illustrates a flowchart of a conventional method for capturing and transmitting an image with user equipment in a mobile communication system.
  • FIG. 3 illustrates slide constructions in accordance with the conventional art.
  • FIG. 4 illustrates a block diagram of a mobile communication device in accordance with the present invention.
  • FIG. 5 illustrates a flowchart of a method for capturing and transmitting images with a mobile communication device in accordance with the present invention.
  • the present invention relates to an apparatus and method for capturing and transmitting consecutive still images that appear to be moving images.
  • the present invention is illustrated with respect to a mobile communication device, it is contemplated that the present invention may be utilized anytime it is desired to capture and transmit still images of a moving subject such that the still images appear to be moving images.
  • the present invention is directed to a mobile communication device using SMIL (synchronized multimedia integration language) to capture and transmit still images of a moving subject such that a plurality of consecutive images look like moving images.
  • SMIL synchronized multimedia integration language
  • SMIL World Wide Web Consortium
  • W3C World Wide Web Consortium
  • SMIL enables the creation of multimedia contents more easily and effectively by integrating the techniques necessary for providing multimedia services and may include a variety of media such as streaming audio or video, images, and text.
  • the W3C presents SMIL, which may provide a presentation function as well as multimedia contents, streaming audio and video, images and texts, as a standard language for transmitting multimedia.
  • a message generated using SMIL is called an MMS message.
  • MMS message A message generated using SMIL is called an MMS message.
  • the content of the message, allowed elements and attributes of the presentation language, media content format and lower level capabilities are required.
  • FIG. 3 illustrates a conventional MMS (Multimedia Messaging Service) message construction.
  • MMS Multimedia Messaging Service
  • Each of slides shown in FIG. 3 can include text and sound.
  • each multimedia message will be represented by SMIL. All still images to be represented by SMIL have the same layout.
  • elements of MMS SMIL are composed of five modules. There are five basic modules for generating an MMS message.
  • the first layout module provides a framework for spatial layout of visual components as illustrated in Table 1.
  • Default dimensions of the root-layout are the dimensions of the mobile communication device, or user equipment, display area and are expressed in pixels.
  • the second media object module provides a framework for describing the media that constitute a SMIL presentation as illustrated in Table 2.
  • the MMS SMIL includes the parts of the SMIL BasicMedia module.
  • the third structure module describes the structure of the SMIL document.
  • MMS SMIL adopts the SMIL Structure module as illustrated in Table 3.
  • the fourth timing and synchronization module provides a framework for timing structure, timing control properties and temporal relationships between the elements as illustrated in Table 4.
  • the fifth Meta information module contains elements and attributes describing SMIL documents as illustrated in Table 5.
  • the MMS messages may contain meta-information included in the message by means of the Meta element.
  • FIG. 4 illustrates a block diagram of user equipment for image capture and transmission in accordance with the present invention.
  • the user equipment 300 includes a capture unit 305 , a control unit 310 , memory 320 , a program unit 330 , an MMS generating unit 340 , a radio unit 350 and an input/output unit 360 .
  • the control unit 310 controls the capture unit 305 to capture images of a subject, stores the captured still images in memory 320 and outputs or transmits the stored still images.
  • the capture unit 305 captures still images of a target subject under the control of the control unit 310 .
  • the program unit 330 contains a plurality of application programs, including SMIL Application programs.
  • the program unit 330 performs the programs under control of the control unit 310 .
  • the MMS generating unit 340 converts captured still images designated by the control unit 310 to generate an MMS message.
  • the control unit 310 controls time intervals used for the capture and display of consecutive still images constituting the MMS message according to user selection via the input/output unit 360 .
  • the input/output unit 360 is connected to the control unit 310 and receives/transmits an audio signal, a text signal using audio signals, texts, symbols, numbers and graphics as well as a dialing signal according to a recipient's ID through a microphone, a speaker, a keyboard and a display unit.
  • An image signal for multimedia communications that is captured by the capture unit 305 may be displayed via a display unit that is part of the input/output unit 360 , thereby allowing an image being transmitted by the user equipment 300 to be viewed.
  • the radio unit 350 provides transmission and reception between the user equipment 300 and other users in the communications system 1 . Once the radio unit 350 is connected to a base station 20 , the radio unit transmits the MMS message to the base station.
  • FIG. 5 illustrates a flowchart of a method for capturing and transmitting images with the user equipment 300 in accordance with the present invention.
  • a user indicates whether to capture a single still image or a plurality of consecutive still images of a subject by inputting commands via the input/output unit 360 (S 400 ).
  • the capture mode set by the user is then checked (S 410 ) and the capture unit 305 then captures one or more images of a subject according to the set capture mode (S 420 and S 430 ).
  • the captured still images are stored in an allocated region of memory 320 (S 440 ).
  • the capture unit 305 captures a single still image (S 420 ). Thereafter, the generated still image is stored (S 440 ) and transmitted (S 480 ) according to conventional methods under control of the control unit 310 .
  • the capture unit 305 captures a plurality of consecutive still images (S 430 ).
  • the capture unit 305 captures images of the subject after setting capture-time intervals to capture consecutive still images by set units of time, thereby generating a plurality of consecutive still images.
  • the user may indicate the capture-time intervals.
  • the captured consecutive still images are stored in memory 320 under control of the control unit 310 (S 440 ).
  • the user selects a transmit mode (S 450 ).
  • the transmit mode is then checked (S 460 ) to determine whether a single stored image or a plurality of stored images is to be transferred.
  • the selected consecutive still images stored in memory 320 are loaded into the MMS generating unit 340 .
  • MMS information is generated using the consecutive still images and a SMIL application (S 470 ) and an MMS message is generated according to set units of time using the generated information.
  • the user may indicate the set units of time.
  • the MMS message generated using the consecutive still images is one still image that appears as a moving image.
  • the user designates an ID of the recipient's user equipment.
  • the single still image or MMS message is transmitted to the recipient via the base station by the radio unit 350 under control of the control unit 310 (S 480 ).
  • a mobile communication device generates an MMS message according to set units of time using consecutive still images and a SMIL application and transmits the generated MMS message to a recipient.
  • the MMS message has a size that is smaller than a comparable moving image file.
  • the recipient's user equipment provided with a device for displaying the MMS message, receives the MMS message at a lower cost in comparison to the transmission of moving images, the MMS message having a similar appearance to the moving images.
  • the communications cost of the sender is reduced because channel occupancy is lowered.

Abstract

An apparatus and method for capturing and transmitting a plurality of consecutive still images that look like moving images. An MMS (Multimedia Messaging Service) message is generated using stored consecutive still images and a SMIL (Synchronized Multimedia Integration Language) application with the MMS message transmitted to a recipient.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
Pursuant to 35 U.S.C. § 119(a), this application claims the benefit of earlier filing date and right of priority to Korean Application No. 20128/2004, filed on Mar. 24, 2004, the contents of which is hereby incorporated by reference herein in its entirety:
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to image capture and transmission by a mobile communication device, and more particularly, to a method and apparatus for capturing and transmitting consecutive still images that appear to be moving images.
2. Description of the Related Art
A user having a mobile communication device, or user equipment, that is subscribed and registered in a communication system may communicate with another communication device in the system via a communication path set by a Mobile Switching Center (MSC) within a service area formed by a base station (BS). However, the user equipment may be used for more than just communication with other user equipment.
Accordingly, mobile communication service providers have developed and offered a variety of supplementary services in order to increase the utilization rate of the user equipment and provide convenience for subscribers. For example, a mobile communication service provider may offer text messaging, multimedia messaging and radio on-line games as well as self-developed additional functions such as a phone-book, note taking, message writing, an organizer, games and a camera. One such supplementary service is a multimedia messaging service that allows a user to display or transmit both still images and moving images that have been captured and stored using a camera function of the user equipment.
FIG. 1 illustrates a conventional mobile communication system 1. With reference to FIG. 1, user equipment 10 moves freely in a service area formed by a base station 20 and in a service area formed by another base station (not shown) and communicates with other user equipment. The types of communications are determined according to signals transmitted by the user equipment; voice communications, text messaging (using symbols, numbers and graphics) and multimedia (including image signals, audio signals and text signals).
Another user communicating with the user equipment 10 is connected to a communications network through a communication path set by a mobile switching center (MSC) 30. If the other user equipment is subscribed to the current communications network, the connection to the communications network is via the self-set communication path. If the other user equipment is subscribed to a different communications network, the connection to the communications network is via a public network 40.
Communication modes formed between two users are classified as a real-time communication mode, which allows the user equipment to communicate in real time, and a non-real-time communication mode, which allows a user to check received data at the user's convenience. Generally, the cost according to communication channel occupation is higher in the real-time communication mode than in the non-real-time communication mode.
In particular, in the real-time communication mode, the longer communications are performed, the longer a channel is occupied and the higher the cost. However, in the non-real-time communication mode, when the amount of data transmitted is large, channel bandwidth is wider, thereby occupying a plurality of channels at the same time and increasing channel occupation time and cost.
FIG. 2 is a flowchart illustrating a conventional method for capturing and transmitting images with user equipment in a mobile communication system. When user's instruction to initiate image capture is inputted through an input device such as a keypad, the user equipment 10 drives a capturing means, such as a camera, to capture one or more images of a subject (S210). If a plurality of still images is captured, the images are sequentially stored in a designated storage region (S220). Thereafter, if the user desires to transmit the stored images (S230), the user equipment selects specific still images selected by the user (S240), designates an ID of the recipient and transmits the selected still images (S250). Accordingly, when a plurality of still images are transmitted, the processes (S240 to S260) will be performed repeatedly.
In the conventional art, the user equipment 10 limits files related to multimedia images, which are attached when transmitting an MMS (Multimedia Messaging Service) message, to a still image and a moving image. Accordingly, transmission of information related to a moving subject is limited. It takes a long time with associated high communication cost to transmit and receive a moving image due to the large size. On the other hand, when a plurality of still images is transmitted, the still images are transmitted individually; a process that is not only inconvenient but also takes a long time.
Therefore, there is a need for a mobile communication device that transmits a plurality of still images that relate the motion of a captured subject in a manner that is convenient and cost-effective. The present invention addresses these and other needs.
SUMMARY OF THE INVENTION
The present invention is directed to a to a method and apparatus for capturing and transmitting consecutive still images that appear to be moving images.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, the present invention is embodied in a mobile communication device that allows the user to capture a plurality of still images of a subject and transmit those images in a cost-effective and efficient manner such that the transmitted still images appear to be a moving image. Specifically, the user indicates whether to capture a single image or a plurality of consecutive still images and, if a plurality of images is selected, the mobile communication device captures a plurality of consecutive still images and generates a MMS message that is then transmitted to a recipient. Although the invention is described herein with regard to a mobile communication device, it is contemplated that the invention may be utilized whenever it is desired to capture a plurality of consecutive still images and transmit the images such that they appear to be a moving image.
In one aspect of the invention, a mobile communication device is provided for capturing and transmitting images. The mobile communication device includes a control unit that controls the operation of the device, a capture unit that can capture either a single still image or a plurality of consecutive still images, an MMS generating unit that generates an MMS message from a plurality of consecutive still images and a radio unit that transmits the MMS message to a recipient.
It is contemplated that the mobile communication device may also include a program unit that provides an SMIL (Synchronized Multimedia Integration Language) application to the MMS generating unit. The MMS generating unit may process the plurality of consecutive still images in slide form using the SMIL application.
It is contemplated that the mobile communication device may include an input/output device that displays the generated MMS message such that the message may be viewed before it is transmitted to a recipient. It is further contemplated that the capture unit may capture the plurality of consecutive still images and the input/output unit may display the MMS message according to units of time specified by a user. Moreover, it is contemplated that the capture unit captures either a single still image or a plurality of consecutive still images according to a user's selected mode.
In another aspect of the invention, a method is provided for capturing and transmitting images in a mobile communication device. The method includes capturing either a single still image or a plurality of consecutive still images, generating an MMS message if a plurality of still images is captured and transmitting the MMS message to a recipient.
It is contemplated that the MMS message may be generated using an SMIL application. It is further contemplated that the MMS message may be generated in slide form.
It is contemplated that the method may include processing a user input to select whether a single still image or a plurality of consecutive still images is captured. It is further contemplated the method may include processing a user input to determine the units of time used to capture a plurality of consecutive still images.
It is contemplated that the method may include displaying the MMS message on a display unit. It is further contemplated the method may include processing a user input to determine the units of time used to display the MMS message. Moreover, it is contemplated that the method may be performed in a control unit.
In another aspect of the invention, a mobile terminal is provided for capturing and transmitting images. The mobile terminal includes a control unit that controls the operation of the mobile terminal, a capture unit that can capture either a single still image or a plurality of consecutive still images, an MMS generating unit that generates an MMS message from a plurality of consecutive still images using a SMIL application, a program unit that provides the SMIL application to the MMS generating unit, an input/output unit that displays the MMS message, and a radio unit that transmits the MMS message to a recipient.
It is contemplated that the MMS generating unit may process the plurality of consecutive still images in slide form. It is further contemplated that a user may indicate the units of time used to capture the plurality of still images and display the MMS message. Moreover, it is contemplated that the user may set a capture mode used to determine whether a single still image or a plurality of consecutive still images is captured.
The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention. Features, elements, and aspects of the invention that are referenced by the same numerals in different figures represent the same, equivalent, or similar features, elements, or aspects in accordance with one or more embodiments.
FIG. 1 illustrates a conventional mobile communication system.
FIG. 2 illustrates a flowchart of a conventional method for capturing and transmitting an image with user equipment in a mobile communication system.
FIG. 3 illustrates slide constructions in accordance with the conventional art.
FIG. 4 illustrates a block diagram of a mobile communication device in accordance with the present invention.
FIG. 5 illustrates a flowchart of a method for capturing and transmitting images with a mobile communication device in accordance with the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention relates to an apparatus and method for capturing and transmitting consecutive still images that appear to be moving images. Although the present invention is illustrated with respect to a mobile communication device, it is contemplated that the present invention may be utilized anytime it is desired to capture and transmit still images of a moving subject such that the still images appear to be moving images.
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. The present invention is directed to a mobile communication device using SMIL (synchronized multimedia integration language) to capture and transmit still images of a moving subject such that a plurality of consecutive images look like moving images.
SMIL, recommended by the World Wide Web Consortium (W3C), is designed to be the standard markup language for standardized multimedia and is based on XML (Extensible Markup Language) composed of simple few tags and attributes. SMIL enables the creation of multimedia contents more easily and effectively by integrating the techniques necessary for providing multimedia services and may include a variety of media such as streaming audio or video, images, and text. The W3C presents SMIL, which may provide a presentation function as well as multimedia contents, streaming audio and video, images and texts, as a standard language for transmitting multimedia.
A message generated using SMIL is called an MMS message. In order to transmit and receive an MMS message between a user and a recipient having user equipment produced by different manufacturers, the content of the message, allowed elements and attributes of the presentation language, media content format and lower level capabilities are required.
FIG. 3 illustrates a conventional MMS (Multimedia Messaging Service) message construction. Each of slides shown in FIG. 3 can include text and sound. Utilizing the present invention, each multimedia message will be represented by SMIL. All still images to be represented by SMIL have the same layout.
According to the W3C SMIL specifications, elements of MMS SMIL are composed of five modules. There are five basic modules for generating an MMS message.
The first layout module provides a framework for spatial layout of visual components as illustrated in Table 1. Default dimensions of the root-layout are the dimensions of the mobile communication device, or user equipment, display area and are expressed in pixels.
The second media object module provides a framework for describing the media that constitute a SMIL presentation as illustrated in Table 2. The MMS SMIL includes the parts of the SMIL BasicMedia module.
The third structure module describes the structure of the SMIL document. MMS SMIL adopts the SMIL Structure module as illustrated in Table 3.
The fourth timing and synchronization module provides a framework for timing structure, timing control properties and temporal relationships between the elements as illustrated in Table 4.
TABLE 1
Layout Modules
Elements Attributes Content Model
Layout region, root-layout
Region left, top, height, width, fit, id EMPTY
root-layout width, height EMPTY
TABLE 2
Media Object Modules
Elements Attributes Content Model
Text src, region, alt, begin, end EMPTY
Img src, region, alt, begin, end EMPTY
Audio src, alt, begin, end EMPTY
ref, src, region, alt, begin, end EMPTY
TABLE 3
Structure Modules
Elements Attributes Content Model
Smil head, body
Head layout
Body MMSSchedule
TABLE 4
Timing and Synchronization Modules
Elements Attributes Content Model
Par dur MMSMediaContent
TABLE 5
Meta Information Modules
Elements Attributes Content Model
Meta Name, content EMPTY
The fifth Meta information module contains elements and attributes describing SMIL documents as illustrated in Table 5. The MMS messages may contain meta-information included in the message by means of the Meta element.
FIG. 4 illustrates a block diagram of user equipment for image capture and transmission in accordance with the present invention. As shown in FIG. 4, the user equipment 300 includes a capture unit 305, a control unit 310, memory 320, a program unit 330, an MMS generating unit 340, a radio unit 350 and an input/output unit 360.
The control unit 310 controls the capture unit 305 to capture images of a subject, stores the captured still images in memory 320 and outputs or transmits the stored still images. The capture unit 305 captures still images of a target subject under the control of the control unit 310.
The program unit 330 contains a plurality of application programs, including SMIL Application programs. The program unit 330 performs the programs under control of the control unit 310.
The MMS generating unit 340 converts captured still images designated by the control unit 310 to generate an MMS message. The control unit 310 controls time intervals used for the capture and display of consecutive still images constituting the MMS message according to user selection via the input/output unit 360.
The input/output unit 360 is connected to the control unit 310 and receives/transmits an audio signal, a text signal using audio signals, texts, symbols, numbers and graphics as well as a dialing signal according to a recipient's ID through a microphone, a speaker, a keyboard and a display unit. An image signal for multimedia communications that is captured by the capture unit 305 may be displayed via a display unit that is part of the input/output unit 360, thereby allowing an image being transmitted by the user equipment 300 to be viewed.
The radio unit 350 provides transmission and reception between the user equipment 300 and other users in the communications system 1. Once the radio unit 350 is connected to a base station 20, the radio unit transmits the MMS message to the base station.
FIG. 5 illustrates a flowchart of a method for capturing and transmitting images with the user equipment 300 in accordance with the present invention. A user indicates whether to capture a single still image or a plurality of consecutive still images of a subject by inputting commands via the input/output unit 360 (S400). The capture mode set by the user is then checked (S410) and the capture unit 305 then captures one or more images of a subject according to the set capture mode (S420 and S430). The captured still images are stored in an allocated region of memory 320 (S440).
If the capture mode is set to single-image capture mode according to the user, the capture unit 305 captures a single still image (S420). Thereafter, the generated still image is stored (S440) and transmitted (S480) according to conventional methods under control of the control unit 310.
On the other hand, if the capture mode is set to consecutive-images capture mode according to the user, the capture unit 305 captures a plurality of consecutive still images (S430). The capture unit 305 captures images of the subject after setting capture-time intervals to capture consecutive still images by set units of time, thereby generating a plurality of consecutive still images. The user may indicate the capture-time intervals. The captured consecutive still images are stored in memory 320 under control of the control unit 310 (S440).
When transmitting the stored still images to a recipient, the user selects a transmit mode (S450). The transmit mode is then checked (S460) to determine whether a single stored image or a plurality of stored images is to be transferred.
If the user selects to transmit a plurality of consecutive still images, the selected consecutive still images stored in memory 320 are loaded into the MMS generating unit 340. MMS information is generated using the consecutive still images and a SMIL application (S470) and an MMS message is generated according to set units of time using the generated information. The user may indicate the set units of time. The MMS message generated using the consecutive still images is one still image that appears as a moving image.
In order to transmit the generated MMS message or a single still image, the user designates an ID of the recipient's user equipment. The single still image or MMS message is transmitted to the recipient via the base station by the radio unit 350 under control of the control unit 310 (S480).
As described herein, by utilizing the apparatus and method of the present invention, a mobile communication device generates an MMS message according to set units of time using consecutive still images and a SMIL application and transmits the generated MMS message to a recipient. The MMS message has a size that is smaller than a comparable moving image file. The recipient's user equipment, provided with a device for displaying the MMS message, receives the MMS message at a lower cost in comparison to the transmission of moving images, the MMS message having a similar appearance to the moving images. In addition, the communications cost of the sender is reduced because channel occupancy is lowered.
The foregoing embodiments and advantages are merely exemplary and are not to be construed as limiting the present invention. The present teaching can be readily applied to other types of apparatuses. The description of the present invention is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, and variations will be apparent to those skilled in the art. In the claims, means-plus-function clauses are intended to cover the structure described herein as performing the recited function and not only structural equivalents but also equivalent structures.

Claims (17)

1. A mobile communication device for capturing and transmitting images, the mobile communication device comprising:
a control unit adapted to control the operation of the mobile communication device;
a capture unit adapted to capture either a single still image or a plurality of consecutive still images, wherein the capture unit is further adapted to capture the plurality of consecutive still images according to units of time set by a user;
a multimedia processing unit adapted to generate a moving image by processing the plurality of consecutive still images captured by the capture unit and to generate a multimedia message under control of the control unit wherein the multimedia message comprises the moving image; and
a radio unit adapted to transmit the multimedia message.
2. The mobile communication device of claim 1, further comprising a program unit adapted to provide an SMIL application to the multimedia processing unit.
3. The mobile communication device of claim 1, wherein the multimedia processing unit is further adapted to process the plurality of consecutive still images as the moving image using an SMIL application.
4. The mobile communication device of claim 1, further comprising an input/output unit adapted to display the multimedia message.
5. The mobile communication device of claim 4, wherein the input/output unit is further adapted to display the multimedia message according to units of time set by a user.
6. The mobile communication device of claim 1, wherein the capture unit is further adapted to capture the single still image or the plurality of consecutive still images according to a capture mode set of by a user.
7. A method for capturing and transmitting images in a mobile communication device, the method comprising:
capturing either a single still image or a plurality of consecutive still images of a subject, wherein capturing the single still image or the plurality of consecutive still images comprises processing an input from a user to determine units of time for capturing the single still image or the plurality of consecutive still images;
generating a multimedia message comprising a moving image by processing the plurality of captured consecutive still images; and
transmitting the multimedia message.
8. The method of claim 7, wherein the multimedia message is generated using an SMIL application.
9. The method of claim 7, wherein the multimedia message is generated in a slide form.
10. The method of claim 7, further comprising processing an input from a user to determine whether to capture the single still image or the plurality of consecutive still images.
11. The method of claim 7, further comprising displaying the multimedia message on a display unit.
12. The method of claim 11, wherein displaying the multimedia message further comprises processing an input from a user to determine units of time for displaying the multimedia message.
13. The method of claim 7, wherein the capturing, generating and transmitting steps are performed under the control of a control unit.
14. A mobile terminal for capturing and transmitting images, the mobile communication terminal comprising:
a control unit adapted to control the operation of the mobile terminal;
a capture unit adapted to capture either a single still image or a plurality of consecutive still images, wherein the capture unit is adapted to capture the plurality of still images according to units of time set by a user;
a multimedia processing unit adapted to generate a moving image by processing the plurality of consecutive still images using a SMIL application and to generate a multimedia message under control of the control unit wherein the multimedia message comprises the moving image;
a program unit adapted to provide the SMIL application to the multimedia processing unit;
an input/output unit adapted to display the multimedia message;
a radio unit adapted to transmit the multimedia message.
15. The mobile terminal of claim 14, wherein the multimedia processing unit is further adapted to process the plurality of consecutive still images in slide form.
16. The mobile terminal of claim 14, wherein the capture unit is further adapted to capture the plurality of consecutive still images according to units of time set by a user.
17. The mobile terminal of claim 14, wherein the capture unit is further adapted to capture the single still image or the plurality of consecutive still images according to a capture mode set by a user.
US11/066,053 2004-03-24 2005-02-24 Method and apparatus for image capture and transmission in a mobile communication device Active 2026-11-30 US7522182B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2004-0020128 2004-03-24
KR1020040020128A KR100677308B1 (en) 2004-03-24 2004-03-24 A method and a apparatus of sending image signal as video image for mobile phone

Publications (2)

Publication Number Publication Date
US20050213834A1 US20050213834A1 (en) 2005-09-29
US7522182B2 true US7522182B2 (en) 2009-04-21

Family

ID=34858877

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/066,053 Active 2026-11-30 US7522182B2 (en) 2004-03-24 2005-02-24 Method and apparatus for image capture and transmission in a mobile communication device

Country Status (7)

Country Link
US (1) US7522182B2 (en)
EP (1) EP1580965B1 (en)
JP (1) JP2005278151A (en)
KR (1) KR100677308B1 (en)
CN (1) CN1674702A (en)
AT (1) ATE406754T1 (en)
DE (1) DE602005009271D1 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080081646A1 (en) * 2006-10-03 2008-04-03 Drew Morin 911 data messaging
US20080090553A1 (en) * 2006-10-13 2008-04-17 Ping Sum Wan Dynamic video messaging
US20080094467A1 (en) * 2006-10-24 2008-04-24 Samsung Electronics Co.; Ltd Video telephony apparatus and signal transmitting/receiving method for mobile terminal
US20080147546A1 (en) * 2006-09-19 2008-06-19 Walter Weichselbaumer Wireless device electronic wallet transaction validation
US20090156185A1 (en) * 2007-12-14 2009-06-18 Drew Morin Wireless application protocol (wap) application location based services (lbs)
US20090154659A1 (en) * 2007-12-14 2009-06-18 Drew Morin Reverse 911 using multicast session internet protocol (SIP) conferencing of voice over internet protocol (VoIP) users
US20110149954A1 (en) * 2008-05-30 2011-06-23 Todd Poremba Wireless emergency services protocols translator between ANSI-41 and VoIP emergency services protocols
US8463284B2 (en) 2006-07-17 2013-06-11 Telecommunication Systems, Inc. Short messaging system (SMS) proxy communications to enable location based services in wireless devices
US8681044B2 (en) 2004-10-15 2014-03-25 Telecommunication Systems, Inc. Culled satellite ephemeris information for quick, accurate assisted locating satellite location determination for cell site antennas
US8688174B2 (en) 2012-03-13 2014-04-01 Telecommunication Systems, Inc. Integrated, detachable ear bud device for a wireless phone
US8738496B2 (en) 2000-02-25 2014-05-27 Telecommunication Systems, Inc. Prepaid short messaging
US8892121B2 (en) 2006-09-19 2014-11-18 Telecommunication Systems, Inc. Device based trigger for location push event
US8942743B2 (en) 2010-12-17 2015-01-27 Telecommunication Systems, Inc. iALERT enhanced alert manager
US9191520B2 (en) 2010-12-13 2015-11-17 Telecommunication Systems, Inc. Location services gateway server
US9208346B2 (en) 2012-09-05 2015-12-08 Telecommunication Systems, Inc. Persona-notitia intellection codifier
US9241040B2 (en) 2000-04-11 2016-01-19 Telecommunication Systems, Inc. Mobile activity status tracker
US9264537B2 (en) 2011-12-05 2016-02-16 Telecommunication Systems, Inc. Special emergency call treatment based on the caller
US9408047B2 (en) 2013-10-10 2016-08-02 Telecommunication Systems, Inc. Read acknowledgement interoperability for text messaging and IP messaging
US10572636B2 (en) * 2017-06-01 2020-02-25 International Business Machines Corporation Authentication by familiar media fragments
US11120118B2 (en) 2017-11-22 2021-09-14 International Business Machines Corporation Location validation for authentication

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2427527B (en) * 2005-06-21 2010-04-14 Vodafone Plc Content delivery in a telecommunications network
KR100690242B1 (en) 2006-04-24 2007-03-12 삼성전자주식회사 Mobile terminal and method for transmitting image during use of mobile messenger service
US20070300267A1 (en) * 2006-06-23 2007-12-27 Sony Ericsson Mobile Communications Ab Method and apparatus to facilitate multimedia transfer

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1117230A2 (en) 2000-01-17 2001-07-18 Nokia Mobile Phones Ltd. A method and system for presenting information in a multimedia terminal
EP1367832A2 (en) 2002-05-31 2003-12-03 Oplayo Oy Arrangement for creating multimedia presentation
JP2004032236A (en) 2002-06-25 2004-01-29 Matsushita Electric Ind Co Ltd Radio communication terminal with camera
JP2004056469A (en) 2002-07-19 2004-02-19 Sony Corp Electronic device and media reproducing method therefor
US7010790B2 (en) * 2002-11-20 2006-03-07 Cegetel Modular method and device for the tracing of a multimedia message through a telecommunications network
US7046276B2 (en) * 1995-02-21 2006-05-16 Ricoh Company, Ltd. Digital camera with external connection detection and mode switching capabilities

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7046276B2 (en) * 1995-02-21 2006-05-16 Ricoh Company, Ltd. Digital camera with external connection detection and mode switching capabilities
EP1117230A2 (en) 2000-01-17 2001-07-18 Nokia Mobile Phones Ltd. A method and system for presenting information in a multimedia terminal
EP1367832A2 (en) 2002-05-31 2003-12-03 Oplayo Oy Arrangement for creating multimedia presentation
JP2004032236A (en) 2002-06-25 2004-01-29 Matsushita Electric Ind Co Ltd Radio communication terminal with camera
JP2004056469A (en) 2002-07-19 2004-02-19 Sony Corp Electronic device and media reproducing method therefor
US7010790B2 (en) * 2002-11-20 2006-03-07 Cegetel Modular method and device for the tracing of a multimedia message through a telecommunications network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Hungter J et al.: "Building and Indexing a Distributed Multimedia Presentation Archive Using SMIL" Lecture Notes in Comuter Science, Springer Verlag, Berlin, DE, vol. 2163, 2001, pp. 415-428, XP002362626 ISSN: 0302-9743.

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8738496B2 (en) 2000-02-25 2014-05-27 Telecommunication Systems, Inc. Prepaid short messaging
US9241040B2 (en) 2000-04-11 2016-01-19 Telecommunication Systems, Inc. Mobile activity status tracker
US8681044B2 (en) 2004-10-15 2014-03-25 Telecommunication Systems, Inc. Culled satellite ephemeris information for quick, accurate assisted locating satellite location determination for cell site antennas
US8463284B2 (en) 2006-07-17 2013-06-11 Telecommunication Systems, Inc. Short messaging system (SMS) proxy communications to enable location based services in wireless devices
US8892121B2 (en) 2006-09-19 2014-11-18 Telecommunication Systems, Inc. Device based trigger for location push event
US9510143B2 (en) 2006-09-19 2016-11-29 Telecommunications Systems, Inc. Device based trigger for location push event
US20080147546A1 (en) * 2006-09-19 2008-06-19 Walter Weichselbaumer Wireless device electronic wallet transaction validation
US9408046B2 (en) * 2006-10-03 2016-08-02 Telecommunication Systems, Inc. 911 data messaging
US20080081646A1 (en) * 2006-10-03 2008-04-03 Drew Morin 911 data messaging
US8260263B2 (en) * 2006-10-13 2012-09-04 Dialogic Corporation Dynamic video messaging
US20080090553A1 (en) * 2006-10-13 2008-04-17 Ping Sum Wan Dynamic video messaging
US20080094467A1 (en) * 2006-10-24 2008-04-24 Samsung Electronics Co.; Ltd Video telephony apparatus and signal transmitting/receiving method for mobile terminal
US8633959B2 (en) * 2006-10-24 2014-01-21 Samsung Electronics Co., Ltd. Video telephony apparatus and signal transmitting/receiving method for mobile terminal
US9344840B2 (en) 2007-12-14 2016-05-17 Telecommunication Systems, Inc. Wireless application protocol (WAP) application location based services (LBS)
US20090156185A1 (en) * 2007-12-14 2009-06-18 Drew Morin Wireless application protocol (wap) application location based services (lbs)
US9369294B2 (en) 2007-12-14 2016-06-14 Telecommunication Systems, Inc. Reverse 911 using multicast session internet protocol (SIP) conferencing of voice over internet protocol (VoIP) users
US20090154659A1 (en) * 2007-12-14 2009-06-18 Drew Morin Reverse 911 using multicast session internet protocol (SIP) conferencing of voice over internet protocol (VoIP) users
US20110149954A1 (en) * 2008-05-30 2011-06-23 Todd Poremba Wireless emergency services protocols translator between ANSI-41 and VoIP emergency services protocols
US9001719B2 (en) 2008-05-30 2015-04-07 Telecommunication Systems, Inc. Wireless emergency services protocols translator between ANSI-41 and VoIP emergency services protocols
US9167403B2 (en) 2008-05-30 2015-10-20 Telecommunication Systems, Inc. Wireless emergency services protocols translator between ANSI-41 and VoIP emergency services protocols
US8369316B2 (en) 2008-05-30 2013-02-05 Telecommunication Systems, Inc. Wireless emergency services protocols translator between ANSI-41 and VoIP emergency services protocols
US9191520B2 (en) 2010-12-13 2015-11-17 Telecommunication Systems, Inc. Location services gateway server
US9210548B2 (en) 2010-12-17 2015-12-08 Telecommunication Systems, Inc. iALERT enhanced alert manager
US8942743B2 (en) 2010-12-17 2015-01-27 Telecommunication Systems, Inc. iALERT enhanced alert manager
US9264537B2 (en) 2011-12-05 2016-02-16 Telecommunication Systems, Inc. Special emergency call treatment based on the caller
US8688174B2 (en) 2012-03-13 2014-04-01 Telecommunication Systems, Inc. Integrated, detachable ear bud device for a wireless phone
US9208346B2 (en) 2012-09-05 2015-12-08 Telecommunication Systems, Inc. Persona-notitia intellection codifier
US9408047B2 (en) 2013-10-10 2016-08-02 Telecommunication Systems, Inc. Read acknowledgement interoperability for text messaging and IP messaging
US10572636B2 (en) * 2017-06-01 2020-02-25 International Business Machines Corporation Authentication by familiar media fragments
US11120118B2 (en) 2017-11-22 2021-09-14 International Business Machines Corporation Location validation for authentication

Also Published As

Publication number Publication date
US20050213834A1 (en) 2005-09-29
ATE406754T1 (en) 2008-09-15
JP2005278151A (en) 2005-10-06
EP1580965B1 (en) 2008-08-27
EP1580965A2 (en) 2005-09-28
DE602005009271D1 (en) 2008-10-09
KR100677308B1 (en) 2007-02-05
EP1580965A3 (en) 2006-12-27
KR20050094693A (en) 2005-09-28
CN1674702A (en) 2005-09-28

Similar Documents

Publication Publication Date Title
US7522182B2 (en) Method and apparatus for image capture and transmission in a mobile communication device
US10009739B2 (en) Method for presenting information contained in messages in a multimedia terminal, a system for transmitting multimedia messages, and a multimedia terminal
US6832259B2 (en) Dynamic adjustment of transmitted data size for a subscriber device
US8391843B2 (en) Method for controlling user interface menu, and mobile terminal and device for providing application service using the same
KR101702659B1 (en) Appratus and method for syncronizing moving picture contents and e-book contents and system thereof
US20070229556A1 (en) Display data size adjustment apparatus and method for portable terminal
US20050208962A1 (en) Mobile phone, multimedia chatting system and method thereof
US20090005089A1 (en) Mobile Terminal for Chatting by Using Sms and Method Thereof
CN101073050A (en) Handheld wireless communicator, method fro operating the apparatus and computer program product displaying information on plurality of display screens
CN1964330A (en) System and method for providing multimedia electronic mail service in a portable terminal
EP2034431A1 (en) Mobile communication terminal and schedule managing method therein
US20060094453A1 (en) Apparatus and method for setting multimedia items using an MMS message in a mobile terminal
CN102447956A (en) Method for sharing video of mobile phone and system
US20100151888A1 (en) Method and system for transmitting and receiving multimedia message
KR101755433B1 (en) Method For Transmitting and Receiving of Video Telephony having function of adjusting Quality of resolution
US20070130499A1 (en) Delivering web content in a message transmitted over a mobile wireless communication network
CN101742215A (en) Realization method, mobile terminal and system of video telephone
WO2004081798A1 (en) Transmitter apparatus and transmitting method
KR100475953B1 (en) Method and System for Providing Substitute Image for Use in Image Mobile Phone
KR101270818B1 (en) Apparatus for transmitting wap/web pages using message service and method thereof
KR100752080B1 (en) Multimedia message service system and service providing method thereof
KR100612684B1 (en) System and Method for Messaging Service Connected with TV Broadcasting
WO2009066944A2 (en) Method and device for displaying of message
KR101366317B1 (en) Method for Multipoint Video Telepony in Mobile Terminal
KR100679511B1 (en) Method of making literal message comprising image and computer readable recording medium thereof

Legal Events

Date Code Title Description
AS Assignment

Owner name: LG ELECTRONICS INC., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BANG, JOON-SUNG;REEL/FRAME:016328/0933

Effective date: 20050202

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LG ELECTRONICS INC.;REEL/FRAME:042004/0425

Effective date: 20150409

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12