US20120159638A1 - Method and apparatus for accessing content protected media streams - Google Patents

Method and apparatus for accessing content protected media streams Download PDF

Info

Publication number
US20120159638A1
US20120159638A1 US13/109,154 US201113109154A US2012159638A1 US 20120159638 A1 US20120159638 A1 US 20120159638A1 US 201113109154 A US201113109154 A US 201113109154A US 2012159638 A1 US2012159638 A1 US 2012159638A1
Authority
US
United States
Prior art keywords
content
drm
access device
accordance
protected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/109,154
Other versions
US8510851B2 (en
Inventor
Darryn D. McDade, SR.
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
STMicroelectronics lnc USA
Original Assignee
STMicroelectronics lnc USA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by STMicroelectronics lnc USA filed Critical STMicroelectronics lnc USA
Priority to US13/109,154 priority Critical patent/US8510851B2/en
Assigned to STMICROELECTRONICS, INC. reassignment STMICROELECTRONICS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MCDADE, SR., DARRYN D.
Publication of US20120159638A1 publication Critical patent/US20120159638A1/en
Priority to US13/915,708 priority patent/US20130276139A1/en
Application granted granted Critical
Publication of US8510851B2 publication Critical patent/US8510851B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541Rights Management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4405Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream decryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782Web browsing, e.g. WebTV
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/64322IP
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8355Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed

Definitions

  • a set top box is a device that connects to an audio and/or video display, such as a television or monitor, and a signal source.
  • the STB receives signals from the signal source and converts the signals into information (content) that can be displayed on the television or monitor or used to generate sound.
  • STB's are employed in homes, hotels, and private offices among other places. Connection to the signal source may be made using Satellite, Cable, or Internet links (such as IPTV), for example. Additionally, the content may be delivered by digital television broadcast, such as DVB-T in Europe and ATSC in the United States. Some types of STB's convert these “free to air” transmissions into PAL signals (in the case of Europe) and NTSC signals (in the case of the United States) so that a television can render these new higher quality transmissions.
  • DRM Digital Rights Management
  • the DVD content scramble system was the first commercially successful “DRM”. Its purpose was to prevent casual DVD copying using a combination of low intensity encryption, a Key Management system and Bus Encryption.
  • Digital rights management is an access control technology that is used to limit the use of software, music, videos or other digital data. It can be used by copyright holders, publishers, content providers, playback manufacturers and individuals to limit the use of digital content and devices.
  • video DVDs usually include a region code. If the region code does not match the player's region code, the DVD player will not allow the disc to be played.
  • DRM Digital Millennium Copyright Act
  • EULAs End User License Agreements
  • DRM involves the user (the entity wishing to render the content), the content to rendered (music, movie, book, etc.) and the user's rights, which are actions the user is permitted perform with the content (for example, access once, access for specified period, copy, transfer to another device, etc).
  • DRM systems include: WM-DRM, Janus (Microsoft), MS PlayReady/Silverlight (Microsoft), Verimatrix, FairPlay (Apple), OMA (Open Mobile Alliance), BD+ (Blue Ray Discs), OpenMG (Sony Proprietary), Marlin (Intertrust) and others.
  • Some DRM systems are hardware based.
  • the DRM system 100 includes a client 102 and a server 104 .
  • Operations performed during a DRM operation may include:
  • Other operations used include the binding encryption key to the user's machine, the use of Web Based License Servers, in which a server provides an access key, and the use of Watermarks and Broadcast Flags, where data is embedded in content. For example, it is not permitted in the USA for a DVD recorder to record content if the embedded broadcast flag (BF) is set.
  • BF embedded broadcast flag
  • FIG. 2 shows an example of a web based license server.
  • a set top box (STB) 202 such as Internet Protocol (IP) STB, communicates with a remote license server 204 using a single proprietary DRM system to obtain an access key to be used in decoding or decrypting content.
  • IP Internet Protocol
  • a number of business models are associated with the use of DRM systems.
  • the content provider selects a Conditional Access (CA)/DRM technology and specifies CA/DRM for the STB's in their network.
  • CA Conditional Access
  • the content provider owns the STB and supplies the STB to their customer.
  • IP Internet Protocol
  • the rendering device is a personal computer, STB, or a portable digital device (mobile phone, PDA, etc).
  • FIG. 1 is a diagrammatic representation of digital rights management system.
  • FIG. 2 shows an example of a web based license server.
  • FIG. 3 shows an example of a conventional set top box.
  • FIG. 4 is a diagrammatic representation of a system for accessing protected media streams in accordance with some embodiments of the present invention.
  • FIG. 5 is a diagrammatic representation of a content access device that supports interaction with a search engine in accordance with some embodiments of the invention.
  • FIG. 6 is a flow chart of a method for accessing protected content in accordance with some embodiments of the present invention.
  • embodiments of the invention described herein may comprise one or more conventional processors and unique stored program instructions that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions used for accessing content protected media streams described herein.
  • some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs) or Field Programmable Gate Arrays (FPGA's), in which each function or some combinations of certain of the functions are implemented as custom logic.
  • ASICs application specific integrated circuits
  • FPGA's Field Programmable Gate Arrays
  • Audio, visual, textual and other media may be encoded as digital data that may be distributed as a data stream.
  • the data stream typically incorporates additional information for signaling, error correction, identification, etc.
  • the information in the data stream relating the media itself is called the ‘content’.
  • a data stream that includes media content is termed a ‘media stream’.
  • the content may be video, such as a television program or a film, or audio information.
  • a content access device such as a set top box (STB) is a device that receives a first data stream, from a content provider, and from it extracts a second data stream of extracted data that forms a content signal to be used by a rendering device to display content such as images and/or sounds.
  • the content in the first data stream may be encoded, encrypted or otherwise protected.
  • FIG. 3 An example is shown in FIG. 3 , where a server 302 of a content provider provides a first data stream 304 to a set top box (STB) 202 via the Internet 306 .
  • the content, encrypted within the data stream 304 is extracted by the STB 202 using a single, proprietary DRM system 308 .
  • the content is provided as a second data stream 310 to a television 312 .
  • a conventional STB is provided to a user by a content provider and may only be used to decrypt and render content supplied by that content provider.
  • the present invention relates to a content access device for processing content protected media streams.
  • the content access device is capable of accessing content from multiple content providers.
  • the content access device is also capable of extracting content that is protected by any of a plurality of Digital Rights Management (DRM) systems.
  • DRM Digital Rights Management
  • FIG. 4 is a diagrammatic representation of a system for accessing protected media streams in accordance with some aspects of the present invention.
  • the system 400 includes a content access device 402 that is capable of searching, receiving and extracting content from multiple content providers, indicated by servers 302 .
  • the three content providers 302 provide encrypted or encoded data streams 304 , 304 ′ and 304 ′′ (carrying content A, B and C, respectively, encoded within the data streams) to the content access device 402 via the Internet 306 .
  • the data stream is received at a network interface 408 of the content access device 402 .
  • the protected content which is encrypted in the protected data stream, is extracted by an extraction unit 410 .
  • the extracted content is provided as a second data stream, or content signal, 404 to a media presentation device 406 , such as a television, visual display unit, rendering engine or audio system.
  • the media presentation device 406 may serve as part of an interface between the content access device and the user.
  • the media presentation device 406 comprises a touch screen.
  • Additional user interface devices, such a mouse, a keypad or a remote control may also be used to enable the user to interact with the content access device.
  • the extraction unit 410 supports three DRM components 308 , 308 ′ and 308 ′′.
  • the content from each data stream is extracted in accordance with the DRM system associated with it.
  • content A encrypted within the data stream 304
  • content B encrypted within the data stream 304 ′
  • Content C encrypted within the data stream 304 ′′
  • DRM C component 308 ′′′ is extracted by the extraction unit 410 using DRM C component 308 ′′′.
  • the appropriate DRM component to be used to extract the content may be identified and activated automatically by the content access device.
  • the DRM component may be identified dependent upon information embedded within the data stream, or dependent upon other data provided by the content provider.
  • the content access device is capable of hosting multiple Digital Rights Management (DRM) components. New components may be added to expand the range of content that a user can access.
  • DRM Digital Rights Management
  • the associated business model differs from current practices for set top boxes (STB's) in that the user (the client or subscriber) may own the content access device 402 and be free to choose a plurality of content providers.
  • the content access device may be leased by the user from a third party, independent of the content providers.
  • currently STB are owned by the content provider and leased to the user.
  • the media presentation device or rendering engine 406 is integrated with the content access device 402 .
  • the content access device 402 may be a data-enabled mobile telephone capable of rendering content on the display screen of the telephone.
  • FIG. 5 is a diagrammatic representation of a further embodiment, in which the content access device 402 supports a content search engine.
  • the content access device 402 is linked to an Internet access port 504 via the network interface and a wired communication link 506 or a wireless communication link 508 .
  • the region of the system above the line 510 and designated as the ‘CLOUD’ is remote from the user and is accessed via the Internet access port 504 .
  • the content access device 402 supports a web browser 502 that enables a user to search the Internet for content by sending queries along path 512 to a search engine 514 .
  • the search engine 514 may query content providers 302 to discover available content.
  • the search engine reports results back along path 512 to the web browser.
  • the user may then request content to be accessed from the content providers 302 via path 304 .
  • the content providers then verify the user's rights using rights servers 516 and, if the rights are verified, provide the content to the user via path 304 .
  • the content access device 402 maintains a list or catalog of the DRM systems supported by the content access device. This catalog is supplied to the search engine 514 . This enables the search engine to match the DRM systems of available content with the DRM systems supported by the content access device and only results that are compatible with the content access device are returned to the content access device 402 .
  • the search engine 514 returns all results of the query, together with the DRM requirements, and the content access device 402 sorts the results dependent upon the available DRM components. For example, the user may select to show only results that match available DRM components. Alternatively, the results displayed to the user may be formatted according to whether DRM components are available or not.
  • the content access device is configured to determine if the DRM system associated with any particular content is supported.
  • the content access device can interact with a search engine to either (1) instruct the search engine to only search for content that can be rendered, or (2) filter the results of a search to only display content that can be rendered to the user. Both of these approaches may be implemented by the content access device building a catalog of supported DRM systems.
  • the code snipped below illustrates how a simple DRM catalog may be created in the content access device.
  • a flag denoted by the variable is_supported, is set for all DRMs supported.
  • FIG. 6 is a flow chart 600 of a method for accessing protected content in content access device that supports a plurality of DRM systems.
  • the content access device receives user input via a web browser or other user interface at block 604 .
  • the device gets a list or catalog of DRM systems that are supported by the device. If this list does not exist, the list maybe created, as described above.
  • the content access device supplies a copy of the list to a search engine at block 608 .
  • the list is maintained in the content access device.
  • the content access device queries a search engine, dependent upon the user input, to discover available content. The search engine responds with a list of references to the available content.
  • the content access devices presents the list of references to the available content to the user, dependent upon whether the content is protected by a DRM system supported by the content access device.
  • the provision of a catalog of supported DRM systems to the search engine enables the search engine to determine which content is protected by a DRM system supported by the content access device.
  • the list of references of available content is filtered to remove references to content that is protected by a DRM system that is not supported by the content access device.
  • the list of references to available content presented to the user is formatted to distinguish between content that is protected by a DRM system that is supported by the content access device and content that is protected by a DRM system that is not supported by the content access device.
  • non-supported content may be marked or shown in a different font or color, or the list may be ordered to show content with supported DRM systems first.
  • the content access device requests selected content from a content provider in accordance with a content reference selected by the user.
  • the content access device receives a data stream carrying the content from the content provider.
  • the selected content is extracted from the data stream using a DRM system of the plurality of DRM systems.
  • the extracted content is presented to the user. In this manner, the content access device has enabled a user to select content efficiently and to access the selected content.

Abstract

A method and apparatus for recovering a content signal from media stream protected by a digital rights management (DRM) system. A content access device includes a network interface configured to receive the protected media stream from a remote content provider via a network and a plurality of distinct DRM components corresponding to DRM systems supported by the content access device. A content extraction unit is operable to select a DRM component of the plurality of DRM components and execute the selected DRM component to recover a content signal from the protected media stream. When a search engine is used to discover available content, a list of references to available content is presented to the user, the presentation being dependent upon whether or not the content is protected by a DRM system supported by the content access device.

Description

    PRIORITY CLAIM
  • This application claims priority to provisional application Ser. No. 61/425,450 titled “Method of Classifying Content Protection Mechanism for DRM Content Streaming with Search Engine”, filed Dec. 21, 2010.
  • BACKGROUND
  • Traditionally, a set top box (STB) is a device that connects to an audio and/or video display, such as a television or monitor, and a signal source. The STB receives signals from the signal source and converts the signals into information (content) that can be displayed on the television or monitor or used to generate sound.
  • STB's are employed in homes, hotels, and private offices among other places. Connection to the signal source may be made using Satellite, Cable, or Internet links (such as IPTV), for example. Additionally, the content may be delivered by digital television broadcast, such as DVB-T in Europe and ATSC in the United States. Some types of STB's convert these “free to air” transmissions into PAL signals (in the case of Europe) and NTSC signals (in the case of the United States) so that a television can render these new higher quality transmissions.
  • In the case of paid services such as Satellite TV, Cable TV, and paid IPTV (such as Netflix, ZillionTV etc), a proprietary content protection system is employed to prevent content theft and enforce the appropriate digital usage rights provided for by the content owners and service providers. Some of these services use Digital Rights Management (DRM) technology.
  • Copy protection has been around since the 1970's. The DVD content scramble system (CSS) was the first commercially successful “DRM”. Its purpose was to prevent casual DVD copying using a combination of low intensity encryption, a Key Management system and Bus Encryption.
  • Later generations evolved to include viewing control, which limited the number of views and restricted transfers to secondary devices. Enforcing the license required aspects such as multi-play monitoring, copying control, print control and alteration control.
  • Digital rights management (DRM) is an access control technology that is used to limit the use of software, music, videos or other digital data. It can be used by copyright holders, publishers, content providers, playback manufacturers and individuals to limit the use of digital content and devices.
  • The technology generally relies on interaction between the media and the system that plays it. For example, video DVDs usually include a region code. If the region code does not match the player's region code, the DVD player will not allow the disc to be played.
  • In the USA, the restrictive power of DRM depends on, and is extended, by two legal mechanisms: the Digital Millennium Copyright Act (“DMCA”) and End User License Agreements (“EULAs”).
  • DRM involves the user (the entity wishing to render the content), the content to rendered (music, movie, book, etc.) and the user's rights, which are actions the user is permitted perform with the content (for example, access once, access for specified period, copy, transfer to another device, etc).
  • Common DRM systems include: WM-DRM, Janus (Microsoft), MS PlayReady/Silverlight (Microsoft), Verimatrix, FairPlay (Apple), OMA (Open Mobile Alliance), BD+ (Blue Ray Discs), OpenMG (Sony Proprietary), Marlin (Intertrust) and others. Some DRM systems are hardware based.
  • An exemplary DRM system is shown in FIG. 1. The DRM system 100 includes a client 102 and a server 104.
  • The sequence of events by which the client obtains a license to a selected content is as follows:
      • (1) The client requests content rights, for example by selecting, authorizing or pay for content using a web browser 106 to communicate over a network to a web server 108.
      • (2) The transaction is recorded by the web server 108 in an Acquired Rights database 110.
      • (3) The web server 108 returns confirmation of the transaction by passing a token to the client's web browser 106.
      • (4) The browser triggers the client side of the DRM system 112.
      • (5) The client DRM system issues a Server Challenge (verify #1) to a web application server 114.
      • (6) The server parses, and validates the challenge and sends it to the application's Evaluation Logic 116.
      • (7) The Evaluation Logic 116 validates the request against the transaction record in the Acquired Rights database 110.
      • (8) The evaluation logic 116 submits a challenge to a DRM License Server 118.
      • (9) The DRM License Server 118 generates and returns a Custom License.
      • (10) The Evaluation Logic 116 passes the license back to application server 114.
      • (11) The Web Application Server 114 returns the license to client's DRM system 112.
      • (12) The client stores the license in protected license database 120.
  • Operations performed during a DRM operation may include:
  • Utilization of proprietary protocols (usually unpublished)
  • Client Side License Request
  • License Logic
  • Server Side License Production
  • Encrypted Media Transmission
  • License Persistence Management
  • License Evaluation
  • License Revocation
  • These operations are usually confidential and proprietary to each DRM manufacturer, but common functions include the retrieval of cryptographic keys and the subsequent decryption of content. In turn, this requires mechanisms for secure storage of cryptographic keys, secure communication of keys (e.g. secure busses), the use of platform serial numbers, and secure decoding of content and Chip ID requests.
  • Other operations used include the binding encryption key to the user's machine, the use of Web Based License Servers, in which a server provides an access key, and the use of Watermarks and Broadcast Flags, where data is embedded in content. For example, it is not permitted in the USA for a DVD recorder to record content if the embedded broadcast flag (BF) is set.
  • FIG. 2 shows an example of a web based license server. Referring to FIG. 2, a set top box (STB) 202, such as Internet Protocol (IP) STB, communicates with a remote license server 204 using a single proprietary DRM system to obtain an access key to be used in decoding or decrypting content.
  • A number of business models are associated with the use of DRM systems. For example, in the case of Satellite and cable content providers, the content provider selects a Conditional Access (CA)/DRM technology and specifies CA/DRM for the STB's in their network. In addition, the content provider owns the STB and supplies the STB to their customer. In the case of IPTV, the content providers select a DRM system to satisfy their content owners and utilize Internet Protocol (IP) streaming technology to deliver the content to the user. The rendering device is a personal computer, STB, or a portable digital device (mobile phone, PDA, etc).
  • In these business models only one type of CA/DRM system is needed on the STB, however, the STB is limited in the type of content that it can display.
  • BRIEF DESCRIPTION OF THE FIGURES
  • The accompanying figures, in which like reference numerals refer to identical or functionally similar elements throughout the separate views and which together with the detailed description below are incorporated in and form part of the specification, serve to further illustrate various embodiments and to explain various principles and advantages all in accordance with the present invention.
  • FIG. 1 is a diagrammatic representation of digital rights management system.
  • FIG. 2 shows an example of a web based license server.
  • FIG. 3 shows an example of a conventional set top box.
  • FIG. 4 is a diagrammatic representation of a system for accessing protected media streams in accordance with some embodiments of the present invention.
  • FIG. 5 is a diagrammatic representation of a content access device that supports interaction with a search engine in accordance with some embodiments of the invention.
  • FIG. 6 is a flow chart of a method for accessing protected content in accordance with some embodiments of the present invention.
  • Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale.
  • DETAILED DESCRIPTION
  • Before describing in detail embodiments that are in accordance with the present invention, it should be observed that the embodiments reside primarily in combinations of method steps and apparatus components related to the accessing of content protected media streams. Accordingly, the apparatus components and method steps have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
  • In this document, relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” “comprising,” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element preceded by “comprises . . . a” does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.
  • It will be appreciated that embodiments of the invention described herein may comprise one or more conventional processors and unique stored program instructions that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions used for accessing content protected media streams described herein. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs) or Field Programmable Gate Arrays (FPGA's), in which each function or some combinations of certain of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used. Thus, methods and means for these functions have been described herein. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein will be readily capable of generating such software instructions and programs and ICs with minimal experimentation.
  • Audio, visual, textual and other media may be encoded as digital data that may be distributed as a data stream. The data stream typically incorporates additional information for signaling, error correction, identification, etc. The information in the data stream relating the media itself is called the ‘content’. A data stream that includes media content is termed a ‘media stream’. The content may be video, such as a television program or a film, or audio information.
  • A content access device, such as a set top box (STB), is a device that receives a first data stream, from a content provider, and from it extracts a second data stream of extracted data that forms a content signal to be used by a rendering device to display content such as images and/or sounds. The content in the first data stream may be encoded, encrypted or otherwise protected.
  • An example is shown in FIG. 3, where a server 302 of a content provider provides a first data stream 304 to a set top box (STB) 202 via the Internet 306. The content, encrypted within the data stream 304, is extracted by the STB 202 using a single, proprietary DRM system 308. The content is provided as a second data stream 310 to a television 312.
  • A conventional STB is provided to a user by a content provider and may only be used to decrypt and render content supplied by that content provider. In contrast, the present invention relates to a content access device for processing content protected media streams. The content access device is capable of accessing content from multiple content providers. The content access device is also capable of extracting content that is protected by any of a plurality of Digital Rights Management (DRM) systems.
  • FIG. 4 is a diagrammatic representation of a system for accessing protected media streams in accordance with some aspects of the present invention. Referring to FIG. 4, the system 400 includes a content access device 402 that is capable of searching, receiving and extracting content from multiple content providers, indicated by servers 302. For example, in FIG. 4, the three content providers 302 provide encrypted or encoded data streams 304, 304′ and 304″ (carrying content A, B and C, respectively, encoded within the data streams) to the content access device 402 via the Internet 306. The data stream is received at a network interface 408 of the content access device 402. The protected content, which is encrypted in the protected data stream, is extracted by an extraction unit 410. The extracted content is provided as a second data stream, or content signal, 404 to a media presentation device 406, such as a television, visual display unit, rendering engine or audio system.
  • The media presentation device 406 may serve as part of an interface between the content access device and the user. For example, in one embodiment the media presentation device 406 comprises a touch screen. Additional user interface devices, such a mouse, a keypad or a remote control may also be used to enable the user to interact with the content access device.
  • In this example, the extraction unit 410 supports three DRM components 308, 308′ and 308″. The content from each data stream is extracted in accordance with the DRM system associated with it. In this example, content A, encrypted within the data stream 304, is extracted by the extraction unit 410 using DRM A component 308. Content B, encrypted within the data stream 304′, is extracted by the extraction unit 410 using DRM B component 308′. Content C, encrypted within the data stream 304″, is extracted by the extraction unit 410 using DRM C component 308′″.
  • In one embodiment, the appropriate DRM component to be used to extract the content may be identified and activated automatically by the content access device. For example, the DRM component may be identified dependent upon information embedded within the data stream, or dependent upon other data provided by the content provider.
  • This enables a single content access device to support multiple DRM systems and thereby expand the pool of content eligible to be extracted and subsequently rendered. This ability to host multiple DRM systems provides the user with greater choice of content.
  • In general, the content access device is capable of hosting multiple Digital Rights Management (DRM) components. New components may be added to expand the range of content that a user can access.
  • Since multiple DRM systems are supported, the associated business model differs from current practices for set top boxes (STB's) in that the user (the client or subscriber) may own the content access device 402 and be free to choose a plurality of content providers. Alternatively, the content access device may be leased by the user from a third party, independent of the content providers. In contrast, currently STB are owned by the content provider and leased to the user.
  • In one embodiment, the media presentation device or rendering engine 406 is integrated with the content access device 402. For example, the content access device 402 may be a data-enabled mobile telephone capable of rendering content on the display screen of the telephone.
  • FIG. 5 is a diagrammatic representation of a further embodiment, in which the content access device 402 supports a content search engine. Referring to FIG. 5, the content access device 402 is linked to an Internet access port 504 via the network interface and a wired communication link 506 or a wireless communication link 508. In the figure, the region of the system above the line 510 and designated as the ‘CLOUD’ is remote from the user and is accessed via the Internet access port 504.
  • The content access device 402 supports a web browser 502 that enables a user to search the Internet for content by sending queries along path 512 to a search engine 514. In turn, the search engine 514 may query content providers 302 to discover available content. The search engine reports results back along path 512 to the web browser.
  • The user may then request content to be accessed from the content providers 302 via path 304. The content providers then verify the user's rights using rights servers 516 and, if the rights are verified, provide the content to the user via path 304.
  • If the user does not have rights to the content, the transaction action is unsuccessful, and resources are used unnecessarily.
  • In accordance with an embodiment of the invention, the content access device 402 maintains a list or catalog of the DRM systems supported by the content access device. This catalog is supplied to the search engine 514. This enables the search engine to match the DRM systems of available content with the DRM systems supported by the content access device and only results that are compatible with the content access device are returned to the content access device 402.
  • In accordance with a further embodiment of the invention, the search engine 514 returns all results of the query, together with the DRM requirements, and the content access device 402 sorts the results dependent upon the available DRM components. For example, the user may select to show only results that match available DRM components. Alternatively, the results displayed to the user may be formatted according to whether DRM components are available or not.
  • Thus, the content access device is configured to determine if the DRM system associated with any particular content is supported. The content access device can interact with a search engine to either (1) instruct the search engine to only search for content that can be rendered, or (2) filter the results of a search to only display content that can be rendered to the user. Both of these approaches may be implemented by the content access device building a catalog of supported DRM systems.
  • The code snipped below illustrates how a simple DRM catalog may be created in the content access device. In this example a flag, denoted by the variable is_supported, is set for all DRMs supported.
  • typedef struct DRM
    {
    // DRM_Function is a pointer to perform DRM operations,
    // is_supported determines if this DRM is available
    int (* DRM_Function)( ), is_supported;
    } DRM;
    int // 3 chosen for just for illustration
    MAX_DRMS_SUPPORTED=3;
    int main (int argc, int *argv[ ])
    {
    DRM drm_catalog[3]; // Populated with pointers to the DRMs
    // supported on this rendering engine
    DRM_TYPE=read_IP_STREAM // reads DRM for the
    type (IP_STREAM); //content in IP_STREAM
    for (int i=0; i<MAX_DRMS_SUPPORTED; i++)
    {
    if (DRM_TYPE==drm_catalog[i].is_supported)
    { // execute this particular DRM for this particular
    // content to render it
    drm_catalog[i].DRM_Function( );
    }
    else continue; // try next DRM or quit if we have tried
    //all known DRMs
    }
    return 0;
    }
  • FIG. 6 is a flow chart 600 of a method for accessing protected content in content access device that supports a plurality of DRM systems. Following start block 602 in FIG. 6, the content access device receives user input via a web browser or other user interface at block 604. At block 606 the device gets a list or catalog of DRM systems that are supported by the device. If this list does not exist, the list maybe created, as described above. In one embodiment, the content access device supplies a copy of the list to a search engine at block 608. In a further embodiment, the list is maintained in the content access device. At block 610, the content access device queries a search engine, dependent upon the user input, to discover available content. The search engine responds with a list of references to the available content. At block 612, the content access devices presents the list of references to the available content to the user, dependent upon whether the content is protected by a DRM system supported by the content access device.
  • The provision of a catalog of supported DRM systems to the search engine enables the search engine to determine which content is protected by a DRM system supported by the content access device.
  • In one embodiment, the list of references of available content is filtered to remove references to content that is protected by a DRM system that is not supported by the content access device.
  • In a further embodiment, the list of references to available content presented to the user is formatted to distinguish between content that is protected by a DRM system that is supported by the content access device and content that is protected by a DRM system that is not supported by the content access device. For example, non-supported content may be marked or shown in a different font or color, or the list may be ordered to show content with supported DRM systems first.
  • At block 614, the content access device requests selected content from a content provider in accordance with a content reference selected by the user. At block 616, the content access device receives a data stream carrying the content from the content provider. At block 618 the selected content is extracted from the data stream using a DRM system of the plurality of DRM systems. Finally, at block 620, the extracted content is presented to the user. In this manner, the content access device has enabled a user to select content efficiently and to access the selected content.
  • In the foregoing specification, specific embodiments of the present invention have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the present invention as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of the present invention. The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims. The invention is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.

Claims (18)

1. A content access device for recovering a content signal from media stream protected by a digital rights management (DRM) system, the content access device comprising:
a network interface configured to receive the protected media stream from a remote content provider via a network;
a plurality of distinct DRM components corresponding to a plurality of DRM systems supported by the content access device; and
a content extraction unit operable to select a DRM component of the plurality of DRM components and execute the selected DRM component to recover the content signal from the protected media stream.
2. A content access device in accordance with claim 1, further comprising a media presentation device operable to receive the content signal and render content in accordance with the content signal.
3. A content access device in accordance with claim 1, wherein the network comprises the Internet and wherein the content access device further comprising a web browser operable to query a search engine via the Internet.
4. A content access device in accordance with claim 3, wherein the content access device is configured to provide a list of supported DRM systems to the search engine to enable the search engine to return results to the content access device that are dependent upon the list of supported DRM systems.
5. A content access device in accordance with claim 3, wherein the content access device is operable to present the results returned from the search engine to the user in a format that is dependent upon the list of supported DRM systems.
6. A content access device in accordance with claim 3, wherein the content access device is operable to filter the results returned from the search engine to remove results relating to content protected by a DRM system that is not supported by the content access device.
7. A content access device in accordance with claim 1, configured to select the DRM component dependent upon information carried in the protected media stream.
8. A method for a content access device that supports a plurality of DRM systems to access protected content in a media stream, the method comprising:
receiving user input via a user interface;
querying a search engine dependent upon the user input to discover available content; and
presenting a list of references to available content to the user, dependent upon whether the content is protected by a DRM system supported by the content access device.
9. A method in accordance with claim 8, further comprising:
providing a catalog of supported DRM systems to the search engine to enable the search engine to determine if content is protected by a DRM system supported by the content access device.
10. A method in accordance with claim 8, further comprising:
filtering the list of references of available content to remove references to content that is protected by a DRM system that is not supported by the content access device.
11. A method in accordance with claim 8, further comprising:
formatting the list of references to available content presented to the user so as to distinguish between content that is protected by a DRM system that is supported by the content access device and content that is protected by a DRM system that is not supported by the content access device
12. A method in accordance with claim 8, further comprising:
selecting a content reference, from the list of references to available content presented to the user, dependent upon user input;
requesting the selected content from a content provider in accordance with the reference to the selected content; and
receiving a data stream carrying the selected content from the content provider; and
extracting the selected content from the data stream using a DRM system of the plurality of DRM systems.
13. A method in accordance with claim 12, wherein extracting the selected content from the data stream using a DRM system of the plurality of DRM systems comprises interacting with the content provider over a network.
14. A method in accordance with claim 12, further comprising presenting the selected content to the user.
15. A method in accordance with claim 8, wherein the user interface comprises a web browser.
16. A computer readable medium containing program instructions that, when executed on a programmable electronic device, provide a user with access to protected content in a data stream by enabling the device to:
support a plurality of DRM systems;
receive user input;
query a search engine dependent upon the user input to discover available content; and
present a list of references to available content to the user, dependent upon whether the content is protected by a supported DRM system.
17. A computer readable medium in accordance with claim 16, wherein the program instructions further enable the device to:
provide a catalog of supported DRM systems to the search engine to enable the search engine to determine if content is protected by a DRM system supported by the content access device.
18. A computer readable medium in accordance with claim 16, wherein the program instructions further enable the device to:
select a content reference from the list of references to available content presented to the user dependent upon user input;
request the selected content from a content provider in accordance with the content reference; and
receive a data stream carrying the content from the content provider; and
extract the selected content from the data stream using a DRM system of the plurality of DRM systems.
US13/109,154 2010-12-21 2011-05-17 Method and apparatus for accessing content protected media streams Active 2031-11-28 US8510851B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/109,154 US8510851B2 (en) 2010-12-21 2011-05-17 Method and apparatus for accessing content protected media streams
US13/915,708 US20130276139A1 (en) 2010-12-21 2013-06-12 Method and apparatus for accessing content protected media streams

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201061425450P 2010-12-21 2010-12-21
US13/109,154 US8510851B2 (en) 2010-12-21 2011-05-17 Method and apparatus for accessing content protected media streams

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/915,708 Continuation US20130276139A1 (en) 2010-12-21 2013-06-12 Method and apparatus for accessing content protected media streams

Publications (2)

Publication Number Publication Date
US20120159638A1 true US20120159638A1 (en) 2012-06-21
US8510851B2 US8510851B2 (en) 2013-08-13

Family

ID=46236345

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/109,154 Active 2031-11-28 US8510851B2 (en) 2010-12-21 2011-05-17 Method and apparatus for accessing content protected media streams
US13/915,708 Abandoned US20130276139A1 (en) 2010-12-21 2013-06-12 Method and apparatus for accessing content protected media streams

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/915,708 Abandoned US20130276139A1 (en) 2010-12-21 2013-06-12 Method and apparatus for accessing content protected media streams

Country Status (1)

Country Link
US (2) US8510851B2 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140297632A1 (en) * 2010-12-22 2014-10-02 Avinash Sridhar Realtime search grid updates
US9032547B1 (en) * 2012-10-26 2015-05-12 Sprint Communication Company L.P. Provisioning vehicle based digital rights management for media delivered via phone
US9031498B1 (en) 2011-04-26 2015-05-12 Sprint Communications Company L.P. Automotive multi-generation connectivity
US9110774B1 (en) 2013-03-15 2015-08-18 Sprint Communications Company L.P. System and method of utilizing driving profiles via a mobile device
US9173238B1 (en) 2013-02-15 2015-10-27 Sprint Communications Company L.P. Dual path in-vehicle communication
US9252951B1 (en) 2014-06-13 2016-02-02 Sprint Communications Company L.P. Vehicle key function control from a mobile phone based on radio frequency link from phone to vehicle
US9398454B1 (en) 2012-04-24 2016-07-19 Sprint Communications Company L.P. In-car head unit wireless communication service subscription initialization
US9439240B1 (en) 2011-08-26 2016-09-06 Sprint Communications Company L.P. Mobile communication system identity pairing
US9444892B1 (en) 2015-05-05 2016-09-13 Sprint Communications Company L.P. Network event management support for vehicle wireless communication
US9591482B1 (en) 2014-10-31 2017-03-07 Sprint Communications Company L.P. Method for authenticating driver for registration of in-vehicle telematics unit
US9604651B1 (en) 2015-08-05 2017-03-28 Sprint Communications Company L.P. Vehicle telematics unit communication authorization and authentication and communication service provisioning
US9649999B1 (en) 2015-04-28 2017-05-16 Sprint Communications Company L.P. Vehicle remote operations control
US10489132B1 (en) 2013-09-23 2019-11-26 Sprint Communications Company L.P. Authenticating mobile device for on board diagnostic system access
EP3669546A4 (en) * 2017-08-17 2021-04-07 Sony Corporation Transport and acquisition of drm-related information
US20210226997A1 (en) * 2015-11-20 2021-07-22 Nasdaq, Inc. Systems and Methods for In-Session Refresh of Entitlements Associated with Web Applications

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040054920A1 (en) * 2002-08-30 2004-03-18 Wilson Mei L. Live digital rights management
US20050086501A1 (en) * 2002-01-12 2005-04-21 Je-Hak Woo Method and system for the information protection of digital content
US20080126801A1 (en) * 2006-11-29 2008-05-29 Samsung Electronics Co., Ltd Method and apparatus for generating proxy-signature on right object and issuing proxy signature certificate
US20080216177A1 (en) * 2005-02-28 2008-09-04 Junichi Yokosato Contents Distribution System
US20080289044A1 (en) * 2007-05-18 2008-11-20 Samsung Electronics Co., Ltd Apparatus, system, and method for storing DRM licenses
US20090113536A1 (en) * 2005-06-23 2009-04-30 Joseph J. Laks Thomson Licensing Llc Digital Rights Management (DRM) Enabled Portable Playback Device, Method and System
US20090210698A1 (en) * 2006-03-01 2009-08-20 Candelore Brant L Multiple DRM management
US20100333209A1 (en) * 2009-06-30 2010-12-30 Nokia Corporation Method, apparatus and computer program product for providing protected content to one or more devices by reacquiring the content from a service
US7966638B2 (en) * 2007-03-30 2011-06-21 Google Inc. Interactive media display across devices

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001050225A2 (en) * 1999-12-30 2001-07-12 Nextaudio, Inc. System and method for multimedia content composition and distribution
US20040133632A1 (en) * 2003-01-08 2004-07-08 Thomas Messerges Method and apparatus for supporting multiple digital-rights management systems
US20080120675A1 (en) * 2006-11-22 2008-05-22 Horizon Semiconductors Ltd. Home gateway for multiple units
WO2009028137A1 (en) * 2007-08-28 2009-03-05 Panasonic Corporation Key terminal apparatus, lsi for encryption process, unique key producing method, and content system
KR20100047435A (en) * 2008-10-29 2010-05-10 삼성전자주식회사 Apparatus and method for manage of contents in a portable device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050086501A1 (en) * 2002-01-12 2005-04-21 Je-Hak Woo Method and system for the information protection of digital content
US20040054920A1 (en) * 2002-08-30 2004-03-18 Wilson Mei L. Live digital rights management
US20080216177A1 (en) * 2005-02-28 2008-09-04 Junichi Yokosato Contents Distribution System
US20090113536A1 (en) * 2005-06-23 2009-04-30 Joseph J. Laks Thomson Licensing Llc Digital Rights Management (DRM) Enabled Portable Playback Device, Method and System
US20090210698A1 (en) * 2006-03-01 2009-08-20 Candelore Brant L Multiple DRM management
US20080126801A1 (en) * 2006-11-29 2008-05-29 Samsung Electronics Co., Ltd Method and apparatus for generating proxy-signature on right object and issuing proxy signature certificate
US7966638B2 (en) * 2007-03-30 2011-06-21 Google Inc. Interactive media display across devices
US20080289044A1 (en) * 2007-05-18 2008-11-20 Samsung Electronics Co., Ltd Apparatus, system, and method for storing DRM licenses
US20100333209A1 (en) * 2009-06-30 2010-12-30 Nokia Corporation Method, apparatus and computer program product for providing protected content to one or more devices by reacquiring the content from a service

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140297632A1 (en) * 2010-12-22 2014-10-02 Avinash Sridhar Realtime search grid updates
US9031498B1 (en) 2011-04-26 2015-05-12 Sprint Communications Company L.P. Automotive multi-generation connectivity
US9439240B1 (en) 2011-08-26 2016-09-06 Sprint Communications Company L.P. Mobile communication system identity pairing
US9398454B1 (en) 2012-04-24 2016-07-19 Sprint Communications Company L.P. In-car head unit wireless communication service subscription initialization
US9032547B1 (en) * 2012-10-26 2015-05-12 Sprint Communication Company L.P. Provisioning vehicle based digital rights management for media delivered via phone
US9173238B1 (en) 2013-02-15 2015-10-27 Sprint Communications Company L.P. Dual path in-vehicle communication
US9110774B1 (en) 2013-03-15 2015-08-18 Sprint Communications Company L.P. System and method of utilizing driving profiles via a mobile device
US10489132B1 (en) 2013-09-23 2019-11-26 Sprint Communications Company L.P. Authenticating mobile device for on board diagnostic system access
US9252951B1 (en) 2014-06-13 2016-02-02 Sprint Communications Company L.P. Vehicle key function control from a mobile phone based on radio frequency link from phone to vehicle
US9591482B1 (en) 2014-10-31 2017-03-07 Sprint Communications Company L.P. Method for authenticating driver for registration of in-vehicle telematics unit
US9649999B1 (en) 2015-04-28 2017-05-16 Sprint Communications Company L.P. Vehicle remote operations control
US9444892B1 (en) 2015-05-05 2016-09-13 Sprint Communications Company L.P. Network event management support for vehicle wireless communication
US9604651B1 (en) 2015-08-05 2017-03-28 Sprint Communications Company L.P. Vehicle telematics unit communication authorization and authentication and communication service provisioning
US20210226997A1 (en) * 2015-11-20 2021-07-22 Nasdaq, Inc. Systems and Methods for In-Session Refresh of Entitlements Associated with Web Applications
US11856028B2 (en) * 2015-11-20 2023-12-26 Nasdaq, Inc. Systems and methods for in-session refresh of entitlements associated with web applications
EP3669546A4 (en) * 2017-08-17 2021-04-07 Sony Corporation Transport and acquisition of drm-related information
US11336937B2 (en) 2017-08-17 2022-05-17 Saturn Licensing Llc Transport and acquisition of DRM-related information

Also Published As

Publication number Publication date
US8510851B2 (en) 2013-08-13
US20130276139A1 (en) 2013-10-17

Similar Documents

Publication Publication Date Title
US8510851B2 (en) Method and apparatus for accessing content protected media streams
US11336624B2 (en) Methods and apparatus to distribute media content
US8392959B2 (en) Portable media asset
US8955020B2 (en) Transcoding and data rights management in a mobile video network with STB as a hub
JP4598616B2 (en) Streaming media player
EP2382781B1 (en) Systems and methods for providing a license for media content over a network
US20080019516A1 (en) Enforced delay of access to digital content
US11490161B2 (en) Content rights management for mobile devices
EP2925007B1 (en) Information processing device and information processing method
CN107077543B (en) Ownership identification, signaling and processing of content components in streaming media
US9178930B2 (en) Content receiving device, and content distribution system
US20080320533A1 (en) Content Download System and Method, Content Providing Apparatus and Method, Content Receiving Apparatus and Method, and Program Therefor
US10430868B2 (en) Content purchases and rights storage and entitlements
JP4321340B2 (en) Playback device
JP4303085B2 (en) Content provision service system
JP2011030218A (en) Processing recordable content in stream
US20130191926A1 (en) Method and Apparatus for Streaming Rights-Managed Content Directly to a Target Device over a Network
US11166081B2 (en) Content rights management for mobile devices
KR20190123191A (en) Method and program for providing a contents streaming service and managing user data statistics using qr code
EP2146481A2 (en) IP Streaming copy control method and system
CN103002322A (en) Method and device for providing relevant information of non-authorized content for subscribers
CN100589096C (en) Apparatus and method for managing unprotected and protected content in private networks
KR20120054898A (en) Method for home service of digital cinema contents using peer to peer communication, and apparatus for the same
JP2009055126A (en) Content distribution system, distribution server, receiving terminal and computer program
WO2008024084A1 (en) A system and method for recording television and/or radio programmes via the internet

Legal Events

Date Code Title Description
AS Assignment

Owner name: STMICROELECTRONICS, INC., TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MCDADE, SR., DARRYN D.;REEL/FRAME:026359/0522

Effective date: 20110515

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8