EP2218037A4 - System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity - Google Patents

System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity

Info

Publication number
EP2218037A4
EP2218037A4 EP08857570.9A EP08857570A EP2218037A4 EP 2218037 A4 EP2218037 A4 EP 2218037A4 EP 08857570 A EP08857570 A EP 08857570A EP 2218037 A4 EP2218037 A4 EP 2218037A4
Authority
EP
European Patent Office
Prior art keywords
size based
tile size
compressing video
scene complexity
intraframe motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP08857570.9A
Other languages
German (de)
French (fr)
Other versions
EP2218037A1 (en
Inventor
Der Laan Roger Van
Stephen G Perlman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OL2 Inc
Original Assignee
OnLive Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by OnLive Inc filed Critical OnLive Inc
Publication of EP2218037A1 publication Critical patent/EP2218037A1/en
Publication of EP2218037A4 publication Critical patent/EP2218037A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
EP08857570.9A 2007-12-05 2008-12-04 System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity Withdrawn EP2218037A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US99965707A 2007-12-05 2007-12-05
PCT/US2008/085600 WO2009073825A1 (en) 2007-12-05 2008-12-04 System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity

Publications (2)

Publication Number Publication Date
EP2218037A1 EP2218037A1 (en) 2010-08-18
EP2218037A4 true EP2218037A4 (en) 2013-06-05

Family

ID=40718183

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08857570.9A Withdrawn EP2218037A4 (en) 2007-12-05 2008-12-04 System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity

Country Status (10)

Country Link
EP (1) EP2218037A4 (en)
JP (1) JP2011507346A (en)
KR (1) KR20100112567A (en)
CN (1) CN101918956A (en)
AU (1) AU2008333827A1 (en)
CA (1) CA2707715A1 (en)
NZ (1) NZ585904A (en)
RU (1) RU2487407C2 (en)
TW (2) TW200935916A (en)
WO (1) WO2009073825A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8888592B1 (en) 2009-06-01 2014-11-18 Sony Computer Entertainment America Llc Voice overlay
US8968087B1 (en) 2009-06-01 2015-03-03 Sony Computer Entertainment America Llc Video game overlay
US8147339B1 (en) 2007-12-15 2012-04-03 Gaikai Inc. Systems and methods of serving game video
US8613673B2 (en) 2008-12-15 2013-12-24 Sony Computer Entertainment America Llc Intelligent game loading
US8926435B2 (en) 2008-12-15 2015-01-06 Sony Computer Entertainment America Llc Dual-mode program execution
US8506402B2 (en) 2009-06-01 2013-08-13 Sony Computer Entertainment America Llc Game execution environments
US8771064B2 (en) 2010-05-26 2014-07-08 Aristocrat Technologies Australia Pty Limited Gaming system and a method of gaming
US8676591B1 (en) 2010-08-02 2014-03-18 Sony Computer Entertainment America Llc Audio deceleration
KR102288072B1 (en) 2010-09-13 2021-08-10 소니 인터랙티브 엔터테인먼트 아메리카 엘엘씨 Add-on Management
KR20170129967A (en) 2010-09-13 2017-11-27 소니 인터랙티브 엔터테인먼트 아메리카 엘엘씨 A method of transferring a game session, over a communication network, between clients on a computer game system including a game server
US20210271364A1 (en) * 2011-01-26 2021-09-02 Benjamin Firooz Ghassabian Data entry systems
CN104835187B (en) * 2015-05-19 2020-04-03 北京三六三教育科技股份有限公司 Animation editor and editing method thereof
US11640626B2 (en) 2017-11-03 2023-05-02 Universal City Studios Llc Queue monitoring techniques
WO2019245003A1 (en) * 2018-06-22 2019-12-26 ミントフラッグ株式会社 Game system, game system control method, and game program
CN109743628A (en) * 2019-01-10 2019-05-10 四川长虹电器股份有限公司 A kind of method that IP set-top box promotes video on live smoothness
CN110996057B (en) * 2019-12-02 2021-11-16 腾讯云计算(北京)有限责任公司 Media data processing method and device, computer equipment and storage medium
CN111669589B (en) * 2020-06-23 2021-03-16 腾讯科技(深圳)有限公司 Image encoding method, image encoding device, computer device, and storage medium
CN112104867B (en) * 2020-11-09 2021-03-02 腾讯科技(深圳)有限公司 Video processing method, video processing device, intelligent equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997033402A1 (en) * 1996-03-04 1997-09-12 Ericsson Inc. Digital communication system for adapting communications protocol based on a current communication channel condition
EP1098444A1 (en) * 1998-07-17 2001-05-09 Kabushiki Kaisha Kenwood Bs digital broadcasting receiver
US20020054578A1 (en) * 2000-07-13 2002-05-09 Qian Zhang Channel and quality of service adaptation for multimedia over wireless networks
WO2003009590A1 (en) * 2001-07-19 2003-01-30 Thomson Licensing S.A. Fade resistant digital transmission and reception system
WO2006100664A2 (en) * 2005-03-21 2006-09-28 Yosef Mizrahi Method, system and computer-readable code for providing a computer gaming service
EP1768346A1 (en) * 2005-09-23 2007-03-28 Microsoft Corporation Provision of game applications across a network according to the display characteristics of a user terminal

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5608458A (en) * 1994-10-13 1997-03-04 Lucent Technologies Inc. Method and apparatus for a region-based approach to coding a sequence of video images
JP3439361B2 (en) * 1999-02-04 2003-08-25 日本電気株式会社 Image encoding device and moving image transmission system
US6711283B1 (en) * 2000-05-03 2004-03-23 Aperio Technologies, Inc. Fully automatic rapid microscope slide scanner
CA2669171C (en) * 2001-09-26 2012-05-01 Interact Devices System and method for communicating media signals
US7027081B2 (en) * 2003-12-21 2006-04-11 Kremen Stanley H System and apparatus for recording, transmitting, and projecting digital three-dimensional images
JP4649615B2 (en) * 2006-02-16 2011-03-16 国立大学法人三重大学 Video encoding / decoding device, video encoding / decoding method, and program thereof
WO2007119236A2 (en) * 2006-04-13 2007-10-25 Yosef Mizrachi Method and apparatus for providing gaming services and for handling video content

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997033402A1 (en) * 1996-03-04 1997-09-12 Ericsson Inc. Digital communication system for adapting communications protocol based on a current communication channel condition
EP1098444A1 (en) * 1998-07-17 2001-05-09 Kabushiki Kaisha Kenwood Bs digital broadcasting receiver
US20020054578A1 (en) * 2000-07-13 2002-05-09 Qian Zhang Channel and quality of service adaptation for multimedia over wireless networks
WO2003009590A1 (en) * 2001-07-19 2003-01-30 Thomson Licensing S.A. Fade resistant digital transmission and reception system
WO2006100664A2 (en) * 2005-03-21 2006-09-28 Yosef Mizrahi Method, system and computer-readable code for providing a computer gaming service
EP1768346A1 (en) * 2005-09-23 2007-03-28 Microsoft Corporation Provision of game applications across a network according to the display characteristics of a user terminal

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
HEINZELMAN W R ET AL: "Unequal error protection of MPEG-4 compressed video", IMAGE PROCESSING, 1999. ICIP 99. PROCEEDINGS. 1999 INTERNATIONAL CONFERENCE ON - KOBE, JAPAN 24-28 OCT. 1999, IEEE, PISCATAWAY, NJ, USA, vol. 2, 24 October 1999 (1999-10-24), pages 530 - 534, XP010369005, ISBN: 978-0-7803-5467-8, DOI: 10.1109/ICIP.1999.822952 *
JARVINEN S ET AL: "QoS-Aware real-time video encoding How to Improve the User Experience of a Gaming-on-Demand Service", CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, 2006. CCNC 2006. 20 06 3RD IEEE LAS VEGAS, NV, USA 8-10 JAN. 2006, PISCATAWAY, NJ, USA,IEEE, vol. 2, 8 January 2006 (2006-01-08), pages 994 - 997, XP010893324, ISBN: 978-1-4244-0085-0, DOI: 10.1109/CCNC.2006.1593187 *
JIN XU ET AL: "Joint Adaptive Intra Refreshment and Unequally Error Protection Algorithms for Robust Transmission of H.264/AVC Video", 2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2006), TORONTO, ONT., CANADA, IEEE, PISCATAWAY, NJ, USA, 1 July 2006 (2006-07-01), pages 693 - 696, XP031032930, ISBN: 978-1-4244-0366-0 *
MARKUS FIDLER ET AL: "Efficient Smoothing of Robust VBR Video Traffic by Explicit Slice-based Mode Type Selection", CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, 2007. CCNC 2007. 20 07 4TH IEEE, IEEE, PI, 1 January 2007 (2007-01-01), pages 880 - 884, XP031087909, ISBN: 978-1-4244-0667-8 *
See also references of WO2009073825A1 *
YAO WANG ET AL: "Error Control and Concealment for Video Communication: A Review", PROCEEDINGS OF THE IEEE, IEEE. NEW YORK, US, vol. 86, no. 5, 1 May 1998 (1998-05-01), XP011044024, ISSN: 0018-9219 *

Also Published As

Publication number Publication date
AU2008333827A1 (en) 2009-06-11
NZ585904A (en) 2013-06-28
KR20100112567A (en) 2010-10-19
TW200935916A (en) 2009-08-16
WO2009073825A1 (en) 2009-06-11
TW200952496A (en) 2009-12-16
EP2218037A1 (en) 2010-08-18
JP2011507346A (en) 2011-03-03
CA2707715A1 (en) 2009-06-11
RU2010127314A (en) 2012-01-10
RU2487407C2 (en) 2013-07-10
CN101918956A (en) 2010-12-15

Similar Documents

Publication Publication Date Title
EP2218037A4 (en) System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity
EP2218039A4 (en) System and method for compressing video based on detected intraframe motion
HK1149810A1 (en) System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity
EP2289049A4 (en) Systems, methods and devices for motion capture using video imaging
EP2290969A4 (en) Telepresence system, method and video capture device
GB201001246D0 (en) Video conferencing system and method
EP2227903A4 (en) System and method for compressing streaming interactive video
TWI372564B (en) Video system, image emission apparatus, video receiver apparatus and control method
GB2463621B (en) Video conferencing system
IL215309A0 (en) System and method for compressing video frames or portions thereof based on feedback information from a client device
HK1127836A1 (en) Video switcher and video switching method
GB2463213B (en) Video Monitoring system and method
HK1149826A1 (en) Tile-based system and method for compressing video
WO2008081458A3 (en) Compressing high resolution images as a low resolution video
HK1190527A1 (en) System and method for synchronizing compression histories
IL210658A0 (en) Video processing and telepresence system and method
EP2418847A4 (en) Image-based video conference control method, terminal and system
EP2168078A4 (en) Apparatus and method employing pre-atr-based real-time compression and video frame segmentation
GB0712879D0 (en) Video communication system and method
IL215305A0 (en) System and method for multi-stream video compression
GB2455837B (en) Visual surveilliance camera and method based on cooperation between cameras
EP2149811A4 (en) Three-dimensional video image projecting device and three-dimensional video image projecting method
HK1134385A1 (en) System and method for implementing low-complexity multi-view video coding
GB0717473D0 (en) Video processing system and method
EP2148468A4 (en) Method, equipment and system for realizing video live broadcast

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100602

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20130508

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/2343 20110101ALI20130502BHEP

Ipc: H04N 7/26 20060101ALI20130502BHEP

Ipc: H04N 21/6587 20110101ALI20130502BHEP

Ipc: H04N 21/2383 20110101ALI20130502BHEP

Ipc: H04N 21/478 20110101AFI20130502BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: OL2, INC.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20131207