WO1991005312A1 - Artificial neural computer based interactive movie production system - Google Patents
Artificial neural computer based interactive movie production system Download PDFInfo
- Publication number
- WO1991005312A1 WO1991005312A1 PCT/AU1990/000457 AU9000457W WO9105312A1 WO 1991005312 A1 WO1991005312 A1 WO 1991005312A1 AU 9000457 W AU9000457 W AU 9000457W WO 9105312 A1 WO9105312 A1 WO 9105312A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- human
- computer
- movie
- neural
- actor
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
Definitions
- This invention relates to an artificial neural computer based interactive movie production system for producing cartoons, feature films and educational films and videos, said system 5 consisting of real time graphics recording and display modules, an artificial neural computer, scene storage module, character storage module, language storage module, music storage module, sound . effects storage module, special effects storage module, module output multiplexing control unit, high resolution electronic ⁇ o cameras and a high definition real time vision monitor.
- Prior art computer based movie production systems have utilised expert system computers which have had to be programmed to carry out each detailed step of the film making process, 5 demanding expert systems of enormous capacity, such as multiple units of the well known Cray Computers, to produce even the simplest format movies of relatively short duration.
- expert computer based movie production systems could not generalise the recorded data so that o it was not possible to accurately duplicate human and animal behaviour in real time so essential for realistic, computer based movie making.
- these prior art computer based movie production systems required a large amount of specific information and could not effectively compete with the more conventional movie making techniques developed over the past century, where the generalisation was provided by actors and directors, the computer bottle neck being the lack of real time image processing ability of these prior art systems.
- our invention overcomes the serious defects of the prior art movie making systems, in particular, expert system computer aided movie making systems, by adapting the unique capabilities of artificial neural computers to match stored and real time image processed data so as to produce a movie by real time interaction with the movie maker, leading to drastic reduction in the cost of making movies arising from the fact that the artificial neural computer can generalise the stored and real time data to fully optimise the movie being made without the need for any particular qualifications from the characters involved, their backdrops, special effects, musical scores, speech or movements.
- the invention is quite capable of producing a full length feature film without any movie stars, expensive location shots or language limitations, all that is required is for the invention to be fed with key instructions and real time interactive tuning to produce an optimum movie output.
- our invention is not linked to cartoons but is capable of being used to produce movies with images of real people irrespective of whether they are present or not, all that is required being that the characters' images are stored within the invention so 5 that the neural computer has real time access to them, together with either their own voice and movement styles or can generate such voice and movement styles that best fit the said images.
- the invention can produce a movie starring a long dead actor or actress with current actors.
- the invention is also able to convert old black and white movies into colour movies or a two dimensional movie into a three dimensional format because the neural computer is able to generalise from one form to another once it has been taught the basic processes of converting a two dimensional object into its three dimensional format.
- the means of projecting the true three dimensional formats so generated are beyond the scope of the invention although the three dimensional formats displayed on two dimensional screens are within the capabilities of the invention.
- Another object of the invention is to provide a real time interaction between the output of the human graphic artist and the neural network computer system.
- Another object of the invention is to provide a means of scanning a black and white movie, frame by frame, then automatically optimising the colouring of each frame, thus converting a black and white movie into a colour movie in real time.
- FIG. 1 A schematic layout of the invention is given in Figure 1 , showing the way in which the movie maker can interact in real time with the artificial neural computer based movie production system 5 to optimise the movie production process.
- numeral 1 indicates a drafting board on which is sketched the appropriate images indicated by numeral 2 by the movie maker whose eye, the vision input, in indicated by numeral 3.
- ⁇ o indicates an electronic camera which records the images 2 in real me and transfers the data to the artificial neural computer indicated by numeral 5.
- Numeral 6 indicates the control unit of the invention which selects the tasks to be undertaken by artificial neural computer 5, the resulting real time images being
- Numeral 8 indicates a data storage module for storing a range of selected musical scores.
- Numeral 9 indicates a data storage module for storing a range of selected special effects associated with movie making.
- Numeral 10 indicates a data storage module for
- Numeral 11 indicates a data storage module for storage of backdrops for movie making.
- Numeral 12 indicates links to outside data storage facilities which can be assessed by the invention if its own data modules prove to be inadequate for particular tasks demanded by
- numeral 13 indicates the module where hard film copies of the movie are produced for distribution as indicated by numeral 14.
- Numeral 15 indicates the module where video copies of the movie are produced for distribution as indicated by numeral 16.
- Numeral 17 indicates the module for printing out details of all the copyright material used by the invention in producing a particular movie.
- the invention is used to produce a movie with a script presented to the operator 3, who places appropriate instructions ⁇ o via images 2 and the control unit 6 to select rhe appropriate outputs from modules 8, 9, 10 and 11.
- the artificial neural computer 5 then combines and blends all of these inputs into an output which is displayed on screen 7 in real time so that the resulting movie can be optimised by the operator 3 in real time to 5 produce the finished product.
- the operator 3 either draws a rough sketch of the required character on 2 and selects the range of appropriate data stored in modules 8, 9, 10 and 11.
- Computer 5 then blends these 0 data packs together, displaying the result on screen 7 in a manner than can be optimsed in real time by operator 3.
- hard copies are made in modules 13 and 15 and the copyright list is produced in module 17.
- the invention can produce movies using live actors, images of 5 actors, cartoon characters, real scenery or images of scenery. The movements of the characters matched to the selected language. Alternatively, the same movie can be produced with actors of any nationality speaking their native language dispensing completely with the need for subtitles.
- the invention has application in the production of cartoons, feature films and educational films. It should also be noted that
- the invention is able to match production characters to blank profiles already in a movie. For example, if a couple were contemplating a divorce, their own images could be superimposed on existing blank images in an appropraite film so that they could be counselled whilst looking at their own reactions in specified ⁇ o situations.
- the invention is also capable of producing a cartoon, feature film or educational film or video from only a set of instructions, producing the required movie from stored information only.
Abstract
This invention relates to a movie production system comprising a panel (1) onto which is positioned drawing material (2) which allows a human (3) to interact via a vision system (4) with a neural computer (5) which has a control module (6). The initial image drawn on (2) by the human (3) is generalised by the neural computer (5) and the result displayed on monitor (7). Data is stored in units (8, 9, 10, 11, 13 and 15) which allows for a complete movie frame to be assembled on monitor (7) via the interactions between the human (3) and the neural network computer (5). Links (12, 14 and 16) connect the units of the invention to remotely sited data storage and data display units. The invention has application in the production of cartoons and feature movies.
Description
Artificial Neural Computer Based Interactive Movie Production
System
Field of the Invention
This invention relates to an artificial neural computer based interactive movie production system for producing cartoons, feature films and educational films and videos, said system 5 consisting of real time graphics recording and display modules, an artificial neural computer, scene storage module, character storage module, language storage module, music storage module, sound . effects storage module, special effects storage module, module output multiplexing control unit, high resolution electronic ι o cameras and a high definition real time vision monitor.
Summary of the Prior Art
Prior art computer based movie production systems have utilised expert system computers which have had to be programmed to carry out each detailed step of the film making process, 5 demanding expert systems of enormous capacity, such as multiple units of the well known Cray Computers, to produce even the simplest format movies of relatively short duration. Such were the serious limitations of prior art, expert computer based movie production systems could not generalise the recorded data so that o it was not possible to accurately duplicate human and animal behaviour in real time so essential for realistic, computer based movie making. Furthermore, these prior art computer based movie production systems required a large amount of specific information and could not effectively compete with the more conventional
movie making techniques developed over the past century, where the generalisation was provided by actors and directors, the computer bottle neck being the lack of real time image processing ability of these prior art systems. Our invention overcomes the serious defects of the prior art movie making systems, in particular, expert system computer aided movie making systems, by adapting the unique capabilities of artificial neural computers to match stored and real time image processed data so as to produce a movie by real time interaction with the movie maker, leading to drastic reduction in the cost of making movies arising from the fact that the artificial neural computer can generalise the stored and real time data to fully optimise the movie being made without the need for any particular qualifications from the characters involved, their backdrops, special effects, musical scores, speech or movements. In fact, the invention is quite capable of producing a full length feature film without any movie stars, expensive location shots or language limitations, all that is required is for the invention to be fed with key instructions and real time interactive tuning to produce an optimum movie output.
Background of the Invention
A need for an interactive movie production system can be clearly seen when one considers the art of cartoon film making as developed over the past seventy years or more. Prior art cartoon films had to be drawn by hand, frame by frame, and it could take over one million drawings over many years of intensive effort to
produce a quality cartoon film of the quality produced by pioneers such as Walt Disney Studios. Over recent years, computer generated cartoons have also been produced where the characters are expressionless and only minor movements, such as lip
5 movements and jerking walks have been within the scope of the software controlled computers used.
To date, only about fifteen percent of quality cartoons are generated using software controlled computers to generate and change the background scenes. All foreground scenes involving
10 expressionable characters have to be laboriously hand drawn in quality cartoons.
The advent of neural computers has changed the whole approach to movie making in that the present invention eliminates the need for software to computer generate the cartoon character i s because the neural computer is simply taught to interact in real time to produce the required character and to fill in the appropriate background scene, musial score, voice requirements and appropriate special effects as the scene is outlined graphically by the art director who can also act as most of the other personnel normally 0 associated with the production of cartoon movies.
However, our invention is not linked to cartoons but is capable of being used to produce movies with images of real people irrespective of whether they are present or not, all that is required being that the characters' images are stored within the invention so 5 that the neural computer has real time access to them, together with either their own voice and movement styles or can generate such voice and movement styles that best fit the said images. For
example, the invention can produce a movie starring a long dead actor or actress with current actors. The invention is also able to convert old black and white movies into colour movies or a two dimensional movie into a three dimensional format because the neural computer is able to generalise from one form to another once it has been taught the basic processes of converting a two dimensional object into its three dimensional format. The means of projecting the true three dimensional formats so generated are beyond the scope of the invention although the three dimensional formats displayed on two dimensional screens are within the capabilities of the invention.
As neural computers develop with the advent of higher capacity neural network circuit boards, the real time capacity of the invention will improve. When neural computers become optically based computers then the real capabilities of the invention will far exceed the capacity and capabilities of a human movie maker from which it will have rapidly learned all of the film production techniques developed over the past century and be able to generalise to the new movie making techniques that will be emerging over the next century.
Summary of the Invention
It is an object of the invention to provide a movie making means which results from the interaction of a graphic artist and a neural network computer based system in such a manner that a basic concept introduced by the said graphic artist is fully generalised by the neural network computer which first of all
generalises the characters, their actions, their environment, including background scenes, foreground scenes, acoustic effects, lighting effects and the appropriate movements.
Another object of the invention is to provide a real time interaction between the output of the human graphic artist and the neural network computer system.
It is an object of the invention to outline a character to the neural computer vision system which, when recognised by the said system is completed on a TV monitor, alterations being then made by the graphic artist and the process repeated until the image is as required.
Another object of the invention is to provide a means of scanning a black and white movie, frame by frame, then automatically optimising the colouring of each frame, thus converting a black and white movie into a colour movie in real time.
It is an object of the invention to convert two dimensional format movies frame by frame into a three dimensional format movie by utilising the neural network computer's ability to generalise a two dimensional format into a three dimensional format.
It is an object of the invention to provide means for superimposing a cartoon character onto an existing movie frame in such a manner that a hybrid movie is produced.
Brief Description of the Drawings A better understanding of the invention will be obtained from the following considerations taken into conjunction with the figure
which is not meant to limit the scope of the invention in any way.
A schematic layout of the invention is given in Figure 1 , showing the way in which the movie maker can interact in real time with the artificial neural computer based movie production system 5 to optimise the movie production process.
Detailed Description of the Invention
In Figure 1 , numeral 1 indicates a drafting board on which is sketched the appropriate images indicated by numeral 2 by the movie maker whose eye, the vision input, in indicated by numeral 3. ι o Numeral 4 indicates an electronic camera which records the images 2 in real me and transfers the data to the artificial neural computer indicated by numeral 5. Numeral 6 indicates the control unit of the invention which selects the tasks to be undertaken by artificial neural computer 5, the resulting real time images being
15 displayed on the vision display system indicated by numeral 7.
Numeral 8 indicates a data storage module for storing a range of selected musical scores. Numeral 9 indicates a data storage module for storing a range of selected special effects associated with movie making. Numeral 10 indicates a data storage module for
20 the storage of a data base for a range of languages, Numeral 11 indicates a data storage module for storage of backdrops for movie making. Numeral 12 indicates links to outside data storage facilities which can be assessed by the invention if its own data modules prove to be inadequate for particular tasks demanded by
25 the movie maker 3.
In Figure 1 , numeral 13 indicates the module where hard film copies of the movie are produced for distribution as indicated by numeral 14. Numeral 15 indicates the module where video copies of the movie are produced for distribution as indicated by numeral 16. 5 Numeral 17 indicates the module for printing out details of all the copyright material used by the invention in producing a particular movie.
The invention is used to produce a movie with a script presented to the operator 3, who places appropriate instructions ι o via images 2 and the control unit 6 to select rhe appropriate outputs from modules 8, 9, 10 and 11. The artificial neural computer 5 then combines and blends all of these inputs into an output which is displayed on screen 7 in real time so that the resulting movie can be optimised by the operator 3 in real time to 5 produce the finished product.
For example, if a cartoon movie is to be produced by the invention, the operator 3 either draws a rough sketch of the required character on 2 and selects the range of appropriate data stored in modules 8, 9, 10 and 11. Computer 5 then blends these 0 data packs together, displaying the result on screen 7 in a manner than can be optimsed in real time by operator 3. When operator 3 is satisfied with the product, hard copies are made in modules 13 and 15 and the copyright list is produced in module 17.
The invention can produce movies using live actors, images of 5 actors, cartoon characters, real scenery or images of scenery. The movements of the characters matched to the selected language. Alternatively, the same movie can be produced with actors of any
nationality speaking their native language dispensing completely with the need for subtitles.
The invention has application in the production of cartoons, feature films and educational films. It should also be noted that
5 the invention is able to match production characters to blank profiles already in a movie. For example, if a couple were contemplating a divorce, their own images could be superimposed on existing blank images in an appropraite film so that they could be counselled whilst looking at their own reactions in specified ι o situations.
The invention is also capable of producing a cartoon, feature film or educational film or video from only a set of instructions, producing the required movie from stored information only.
Claims
1. A neural network computer based motion picture production system which interacts with human initiated scene sequences to generalise the optimum avenue to the end product with a minimum 5 of human control, said system consisting of, a) A drafting board onto which a human inputs the basic concepts of the motion picture to be produced in such a manner that the vision camera system of the output neural network computer can record details of said human inputs in such a manner that ι o they can be pro cessed in real time by the neural computer which then uti! ses a range of stored data in the form of character movaments, foreground and background scenery, acoustic effects, environmental effects, appropriate stories, graphics and colour schemes to complete the frame sequence 5 of the plannnd motion picture. b) A television monitor to display the result of the human neural computer interactions so that human control can be exercised to guide the motion picture making process along as such a requiremer t arises. 0 c) Local data storage of basic information necessary for the neural computer to assemble the most appropriate scenes frame by frame, d) Remote cata storage systems which provide any additional data not available in the local storage units, but linked to them 5 via large capacity information links.
2. A system as claimed in claim 1 which provides a real time interaction between the output of a human graphic artist and the artificial neural network computer such that it is possible to drastically reduce the number of drawings that had to be produced
5 by graphic artists in prior art cartoon production processes by allowing the neural computer to generalise its movements, expressions and the voices of cartoon characters whose outlines have been indicated by the graphic artist.
3. A system as claimed in claim 1 which can superimpose an ι o image of any actor onto an outline of said actor and then proceed to generalise the actor's known characteristics so that complete scenes featuring the said actor can be compiled without his presence being required.
4. A system as claimed in claim 1 where cartoon characters and 15 images of actors can be incorporated in the same scene.
5. A system as claimed in claim 1 where an image of an artificial actor or actress is generated so that said artificial actor or actess can then star in the motion picture being produced.
6. A system as claimed in claim 1 where a two dimensional film 20 frame is scanned and generalised into a three dimensional format by the artificial neural computer.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AUPJ6575 | 1989-09-27 | ||
| AUPJ657589 | 1989-09-27 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO1991005312A1 true WO1991005312A1 (en) | 1991-04-18 |
Family
ID=3774230
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/AU1990/000457 WO1991005312A1 (en) | 1989-09-27 | 1990-09-28 | Artificial neural computer based interactive movie production system |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO1991005312A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4803736A (en) * | 1985-11-27 | 1989-02-07 | The Trustees Of Boston University | Neural networks for machine vision |
| US4804250A (en) * | 1987-06-12 | 1989-02-14 | The United States Of America As Represented By The Secretary Of The Army | Optical processor for an adaptive pattern classifier |
| WO1989009458A1 (en) * | 1988-03-22 | 1989-10-05 | Strandberg Oerjan | Method and device for computerized animation |
| WO1989012870A1 (en) * | 1988-06-24 | 1989-12-28 | Thomson-Csf | Device for processing an adaptive, nonlinear signal |
-
1990
- 1990-09-28 WO PCT/AU1990/000457 patent/WO1991005312A1/en unknown
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4803736A (en) * | 1985-11-27 | 1989-02-07 | The Trustees Of Boston University | Neural networks for machine vision |
| US4804250A (en) * | 1987-06-12 | 1989-02-14 | The United States Of America As Represented By The Secretary Of The Army | Optical processor for an adaptive pattern classifier |
| WO1989009458A1 (en) * | 1988-03-22 | 1989-10-05 | Strandberg Oerjan | Method and device for computerized animation |
| WO1989012870A1 (en) * | 1988-06-24 | 1989-12-28 | Thomson-Csf | Device for processing an adaptive, nonlinear signal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Beane | 3D animation essentials | |
| Bowen | Grammar of the Shot | |
| US6351265B1 (en) | Method and apparatus for producing an electronic image | |
| US5734794A (en) | Method and system for voice-activated cell animation | |
| US6492990B1 (en) | Method for the automatic computerized audio visual dubbing of movies | |
| US3510210A (en) | Computer process character animation | |
| US8655152B2 (en) | Method and system of presenting foreign films in a native language | |
| US20070165022A1 (en) | Method and system for the automatic computerized audio visual dubbing of movies | |
| US7109993B2 (en) | Method and system for the automatic computerized audio visual dubbing of movies | |
| Saeghe et al. | Augmented reality and television: Dimensions and themes | |
| CN110418148B (en) | Video generation method, video generation device and readable storage medium | |
| Pinhanez et al. | Intelligent studios: Using computer vision to control TV cameras | |
| WO1991005312A1 (en) | Artificial neural computer based interactive movie production system | |
| AU6444090A (en) | Artificial neural computer based interactive movie production system | |
| CN113891079A (en) | Automatic teaching video generation method and device, computer equipment and storage medium | |
| Ramey | Do No Harm—The Cameraless Animation of Anthropologist Robert Ascher | |
| KR19980066044A (en) | Apparatus and copyrighted work for converting the main character's face and metabolism into a specific person using an image processing technique | |
| CN113709544A (en) | Video playing method, device, equipment and computer readable storage medium | |
| KR102569687B1 (en) | method and system for producing animation | |
| CN113784077B (en) | Information processing method and device and electronic equipment | |
| KR102599170B1 (en) | Style transfer used real-time work producing system and its method | |
| Derakhshani | Introducing Maya 2008 | |
| Kelly et al. | Foundation Flash Cartoon Animation | |
| Maric | The evolving aesthetics of the moving image in vertical video online: a thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Media Studies at Massey University, New Zealand | |
| Jinhong et al. | Intelligent digital filmmaker dmp |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AU JP US |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH DE DK ES FR GB IT LU NL SE |