CA2199969C

CA2199969C - Device for the autonomous generation of useful information

Info

Publication number: CA2199969C
Application number: CA002199969A
Authority: CA
Inventors: Stephen L. Thaler
Original assignee: Individual
Current assignee: Individual
Priority date: 1994-10-13
Filing date: 1995-10-04
Publication date: 2008-04-15
Anticipated expiration: 2015-10-04
Also published as: AU689677B2; US6356884B1; GB9916090D0; GB2336227A; EP0786106A4; US5659666A; GB2308476B; US6115701A; WO1996012221A1; EP0786106A1; CA2199969A1; GB2336227B; GB2308476A; US6018727A; DE69525059D1; JP4282760B2; JP2007299387A; GB9705632D0; EP0786106B1; AU4193696A

Abstract

A device (20) for simulating human creativity employing a neural network (22) trained to produce input-output maps within some predetermined knowledge domain, an apparatus for subjecting the neural network to perturbations that produce changes in the predetermined knowledge domain, the neural network (22) having an optional output (26) for feeding the outputs of the neural network (22) to a second neural network (24) that evaluates and selects outputs based on training within the second neural network (24). The device may also include a reciprocal feed back connection (28) from the output of the second neural network (24) to the first neural network (22) to further influence and change what takes place in the aforesaid neural network.

Description

DEVICi: FOR THE AUTONOMOUS
GENERATION OF USEFUL INFORMATION

The present invention relates to a system and process for simulating the internal imagery and additional mechanisms which together emulate creativity in the human mind. The system allows for the totally autonomous generation of new concepts, designs, music, processes, discovery, and problem solving using recent developments in the area of artificial neural network (ANN) technology. Several examples of the type of useful information that can be obtained using the present technology are set forth and described herein.
The present system can be used to tailor machine responses thereby making computers less rigid in communicating with and interpreting the way a human responds to various stimuli. In a more generalized sense, the subject system supplies the equivalence of free-will and a continuous stream of consciousness through wiiich the device may formulate novel concepts or plans of action or other useful information.
Prior to this invention, artificial rieural network (ANN) emulations ofbiological systems were used for non-creative tasks such as pattern recognition, neural control, and the generalization of experimental data. The present system represents a new approach and a new application ofANN's in which the system synthesizes novel plans ofaction and original designs or creations. These systems, which we refer to as autonomous systems or "creativity machines" may perform imaginative feats that extend beyond technological invention into the realms of aesthetics and emotions.
The present preferred embodiment of the system employs two essential components, namely (1) a neural network containing training in some problem domain, which neural network is subjected to perturbations and, as a result of the perturbations, continuously outputs a stream ofeoncepts, and (2) a rnonitoring portion, such as, in one particular preferred form, a second or patrolling neural network, which portion constantly monitors the outputs of the first network for various reasons, such as to identify and isolate useful outputs. This tandem arrangement may be thought of as constituting a model of creativity, and perhaps attentional consciousness, and this internal imagery is spontaneously generated within the perturbed network, while the monitoring portion is constantly alert to the occurrence ofcertain outputs, such as specific images possessing either utility or other useful characteristics including aesthetic appeal. The perturbations used may be achieved by any number of different means including by the introduction of noise, relaxation or degradation of the network and so forth. The two components discussed above will be described in more detail hereinafter.
It is important to emphasize that the present system need not necessarily accept external information. Instead, the system may be allowed to operate such that information emerges spontaneously as a result of any number of stochastic and/or systematic processes applied to the characterizing parameters of the networks involved. With this tandem arrangement of the free-running neural network and the associated monitoring or policing portion, it is possible to generate a notion that is superior in quality to anything generated by a known system, device or machine similarly exposed or perturbed.

DISCUSSION OF THE PRIOR ART
The inventor has demonstrated that the application of certain types of noise to the inputs or weights of an ANN may produce novel outputs if the vector completion process fails to activate an output vector encountered during the network's training. Such outputs generally take the form of a combination of known training outputs and generally emulate the environment in which it was trained. Therefore, a neural network trained to generate the surface profiles of some device or object such as a known mountain range would tend to produce very plausible but unfamiliar mountain ranges if the inputs are subjected to random stimulations. Similarly, a neural network trained to only produce classical music would tend to produce potential classical themes when exposed to random inputs. The inventor has shown that static networks have produced some very novel outputs which have been detected within mathematical studies. In all known cases, however, they have been isolated by a human operator for their novelty. In contrast, the present system autonomously monitors the output of such a network and can operate to identify correspondences with or differences from predetermined criteria associated with the monitoring portion for various purposes, such as, in a preferred embodiment to select emergent concepts on the basis of some predetermined criteria established within a policing or patrolling neural network which, in such embodiment, is the monitoring portion of the system. Such concepts may include producing music or musical themes for some purpose, or for designing some device such as a coffee mug, or producing a process planning operation, or solving a problem, such as to seek a target figure of merit in a target seeking application of the system, and for many other applications, some of which will be described more in detail hereinafter.
Known ANNs have obtained a relatively high degree of precision in some areas such as in input-output mapping. The present invention teaches the use of deliberate degradation of an ANN and therefore a corruption of such precise mapping to produce useful information.
Thus a network trained to duplicate some knowledge domain may generate fairly representative examples of known devices at low levels of network degradation.
For example, in the case of automobile design the known networks may generate fairly representative examples of existing cars at low levels of network degradation owing to the constraints existing within the network. In other words sensible designs are produced. At progressively higher levels of network degradation, such network constraints further relax to produce novel and more unusual hybrid automobile designs, some of which may fill a useful application niche or market. The key to making the transition from the ordinary to the novel is achieved by the control over the network degradation and the ability to relax or perturb certain network parameters from their trained-in values. Thus the present system provides a way to design around the ordinary or the near ordinary and to create new designs in much the same manner as a creative designer would do, unlimited by certain constraints. As a result of the introduction of various forms of perturbations to the inputs, internal activations, weights and biases, such known systems may control a process or create an object or design. The information thus produced with the present system may be stored for later use to control a process or the like and/or used in its own autonomous decisions to modify the output or outputs that have been produced in some desired fashion. Thus the present system provides another tool, and a very broad based tool, for doing design or creative work, including as part of target seeking applications, through utilization of the two elements discussed above. It is contemplated, however, to fine-tune or toggle the subject system to autonomously change its mode of operation from performing one task to performing a different task or different purpose.
Being able to internally modify the network in a myriad of ways allows for vast numerical superiority in the number of viable concepts that may be produced.
The present tandem arrangement of system elements allows for complete autonomy in this task.
SUMMARY OF THE INVENTION
In accordance with one embodiment of the present invention there is provided an artificial neural network based discovery device comprising a first artificial neural network trained to produce an input-output mapping within a predetermined knowledge domain, the knowledge domain being incorporated within the first artificial neural network in a plurality ofweights and biases established therein, means for subjecting the first artificial neural network to progressively increasing degrees of perturbation so that the knowledge domain of the first artificial neural network is progressively degraded and the neural network produces outputs which progressively differ from the outputs which would be mapped by the first artificial neural network ifthe knowledge domain thereof were not degraded, a second artificial neural network associated with the first artificial neural network so as to receive at least one of the outputs therefrom and trained to identify potentially desirable outputs as they are produced by the first artificial neural network, means for feeding back from the second artificial neural network to a portion of the first artificial neural network outputs generated from the second artificial neural network.
In accordance with another embodiment of the present invention there is provided a neural network discovery device for producing and identifying novel information, such novel information being different than any information upon which the neural network discovery device has been trained, comprising an artificial neural network portion trained to produce input-output maps within a predetermined initial knowledge domain, means for subjecting the artificial neural network portion to perturbation which is applied to inputs of the artificial network, the artificial neural network portion operable to produce outputs as it is perturbed, and means for monitoring the outputs of the artificial neural network portion in order to identify outputs which meet predetermined criteria of acceptability, wherein the identification of outputs by the monitoring means is indicative of production of novel and acceptable information by the neural network discovery device.
In accordance with a further embodiment of the present invention there is provided a discovery device including a first neural network portion trained to produce output information according to a predetermined initial knowledge domain, means for providing at least one constant input to the first artificial neural network, means for subjecting the initial knowledge domain to increasing degrees of perturbation, which perturbation degrades the first neural network portion so as to eventually produce outputs which are progressively different from those that would be produced according to the initial knowledge domain, a second neural network portion associated with the first neural network portion so as to receive the outputs therefrom and operable to patrol such outputs in order to identify those outputs which it associates as being acceptable according to a trained in knowledge domain established in the second artificial neural network portion.
In accordance with a yet further embodiment of the present invention there is provided a computer-based system for developing and storing a data set representative of an emergent thought-like concept in a simulation of consciousness over a period of time, comprising: a first simulated artificial neural network having a particular knowledge domain established therein as a result of prior training of the neural network in accordance with predefined constraints;
means for repetitively perturbing the first simulated artificial neural network to repetitively degrade the operation thereof and to thereby effect ongoing production thereby of outputs therefrom in a process tantamount to stream of consciousness associated with the particular knowledge domain of the first simulated artificial neural network; a second simulated artificial neural network attentive to the outputs of the first artificial neural network as they are produced in response to the perturbations of the first artificial neural network in a process tantamount to awareness of stream of consciousness, the second simulated artificial neural network having an established knowledge domain and operating in accordance therewith to regulate the means for repetitively perturbing the first neural network and the ongoing perturbations in the first simulated artificial neural network; and an archive to retain at least a subset of the set of ongoing outputs from the first simulated artificial neural network over a period of time, the retained subset of ongoing outputs from the first simulated artificial neural network defining a data set developed over such period of time and being tantamount to an emergent thought-like concept developed over such period of time.
In accordance with an embodiment of the present invention there is provided an artificial neural network system for developing non-standard design concepts within a predefined field of endeavour, comprising: a first artificial neural network portion, the first artificial neural network having been previously trained in a predefined field of endeavour and having an input portion, an output portion, and a particular knowledge domain as established therein for the predefined field of endeavour through prior training of the first neural network portion, which first trained neural network portion would be normally operable in accordance with its basis design constraints and the established knowledge domain to produce established outputs reflective of standard design concepts in the predefined field of endeavour in response to a pattern of inputs supplied to the first neural network portion at the input portion thereof, means for perturbing the first neural network portion to degrade the previously trained operation thereof, which neural network perturbation effects a change in the operation of the first neural network portion, subject to design constraints that remain in effect, to thereby effect production at the output portion of the first neural network portion, for a given pattern of inputs to the first neural network portion, of data outputs that are distinct from the corresponding standard data outputs that would be produced in response to such given pattern of inputs by the first neural network portion in the absence of such network perturbation, which distinct data outputs remain subject to the unchanged design constraints of the first neural network portion by identify distinct non-standard design concepts in the predefined field of endeavour; and a monitor portion associated with the first neural network portion to observe the data outputs therefrom and to select from among such observed data outputs certain data outputs which meet given criteria of acceptability as useful and creative non-standard design concepts within the predefined field of endeavour.
In accordance with another embodiment of the present invention there is provided a method for deriving non-standard design concepts for a given field of endeavour from a previously trained artificial neural network that is normally operable to produce only established outputs reflective of known design concepts in response to a pattern of inputs, comprising the steps of (a) providing a first artificial neural network, the first artificial neural network having been previously trained in a predefined field of endeavour and having an input portion, an output portion, and a particular established knowledge domain for the predefined field of endeavour, which first previously trained neural network is normally operable in accordance with its basic design constraints and its established knowledge domain to produce at its output portion established outputs reflective of standard design concepts in response to patterns of inputs supplied to the neural network at the input portion thereof; (b) perturbing the first previously trained neural network to degrade the previously trained operation thereof to thereby effect a change in th operation of the neural network, subject to design constraints of the first previously trained neural network that remain in effect, to effect production, for a given pattern of inputs supplied to the first neural network, of data outputs that are distinct from the corresponding data outputs that would be produced by aid first neural network in the absence of such network perturbation, which distinct data outputs remain subject o the unchanged design constraints of the first neural network but identify distinct non-standard design concepts in the predefined field of endeavour; (c) monitoring the first neural network to detect the data outputs produced thereby in response to perturbations; and (d) selecting from among the data outputs certain data outputs which meet given criteria of acceptability as useful and creative non-standard design concepts within the predefined field of endeavour.
In accordance with a further embodiment of the present invention there is provided an artificial neural network-based system for deternzining, for a special knowledge domain in a given field of endeavour as represented in a neural network, desired concepts and relationships within such predefined field of endeavour, comprising: a neural network portion having an output portion at which data outputs are produced, the neural network portion including an artificial neural network that has an input portion and which is operable to effect production of a data output from the output portion of the neural network portion when an input pattern is supplied to the artificial neural network, at the input portion thereof, the artificial neural network having been previously trained= in accordance with training exemplars in a given predefined field of endeavour to establish a particular knowledge domain therein and being normally operable in accordance with the constraints embodied in its design and the established knowledge domain to produce standard data outputs in response to input patterns supplied to said previously trained artificial neural network at the input portion thereof; a monitor portion associated with the neural network portion to observe data outputs produced at the output portion of neural network portion; and a network perturbation portion for perturbing the neural network portion to effect changes, subject to constrains embodied in the design of the previously trained artificial neural network that remain unperturbed, in the data output produced by the neural network portion at the output portion of the neural network portion;
the network perturbation portion operable such that production of a data output by the neural network portion thereafter effects a perturbation of the network perturbation portion of the neural network portion, the perturbation driving an operation of the artificial neural network to effect production of a data output from said neural network portion, the data output so produced establishing, based in part upon the particular varied perturbation effected, an input-perturbation-output mapping relationship within the predefined field of endeavour; the monitor portion operable to detect and to identify, from among the data outputs being produced over a period of time at the output portion of the neural network portion when the neural network portion is so perturbed, data outputs which satisfy certain predefined criteria as preselected by a user, identification of a data output that satisfied the predefined criteria determining a desired concept within the predefined field of endeavour, which desired concept is associated with a particular input-perturbation-output mapping relationship established during operation of the system.

In accordance with a yet further embodiment of the present invention there is provided a method for determining, for a special knowledge domain in a given field of endeavour as represented in a neural network, desired concepts and relationships within such predefined field of endeavour, comprising the steps of: (a) providing a neural network object having an output portion at which data outputs are produced and including an artificial neural network having an input portion and which is operable to effect production of data outputs at the output portion of the neural network object in response to input patterns supplied to the input portion of the artificial neural network, the data outputs so produced having particular data patterns associated therewith, the artificial neural network having been previously trained in accordance with a set of given training exemplars in a predefined field of endeavour and having a particular established knowledge domain for the predefined field of endeavour, which previously trained neural network is normally operable in accordance with the constraints embodied in its design and its established knowledge domain to produce at the output portion, in response to input patterns supplied to the neural network at the input portion thereof, standard data outputs representative of known concepts and having associated input-perturbation-output mapping relationships; (b) perturbing the neural network objet to drive an operation of the neural network object and to effect a change in the data outputs produced thereby, such changed data outputs having input-perturbation-output mapping relationships that differ from the input-perturbation-output mapping relationships ofthe given training exemplars and their associated standard data outputs; (c) monitoring the neural network object over a period of time to detect the data outputs produced thereby in response to perturbations and to identify from among the data outputs those data patterns which satisfy predefined criteria ofacceptability, identification of a data pattern that satisfied the predefined criteria determining a particular concept within the predefined field of endeavour, which concept has associated therewith a particular input-perturbation-output mapping relationship.
In accordance with one embodiment of the present invention there is provided an artificial neural network-based system for obtaining, for a specified knowledge domain in a given field of endeavour as represented in a neural network, a desired concept within such predefined field of endeavour, comprising: a neural network portion including an artificial neural network object having a plurality of interrelated nodes disposed in at least an input layer, an output layer, and at least one intermediate layer, the nodes of the input layer connected to receive data inputs supplied thereto, at least one node of the neural network object connected to receive a selection criteria input, the neural network object having been previously trained in a given predefined field of endeavour, with non-restrictive selection criteria input, to establish a particular knowledge domain in the neural network object, the neural network object, after such training, operable in accordance with the constraints embodied in its design and the established knowledge domain, when a non-restrictive selection criteria input is being supplied thereto, to produce standard outputs therefrom which are representative of concepts consistent with the training of the neural network object; a neural network perturbation portion for perturbing the artificial neural network object to drive an operation of the neural network object and to effect changes, subject to constraints embodied in the design of the artificial neural network that remain unperturbed and when a non-restrictive selection criteria input is supplied, in the outputs produced by the artificial neural network object; the neural network object being normally operable, upon being perturbed by the neural network perturbation, when a predefined restrictive selection criteria as preselected by a user is supplied as a selection criteria input and such selection criteria is satisfied, to produce an output therefrom, which output is representative of a desired concept; and a system output portion for receiving outputs that are representative of a desired concept in accordance with the predefined restrictive selection criteria.
In accordance with another embodiment of the present invention there is provided an artificial neural network-based system for determining, for a specified knowledge domain in a given field of endeavour as represented in a neural network, desired concepts and relationships within such predefined field of endeavour, comprising: a neural network portion including an artificial neural network that has an input portion and an output portion and is operable to produce outputs at the output portion when inputs are supplied to the artificial neural network at the input portion thereof, the artificial neural network having been previously trained in accordance with training exemplars in a given predefined field of endeavour to establish a particular knowledge domain therein and being normally operable in accordance with the constraints embodied in its design and the established knowledge domain to produce standard outputs in response to a pattern of inputs supplied to the previously trained artificial neural network at the input portion thereof, a neural network perturbation portion for perturbing the neural network portion to degrade the neural network portion and the knowledge domain of the neural network to effect changes, subject to constraints embodied in the design of the artificial neural network that remain unperturbed, in the outputs produced by the neural network portion at the output portion of the neural network portion, the changed outputs differing from the standard outputs that would be produced by the neural network portion if the knowledge domain of the neural network were not degraded, each output so produced establishing an input-perturbation-output mapping relationship within the predefined field of endeavour; and a monitor portion associated with the neural network portion to observe the outputs produced at the output portion of the artificial neural network over a period of time and to identify from among the outputs so produced particular outputs that satisfy predefined criteria as preselected by a user, identification of an output that satisfies the predefined criteria determining a desired concept within the predefined field of endeavour, which desired concept is associated with a particular input-perturbation-output mapping relationship established during operation of the system.
In accordance with a further embodiment ofthe present invention there is provided an artificial neural network-based system for determining, for a specified knowledge domain in a given field of endeavour as represented in a neural network, a sough-for set of perturbations applicable to such knowledge domain that will produce a desired targeted result, comprising:
an artificial neural network that has an input layer, an output layer, and at least one hidden layer, and which is operable to produce outputs from the output layer when inputs are supplied to the input layer of the artificial neural network, the artificial neural network having been previously trained in accordance with training exemplars in a predefined field of endeavour to establish a particular knowledge domain therein; a network perturbation portion for iteratively perturbing the artificial neural network to effect iterative changes, subject to design constraints of the artificial neural network that remain unperturbed, in the outputs produced by the artificial neural network, the combined set of perturbations applied to the artificial neural network in any given iteration constituting a candidate set of perturbations;
and a monitor portion associated with the artificial neural network to observe the data outputs produced by the artificial neural network in response to candidate sets of perturbations, the monitor portion including a comparator portion that operates to identify from among the observed data outputs being produced by the artificial neural network certain data patterns in the observed data outputs which satisfy predefined target criteria; identification of a data output that satisfies the predefined criteria determining a particular perturbation-output mapping relationship and establishing the candidate set of perturbations that has produced the desired targeted result as the sought-for set of perturbations.
In accordance with a yet further embodiment of the present invention there is provided a method for determining, for a specified knowledge domain in a given field of endeavour as represented in a neural network, a sought-for set of perturbations applicable to such knowledge domain that will produce a desired targeted result, comprising the steps of: (a) providing an artificial neural network, the artificial neural network having been previously trained in accordance with a set of given training exemplars in the predefined field of endeavour and having an input portion, an output portion, at least one hidden layer, and a particular established knowledge domain for the predefined field of endeavour;
(b) perturbing said previously trained artificial neural network to effect production of a data output thereby;
(c) monitoring the neural network to detect the data output produced thereby in response to the set of perturbations applied thereto and determining whether or not such data output satisfies predefined target criteria and either (i) proceeding to sep (b) if the predefined target criteria are not satisfied, or (ii) archiving the set of perturbations applied to the artificial neural network.

BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram of a system that depicts a system portion entitled imagination engine (IE) in association with another system portion entitled alert associative center (AAC) connected to operate according to the teachings of the present invention;
Fig. 2 illustrates how perturbations from an external source are applied to a particular embodiment of the present system to produce a plurality of outputs any one or more of which can be selected to represent the desired output information (mode A);
Figure 3 illustrates how perturbations in the form of connection weight pruning can be applied to the system of Fig. 2 to produce a plurality of outputs any one or more of which can be selected to represent the desired output information (mode B);
Fig. 4 illustrates how perturbations in the form of connection weight prunings can be applied to a recurrent network to produce a plurality of outputs which can be selected to represent a novel procedure (mode C);
Fig. 5 is a diagram of one embodiment of the subject system used in designing and/or producing a desired shape for a coffee mug;
Fig. 6 is a block diagram of the means employed to produce the coffee mug of Fig. 5;
Fig. 7 is a view showing one form of the operating members controlled by the subject system in the production of the desired shape for a coffee mug;
Fig. 8 shows examples of acceptable and unacceptable coffee mug designs;
Fig. 9 depicts an embodiment of the subject system, illustrating the manner in which the inputs and outputs of the subject system can be used for producing musical verses utilizing a recurrent network;
Figs. I OA-I OC illustrate network activations employed in the production of acceptable music where the training produces a combination of the songs "TWINKLE, TWINKLE
LITTLE STAR", "DAISY" and "MARY HAD A LITTLE LAMB";

Fig. 11 shows a manner in which the subject system can be employed to convert the outputs of the IE of Fig. 10A to sounds;
Fig. 12 shows ten (10) musical phrases produced by the system depicted in Fig.
9;
Fig. 13 depicts an embodiment of the subject system, illustrating a manner in which the inputs and outputs of the subject system can be used for producing musical phrases utilizing a simple feed forward network and perturbations applied to both inputs and connection weights of that network;
Figs. 14A and 14B show musical phrases of acceptable form produced using a non-recurrent feed forward network;
Fig. 15 shows fifty (50) novel musical themes or phrases produced by the system of Fig. 13;
Fig. 16 depicts an embodiment ofthe subject system, illustrating a manner in which the inputs and outputs produced by the subject system can be used for producing novel automobile designs; and Figs. 17A and 17B show two automobile designs produced by the subject system, including a design (1) to achieve at least 35 MPG, cost less than $25,000.00 and have a favorable rating in terms of user satisfaction and design (2) which is an automobile capable of accelerating to 60 MPH in less than eight (8) seconds and achieve a top speed of at least 150 MPH.
DETAILED SPECIFICATION OF PREFERRED EMBODIMENTS
Referring to the drawings more particularly by reference numbers, number 20 in Fig.
1 refers to a preferred system constructed according to the present invention.
The system 20 includes two basic components, one labeled imagination engine (IE) 22, which is an artificial neural network (ANN) that is subjected to perturbations, sometimes in a progressive manner, while producing outputs which it feeds to a second component, identified as an alert associative center (AAC) 24, which is a system element or portion that monitors the IE 22 and which, in some preferred embodiments, may also be an artificial neural network which, in turn, may have one or more feed back connections 28 to the IE 22. The IE or imagination engine constitutes that portion of the subject device that receives the input information in the form usually of stochastic noise or perturbations applied against the training of the IE and is applied to its weights, biases, inputs, outputs or internal activations. The imagination engine is so described in order to convey the idea that this network is perturbed either internally or externally, and as a result of attempting to perform pattern completion in the presence of the perturbations or noise, produces outputs which freely wander through some given knowledge domain which is embodied in the network's training. The outputs can also be recycled. The outputs of the IE are monitored or patrolled by the AAC. The IEs and the AACs may be grouped or coupled into one or more of a plurality of relationships depending upon what is to be accomplished and the nature of the inputs and outputs that are required.
The IE and AAC
can be combined into more complex systems involving a plurality of coupled ANNs and is able to perform more involved tasks including problems that require a certain degree of creativity, as will be further addressed hereinafter with regard to Fig. 16.

It has been discovered that it is common to all neural networks that whenever a neural network is subjected to a synaptic perturbation process wherein connection strengths between neurons are progressively altered, such a process activates the memories of the environmental features the network has already seen or been trained in. Tllereafter, as the network continues to evolve trom its initial trained state, such enviromnental features are combined into hybridized or juxtaposed features. For example, a neural network trained to produced the images of various animals1 including those of a cow and a bird, would first produce random, intact images of these animals and birds during low levels of synaptic perturbation. Progressively stronger perturbations in synaptic connection strength would now produce hybridized images, including that of a flying cow, something that is part cow, part bird and so forth. In other words, the same universe enibodied within the IE has begun to unravel as constraints are gradually removed and new, unheard of combinations einerge. By the same token, intact neural networks, either artificial or biological, may be activated to produce novel environmental images by noise or other processes occurring externally to themselves. Such noise may be generated by the fiinction, relaxation or degradation of other surrounding networks and comniunicating biological networks or complex network implementations. The results will be similar to that when using internally generated perturbations, with a spontaneous appearance of both straight forward as well as hybridized environmental features.

This can also be accomplished by constructing the IB of a plurality of neurons so that sonie portion of the processing units remains unrecruited to the required training or mapping.
Application of any of the perturbing influences to these Lulcommitted neurons can produce significantly increased generation of useful concepts, which can in turn be captured or processed or selected by the AAC, the AAC, which is the second major component ofthe subject system operates in some of the preferred embodiments, as will be discussed in greater detail hereinafter, to identify useful information or juxtapositions produced by the IE. The AAC is therefore an opportunistic component that is on the lookout for certain features or conditions, such as correspondences with or deviations from established criteria, which, in our present example, would entail looking out for particular animals or the like. In a typical situation, the AAC can be designed or trained to assign numerical or other scores to the hybrids or results synthesized by the IE. One or more separate algorithms can form or be associated with the AAC for such purposes and to store potentially useful concepts for later consideration and refinement, or alternatively can be used to immediately influence results in a hardware condition. In many of the more detailed embodiments depicted and discussed herein, the AAC
is, like the IE, also selected to be an ANN, which has been trained to identify useful information or juxtapositions produced by the IE and which can also be trained to assign numerical values to the hybrids synthesized by the IE. In some embodiments it is also contemplated that some of the inputs to the AAC may not be connected to outputs of the IE
but may be left free for other purposes. In ths way the AAC selection criteria can be adjusted initially or during operation for example as shown in Fig. 3.
Three different modes of operation for the combined IE and AAC (which combination can encompass various degrees or levels of distinction and/or integration of the IE and AAC
when both are neural network objects) will be discussed hereinafter. These modes can be used separately or in various combinations. These are described as modes A, B and C. In mode A, any number of techniques, including random number generation, may be used to supply novel inputs to the IE. This results in the IE attempting vector completion on the novel inputs, usually resulting in some change orjuxtaposition of its established training outputs. The AAC
then checks the utility of these resulting hybridized outputs from the IE and assigns values to select criteria shown as A-Z in Fig. 2. When the selection criteria are met, the hybridized output may then be immediately utilized or recorded for later use.
In mode B, fixed values are clamped to the inputs of the IE while its weights, biases, or internal activations are perturbed by any number of numerical techniques, including random number generation to perturb them from their original values. An internal completion process within the network layers produces new conditions or juxtapositional concepts which emerge at the outputs of the IE. The AAC then rates these in terms of their usefulness based on its own training. As in mode A, these new concepts may be utilized in real time as the network relaxes or they may be saved in an archival file for later use.
In mode C, the IE perturbation is used to create a plan of action or a procedure to solve a given problem. An example of such a system is shown in Fig. 4. In this example the IE feeds its own outputs back to its respective inputs and the procedure consists of a sequence of steps each of which is contingent upon the prior step. In mode C, the AAC
examines each step to assure its utility in forming an allowable and useful step in arriving at the desired result.
Also in mode C, the AAC may be used to modify the architecture of the IE at any stage, for instance, by the removal, modification, or replacement of any given weight or step. In mode C, an algorithm governing the operation could have weights randomly chosen within the IE
and set to constant values, for example zero. The AAC would then evaluate the system configuration for its utility or other purpose. If the'evaluated state is not an allowable one, the AAC would make the decision to replace the temporarily removed weight and inform the driving algorithm to select a new weight for removal. Once the desired system configuration is obtained, the system begins to remove more weights from the IE. The AAC is alert to whether the overall target configuration was obtained. If it was, the algorithm stores the successful sequence of operation which constitutes a procedure or it would immediately convey this information to control some external device or hardware mechanism.
In this way an ANN serving as the IE assists, in a manner somewhat similar to the way the human brain works, storing a concept or idea using a computer or the like. This can be done in the present system by having a human participant or the machine user produce feed backs to the IE in which different perturbations are applied to the IE network for some purpose such as to boost or change its outputs. By using multiple lEs and AACs more complex outputs can be obtained and in some cases more accurate and precise data can be produced. For example, many separate networks of this type can be used in the concept selection process thereby necessitating the use of many different AACs.
In any ofthe above modes or juxtapositions any combination of perturbing factors can be used to generate novel concepts within the IE. Such perturbations may combine different factors such as (a) weights, (b) biases, (c) activations, (d) external input signals (e) internal input signals to any given unit within the network, or (f) internal output signals from any given unit within the network. In like manner the parameters a-f may be perturbed by various means such as by (1) successively setting their values to some constant value such as zero; (2) successively adding some random number as obtained with a random number table to their original values; (3) successively changing their values by replacing them with random numbers obtained from a random number table; (4) multiplying their values by a time-dependent factor usually with some decay constant; (5) successively adding positive and negative random numbers obtained through a random number table to allow these parameters to perform a random walk about the original values; (6) adding numbers which obey certain statistical frequency distributions of the form where the probability of choosing such a number obeys a probability function; (7) adding numbers which obey set time-dependent statistical distributions; and/or (8) progressively multiplying any of the above factors by some gradually increasing amplitude factor so as to smoothly transition the IE from its original constrained condition, implicit within its training, to progressively relax constraints as the weights and biases stray from their training values. It has been found that enhanced results may be obtained by specifically applying such perturbating influences to neurons which have not been fully recruited into the network's mapping or training.
In summary, an autonomous search procedure to arrive at novel concepts has been described, and such a search procedure is applicable to different knowledge domains. The novel outputs or problem solutions are arrived at through the interaction of an IE comprising an ANN and an associated AAC which monitors the outputs of the IE and which can also itself take the form of an ANN in particular embodiments. The IE network is trained to produce outputs within the knowledge domain of its training, as a consequence of which input-output mapping is produced that models a particular problem. One can then seek a given output pattern from the IE network by applying perturbations to the IE until the desired output pattern is produced. The introduction of such perturbations to any number of ANN features causes the IE to wander through the knowledge domain producing meaningful outputs under the constraints of its connection strengths and biases. As the level of the network perturbations increases, the constraints begin to more dramatically relax from their trained-in values and unconventional conceptualjuxtapositions emerge which can be detected and utilized by the AAC to alert an associative center or output device, such as when a targeted figure of merit is obtained or a desired output pattern is realized. The major strength of this technique is its ability to gradually and systematically perturb the IE network from a state in which it simply duplicates known features of its knowledge within its knowledge domain to a subsequent state of perturbation in which ever so slightly new j uxtapositional concepts emerge.
The subtle changes from the conventional to the mildly unconventional produce new and potentially useful inventions which can be autonomously identified and selected by the AAC.
Thus the present system limits its search space in seeking solutions to many different problems and it does so in a unique manner.
COFFEE MUG DESIGN
Referring now to Figs. 5-8 there is shown a particular embodiment of the subject system that can be used in the design and production of devices such as a novel coffee mug and the like. The subject coffee mug can be aesthetically pleasing and also serve a useful function.
It is apparent, however, that the subject device is not limited to the production of coffee mugs and can be used to produce many other designs and shapes including works of art. It is also possible to interface the subject system with a lathe, stereo lithographic, or other operating device including a potter's wheel to cause the subject system to produce in a three dimensional form, the object in question, in this case a coffee mug. In Fig. 5 the subject system 20 is illustrated on the right hand side and a potter's wheel 47 with a Ill(lUlld ofclay 46 I17oLllltecl Oil it is ShoWll OIl the left side. Also SIIOWIl in Fig. 5, in Illustl'ativc lil--m, is a clevice or Operator mcmber 48 wllich operates al;ainst the lump of clay 46 to iorm tllc COI fCe I11L-" into the desired shapccl. 'I'he colltl'oIS IOr tllc sllaplllb 111ca11S 48 are producccl by the output of thc IE 22 as sclcctcd by the bcauty allct ILI11CtlOl1 0LItpL1tS
WI11C11 slgilal the controlling algorithm to apply the I1? outputs.

Pi~~. 6 is a logic flow diabram of the means sllown in Fig. 5. Tlle dial;ranl inclucics tllc IC
22, the AAC 24, all output dcclsloll block 52 Whlch haS a NO oLitpllt IloWlllg back to the IE oll 58 and a YES output 54 labeled Implcmellt Desil;n wllich is lecl back at 56 to the IE. The block 52 is labcled Does IE Output Exceed Thresholds? The YES output 54 controls dcvices such as a template Or I11ovaUlC p1115 or the lllCc in suCh a lllallller as to f01'lll the Sllapc of the i11L1g.

C:ig. 7 illustralcs Ilow tllc outpuls ofthe various portions ol'thc IL 22 arc L-sccl to contrc-1, in this casc, solcnoids 48 wllicll llave means that enl;age the body of clay 46 to produce the LIcsirccl shape. 'I'hc solcnoids 62 arc parts ol'thc asscmbly 43 and arc stloWll operated by Spl'lilg tcnsion produced by springs 60 ancl offset by the nlagnetic force beneratcd by the clectrical currents proportional to tllc IE outputs.

Fig. 8 S11oWS various COffce 111L1g dCSlblls, I11CIudl11g Sollle W111C11 are acsthctically pleasing anci utilitarian, and otllers wllicll llave minimal utility values.
7'Ile cup desibns are labcled 46A-46L.

In designing a coffee mug, various options sllould be assemblcd as to the acsthetic and Utilltarlllll prelel'c-lces a-lct this lllrorlllatloll should be c-lcoded in the AAC. This can be done using a computcr cocie which l;cneratcs vertically alibnecl stripes ol'various lent;ths wllich to~~etllCr Stll'_llllate thc prorlC or potclltlal mug CICsIg11. T11c5C
c1CSlglls cail 1)c dlsplayCd oll a cathode ray tube or the like using stripes of random lengths and widths and opinions can be gathered as to beauty and utility using ranking scores. The information thus obtained can be put on a spread sheet to be used for training the two separate neural networks, the IE and the AAC of this particular embodiment. The IE is trained using beauty and utility as the inputs and the AAC reverses the significance of the inputs and outputs so that the shape now serves as inputs and beauty/utility ratings and these become the outputs.

MUSIC
Figs. 9-15 illustrate another embodiment of the subject system 70 being used to produce musical compositions or musical phrases. Referring to Fig. 9, the embodiment 70 includes an IE 72 and an AAC 74 shown coupled together as in the previous constructions.
The AAC is trained to select from among the various outputs of the IE and to produce an output musical rating at block 76, which rating is applied to a block 78 which is labeled Rating Exceeds Threshold? If the rating does not exceed the threshold then an output will be produced on lead 80 which is applied to a block labeled Disregard New Note 82, and this output is applied to other blocks including block 84 labeled Refresh Weights and block 86 labeled Perform Random Weight Prunings and fed back to the IE on lead 90. If the output of the block 78 is YES then outputs will be produced through the block 88 labeled Add New Note To The Buffer for applying back to the IE to further modify the condition of the IE. The difference between Fig. 9 and the design previously discussed in connection with the production of a coffee mug is that in Fig. 9 the outputs are musical tones or the like arranged in a particular manner depending upon the training of the IE and the AAC, and the outputs are musical phrases or themes as will be explained. In the production of musical compositions or themes the present embodiment employs a similar relaxation technique that embodies modes A, B and C, as discussed above, and in so doing achieves a meaningful synthesis of the original musical themes. The IE in this embodiment is a recurrent network which learns to perform a number of songs such as "TWINKLE, TWINKLE LITTLE STAR", "DAISY" and "MARY
HAD A LITTLE LAMB". The network as shown utilizes an 8-10-8 architecture as shown in Fig. 9, with the outputs of the network fed back as inputs. The first two inputs encode song (S 1), (S2), the next four (N I -N4) signify note order and the last two (Fl, DI) contain the pitch and duration of any given note. The outputs of the network take on similar significances with all the values taking on appropriate values for the next note within the musical sequence. The network as shown in Fig. 10A has four layers (1-4), denoted (L1-L4). The outputs of the network attain the same significance but now represent the next note in the sequence. There are two hidden layers ofneurons each necessary to achieve the desired mapping.
This is shown in Fig. 10A by the two middle rows of neurons. By setting the left most inputs S 1-S 1 to values of (0,1), (1,0) or (1,1), the recurrent network would play "TWINKLE, TWINKLE
LITTLE
STAR", "DAISY" and "MARY", respectively. The application of random numbers to all of the inputs of the networks and in particular to S 1 and S2 would cause the network to jump from one song to another song thereby juxtaposing tunes and producing music.
Referring again to Figs. l0A-l OC there is shown (1) network activation in the form of individual neurons shrinking and expanding according to different levels of activation, (2) a strip chart recording the most recent train of notes including their pitches, and (3) the output of a separate network which has been trained to classify the output of the concurrent network as a linear combination of any of the three training melodies. This latter feature is helpful in envisioning the weighting of individual tunes within the hybridized songs.
Such musical hybridization is occurring in Fig. I OC where we see a combination of "TWINKLE" and "MARY" liaving been selected by the AAC and being performed. Training of the IE is accomplislied by creating the map between successive notes witliin any particular song. As inputs the circuit is provided with binaiy coded labels for the song number.
For example, binary coded song numbers 1-3 are input to nodes S1 and S2, binary coded note order 1-31 are input to nodes N 1-N4 and frequency and duration values are input to nodes F 1 and D 1.
The targets for traininl; include identical binary coded song number (output notes S 1 and S2), binary coded note order incremented by a value of 1(output nodes Nl-N4) and the next frequency-duration pair of the song in output nodes F1 and D1. Wrap-around of the songs is achieved by nlapping the last note in the musical sequence to the first. What has just been described refers to the operation of the IE. It is now necessary to describe the function and training of the AAC
which operates on the output from the IE. For training purposes a training computer code is written to generate a series of 4 notes, consisting of a series of notes which obey a 1/f distribution, a feature which is characteristic of all sounds we accept as music. This series of tones is subjected to an evaluation after which human evaluators were asked to respond on a 0-10 point scale to its aesthetic value.
After about 100 trials of this sort, the series of frequencies comprising each nielody was passed to a spread sheet along with their consensus rankings. Inputs therefore consisted of the note sequences along with target values for training consisting of the numerical scores. Real melodies were implanted within the training set and ranked at values of 10 for their appeal.
Noise on the otller hand from a random generator was embedded within the spread sheet with ranking values of 0. Following training on this data, the trained neural network IE and AAC
were embedded within the same computer code.
The IE was placed within a loop wherein values between zero and 1 were fed to its inputs from a random number generator thus producing or generating composite melodies at the IE's outputs. A buffer containing at most four notes (4 frequency-duration pairs) played at anytime was sampled by the eight inputs of the AAC, rating each according to its musical acceptability. The best musical themes, those exceeding a threshold of 8 on the 10 point scale were played and archived to a separate file. Generation of music composed by the subject machine was achieved by the scheme shown in Fig. 11. Outputs from the IE
deemed acceptable by the AAC are serially transmitted as a series of sound commands involving both frequency and duration of successive notes to the computer. These total commands are translated from digital to analog signals and fed to a loud speaker where the sounds can be heard. Therefore as the subject machine generates acceptable note sequences, it instantaneously relays them to an audio output device so that the operator of the machine can hear the music that has been produced. The next 4 notes generated by the IE
were similarly added to the buffer and played, and so on. Ten samples of these melodies captured by the AAC are displayed in Fig. 12. Their frequencies F are shown in Hz (1 octave being shown), while the duration D of each note is given in units- of 1/18 of a second. The combination of frequency and duration produce sound.
A second approach to synthesizing original music involves using the subject embodiment modified to consist of an IE of 3-16-20 nodal architecture and an AAC of 20-10-1 nodal architecture. The former produced a note sequence consisting of musical phrases or themes. Subsequently, the AAC checks this trial melodic phrase for its musical acceptability.
This is shown in Fig. 13. In this case the IE is trained to perform pattern completion on the tonal frequencies (i.e. in Hz) ofthe first three notes within a given musical phrase. The musical phrases for training consist of very recognizable segments from twenty well known songs.
Thus given the first three notes, the network was trained to supply the remainder of that musical sequence. The output consisted of ten successive frequency-duration pairs with the frequency given in Hertz and the duration in units of 1/18 second.

In the same embodiment the AAC is trained by exposure to twenty ten note segments from popular melodic themes, 50 examples of tones generated from frequencies selected from a random number table and about 100 trail melodies generated by the introduction of noise into a similar IE trained only on noise and the above popular melodic themes.
Target values for training consisted of numerical scores of 1 for the popular themes, numerical rankings of 0-1 on the IE generated melodies (as determined by human panellists) and numerical scores of 0 for noise generated using a random number table.
Using various combinations of IE prunings, introduction of both time-varying inputs, and time-varying perturbations to the internal connection weights ofthe IE
enabled the subject creativity machine to run autonomously until 11,000 musically acceptable themes or phrases had been collected. Typical musical phrases created by this process are shown in Figs. 14A
and 14B. In Fig. 15 fifty representative musical phrases produced by the subject embodiment are shown. At the top of the listing are identifiers as to the frequency and duration for the numbers shown in each row. In other words, Fig. 15 shows a number of musical themes audibly reproducible wherein the frequency and duration of each tone is indicated.
AUTOMOBILE DESIGN
Another application ofan embodiment of the subject system demonstrates modes A
and B wherein the AAC is allowed to make autonomous decisions to modify the architecture of the IE as well as to hold certain inputs to the IE constant. The intent of this example is to design an automobile or car in terms of its major specifications and characteristics. This is done based on some notions as to its desired performance, insurance coverage, warranties, probability of theft, and anticipated user satisfaction. In creating the subject embodiment, 29 performance characteristic of the design specification are shown as possible inputs to the IE
in Fig. 16. The AAC, on the other hand, which, in this embodiment is an ANN, reverse maps from the design specifications to performance characteristic. Both networks IE
and AAC
utilize a 29-10-29 nodal architecture. The structure 100 shown in Fig. 16 includes an IE 102, an AAC 104, and an output 106 from the AAC which flows into a decision block 108 that bears the legend Does Candidate Auto Design Meet Performance Criteria? The block 108 has a YES output 110 which flows to an archive design block 112 which in turn flows back to the input of the device 100 through branch 116. The output of the block 108 also flows back to the input of the device 100 via branches 118 and 116. The branch 116 flows to the input of the IE 102 by a block 120 labeled Apply Perturbations to IE connection weight which provides the perturbations to IE 102. The block 120 also flows to another block 122 labeled "Search Continued for More Than N Cycles?" which has an output 124 that flows to block 126 labeled Skeletonize IE which are applied as inputs to the IE 102 and also has an output which flows to the input block labeled Input Random Performance Factors to IE. The block 124 has another output which flows through branch 130 to the same Input Random Performance Factor block to inputs of the IE 102.
In operation, the IE inputs are fed values from a random number table. As each of these 29 component vectors are propagated through the network, physically realisable automobile designs appear at its putouts, prescribed in terms of its 29 design specifications.
Each set of outputs from the IE is then fed to the AAC 104 inputs wherein feed forward propagation produces the performance characteristics which would result from that particular set of specifications. These performance characteristics are then compared with those desired to determine whether or not the appropriate design has been obtained. This is what is trained into the AAC. If the design characteristics meet the criteria, the car design is displayed on some means such as a cathode ray tube. If the design does not meet these requirements, additional random inputs are fed to the IE 102 and new perturbations are applied to the IE
connection weights to generated another candidate design to be evaluated in like fashion by the AAC 104. Fig. 17A shows the design of a car possessing a highway mileage of at least 35 MPG, a retail price of at most $25,000 and a projected user satisfaction of one on a (1), 0, (-1) rating scale that has been synthesized by the subject embodiment.
It is important to note that the .network in this case is producing only physically realizable car designs by carrying out vector completion on the input vector consisting of random components as well as internal perturbations applied to the IE. Also, in this example, properties such as curb weights and tire size are realistically scaled with factors such as horsepower. Thus myriad nonsensical specifications are eliminated within the IE via the soft constraints offered by the connection strengths within the trained neural network. If the subject device is given numerous performance criteria search time will be extended. Therefore, if after a predetermined number of forward propagations such as ten propagations through the IE 102, the performance criteria have not been met, the algorithm would direct the controlled pruning of weights from the IE 102 in an attempt to narrow the search down. In this case, weights are removed one by one from the IE, while propagating a number of randomized input vectors through the entire device 100 to see if the AAC output falls within a predetermined envelope of performance values that blanketed the desired range. Should a weight be removed which generates AAC outputs outside this range, it is replaced. Should a more radical automobile design be required, systematic increase of the amplitude of the perturbations applied to the connection weights of the IE would be made, depending upon the AAC to predict the performance of such hypothetical automobiles.
It will be obvious to those skilled in the art that the present invention can be used for many purposes other than the limited purposes described herein. The important thing to recognize is that by using an IE and an AAC, especially when the IE and the AAC are comprised of two neural networks or groups of neural networks, one of which operates as the IE and the other as the AAC, it is possible to envision myriad possible uses therefor. These uses can be in designing, problem solving, selecting, developing manufacturing processes and many other areas.
Thus there has been shown and described a novel system which simulates creativity and autonomously generates useful information for some purpose. Many changes, modifications, variations and other uses in applications for the subject system will suggest themselves, to those familiar with the art. All such changes, modifications, variations and other uses in applications which do not depart from the spirit and scope of the invention are deemed to be covered by the invention which is limited only by the claims which follow.

Claims

THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE
PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS:

1. An artificial neural network based discovery device comprising a first artificial neural network trained to produce an input-output mapping within a predetermined knowledge domain, the knowledge domain being incorporated within the first artificial neural network in a plurality of weights and biases established therein, means for subjecting the first artificial neural network to progressively increasing degrees of perturbation so that the knowledge domain of the first artificial neural network is progressively degraded and the neural network produces outputs which progressively differ from the outputs which would be mapped by the first artificial neural network if the knowledge domain thereof were not degraded, a second artificial neural network associated with the first artificial neural network so as to receive at least one of the outputs therefrom and trained to identify potentially desirable outputs as they are produced by the first artificial neural network, means for feeding back from the second artificial neural network to a portion of the first artificial neural network outputs generated from the second artificial neural network.

2. A neural network discovery device for producing and identifying novel information, such novel information being different than any information upon which the neural network discovery device has been trained, comprising an artificial neural network portion trained to produce input-output maps within a predetermined initial knowledge domain, means for subjecting the artificial neural network portion to perturbation which is applied to inputs of the artificial neural network, the artificial neural network portion operable to produce outputs as it is perturbed, and means for monitoring the outputs of the artificial neural network portion in order to identify outputs which meet predetermined criteria of acceptability, wherein the identification of outputs by said monitoring means is indicative of production of novel and acceptable information by said neural network discovery device.

3. The neural network discovery device of claim 2, wherein the monitoring means includes a program routine associated with the artificial neural network portion for ing identifying outputs which meet the predetermine criteria as the outputs are produced.

4. The neural network discovery device of claim 2 or 3, including means to feed back information to the artificial neutral network portion in response to the outputs produced so as to adjust the perturbation applied thereto.

5. The neural network discovery device of any one of claims 2 to 4, further comprising means for identifying inputs applied to the artificial neural network portion which result in outputs being identified by the monitoring means, the identified applied inputs representing the novel and acceptable information produced by said neural network discovery device.

6. The neural network discovery device of any one of claims 2 to 5, wherein the outputs identified by the monitoring means represent the novel and acceptable information produced by said neural network discovery device.

7. The neural network discovery device of any one of claims 2 to 6, wherein the artificial neural network portion comprises a recurrent artificial neural network.

8. The neural network discovery device of any one of claims 2 to 6, wherein the artificial neural network portion comprises a parallel distributed system of trained neural networks.

9. A discovery device including a first neural network portion trained to produce output information according to a predetermined initial knowledge domain, means for providing at least one constant input to said first artificial neural network, means for subjecting the initial knowledge domain to increasing degrees of perturbation, which perturbation degrades the first neural network portion so as to eventually produce outputs which are progressively different from those that would be produced according to the initial knowledge domain, a second neural network portion associated with the first neural network portion so as to receive the outputs therefrom and operable to patrol such outputs in order to identify those outputs which it associates as being acceptable according to a trained in knowledge domain established in the second artificial neural network portion.

10. The discovery device of claim 9 including an output interface associated with said device and means to produce electrically generated output signals at said output interface in response to identified outputs of the fist neural network portion.

11. The discovery device of claim 9 or 10 including means to autonomously feed back at least one of the outputs of the second neural network portion to the first neural network portion to further effect changes in the outputs of the first neural network portion.

12. The discovery device of any one of claims 9 to 11, wherein the first neural network portion has the form of a parallel distributed system of neural networks.

13. A discovery device comprising a recurrent neural network trained within a knowledge domain and operable to provide at least one output therefrom as a feed back input thereto, means to subject the knowledge domain to progressively increasing degrees of perturbation which affect at least one of its weights, biases, internal and external activations so as to degrade the knowledge domain, and means to select those outputs of the recurrent neural network which are considered desirable based upon predetermined criteria as they are produced.

14. The discovery device of claim 13, wherein the knowledge domain relates to a procedure.

15. The discovery device of claim 13 or 14, wherein the recurrent neural network has the form of a parallel distributed system of neural networks.

16. The discovery device of any one of claims 13 to 15, wherein the means to select those outputs which are considered desirable includes a parallel distributed system of trained neural networks.

17. The discovery device described in any one of claims 13 to 15, wherein the means to select those outputs which are considered desirable based upon predetermined criteria includes an algorithmic computer code.

18. A computer-based system for developing and storing a data set representative of an emergent thought-like concept in a simulation of consciousness over a period of time, comprising:
a first simulated artificial neural network having a particular knowledge domain established therein as a result of prior training of the neural network in accordance with predefined constraints;
means for repetitively perturbing the first simulated artificial neural network to repetitively degrade the operation thereof and to thereby effect ongoing production thereby of outputs therefrom in a process tantamount to stream of consciousness associated with the particular knowledge domain of the first simulated artificial neural network;
a second simulated artificial neural network attentive to the outputs of the first artificial neural network as they are produced in response to the perturbations of the first artificial neural network in a process tantamount to awareness of stream of consciousness, said second simulated artificial neural network having an established knowledge domain and operating in accordance therewith to regulate said means for repetitively perturbing the first neural network and the ongoing perturbations in the first simulated artificial neural network; and an archive to retain at least a subset of the set of ongoing outputs from the first simulated artificial neural network over a period of time, the retained subset of ongoing outputs from the first simulated artificial neural network defining a data set developed over such period of time and being tantamount to an emergent thought-like concept developed over such period of time.

19. An artificial neural network system for developing non-standard design concepts within a predefined field of endeavour, comprising:
a first artificial neural network portion, said first artificial neural network having been previously trained in a predefined field of endeavour and having an input portion, an output portion, and a particular knowledge domain as established therein for the predefined field of endeavour through prior training of said first neural network portion, which first trained neural network portion would be normally operable in accordance with its basis design constraints and the established knowledge domain to produce established outputs reflective of standard design concepts in the predefined field of endeavour in response to a pattern of inputs supplied to said first neural network portion at the input portion thereof;
means for perturbing said first neural network portion to degrade the previously trained operation thereof, which neural network perturbation effects a change in the operation of said first neural network portion, subject to design constraints that remain in effect, to thereby effect production at the output portion of said first neural network portion, for a given pattern of inputs to said first neural network portion, of data outputs that are distinct from the corresponding standard data outputs that would be produced in response to such given pattern of inputs by said first neural network portion in the absence of such network perturbation, which distinct data outputs remain subject to the unchanged design constraints of said first neural network portion but identify distinct non-standard design concepts in the predefined field of endeavour; and a monitor portion associated with said first neural network portion to observe said data outputs therefrom and to select from among such observed data outputs certain data outputs which meet given criteria of acceptability as useful and creative non-standard design concepts within the predefined field of endeavour.

20. The artificial neural network system of claim 19, wherein the first artificial neural network portion is progressively degraded as it is perturbed.

21. The artificial neural network system of claim 19 or 20, wherein the means for perturbing the first artificial neural network portion includes means for repetitively perturbing the first artificial neural network such that the operation thereof is repetitively degraded.

22. The artificial neural network system of any one of claims 19 to 21, wherein said monitor portion includes a second artificial neural network portion having an input portion, an output portion, and a knowledge domain established therein, and wherein at least some of the outputs of the first artificial neural network portion are provided as inputs to the second artificial neural network portion.

23. The artificial neural network system of claim 22, wherein the outputs produced by the first artificial neural network portion as it is perturbed include output information representative of a design for an object type and wherein the second artificial neural network portion maps said output information representative of a design to characteristics of the design.

24. The artificial neural network system of claim 23, wherein the object type is a material, the design is a representation of the material, and the characteristics mapped are properties of the material.

25. The artificial neural network system of claim 22, wherein the outputs produced by the first artificial neural network portion as it is perturbed include output information representative of a set of specifications of a device and wherein the second artificial neural network portion maps said output information representative of a set of specifications of a device to characteristics for given specifications.

26. The artificial neural network system of claim 22, wherein the second artificial neural network portion produces at least one output, the system further comprising means for monitoring at least one output of the second artificial neural network, and means for adjusting the perturbation of the first artificial neural network in response to the monitored output of the second artificial neural network.

27. The artificial neural network system of claim 22, wherein the second artificial neural network portion produces at least one output, the system further comprising operating means responsive to at least one of the outputs from one of the artificial neural network portions.

28. The artificial neural network system of any one of claims 19 to 27, wherein the outputs produced by the first artificial neural network as it is perturbed include output information representative of sensory information.

29. The artificial neural network system of any one of claims 19 to 28, wherein the first artificial neural network is a recurrent neural network.

30. The artificial neural network system of any one of claims 19 to 29, wherein the knowledge domain established in the first artificial neural network portion includes information representative of variations in a solution to a problem.

31. The artificial neural network system of any one of claims 19 to 29, wherein the knowledge domain established in the first neural network portion includes information representative of steps of a process.

32. The artificial neural network system of claim 31, wherein, as the first artificial neural network is perturbed the outputs therefrom represent possible novel steps in the process.

33. The artificial neural network system of any one of claims 19 to 32, wherein the first artificial neural network portion includes a plurality of stages each capable of being operated independently of the others.

34. The artificial neural network system of any one of claims 19 to 32, wherein the first artificial neural network portion includes a plurality of weights, biases, and activation levels associated therewith, and the means for perturbing the first artificial neural network portion includes means for altering at least one of the weights, biases, or activation levels thereof.

35. A method for deriving non-standard design concepts for a given field of endeavour from a previously trained artificial neural network that is normally operable to produce only established outputs reflective of known design concepts in response to a pattern of inputs, comprising the steps of:
(a) providing a first artificial neural network, said first artificial neural network having been previously trained in a predefined field of endeavour and having an input portion, an output portion, and a particular established knowledge domain for the predefined field of endeavour, which first previously trained neural network is normally operable in accordance with its basic design constraints and its established knowledge domain to produce at its output portion established outputs reflective of standard design concepts in response to patterns of inputs supplied to the neural network at the input portion thereof;
(b) perturbing the first previously trained neural network to degrade the previously trained operation thereof to thereby effect a change in the operation of the neural network, subject to design constraints of the first previously trained neural network that remain in effect, to effect production, for a given pattern of inputs supplied to the first neural network, of data outputs that are distinct from the corresponding data outputs that would be produced by said first neural network in the absence of such network perturbation, which distinct data outputs remain subject to the unchanged design constraints of the first neural network but identify distinct non-standard design concepts in the predefined field of endeavour;
(c) monitoring the first neural network to detect the data outputs produced thereby in response to perturbations; and (d) selecting from among the data outputs certain data outputs which meet given criteria of acceptability as useful and creative non-standard design concepts within the predefined field of endeavour.

36. The method of claim 35, wherein said output portion of said first neural network includes a plurality of output node activations and step (c) includes:
(i) establishing a second artificial neural network having a knowledge domain including predetermined criteria of acceptability; and (ii) providing at least one output node activation from the first artificial neural network as an input to the second artificial neural network.

37. The method of claim 35, wherein said output portion of said first neural network includes a plurality of output node activations and at least some of the data outputs produced in step (b) represent a design for a predetermined object type and wherein step (c) includes:
(i) establishing a second artificial neural network having a knowledge domain including characteristics of the predetermined object type; and (ii) providing at least one output node activation from the first artificial neural network to the second artificial neural network.

38. The method of claim 35, wherein step (b) includes:
(i) degrading the knowledge domain contained in the first artificial neural network.

39. The method of claim 38, wherein in step (b)(i) the knowledge domain of the first artificial neural network is progressively degraded.

40. The method of claim 35, wherein step (b) includes:
(i) repetitively perturbing the first artificial neural network such that the knowledge domain thereof is repetitively degraded.

41. An artificial neural network-based system for determining, for a specified knowledge domain in a given field of endeavor as represented in a neural network, desired concepts and relationships within such predefined field of endeavor, comprising a neural network portion having an output portion at which data outputs are produced, said neural network portion including an artificial neural network that has an input portion and which is operable to effect production of a data output from said output portion of said neural network portion when an input pattern is supplied to said artificial neural network at the input portion thereof, said artificial neural network having been previously trained in accordance with training exemplars in a given predefined field of endeavor to establish a particular knowledge domain therein and being normally operable in accordance with the constraints embodied in its design and the established knowledge domain to produce standard data outputs in response to input patterns supplied to said previously trained artificial neural network at the input portion thereof, a monitor portion associated with said neural network portion to observe data outputs produced at the output portion of neural network portion, and a network perturbation portion for perturbing said neural network portion to effect changes, subject to constraints embodied in the design of the previously trained artificial neural network that remain unperturbed, in the data outputs produced by said neural network portion at the output portion of said neural network portion, said network perturbation portion operable such that production of a data output by said neural network portion thereafter effects a perturbation by said network perturbation portion of said neural network portion, such perturbation driving an operation of said artificial neural network to effect production of a data output from said neural network portion, the data output so produced establishing, based in part upon the particular varied perturbation effected, an input-perturbation-output mapping relationship within said predefined field of endeavor, said monitor portion operable to detect and to identify, from among the data outputs being produced over a period of time at the output portion of said neural network portion when said neural network portion is so perturbed, data outputs which satisfy certain predefined criteria as preselected by a user, identification of a data output that satisfies the predefined criteria determining a desired concept within the predefined field of endeavor, which desired concept is associated with a particular input-perturbation-output mapping relationship established during operation of said system.

42.The system of claim 41, wherein the monitor portion includes a comparator portion that operates to identify from among the observed data outputs being produced at the output portion of the neural network portion certain data patterns in said observed data outputs which satisfy said predefined criteria.

43. The system of claim 42, wherein the network perturbation portion includes means for introducing internal perturbations to said previously trained artificial neural network to thereby effect a change in the operation thereof, subject to the constraints embodied in the design that remain in effect, to thereby effect production at the output portion of said neural network portion, for given input patterns being supplied to said previously trained artificial neural network, of data outputs that are distinct from the corresponding standard data outputs that would be produced in response to such given pattern of inputs by said previously trained artificial neural network in the absence of such network perturbation, which distinct data outputs remain subject to the unchanged constraints embodied in the design of said previously trained artificial neural network but identify distinct concepts in the predefined field of endeavor.

44. The system of claim 43, wherein the predefined criteria have been selected such that a data output from said neural network portion which satisfies such predefined criteria is a desired concept within the given field of endeavor.

45. The system of claim 43, wherein the monitor portion includes a program routine.

46. The system of claim 43, wherein the monitor portion comprises a second previously trained neural network.

47. The system of claim 43, wherein a subsequent perturbation of said neural network portion is determined at least in part by the response of said monitor portion to a prior data output of said neural network portion.

48. The system of claim 42, wherein the network perturbation portion includes means for introducing external perturbations to said previously trained artificial neural network to vary the particular pattern of inputs as presented at the input portion of said previously trained artificial neural network to thereby establish, upon the production of a data output in response to the particular pattern of inputs as presented, an input-output data pairing relationship.

49. The system of claim 48, wherein the predefined criteria have been selected to represent a particular desired pattern within a data output from said neural network portion, whereby, upon satisfaction of said predefined criteria, the determined input-output pairing relationship identifies a data input that results in the data output that satisfies such predefined criteria.

50. The system of claim 48, further characterized in that the monitor portion includes a program routine.

51. The system of claim 48, wherein the monitor portion comprises a second previously trained neural network.

52. The system of claim 48, wherein said means for introducing external perturbations includes a second previously trained artificial neural network and associated means for generating varied input patterns to said previously trained artificial neural network.

53. The system of any one of claims 41 to 52, wherein said network perturbation portion is operable to effect perturbations of said neural network portion in a substantially random manner.

54. The system of any one of claims 41 to 53, wherein said artificial neural network includes an input layer, an output layer, and at least one hidden layer.

55. The system of any one of claims 41 to 54 including a storage medium associated with said monitor portion for retaining and storing data representative of said established input-perturbation-output mapping relationships.

56. The system of any one of claims 41 to 55 including a system output portion associated with said monitor portion for receiving data representative of said established input-perturbation-output mapping relationships and formatting said data for use in external systems.

57. A method for determining, for a specified knowledge domain in a given field of endeavor as represented in a neural network, desired concepts and relationships within such predefined field of endeavor, comprising the steps of:
(a) providing a neural network object having an output portion at which data outputs are produced and including an artificial neural network having an input portion and which is operable to effect production of data outputs at said output portion of said neural network object in response to input patterns supplied to said input portion of said artificial neural network, the data outputs so produced having particular data patterns associated therewith, said artificial neural network having been previously trained in accordance with a set of given training exemplars in a predefined field of endeavor and having a particular established knowledge domain for the predefined field of endeavor, which previously trained neural network is normally operable in accordance with the constraints embodied in its design and its established knowledge domain to produce at said output portion, in response to input patterns supplied to the neural network at the input portion thereof, standard data outputs representative of known concepts and having associated input-perturbation-output mapping relationships, (b) perturbing the neural network object to drive an operation of the neural network object and to effect a change in the data outputs produced thereby, such changed data outputs having input-perturbation-output mapping relationships that differ from the input-perturbation-output mapping relationships of the given training exemplars and their associated standard data outputs, (c) monitoring the neural network object over a period of time to detect the data outputs produced thereby in response to perturbations and to identify from among the data outputs those data patterns which satisfy predefined criteria of acceptability, identification of a data pattern that satisfies the predefined criteria determining a particular concept within the predefined field of endeavor, which concept has associated therewith a particular input-perturbation-output mapping relationship.

58. The method of claim 57, wherein step (b) includes the step of:
internally perturbing said artificial neural network to thereby effect a change in the operation thereof, subject to the constraints embodied in the design that remain in effect, to thereby effect production at said output portion, for given input patterns being supplied to said previously trained artificial neural network, of data outputs that are distinct from the corresponding standard data outputs that would be produced in response to such given input patterns by said previously trained artificial neural network in the absence of such network perturbation, which distinct data outputs remain subject to the unchanged constraints embodied in the design of said previously trained artificial neural network but identify distinct concepts in the predefined field of endeavor.

59. The method of claim 57, wherein step (b) includes the step of:

introducing external perturbations to said previously trained artificial neural network to vary the particular input patterns as presented at the input portion of said previously trained artificial neural network to thereby establish, upon the production of an output in response to the particular input pattern as presented, an input-output data pairing relationship.

60. The method of claim 57, wherein the predefined criteria have been selected to represent a particular desired pattern within a data output from said previously trained neural network, whereby, upon satisfaction of said predefined criteria, the determined input-output pairing relationship identifies a data input that results in the data output that satisfies such predefined criteria.

61. An artificial neural network-based system for obtaining, for a specified knowledge domain in a given field of endeavor as represented in a neural network, a desired concept within such predefined field of endeavor, comprising a neural network portion including an artificial neural network object having a plurality of interrelated nodes disposed in at least an input layer, an output layer, and at least one intermediate layer, said nodes of said input layer connected to receive data inputs supplied thereto, at least one node of said neural network object connected to receive a selection criteria input, said neural network object having been previously trained in a given predefined field of endeavor, with non-restrictive selection criteria input, to establish a particular knowledge domain in said neural network object, said neural network object, after such training, operable in accordance with the constraints embodied in its design and the established knowledge domain, when a non-restrictive selection criteria input is being supplied thereto, to produce standard outputs therefrom which are representative of concepts consistent with the training of said neural network object, a neural network perturbation portion for perturbing said artificial neural network object to drive an operation of said neural network object and to effect changes, subject to constraints embodied in the design of the artificial neural network that remain unperturbed and when a non-restrictive selection criteria input is supplied, in the outputs produced by said artificial neural network object, said neural network object being normally operable, upon being perturbed by said neural network perturbation, when a predefined restrictive selection criteria as preselected by a user is supplied as a selection criteria input and such selection criteria is satisfied, to produce an output therefrom, which output is representative of a desired concept, and a system output portion for receiving outputs that are representative of a desired concept in accordance with the predefined restrictive selection criteria.

62. The system of claim 61, wherein said neural network object includes first and second artificial neural networks, said first artificial neural network connected to receive said data inputs and to produce data outputs in response thereto, said second artificial neural network connected to receive said predefined selection criteria and at least some of said data outputs produced by said first artificial neural network.

63. An artificial neural network-based system for determining, for a specified knowledge domain in a given field of endeavor as represented in a neural network, desired concepts and relationships within such predefined field of endeavor, comprising a neural network portion including an artificial neural network that has an input portion and an output portion and is operable to produce outputs at said output portion when inputs are supplied to said artificial neural network at the input portion thereof, said artificial neural network having been previously trained in accordance with training exemplars in a given predefined field of endeavor to establish a particular knowledge domain therein and being normally operable in accordance with the constraints embodied in its design and the established knowledge domain to produce standard outputs in response to a pattern of inputs supplied to said previously trained artificial neural network at the input portion thereof, a neural network perturbation portion for perturbing said neural network portion to degrade said neural network portion and the knowledge domain of said neural network to effect changes, subject to constraints embodied in the design of the artificial neural network that remain unperturbed, in the outputs produced by said neural network portion at the output portion of said neural network portion, said changed outputs differing from the standard outputs that would be produced by said neural network portion if the knowledge domain of said neural network were not degraded, each output so produced establishing an input-perturbation-output mapping relationship within said predefined field of endeavor, and a monitor portion associated with said neural network portion to observe the outputs produced at the output portion of the artificial neural network over a period of time and to identify from among said outputs so produced particular outputs that satisfy predefined criteria as preselected by a user, identification of an output that satisfies the predefined criteria determining a desired concept within the predefined field of endeavor, which desired concept is associated with a particular input-perturbation-output mapping relationship established during operation of said system.

64. An artificial neural network-based system for determining, for a specified knowledge domain in a given field of endeavor as represented in a neural network, a sought-for set of perturbations applicable to such knowledge domain that will produce a desired targeted result, comprising an artificial neural network that has an input layer, an output layer, and at least one hidden layer, and which is operable to produce outputs from said output layer when inputs are supplied to the input layer of said artificial neural network, said artificial neural network having been previously trained in accordance with training exemplars in a predefined field of endeavor to establish a particular knowledge domain therein, a network perturbation portion for iteratively perturbing said artificial neural network to effect iterative changes, subject to design constraints of the artificial neural network that remain unperturbed, in the outputs produced by said artificial neural network, the combined set of perturbations applied to said artificial neural network in any given iteration constituting a candidate set of perturbations, and a monitor portion associated with said artificial neural network to observe said data outputs produced by the artificial neural network in response to candidate sets of perturbations, said monitor portion including a comparator portion that operates to identify from among the observed data outputs being produced by the artificial neural network certain data patterns in said observed data outputs which satisfy predefined target criteria, identification of a data output that satisfies the predefined criteria determining a particular perturbation-output mapping relationship and establishing the candidate set of perturbations that has produced the desired targeted result as the sought-for set of perturbations.

65. The system of claim 64, wherein the monitor portion includes an archive portion to archive said sought-for set of perturbations.

66. The system of claim 65, wherein the network perturbation portion includes a data input generator portion for introducing external perturbations to said previously trained artificial neural network to vary the particular pattern of inputs as presented at the input portion of said previously trained artificial neural network to thereby establish, upon the production of an output in response to the particular pattern of inputs as presented, an input-output data pairing relationship.

67. The system of claim 66, wherein the predefined target criteria have been selected to represent a particular desired pattern within a data output from said artificial neural network, whereby, upon satisfaction of said predefined criteria, the determined input-output pairing relationship identifies a set of input data that represents the sought-for set of perturbations.

68. The system of claim 66, wherein said data input generator portion includes a neural network portion for generating and providing varied inputs to said previously trained artificial neural network, said neural network portion including a second previously trained neural network.

69. The system of claim 66, wherein sets of external perturbations are representative of candidate designs and said outputs produced in response thereto represent performance characteristics of said candidate designs.

70. The system of claim 65, wherein the network perturbation portion includes means for introducing internal perturbations to said previously trained artificial neural network to vary the operational process of said previously trained artificial neural network to thereby establish, upon the production of an output in response to the particular set of internal perturbations as effected in said artificial neural network, a perturbation-output data pairing relationship.

71. The system of claim 70, wherein the predefined criteria have been selected to represent a particular desired pattern within a data output from said previously trained neural network, whereby, upon satisfaction of said predefined criteria, the determined perturbation-output pairing relationship identifies an operational process that results in the data output that satisfies such predefined criteria.

72. The system of claim 70, wherein sets of internal perturbations are representative of candidate process steps and said output produced in response thereto represents performance characteristics of said candidate process steps.

73. The system of any one of claims 64 to 72, wherein said network perturbation portion is operable to effect perturbations of said previously trained neural network in a substantially random manner.

74. The system of any one of claims 64 to 73 including a storage medium associated with said monitor portion for retaining and storing data representative of said established perturbation-mapping relationships.

75. The system of claim 74, wherein said data stored by said storage medium includes data representative of the inputs supplied to said input layer of said artificial neural network.

76. The system of any one of claims 64 to 75 including a system output portion associated with said monitor portion for receiving data representative of said established perturbation-output mapping relationships and formatting said data for use in external systems.

77. The system of claim 76, wherein said data received by said system output portion includes data representative of the inputs supplied to said input layer of said artificial neural network.

78. A method for determining, for a specified knowledge domain in a given field of endeavor as represented in a neural network, a sought-for set of perturbations applicable to such knowledge domain that will produce a desired targeted result, comprising the steps of:
(a) providing an artificial neural network, said artificial neural network having been previously trained in accordance with a set of given training exemplars in the predefined field of endeavor and having an input portion, an output portion, at least one hidden layer, and a particular established knowledge domain for the predefined field of endeavor, (b) perturbing said previously trained artificial neural network to effect production of a data output thereby, (c) monitoring the neural network to detect the data output produced thereby in response to the set of perturbations applied thereto and determining whether or not such data output satisfies predefined target criteria and either (i) proceeding to step (b) if the predefined target criteria are not satisfied, or (ii) archiving the set of perturbations applied to said artificial neural network.

79. The method of claim 78, wherein step (b) includes externally perturbing said artificial neural network.

80. The method of claim 79, wherein step (b) includes providing a second artificial neural network operable to produce candidate sets of data for presentment to said first artificial neural network.

81. The method of claim 80, wherein said archived set of perturbations corresponds to the candidate set of data that results in the data output that satisfies the predefined target criteria.

82. The method of claim 78, wherein step (b) includes the step of:
introducing external perturbations to said previously trained artificial neural network to vary the particular pattern of inputs as presented at the input portion of said previously trained artificial neural network to thereby establish, upon the production of an output in response to the particular pattern of inputs as presented, an input-output data pairing relationship.

83. The system of claim 82, wherein the predefined target criteria have been selected to represent a particular desired pattern within a data output from said previously trained neural network, whereby, upon satisfaction of said predefined target criteria, the determined input-output pairing relationship identifies a data input that results in the data output that satisfies such predefined target criteria.

84. The method of claim 83, wherein step (b) includes internally perturbing said artificial neural network.