US20040260515A1 - Generalized lensing angular similarity operator - Google Patents

Generalized lensing angular similarity operator Download PDF

Info

Publication number
US20040260515A1
US20040260515A1 US10/892,808 US89280804A US2004260515A1 US 20040260515 A1 US20040260515 A1 US 20040260515A1 US 89280804 A US89280804 A US 89280804A US 2004260515 A1 US2004260515 A1 US 2004260515A1
Authority
US
United States
Prior art keywords
similarity
domain
lensing
snapshots
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/892,808
Inventor
Stephan Wegerich
R. Pipke
Andre Wolosewicz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SmartSignal Corp
Original Assignee
SmartSignal Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SmartSignal Corp filed Critical SmartSignal Corp
Priority to US10/892,808 priority Critical patent/US20040260515A1/en
Publication of US20040260515A1 publication Critical patent/US20040260515A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0218Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterised by the fault detection method dealing with either existing or incipient faults
    • G05B23/0224Process history based detection method, e.g. whereby history implies the availability of large amounts of data
    • G05B23/024Quantitative history assessment, e.g. mathematical relationships between available data; Functions therefor; Principal component analysis [PCA]; Partial least square [PLS]; Statistical classifiers, e.g. Bayesian networks, linear regression or correlation analysis; Neural networks
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B17/00Systems involving the use of models or simulators of said systems
    • G05B17/02Systems involving the use of models or simulators of said systems electric

Definitions

  • the present invention relates generally to equipment and process monitoring, and more particularly to monitoring systems instrumented with sensors that measure correlated phenomena.
  • the present invention further relates to modeling instrumented, real-time processes using the aggregate sensor information to ascertain information about the state of the process.
  • One problem is the difficulty of selecting a threshold for a dynamic parameter that avoids a burdensome number of false alarms, yet catches real alarms and provides sufficient warning to take corrective action when a system parameter—as measured by a sensor—moves outside of acceptable operation.
  • Another problem is posed by sensor failure, which may result in spurious parameter values. It may not be clear from a sensor data value that the sensor has failed. Such a failure can entirely undermine monitoring of the subject system.
  • Known methods for viewing aggregate sensor data typically employ a modeling function that embodies prior knowledge of the system.
  • One such technique known as “first-principles” modeling requires a well-defined mathematical description of the dynamics of the system, which is used as a reference against which current aggregate sensor data can be compared to view nascent problems or sensor failures.
  • this technique is particularly vulnerable to even the slightest structural change in the observed system.
  • the mathematical model of the system is often very costly to obtain, and in many cases, may not be reasonably possible at all.
  • Another class of techniques involves empirically modeling the system as a “black box” without discerning any specific mechanics within the system. System modeling using such techniques can be easier and more resilient in the face of structural system changes. Modeling in these techniques typically involves providing some historic sensor data corresponding to desired or normal system operation, which is then used to “train” the model.
  • sensor data is gathered from a plurality of sensors measuring correlated parameters of a system in a desired operating state. This historical data is used to derive an empirical model comprising certain acceptable system states.
  • Real-time sensor data from the system is provided to a modeling engine embodying the empirical model, which computes a measure of the similarity of the real-time state to all prior known acceptable states in the model. From that measure of similarity, an estimate is generated for expected sensor data values. The real-time sensor data and the estimated expected sensor data are compared, and if there is a discrepancy, corrective action can be taken.
  • BART The bounded area ratio test as taught in U.S. Pat. No. 5,987,399, is a well known state of the art similarity operator, wherein an angle is used to gauge the similarity of two values.
  • the similarity operator is insensitive to variations across the training set range of the particular signal or sensor.
  • BART uses the sensor range of values from low to high across all snapshots in the training set to form the hypotenuse of a triangle—preferably a right triangle—which is its base. BART, therefore, forms a straight line with minimum and maximum expected values disposed at either end.
  • BART periodically maps two points representative of an expected and a parameter value onto the base. These two points are placed, according to their values, within the range of values in the training set.
  • a comparison angle is formed at the apex, opposite the base, by drawing a line to the apex from each of the points and the angle is the basis by which two values are compared for similarity. Furthermore, BART typically locates the apex point at a point above the median or mean of the range, and at a height that provides a right angle at the apex (for easy computation).
  • BART does not exhibit equal sensitivity to similarity values across the base range. Differences between values in the middle of the range, i.e., around 45° are amplified, and differences at the ends of the range, i.e., at 0° or 90° are diminished. Consequently, prior models, such as those employing a BART operator or other operators, might not optimally model all non-linear systems. In certain value ranges for certain sensors, these prior models may be inaccurate. Apart from selecting new or additional training data, both of which require additional time, as well as computer capacity, without providing any guarantee of improving the model, no effective way has been found in the prior art to adjust the empirical model to improve modeling fidelity.
  • the present invention provides for monitoring equipment, processes or other closed systems instrumented with sensors and periodically, aperiodically or randomly recording a system snapshot therefrom.
  • a monitored system e.g., equipment, a process or any closed system
  • the improved operators provide for modeling with heightened or adjusted sensitivity to system state similarity for particular ranges of sensor values.
  • the invention thus provides for greater possible fidelity of the model to the underlying monitored system.
  • the similarity between a system data snapshot and a selected known state vector is measured based on similarity values between corresponding parameter values from the data snapshot and the selected known state vector.
  • Each similarity value is effectively computed according to a ratio of angles formed by the difference of the corresponding data values and by the range of corresponding values across all the known state vectors.
  • the ratio of angles is affected by the location within this range of the data value from the snapshot and the data value from the selected known state vector.
  • the similarity engine can be flexibly honed to focus as through a lens on certain parts of the range with altered sensitivity, expanding or contracting those parts.
  • the similarity operator class of this invention can be used in a multivariate state estimation technique (MSET) type process monitoring technique as taught in U.S. Pat. No. 5,764,509, and can also be used for a variety of complex signal decomposition applications.
  • a complex signal can be decomposed into components (e.g., a frequency domain or wavelets), which are input to this MSET similarity engine.
  • the similarity operator can be embodied both as general purpose computer software for a mainframe computer or a microprocessor or as code for an embedded processor.
  • the result of the similarity operation can be used for generating estimated or expected states, or for identifying which one of a finite set of patterns stored in memory that most closely matches the input pattern.
  • the present invention By allowing selection of a curve instead of the base of a triangle in combination with angle selection, the present invention adds the advantage of providing a lens function for “lensing” certain parts of the range for greater or lesser sensitivity to differences that, ultimately, are reflected in the similarity for the two values. Where ease of computation is not an issue, the present invention provides improved lensing flexibility that allows freeform location of the apex point at different locations above the base.
  • lensing provides a means for focusing focus in a particular range for a given sensor, when performing a similarity determination between a current state vector and a prior known expected state vector.
  • an estimated state vector can be computed for a real-time system that is being monitored and modeled using MSET or the like.
  • the model performance can be honed for improved model estimates using the improved class of similarity operators of the present invention.
  • the similarity operation of the present invention is rendered particularly non-linear and adaptive.
  • the present invention can be used in system state classification, system state alarm notification, system virtual parameter generation, system component end of life determination and other techniques where an empirical model is useful.
  • the present invention overcomes the above restrictions of the prior art methods by providing more flexibility to adapt and improve modeling fidelity.
  • the present invention also includes a similarity engine in an information processor embodiment.
  • Preprocessed known state vectors characteristic of a desired operating condition, i.e., historic data, of a monitored system are stored in memory.
  • a data acquisition unit acquires system parameter data, such as real-time sensor data, representative of the current state of the monitored system.
  • the information processor is coupled to the memory and to the data acquisition system, and operates to process one system state frame or snapshot at a time from the data acquisition unit against the known state vector snapshots in the memory.
  • a measure of similarity is computed between system state snapshots from the data acquisition unit and each known state vector in the memory.
  • An expected state vector is computed from the snapshot for the monitored system.
  • the information processor may be further disposed to compare the state snapshots with the expected state vectors sequentially, to determine if they are the same or different. This determination can be used for an alarm or event trigger.
  • an empirical modeling module for modeling non-linearly and linearly correlated signal inputs using a non-linear angular similarity function with variable sensitivity across the range of a signal input is described. Different angle-based similarity functions can be chosen for different inputs to improve sensitivity particular to the behavior of that input. Sections of interest within a range of a signal input can be lensed for particular sensitivity.
  • FIG. 1 is a functional block diagram of an example of an empirical modeling apparatus for monitoring an instrumented system
  • FIGS. 2 and 3 are diagrams showing an example of a prior art similarity operator
  • FIG. 4 is a diagram generally showing an example of a similarity operator according to the invention.
  • FIG. 5 illustrates distillation of sensor data to create a training data set representative of the similarity domain
  • FIG. 6 shows the steps of a method of distilling sensor data to a training set for use with the present invention
  • FIG. 7A is a diagram showing an example of a polynomial embodiment of a similarity operator according to the invention.
  • FIG. 7B is a diagram showing an example of an elliptical embodiment of a similarity operator according to the invention.
  • FIG. 7C is a diagram showing an example of a trigonometric embodiment of a similarity operator according to the invention.
  • FIG. 8A is a diagram showing an example of the lensing effect of the similarity operator of the present invention.
  • FIG. 8B is a diagram showing an example of an alternative approach to the use of the lensing effect of the similarity operator of the present invention.
  • FIGS. 9A-9D through 12 A- 12 D illustrate alternate embodiments showing extension of range and lensing functions in similarity operators in accordance with the invention
  • FIGS. 13A-13B are flow diagrams showing preferred methods of generating a generalized lensing Similarity Operator.
  • FIG. 14 is yet another embodiment of the similarity operator of the present invention showing discontinuous lensing effects.
  • the inventive system 100 in a preferred embodiment comprises a data acquisition module 102 , an information processor 104 , a memory 106 and an output module 108 , which can be coupled to other software, to a display, to an alarm system, or any other system that can utilize the results, as may be known in the art.
  • the processor 104 generally may include a Similarity Engine 110 , an Estimated State Generator 112 and a Deviation Detection Engine 114 .
  • Memory 106 stores a plurality of selected time-correlated snapshots of sensor values characterizing normal, optimal, desirable or acceptable operation of a monitored process or machine.
  • This plurality of snapshots distilled according to a selected “training” method as described below, comprises an empirical model of the process or machine being monitored.
  • the inventive monitoring system 100 samples current snapshots of sensor data via acquisition module 102 .
  • the estimates for the sensors can be generated by the Estimated State Generator 112 according to:
  • D is a matrix comprised of the plurality of snapshots in memory 106 and W is a contribution weighting vector determined by Similarity Engine 110 and Estimated State Generator 112 using a similarity operator such as the inventive class of similarity operators of the present invention.
  • the multiplication operation is the standard matrix/vector multiplication operator.
  • T superscript denotes transpose of the matrix
  • Y(in) is the current snapshot of actual, real-time sensor data.
  • the improved similarity operator of the present invention is symbolized in the equation above as .
  • Yin is the real-time or actual sensor values from the underlying system, and therefore it is a vector snapshot.
  • the similarity operation typically returns a scalar value between 0 and 1 for each comparison of one vector or matrix row to another vector. It represents a numeric quantification of the overall similarity of two system states represented by two snapshots of the same sensors. A similarity value closer to 1 indicates sameness, whereas a similarity value closer to 0 typically indicates difference.
  • Deviation detection engine 114 receives both the actual current snapshot of sensor values and the set of sensor value estimates from the estimated state generator 112 , and compares the two.
  • a variety of tests can be used, including the sequential probability ratio test (SPRT), or a CUSUM test, both of which are known in the art.
  • SPRT sequential probability ratio test
  • CUSUM test CUSUM test
  • the set of actual sensor values and the set of estimated sensor values are differenced to provide residual values, one for each sensor. Applying the SPRT to a sequence of such residual values for a given sensor provides an advantageously early indication of any difference between the actual sensor values and what is expect under normal operation.
  • FIG. 2 graphically illustrates the prior art BART similarity operation wherein a right triangle 120 is formed having a monotonically linear base 122 bounded by the range for a given sensor in training data, the range minimum and maximum forming vertices 124 , 126 at opposite ends of the base 122 .
  • the triangle 120 was formed preferably as a right triangle with the right angle located at height (h) above the median of the range data along the base 122 . In this prior art method the height (h) was required to be chosen so that the apex angle is a right angle.
  • each value was plotted along the base between minimum 124 and maximum 126 according to its value, and lines 128 and 129 were drawn from the apex to each plotted point X 0 and X 1 , forming an angle therebetween.
  • the similarity of the two values was then computed as a function of the comparison of the formed angle ⁇ to the right angle ⁇ of the apex.
  • FIG. 3 which shows each of two different comparisons 130 , 132 , equally spaced pairs of values are compared in each instance for similarity by mapping the value pairs in the range for the sensor along the base 134 .
  • One of each of the pairs represents a sensor value from a training set vector and the other of the pair represents a sensor value from an input data vector.
  • Each pair of values identifies a segment that, in combination with the apex, identifies a smaller triangle within the original right triangle.
  • the angle in each of the smaller triangles 136 , 138 that shares the apex and is a fraction of the right angle, provides a measure of similarity for the respective pair of values when scaled against the full ninety degrees (90°) of the right angle. This angle is zero degrees (0°) for an identical pair and 90° for a completely dissimilar pair at the extrema of the range stored in the training set.
  • the inventors have found that the restrictions of the prior art analysis method, i.e. a right triangle based model with its apex at the right angle and disposed immediately above the median value on the base (hypotenuse) for the particular parameter, may be ignored to provide a more useful, flexible and all encompassing analysis tool. Further, the inventors have determined that the analysis model need not be triangular at all but merely defined by two partial rays of an angle extending to endpoints identified by either a system parameter minimum or maximum and connected therebetween by a curve that may be linear or non-linear. The curve may be selected, for example, to highlight one region of operation while de-emphasizing another or others as set forth herebelow.
  • FIG. 4 The most general form of the similarity operation of the invention is shown in FIG. 4.
  • a range of data for a given parameter sensor across a training set is mapped to an arc length forming the curve 140 and being identified as a Similarity Domain.
  • An apex location 142 may be chosen above the similarity domain curve 140 , and an angle ⁇ is defined by connecting the apex with straight line segments 144 and 146 to the ends of the similarity domain 140 . Alternately, an angle may be selected and an apex location 142 derived accordingly.
  • the similarity domain (being the curve length) for a given sensor or parameter in a monitored system can be mapped by equating one end of the curve to the lowest value observed across the reference library or training set for that sensor, and equating the other end to the highest value observed across the training set for that sensor.
  • the length between these extrema is scaled linearly (or in some other appropriate fashion, e.g., logarithmically where appropriate).
  • expected lower and upper limits for a sensor can be chosen based on knowledge of the application domain, e.g., industrial, medical, etc., know-how.
  • the similarity domain can be mapped using the extrema of the original data set from which the reference library or training set is distilled. This can be advantageous if the training method does not necessarily include the highest and lowest sensor readings.
  • the similarity value S is closer to one for value pairs that are more similar, and S is closer to zero for value pairs that are less similar.
  • the elemental similarities are calculated for each corresponding pairs of sensor values (elements) of the two snapshots being compared. Then, the elemental similarities are combined in some statistical fashion to generate a single similarity scalar value for the vector-to-vector comparison.
  • the general result of the similarity operation of the present invention applied to two matrices is a matrix (or vector) wherein the element of the i th row and j th column is determined from the i th row of the first operand and the j th column of the second operand.
  • the resulting element (i,j) is a measure of the sameness of these two vectors.
  • the i th row of the first operand generally has elements corresponding to sensor values for a given temporally related state of the process or machine, and the same is true for the j th column of the second operand.
  • the resulting array of similarity measurements represents the similarity of each state vector in one operand to each state vector in the other operand.
  • two vectors are compared for similarity according to equation 4 above on an element-by-element basis. Only corresponding elements are compared, e.g., element (i,m) with element (m,j) but not element (i,m) with element (n,j).
  • the similarity is given by equation 4, with reference to a similarity operator construct as in FIG. 4.
  • the similarity is equal to one, and if the values are grossly unequal, the similarity approaches zero.
  • the overall similarity of the two vectors is equal to the average of the elemental similarities.
  • a different statistical combination of the elemental similarities can also be used in place of averaging, e.g., median.
  • the matrix D of reference snapshots stored in memory 106 characterizing acceptable operation of the monitored process or machine is composed using a method of training, that is, a method of distilling a larger set of data gathered from the sensors on the process or machine while it is running in known acceptable states.
  • FIG. 5 graphically depicts such a method for distilling the collected sensor data to create a representative training data set (D matrix) for defining a Similarity Domain.
  • D matrix representative training data set
  • the sample number or a time stamp of the collected sensor data is on the abscissa axis 162 , where the data is digitally sampled and the sensor data is temporally correlated at each sample.
  • the ordinate axis 164 represents the relative magnitude of each sensor reading over the samples or “snapshots.”
  • each snapshot represents a vector of five elements, one reading for each sensor in that snapshot. Of all the sensor data collected (in all of the snapshots), according to this training method example, only those five-element snapshots are included in the representative training set that contain either a global minimum or a global maximum value for any given sensor.
  • the global maximum 166 for sensor signal 152 justifies inclusion of the five sensor values at the intersections of line 168 with each sensor signal 152 , 154 , 156 , 158 , 160 , including global maximum 166 , in the representative training set, as a vector of five elements.
  • the global minimum 170 for sensor signal 152 justifies inclusion of the five sensor values at the intersections of line 172 with each sensor signal 152 , 154 , 156 , 158 , 160 . So, collections of such snapshots represent states the system has taken on and, that are expected to reoccur.
  • the pre-collected sensor data is filtered to produce a “training” subset that reflects all states that the system takes on while operating “normally” or “acceptably” or “preferably.”
  • This training set forms a matrix, having as many rows as there are sensors of interest, and as many columns (snapshots) as necessary to capture all the acceptable states without redundancy.
  • step 180 Data so collected in step 180 from N sensors at L observations or snapshots or from temporally related sets of sensor parameter data, form an array X of N rows and L columns.
  • an element number counter (i) is initialized to zero
  • an observation or snapshot counter (t) is initialized to one.
  • Two arrays, “max” and “min,” for containing maximum and minimum values respectively across the collected data for each sensor, are initialized to be vectors each of N elements which are set equal to the first column of X.
  • Two additional arrays, Tmax and Tmin for holding the observation number of the maximum and minimum value seen in the collected data for each sensor, are initialized to be vectors each of N elements, all zero.
  • step 200 counters i an j are initialized to one.
  • step 202 arrays Tmax and Tmin are concatenated to form a single vector Ttmp having 2N elements. These array elements are sorted into ascending (or descending) order in step 204 to form array T.
  • step 206 holder tmp is set to the first value in T (an observation number that contains a sensor minimum or maximum). The first column of D is set equal to the column of X corresponding to the observation number that is the first element of T.
  • the ith element of T is compared to the value of tmp that contains the previous element of T.
  • step 210 If the two adjacent values of T are equal indicating that the corresponding observation vector is a minimum or maximum for more than one sensor, then, it has already been included in D and need not be included again.
  • Counter i is incremented in step 210 . If the two adjacent values are not equal, D is updated to include the column from X that corresponds to the observation number of T(i) in step 212 , and tmp is updated with the value at T(i).
  • the counter (j) is then incremented in step 214 .
  • step 216 if all the elements of T have been checked, then the distillation into training set D has finished in step 218 and D is stored in memory 106 .
  • the training set as selected according to the above method may additionally be augmented using a number of techniques. For example, once the snapshots selected according to the above Min-Max method are determined, the remaining original set of data may be selected from and added to the training set at regular time stamp intervals. Yet another way of adding more snapshots to the Min-Max training set involves randomly selecting a remaining number of snapshots from the original set of data.
  • the preferred similarity engine 110 is turned on with the underlying system being monitored, and through time, actual snapshots of real sensor values are input to the Similarity Engine 110 from Data Acquisition Unit 102 .
  • the output of the results from Similarity Engine 110 can be similarity values, expected values, or the “residual” values (being the difference between the actual and expected values).
  • One of these output types is selected and passed to the deviation detection engine 114 of FIG. 1, which then determines through a series of such snapshots, whether a statistically significant change has occurred as set forth hereinbelow.
  • the statistical significance engine effectively determines if those real values represent a significant change from the “acceptable” states stored in the D matrix.
  • a vector (Y) is generated in Estimated State Generator 112 of expected sensor values from contributions by each of the snapshots in D, which contributions are determined by a weight vector W.
  • W has as many elements as there are snapshots in D and W is determined according to equations 2 and 3 above.
  • the deviation detection engine 114 can implement a comparison of the residuals to selected thresholds to determine when an alert should be output of a deviation in the monitored process or machine from recognized states stored in the reference library.
  • a statistical test preferably the sequential probability ratio test (SPRT) can be used to determine when a deviation has occurred.
  • SPRT sequential probability ratio test
  • the basic approach of the SPRT technique is to analyze successive observations of a sampled parameter. A sequence of sampled differences between the generated expected value and the actual value for a monitored sensor signal should be distributed according to some kind of distribution function around a mean of zero.
  • Y n are the individual observations and H n are the probability distributions for those hypotheses.
  • This general SPRT test ratio can be compared to a decision threshold to reach a decision with any observation. For example, if the outcome is greater than 0.80, then decide H 1 is the case, if less than 0.20 then decide H 0 is the case, and if in between then make no decision.
  • the SPRT test can be applied to various statistical measures of the respective distributions.
  • a first SPRT test can be applied to the mean and a second SPRT test can be applied to the variance.
  • a positive mean test involves the ratio of the likelihood that a sequence of values belongs to a distribution H 0 around zero, versus belonging to a distribution H 1 around a positive value, typically the one standard deviation above zero.
  • the negative mean test is similar, except H 1 is around zero minus one standard deviation.
  • the variance SPRT test can be to test whether the sequence of values belongs to a first distribution H 0 having a known variance, or a second distribution H 2 having a variance equal to a multiple of the known variance.
  • the mean is zero, and the variance can be determined. Then in run-time monitoring mode, for the mean SPRT test, the likelihood that H 0 is true (mean is zero and variance is ⁇ 2 ) is given by: L ⁇ ( y 1 , y 2 , ... ⁇ , y n
  • the SPRT test is advantageous because a user-selectable false alarm probability ⁇ and a missed alarm probability ⁇ can provide thresholds against with SPRT mean can be tested to produce a decision:
  • H 2 where the residual forms a Gaussian probability density function with a mean of zero and a variance of V ⁇ 2 ; and H 0 where the residual forms a Gaussian probability density function with a mean of zero and a variance of ⁇ 2 .
  • Each snapshot of residuals (one residual “signal” per sensor) that is passed to the SPRT test module, can have SPRT test decisions for positive mean, negative mean, and variance for each parameter in the snapshot.
  • any such SPRT test on any such parameter that results in a hypothesis other than H 0 being accepted as true is effectively an alert on that parameter.
  • logic to be inserted between the SPRT tests and the output alerts, such that a combination of a non-H 0 result is required for both the mean and variance SPRT tests in order for the alert to be generated for the parameter, or some other such rule.
  • the output of the deviation detection engine 114 will represent a decision for each sensor signal input, as to whether the estimate is different or the same. These decisions, in turn, can be used to diagnose the state of the process or equipment being monitored. The occurrence of some difference decisions in conjunction with other sameness decisions can be used as an indicator of likely future machine health or process states. The SPRT decisions can be used to index into a diagnostic lookup database, automatically diagnosing the condition of the process or equipment being monitored.
  • any statistical hypothesis test as known by those skilled in the statistical arts can be substituted for the above-described application of SPRT.
  • decisioning methods known in the art such as fuzzy logic sets and neural networks can be used to render a decision with regard to the sameness or difference of the estimates and the actual values.
  • the location of the apex and the shape and length of the curve forming the similarity domain of the preferred embodiment can be selected to adjust sensitivity to similarity of two values differently for different parts of the Similarity Domain.
  • regions of interest for particular sensors can be lensed to enhance sensitivity to similarity, flexibility not available in prior techniques.
  • Mathematical methods for computing the angles ⁇ and ⁇ are known in the art, and can include numerical techniques for approximating the angles.
  • FIGS. 7 A-C show examples of particular forms of the similarity operator of the invention in which lensing is applied to the Similarity Domain.
  • the example of FIG. 7A shows a Similarity Domain defined by a polynomial curve 220 , in this example a function based on a polynomial including terms a fourth power, a third power, and a square.
  • FIG. 7B shows yet another example of a particular form of the similarity operator of the invention in which the Similarity Domain is defined by an elliptical arc 222 .
  • the elliptical arc 222 forms a convex similarity domain from the perspective of the apex and line segments forming angle ⁇ .
  • FIG. 8A shows an example wherein the lensing effect of the similarity operator according to the present invention is enhanced for visible understanding.
  • the Similarity Domain distance between value pairs at arcs 230 , 232 are of equal arc length, they are mapped to different areas of the similarity domain 234 .
  • these arcs 230 , 232 represent two separate pairs of values being compared for similarity with quite different results.
  • Similarity domain 234 is now mapped to from the straight baseline 802 , which provides the linear scale from an expected overall minimum 804 to an expected overall maximum 806 for the sensor, on which to map the sensor value differences 230 and 232 (which are equal differences, but at different parts of the expected range). Mapping sensor value differences 230 and 232 to the similarity domain 234 provides angles 810 and 812 . The angles 810 and 812 can be seen to be different, even though the length of the sensor value difference (either 230 or 232 ) is equal, hence providing the advantageous lensing effect. An angle 810 or 812 is compared to the overall angle Q to provide a measure of similarity as per the equations above for two sensor values that have a difference of 230 or 232 respectively.
  • FIGS. 9A-9D through 12 A- 12 D show examples of four additional alternate embodiments with lensing functions being defined according to sinusoidal and polynomial functions for use with the similarity operators.
  • FIG. 9A shows a cosine function 240 as the lensing function extending the range for ⁇ beyond 90° and showing equal length sensor value differences 903 , 905 , 907 , and 909 positioned over the cosine lensing function range.
  • Each length 903 , 905 , 907 and 909 represents a same sensor value difference, but located in a different part of the expected range for the sensors being compared.
  • FIG. 9B shows the corresponding similarity values generated by smoothly moving the equal length sensor value difference (same as 903 , etc., with a length of 0.2) across the entire range.
  • FIG. 9C provides a three-dimensional surface 242 illustrating a range of similarity values for the cosine lensing function 240 for a vertex 244 located at varying heights above the similarity domain, to demonstrate the effect on the similarity curve of FIG. 9B of the vertex height.
  • FIG. 9B illustrates a slice in surface 242 at a vertex height of 3.
  • FIG. 9D illustrates how changing the expected range angle ⁇ (in this example from 90° through 180°) results in changing similarity values.
  • FIG. 10A is an example wherein x 3 is applied as a lensing function to form curve 250 with vertex 252 selected thereabove.
  • FIG. 10B shows the effect of the lensing functions curve 250 on similarity values, which corresponds to vertex height ⁇ 1.2 on surface 254 of FIG. 10C.
  • the similarity values are plotted in FIG. 10B for the x 3 lensing function, illustrating a segment at approximately ⁇ 1.2 as showing a similarity value of 1.
  • the surface 254 of FIG. 10C illustrates the effect of vertex 252 height on similarity values.
  • FIG. 10D illustrates the incremental effect of increasing ⁇ above 90° to 180°.
  • FIGS. 11A and 12A illustrate analogous curves 260 , 270 formed using polynomial lensing functions of x 2 and x 4 , respectively.
  • FIGS. 11B-11C and 12 B- 12 C illustrate the similarity value and the effect of a variation in vertex height corresponding to FIGS. 10B-10C.
  • FIGS. 11D and 12D correspondingly illustrate variations in the Q range above 90° to 180°.
  • the similarity values are magnified, or lensed, when a pair of values falls along the similarity domain at a point where it is more orthogonal to the angle rays extending from the apex.
  • the similarity values are diminished where the pair of values falls along the similarity domain at a point where it is more parallel to the rays from the apex.
  • the lensing effect is further increased inversely with apex height, and distance of a portion of the similarity domain curve from the apex or vertex.
  • different similarity curves can be empirically tested to determine which works best for a given sensor.
  • the curve shapes can be numerical approximations (such as a lookup table of values) rather than equations for the curves.
  • a similarity domain curve can be qualitatively generated by selecting various subranges of the expected range for a sensor to be more or less lensed. This can be done with the use of a smooth curve with the use of a spline technique to join curve segments together to provide the necessary lensing. Alternatively, turning to FIG.
  • the invention may also be accomplished with a discontinuous similarity domain line 405 , such that a discontinuities 407 and 408 at the edges of a section 410 provide for a discrete jump in the distance from the vertex 415 , and thus a discrete change in the angle, since a given arc length along domain line 405 will generate a smaller angle at a greater distance from the vertex 415 .
  • FIG. 13A is a flow diagram of a first preferred embodiment 300 for generating a lensing operator according to the present invention.
  • sensor data is collected as described hereinabove.
  • minimum and maximum vectors are identified for each parameter such as for example as is done in FIG. 6.
  • a lensing function may be selected.
  • a Similarity Domain surface is generated based on the lensing function selected in step 306 .
  • the lensing surface is generated by identifying an origin with respect to the min and max values and then, generating curves to define the surface based on the origin and min/max values, each of the curves being generated with reference to a selected apex height. Then, any well known smoothing function may be applied to the curves to generate the surface.
  • the surface is stored for subsequent system monitoring which begins in step 312 .
  • an apex height is selected interactively.
  • the Similarity Operator is generated from the apex height and throughout monitoring, different apex heights may be selected to vary the lensing and to vary the view provided to an operator monitoring system operation.
  • FIG. 13B shows an alternate embodiment 320 wherein instead of varying apex height, viewing angle is varied. All steps except step 322 are identical to those at FIG. 13A and so, are labeled identically. Thus, in step 322 the operator is allowed to select different viewing angles and in step 316 the view of system operation is provided based on that selected viewing angle. In both embodiments, snapshots are taken of the monitored system and compared against training set vectors using the selected lensing Similarity Operator to provide enhanced system modeling and to facilitate better understanding of the system's current operating state.
  • the advantage afforded by lensing is that focus can be directed to different regions of interest in a particular range for a given sensor, when performing a similarity determination between a current state vector and a prior known expected state vector.
  • an estimated state vector can be computed for a real-time system that is being monitored and modeled using MSET or the like.
  • the model performance can be honed for improved model estimates using the improved class of similarity operators of the present invention.
  • the similarity operation of the present invention is rendered particularly non-linear and adaptive.
  • the present invention can be used in system state classification, system state alarm notification, system virtual parameter generation, system component end of life determination and other techniques where an empirical model is useful.
  • the present invention overcomes the above restrictions of the prior art methods by providing more flexibility to tweak and improve modeling fidelity.

Abstract

In a machine for monitoring an instrumented process or for analyzing one or more signals, an empirical modeling module for modeling non-linearly and linearly correlated signal inputs using a non-linear angular similarity function with variable sensitivity across the range of a signal input. A different angle-based similarity function can be chosen for different inputs for improved sensitivity particular to the behavior of that input. Sections of interest within a range of a signal input can be lensed for particular sensitivity.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 09/802,482, filed Mar. 9, 2001, which claims the benefit of priority under 35 U.S.C. §119(e) to U.S. Provisional Application No. 60/188,102 filed Mar. 9, 2000.[0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The present invention relates generally to equipment and process monitoring, and more particularly to monitoring systems instrumented with sensors that measure correlated phenomena. The present invention further relates to modeling instrumented, real-time processes using the aggregate sensor information to ascertain information about the state of the process. [0003]
  • 2. Description of the Related Art [0004]
  • Conventional methods are known for monitoring equipment or processes—generically “systems”—using sensors to measure operational parameters of the system. The data values from sensors can be observed directly to understand how the system is functioning. Alternatively, for unattended operation, it is known to compare sensor data values against stored or predetermined thresholds in an automated fashion, and generate an exception condition or alarm requiring human intervention only when a sensor datum value exceeds a corresponding threshold. [0005]
  • A number of problems exist with monitoring systems using thresholds. One problem is the difficulty of selecting a threshold for a dynamic parameter that avoids a burdensome number of false alarms, yet catches real alarms and provides sufficient warning to take corrective action when a system parameter—as measured by a sensor—moves outside of acceptable operation. Another problem is posed by sensor failure, which may result in spurious parameter values. It may not be clear from a sensor data value that the sensor has failed. Such a failure can entirely undermine monitoring of the subject system. [0006]
  • In systems with a plurality of sensors measuring correlated phenomena in the system, it is known to use certain methods to consider all sensors in aggregate to overcome some of these problems. By observing the behavior of all the sensor data values in aggregate, it can be possible to dramatically improve monitoring without suffering unduly from false and missed alarms. Also, knowledge of how all the correlated parameters behave in unison can help determine that a sensor has failed, when isolated monitoring of data from that sensor in and of itself would not indicate the sensor failure. [0007]
  • Known methods for viewing aggregate sensor data typically employ a modeling function that embodies prior knowledge of the system. One such technique known as “first-principles” modeling requires a well-defined mathematical description of the dynamics of the system, which is used as a reference against which current aggregate sensor data can be compared to view nascent problems or sensor failures. However, this technique is particularly vulnerable to even the slightest structural change in the observed system. The mathematical model of the system is often very costly to obtain, and in many cases, may not be reasonably possible at all. [0008]
  • Another class of techniques involves empirically modeling the system as a “black box” without discerning any specific mechanics within the system. System modeling using such techniques can be easier and more resilient in the face of structural system changes. Modeling in these techniques typically involves providing some historic sensor data corresponding to desired or normal system operation, which is then used to “train” the model. [0009]
  • One particular technique is described in U.S. Pat. No. 5,987,399, the teachings of which are incorporated herein by reference. As taught therein, sensor data is gathered from a plurality of sensors measuring correlated parameters of a system in a desired operating state. This historical data is used to derive an empirical model comprising certain acceptable system states. Real-time sensor data from the system is provided to a modeling engine embodying the empirical model, which computes a measure of the similarity of the real-time state to all prior known acceptable states in the model. From that measure of similarity, an estimate is generated for expected sensor data values. The real-time sensor data and the estimated expected sensor data are compared, and if there is a discrepancy, corrective action can be taken. [0010]
  • The bounded area ratio test (BART) as taught in U.S. Pat. No. 5,987,399, is a well known state of the art similarity operator, wherein an angle is used to gauge the similarity of two values. The similarity operator is insensitive to variations across the training set range of the particular signal or sensor. BART uses the sensor range of values from low to high across all snapshots in the training set to form the hypotenuse of a triangle—preferably a right triangle—which is its base. BART, therefore, forms a straight line with minimum and maximum expected values disposed at either end. During system monitoring, BART periodically maps two points representative of an expected and a parameter value onto the base. These two points are placed, according to their values, within the range of values in the training set. A comparison angle is formed at the apex, opposite the base, by drawing a line to the apex from each of the points and the angle is the basis by which two values are compared for similarity. Furthermore, BART typically locates the apex point at a point above the median or mean of the range, and at a height that provides a right angle at the apex (for easy computation). [0011]
  • BART does not exhibit equal sensitivity to similarity values across the base range. Differences between values in the middle of the range, i.e., around 45° are amplified, and differences at the ends of the range, i.e., at 0° or 90° are diminished. Consequently, prior models, such as those employing a BART operator or other operators, might not optimally model all non-linear systems. In certain value ranges for certain sensors, these prior models may be inaccurate. Apart from selecting new or additional training data, both of which require additional time, as well as computer capacity, without providing any guarantee of improving the model, no effective way has been found in the prior art to adjust the empirical model to improve modeling fidelity. [0012]
  • Thus, there is a need for system monitoring mathematical operators for accurately measuring similarities between a monitored system and expected system states, flexibly modeling and improving model sensitivity such that component failures can be accurately predicted and so that acceptably functioning components are not prematurely replaced. [0013]
  • SUMMARY OF THE INVENTION
  • It is an object of the present invention to provide for equipment and process monitoring using empirical modeling with a class of improved operators for determining measures of similarities between modeled or known states of a system and a current or selected state of the system. [0014]
  • The present invention provides for monitoring equipment, processes or other closed systems instrumented with sensors and periodically, aperiodically or randomly recording a system snapshot therefrom. Thus, a monitored system, e.g., equipment, a process or any closed system, is empirically modeled using improved operators for determining system state similarity to known acceptable states. The improved operators provide for modeling with heightened or adjusted sensitivity to system state similarity for particular ranges of sensor values. The invention thus provides for greater possible fidelity of the model to the underlying monitored system. [0015]
  • The similarity between a system data snapshot and a selected known state vector is measured based on similarity values between corresponding parameter values from the data snapshot and the selected known state vector. Each similarity value is effectively computed according to a ratio of angles formed by the difference of the corresponding data values and by the range of corresponding values across all the known state vectors. Importantly, the ratio of angles is affected by the location within this range of the data value from the snapshot and the data value from the selected known state vector. The similarity engine can be flexibly honed to focus as through a lens on certain parts of the range with altered sensitivity, expanding or contracting those parts. [0016]
  • The similarity operator class of this invention can be used in a multivariate state estimation technique (MSET) type process monitoring technique as taught in U.S. Pat. No. 5,764,509, and can also be used for a variety of complex signal decomposition applications. In these applications, a complex signal can be decomposed into components (e.g., a frequency domain or wavelets), which are input to this MSET similarity engine. The similarity operator can be embodied both as general purpose computer software for a mainframe computer or a microprocessor or as code for an embedded processor. The result of the similarity operation can be used for generating estimated or expected states, or for identifying which one of a finite set of patterns stored in memory that most closely matches the input pattern. [0017]
  • By allowing selection of a curve instead of the base of a triangle in combination with angle selection, the present invention adds the advantage of providing a lens function for “lensing” certain parts of the range for greater or lesser sensitivity to differences that, ultimately, are reflected in the similarity for the two values. Where ease of computation is not an issue, the present invention provides improved lensing flexibility that allows freeform location of the apex point at different locations above the base. [0018]
  • The advantage afforded by lensing is that focus can be directed to different regions of interest in a particular range for a given sensor, when performing a similarity determination between a current state vector and a prior known expected state vector. Using this similarity determination an estimated state vector can be computed for a real-time system that is being monitored and modeled using MSET or the like. The model performance can be honed for improved model estimates using the improved class of similarity operators of the present invention. [0019]
  • The similarity operation of the present invention is rendered particularly non-linear and adaptive. The present invention can be used in system state classification, system state alarm notification, system virtual parameter generation, system component end of life determination and other techniques where an empirical model is useful. The present invention overcomes the above restrictions of the prior art methods by providing more flexibility to adapt and improve modeling fidelity. [0020]
  • The present invention also includes a similarity engine in an information processor embodiment. Preprocessed known state vectors characteristic of a desired operating condition, i.e., historic data, of a monitored system are stored in memory. A data acquisition unit acquires system parameter data, such as real-time sensor data, representative of the current state of the monitored system. The information processor is coupled to the memory and to the data acquisition system, and operates to process one system state frame or snapshot at a time from the data acquisition unit against the known state vector snapshots in the memory. A measure of similarity is computed between system state snapshots from the data acquisition unit and each known state vector in the memory. An expected state vector is computed from the snapshot for the monitored system. [0021]
  • The information processor may be further disposed to compare the state snapshots with the expected state vectors sequentially, to determine if they are the same or different. This determination can be used for an alarm or event trigger. [0022]
  • Briefly summarized, in a machine for monitoring an instrumented process or for analyzing one or more signals, an empirical modeling module for modeling non-linearly and linearly correlated signal inputs using a non-linear angular similarity function with variable sensitivity across the range of a signal input is described. Different angle-based similarity functions can be chosen for different inputs to improve sensitivity particular to the behavior of that input. Sections of interest within a range of a signal input can be lensed for particular sensitivity.[0023]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as the preferred mode of use, further objectives and advantages thereof, is best understood by reference to the following detailed description of the embodiments in conjunction with the accompanying drawings, wherein: [0024]
  • FIG. 1 is a functional block diagram of an example of an empirical modeling apparatus for monitoring an instrumented system; [0025]
  • FIGS. 2 and 3 are diagrams showing an example of a prior art similarity operator; [0026]
  • FIG. 4 is a diagram generally showing an example of a similarity operator according to the invention; [0027]
  • FIG. 5 illustrates distillation of sensor data to create a training data set representative of the similarity domain; [0028]
  • FIG. 6 shows the steps of a method of distilling sensor data to a training set for use with the present invention; [0029]
  • FIG. 7A is a diagram showing an example of a polynomial embodiment of a similarity operator according to the invention; [0030]
  • FIG. 7B is a diagram showing an example of an elliptical embodiment of a similarity operator according to the invention; [0031]
  • FIG. 7C is a diagram showing an example of a trigonometric embodiment of a similarity operator according to the invention; [0032]
  • FIG. 8A is a diagram showing an example of the lensing effect of the similarity operator of the present invention; [0033]
  • FIG. 8B is a diagram showing an example of an alternative approach to the use of the lensing effect of the similarity operator of the present invention; [0034]
  • FIGS. 9A-9D through [0035] 12A-12D illustrate alternate embodiments showing extension of range and lensing functions in similarity operators in accordance with the invention;
  • FIGS. 13A-13B are flow diagrams showing preferred methods of generating a generalized lensing Similarity Operator; and [0036]
  • FIG. 14 is yet another embodiment of the similarity operator of the present invention showing discontinuous lensing effects.[0037]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • As depicted in the example of FIG. 1, the [0038] inventive system 100 in a preferred embodiment comprises a data acquisition module 102, an information processor 104, a memory 106 and an output module 108, which can be coupled to other software, to a display, to an alarm system, or any other system that can utilize the results, as may be known in the art. The processor 104 generally may include a Similarity Engine 110, an Estimated State Generator 112 and a Deviation Detection Engine 114.
  • [0039] Memory 106 stores a plurality of selected time-correlated snapshots of sensor values characterizing normal, optimal, desirable or acceptable operation of a monitored process or machine. This plurality of snapshots, distilled according to a selected “training” method as described below, comprises an empirical model of the process or machine being monitored. In operation, the inventive monitoring system 100 samples current snapshots of sensor data via acquisition module 102. For a given set of time-correlated sensor data from the monitored process or machine running in real-time, the estimates for the sensors can be generated by the Estimated State Generator 112 according to:
  • {right arrow over (y)} estimated ={overscore (D)}·{right arrow over (W)}  (1)
  • where D is a matrix comprised of the plurality of snapshots in [0040] memory 106 and W is a contribution weighting vector determined by Similarity Engine 110 and Estimated State Generator 112 using a similarity operator such as the inventive class of similarity operators of the present invention. The multiplication operation is the standard matrix/vector multiplication operator. W has as many elements as there are snapshots in D, and is determined by: W = W ^ ( j = 1 N W ^ ( j ) ) ( 2 ) W ^ = ( D _ T D _ ) - 1 · ( D _ T y i n ) ( 3 )
    Figure US20040260515A1-20041223-M00001
  • where the T superscript denotes transpose of the matrix, and Y(in) is the current snapshot of actual, real-time sensor data. The improved similarity operator of the present invention is symbolized in the equation above as [0041]
    Figure US20040260515A1-20041223-P00900
    . Yin is the real-time or actual sensor values from the underlying system, and therefore it is a vector snapshot.
  • The similarity operation typically returns a scalar value between 0 and 1 for each comparison of one vector or matrix row to another vector. It represents a numeric quantification of the overall similarity of two system states represented by two snapshots of the same sensors. A similarity value closer to 1 indicates sameness, whereas a similarity value closer to 0 typically indicates difference. [0042]
  • [0043] Deviation detection engine 114 receives both the actual current snapshot of sensor values and the set of sensor value estimates from the estimated state generator 112, and compares the two. A variety of tests can be used, including the sequential probability ratio test (SPRT), or a CUSUM test, both of which are known in the art. Preferably, the set of actual sensor values and the set of estimated sensor values are differenced to provide residual values, one for each sensor. Applying the SPRT to a sequence of such residual values for a given sensor provides an advantageously early indication of any difference between the actual sensor values and what is expect under normal operation.
  • Applying the SPRT to a sequence of such residual values for a given sensor provides an advantageously early indication of any difference between the actual sensor values and what is expected under normal operation. [0044]
  • FIG. 2 graphically illustrates the prior art BART similarity operation wherein a [0045] right triangle 120 is formed having a monotonically linear base 122 bounded by the range for a given sensor in training data, the range minimum and maximum forming vertices 124, 126 at opposite ends of the base 122. The triangle 120 was formed preferably as a right triangle with the right angle located at height (h) above the median of the range data along the base 122. In this prior art method the height (h) was required to be chosen so that the apex angle is a right angle. Then, in performing a similarity operation on two values of the sensor, each value was plotted along the base between minimum 124 and maximum 126 according to its value, and lines 128 and 129 were drawn from the apex to each plotted point X0 and X1, forming an angle therebetween. The similarity of the two values was then computed as a function of the comparison of the formed angle θ to the right angle Ω of the apex.
  • As can be seen from FIG. 3, which shows each of two [0046] different comparisons 130, 132, equally spaced pairs of values are compared in each instance for similarity by mapping the value pairs in the range for the sensor along the base 134. One of each of the pairs represents a sensor value from a training set vector and the other of the pair represents a sensor value from an input data vector. Each pair of values identifies a segment that, in combination with the apex, identifies a smaller triangle within the original right triangle. The angle in each of the smaller triangles 136, 138, that shares the apex and is a fraction of the right angle, provides a measure of similarity for the respective pair of values when scaled against the full ninety degrees (90°) of the right angle. This angle is zero degrees (0°) for an identical pair and 90° for a completely dissimilar pair at the extrema of the range stored in the training set.
  • The inventors have found that the restrictions of the prior art analysis method, i.e. a right triangle based model with its apex at the right angle and disposed immediately above the median value on the base (hypotenuse) for the particular parameter, may be ignored to provide a more useful, flexible and all encompassing analysis tool. Further, the inventors have determined that the analysis model need not be triangular at all but merely defined by two partial rays of an angle extending to endpoints identified by either a system parameter minimum or maximum and connected therebetween by a curve that may be linear or non-linear. The curve may be selected, for example, to highlight one region of operation while de-emphasizing another or others as set forth herebelow. [0047]
  • The most general form of the similarity operation of the invention is shown in FIG. 4. A range of data for a given parameter sensor across a training set is mapped to an arc length forming the [0048] curve 140 and being identified as a Similarity Domain. An apex location 142 may be chosen above the similarity domain curve 140, and an angle Ω is defined by connecting the apex with straight line segments 144 and 146 to the ends of the similarity domain 140. Alternately, an angle may be selected and an apex location 142 derived accordingly.
  • According to one embodiment of the invention, the similarity domain (being the curve length) for a given sensor or parameter in a monitored system can be mapped by equating one end of the curve to the lowest value observed across the reference library or training set for that sensor, and equating the other end to the highest value observed across the training set for that sensor. The length between these extrema is scaled linearly (or in some other appropriate fashion, e.g., logarithmically where appropriate). According to another embodiment of the invention, expected lower and upper limits for a sensor can be chosen based on knowledge of the application domain, e.g., industrial, medical, etc., know-how. According to yet another embodiment, the similarity domain can be mapped using the extrema of the original data set from which the reference library or training set is distilled. This can be advantageous if the training method does not necessarily include the highest and lowest sensor readings. [0049]
  • The similarity of value pairs (“elemental similarity”) is found by mapping that pair of values X[0050] 0 and X1 onto the Similarity Domain for that sensor. Connecting these two points from the similarity domain curve with lines 147 and 148 to the apex 142 defines a second angle θ. The similarity of the pair of values is then defined as equal to: S = 1 - θ Ω ( 4 )
    Figure US20040260515A1-20041223-M00002
  • Thus, the similarity value S is closer to one for value pairs that are more similar, and S is closer to zero for value pairs that are less similar. The elemental similarities are calculated for each corresponding pairs of sensor values (elements) of the two snapshots being compared. Then, the elemental similarities are combined in some statistical fashion to generate a single similarity scalar value for the vector-to-vector comparison. Preferably, this overall similarity, S[0051] snapshot, of two snapshots is equal to the average of the number N (the element count) of elemental similarity values Sc: S snapshot = c = 1 N S c N ( 5 )
    Figure US20040260515A1-20041223-M00003
  • It can be understood that the general result of the similarity operation of the present invention applied to two matrices (or a matrix D and a vector Y[0052] in, as per equation 3 above) is a matrix (or vector) wherein the element of the ith row and jth column is determined from the ith row of the first operand and the jth column of the second operand. The resulting element (i,j) is a measure of the sameness of these two vectors. In the present invention, the ith row of the first operand generally has elements corresponding to sensor values for a given temporally related state of the process or machine, and the same is true for the jth column of the second operand. Effectively, the resulting array of similarity measurements represents the similarity of each state vector in one operand to each state vector in the other operand.
  • By way of example, two vectors (the ith row and jth column) are compared for similarity according to [0053] equation 4 above on an element-by-element basis. Only corresponding elements are compared, e.g., element (i,m) with element (m,j) but not element (i,m) with element (n,j). For each such comparison, the similarity is given by equation 4, with reference to a similarity operator construct as in FIG. 4. Hence, if the values are identical, the similarity is equal to one, and if the values are grossly unequal, the similarity approaches zero. When all the elemental similarities are computed, the overall similarity of the two vectors is equal to the average of the elemental similarities. A different statistical combination of the elemental similarities can also be used in place of averaging, e.g., median.
  • The matrix D of reference snapshots stored in [0054] memory 106 characterizing acceptable operation of the monitored process or machine is composed using a method of training, that is, a method of distilling a larger set of data gathered from the sensors on the process or machine while it is running in known acceptable states. FIG. 5 graphically depicts such a method for distilling the collected sensor data to create a representative training data set (D matrix) for defining a Similarity Domain. In this simple example only five sensor signals 152, 154, 156, 158 and 160 are shown for the process or machine to be monitored. Although described herein generically as comparing system vectors, “system” is used for example only and not intended as a limitation. System is intended to include any system living or dead whether a machine, a process being carried out in a system or any other monitorable closed system.
  • Continuing this example, the sample number or a time stamp of the collected sensor data is on the [0055] abscissa axis 162, where the data is digitally sampled and the sensor data is temporally correlated at each sample. The ordinate axis 164 represents the relative magnitude of each sensor reading over the samples or “snapshots.” In this example, each snapshot represents a vector of five elements, one reading for each sensor in that snapshot. Of all the sensor data collected (in all of the snapshots), according to this training method example, only those five-element snapshots are included in the representative training set that contain either a global minimum or a global maximum value for any given sensor. Therefore, the global maximum 166 for sensor signal 152 justifies inclusion of the five sensor values at the intersections of line 168 with each sensor signal 152, 154, 156, 158, 160, including global maximum 166, in the representative training set, as a vector of five elements. Similarly, the global minimum 170 for sensor signal 152 justifies inclusion of the five sensor values at the intersections of line 172 with each sensor signal 152, 154, 156, 158, 160. So, collections of such snapshots represent states the system has taken on and, that are expected to reoccur. The pre-collected sensor data is filtered to produce a “training” subset that reflects all states that the system takes on while operating “normally” or “acceptably” or “preferably.” This training set forms a matrix, having as many rows as there are sensors of interest, and as many columns (snapshots) as necessary to capture all the acceptable states without redundancy.
  • Turning to FIG. 6, the training method of FIG. 5 is shown in a flowchart. Data so collected in [0056] step 180 from N sensors at L observations or snapshots or from temporally related sets of sensor parameter data, form an array X of N rows and L columns. In step 182, an element number counter (i) is initialized to zero, and an observation or snapshot counter (t) is initialized to one. Two arrays, “max” and “min,” for containing maximum and minimum values respectively across the collected data for each sensor, are initialized to be vectors each of N elements which are set equal to the first column of X. Two additional arrays, Tmax and Tmin, for holding the observation number of the maximum and minimum value seen in the collected data for each sensor, are initialized to be vectors each of N elements, all zero.
  • In [0057] step 184, if the value of sensor number i at snapshot number t in X is greater than the maximum yet seen for that sensor in the collected data, max(i) is updated to equal the sensor value and Tmax(i) stores the number t of the observation in step 186. If not, a similar test is done for the minimum for that sensor in steps 188 and 190. The observation counter is incremented in step 192. In step 194, if all the observations have been reviewed for a given sensor (i.e., t=L), then t is reset to zero and i is incremented (in preparation for finding the maximum and minimum for the next sensor) in step 196. If the limits have been found for the last sensor (i.e., i=N), step 198, then redundancies are removed (i.e., eliminate multiple occurrences of snapshots that have been selected for two or more parameters) and an array D is created from the resulting subset of snapshot vectors from X.
  • So, in [0058] step 200, counters i an j are initialized to one. In step 202, arrays Tmax and Tmin are concatenated to form a single vector Ttmp having 2N elements. These array elements are sorted into ascending (or descending) order in step 204 to form array T. In step 206, holder tmp is set to the first value in T (an observation number that contains a sensor minimum or maximum). The first column of D is set equal to the column of X corresponding to the observation number that is the first element of T. In the loop starting with decision step 208, the ith element of T is compared to the value of tmp that contains the previous element of T. If the two adjacent values of T are equal indicating that the corresponding observation vector is a minimum or maximum for more than one sensor, then, it has already been included in D and need not be included again. Counter i is incremented in step 210. If the two adjacent values are not equal, D is updated to include the column from X that corresponds to the observation number of T(i) in step 212, and tmp is updated with the value at T(i). The counter (j) is then incremented in step 214. In step 216, if all the elements of T have been checked, then the distillation into training set D has finished in step 218 and D is stored in memory 106.
  • The training set as selected according to the above method may additionally be augmented using a number of techniques. For example, once the snapshots selected according to the above Min-Max method are determined, the remaining original set of data may be selected from and added to the training set at regular time stamp intervals. Yet another way of adding more snapshots to the Min-Max training set involves randomly selecting a remaining number of snapshots from the original set of data. [0059]
  • Once the D matrix has been determined, in a training and implementation phase, the [0060] preferred similarity engine 110 is turned on with the underlying system being monitored, and through time, actual snapshots of real sensor values are input to the Similarity Engine 110 from Data Acquisition Unit 102. The output of the results from Similarity Engine 110 can be similarity values, expected values, or the “residual” values (being the difference between the actual and expected values).
  • One of these output types is selected and passed to the [0061] deviation detection engine 114 of FIG. 1, which then determines through a series of such snapshots, whether a statistically significant change has occurred as set forth hereinbelow. In other words, the statistical significance engine effectively determines if those real values represent a significant change from the “acceptable” states stored in the D matrix. Thus, a vector (Y) is generated in Estimated State Generator 112 of expected sensor values from contributions by each of the snapshots in D, which contributions are determined by a weight vector W. W has as many elements as there are snapshots in D and W is determined according to equations 2 and 3 above.
  • The [0062] deviation detection engine 114 can implement a comparison of the residuals to selected thresholds to determine when an alert should be output of a deviation in the monitored process or machine from recognized states stored in the reference library. Alternatively, a statistical test, preferably the sequential probability ratio test (SPRT) can be used to determine when a deviation has occurred. The basic approach of the SPRT technique is to analyze successive observations of a sampled parameter. A sequence of sampled differences between the generated expected value and the actual value for a monitored sensor signal should be distributed according to some kind of distribution function around a mean of zero. Typically, this will be a Gaussian distribution, but it may be a different distribution, as for example a binomial distribution for a parameter that takes on only two discrete values (this can be common in telecommunications and networking machines and processes). Then, with each observation, a test statistic is calculated and compared to one or more decision limits or thresholds. The SPRT test statistic generally is the likelihood ratio In, which is the ratio of the probability that a hypothesis H1 is true to the probability that a hypothesis H0 is true: l n = ( y 1 , y 2 , , y n | H 1 ) ( y 1 , y 2 , , y n | H 0 ) ( 6 )
    Figure US20040260515A1-20041223-M00004
  • where Y[0063] n are the individual observations and Hn are the probability distributions for those hypotheses. This general SPRT test ratio can be compared to a decision threshold to reach a decision with any observation. For example, if the outcome is greater than 0.80, then decide H1 is the case, if less than 0.20 then decide H0 is the case, and if in between then make no decision.
  • The SPRT test can be applied to various statistical measures of the respective distributions. Thus, for a Gaussian distribution, a first SPRT test can be applied to the mean and a second SPRT test can be applied to the variance. For example, there can be a positive mean test and a negative mean test for data such as residuals that should distribute around zero. The positive mean test involves the ratio of the likelihood that a sequence of values belongs to a distribution H[0064] 0 around zero, versus belonging to a distribution H1 around a positive value, typically the one standard deviation above zero. The negative mean test is similar, except H1 is around zero minus one standard deviation. Furthermore, the variance SPRT test can be to test whether the sequence of values belongs to a first distribution H0 having a known variance, or a second distribution H2 having a variance equal to a multiple of the known variance.
  • For residuals derived for sensor signals from the monitored process or machine behaving as expected, the mean is zero, and the variance can be determined. Then in run-time monitoring mode, for the mean SPRT test, the likelihood that H[0065] 0 is true (mean is zero and variance is σ2) is given by: L ( y 1 , y 2 , , y n | H 0 ) = 1 ( 2 π σ ) n / 2 [ - 1 2 σ 2 k = 1 n y k 2 ] ( 7 )
    Figure US20040260515A1-20041223-M00005
  • and similarly, for H[0066] 1, where the mean is M (typically one standard deviation below or above zero, using the variance determined for the residuals from normal operation) and the variance is again σ2 (variance is assumed the same): L ( y 1 , y 2 , , y n | H 1 ) = 1 ( 2 π σ ) n / 2 [ - 1 2 σ 2 ( k = 1 n y k 2 - 2 k = 1 n y k M + k = 1 n M 2 ) ] ( 8 )
    Figure US20040260515A1-20041223-M00006
  • The ratio l[0067] n from equations 7 and 8 then becomes: l n = [ - 1 2 σ 2 k = 1 n M ( M - 2 y k ) ] ( 9 )
    Figure US20040260515A1-20041223-M00007
  • A SPRT statistic can be defined for the mean test to be the exponent in equation 9: [0068] SPRT mean = - 1 2 σ 2 k = 1 n M ( M - 2 y k ) ( 10 )
    Figure US20040260515A1-20041223-M00008
  • The SPRT test is advantageous because a user-selectable false alarm probability α and a missed alarm probability β can provide thresholds against with SPRT[0069] mean can be tested to produce a decision:
  • 1. If SPRT[0070] mean≦ln(β/(1−α)), then accept hypothesis H0 as true;
  • 2. If SPRT[0071] mean≧ln((1−β)/α), then accept hypothesis H1 as true; and
  • 3. If ln(β/(1−α))<SPRT[0072] mean<ln((1−β)/α), then make no decision and continue sampling.
  • For the variance SPRT test, the problem is to decide between two hypotheses: H[0073] 2 where the residual forms a Gaussian probability density function with a mean of zero and a variance of Vσ2; and H0 where the residual forms a Gaussian probability density function with a mean of zero and a variance of σ2. The likelihood that H2 is true is given by: L ( y 1 , y 2 , , y n | H 2 ) = 1 ( 2 π V 1 / 2 σ ) n / 2 [ - 1 2 V σ 2 k = 1 n y k 2 ] ( 11 )
    Figure US20040260515A1-20041223-M00009
  • The ratio l[0074] n is then provided for the variance SPRT test as the ratio of equation 11 over equation 7, to provide: l n = V - 1 / 2 [ - 1 2 σ 2 k = 1 n y k 2 ( 1 - V V ) ] ( 12 )
    Figure US20040260515A1-20041223-M00010
  • and the SPRT statistic for the variance test is then: [0075] SPRT variance = 1 2 σ 2 ( V - 1 V ) k = 1 n y k 2 - ln V 2 ( 13 )
    Figure US20040260515A1-20041223-M00011
  • Thereafter, the above tests (1) through (3) can be applied as above: [0076]
  • 1. If SPRT[0077] variance≦ln(β/(1−α)), then accept hypothesis H0 as true;
  • 2. If SPRT[0078] variance≧ln((1−β)/α), then accept hypothesis H2 as true; and
  • 3. If ln(β/(1−α))<SPRT[0079] variance<ln((1−β)/α), then make no decision and continue sampling.
  • Each snapshot of residuals (one residual “signal” per sensor) that is passed to the SPRT test module, can have SPRT test decisions for positive mean, negative mean, and variance for each parameter in the snapshot. In an empirical model-based monitoring system according to the present invention, any such SPRT test on any such parameter that results in a hypothesis other than H[0080] 0 being accepted as true is effectively an alert on that parameter. Of course, it lies within the scope of the invention for logic to be inserted between the SPRT tests and the output alerts, such that a combination of a non-H0 result is required for both the mean and variance SPRT tests in order for the alert to be generated for the parameter, or some other such rule.
  • The output of the [0081] deviation detection engine 114 will represent a decision for each sensor signal input, as to whether the estimate is different or the same. These decisions, in turn, can be used to diagnose the state of the process or equipment being monitored. The occurrence of some difference decisions in conjunction with other sameness decisions can be used as an indicator of likely future machine health or process states. The SPRT decisions can be used to index into a diagnostic lookup database, automatically diagnosing the condition of the process or equipment being monitored.
  • Generally, any statistical hypothesis test as known by those skilled in the statistical arts can be substituted for the above-described application of SPRT. In addition, decisioning methods known in the art such as fuzzy logic sets and neural networks can be used to render a decision with regard to the sameness or difference of the estimates and the actual values. [0082]
  • In contrast to the restrictions imposed on the above-described BART technique, the location of the apex and the shape and length of the curve forming the similarity domain of the preferred embodiment can be selected to adjust sensitivity to similarity of two values differently for different parts of the Similarity Domain. In so doing, regions of interest for particular sensors can be lensed to enhance sensitivity to similarity, flexibility not available in prior techniques. Mathematical methods for computing the angles Ω and θ are known in the art, and can include numerical techniques for approximating the angles. [0083]
  • FIGS. [0084] 7A-C show examples of particular forms of the similarity operator of the invention in which lensing is applied to the Similarity Domain. The example of FIG. 7A shows a Similarity Domain defined by a polynomial curve 220, in this example a function based on a polynomial including terms a fourth power, a third power, and a square. FIG. 7B shows yet another example of a particular form of the similarity operator of the invention in which the Similarity Domain is defined by an elliptical arc 222. In this example the elliptical arc 222 forms a convex similarity domain from the perspective of the apex and line segments forming angle Ω. It is also within the scope of the invention to use the concave elliptical arc. An example of a trigonometric Similarity Domain shown in FIG. 7C wherein the Similarity Domain curve 224 is defined by a function of the sum of a sine and a cosine and wherein the amplitude of the sine is twice that of the cosine.
  • FIG. 8A shows an example wherein the lensing effect of the similarity operator according to the present invention is enhanced for visible understanding. Although the Similarity Domain distance between value pairs at [0085] arcs 230, 232 are of equal arc length, they are mapped to different areas of the similarity domain 234. Thus, these arcs 230, 232 represent two separate pairs of values being compared for similarity with quite different results. Even though the scalar difference between the values in the two pairs is equal, one pair at arc 230 falls toward a part of the range in the training set (a part of the similarity domain 234) that yields a very narrow angle 236, whereas the other pair at arc 232 falls in a part of the similarity domain 234 that yields a much wider angle 238. The pair at arc 232 with the wider angle 238 will thus have a similarity value lower than the pair at arc 230 with the narrower angle 236, even though both pairs are separated by arcs 230, 232 having the same scalar distance.
  • Turning to FIG. 8B, an alternative approach to the similarity operator of the present invention is shown. [0086] Similarity domain 234 is now mapped to from the straight baseline 802, which provides the linear scale from an expected overall minimum 804 to an expected overall maximum 806 for the sensor, on which to map the sensor value differences 230 and 232 (which are equal differences, but at different parts of the expected range). Mapping sensor value differences 230 and 232 to the similarity domain 234 provides angles 810 and 812. The angles 810 and 812 can be seen to be different, even though the length of the sensor value difference (either 230 or 232) is equal, hence providing the advantageous lensing effect. An angle 810 or 812 is compared to the overall angle Q to provide a measure of similarity as per the equations above for two sensor values that have a difference of 230 or 232 respectively.
  • This alternative approach is further understood with reference to FIGS. 9A-9D through [0087] 12A-12D, which show examples of four additional alternate embodiments with lensing functions being defined according to sinusoidal and polynomial functions for use with the similarity operators. In particular, FIG. 9A shows a cosine function 240 as the lensing function extending the range for Ω beyond 90° and showing equal length sensor value differences 903, 905, 907, and 909 positioned over the cosine lensing function range. Each length 903, 905, 907 and 909 represents a same sensor value difference, but located in a different part of the expected range for the sensors being compared. Each forms a different angle θ with respect to lines drawn to the vertex 244, such as lines 913 and 915. This angle is then compared to the angle Ω shown therein to provide a measure of similarity, is generally defined by the edges of the mapped range, from a minimum expected range value to a maximum expected range value, and in this case was 90°. It can also be seen that the inventive similarity operation can accommodate data points outside the edges of the expected minimums and maximums. FIG. 9B shows the corresponding similarity values generated by smoothly moving the equal length sensor value difference (same as 903, etc., with a length of 0.2) across the entire range. FIG. 9C provides a three-dimensional surface 242 illustrating a range of similarity values for the cosine lensing function 240 for a vertex 244 located at varying heights above the similarity domain, to demonstrate the effect on the similarity curve of FIG. 9B of the vertex height. Generally, an increase in the height of the vertex 244 above the similarity domain 240 flattens out the lensing effect of the curve and drives similarity values higher. FIG. 9B illustrates a slice in surface 242 at a vertex height of 3. FIG. 9D illustrates how changing the expected range angle Ω (in this example from 90° through 180°) results in changing similarity values.
  • FIG. 10A is an example wherein x[0088] 3 is applied as a lensing function to form curve 250 with vertex 252 selected thereabove. FIG. 10B shows the effect of the lensing functions curve 250 on similarity values, which corresponds to vertex height −1.2 on surface 254 of FIG. 10C. Thus, the similarity values are plotted in FIG. 10B for the x3 lensing function, illustrating a segment at approximately −1.2 as showing a similarity value of 1. This is further illustrated in the three-dimensional surface plot of FIG. 10C which corresponds to the knee of the x3 lensing function and generates a similarity value of 1 for points mapped from the apex to points on the polynomial curve that generate 2=0. The surface 254 of FIG. 10C illustrates the effect of vertex 252 height on similarity values. FIG. 10D illustrates the incremental effect of increasing Ω above 90° to 180°.
  • FIGS. 11A and 12A illustrate [0089] analogous curves 260, 270 formed using polynomial lensing functions of x2 and x4, respectively. FIGS. 11B-11C and 12B-12C illustrate the similarity value and the effect of a variation in vertex height corresponding to FIGS. 10B-10C. FIGS. 11D and 12D correspondingly illustrate variations in the Q range above 90° to 180°.
  • Essentially, the similarity values are magnified, or lensed, when a pair of values falls along the similarity domain at a point where it is more orthogonal to the angle rays extending from the apex. The similarity values are diminished where the pair of values falls along the similarity domain at a point where it is more parallel to the rays from the apex. As can be seen, the lensing effect is further increased inversely with apex height, and distance of a portion of the similarity domain curve from the apex or vertex. According to the invention, different similarity curves can be empirically tested to determine which works best for a given sensor. The curve shapes can be numerical approximations (such as a lookup table of values) rather than equations for the curves. Thus, a similarity domain curve can be qualitatively generated by selecting various subranges of the expected range for a sensor to be more or less lensed. This can be done with the use of a smooth curve with the use of a spline technique to join curve segments together to provide the necessary lensing. Alternatively, turning to FIG. 14, the invention may also be accomplished with a discontinuous [0090] similarity domain line 405, such that a discontinuities 407 and 408 at the edges of a section 410 provide for a discrete jump in the distance from the vertex 415, and thus a discrete change in the angle, since a given arc length along domain line 405 will generate a smaller angle at a greater distance from the vertex 415.
  • FIG. 13A is a flow diagram of a first [0091] preferred embodiment 300 for generating a lensing operator according to the present invention. First, in step 302 sensor data is collected as described hereinabove. Then in step 304 minimum and maximum vectors are identified for each parameter such as for example as is done in FIG. 6. Coincidentally, in step 306 a lensing function may be selected. Then, in step 308 using the min/max values provided in step 304 a Similarity Domain surface is generated based on the lensing function selected in step 306. Typically, the lensing surface is generated by identifying an origin with respect to the min and max values and then, generating curves to define the surface based on the origin and min/max values, each of the curves being generated with reference to a selected apex height. Then, any well known smoothing function may be applied to the curves to generate the surface. In step 310 the surface is stored for subsequent system monitoring which begins in step 312. For system monitoring, in step 314, an apex height is selected interactively. So, finally, in step 316 the Similarity Operator is generated from the apex height and throughout monitoring, different apex heights may be selected to vary the lensing and to vary the view provided to an operator monitoring system operation.
  • FIG. 13B shows an [0092] alternate embodiment 320 wherein instead of varying apex height, viewing angle is varied. All steps except step 322 are identical to those at FIG. 13A and so, are labeled identically. Thus, in step 322 the operator is allowed to select different viewing angles and in step 316 the view of system operation is provided based on that selected viewing angle. In both embodiments, snapshots are taken of the monitored system and compared against training set vectors using the selected lensing Similarity Operator to provide enhanced system modeling and to facilitate better understanding of the system's current operating state.
  • Thus, the advantage afforded by lensing is that focus can be directed to different regions of interest in a particular range for a given sensor, when performing a similarity determination between a current state vector and a prior known expected state vector. Using this similarity determination an estimated state vector can be computed for a real-time system that is being monitored and modeled using MSET or the like. The model performance can be honed for improved model estimates using the improved class of similarity operators of the present invention. [0093]
  • Further, the similarity operation of the present invention is rendered particularly non-linear and adaptive. The present invention can be used in system state classification, system state alarm notification, system virtual parameter generation, system component end of life determination and other techniques where an empirical model is useful. The present invention overcomes the above restrictions of the prior art methods by providing more flexibility to tweak and improve modeling fidelity. [0094]
  • It should be appreciated that a wide range of changes and modifications may be made to the embodiments of the invention as described herein. Thus, it is intended that the foregoing detailed description be regarded as illustrative rather than limiting and that the following claims, including all equivalents, are intended to define the scope of the invention. [0095]

Claims (8)

What is claimed is:
1. A tool for monitoring system operation, said tool comprising:
a data acquisition unit, said data acquisition unit receiving signals from sensors, said sensors being disposed upon a system being monitored and providing parametric snapshots of system operation;
a memory storing a training set, said training set containing a plurality of system vectors, each of said system vectors being representative of an expected operating state of said system being monitored;
a processor receiving snapshots from said data acquisition unit and comparing received snapshots with system vectors from said memory, said processor comprising a similarity engine, said similarity engine receiving said snapshots from said acquisition unit and selectively applying a lensing similarity function to said comparison; and
an output unit using said similarity engine to apply the lensing similarity function to the received vectors to generate a similarity vector, said processor providing results of said comparison to said output unit.
2. A tool as in claim 1, said processor further comprising an estimated state generator receiving said similarity vector from said similarity engine and training vectors from said memory and generating an estimated state therefrom, said estimated state being selectively provided to said output device.
3. A tool as in claim 2, said processor further comprising a deviation detection engine, said deviation detection engine receiving snapshots from said data acquisition unit and estimated states from said estimated state generator and determining deviation therefrom, said deviation detection engine selectively providing said determined deviation to said output device.
4. A tool as in claim 3 wherein said lensing similarity function defines a similarity domain, vectors belonging to said training set falling on said similarity domain, snapshots being expected to fall within said similarity domain, each said snapshot's location within said similarity domain being a basis of said comparison by said processor.
5. A tool as in claim 4 wherein the lensing similarity function is representable as a line segment selected from the group consisting of a polynomial segment, an elliptical arc, a trigonometric segment and a circular arc, said line segment defining said similarity domain.
6. A tool as in claim 4 wherein said lensing similarity function comprises selecting a line segment from a non-planar surface, said line segment defining said similarity domain.
7. A tool as in claim 3 wherein the lensing similarity function comprises moving the comparison angle apex with respect to a similarity domain, vectors belonging to said training set falling on said similarity domain, snapshots being expected to fall within said similarity domain, each said snapshot's location within said similarity domain being a basis of said comparison by said processor.
8. A tool as in claim 3 wherein the lensing similarity function comprises extending a comparison angle range beyond 90°, rays from said comparison angle contacting outer limits of a similarity domain, vectors belonging to said training set falling on said similarity domain, snapshots being expected to fall within said similarity domain, each said snapshot's location within said similarity domain being a basis of said comparison.
US10/892,808 2000-03-09 2004-07-16 Generalized lensing angular similarity operator Abandoned US20040260515A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/892,808 US20040260515A1 (en) 2000-03-09 2004-07-16 Generalized lensing angular similarity operator

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US18810200P 2000-03-09 2000-03-09
US09/802,482 US6775641B2 (en) 2000-03-09 2001-03-09 Generalized lensing angular similarity operator
US10/892,808 US20040260515A1 (en) 2000-03-09 2004-07-16 Generalized lensing angular similarity operator

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/802,482 Continuation US6775641B2 (en) 2000-03-09 2001-03-09 Generalized lensing angular similarity operator

Publications (1)

Publication Number Publication Date
US20040260515A1 true US20040260515A1 (en) 2004-12-23

Family

ID=26883727

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/802,482 Expired - Lifetime US6775641B2 (en) 2000-03-09 2001-03-09 Generalized lensing angular similarity operator
US10/892,808 Abandoned US20040260515A1 (en) 2000-03-09 2004-07-16 Generalized lensing angular similarity operator
US11/986,407 Expired - Fee Related US7767239B1 (en) 2000-03-09 2007-11-21 Methods and formulations for hydrating dry skin, employing a low-energy beverage

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/802,482 Expired - Lifetime US6775641B2 (en) 2000-03-09 2001-03-09 Generalized lensing angular similarity operator

Family Applications After (1)

Application Number Title Priority Date Filing Date
US11/986,407 Expired - Fee Related US7767239B1 (en) 2000-03-09 2007-11-21 Methods and formulations for hydrating dry skin, employing a low-energy beverage

Country Status (8)

Country Link
US (3) US6775641B2 (en)
EP (1) EP1279104B1 (en)
AT (1) ATE418761T1 (en)
AU (2) AU2001240127B2 (en)
CA (1) CA2402631C (en)
DE (1) DE60137122D1 (en)
ES (1) ES2320095T3 (en)
WO (1) WO2001067262A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080115014A1 (en) * 2006-11-13 2008-05-15 Kalyanaraman Vaidyanathan Method and apparatus for detecting degradation in a remote storage device
US20130024166A1 (en) * 2011-07-19 2013-01-24 Smartsignal Corporation Monitoring System Using Kernel Regression Modeling with Pattern Sequences
US20130024415A1 (en) * 2011-07-19 2013-01-24 Smartsignal Corporation Monitoring Method Using Kernel Regression Modeling With Pattern Sequences
CN111625421A (en) * 2020-05-26 2020-09-04 云和恩墨(北京)信息技术有限公司 Method and device for monitoring distributed storage system, storage medium and processor
US11178037B2 (en) * 2017-06-02 2021-11-16 Vmware, Inc. Methods and systems that diagnose and manage undesirable operational states of computing facilities

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6957172B2 (en) 2000-03-09 2005-10-18 Smartsignal Corporation Complex signal decomposition and modeling
US6952662B2 (en) * 2000-03-30 2005-10-04 Smartsignal Corporation Signal differentiation system using improved non-linear operator
US6917839B2 (en) * 2000-06-09 2005-07-12 Intellectual Assets Llc Surveillance system and method having an operating mode partitioned fault classification model
US20020183971A1 (en) * 2001-04-10 2002-12-05 Wegerich Stephan W. Diagnostic systems and methods for predictive condition monitoring
US7655049B2 (en) * 2001-07-26 2010-02-02 Phillips Van L Socket insert having a bladder system
US7085675B2 (en) * 2002-02-06 2006-08-01 The University Of Chicago Subband domain signal validation
US20040172312A1 (en) * 2002-11-15 2004-09-02 Selwanes Ragui N. Method, system and storage medium for facilitating multi-party transactions
GB2421667A (en) * 2003-04-22 2006-06-28 Spinvox Ltd Queuing and load balancing of voicemail for intelligent transcription into text message
FR2871949B1 (en) * 2004-06-21 2006-09-01 Renault Sas METHOD FOR MONITORING ONE OR MORE PHYSICAL PARAMETERS AND FUEL CELL USING THE SAME
US7191096B1 (en) * 2004-08-13 2007-03-13 Sun Microsystems, Inc. Multi-dimensional sequential probability ratio test for detecting failure conditions in computer systems
CA2631870C (en) 2005-11-29 2021-07-06 Venture Gain, L.L.C. Residual-based monitoring of human health
WO2008006323A1 (en) * 2006-07-14 2008-01-17 Siemens Aktiengesellschaft Arrangement and method for storing measured values, in particular for monitoring energy transmission systems
ATE552543T1 (en) 2006-07-14 2012-04-15 Siemens Ag ARRANGEMENT AND METHOD FOR STORING MEASURED VALUES, IN PARTICULAR FOR MONITORING ENERGY TRANSMISSION SYSTEMS
US8275577B2 (en) * 2006-09-19 2012-09-25 Smartsignal Corporation Kernel-based method for detecting boiler tube leaks
US8311774B2 (en) 2006-12-15 2012-11-13 Smartsignal Corporation Robust distance measures for on-line monitoring
US8204697B2 (en) * 2008-04-24 2012-06-19 Baker Hughes Incorporated System and method for health assessment of downhole tools
EP2145621A1 (en) * 2008-07-16 2010-01-20 Stephan Lück Prevention of dehydration and reduction of gluconeogenetic losses of amino acids by means of propane-1,2,3-triol
US20100042327A1 (en) * 2008-08-13 2010-02-18 Baker Hughes Incorporated Bottom hole assembly configuration management
US20100038135A1 (en) * 2008-08-14 2010-02-18 Baker Hughes Incorporated System and method for evaluation of structure-born sound
US8046637B2 (en) * 2009-03-06 2011-10-25 Oracle America, Inc. Telemetry data filtering through sequential analysis
CN102917661B (en) * 2010-01-14 2015-09-23 风险获利有限公司 Based on the health index monitored for health of multivariate residual error
US20120307624A1 (en) * 2011-06-01 2012-12-06 Cisco Technology, Inc. Management of misbehaving nodes in a computer network
US9250625B2 (en) 2011-07-19 2016-02-02 Ge Intelligent Platforms, Inc. System of sequential kernel regression modeling for forecasting and prognostics
US9256224B2 (en) 2011-07-19 2016-02-09 GE Intelligent Platforms, Inc Method of sequential kernel regression modeling for forecasting and prognostics
US20160155098A1 (en) 2014-12-01 2016-06-02 Uptake, LLC Historical Health Metrics
US10254751B2 (en) 2015-06-05 2019-04-09 Uptake Technologies, Inc. Local analytics at an asset
US10579750B2 (en) 2015-06-05 2020-03-03 Uptake Technologies, Inc. Dynamic execution of predictive models
US10176279B2 (en) 2015-06-05 2019-01-08 Uptake Technologies, Inc. Dynamic execution of predictive models and workflows
US10878385B2 (en) 2015-06-19 2020-12-29 Uptake Technologies, Inc. Computer system and method for distributing execution of a predictive model
WO2017049207A1 (en) 2015-09-17 2017-03-23 Uptake Technologies, Inc. Computer systems and methods for sharing asset-related information between data platforms over a network
WO2017100306A1 (en) 2015-12-07 2017-06-15 Uptake Technologies, Inc. Local analytics device
US11295217B2 (en) 2016-01-14 2022-04-05 Uptake Technologies, Inc. Localized temporal model forecasting
US10510006B2 (en) 2016-03-09 2019-12-17 Uptake Technologies, Inc. Handling of predictive models based on asset location
US10796235B2 (en) 2016-03-25 2020-10-06 Uptake Technologies, Inc. Computer systems and methods for providing a visualization of asset event and signal data
US20170353353A1 (en) 2016-06-03 2017-12-07 Uptake Technologies, Inc. Provisioning a Local Analytics Device
US10210037B2 (en) 2016-08-25 2019-02-19 Uptake Technologies, Inc. Interface tool for asset fault analysis
US10474932B2 (en) 2016-09-01 2019-11-12 Uptake Technologies, Inc. Detection of anomalies in multivariate data
US10228925B2 (en) 2016-12-19 2019-03-12 Uptake Technologies, Inc. Systems, devices, and methods for deploying one or more artifacts to a deployment environment
US10579961B2 (en) 2017-01-26 2020-03-03 Uptake Technologies, Inc. Method and system of identifying environment features for use in analyzing asset operation
US10671039B2 (en) 2017-05-03 2020-06-02 Uptake Technologies, Inc. Computer system and method for predicting an abnormal event at a wind turbine in a cluster
US10255526B2 (en) 2017-06-09 2019-04-09 Uptake Technologies, Inc. Computer system and method for classifying temporal patterns of change in images of an area
US11232371B2 (en) 2017-10-19 2022-01-25 Uptake Technologies, Inc. Computer system and method for detecting anomalies in multivariate data
US10552246B1 (en) 2017-10-24 2020-02-04 Uptake Technologies, Inc. Computer system and method for handling non-communicative assets
US10379982B2 (en) 2017-10-31 2019-08-13 Uptake Technologies, Inc. Computer system and method for performing a virtual load test
US10635519B1 (en) 2017-11-30 2020-04-28 Uptake Technologies, Inc. Systems and methods for detecting and remedying software anomalies
US10815966B1 (en) 2018-02-01 2020-10-27 Uptake Technologies, Inc. Computer system and method for determining an orientation of a wind turbine nacelle
US10554518B1 (en) 2018-03-02 2020-02-04 Uptake Technologies, Inc. Computer system and method for evaluating health of nodes in a manufacturing network
US10169135B1 (en) 2018-03-02 2019-01-01 Uptake Technologies, Inc. Computer system and method of detecting manufacturing network anomalies
US10820617B1 (en) 2018-03-29 2020-11-03 Government Of The United States, As Represented By The Secretary Of The Air Force All inclusive electrolytes, vitamins, and protein powder training supplement
US10635095B2 (en) 2018-04-24 2020-04-28 Uptake Technologies, Inc. Computer system and method for creating a supervised failure model
US10860599B2 (en) 2018-06-11 2020-12-08 Uptake Technologies, Inc. Tool for creating and deploying configurable pipelines
US10579932B1 (en) 2018-07-10 2020-03-03 Uptake Technologies, Inc. Computer system and method for creating and deploying an anomaly detection model based on streaming data
US11119472B2 (en) 2018-09-28 2021-09-14 Uptake Technologies, Inc. Computer system and method for evaluating an event prediction model
US11181894B2 (en) 2018-10-15 2021-11-23 Uptake Technologies, Inc. Computer system and method of defining a set of anomaly thresholds for an anomaly detection model
US11480934B2 (en) 2019-01-24 2022-10-25 Uptake Technologies, Inc. Computer system and method for creating an event prediction model
US11030067B2 (en) 2019-01-29 2021-06-08 Uptake Technologies, Inc. Computer system and method for presenting asset insights at a graphical user interface
US11797550B2 (en) 2019-01-30 2023-10-24 Uptake Technologies, Inc. Data science platform
CN109673900A (en) * 2019-02-25 2019-04-26 黑龙江阳光工业大麻研究院 Anti- saccharification sports drink of one kind and preparation method thereof
US11208986B2 (en) 2019-06-27 2021-12-28 Uptake Technologies, Inc. Computer system and method for detecting irregular yaw activity at a wind turbine
US10975841B2 (en) 2019-08-02 2021-04-13 Uptake Technologies, Inc. Computer system and method for detecting rotor imbalance at a wind turbine
CN112414694B (en) * 2020-06-12 2021-08-27 北京航空航天大学 Equipment multistage abnormal state identification method and device based on multivariate state estimation technology
US11892830B2 (en) 2020-12-16 2024-02-06 Uptake Technologies, Inc. Risk assessment at power substations
CN113159405B (en) * 2021-04-14 2022-03-29 西南交通大学 Wind power prediction method for optimizing LSSVR (least Square support vector regression) based on improved satin blue gardener algorithm

Citations (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3045221A (en) * 1958-01-22 1962-07-17 Gen Atronics Corp Monitoring device
US4336595A (en) * 1977-08-22 1982-06-22 Lockheed Corporation Structural life computer
US4639882A (en) * 1983-06-24 1987-01-27 United Kingdom Atomic Energy Authority Monitoring system
US4761748A (en) * 1984-09-13 1988-08-02 Framatome & Cie Method for validating the value of a parameter
US4796205A (en) * 1984-08-17 1989-01-03 Hochiki Corp. Fire alarm system
US4823290A (en) * 1987-07-21 1989-04-18 Honeywell Bull Inc. Method and apparatus for monitoring the operating environment of a computer system
US4841456A (en) * 1986-09-09 1989-06-20 The Boeing Company Test system and method using artificial intelligence control
US4937763A (en) * 1988-09-06 1990-06-26 E I International, Inc. Method of system state analysis
US5003950A (en) * 1988-06-15 1991-04-02 Toyota Jidosha Kabushiki Kaisha Apparatus for control and intake air amount prediction in an internal combustion engine
US5025499A (en) * 1988-04-13 1991-06-18 Hitachi, Ltd. Process control method and control system
US5052630A (en) * 1990-02-27 1991-10-01 Mac Corporation Method and apparatus to reduce material
US5093792A (en) * 1988-05-31 1992-03-03 Kabushiki Kaisha Toyota Chuo Kenkyusho Combustion prediction and discrimination apparatus for an internal combustion engine and control apparatus therefor
US5113483A (en) * 1990-06-15 1992-05-12 Microelectronics And Computer Technology Corporation Neural network with semi-localized non-linear mapping of the input space
US5119287A (en) * 1987-09-11 1992-06-02 Kabushiki Kaisha Yaskawa Denki Seisakusho Optimum tracking control method for periodic target value
US5123017A (en) * 1989-09-29 1992-06-16 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Remote maintenance monitoring system
US5187735A (en) * 1990-05-01 1993-02-16 Tele Guia Talking Yellow Pages, Inc. Integrated voice-mail based voice and information processing system
US5195046A (en) * 1989-01-10 1993-03-16 Gerardi Joseph J Method and apparatus for structural integrity monitoring
US5210704A (en) * 1990-10-02 1993-05-11 Technology International Incorporated System for prognosis and diagnostics of failure and wearout monitoring and for prediction of life expectancy of helicopter gearboxes and other rotating equipment
US5223207A (en) * 1992-01-29 1993-06-29 The United States Of America As Represented By The United States Department Of Energy Expert system for online surveillance of nuclear reactor coolant pumps
US5239462A (en) * 1992-02-25 1993-08-24 Creative Solutions Groups, Inc. Method and apparatus for automatically determining the approval status of a potential borrower
US5251285A (en) * 1988-03-25 1993-10-05 Hitachi, Ltd. Method and system for process control with complex inference mechanism using qualitative and quantitative reasoning
US5285494A (en) * 1992-07-31 1994-02-08 Pactel Corporation Network management system
US5311562A (en) * 1992-12-01 1994-05-10 Westinghouse Electric Corp. Plant maintenance with predictive diagnostics
US5327349A (en) * 1993-04-15 1994-07-05 Square D Company Method and apparatus for analyzing and recording downtime of a manufacturing process
US5386373A (en) * 1993-08-05 1995-01-31 Pavilion Technologies, Inc. Virtual continuous emission monitoring system with sensor validation
US5387783A (en) * 1992-04-30 1995-02-07 Postalsoft, Inc. Method and apparatus for inserting and printing barcoded zip codes
US5390776A (en) * 1991-03-21 1995-02-21 Mars, Incorporated Device for routing coins
US5420571A (en) * 1994-01-11 1995-05-30 Honeywell Inc. Switch with end of life prediction capability
US5421204A (en) * 1993-06-08 1995-06-06 Svaty, Jr.; Karl J. Structural monitoring system
US5446672A (en) * 1994-08-09 1995-08-29 Air Gage Company Machine monitoring system
US5450537A (en) * 1989-12-08 1995-09-12 Hitachi, Ltd. Method and apparatus for completing a partially completed document in accordance with a blank form from data automatically retrieved from a database
US5455777A (en) * 1992-11-20 1995-10-03 Kabushiki Kaisha Toshiba Method of predicting deterioration and damage of structural member and prediction apparatus for use with the method
US5459675A (en) * 1992-01-29 1995-10-17 Arch Development Corporation System for monitoring an industrial process and determining sensor status
US5481647A (en) * 1991-03-22 1996-01-02 Raff Enterprises, Inc. User adaptable expert system
US5495168A (en) * 1994-09-12 1996-02-27 Fluke Corporation Method of signal analysis employing histograms to establish stable, scaled displays in oscilloscopes
US5500940A (en) * 1994-04-25 1996-03-19 Hewlett-Packard Company Method for evaluating failure in an electronic data storage system and preemptive notification thereof, and system with component failure evaluation
US5502543A (en) * 1994-06-28 1996-03-26 Xerox Corporation System for collecting statistical data on remotely monitored machines
US5539638A (en) * 1993-08-05 1996-07-23 Pavilion Technologies, Inc. Virtual emissions monitor for automobile
US5553239A (en) * 1994-11-10 1996-09-03 At&T Corporation Management facility for server entry and application utilization in a multi-node server configuration
US5600726A (en) * 1995-04-07 1997-02-04 Gemini Systems, L.L.C. Method for creating specific purpose rule-based n-bit virtual machines
US5611052A (en) * 1993-11-01 1997-03-11 The Golden 1 Credit Union Lender direct credit evaluation and loan processing system
US5629878A (en) * 1993-10-07 1997-05-13 International Business Machines Corporation Test planning and execution models for generating non-redundant test modules for testing a computer system
US5638413A (en) * 1994-06-21 1997-06-10 Kabushiki Kaisha Toshiba Apparatus and method for estimating core performance
US5657245A (en) * 1994-11-09 1997-08-12 Westinghouse Electric Corporation Component maintenance system
US5663894A (en) * 1995-09-06 1997-09-02 Ford Global Technologies, Inc. System and method for machining process characterization using mechanical signature analysis
US5668944A (en) * 1994-09-06 1997-09-16 International Business Machines Corporation Method and system for providing performance diagnosis of a computer system
US5671635A (en) * 1994-11-14 1997-09-30 Westinghouse Electric Corporation Method and apparatus for monitoring of spring pack displacement of a motor-operated valve
US5680409A (en) * 1995-08-11 1997-10-21 Fisher-Rosemount Systems, Inc. Method and apparatus for detecting and identifying faulty sensors in a process
US5708780A (en) * 1995-06-07 1998-01-13 Open Market, Inc. Internet server access control and monitoring systems
US5710723A (en) * 1995-04-05 1998-01-20 Dayton T. Brown Method and apparatus for performing pre-emptive maintenance on operating equipment
US5727163A (en) * 1995-03-30 1998-03-10 Amazon.Com, Inc. Secure method for communicating credit card data when placing an order on a non-secure network
US5727144A (en) * 1994-12-15 1998-03-10 International Business Machines Corporation Failure prediction for disk arrays
US5745654A (en) * 1996-02-13 1998-04-28 Hnc Software, Inc. Fast explanations of scored observations
US5748469A (en) * 1994-10-18 1998-05-05 Neles Controls Oy Method and apparatus for detecting a fault of a control valve assembly in a control loop
US5757309A (en) * 1996-12-18 1998-05-26 The United States Of America As Represented By The Secretary Of The Navy Spatial frequency feature extraction for a classification system using wavelets
US5761640A (en) * 1995-12-18 1998-06-02 Nynex Science & Technology, Inc. Name and address processor
US5761090A (en) * 1995-10-10 1998-06-02 The University Of Chicago Expert system for testing industrial processes and determining sensor status
US5764509A (en) * 1996-06-19 1998-06-09 The University Of Chicago Industrial process surveillance system
US5774883A (en) * 1995-05-25 1998-06-30 Andersen; Lloyd R. Method for selecting a seller's most profitable financing program
US5774379A (en) * 1995-07-21 1998-06-30 The University Of Chicago System for monitoring an industrial or biological process
US5774882A (en) * 1992-03-12 1998-06-30 Keen; Regina D. Credit approval system
US5784285A (en) * 1996-01-31 1998-07-21 Nec Corporation Waveform analyzer
US5787138A (en) * 1994-06-02 1998-07-28 Abb Atom Ab Supervision of a neutron detector in a nuclear reactor
US5790977A (en) * 1997-02-06 1998-08-04 Hewlett-Packard Company Data acquisition from a remote instrument via the internet
US5797133A (en) * 1994-08-31 1998-08-18 Strategic Solutions Group, Inc Method for automatically determining the approval status of a potential borrower
US5796633A (en) * 1996-07-12 1998-08-18 Electronic Data Systems Corporation Method and system for performance monitoring in computer networks
US5819029A (en) * 1997-02-20 1998-10-06 Brittan Communications International Corp. Third party verification system and method
US5819291A (en) * 1996-08-23 1998-10-06 General Electric Company Matching new customer records to existing customer records in a large business database using hash key
US5822212A (en) * 1993-08-06 1998-10-13 Fanuc Ltd Machining load monitoring system
US5864773A (en) * 1995-11-03 1999-01-26 Texas Instruments Incorporated Virtual sensor based monitoring and fault detection/classification system and method for semiconductor processing equipment
US5870721A (en) * 1993-08-27 1999-02-09 Affinity Technology Group, Inc. System and method for real time loan approval
US5878403A (en) * 1995-09-12 1999-03-02 Cmsi Computer implemented automated credit application analysis and decision routing system
US5886913A (en) * 1997-05-29 1999-03-23 Alcatel Alsthom Compagnie Generale D'electricite Method of synthesizing a finite impulse response digital filter and filter obtained by this method
US5895177A (en) * 1996-05-20 1999-04-20 Brother Kogyo Kabushiki Kaisha Machine tool with fault detection
US5905989A (en) * 1996-11-27 1999-05-18 Bently Nevada Corporation Knowledge manager relying on a hierarchical default expert system: apparatus and method
US5909368A (en) * 1996-04-12 1999-06-01 Fisher-Rosemount Systems, Inc. Process control system using a process control strategy distributed among multiple control elements
US5911135A (en) * 1987-04-15 1999-06-08 Proprietary Financial Products, Inc. System for managing financial accounts by a priority allocation of funds among accounts
US5913911A (en) * 1997-02-14 1999-06-22 Kuhlman Corporation Method and apparatus for concentrating signals
US5930779A (en) * 1997-03-25 1999-07-27 Mci Communications Corporation Web based system and method to automate storage of power plant data and calculation of battery reserves
US5933818A (en) * 1997-06-02 1999-08-03 Electronic Data Systems Corporation Autonomous knowledge discovery system and method
US5933352A (en) * 1994-06-08 1999-08-03 Salut; Gerard Method and a system for non-linear optimal estimation of dynamic processes in real time
US5940811A (en) * 1993-08-27 1999-08-17 Affinity Technology Group, Inc. Closed loop financial transaction method and apparatus
US5940812A (en) * 1997-08-19 1999-08-17 Loanmarket Resources, L.L.C. Apparatus and method for automatically matching a best available loan to a potential borrower via global telecommunications network
US5950179A (en) * 1996-12-03 1999-09-07 Providian Financial Corporation Method and system for issuing a secured credit card
US5960411A (en) * 1997-09-12 1999-09-28 Amazon.Com, Inc. Method and system for placing a purchase order via a communications network
US6014645A (en) * 1996-04-19 2000-01-11 Block Financial Corporation Real-time financial card application system
US6023507A (en) * 1997-03-17 2000-02-08 Sun Microsystems, Inc. Automatic remote computer monitoring system
US6026348A (en) * 1997-10-14 2000-02-15 Bently Nevada Corporation Apparatus and method for compressing measurement data correlative to machine status
US6029890A (en) * 1998-06-22 2000-02-29 Austin; Frank User-Specified credit card system
US6049827A (en) * 1997-02-20 2000-04-11 Hitachi, Ltd. Network management tool for causing network equipment to display information of a network relevant to the network equipment
US6076088A (en) * 1996-02-09 2000-06-13 Paik; Woojin Information extraction system and method using concept relation concept (CRC) triples
US6088686A (en) * 1995-12-12 2000-07-11 Citibank, N.A. System and method to performing on-line credit reviews and approvals
US6104965A (en) * 1997-05-01 2000-08-15 Motorola, Inc. Control of workstations in assembly lines
US6112190A (en) * 1997-08-19 2000-08-29 Citibank, N.A. Method and system for commercial credit analysis
US6202038B1 (en) * 1998-01-14 2001-03-13 Arch Development Corporation Ultrasensitive surveillance of sensors and processes
US6418431B1 (en) * 1998-03-30 2002-07-09 Microsoft Corporation Information retrieval and speech recognition based on language models

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE31750E (en) * 1977-11-25 1984-11-27 Ird Mechanalysis, Inc. Data acquisition system
US4480480A (en) 1981-05-18 1984-11-06 Scott Science & Technology, Inc. System for assessing the integrity of structural systems
US4707796A (en) 1983-10-19 1987-11-17 Calabro Salvatore R Reliability and maintainability indicator
US5067099A (en) * 1988-11-03 1991-11-19 Allied-Signal Inc. Methods and apparatus for monitoring system performance
US5262941A (en) 1990-03-30 1993-11-16 Itt Corporation Expert credit recommendation method and system
US5930776A (en) 1993-11-01 1999-07-27 The Golden 1 Credit Union Lender direct credit evaluation and loan processing system
US5480865A (en) * 1994-02-25 1996-01-02 Parkinson's Charitable Trust Nutritional composition
US5704029A (en) 1994-05-23 1997-12-30 Wright Strategies, Inc. System and method for completing an electronic form
US5586066A (en) 1994-06-08 1996-12-17 Arch Development Corporation Surveillance of industrial processes with correlated parameters
US5696907A (en) 1995-02-27 1997-12-09 General Electric Company System and method for performing risk and credit analysis of financial service applications
US5699403A (en) 1995-04-12 1997-12-16 Lucent Technologies Inc. Network vulnerability management apparatus and method
US5819236A (en) 1995-06-12 1998-10-06 Carreker-Antinori, Inc. System and method for providing advance notification of potential presentment returns due to account restrictions
US5845230A (en) 1996-01-30 1998-12-01 Skf Condition Monitoring Apparatus and method for the remote monitoring of machine condition
US5995916A (en) 1996-04-12 1999-11-30 Fisher-Rosemount Systems, Inc. Process control system for monitoring and displaying diagnostic information of multiple distributed devices
US5987434A (en) 1996-06-10 1999-11-16 Libman; Richard Marc Apparatus and method for transacting marketing and sales of financial products
US5963884A (en) 1996-09-23 1999-10-05 Machine Xpert, Llc Predictive maintenance system
US5970430A (en) 1996-10-04 1999-10-19 Fisher Controls International, Inc. Local device and process diagnostics in a process control network having distributed control functions
US5966699A (en) 1996-10-11 1999-10-12 Zandi; Richard System and method for conducting loan auction over computer network
US6603487B1 (en) 1996-10-31 2003-08-05 International Business Machines Corporation System for electronically developing and processing a document
US5970478A (en) 1997-03-12 1999-10-19 Walker Asset Management Limited Partnership Method, apparatus, and program for customizing credit accounts
US5832465A (en) 1997-04-07 1998-11-03 General Electric Company Method for building a self-learning evidential reasoning system
US6006260A (en) 1997-06-03 1999-12-21 Keynote Systems, Inc. Method and apparatus for evalutating service to a user over the internet
US5995947A (en) 1997-09-12 1999-11-30 Imx Mortgage Exchange Interactive mortgage and loan information and real-time trading system
US6000832A (en) 1997-09-24 1999-12-14 Microsoft Corporation Electronic online commerce card with customer generated transaction proxy number for online transactions
US6128543A (en) 1998-06-24 2000-10-03 Hitchner; Jim Method and apparatus for collecting manufacturing equipment downtime data
US6051236A (en) * 1998-11-12 2000-04-18 Pacifichealth Laboratories, Inc. Composition for optimizing muscle performance during exercise

Patent Citations (99)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3045221A (en) * 1958-01-22 1962-07-17 Gen Atronics Corp Monitoring device
US4336595A (en) * 1977-08-22 1982-06-22 Lockheed Corporation Structural life computer
US4639882A (en) * 1983-06-24 1987-01-27 United Kingdom Atomic Energy Authority Monitoring system
US4796205A (en) * 1984-08-17 1989-01-03 Hochiki Corp. Fire alarm system
US4761748A (en) * 1984-09-13 1988-08-02 Framatome & Cie Method for validating the value of a parameter
US4841456A (en) * 1986-09-09 1989-06-20 The Boeing Company Test system and method using artificial intelligence control
US5911135A (en) * 1987-04-15 1999-06-08 Proprietary Financial Products, Inc. System for managing financial accounts by a priority allocation of funds among accounts
US4823290A (en) * 1987-07-21 1989-04-18 Honeywell Bull Inc. Method and apparatus for monitoring the operating environment of a computer system
US5119287A (en) * 1987-09-11 1992-06-02 Kabushiki Kaisha Yaskawa Denki Seisakusho Optimum tracking control method for periodic target value
US5251285A (en) * 1988-03-25 1993-10-05 Hitachi, Ltd. Method and system for process control with complex inference mechanism using qualitative and quantitative reasoning
US5025499A (en) * 1988-04-13 1991-06-18 Hitachi, Ltd. Process control method and control system
US5093792A (en) * 1988-05-31 1992-03-03 Kabushiki Kaisha Toyota Chuo Kenkyusho Combustion prediction and discrimination apparatus for an internal combustion engine and control apparatus therefor
US5003950A (en) * 1988-06-15 1991-04-02 Toyota Jidosha Kabushiki Kaisha Apparatus for control and intake air amount prediction in an internal combustion engine
US4937763A (en) * 1988-09-06 1990-06-26 E I International, Inc. Method of system state analysis
US5195046A (en) * 1989-01-10 1993-03-16 Gerardi Joseph J Method and apparatus for structural integrity monitoring
US5123017A (en) * 1989-09-29 1992-06-16 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Remote maintenance monitoring system
US5450537A (en) * 1989-12-08 1995-09-12 Hitachi, Ltd. Method and apparatus for completing a partially completed document in accordance with a blank form from data automatically retrieved from a database
US5052630A (en) * 1990-02-27 1991-10-01 Mac Corporation Method and apparatus to reduce material
US5187735A (en) * 1990-05-01 1993-02-16 Tele Guia Talking Yellow Pages, Inc. Integrated voice-mail based voice and information processing system
US5113483A (en) * 1990-06-15 1992-05-12 Microelectronics And Computer Technology Corporation Neural network with semi-localized non-linear mapping of the input space
US5210704A (en) * 1990-10-02 1993-05-11 Technology International Incorporated System for prognosis and diagnostics of failure and wearout monitoring and for prediction of life expectancy of helicopter gearboxes and other rotating equipment
US5390776A (en) * 1991-03-21 1995-02-21 Mars, Incorporated Device for routing coins
US5481647A (en) * 1991-03-22 1996-01-02 Raff Enterprises, Inc. User adaptable expert system
US5223207A (en) * 1992-01-29 1993-06-29 The United States Of America As Represented By The United States Department Of Energy Expert system for online surveillance of nuclear reactor coolant pumps
US5459675A (en) * 1992-01-29 1995-10-17 Arch Development Corporation System for monitoring an industrial process and determining sensor status
US5239462A (en) * 1992-02-25 1993-08-24 Creative Solutions Groups, Inc. Method and apparatus for automatically determining the approval status of a potential borrower
US5774882A (en) * 1992-03-12 1998-06-30 Keen; Regina D. Credit approval system
US5387783A (en) * 1992-04-30 1995-02-07 Postalsoft, Inc. Method and apparatus for inserting and printing barcoded zip codes
US5285494A (en) * 1992-07-31 1994-02-08 Pactel Corporation Network management system
US5455777A (en) * 1992-11-20 1995-10-03 Kabushiki Kaisha Toshiba Method of predicting deterioration and damage of structural member and prediction apparatus for use with the method
US5311562A (en) * 1992-12-01 1994-05-10 Westinghouse Electric Corp. Plant maintenance with predictive diagnostics
US5327349A (en) * 1993-04-15 1994-07-05 Square D Company Method and apparatus for analyzing and recording downtime of a manufacturing process
US5421204A (en) * 1993-06-08 1995-06-06 Svaty, Jr.; Karl J. Structural monitoring system
US5682317A (en) * 1993-08-05 1997-10-28 Pavilion Technologies, Inc. Virtual emissions monitor for automobile and associated control system
US5539638A (en) * 1993-08-05 1996-07-23 Pavilion Technologies, Inc. Virtual emissions monitor for automobile
US5548528A (en) * 1993-08-05 1996-08-20 Pavilion Technologies Virtual continuous emission monitoring system
US5386373A (en) * 1993-08-05 1995-01-31 Pavilion Technologies, Inc. Virtual continuous emission monitoring system with sensor validation
US5822212A (en) * 1993-08-06 1998-10-13 Fanuc Ltd Machining load monitoring system
US5870721A (en) * 1993-08-27 1999-02-09 Affinity Technology Group, Inc. System and method for real time loan approval
US5940811A (en) * 1993-08-27 1999-08-17 Affinity Technology Group, Inc. Closed loop financial transaction method and apparatus
US6105007A (en) * 1993-08-27 2000-08-15 Affinity Technology Group, Inc. Automatic financial account processing system
US5629878A (en) * 1993-10-07 1997-05-13 International Business Machines Corporation Test planning and execution models for generating non-redundant test modules for testing a computer system
US5611052A (en) * 1993-11-01 1997-03-11 The Golden 1 Credit Union Lender direct credit evaluation and loan processing system
US5420571A (en) * 1994-01-11 1995-05-30 Honeywell Inc. Switch with end of life prediction capability
US5500940A (en) * 1994-04-25 1996-03-19 Hewlett-Packard Company Method for evaluating failure in an electronic data storage system and preemptive notification thereof, and system with component failure evaluation
US5787138A (en) * 1994-06-02 1998-07-28 Abb Atom Ab Supervision of a neutron detector in a nuclear reactor
US5933352A (en) * 1994-06-08 1999-08-03 Salut; Gerard Method and a system for non-linear optimal estimation of dynamic processes in real time
US5638413A (en) * 1994-06-21 1997-06-10 Kabushiki Kaisha Toshiba Apparatus and method for estimating core performance
US5502543A (en) * 1994-06-28 1996-03-26 Xerox Corporation System for collecting statistical data on remotely monitored machines
US5446672A (en) * 1994-08-09 1995-08-29 Air Gage Company Machine monitoring system
US5797133A (en) * 1994-08-31 1998-08-18 Strategic Solutions Group, Inc Method for automatically determining the approval status of a potential borrower
US5668944A (en) * 1994-09-06 1997-09-16 International Business Machines Corporation Method and system for providing performance diagnosis of a computer system
US5495168A (en) * 1994-09-12 1996-02-27 Fluke Corporation Method of signal analysis employing histograms to establish stable, scaled displays in oscilloscopes
US5748469A (en) * 1994-10-18 1998-05-05 Neles Controls Oy Method and apparatus for detecting a fault of a control valve assembly in a control loop
US5657245A (en) * 1994-11-09 1997-08-12 Westinghouse Electric Corporation Component maintenance system
US5553239A (en) * 1994-11-10 1996-09-03 At&T Corporation Management facility for server entry and application utilization in a multi-node server configuration
US5671635A (en) * 1994-11-14 1997-09-30 Westinghouse Electric Corporation Method and apparatus for monitoring of spring pack displacement of a motor-operated valve
US5727144A (en) * 1994-12-15 1998-03-10 International Business Machines Corporation Failure prediction for disk arrays
US5727163A (en) * 1995-03-30 1998-03-10 Amazon.Com, Inc. Secure method for communicating credit card data when placing an order on a non-secure network
US5710723A (en) * 1995-04-05 1998-01-20 Dayton T. Brown Method and apparatus for performing pre-emptive maintenance on operating equipment
US5600726A (en) * 1995-04-07 1997-02-04 Gemini Systems, L.L.C. Method for creating specific purpose rule-based n-bit virtual machines
US5774883A (en) * 1995-05-25 1998-06-30 Andersen; Lloyd R. Method for selecting a seller's most profitable financing program
US5708780A (en) * 1995-06-07 1998-01-13 Open Market, Inc. Internet server access control and monitoring systems
US5774379A (en) * 1995-07-21 1998-06-30 The University Of Chicago System for monitoring an industrial or biological process
US5680409A (en) * 1995-08-11 1997-10-21 Fisher-Rosemount Systems, Inc. Method and apparatus for detecting and identifying faulty sensors in a process
US5663894A (en) * 1995-09-06 1997-09-02 Ford Global Technologies, Inc. System and method for machining process characterization using mechanical signature analysis
US5878403A (en) * 1995-09-12 1999-03-02 Cmsi Computer implemented automated credit application analysis and decision routing system
US5761090A (en) * 1995-10-10 1998-06-02 The University Of Chicago Expert system for testing industrial processes and determining sensor status
US5864773A (en) * 1995-11-03 1999-01-26 Texas Instruments Incorporated Virtual sensor based monitoring and fault detection/classification system and method for semiconductor processing equipment
US6088686A (en) * 1995-12-12 2000-07-11 Citibank, N.A. System and method to performing on-line credit reviews and approvals
US5761640A (en) * 1995-12-18 1998-06-02 Nynex Science & Technology, Inc. Name and address processor
US5784285A (en) * 1996-01-31 1998-07-21 Nec Corporation Waveform analyzer
US6076088A (en) * 1996-02-09 2000-06-13 Paik; Woojin Information extraction system and method using concept relation concept (CRC) triples
US5745654A (en) * 1996-02-13 1998-04-28 Hnc Software, Inc. Fast explanations of scored observations
US5909368A (en) * 1996-04-12 1999-06-01 Fisher-Rosemount Systems, Inc. Process control system using a process control strategy distributed among multiple control elements
US6014645A (en) * 1996-04-19 2000-01-11 Block Financial Corporation Real-time financial card application system
US5895177A (en) * 1996-05-20 1999-04-20 Brother Kogyo Kabushiki Kaisha Machine tool with fault detection
US5764509A (en) * 1996-06-19 1998-06-09 The University Of Chicago Industrial process surveillance system
US5796633A (en) * 1996-07-12 1998-08-18 Electronic Data Systems Corporation Method and system for performance monitoring in computer networks
US5819291A (en) * 1996-08-23 1998-10-06 General Electric Company Matching new customer records to existing customer records in a large business database using hash key
US5905989A (en) * 1996-11-27 1999-05-18 Bently Nevada Corporation Knowledge manager relying on a hierarchical default expert system: apparatus and method
US5950179A (en) * 1996-12-03 1999-09-07 Providian Financial Corporation Method and system for issuing a secured credit card
US5757309A (en) * 1996-12-18 1998-05-26 The United States Of America As Represented By The Secretary Of The Navy Spatial frequency feature extraction for a classification system using wavelets
US5790977A (en) * 1997-02-06 1998-08-04 Hewlett-Packard Company Data acquisition from a remote instrument via the internet
US5913911A (en) * 1997-02-14 1999-06-22 Kuhlman Corporation Method and apparatus for concentrating signals
US5819029A (en) * 1997-02-20 1998-10-06 Brittan Communications International Corp. Third party verification system and method
US6049827A (en) * 1997-02-20 2000-04-11 Hitachi, Ltd. Network management tool for causing network equipment to display information of a network relevant to the network equipment
US6023507A (en) * 1997-03-17 2000-02-08 Sun Microsystems, Inc. Automatic remote computer monitoring system
US5930779A (en) * 1997-03-25 1999-07-27 Mci Communications Corporation Web based system and method to automate storage of power plant data and calculation of battery reserves
US6104965A (en) * 1997-05-01 2000-08-15 Motorola, Inc. Control of workstations in assembly lines
US5886913A (en) * 1997-05-29 1999-03-23 Alcatel Alsthom Compagnie Generale D'electricite Method of synthesizing a finite impulse response digital filter and filter obtained by this method
US5933818A (en) * 1997-06-02 1999-08-03 Electronic Data Systems Corporation Autonomous knowledge discovery system and method
US5940812A (en) * 1997-08-19 1999-08-17 Loanmarket Resources, L.L.C. Apparatus and method for automatically matching a best available loan to a potential borrower via global telecommunications network
US6112190A (en) * 1997-08-19 2000-08-29 Citibank, N.A. Method and system for commercial credit analysis
US5960411A (en) * 1997-09-12 1999-09-28 Amazon.Com, Inc. Method and system for placing a purchase order via a communications network
US6026348A (en) * 1997-10-14 2000-02-15 Bently Nevada Corporation Apparatus and method for compressing measurement data correlative to machine status
US6202038B1 (en) * 1998-01-14 2001-03-13 Arch Development Corporation Ultrasensitive surveillance of sensors and processes
US6418431B1 (en) * 1998-03-30 2002-07-09 Microsoft Corporation Information retrieval and speech recognition based on language models
US6029890A (en) * 1998-06-22 2000-02-29 Austin; Frank User-Specified credit card system

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080115014A1 (en) * 2006-11-13 2008-05-15 Kalyanaraman Vaidyanathan Method and apparatus for detecting degradation in a remote storage device
US7769562B2 (en) * 2006-11-13 2010-08-03 Oracle America, Inc. Method and apparatus for detecting degradation in a remote storage device
US20130024166A1 (en) * 2011-07-19 2013-01-24 Smartsignal Corporation Monitoring System Using Kernel Regression Modeling with Pattern Sequences
US20130024415A1 (en) * 2011-07-19 2013-01-24 Smartsignal Corporation Monitoring Method Using Kernel Regression Modeling With Pattern Sequences
US8620853B2 (en) * 2011-07-19 2013-12-31 Smartsignal Corporation Monitoring method using kernel regression modeling with pattern sequences
US8660980B2 (en) * 2011-07-19 2014-02-25 Smartsignal Corporation Monitoring system using kernel regression modeling with pattern sequences
US11178037B2 (en) * 2017-06-02 2021-11-16 Vmware, Inc. Methods and systems that diagnose and manage undesirable operational states of computing facilities
CN111625421A (en) * 2020-05-26 2020-09-04 云和恩墨(北京)信息技术有限公司 Method and device for monitoring distributed storage system, storage medium and processor

Also Published As

Publication number Publication date
US6775641B2 (en) 2004-08-10
US7767239B1 (en) 2010-08-03
AU2001240127B2 (en) 2006-11-30
AU4012701A (en) 2001-09-17
CA2402631A1 (en) 2001-09-13
EP1279104A4 (en) 2004-07-14
ES2320095T3 (en) 2009-05-19
EP1279104A1 (en) 2003-01-29
US20020091499A1 (en) 2002-07-11
ATE418761T1 (en) 2009-01-15
CA2402631C (en) 2011-10-11
EP1279104B1 (en) 2008-12-24
DE60137122D1 (en) 2009-02-05
WO2001067262A1 (en) 2001-09-13

Similar Documents

Publication Publication Date Title
US6775641B2 (en) Generalized lensing angular similarity operator
US7373283B2 (en) Monitoring and fault detection system and method using improved empirical model for range extrema
US6952662B2 (en) Signal differentiation system using improved non-linear operator
US7739096B2 (en) System for extraction of representative data for training of adaptive process monitoring equipment
CA2433941C (en) Adaptive modeling of changed states in predictive condition monitoring
JP3495705B2 (en) Ultra-sensitive monitoring of sensors and processes
JP6068468B2 (en) A sequential kernel regression modeling method for prediction and prediction
Willsky Detection of abrupt changes in dynamic systems
US20020128731A1 (en) Global state change indicator for empirical modeling in condition based monitoring
Sohn et al. Applying the LANL statistical pattern recognition paradigm for structural health monitoring to data from a surface-effect fast patrol boat
US9250625B2 (en) System of sequential kernel regression modeling for forecasting and prognostics
US8660980B2 (en) Monitoring system using kernel regression modeling with pattern sequences
US6957172B2 (en) Complex signal decomposition and modeling
US7308385B2 (en) Diagnostic systems and methods for predictive condition monitoring
EP3258333A1 (en) Method and system for monitoring sensor data of rotating equipment
US20130024415A1 (en) Monitoring Method Using Kernel Regression Modeling With Pattern Sequences
US7085675B2 (en) Subband domain signal validation
US20170249559A1 (en) Apparatus and method for ensembles of kernel regression models
KR20170127430A (en) Method and system for detecting, classifying and / or mitigating sensor error
US20030028349A1 (en) System for monitoring non-coincident, nonstationary process signals
CN114662977A (en) Method and system for detecting abnormity of motion state of offshore drilling platform and electronic equipment
JP6633403B2 (en) Analysis target determination apparatus and analysis target determination method
Botha Detecting change in complex process systems with phase space methods
Lamba et al. Phase space reconstruction of discontinuous maps
D Popescu Detection and Diagnosis of Model Parameter and Noise Variance Changes Using Sliding Windows Approach

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION