US20070217670A1 - On-train rail track monitoring system - Google Patents

On-train rail track monitoring system Download PDF

Info

Publication number
US20070217670A1
US20070217670A1 US11/679,556 US67955607A US2007217670A1 US 20070217670 A1 US20070217670 A1 US 20070217670A1 US 67955607 A US67955607 A US 67955607A US 2007217670 A1 US2007217670 A1 US 2007217670A1
Authority
US
United States
Prior art keywords
train
rail track
irregularity
video images
track
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US11/679,556
Other versions
US8942426B2 (en
Inventor
Michael Bar-Am
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US11/679,556 priority Critical patent/US8942426B2/en
Publication of US20070217670A1 publication Critical patent/US20070217670A1/en
Application granted granted Critical
Publication of US8942426B2 publication Critical patent/US8942426B2/en
Active - Reinstated legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning, or like safety means along the route or between vehicles or vehicle trains
    • B61L23/04Control, warning, or like safety means along the route or between vehicles or vehicle trains for monitoring the mechanical state of the route
    • B61L23/042Track changes detection
    • B61L23/048Road bed changes, e.g. road bed erosion
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61KAUXILIARY EQUIPMENT SPECIALLY ADAPTED FOR RAILWAYS, NOT OTHERWISE PROVIDED FOR
    • B61K9/00Railway vehicle profile gauges; Detecting or indicating overheating of components; Apparatus on locomotives or cars to indicate bad track sections; General design of track recording vehicles
    • B61K9/08Measuring installations for surveying permanent way
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning, or like safety means along the route or between vehicles or vehicle trains
    • B61L23/04Control, warning, or like safety means along the route or between vehicles or vehicle trains for monitoring the mechanical state of the route
    • B61L23/041Obstacle detection
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning, or like safety means along the route or between vehicles or vehicle trains
    • B61L23/04Control, warning, or like safety means along the route or between vehicles or vehicle trains for monitoring the mechanical state of the route
    • B61L23/042Track changes detection
    • B61L23/045Rail wear
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L23/00Control, warning, or like safety means along the route or between vehicles or vehicle trains
    • B61L23/04Control, warning, or like safety means along the route or between vehicles or vehicle trains for monitoring the mechanical state of the route
    • B61L23/042Track changes detection
    • B61L23/047Track or rail movements

Definitions

  • This application relates to automatic inspection of rail track, for the detection of and generating alerts for certain hazards on rail tracks.
  • Some defective conditions of rail tracks may be detected via visual inspections by rail track technicians or engineers who patrol along the rail tracks.
  • Visual patrol inspections are labor intensive, time consuming, and highly dependent on the skills and sometimes physical conditions of individual inspectors, and the lighting and weather conditions.
  • Specially designed inspection vehicles such as track recording vehicles may be equipped with various sensors including cameras and video recorders to inspect rail tracks.
  • the electronic imaging and other devices e.g., ultrasonic sensors
  • track recording vehicles can capture images and various data of the rail tracks for further analysis of any defects or hazards by a rail track engineer or inspector.
  • the use of such inspection vehicles may require designated inspection periods different from regular railway service schedules to run the inspection vehicles through rail tracks to be inspected.
  • This application describes rail track inspection and monitoring techniques and systems that allow for automatic inspection of rail tracks by monitoring the interface between the wheel and rail and the condition of critical track components on regular trains during normal railway service runs without interrupting the normal railway services.
  • a method for monitoring a rail track.
  • An imaging module is used on a passenger or freight train to capture video images of the rail track under the train in motion.
  • the captured video images are automatically processed in a computer on the train to determine whether an irregularity is present on the rail track to adversely affect safety of the train.
  • a method for monitoring a rail track is provided to capture video images from a moving passenger or freight train operating on the rail track during a regular service run of the train.
  • the captured video images are then processed in a computer on the train to determine whether an irregularity is present on the rail track according to a set of predetermined irregularity criteria.
  • Video images that contain detected irregularities on the rail track are selected for further analysis of each detected irregularity.
  • a method for monitoring a rail track includes capturing video images from a moving train operating on the rail track; and automatically processing captured video images using a digital motion detection algorithm to monitor an interface between a wheel of the train and the rail track.
  • a method for monitoring a rail track includes capturing video images from a moving train operating on the rail track; automatically processing captured video images using a digital image matching algorithm to compare the captured video images to stored images of irregularities of the rail track in a digital library to find a match; analyzing a matched video image to determine the nature of an irregularity; and generate an alert signal to alert the irregularity if a parameter of the irregularity exceeds a safety standard threshold.
  • FIG. 1 illustrates a system block diagram
  • FIG. 2 illustrates a WRI monitoring process
  • Implementations of the on-train rail track monitoring described in this application may be used to capture images and data for further analysis by a computer or an inspection specialist at a later time, and to automatically detect selected irregularities or hazardous conditions via on-train software processing of the captured images and data during the normal run of the train without involvement or input of the train operator or driver.
  • the on-train computer processes the captured images and data as they are being captured and the automatic detection is in real time.
  • the on-train system may be configured to identify first signs of an irregularity and deteriorating track condition such that a proper corrective action can be timely taken to intervene before the condition develops into a service or safety issue.
  • Certain selected critical hazardous conditions may be programmed in the on-train system according to safety standards for the automatic detection by the on-train computer. For example, missing or defective components such as voided ties, missing chairs, clips, and other types of track critical components may be selected as the critical hazardous conditions. Inspection of visible rail-head defects may be carried out in some implementations. Warnings or alerts for the selected critical hazardous conditions are generated to alert the railroad and infrastructure operators with the aim of reducing the risk of derailment.
  • the images of irregularities will be transmitted to a control center to be analyzed by a track expert who will decide whether an irregularity is a defect which is required to be further investigated and to be rectified, if needed, by the track workforce on-site. In the event that an irregularity is defined by the analyst as a defect, the urgency of rectifying the defect and notifying railroad operator and perhaps train operators will be dependent upon the level of risk identified by the track expert in the control center.
  • FIG. 1 illustrates one implementation of an on-train rail track monitoring system for use with a regular passenger or freight train during normal service routines.
  • the system is represented by the functional block labeled as “On Train Equipment” and includes an under-train sensing module, an on-train computer as the on-train data processing station, and a positioning device which provides the position data of the train.
  • the positioning device may include a global positioning system (GPS) or other positioning devices.
  • the on-train system may also include a power supply unit (PSU) which receives electrical power from the existing power equipment of the train and converts the received power into suitable voltages/currents as needed for operating various components in the on-train monitoring system.
  • a self-contained power supply unit including rechargeable batteries and/or an electrical generator may be used in some implementations.
  • the system as an option may further include a communication device for linking the on-train computer to an off-train computer or computer storage device to transmit the captured images and data for further analysis.
  • the sensing module is located under the train to allow for detection of the defects in the rail tracks, and irregularities in the Interface of Wheel and Rail (WRI).
  • the sensing module can include video imaging devices such as two or more CCD cameras or cameras with other imaging sensor arrays to capture the video images of the rail tracks and the WRI images, and one or more lights to illuminate the rail tracks and the wheel(s) under monitoring.
  • both day imaging devices and night imaging devices may be used to capture video images under different lighting conditions.
  • the day imaging devices may be CCD cameras which capture the video images under well-lit conditions such as during the day time.
  • the CCD cameras may also be used to capture video images under poorly lit conditions when proper illumination lights are used to illuminate the areas to be imaged.
  • the night imaging devices which may be Infrared (IR) cameras, are used to capture video images under poorly lit conditions, or harsh weather conditions.
  • Millimeter-wave (MM-wave) cameras may be used for inspection in poor visibility conditions in bad weather (e.g. heavy fog, heavy rain, and heavy snow conditions).
  • the positions and the field of view (FOV) of one of the cameras may be set to cover the interface between the right-hand Rail and a corresponding right-hand wheel on the train, and it may cover the track components in the area of the right-hand rail.
  • a second camera may have a FOV that covers the interface between the left-hand rail and the corresponding left-hand wheel on the train, and it may cover the track components in the area of the left-hand rail.
  • the third camera may have a FOV that covers the whole track including the two rails, ties (sleepers), chairs and other supporting components of the rail.
  • the sensing module and its components are designed for operation under extreme environment conditions in the railroad service regions where the railroad tracks are located.
  • the on-train computer e.g., a personal computer (PC) may be programmed to automatically perform various imaging processing tasks without control or input from an operator on the train and to produce output image data files for the captured images and videos.
  • the computer may also be used to control the sensing module and other on-train sub systems and to receive and process data other than captured images and videos.
  • the on-train system may include a communication unit to provide real-time transmission of the captured images and videos to a computer in an off-train control center manned by one or more engineers.
  • This communication unit may be a wireless communication device to wirelessly transmit the data to the off-train control center.
  • the on-train system may also include an interface with existing accelerometers on the train.
  • the on-train computer is programmed with image processing software to automatically detect irregularities in the rail tracks by monitoring the WRI and critical track components.
  • the part of the software for the WRI monitoring is capable of detecting motion in video and is used to detect the dynamic phenomena of the interface between the wheel and the rail.
  • the software further includes a pattern recognition module as a track condition monitoring (TCM) mechanism to detect missing critical parts of the track.
  • TCM track condition monitoring
  • the on-train computer is programmed to produce an alert signal to the railroad/maintenance operator about the detected irregularity.
  • FIG. 1 shows that the captured image and video data from the on-train system may be processed and transmitted in an off-line transmission to the off-train control center.
  • the captured image and video data may be first transferred from the on-train computer to a data storage device or another computer and is subsequently transmitted to the control center, e.g., via a secured internet broadband connection.
  • the control center is designed to include a track monitoring work station for receiving the captured image and video data from one or multiple trains equipped with the on-train monitoring system.
  • the monitoring work station may include one or more display monitors for displaying monitoring images and data transmitted from one or more trains, a data link receiver for receiving the real-time images and data from one or more trains, an Internet connection or other communication connection, a computer for analysis of the transmitted images and data, and video recording equipment that is either separate from the computer or is a function module provided by the computer for viewing and editing the video recording received from the trains.
  • a printer may also be included for printing outputs from the on-train computer.
  • a track expert at the control center can analyze the details of the captured images, video and data on selected irregularities from each train.
  • the above on-train monitoring system may also include a Deferential GPS (DGPS) unit as an option to increase the accuracy of the location identification when operated in areas where the DGPS infrastructure (e.g., presence of DGPS transmitters) is available.
  • DGPS Deferential GPS
  • CDU Control Display Unit
  • the CDU may also include a user interface for initiating and performing the calibration and the set-up process of the on-train monitoring system. A small display screen may be included in the CDU for viewing the camera output from the sensing module.
  • the on-train monitoring system may be turned on by the train driver via pushing a control button at the start of the trip. Alternatively, the on-train monitoring system may be automatically turned on as part of the train start-up process and the system can be configured to continue to operate as long as the train is in motion. This can save an additional operation for the driver.
  • the on-train monitoring system can be installed on a regular passenger or freight train to automatically detect irregularities in the Wheel/Rail Interface (WRI) and track defects during the normal run of the train.
  • WRI Wheel/Rail Interface
  • This on-train monitoring system can be used to provide frequent inspections in regular service runs of the train and provide an efficient and convenient way to alert the railroad and the infrastructure operators of major hazards, thus reducing the risk of derailment.
  • the system in combination with the track expert at the control center, can be used to identify the first signs of an irregularity and a deteriorating track condition, such that an appropriate corrective action can be taken to intervene before the condition further degrades into a concern for the safe operation of the train.
  • the system is used to provide an alert for an immediate short-term maintenance need or an imminent risk, and to trigger attention to certain locations in the rail tracks for further detailed inspections and corrective measures.
  • the on-train monitoring system may be used as a supplement monitoring system and operate in combination with and supplement other monitoring mechanisms such as visual patrol monitoring and track recording vehicles.
  • the automatic on-train monitoring during the normal runs of trains provides an alert for major hazards and short term maintenance.
  • the other systems can be used for the long term to provide elaborated data regarding the track condition and track geometry.
  • the on-train computer can be programmed to perform various imaging-based detections for monitoring the WRI dynamics and certain selected track conditions.
  • the system can be configured to detect flange climb, rapid vertical movement (e.g. wheel unloading), rapid lateral movement (hunting), and rail gauge distance to verify if the distance is within the safety tolerance.
  • the system can be configured to detect defects and irregularities. Those ‘effects’, include, among others, the wheel climb or wheel unloading.
  • the system can detect the first sign (effect) in the case of multiple factors (causes), such as small track defects which may each be within the track standards and each alone may not be sufficient to cause derailment but the combination of these factors as a whole can lead to a derailment.
  • the railroad operator initiates an investigation of the cause for the alerted hazardous condition by, e.g., dispatching an engineer or a track recording vehicle to inspect the location or locations of rail tracks where the alert is generated. Based on this detailed investigation, a proper corrective measure, if needed, is taken to rectify the defect and therefore mitigate the risk caused by the alerted hazardous condition.
  • FIG. 2 shows one example of the processing flow of the WRI monitoring and inspection process performed by the on-train computer.
  • the output video is automatically analyzed by a WRI image processing software installed on the on-train computer.
  • the system detects the irregularities and compares each detected irregularity to the predefined defects in the defect benchmark library. If the irregularity is equal to or exceeds a safety threshold, a defect type code is assigned to the image.
  • the image of the irregularity is next transmitted to the track control work station in the off-train control center to be analyzed by a track expert.
  • the transmitted data may include, e.g., the image of the irregularity, a section of the video recording (a few seconds before and after the irregularity), the location of the train from the GPS system, a corresponding defect code number from the library, the time of the detection, and the identification of the train and the route.
  • data from the accelerometer on the train may be transmitted as well.
  • the images of irregularities from the different trains that are received at the control center may be limited to the images of irregularities which are detected by the system as exceeding the safety thresholds.
  • the detailed analysis can be carried out on the workstation at the off-train control center.
  • the track expert reviews the displayed still images and the associated section of a video recording and decides whether this is a defect to be further investigated or to be rectified by the track workforce on-site. If an action is needed, a new corrective action item can be logged on the system. The urgency of the problem can be defined in the log. If the defect is defined as an urgent matter, the maintainers can be contacted immediately.
  • a track manager on-site may be authorized to close the log of the corrective action item.
  • the track expert at the control center can check the recordings from previous runs at the same location of the train where a defect is currently detected.
  • a database with recordings from previous runs can be provided as a trend database. This is done in order to verify whether this is a repeated irregularity.
  • the track expert can check whether there are any details about this irregularity in the trend database based on previous records. If the track expert decides that the irregularity is not a defect, the images can then be saved in the trend database for future comparison and analysis.
  • the images can be viewed by the expert on the display screen together with the supporting data.
  • the expert may edit the video recording and the images.
  • Database software can be used for reporting the defects and for inserting diagnostic comments. A predetermined list of irregularities and comment descriptions may be used to minimize the time for inserting the data by the analyst.
  • the control center may also include one or more high quality printers to print out the images.
  • An inspection report can be issued on a regular basis, e.g., every day, to the track manager in each line and/or region. The report may include a list of the defects, their descriptions and the diagnosis of the track expert in addition to the image of the defect, location, time, train and line.
  • the on-train computer may be programmed to conduct a trend analysis of a given rail track.
  • this feature allows the system to perform a comparison between the current measurement and historical data from one or more prior monitoring runs.
  • the historical data can be from a run that was undertaken a few weeks or days before the current run.
  • the image may be stored in an anomalies trend database.
  • a trend anomalies report to the track maintainers may be generated.
  • This feature of the system may be configured to limit the number of irregularities which are not safety issues in the trend anomalies report, with the view of reducing the workload on the track maintainers.
  • the associated trend anomalies database may include images that are not considered a safety risk but indicate a significant change from previous runs.
  • the trend database may include images of irregularities that were previously identified by the system as safety defects but were determined not to be safety defects by the track expert. For such irregularities, no intervention is required by the track maintainers in the short term.
  • the above trend analysis may be implemented at a computer off the train, e.g., at the control center.
  • accelerometers When accelerometers are interfaced with the on-train monitoring system, information from the accelerometers installed on the wheel axis can be transmitted together with the image of the irregularity for correlation and verification purposes.
  • the track condition monitoring (TCM) mechanism in the on-train system is implemented in a separate TCM software module based on digital image processing techniques and algorithms including pattern recognition, image matching, or stereo vision technologies.
  • the TCM software module can be configured to automatically detect certain selected missing critical track components via image processing.
  • a digital defect library may be provided in the on-train computer to include images of defects that are used as benchmarks for the decision making as to whether a detected irregularity is a defect or not.
  • the images of the library may be originally generated and recorded from a moving train in testing runs.
  • This track condition monitoring provides to the railway operator signs of deteriorating track conditions.
  • the system is configured to generate alert signals for only major hazards that could lead to derailment.
  • the decision criteria can be formulated according to safety standard thresholds, e.g., if there are a number of missing ties in a row which exceeds a corresponding safety threshold, the system can highlight such a condition via an alert signal.
  • the information provided by the track condition monitoring may be used in conjunction with the data received from the WRI detection to determine, in some cases, reasons for the irregularities.
  • a track safety standard is used to set a threshold for a certain number of missing or defective critical components per a length of track or in a group of N ties. If the detected number of missing/defective components exceeds the safety threshold, a safety alert will be generated.
  • an anomalies library will be generated as part of the inspection process for the comparison of the condition on site and the benchmark condition.
  • the library can include images of critical components in an acceptable condition and in unacceptable condition.
  • the TCM inspection can be carried out during the normal run of the train. Once the system detects a missing/defective component, the detected component can be marked and stored in memory or database while the TCM inspection continues with components in the adjacent tie, and along the rail head. This process can proceed in sequence. If the number of missing or defective components detected by the system exceeds the safety standard thresholds, the data can be transmitted to the track control center.
  • the transmitted data may include, e.g., still images of the detected components, a section of video recordings, definitions of the irregularities, location, time, train identification and route.
  • the data received by the control center can then be analyzed by a track expert who decides whether this condition is a track defect and whether this condition requires a further investigation by the track maintainers on-site.
  • the process of reporting the analysis by the track expert is similar to that in the WRI inspection.
  • the results of TCM analyses may be validated with the WRI monitoring data. This could provide, in some cases, an explanation about the causes of the irregularities that are detected in the WRI inspection (effect).
  • the software module for the WRI monitoring and inspection is based on digital detection of moving objects in videos.
  • Various motion detection techniques may be used.
  • a Video Motion Detection (VMD), image matching, or stereo vision technologies may be in use.
  • VMD Video Motion Detection
  • This software module is a powerful high performance software technology for outdoor environments, may be used to detect moving objects appearing in a video.
  • the software is suitable to work in harsh outdoor conditions, when the camera moves, rotates or shakes, and when changes in the illumination conditions occur.
  • the Software performances are not degraded by motion and vibration. It will work under poor illumination conditions and is compatible with night vision cameras.
  • the software has high detection reliability with high resistance to false alarms and high sensitivity to very small moving objects.
  • a set of virtual digital detectors may be used to detect different parts of an image and each detector tracks a small portion of the image.
  • Each of the digital detectors is sensitive to motion, and when motion is detected, the detector turns on.
  • video images of the interface between the wheel of the train and the rail track are captured when the train is in motion.
  • the computer on the train digitally monitors a relative position and a relative motion of the wheel and the rail track.
  • Digital motion detectors are to respectively monitor motion at different locations of a video image.
  • the captured video images can be filtered to selectively detect motion in the video images.
  • the software module for the TCM may be based on digital pattern recognition in still images and videos and/or an Image Matching technology.
  • Various pattern recognition techniques may be used.
  • an image matching or registration technique may be used to match two or more images which are misaligned relative to one another due to rotation, shifting and zooming of one image with respect to another.
  • the matching can be performed when the two images are not exactly similar due to differences in weather conditions, using different types of cameras, or types of illuminations.
  • the image matching algorithm may be integrated with the motion detection algorithm. With this integration, the motion detection may be achieved even when the camera moves, rotates or shakes, and when changes in the illumination conditions occur.
  • U.S. Pat. No. 6,798,897 entitled “Real time image registration, motion detection and background replacement using discrete local motion estimation” describes techniques for image registration and motion detection based on discrete representation of the location motion in an image to detect and track an object in video images. Such techniques may be implemented as part of the system's software.
  • the on-train monitoring system as illustrated in FIG. 1 may be designed to be as small and compact as possible and to allow for easy installation on and removal from the train.
  • the equipment may be mounted on the train by using quick release devices.
  • Each optical sensor may be mounted inside a rigid enclosure under the train with easy access.
  • all the equipment onboard the train may be mounted in a single assembly on a rack/cabinet with easy access.
  • the installation kit which includes supporting brackets and electrical harnesses for the system, may be fitted as a provision on a number of trains and cars on each line/route.
  • the provision for fitting can be designed for installing the system on different trains and on a few locations along the train and therefore can increase the reliability of the inspections by reducing the bias of the specific car or rolling stock.
  • LRU Line Replace Unit
  • the on-train system is installed on a regular train for carrying passengers or freight cars, the maintenance of the system should be designed to minimize the regular service.
  • a Line Replace Unit (LRU) approach may be used where in case there is a fault in one of the components of the system on the train, the whole assembly is replaced by a line technician and is sent for repair in a maintenance lab or an electronic workshop. If one of the sensors is faulty, the whole detectors-enclosure may be replaced with a spare unit. In this LRU approach, the downtime of the on-train monitoring system and any delays to the service of the train are minimized.
  • LRU Line Replace Unit
  • the on-train monitoring system can be designed to perform automatic inspections of the rail track monitoring Wheel Rail Interface (WRI) irregularities and selected critical track defects. Based on safety standards, the system operates to alert major hazards that may cause derailment.
  • the automatic processing and detection by the computer during the normal service can also be used to identify immediate short term track maintenance needs.
  • the on-train monitoring system can be used to support established routine track visual inspection activities by providing critical safety information more frequently and with enhanced quality.
  • the frequent inspections e.g., daily or whenever the train is operated
  • the system can allow for timely identification of first signs of deterioration, enabling intervention before major risks develop.
  • Using the system to inspect simultaneously on multiple trains and multiple lines can enable the railroad operators to cover the entire infrastructure on a daily basis.
  • the on-train monitoring system can be used in long trains. During the operation of long trains an unstable situation may occur which can cause a derailment. By installing cameras on different locations along the train length, the system may detect the first sign of an irregularity (e.g wheel climb on the rail) and therefore avoid such derailment.
  • an irregularity e.g wheel climb on the rail
  • the system can be designed to detect selected hazardous conditions based on safety standard thresholds for various defects to detect the effect on safety and leave the determination of the cause(s) to subsequent separate investigations.
  • the system may be designed to compare changes of a measured parameter to a benchmark value or to compare changes to previous runs stored in the database.

Abstract

An automatic inspection system is provided for monitoring rail track for detecting and generating alerts for certain hazards to the operation of trains that may cause various safety concerns and even derailment. The monitoring is during normal railway service runs without interrupting the normal railway services. In one implementation, an imaging module is used on a passenger or freight train to capture video images of the rail track under the train in motion. In one implementation, the captured video images are automatically processed in a computer using a software module which is based on digital image processing techniques and algorithms to determine whether an irregularity is present on the rail track. In one implementation, video images containing detected irregularities on the rail track are transmitted to a control center for further analysis and possible alert.

Description

    BACKGROUND
  • This application relates to automatic inspection of rail track, for the detection of and generating alerts for certain hazards on rail tracks.
  • In railway systems, certain defective conditions on rail tracks are hazardous to operations of trains and may cause various safety concerns and even derailment. A hazardous condition can occur at any location in the railway systems. Hence, rail tracks must be inspected to detect the hazardous condition and, depending on the nature and magnitude of the detected hazardous condition, an appropriate corrective measure, if needed, is taken to rectify the detected hazardous condition.
  • Some defective conditions of rail tracks may be detected via visual inspections by rail track technicians or engineers who patrol along the rail tracks. Visual patrol inspections are labor intensive, time consuming, and highly dependent on the skills and sometimes physical conditions of individual inspectors, and the lighting and weather conditions.
  • Specially designed inspection vehicles such as track recording vehicles may be equipped with various sensors including cameras and video recorders to inspect rail tracks. The electronic imaging and other devices (e.g., ultrasonic sensors) used in track recording vehicles can capture images and various data of the rail tracks for further analysis of any defects or hazards by a rail track engineer or inspector. The use of such inspection vehicles may require designated inspection periods different from regular railway service schedules to run the inspection vehicles through rail tracks to be inspected.
  • SUMMARY
  • This application describes rail track inspection and monitoring techniques and systems that allow for automatic inspection of rail tracks by monitoring the interface between the wheel and rail and the condition of critical track components on regular trains during normal railway service runs without interrupting the normal railway services.
  • In one implementation, a method is provided for monitoring a rail track. An imaging module is used on a passenger or freight train to capture video images of the rail track under the train in motion. The captured video images are automatically processed in a computer on the train to determine whether an irregularity is present on the rail track to adversely affect safety of the train.
  • In another implementation, a method for monitoring a rail track is provided to capture video images from a moving passenger or freight train operating on the rail track during a regular service run of the train. The captured video images are then processed in a computer on the train to determine whether an irregularity is present on the rail track according to a set of predetermined irregularity criteria. Video images that contain detected irregularities on the rail track are selected for further analysis of each detected irregularity.
  • In yet another implementation, a method for monitoring a rail track includes capturing video images from a moving train operating on the rail track; and automatically processing captured video images using a digital motion detection algorithm to monitor an interface between a wheel of the train and the rail track.
  • In yet another implementation, a method for monitoring a rail track includes capturing video images from a moving train operating on the rail track; automatically processing captured video images using a digital image matching algorithm to compare the captured video images to stored images of irregularities of the rail track in a digital library to find a match; analyzing a matched video image to determine the nature of an irregularity; and generate an alert signal to alert the irregularity if a parameter of the irregularity exceeds a safety standard threshold.
  • These and other features and implementations are described in greater detail in the following description, the drawings, and the claims.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The drawings are only for purposes of illustrating a preferred method and are not to be construed as limiting the invention:
  • FIG. 1 illustrates a system block diagram.
  • FIG. 2 illustrates a WRI monitoring process.
  • DETAILED DESCRIPTION
  • Implementations of the on-train rail track monitoring described in this application may be used to capture images and data for further analysis by a computer or an inspection specialist at a later time, and to automatically detect selected irregularities or hazardous conditions via on-train software processing of the captured images and data during the normal run of the train without involvement or input of the train operator or driver. Hence, in such implementations, the on-train computer processes the captured images and data as they are being captured and the automatic detection is in real time. In some implementations, the on-train system may be configured to identify first signs of an irregularity and deteriorating track condition such that a proper corrective action can be timely taken to intervene before the condition develops into a service or safety issue. Certain selected critical hazardous conditions may be programmed in the on-train system according to safety standards for the automatic detection by the on-train computer. For example, missing or defective components such as voided ties, missing chairs, clips, and other types of track critical components may be selected as the critical hazardous conditions. Inspection of visible rail-head defects may be carried out in some implementations. Warnings or alerts for the selected critical hazardous conditions are generated to alert the railroad and infrastructure operators with the aim of reducing the risk of derailment. The images of irregularities will be transmitted to a control center to be analyzed by a track expert who will decide whether an irregularity is a defect which is required to be further investigated and to be rectified, if needed, by the track workforce on-site. In the event that an irregularity is defined by the analyst as a defect, the urgency of rectifying the defect and notifying railroad operator and perhaps train operators will be dependent upon the level of risk identified by the track expert in the control center.
  • FIG. 1 illustrates one implementation of an on-train rail track monitoring system for use with a regular passenger or freight train during normal service routines. The system is represented by the functional block labeled as “On Train Equipment” and includes an under-train sensing module, an on-train computer as the on-train data processing station, and a positioning device which provides the position data of the train. The positioning device may include a global positioning system (GPS) or other positioning devices. The on-train system may also include a power supply unit (PSU) which receives electrical power from the existing power equipment of the train and converts the received power into suitable voltages/currents as needed for operating various components in the on-train monitoring system. A self-contained power supply unit including rechargeable batteries and/or an electrical generator may be used in some implementations. The system as an option may further include a communication device for linking the on-train computer to an off-train computer or computer storage device to transmit the captured images and data for further analysis.
  • The sensing module is located under the train to allow for detection of the defects in the rail tracks, and irregularities in the Interface of Wheel and Rail (WRI). The sensing module can include video imaging devices such as two or more CCD cameras or cameras with other imaging sensor arrays to capture the video images of the rail tracks and the WRI images, and one or more lights to illuminate the rail tracks and the wheel(s) under monitoring. Optionally, both day imaging devices and night imaging devices may be used to capture video images under different lighting conditions. The day imaging devices may be CCD cameras which capture the video images under well-lit conditions such as during the day time. The CCD cameras may also be used to capture video images under poorly lit conditions when proper illumination lights are used to illuminate the areas to be imaged. The night imaging devices, which may be Infrared (IR) cameras, are used to capture video images under poorly lit conditions, or harsh weather conditions. Millimeter-wave (MM-wave) cameras may be used for inspection in poor visibility conditions in bad weather (e.g. heavy fog, heavy rain, and heavy snow conditions). In implementations with three cameras as an option, the positions and the field of view (FOV) of one of the cameras may be set to cover the interface between the right-hand Rail and a corresponding right-hand wheel on the train, and it may cover the track components in the area of the right-hand rail. A second camera may have a FOV that covers the interface between the left-hand rail and the corresponding left-hand wheel on the train, and it may cover the track components in the area of the left-hand rail. The third camera may have a FOV that covers the whole track including the two rails, ties (sleepers), chairs and other supporting components of the rail. The sensing module and its components are designed for operation under extreme environment conditions in the railroad service regions where the railroad tracks are located.
  • The on-train computer, e.g., a personal computer (PC), may be programmed to automatically perform various imaging processing tasks without control or input from an operator on the train and to produce output image data files for the captured images and videos. The computer may also be used to control the sensing module and other on-train sub systems and to receive and process data other than captured images and videos. As illustrated in FIG. 1, the on-train system may include a communication unit to provide real-time transmission of the captured images and videos to a computer in an off-train control center manned by one or more engineers. This communication unit may be a wireless communication device to wirelessly transmit the data to the off-train control center. The on-train system may also include an interface with existing accelerometers on the train.
  • The on-train computer is programmed with image processing software to automatically detect irregularities in the rail tracks by monitoring the WRI and critical track components. The part of the software for the WRI monitoring is capable of detecting motion in video and is used to detect the dynamic phenomena of the interface between the wheel and the rail. The software further includes a pattern recognition module as a track condition monitoring (TCM) mechanism to detect missing critical parts of the track. In various implementations, based on pre-set criteria and the nature of a detected irregularity, the on-train computer is programmed to produce an alert signal to the railroad/maintenance operator about the detected irregularity.
  • FIG. 1 shows that the captured image and video data from the on-train system may be processed and transmitted in an off-line transmission to the off-train control center. The captured image and video data may be first transferred from the on-train computer to a data storage device or another computer and is subsequently transmitted to the control center, e.g., via a secured internet broadband connection.
  • The control center is designed to include a track monitoring work station for receiving the captured image and video data from one or multiple trains equipped with the on-train monitoring system. The monitoring work station may include one or more display monitors for displaying monitoring images and data transmitted from one or more trains, a data link receiver for receiving the real-time images and data from one or more trains, an Internet connection or other communication connection, a computer for analysis of the transmitted images and data, and video recording equipment that is either separate from the computer or is a function module provided by the computer for viewing and editing the video recording received from the trains. A printer may also be included for printing outputs from the on-train computer. A track expert at the control center can analyze the details of the captured images, video and data on selected irregularities from each train.
  • The above on-train monitoring system may also include a Deferential GPS (DGPS) unit as an option to increase the accuracy of the location identification when operated in areas where the DGPS infrastructure (e.g., presence of DGPS transmitters) is available. Another optional feature is a Control Display Unit (CDU) installed in the train operator cab which may include an indication panel to display the operating status of the sensors and subsystems and to indicate any faulty condition thereof. The CDU may also include a user interface for initiating and performing the calibration and the set-up process of the on-train monitoring system. A small display screen may be included in the CDU for viewing the camera output from the sensing module. The on-train monitoring system may be turned on by the train driver via pushing a control button at the start of the trip. Alternatively, the on-train monitoring system may be automatically turned on as part of the train start-up process and the system can be configured to continue to operate as long as the train is in motion. This can save an additional operation for the driver.
  • The on-train monitoring system can be installed on a regular passenger or freight train to automatically detect irregularities in the Wheel/Rail Interface (WRI) and track defects during the normal run of the train. This on-train monitoring system can be used to provide frequent inspections in regular service runs of the train and provide an efficient and convenient way to alert the railroad and the infrastructure operators of major hazards, thus reducing the risk of derailment. The system, in combination with the track expert at the control center, can be used to identify the first signs of an irregularity and a deteriorating track condition, such that an appropriate corrective action can be taken to intervene before the condition further degrades into a concern for the safe operation of the train. In addition, the system is used to provide an alert for an immediate short-term maintenance need or an imminent risk, and to trigger attention to certain locations in the rail tracks for further detailed inspections and corrective measures.
  • In applications, the on-train monitoring system may be used as a supplement monitoring system and operate in combination with and supplement other monitoring mechanisms such as visual patrol monitoring and track recording vehicles. The automatic on-train monitoring during the normal runs of trains provides an alert for major hazards and short term maintenance. The other systems can be used for the long term to provide elaborated data regarding the track condition and track geometry.
  • The on-train computer can be programmed to perform various imaging-based detections for monitoring the WRI dynamics and certain selected track conditions. In monitoring the wheel rail interface, the system can be configured to detect flange climb, rapid vertical movement (e.g. wheel unloading), rapid lateral movement (hunting), and rail gauge distance to verify if the distance is within the safety tolerance. The system can be configured to detect defects and irregularities. Those ‘effects’, include, among others, the wheel climb or wheel unloading. Upon detection of an irregularities effect, a further investigation is triggered to find out the ‘cause’ of the irregularities, which may be, for example, a track defect, twisting of the rail, rolling stock problem, a problem with the lubrication between the wheel and the rail or any other irregularities with the track conditions or rail geometry. Notably, the system can detect the first sign (effect) in the case of multiple factors (causes), such as small track defects which may each be within the track standards and each alone may not be sufficient to cause derailment but the combination of these factors as a whole can lead to a derailment. In this regard, after the on-train monitoring system alerts a selected hazardous condition, the railroad operator initiates an investigation of the cause for the alerted hazardous condition by, e.g., dispatching an engineer or a track recording vehicle to inspect the location or locations of rail tracks where the alert is generated. Based on this detailed investigation, a proper corrective measure, if needed, is taken to rectify the defect and therefore mitigate the risk caused by the alerted hazardous condition.
  • FIG. 2 shows one example of the processing flow of the WRI monitoring and inspection process performed by the on-train computer. The output video is automatically analyzed by a WRI image processing software installed on the on-train computer. The system detects the irregularities and compares each detected irregularity to the predefined defects in the defect benchmark library. If the irregularity is equal to or exceeds a safety threshold, a defect type code is assigned to the image. The image of the irregularity is next transmitted to the track control work station in the off-train control center to be analyzed by a track expert. The transmitted data may include, e.g., the image of the irregularity, a section of the video recording (a few seconds before and after the irregularity), the location of the train from the GPS system, a corresponding defect code number from the library, the time of the detection, and the identification of the train and the route. As an option, data from the accelerometer on the train may be transmitted as well.
  • The images of irregularities from the different trains that are received at the control center may be limited to the images of irregularities which are detected by the system as exceeding the safety thresholds. The detailed analysis can be carried out on the workstation at the off-train control center. The track expert reviews the displayed still images and the associated section of a video recording and decides whether this is a defect to be further investigated or to be rectified by the track workforce on-site. If an action is needed, a new corrective action item can be logged on the system. The urgency of the problem can be defined in the log. If the defect is defined as an urgent matter, the maintainers can be contacted immediately. A track manager on-site may be authorized to close the log of the corrective action item.
  • The track expert at the control center can check the recordings from previous runs at the same location of the train where a defect is currently detected. A database with recordings from previous runs can be provided as a trend database. This is done in order to verify whether this is a repeated irregularity. In addition, the track expert can check whether there are any details about this irregularity in the trend database based on previous records. If the track expert decides that the irregularity is not a defect, the images can then be saved in the trend database for future comparison and analysis.
  • At the control center, the images can be viewed by the expert on the display screen together with the supporting data. The expert may edit the video recording and the images. Database software can be used for reporting the defects and for inserting diagnostic comments. A predetermined list of irregularities and comment descriptions may be used to minimize the time for inserting the data by the analyst. The control center may also include one or more high quality printers to print out the images. An inspection report can be issued on a regular basis, e.g., every day, to the track manager in each line and/or region. The report may include a list of the defects, their descriptions and the diagnosis of the track expert in addition to the image of the defect, location, time, train and line.
  • The on-train computer may be programmed to conduct a trend analysis of a given rail track. In implementations, this feature allows the system to perform a comparison between the current measurement and historical data from one or more prior monitoring runs. The historical data can be from a run that was undertaken a few weeks or days before the current run. As an example, if a significant change is detected for a certain irregularity from a previous run but it does not exceed the safety limit, the image may be stored in an anomalies trend database. Depending upon the nature of the irregularities, the rate of change, and the number of detections, a trend anomalies report to the track maintainers may be generated. This feature of the system may be configured to limit the number of irregularities which are not safety issues in the trend anomalies report, with the view of reducing the workload on the track maintainers. The associated trend anomalies database may include images that are not considered a safety risk but indicate a significant change from previous runs. In addition, the trend database may include images of irregularities that were previously identified by the system as safety defects but were determined not to be safety defects by the track expert. For such irregularities, no intervention is required by the track maintainers in the short term. The above trend analysis may be implemented at a computer off the train, e.g., at the control center.
  • When accelerometers are interfaced with the on-train monitoring system, information from the accelerometers installed on the wheel axis can be transmitted together with the image of the irregularity for correlation and verification purposes.
  • The track condition monitoring (TCM) mechanism in the on-train system is implemented in a separate TCM software module based on digital image processing techniques and algorithms including pattern recognition, image matching, or stereo vision technologies. In monitoring the track condition, the TCM software module can be configured to automatically detect certain selected missing critical track components via image processing. A digital defect library may be provided in the on-train computer to include images of defects that are used as benchmarks for the decision making as to whether a detected irregularity is a defect or not. The images of the library may be originally generated and recorded from a moving train in testing runs. This track condition monitoring provides to the railway operator signs of deteriorating track conditions. The system is configured to generate alert signals for only major hazards that could lead to derailment. The decision criteria can be formulated according to safety standard thresholds, e.g., if there are a number of missing ties in a row which exceeds a corresponding safety threshold, the system can highlight such a condition via an alert signal. The information provided by the track condition monitoring may be used in conjunction with the data received from the WRI detection to determine, in some cases, reasons for the irregularities.
  • In implementations, a track safety standard is used to set a threshold for a certain number of missing or defective critical components per a length of track or in a group of N ties. If the detected number of missing/defective components exceeds the safety threshold, a safety alert will be generated. As described above, an anomalies library will be generated as part of the inspection process for the comparison of the condition on site and the benchmark condition. The library can include images of critical components in an acceptable condition and in unacceptable condition.
  • The TCM inspection can be carried out during the normal run of the train. Once the system detects a missing/defective component, the detected component can be marked and stored in memory or database while the TCM inspection continues with components in the adjacent tie, and along the rail head. This process can proceed in sequence. If the number of missing or defective components detected by the system exceeds the safety standard thresholds, the data can be transmitted to the track control center. The transmitted data may include, e.g., still images of the detected components, a section of video recordings, definitions of the irregularities, location, time, train identification and route. The data received by the control center can then be analyzed by a track expert who decides whether this condition is a track defect and whether this condition requires a further investigation by the track maintainers on-site. The process of reporting the analysis by the track expert is similar to that in the WRI inspection. The results of TCM analyses may be validated with the WRI monitoring data. This could provide, in some cases, an explanation about the causes of the irregularities that are detected in the WRI inspection (effect).
  • The software module for the WRI monitoring and inspection is based on digital detection of moving objects in videos. Various motion detection techniques may be used. In one implementation, a Video Motion Detection (VMD), image matching, or stereo vision technologies may be in use. This software module is a powerful high performance software technology for outdoor environments, may be used to detect moving objects appearing in a video. The software is suitable to work in harsh outdoor conditions, when the camera moves, rotates or shakes, and when changes in the illumination conditions occur. The Software performances are not degraded by motion and vibration. It will work under poor illumination conditions and is compatible with night vision cameras. The software has high detection reliability with high resistance to false alarms and high sensitivity to very small moving objects. This is gained by using filters which can limit the detection to a specific direction, speed, amount of motion etc. In one implementation, for example, a set of virtual digital detectors may be used to detect different parts of an image and each detector tracks a small portion of the image. Each of the digital detectors is sensitive to motion, and when motion is detected, the detector turns on. In operation, video images of the interface between the wheel of the train and the rail track are captured when the train is in motion. The computer on the train digitally monitors a relative position and a relative motion of the wheel and the rail track. Digital motion detectors are to respectively monitor motion at different locations of a video image. The captured video images can be filtered to selectively detect motion in the video images.
  • The software module for the TCM may be based on digital pattern recognition in still images and videos and/or an Image Matching technology. Various pattern recognition techniques may be used. In one implementation, for example, an image matching or registration technique may be used to match two or more images which are misaligned relative to one another due to rotation, shifting and zooming of one image with respect to another. In addition, the matching can be performed when the two images are not exactly similar due to differences in weather conditions, using different types of cameras, or types of illuminations. The image matching algorithm may be integrated with the motion detection algorithm. With this integration, the motion detection may be achieved even when the camera moves, rotates or shakes, and when changes in the illumination conditions occur.
  • U.S. Pat. No. 6,798,897 entitled “Real time image registration, motion detection and background replacement using discrete local motion estimation” describes techniques for image registration and motion detection based on discrete representation of the location motion in an image to detect and track an object in video images. Such techniques may be implemented as part of the system's software.
  • The on-train monitoring system as illustrated in FIG. 1 may be designed to be as small and compact as possible and to allow for easy installation on and removal from the train. As an example, the equipment may be mounted on the train by using quick release devices. Each optical sensor may be mounted inside a rigid enclosure under the train with easy access. If possible, all the equipment onboard the train may be mounted in a single assembly on a rack/cabinet with easy access. The installation kit, which includes supporting brackets and electrical harnesses for the system, may be fitted as a provision on a number of trains and cars on each line/route. The provision for fitting can be designed for installing the system on different trains and on a few locations along the train and therefore can increase the reliability of the inspections by reducing the bias of the specific car or rolling stock.
  • Because the on-train system is installed on a regular train for carrying passengers or freight cars, the maintenance of the system should be designed to minimize the regular service. For example, a Line Replace Unit (LRU) approach may be used where in case there is a fault in one of the components of the system on the train, the whole assembly is replaced by a line technician and is sent for repair in a maintenance lab or an electronic workshop. If one of the sensors is faulty, the whole detectors-enclosure may be replaced with a spare unit. In this LRU approach, the downtime of the on-train monitoring system and any delays to the service of the train are minimized.
  • Therefore, the above examples and implementations illustrate that the on-train monitoring system can be designed to perform automatic inspections of the rail track monitoring Wheel Rail Interface (WRI) irregularities and selected critical track defects. Based on safety standards, the system operates to alert major hazards that may cause derailment. The automatic processing and detection by the computer during the normal service can also be used to identify immediate short term track maintenance needs. The on-train monitoring system can be used to support established routine track visual inspection activities by providing critical safety information more frequently and with enhanced quality. Notably, the frequent inspections (e.g., daily or whenever the train is operated) provided by the system can allow for timely identification of first signs of deterioration, enabling intervention before major risks develop. Using the system to inspect simultaneously on multiple trains and multiple lines can enable the railroad operators to cover the entire infrastructure on a daily basis.
  • The on-train monitoring system can be used in long trains. During the operation of long trains an unstable situation may occur which can cause a derailment. By installing cameras on different locations along the train length, the system may detect the first sign of an irregularity (e.g wheel climb on the rail) and therefore avoid such derailment.
  • To function effectively, the system can be designed to detect selected hazardous conditions based on safety standard thresholds for various defects to detect the effect on safety and leave the determination of the cause(s) to subsequent separate investigations. The system may be designed to compare changes of a measured parameter to a benchmark value or to compare changes to previous runs stored in the database.
  • Only a few implementations are disclosed. However, it is understood that variations and enhancements may be made.

Claims (20)

What is claimed is what is described and illustrated, including:
1. A method for monitoring a rail track, comprising:
providing an imaging module on a passenger or freight train to capture video images of the rail track under the train in motion; and
automatically processing captured video images in a computer on the train to determine whether an irregularity is present on the rail track to adversely affect safety of the train.
2. The method as in claim 1, further comprising:
capturing video images of an interface between a wheel of the train and the rail track when the train is in motion; and
in the computer on the train, digitally monitoring a relative position and a relative motion of the wheel and the rail track.
3. The method as in claim 2, wherein the digital monitoring comprises:
using a plurality of digital motion detectors to respectively monitor motion at different locations of a video image.
4. The method as in claim 3, wherein the digital monitoring further comprises:
digitally filtering a video image to selectively detect motion in the video image.
5. The method as in claim 2, further comprising:
comparing to at least one of the relative position and the relative motion of the wheel and the rail track to a pre-determined safety standard threshold value; and
sending a captured video image to a control center off the train for further analysis when the pre-determined safety standard threshold value is exceeded.
6. The method as in claim 1, where the digital processing of the captured video images in the computer comprises:
digitally comparing the captured video images to stored images of irregularities of the rail track in a digital library to find a match; and
sending a matched video image to a control center off the train to be further analyzed to determine the nature of the matched video image.
7. The method as in claim 1, further comprising:
upon detection of an irregularity on the rail track that adversely affects safety of the train, generating an alert signal to notify the presence of the irregularity when the detected irregularity meets a pre-selected criteria.
8. The method as in claim 7, further comprising:
conducting a further investigation of a cause for the irregularity in response to the alert signal.
9. The method as in claim 1, further comprising:
upon detection of an irregularity on the rail track that adversely affects safety of the train, analyzing the image of the irregularity at a control center off the train to further determine the nature of the irregularity.
10. The method as in claim 9, wherein the image of the irregularity is conducted by a track expert.
11. The method as in claim 1, further comprising:
providing one or more illuminating lights to illuminate the rail track to allow for capture of video images by the imaging module under a poorly lit condition.
12. The method as in claim 1, further comprising:
providing at least one infrared sensor and/or MM Wave sensor in the imaging module to allow for capture of video images under a poorly lit condition and/or a poor visibility condition in bad weather.
13. The method as in claim 1, further comprising:
engaging the imaging module removable on the train in a detachable manner; and
replacing the imaging module when inoperable with a working imaging module to reduce an interruption to a service run of the train.
14. A method for monitoring a rail track, comprising:
capturing video images from a moving passenger or freight train operating on the rail track during a regular service run of the train;
automatically processing captured video images in a computer on the train to determine whether an irregularity is present on the rail track according to a set of predetermined irregularity criteria; and
selecting video images that contain detected irregularities on the rail track for further analysis of each detected irregularity.
15. The method as in claim 14, further comprising:
transmitting the selected video images that contain detected irregularities on the rail track in real time off the train to a control center; and
at the control center, analyzing each detected irregularity to determine the nature of the detected irregularity.
16. The method as in claim 14, further comprising:
transmitting the selected video images that contain detected irregularities on the rail track off the train to a data storage device;
transmitting the selected video images from the data storage device to a control center via a communication link; and
at the control center, analyzing each detected irregularity to determine the nature of the detected irregularity.
17. A method for monitoring a rail track, comprising:
capturing video images from a moving train operating on the rail track; and
automatically processing captured video images using a digital motion detection algorithm to monitor an interface between a wheel of the train and the rail track.
18. The method as in claim 17, wherein the digital processing comprises:
using a plurality of digital motion detectors to respectively monitor motion at different locations of a video image of the interface.
19. The method as in claim 18, wherein the digital processing further comprises:
digitally filtering the video image of the interface to selectively detect motion of the interface.
20. A method for monitoring a rail track, comprising:
capturing video images from a moving train operating on the rail track;
automatically processing captured video images using a digital image matching algorithm to compare the captured video images to stored images of irregularities of the rail track in a digital library to find a match;
analyzing a matched video image to determine the nature of an irregularity; and
generating an alert signal to alert an irregularity if a parameter of the irregularity exceeds a safety standard threshold.
US11/679,556 2006-03-02 2007-02-27 On-train rail track monitoring system Active - Reinstated 2033-08-29 US8942426B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/679,556 US8942426B2 (en) 2006-03-02 2007-02-27 On-train rail track monitoring system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US77895606P 2006-03-02 2006-03-02
US11/679,556 US8942426B2 (en) 2006-03-02 2007-02-27 On-train rail track monitoring system

Publications (2)

Publication Number Publication Date
US20070217670A1 true US20070217670A1 (en) 2007-09-20
US8942426B2 US8942426B2 (en) 2015-01-27

Family

ID=38517884

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/679,556 Active - Reinstated 2033-08-29 US8942426B2 (en) 2006-03-02 2007-02-27 On-train rail track monitoring system

Country Status (1)

Country Link
US (1) US8942426B2 (en)

Cited By (84)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090079560A1 (en) * 2007-09-26 2009-03-26 General Electric Company Remotely monitoring railroad equipment using network protocols
US20090192758A1 (en) * 2008-01-24 2009-07-30 Brad Pelletier System, method and kit for measuring a distance within a railroad system
US20100057512A1 (en) * 2008-05-21 2010-03-04 Dwight Tays Linear assets inspection system
US20120190404A1 (en) * 2008-08-19 2012-07-26 Rhoads Geoffrey B Methods and Systems for Content Processing
US20120192756A1 (en) * 2011-01-31 2012-08-02 Harsco Corporation Rail vision system
US20120263342A1 (en) * 2011-04-15 2012-10-18 International Business Machines Corporation Method and system of rail component detection using vision technology
US20130027556A1 (en) * 2011-07-26 2013-01-31 Clark Jeffrey W System and method for security zone checking
US20130101221A1 (en) * 2011-10-25 2013-04-25 International Business Machines Corporation Anomaly detection in images and videos
US20130231873A1 (en) * 2012-03-01 2013-09-05 Randy Scott Fraser Railway inspection system
WO2013121344A3 (en) * 2012-02-17 2014-02-06 Balaji Venkatraman Real time railway disaster vulnerability assessment and rescue guidance system using multi-layered video computational analytics
US20140176711A1 (en) * 2012-12-21 2014-06-26 Wabtec Holding Corp. Track Data Determination System and Method
US20140200828A1 (en) * 2013-01-11 2014-07-17 International Business Machines Corporation Asset failure prediction with location uncertainty
US20140247356A1 (en) * 2011-09-30 2014-09-04 Siemens S.A.S. Method and system for determining the availability of a lane for a guided vehicle
US8914162B2 (en) * 2013-03-12 2014-12-16 Wabtec Holding Corp. System, method, and apparatus to detect and report track structure defects
US8914171B2 (en) 2012-11-21 2014-12-16 General Electric Company Route examining system and method
US9070020B2 (en) 2012-08-21 2015-06-30 International Business Machines Corporation Determination of train presence and motion state in railway environments
US9255913B2 (en) 2013-07-31 2016-02-09 General Electric Company System and method for acoustically identifying damaged sections of a route
WO2016022635A1 (en) * 2014-08-05 2016-02-11 Panasec Corporation Positive train control system and apparatus therefor
US20160052531A1 (en) * 2013-04-16 2016-02-25 Prodose Device for communicating and monitoring railway tracks and operating method
US20160070991A1 (en) * 2014-05-19 2016-03-10 Rockwell Automation Technologies, Inc. Integration of optical area monitoring with industrial machine control
US20160114820A1 (en) * 2014-10-28 2016-04-28 Smartdrive Systems, Inc. Rail vehicle event detection and recording system
US20160152253A1 (en) * 2013-07-31 2016-06-02 Rail Safe R.S. (2015) Ltd. System and method for utilizing an infra-red sensor by a moving train
WO2016112358A1 (en) 2015-01-08 2016-07-14 Smartdrive Systems, Inc. System and method for synthesizing rail vehicle event information
EP2993105A3 (en) * 2014-09-08 2016-07-20 General Electric Company Optical route examination system and method
US9487222B2 (en) 2015-01-08 2016-11-08 Smartdrive Systems, Inc. System and method for aggregation display and analysis of rail vehicle event information
WO2017034531A1 (en) * 2015-08-21 2017-03-02 Hewlett Packard Enterprise Development Lp Digital context-aware data collection
US9625108B2 (en) 2014-10-08 2017-04-18 Rockwell Automation Technologies, Inc. Auxiliary light source associated with an industrial application
US9669847B2 (en) 2008-10-20 2017-06-06 Rail Pod Inc. Switching device configured for operation on a conventional railroad track
US9671358B2 (en) 2012-08-10 2017-06-06 General Electric Company Route examining system and method
US9679424B2 (en) 2007-05-08 2017-06-13 Smartdrive Systems, Inc. Distributed vehicle event recorder systems having a portable memory data transfer system
US9691195B2 (en) 2006-03-16 2017-06-27 Smartdrive Systems, Inc. Vehicle event recorder systems and networks having integrated cellular wireless communications systems
US9696424B2 (en) 2014-05-19 2017-07-04 Rockwell Automation Technologies, Inc. Optical area monitoring with spot matrix illumination
CN107024361A (en) * 2016-02-02 2017-08-08 株式会社神户制钢所 The abnormal detector of rotating machinery and the abnormality detection system of rotating machinery
US9733625B2 (en) 2006-03-20 2017-08-15 General Electric Company Trip optimization system and method for a train
EP2687419A3 (en) * 2012-07-20 2017-11-08 Siemens Plc Apparatus and method for monitoring the condition of railway tracks
US9828010B2 (en) 2006-03-20 2017-11-28 General Electric Company System, method and computer software code for determining a mission plan for a powered system using signal aspect information
US9875414B2 (en) 2014-04-15 2018-01-23 General Electric Company Route damage prediction system and method
US9908546B2 (en) 2015-01-12 2018-03-06 Smartdrive Systems, Inc. Rail vehicle event triggering system and method
US9921300B2 (en) 2014-05-19 2018-03-20 Rockwell Automation Technologies, Inc. Waveform reconstruction in a time-of-flight sensor
US9942526B2 (en) 2006-03-16 2018-04-10 Smartdrive Systems, Inc. Vehicle event recorders with integrated web server
US9950722B2 (en) 2003-01-06 2018-04-24 General Electric Company System and method for vehicle control
US9956974B2 (en) 2004-07-23 2018-05-01 General Electric Company Vehicle consist configuration control
CN108181902A (en) * 2017-12-27 2018-06-19 广州地铁集团有限公司 A kind of intelligent polling method and the robot for realizing this method
US10019858B2 (en) 2013-10-16 2018-07-10 Smartdrive Systems, Inc. Vehicle event playback apparatus and methods
US10049298B2 (en) 2014-02-17 2018-08-14 General Electric Company Vehicle image data management system and method
US10053032B2 (en) 2006-11-07 2018-08-21 Smartdrive Systems, Inc. Power management systems for automotive video event recorders
CN108528478A (en) * 2018-04-02 2018-09-14 交控科技股份有限公司 The recognition methods of rail traffic situation and device
US10110795B2 (en) 2002-06-04 2018-10-23 General Electric Company Video system and method for data communication
US10249105B2 (en) 2014-02-21 2019-04-02 Smartdrive Systems, Inc. System and method to detect execution of driving maneuvers
US10286460B2 (en) 2017-04-07 2019-05-14 Robert J. Murphy Single-pass, single-radial layer, circumferential-progression fill-welding system, apparatus and method for refurbishing railway and other transit rails
US10311551B2 (en) 2016-12-13 2019-06-04 Westinghouse Air Brake Technologies Corporation Machine vision based track-occupancy and movement validation
US10308265B2 (en) 2006-03-20 2019-06-04 Ge Global Sourcing Llc Vehicle control system and method
US10339732B2 (en) 2006-11-07 2019-07-02 Smartdrive Systems, Inc. Vehicle operator performance history recording, scoring and reporting systems
US10471828B2 (en) 2006-11-09 2019-11-12 Smartdrive Systems, Inc. Vehicle exception event management systems
US10501102B2 (en) 2017-02-06 2019-12-10 Avante International Technology, Inc. Positive train control system and apparatus employing RFID devices
WO2020053699A1 (en) * 2018-09-10 2020-03-19 Mer Mec S.P.A. Device and method for detecting railway equipment defects
US10607090B2 (en) 2015-12-02 2020-03-31 Icomera Ab Train security system
US10618534B2 (en) * 2016-11-28 2020-04-14 Taiwan Semiconductor Manufacturing Co., Ltd. Monitor vehicle for a rail system and method thereof
WO2020102297A1 (en) * 2018-11-15 2020-05-22 Avante International Technology, Inc. Image-based monitoring and detection of track/rail faults
CN111319655A (en) * 2020-03-09 2020-06-23 唐智科技湖南发展有限公司 Track damage detection method and device and computer readable storage medium
US10796192B2 (en) 2017-03-23 2020-10-06 Harsco Technologies LLC Track feature detection using machine vision
CN111855242A (en) * 2020-06-12 2020-10-30 佛山中国空间技术研究院创新中心 Rail train inspection control method, system and device and storage medium
DE102019212261A1 (en) * 2019-08-15 2021-02-18 Siemens Mobility GmbH Method, device and rail vehicle
US10930093B2 (en) 2015-04-01 2021-02-23 Smartdrive Systems, Inc. Vehicle event recording system and method
CN112731407A (en) * 2020-12-31 2021-04-30 西南交通大学 Train positioning method based on ultrasonic detection
US11004228B2 (en) * 2018-11-16 2021-05-11 Westinghouse Air Brake Technologies Corporation Image based train length determination
CN113282982A (en) * 2021-04-30 2021-08-20 杭州申昊科技股份有限公司 System and method for evaluating safety of rail under condition of mud spraying
US11124207B2 (en) 2014-03-18 2021-09-21 Transportation Ip Holdings, Llc Optical route examination system and method
RU2761763C1 (en) * 2020-12-18 2021-12-13 Акционерное общество "Научно-исследовательский и проектно-конструкторский институт информатизации, автоматизации и связи на железнодорожном транспорте" System for ensuring safety on railway transport
RU2762164C1 (en) * 2018-05-29 2021-12-16 Сименс Мобилити Гмбх Calibration method and calibration system for a railway vehicle camera and a railway vehicle having a railway vehicle camera
US11238212B1 (en) * 2017-02-07 2022-02-01 Railworks Corporation Systems and methods for generating maintenance data
US11243294B2 (en) 2014-05-19 2022-02-08 Rockwell Automation Technologies, Inc. Waveform reconstruction in a time-of-flight sensor
US11260878B2 (en) 2013-11-11 2022-03-01 Smartdrive Systems, Inc. Vehicle fuel consumption monitor and feedback systems
RU2769100C2 (en) * 2020-06-25 2022-03-28 Общество с ограниченной ответственностью "НАУЧНО-ПРОИЗВОДСТВЕННОЕ ОБЪЕДИНЕНИЕ САУТ" (ООО "НПО САУТ") Method for compiling a digital railway map and application thereof for monitoring the movement of a locomotive
CN114363582A (en) * 2022-03-15 2022-04-15 深圳中慧轨道智能科技有限公司 Integrated track inspection vehicle image processing system
WO2022130488A1 (en) * 2020-12-15 2022-06-23 川崎車両株式会社 Fastener-monitoring device, fastener-monitoring system, and fastener-monitoring method
US11400964B2 (en) * 2009-10-19 2022-08-02 Transportation Ip Holdings, Llc Route examining system and method
US11529980B2 (en) 2019-01-30 2022-12-20 Ensco, Inc. Systems and methods for inspecting a railroad
WO2023274811A1 (en) * 2021-06-30 2023-01-05 Siemens Mobility GmbH Method and assembly for monitoring wheel-rail contact for a rail vehicle
US11565730B1 (en) * 2022-03-04 2023-01-31 Bnsf Railway Company Automated tie marking
CN116353660A (en) * 2023-06-01 2023-06-30 兰州交通大学 High-speed railway wheel polygon fault detection method and system based on BWO-VMD
CN117078687A (en) * 2023-10-17 2023-11-17 常州海图信息科技股份有限公司 Track inspection system and method based on machine vision
US11834082B2 (en) * 2019-09-18 2023-12-05 Progress Rail Services Corporation Rail buckle detection and risk prediction
US20240035919A1 (en) * 2022-07-29 2024-02-01 Network Rail Infrastructure Limited Mutual alignment of rail geometry measurements

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11022982B2 (en) * 2014-03-18 2021-06-01 Transforation Ip Holdings, Llc Optical route examination system and method
JP5946272B2 (en) * 2011-12-28 2016-07-06 川崎重工業株式会社 Railway rail displacement detector
CN103640595B (en) * 2013-12-25 2016-03-02 江西理工大学 A kind of railway protective hurdle net automatic detection system and failure evaluation method
US9536311B2 (en) * 2014-09-29 2017-01-03 General Electric Company System and method for component detection
US9849895B2 (en) 2015-01-19 2017-12-26 Tetra Tech, Inc. Sensor synchronization apparatus and method
US9849894B2 (en) 2015-01-19 2017-12-26 Tetra Tech, Inc. Protective shroud for enveloping light from a light emitter for mapping of a railway track
US10349491B2 (en) 2015-01-19 2019-07-09 Tetra Tech, Inc. Light emission power control apparatus and method
CA2892885C (en) 2015-02-20 2020-07-28 Tetra Tech, Inc. 3d track assessment system and method
GB2542115B (en) 2015-09-03 2017-11-15 Rail Vision Europe Ltd Rail track asset survey system
US9934623B2 (en) 2016-05-16 2018-04-03 Wi-Tronix Llc Real-time data acquisition and recording system
US10392038B2 (en) 2016-05-16 2019-08-27 Wi-Tronix, Llc Video content analysis system and method for transportation system
US11423706B2 (en) 2016-05-16 2022-08-23 Wi-Tronix, Llc Real-time data acquisition and recording data sharing system
US10410441B2 (en) 2016-05-16 2019-09-10 Wi-Tronix, Llc Real-time data acquisition and recording system viewer
JP7086949B2 (en) 2016-10-20 2022-06-20 レール ビジョン リミテッド Systems and methods for detecting and classifying objects and obstacles in collision avoidance for railroad applications
CN106524947B (en) * 2016-12-14 2018-03-02 石家庄铁道大学 Engine is shaken the head angle detecting device and method
RU2642687C1 (en) * 2017-02-27 2018-01-25 Анатолий Аркадиевич Марков Method of complex rail diagnostics
US10625760B2 (en) 2018-06-01 2020-04-21 Tetra Tech, Inc. Apparatus and method for calculating wooden crosstie plate cut measurements and rail seat abrasion measurements based on rail head height
US11377130B2 (en) 2018-06-01 2022-07-05 Tetra Tech, Inc. Autonomous track assessment system
US10730538B2 (en) 2018-06-01 2020-08-04 Tetra Tech, Inc. Apparatus and method for calculating plate cut and rail seat abrasion based on measurements only of rail head elevation and crosstie surface elevation
US10807623B2 (en) 2018-06-01 2020-10-20 Tetra Tech, Inc. Apparatus and method for gathering data from sensors oriented at an oblique angle relative to a railway track
US10908291B2 (en) 2019-05-16 2021-02-02 Tetra Tech, Inc. System and method for generating and interpreting point clouds of a rail corridor along a survey path
US20220044183A1 (en) * 2020-08-05 2022-02-10 Wi-Tronix, Llc Engineer recertification assistant
US11919552B2 (en) 2020-12-21 2024-03-05 Progress Rail Services Corporation System and method for scoring train runs

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4932784A (en) * 1986-10-13 1990-06-12 Caltronic A/S Apparatus for track-based detection of the wheel profile of passing railway wheels
US5347588A (en) * 1991-10-11 1994-09-13 Bridgestone Method and apparatus for video imaging of tire ground contact patch
US5808906A (en) * 1995-06-29 1998-09-15 Patentes Talgo, S.A. Installation and process for measuring rolling parameters by means of artificial vision on wheels of railway vehicles
US6163755A (en) * 1996-02-27 2000-12-19 Thinkware Ltd. Obstacle detection system
US20010035907A1 (en) * 2000-03-10 2001-11-01 Broemmelsiek Raymond M. Method and apparatus for object tracking and detection
US6356299B1 (en) * 1996-08-05 2002-03-12 National Railroad Passenger Corporation Automated track inspection vehicle and method
US20030048193A1 (en) * 2001-08-30 2003-03-13 General Electric Company Apparatus and method for rail track inspection
US6546791B2 (en) * 2001-08-08 2003-04-15 Bridgestone/Firestone North American Tire, Llc Indoor hydroplaning test apparatus and method
US6600999B2 (en) * 2000-10-10 2003-07-29 Sperry Rail, Inc. Hi-rail vehicle-based rail inspection system
US20030222981A1 (en) * 2002-06-04 2003-12-04 Kisak Jeffrey James Locomotive wireless video recorder and recording system
US20040130618A1 (en) * 2001-05-28 2004-07-08 Kilian Krzysztof Piotr Automated wheel slide detector
US6768551B2 (en) * 2001-10-17 2004-07-27 International Electronic Machines Corp. Contactless wheel measurement system and method
US20040263524A1 (en) * 2003-06-27 2004-12-30 Lippincott Louis A. Memory command handler for use in an image signal processor having a data driven architecture

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4270553B2 (en) * 2004-02-10 2009-06-03 健一 稲宮 Seismic derailment prevention latch operation system with video sensor

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4932784A (en) * 1986-10-13 1990-06-12 Caltronic A/S Apparatus for track-based detection of the wheel profile of passing railway wheels
US5347588A (en) * 1991-10-11 1994-09-13 Bridgestone Method and apparatus for video imaging of tire ground contact patch
US5808906A (en) * 1995-06-29 1998-09-15 Patentes Talgo, S.A. Installation and process for measuring rolling parameters by means of artificial vision on wheels of railway vehicles
US6163755A (en) * 1996-02-27 2000-12-19 Thinkware Ltd. Obstacle detection system
US6356299B1 (en) * 1996-08-05 2002-03-12 National Railroad Passenger Corporation Automated track inspection vehicle and method
US20010035907A1 (en) * 2000-03-10 2001-11-01 Broemmelsiek Raymond M. Method and apparatus for object tracking and detection
US6600999B2 (en) * 2000-10-10 2003-07-29 Sperry Rail, Inc. Hi-rail vehicle-based rail inspection system
US20040130618A1 (en) * 2001-05-28 2004-07-08 Kilian Krzysztof Piotr Automated wheel slide detector
US6546791B2 (en) * 2001-08-08 2003-04-15 Bridgestone/Firestone North American Tire, Llc Indoor hydroplaning test apparatus and method
US20030048193A1 (en) * 2001-08-30 2003-03-13 General Electric Company Apparatus and method for rail track inspection
US6768551B2 (en) * 2001-10-17 2004-07-27 International Electronic Machines Corp. Contactless wheel measurement system and method
US20030222981A1 (en) * 2002-06-04 2003-12-04 Kisak Jeffrey James Locomotive wireless video recorder and recording system
US20040263524A1 (en) * 2003-06-27 2004-12-30 Lippincott Louis A. Memory command handler for use in an image signal processor having a data driven architecture

Cited By (140)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10110795B2 (en) 2002-06-04 2018-10-23 General Electric Company Video system and method for data communication
US9950722B2 (en) 2003-01-06 2018-04-24 General Electric Company System and method for vehicle control
US9956974B2 (en) 2004-07-23 2018-05-01 General Electric Company Vehicle consist configuration control
US10404951B2 (en) 2006-03-16 2019-09-03 Smartdrive Systems, Inc. Vehicle event recorders with integrated web server
US9942526B2 (en) 2006-03-16 2018-04-10 Smartdrive Systems, Inc. Vehicle event recorders with integrated web server
US9691195B2 (en) 2006-03-16 2017-06-27 Smartdrive Systems, Inc. Vehicle event recorder systems and networks having integrated cellular wireless communications systems
US9733625B2 (en) 2006-03-20 2017-08-15 General Electric Company Trip optimization system and method for a train
US10308265B2 (en) 2006-03-20 2019-06-04 Ge Global Sourcing Llc Vehicle control system and method
US9828010B2 (en) 2006-03-20 2017-11-28 General Electric Company System, method and computer software code for determining a mission plan for a powered system using signal aspect information
US10682969B2 (en) 2006-11-07 2020-06-16 Smartdrive Systems, Inc. Power management systems for automotive video event recorders
US10339732B2 (en) 2006-11-07 2019-07-02 Smartdrive Systems, Inc. Vehicle operator performance history recording, scoring and reporting systems
US10053032B2 (en) 2006-11-07 2018-08-21 Smartdrive Systems, Inc. Power management systems for automotive video event recorders
US10471828B2 (en) 2006-11-09 2019-11-12 Smartdrive Systems, Inc. Vehicle exception event management systems
US11623517B2 (en) 2006-11-09 2023-04-11 SmartDriven Systems, Inc. Vehicle exception event management systems
US9679424B2 (en) 2007-05-08 2017-06-13 Smartdrive Systems, Inc. Distributed vehicle event recorder systems having a portable memory data transfer system
US20090079560A1 (en) * 2007-09-26 2009-03-26 General Electric Company Remotely monitoring railroad equipment using network protocols
US7716010B2 (en) * 2008-01-24 2010-05-11 General Electric Company System, method and kit for measuring a distance within a railroad system
US20090192758A1 (en) * 2008-01-24 2009-07-30 Brad Pelletier System, method and kit for measuring a distance within a railroad system
US10943192B2 (en) 2008-05-21 2021-03-09 Canadian National Railway Company Method and system for displaying work assignment status information in connection with work to be performed on a component of a linear asset infrastructure
US11842294B2 (en) 2008-05-21 2023-12-12 Canadian National Railway Company Method and system for inspecting railway tracks
US20100064241A1 (en) * 2008-05-21 2010-03-11 Dwight Tays Linear assets inspection system
US20100064240A1 (en) * 2008-05-21 2010-03-11 Dwight Tays Linear assets inspection system
US20100064242A1 (en) * 2008-05-21 2010-03-11 Dwight Tays Linear assets inspection system
US20100064237A1 (en) * 2008-05-21 2010-03-11 Dwight Tays Linear assets inspection system
US20100057512A1 (en) * 2008-05-21 2010-03-04 Dwight Tays Linear assets inspection system
US11544641B2 (en) 2008-05-21 2023-01-03 Canadian National Railway Company Method and system for inspecting railway tracks
US20100064041A1 (en) * 2008-05-21 2010-03-11 Dwight Tays Linear assets inspection system
US8589256B2 (en) 2008-05-21 2013-11-19 Canadian National Railway Company Method and system for creating a condition record for a linear asset
US20120190404A1 (en) * 2008-08-19 2012-07-26 Rhoads Geoffrey B Methods and Systems for Content Processing
US9669847B2 (en) 2008-10-20 2017-06-06 Rail Pod Inc. Switching device configured for operation on a conventional railroad track
US11400964B2 (en) * 2009-10-19 2022-08-02 Transportation Ip Holdings, Llc Route examining system and method
US20120192756A1 (en) * 2011-01-31 2012-08-02 Harsco Corporation Rail vision system
US8625878B2 (en) * 2011-04-15 2014-01-07 International Business Machines Corporation Method and system of rail component detection using vision technology
US20120263342A1 (en) * 2011-04-15 2012-10-18 International Business Machines Corporation Method and system of rail component detection using vision technology
US20130027556A1 (en) * 2011-07-26 2013-01-31 Clark Jeffrey W System and method for security zone checking
US9533626B2 (en) * 2011-09-30 2017-01-03 Siemens S.A.S. Method and system for determining the availability of a lane for a guided vehicle
US20140247356A1 (en) * 2011-09-30 2014-09-04 Siemens S.A.S. Method and system for determining the availability of a lane for a guided vehicle
US20130101221A1 (en) * 2011-10-25 2013-04-25 International Business Machines Corporation Anomaly detection in images and videos
WO2013062738A1 (en) * 2011-10-25 2013-05-02 International Business Machines Corporation Anomaly detection in images and videos
US8724904B2 (en) * 2011-10-25 2014-05-13 International Business Machines Corporation Anomaly detection in images and videos
US20150009331A1 (en) * 2012-02-17 2015-01-08 Balaji Venkatraman Real time railway disaster vulnerability assessment and rescue guidance system using multi-layered video computational analytics
WO2013121344A3 (en) * 2012-02-17 2014-02-06 Balaji Venkatraman Real time railway disaster vulnerability assessment and rescue guidance system using multi-layered video computational analytics
US20130231873A1 (en) * 2012-03-01 2013-09-05 Randy Scott Fraser Railway inspection system
US9981671B2 (en) * 2012-03-01 2018-05-29 Nordco Inc. Railway inspection system
EP2687419A3 (en) * 2012-07-20 2017-11-08 Siemens Plc Apparatus and method for monitoring the condition of railway tracks
US9671358B2 (en) 2012-08-10 2017-06-06 General Electric Company Route examining system and method
US9495599B2 (en) 2012-08-21 2016-11-15 International Business Machines Corporation Determination of train presence and motion state in railway environments
US9070020B2 (en) 2012-08-21 2015-06-30 International Business Machines Corporation Determination of train presence and motion state in railway environments
US9594963B2 (en) 2012-08-21 2017-03-14 International Business Machines Corporation Determination of object presence and motion state
US8914171B2 (en) 2012-11-21 2014-12-16 General Electric Company Route examining system and method
US20140176711A1 (en) * 2012-12-21 2014-06-26 Wabtec Holding Corp. Track Data Determination System and Method
US9846025B2 (en) * 2012-12-21 2017-12-19 Wabtec Holding Corp. Track data determination system and method
AU2013364345B2 (en) * 2012-12-21 2017-10-19 Wabtec Holding Corp. Track data determination system and method
US20140200828A1 (en) * 2013-01-11 2014-07-17 International Business Machines Corporation Asset failure prediction with location uncertainty
US9744978B2 (en) 2013-01-11 2017-08-29 International Business Machines Corporation Railway track geometry defect modeling for predicting deterioration, derailment risk, and optimal repair
US10414416B2 (en) * 2013-01-11 2019-09-17 International Business Machines Corporation Asset failure prediction with location uncertainty
US20140200829A1 (en) * 2013-01-11 2014-07-17 International Business Machines Corporation Asset failure prediction with location uncertainty
US9561810B2 (en) 2013-01-11 2017-02-07 International Business Machines Corporation Large-scale multi-detector predictive modeling
US9764746B2 (en) 2013-01-11 2017-09-19 International Business Machines Corporation Railway track geometry defect modeling for predicting deterioration, derailment risk, and optimal repair
US8914162B2 (en) * 2013-03-12 2014-12-16 Wabtec Holding Corp. System, method, and apparatus to detect and report track structure defects
US10220861B2 (en) * 2013-04-16 2019-03-05 Prodose Sarl Device for communicating and monitoring railway tracks and operating method
US20160052531A1 (en) * 2013-04-16 2016-02-25 Prodose Device for communicating and monitoring railway tracks and operating method
US20160152253A1 (en) * 2013-07-31 2016-06-02 Rail Safe R.S. (2015) Ltd. System and method for utilizing an infra-red sensor by a moving train
US9255913B2 (en) 2013-07-31 2016-02-09 General Electric Company System and method for acoustically identifying damaged sections of a route
US10654499B2 (en) * 2013-07-31 2020-05-19 Rail Vision Ltd. System and method for utilizing an infra-red sensor by a moving train
US10019858B2 (en) 2013-10-16 2018-07-10 Smartdrive Systems, Inc. Vehicle event playback apparatus and methods
US10818112B2 (en) 2013-10-16 2020-10-27 Smartdrive Systems, Inc. Vehicle event playback apparatus and methods
US11884255B2 (en) 2013-11-11 2024-01-30 Smartdrive Systems, Inc. Vehicle fuel consumption monitor and feedback systems
US11260878B2 (en) 2013-11-11 2022-03-01 Smartdrive Systems, Inc. Vehicle fuel consumption monitor and feedback systems
US10049298B2 (en) 2014-02-17 2018-08-14 General Electric Company Vehicle image data management system and method
US10249105B2 (en) 2014-02-21 2019-04-02 Smartdrive Systems, Inc. System and method to detect execution of driving maneuvers
US11250649B2 (en) 2014-02-21 2022-02-15 Smartdrive Systems, Inc. System and method to detect execution of driving maneuvers
US11734964B2 (en) 2014-02-21 2023-08-22 Smartdrive Systems, Inc. System and method to detect execution of driving maneuvers
US10497187B2 (en) 2014-02-21 2019-12-03 Smartdrive Systems, Inc. System and method to detect execution of driving maneuvers
US11124207B2 (en) 2014-03-18 2021-09-21 Transportation Ip Holdings, Llc Optical route examination system and method
US9875414B2 (en) 2014-04-15 2018-01-23 General Electric Company Route damage prediction system and method
US20160070991A1 (en) * 2014-05-19 2016-03-10 Rockwell Automation Technologies, Inc. Integration of optical area monitoring with industrial machine control
US9696424B2 (en) 2014-05-19 2017-07-04 Rockwell Automation Technologies, Inc. Optical area monitoring with spot matrix illumination
US11243294B2 (en) 2014-05-19 2022-02-08 Rockwell Automation Technologies, Inc. Waveform reconstruction in a time-of-flight sensor
US9921300B2 (en) 2014-05-19 2018-03-20 Rockwell Automation Technologies, Inc. Waveform reconstruction in a time-of-flight sensor
US9477907B2 (en) * 2014-05-19 2016-10-25 Rockwell Automation Technologies, Inc. Integration of optical area monitoring with industrial machine control
WO2016022635A1 (en) * 2014-08-05 2016-02-11 Panasec Corporation Positive train control system and apparatus therefor
US10315673B2 (en) 2014-08-05 2019-06-11 Avante International Technology, Inc. Positive train control system, apparatus and method
US10611388B2 (en) 2014-08-05 2020-04-07 Avante International Technology, Inc. Positive train control system and method
US9434397B2 (en) 2014-08-05 2016-09-06 Panasec Corporation Positive train control system and apparatus therefor
US9937938B2 (en) 2014-08-05 2018-04-10 Panasec Corporation Positive train control apparatus
EP2993105A3 (en) * 2014-09-08 2016-07-20 General Electric Company Optical route examination system and method
US9625108B2 (en) 2014-10-08 2017-04-18 Rockwell Automation Technologies, Inc. Auxiliary light source associated with an industrial application
US9663127B2 (en) * 2014-10-28 2017-05-30 Smartdrive Systems, Inc. Rail vehicle event detection and recording system
US10358154B1 (en) * 2014-10-28 2019-07-23 Smartdrive Systems, Inc. Rail vehicle event detection and recording system
US20160114820A1 (en) * 2014-10-28 2016-04-28 Smartdrive Systems, Inc. Rail vehicle event detection and recording system
EP3242825A4 (en) * 2015-01-08 2019-03-13 Smartdrive Systems, Inc. System and method for synthesizing rail vehicle event information
WO2016112358A1 (en) 2015-01-08 2016-07-14 Smartdrive Systems, Inc. System and method for synthesizing rail vehicle event information
US9981674B1 (en) 2015-01-08 2018-05-29 Smartdrive Systems, Inc. System and method for aggregation display and analysis of rail vehicle event information
US9487222B2 (en) 2015-01-08 2016-11-08 Smartdrive Systems, Inc. System and method for aggregation display and analysis of rail vehicle event information
US9902410B2 (en) 2015-01-08 2018-02-27 Smartdrive Systems, Inc. System and method for synthesizing rail vehicle event information
US9908546B2 (en) 2015-01-12 2018-03-06 Smartdrive Systems, Inc. Rail vehicle event triggering system and method
US10930093B2 (en) 2015-04-01 2021-02-23 Smartdrive Systems, Inc. Vehicle event recording system and method
WO2017034531A1 (en) * 2015-08-21 2017-03-02 Hewlett Packard Enterprise Development Lp Digital context-aware data collection
US10607090B2 (en) 2015-12-02 2020-03-31 Icomera Ab Train security system
CN107024361A (en) * 2016-02-02 2017-08-08 株式会社神户制钢所 The abnormal detector of rotating machinery and the abnormality detection system of rotating machinery
US10618534B2 (en) * 2016-11-28 2020-04-14 Taiwan Semiconductor Manufacturing Co., Ltd. Monitor vehicle for a rail system and method thereof
US10311551B2 (en) 2016-12-13 2019-06-04 Westinghouse Air Brake Technologies Corporation Machine vision based track-occupancy and movement validation
US10501102B2 (en) 2017-02-06 2019-12-10 Avante International Technology, Inc. Positive train control system and apparatus employing RFID devices
US11238212B1 (en) * 2017-02-07 2022-02-01 Railworks Corporation Systems and methods for generating maintenance data
US10796192B2 (en) 2017-03-23 2020-10-06 Harsco Technologies LLC Track feature detection using machine vision
US11495009B2 (en) 2017-03-23 2022-11-08 Harsco Technologies LLC Track feature detection using machine vision
US10286460B2 (en) 2017-04-07 2019-05-14 Robert J. Murphy Single-pass, single-radial layer, circumferential-progression fill-welding system, apparatus and method for refurbishing railway and other transit rails
CN108181902A (en) * 2017-12-27 2018-06-19 广州地铁集团有限公司 A kind of intelligent polling method and the robot for realizing this method
CN108528478A (en) * 2018-04-02 2018-09-14 交控科技股份有限公司 The recognition methods of rail traffic situation and device
RU2762164C1 (en) * 2018-05-29 2021-12-16 Сименс Мобилити Гмбх Calibration method and calibration system for a railway vehicle camera and a railway vehicle having a railway vehicle camera
US20210403060A1 (en) * 2018-09-10 2021-12-30 Mer Mec S.P.A. Device and method for detecting railway equipment defects
WO2020053699A1 (en) * 2018-09-10 2020-03-19 Mer Mec S.P.A. Device and method for detecting railway equipment defects
AU2019338073B2 (en) * 2018-09-10 2021-08-19 Mer Mec S.P.A. Device and method for detecting railway equipment defects
US11958514B2 (en) * 2018-09-10 2024-04-16 Mer Mec S. P. A. Device and method for detecting railway equipment defects
CN113365896A (en) * 2018-11-15 2021-09-07 阿万特国际科技公司 Image-based track/rail fault monitoring and detection
US10953899B2 (en) 2018-11-15 2021-03-23 Avante International Technology, Inc. Image-based monitoring and detection of track/rail faults
US10752271B2 (en) 2018-11-15 2020-08-25 Avante International Technology, Inc. Image-based monitoring and detection of track/rail faults
WO2020102297A1 (en) * 2018-11-15 2020-05-22 Avante International Technology, Inc. Image-based monitoring and detection of track/rail faults
US11433931B2 (en) 2018-11-15 2022-09-06 Avante International Technology, Inc. Image-based monitoring and detection of track/rail faults
US11004228B2 (en) * 2018-11-16 2021-05-11 Westinghouse Air Brake Technologies Corporation Image based train length determination
US11529980B2 (en) 2019-01-30 2022-12-20 Ensco, Inc. Systems and methods for inspecting a railroad
US11938982B2 (en) 2019-01-30 2024-03-26 Ensco, Inc. Systems and methods for inspecting a railroad
DE102019212261A1 (en) * 2019-08-15 2021-02-18 Siemens Mobility GmbH Method, device and rail vehicle
US11834082B2 (en) * 2019-09-18 2023-12-05 Progress Rail Services Corporation Rail buckle detection and risk prediction
CN111319655A (en) * 2020-03-09 2020-06-23 唐智科技湖南发展有限公司 Track damage detection method and device and computer readable storage medium
CN111855242A (en) * 2020-06-12 2020-10-30 佛山中国空间技术研究院创新中心 Rail train inspection control method, system and device and storage medium
RU2769100C2 (en) * 2020-06-25 2022-03-28 Общество с ограниченной ответственностью "НАУЧНО-ПРОИЗВОДСТВЕННОЕ ОБЪЕДИНЕНИЕ САУТ" (ООО "НПО САУТ") Method for compiling a digital railway map and application thereof for monitoring the movement of a locomotive
JP7271798B2 (en) 2020-12-15 2023-05-11 川崎車両株式会社 Fastener monitoring device, fastener monitoring system and fastener monitoring method
JPWO2022130488A1 (en) * 2020-12-15 2022-06-23
WO2022130488A1 (en) * 2020-12-15 2022-06-23 川崎車両株式会社 Fastener-monitoring device, fastener-monitoring system, and fastener-monitoring method
RU2761763C1 (en) * 2020-12-18 2021-12-13 Акционерное общество "Научно-исследовательский и проектно-конструкторский институт информатизации, автоматизации и связи на железнодорожном транспорте" System for ensuring safety on railway transport
CN112731407A (en) * 2020-12-31 2021-04-30 西南交通大学 Train positioning method based on ultrasonic detection
CN113282982A (en) * 2021-04-30 2021-08-20 杭州申昊科技股份有限公司 System and method for evaluating safety of rail under condition of mud spraying
WO2023274811A1 (en) * 2021-06-30 2023-01-05 Siemens Mobility GmbH Method and assembly for monitoring wheel-rail contact for a rail vehicle
US11565730B1 (en) * 2022-03-04 2023-01-31 Bnsf Railway Company Automated tie marking
CN114363582A (en) * 2022-03-15 2022-04-15 深圳中慧轨道智能科技有限公司 Integrated track inspection vehicle image processing system
US20240035919A1 (en) * 2022-07-29 2024-02-01 Network Rail Infrastructure Limited Mutual alignment of rail geometry measurements
CN116353660A (en) * 2023-06-01 2023-06-30 兰州交通大学 High-speed railway wheel polygon fault detection method and system based on BWO-VMD
CN117078687A (en) * 2023-10-17 2023-11-17 常州海图信息科技股份有限公司 Track inspection system and method based on machine vision

Also Published As

Publication number Publication date
US8942426B2 (en) 2015-01-27

Similar Documents

Publication Publication Date Title
US8942426B2 (en) On-train rail track monitoring system
US6064428A (en) Automated track inspection vehicle and method
EP2546120B1 (en) Method and stationery system for monitoring equipment of a railway vehicle
KR101672472B1 (en) Comprehensive diagnosing and managementing system of a railcar
US7755660B2 (en) Video inspection system for inspection of rail components and method thereof
US9308925B2 (en) System and method for inspection of wayside rail equipment
KR101111569B1 (en) Monitering System of Railroad Facilities using Railway Vehicle
KR101093021B1 (en) Inforamation integrated railway system
EP3354532A1 (en) Vehicle mounted monitoring system
JP4415330B2 (en) Train line departure detection device and train line departure detection method
KR101701160B1 (en) Cantilever defect inspection system
CN105115605A (en) Track train infrared detection system and detection method
KR101590712B1 (en) Rail car and track monitoring system using running record and the method
KR20090091837A (en) System and method to monitor a wheel of train
GB2546344A (en) Vehicle underframe examination system
KR100689633B1 (en) A system and method for auto managementing and detecting to defect of railroad track
KR101041962B1 (en) An automatic abnormality Detectingy system of Railroad Cars
JP2018136877A (en) Inspection management system, inspection management method and program
KR20090085214A (en) System and method to monitor a rail
KR20090085221A (en) System and method to monitor a rail
US10523858B1 (en) Apparatus and method to capture continuous high resolution images of a moving train undercarriage
JP2011011715A (en) Abnormal cause specifying device, abnormal cause specifying system, and abnormal cause specifying method
KR20140133635A (en) System and method for monitoring of railway vehicles
KR101308150B1 (en) Inspection Device Of Train And Railroad Using Multimedia Equipments And Method Using The Method
JPH1016777A (en) Heating part detector of track equipment

Legal Events

Date Code Title Description
STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551)

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230127

PRDP Patent reinstated due to the acceptance of a late maintenance fee

Effective date: 20230523

FEPP Fee payment procedure

Free format text: PETITION RELATED TO MAINTENANCE FEES FILED (ORIGINAL EVENT CODE: PMFP); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Free format text: PETITION RELATED TO MAINTENANCE FEES GRANTED (ORIGINAL EVENT CODE: PMFG); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Free format text: SURCHARGE, PETITION TO ACCEPT PYMT AFTER EXP, UNINTENTIONAL. (ORIGINAL EVENT CODE: M2558); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 8

STCF Information on status: patent grant

Free format text: PATENTED CASE