WO2009124141A1 - Generating a representation of an object of interest - Google Patents

Generating a representation of an object of interest Download PDF

Info

Publication number
WO2009124141A1
WO2009124141A1 PCT/US2009/039192 US2009039192W WO2009124141A1 WO 2009124141 A1 WO2009124141 A1 WO 2009124141A1 US 2009039192 W US2009039192 W US 2009039192W WO 2009124141 A1 WO2009124141 A1 WO 2009124141A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
interest
dimensional
radiograph
radiation
Prior art date
Application number
PCT/US2009/039192
Other languages
French (fr)
Inventor
Andrew Dean Foland
Original Assignee
L-3 Communications Security And Detection Systems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by L-3 Communications Security And Detection Systems, Inc. filed Critical L-3 Communications Security And Detection Systems, Inc.
Priority to ES09726675T priority Critical patent/ES2722850T3/en
Priority to EP09726675.3A priority patent/EP2269162B1/en
Publication of WO2009124141A1 publication Critical patent/WO2009124141A1/en

Links

Classifications

    • G01V5/22
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01TMEASUREMENT OF NUCLEAR OR X-RADIATION
    • G01T1/00Measuring X-radiation, gamma radiation, corpuscular radiation, or cosmic radiation
    • G01T1/29Measurement performed on radiation beams, e.g. position or section of the beam; Measurement of spatial distribution of radiation
    • G01T1/2914Measurement of spatial distribution of radiation
    • G01T1/2985In depth localisation, e.g. using positron emitters; Tomographic imaging (longitudinal and transverse section imaging; apparatus for radiation diagnosis sequentially in different planes, steroscopic radiation diagnosis)
    • G01V5/226
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis

Definitions

  • This disclosure relates to techniques for generating a representation of an obj ect of interest
  • a screening system that is designed to screen objects (e g , packages, luggage, hand-camed items, and/or larger objects such as shipping containers and trucks) for the presence of explosives, hazardous matenals, contraband, or other types of objects of interest may produce a relatively low-resolution volumetric (e g , three- dimensional) image of a region
  • objects e g , packages, luggage, hand-camed items, and/or larger objects such as shipping containers and trucks
  • explosives, hazardous matenals, contraband, or other types of objects of interest may produce a relatively low-resolution volumetric (e g , three- dimensional) image of a region
  • direct visualization and/or analysis of the volumetric image may pose challenges in determining whether the volumetric image includes a representation of an object of interest
  • a high-resolution, two-dimensional image that includes an object of interest but not clutter objects is created from a volumetnc image and a two-dimensional radiograph
  • the volumetnc image and the two-dimensional radiograph include representations of clutter objects and the object of interest
  • the two-dimensional radiograph and the volumetnc image are both produced by a screening system that images the clutter objects and the object of interest
  • a matenals screening system in another general aspect, includes a scan region configured to receive an object, a source of radiation configured to illuminate the scan region, and a sensor configured to sense radiation from the scan region
  • the system also includes a processor, and a computer-readable storage medium sto ⁇ ng instructions for generating a two- dimensional image of the object of interest
  • the instructions When executed, the instructions cause the processor to generate a volumetric image of the scan region based on the sensed radiation, the volumetric image including a representation of an object of interest and another object, to generate a two-dimensional radiograph of the scan region based on the sensed radiation, the two-dimensional radiograph including a representation of the object of interest and the other object, and to analyze the volumetric image to identify the object of interest or the other object Based on the analyzed volumet ⁇ c image, a two-dimensional image that excludes the object of interest is generated The two- dimensional radiograph and the two-dimensional image that excludes the identified object of interest are compared and a two-dimensional image based on the comparison
  • Implementations may include one or more of the following features
  • the source may be configured to produce x-ray radiation
  • the sensor may be configured to sense x-ray radiation
  • the volumetric image may be analyzed to identify the object of interest, and the identified object of interest may be removed from the volumetric image to generate a de-objectified volumet ⁇ c image
  • Generating a two-dimensional image that excludes the object of interest may include forward- projecting the de-objectified volumet ⁇ c image
  • the instructions to cause the processor to compare the two-dimensional radiograph and the two-dimensional image that excludes the identified object of interest may include instructions to cause the processor to subtract the two-dimensional radiograph from the two-dimensional image
  • the system also may include a display module
  • an apparatus for generating images of an object of interest includes a source of radiation configured to emit radiation that illuminates a space and interacts with an object of interest in the space and another object in the space
  • the apparatus also includes a sensor configured to sense radiation from the space, a processor, and a computer-readable storage medium
  • the source of radiation may be a source of x-ray radiation
  • the sensor configured to sense radiation may include a detector configured to sense x-ray radiation passing through the object of interest and the other object
  • the space may be a cavity in a screening apparatus that is configured to image an object in the cavity
  • the space may be an open region that is illuminated by the source of radiation
  • a volumet ⁇ c image of a space is acquired from an imaging system
  • the space includes an object of interest and another object
  • the volumet ⁇ c image includes data representing the object of interest and the other object
  • a two-dimensional radiograph of the space is acquired from the imaging system
  • the two-dimensional radiograph of the space includes data representing the object of interest and the other object
  • the two-dimensional radiograph and the volumet ⁇ c image are compared at the imaging system
  • a two-dimensional image is generated based on the compa ⁇ son
  • the generated two-dimensional image includes the object of interest and excludes the other object
  • Implementations may include one or more of the following features
  • the generated two-dimensional image may be presented
  • the object of interest may be identified in the volumet ⁇ c image, and a de-objectified image may be generated by removing the object of interest from the volumet ⁇ c image Comparing the two- dimensional radiograph and the volumet ⁇ c image may be achieved by compa ⁇ ng the de-objectified image to the two-dimensional radiograph
  • the de-objectified image may be a two-dimensional image that excludes the object of interest, and compa ⁇ ng the two-dimensional radiograph and the volumet ⁇ c image may include subtracting the de-objectified image from the two-dimensional radiograph
  • the de- objectified two-dimensional image and the acquired two-dimensional radiograph may be registered with each other p ⁇ or to subtracting the de-objectified two-dimensional image from the acquired two-dimensional radiograph
  • the de-objectified two- dimensional image may be filtered
  • the identified object of interest may be represented in the volumetric image by one or more voxels, and removing the identified
  • the acquired two-dimensional radiograph may have a higher spatial resolution than the acquired volumetric image At least a portion of the object of interest may obscures at least a portion of the other object in the acquired two-dimensional radiograph
  • Two-dimensional radiographs may be repeatedly acquired and each of the two- dimensional radiographs may be compared to the volumetric image
  • Implementations of any of the techniques desc ⁇ bed above may include a method, a process, a system, a device, an apparatus, or instructions stored on a computer-readable storage medium
  • the details of one or more implementations are set forth in the accompanying drawings and the description below Other features will be apparent from the description and drawings, and from the claims
  • FIG IB illustrates a side-view of the example screening system of FIG IA
  • FIG 2 illustrates a block diagram of a screening system
  • FIG 3 illustrates a process for generating a two-dimensional representation of an object of interest
  • FIG 4 shows an illustration of volumetric images and two-dimensional images used to generate a two-dimensional representation of an object of interest
  • an example system 100 for detecting the presence of objects of interest such as explosives, hazardous materials, controlled substances (e g , illegal drugs and narcotics), or contraband in containers 102, 104, and 106 is illustrated
  • the system 100 may be referred to as a mate ⁇ als screening system, and the system 100 includes a screening device 101 that produces a two-dimensional image of an object of interest without clutter objects
  • the system 100 may be used to process, image, and/or analyze a large volume of containers at, for example, a civilian, military, or commercial airport, a rail station, a bus terminal, a seaport, a public gathering place, or a border checkpoint
  • the screening device 101 produces a two- dimensional image of an object of interest without clutter from a volumet ⁇ c (e g , three-dimensional) image 108 and a two-dimensional radiograph 109
  • the volumet ⁇ c image 108 and the two-dimensional radiograph 109 each include representations of objects that are in a scan region 112 of the screening device 101
  • the scan region 112 may include objects of interest and objects that are not of interest (e g , clutter objects)
  • the volumetric image 108 and the two-dimensional radiograph 108 may include representations of the object of interest and clutter objects
  • the volumetric image 108 and the two-dimensional radiograph 109 may be used to produce a two-dimensional image that only includes the object of interest This two-dimensional image of the object of interest may be presented to an operator of the system 100 and/or provided to an automated process for further analysis
  • the generated two-dimensional image does not include overlapping objects, whereas the volumet ⁇ c image 108 and the two-dimensional radiograph 109 usually do include overlapping objects
  • the generated two-dimensional image may be easier to view and understand as compared to the two- dimensional radiograph 109 or the volumet ⁇ c image 108
  • the generated two-dimensional image is a relatively high spatial resolution image as compared to the volumet ⁇ c image 108, and the generated two- dimensional image may provide a better representation of the region imaged
  • the generated two-dimensional image is created from the two- dimensional radiograph 109, which has a higher spatial resolution than the volumetnc image 108
  • the volumetric image 108 may include voxels that
  • the system 100 includes a screening device 101 that images the containers 102, 104, and 106 while the containers 102, 104, and 106 are present in the scan region 112
  • the containers 102, 104, and 106 may be present in the scan region 112 as the containers pass through the scan region 112 on a conveyor belt 119, or the containers 102, 104, and 106 may be stationary in the scan region 112
  • the containers 102, 104, and 106 enter the scan region 112 at an entrance 115
  • the entrance 115 may be covered by a removable door or other type of cover (not shown)
  • the scan region 112 may be considered to be a volumet ⁇ c region or space that is configured to receive objects that are imaged by the screening device 101
  • the scan region 112 maybe imaged by, for example, illuminating the scan region 112 with radiation from a radiation source 120
  • the source 120 is an x-ray source that illuminates the scan region, and
  • the volumetric image 108 may be, for example, a three-dimensional computed tomography image that is produced from a full volumetric reconstruction of the data collected by the sensor 125
  • the two-dimensional radiograph 109 may be an x-ray projection of a portion of the scan region 112 or the entire scan region 112 As discussed above, the two-dimensional radiograph 109 may have a higher spatial resolution than the volumet ⁇ c image 108
  • the volumet ⁇ c image 108 is a representation of the scan region 112 and objects withm the scan region 112, and the two-dimensional radiograph 109 is a two-dimensional image of the scan region 112
  • FIG IB a side view of the screening device 101 is shown
  • the screening device 101 includes the radiation source 120, which maybe an x-ray source, a first detector 160 and a second detector 165
  • the screening device 101 also may include a collimator 167 and a filter 169
  • the radiation source 120 exposes an object of interest that is inside the scan region 112, such as the suitcase 104, to x-ray radiation of at least two energy levels
  • the x-rays may be collimated by the collimator 167, which may be made of lead or another mate ⁇ al of sufficient thickness to block the x- rays
  • the collimated x-rays pass through the suitcase 104, are attenuated by the suitcase 104 and the contents of the suitcase 104, and the attenuated x-rays are sensed by the first detector 160
  • the first detector 160 may be, for example, a scintillator, and the some or all of the attenuated x-rays may pass through the first detector 160
  • the filter 169 may be placed in front of the second detector 165 such that only x-rays having energies below a cut-off energy of the filter 169 reach the second detector 165
  • the filter 169 may be made from a metal material such as, for example, copper
  • the first and second detectors 160 and 165 sense attenuated x-rays that pass through the suitcase 106 The sensed x-rays are used to generate the volumetric image 108 and the two-dimensional image 109 of the scan region 112 and the contents of the scan region 112
  • an image generation module 135 processes the volumetric image 108 and the two-dimensional image 109 (both of which include the object of interest and clutter to produce a two-dimensional image that only mcludes the obj ect of interest
  • the two-dimensional image of the obj ect of interest may be presented at an operator station 140 at a display 142
  • an alarm 144 may be triggered based on the presence of the explosive 152
  • the system 100 detects the presence of objects of interest m containers that are used in relation to commerce and/or transportation
  • the techniques discussed below may be used to detect the presence of objects of mterest in other contexts
  • the techniques discussed below may be used m medical imaging applications to determine whether, for example, biological tissues of a human patient or a tissue sample are diseased or healthy, or to image hard structures such as bones m the patient
  • the system 200 includes a screening apparatus 210 and an analysis station 250 that displays two-dimensional image data of an object of interest received from the screening apparatus 210
  • the system 200 may be similar to the system 100 discussed with respect to FIGS IA and IB
  • the screening apparatus 210 may be used to screen objects to determine whether the object includes items of interest
  • the screemng apparatus 210 mcludes a scan region 215 that is configured to receive an object (such as a container or a human patient) to be imaged with the screemng apparatus 210
  • the screemng apparatus 210 also includes an imaging system 220, a image generation module 230, a processor 240, an input/output device 242, and an electronic storage 245
  • the screemng apparatus 210 generates a two-dimensional image that mcludes only a representation of an object of interest from a volumetric image and a two-dimensional radiograph, each of which include representations of the object of interest and clutter objects
  • the scan region 215 is appropnately sized depending on the types of objects to be screened For example, the scan region 215 may be large enough to receive a suitcase or other hand-transportable luggage item The scan region 215 may accommodate a truck or shipping container In other examples, the scan region 215 may be sized to accommodate a human patient The scan region 215 may pass through the screening apparatus 215, or the scan region 215 may be open at just one end of the screening apparatus 215
  • the screemng apparatus 210 also includes the imaging system 220, which includes a source 222 and a sensing module 224 The imaging system 220 images the inside of the scan region 215 and the objects within the scan region 215 to produce a volumetric image 226 of the scan region 215 and the objects inside of the scan region 215 The imaging system 220 also produces a two-dimensional image 228 of the scan region 215
  • the source 222 may be a source that emits x-rays, and the source 222 may be similar to the radiation source 120 discussed above with respect to
  • the image generation module 230 generates a two dimensional image of an object of interest from the volumetric image of the scan region 215 and a two- dimensional radiograph of the scan region 215
  • the screemng apparatus 210 also includes the processor 240, the mput/output device 242, and the storage 245
  • the storage 245 stores instructions that, when executed by the processor 240, cause the image generation module 230 to perform operations such as identifying an object of interest m the volumet ⁇ c image 108
  • the storage 245 also may store data sensed by the sensing module 224, instructions for ret ⁇ eving the data from the sensing module 224, and instructions for generating a volumetric image based on the data from the sensing module 224
  • the storage 245 is an electronic memory module, and the storage 245 may be a non-volatile or persistent memory
  • the storage 245 may be volatile memory, such as RAM In some implementations, the storage 245 may include both non-volatile and volatile portions or components
  • the input/output device 242 may be any device able to transmit data to, and receive data from, the screening apparatus 210
  • the input/output device 242 may be a mouse, a touch screen, a stylus, a keyboard, or any other device that enables a user to interact with the screening apparatus 210
  • the input/output device 242 may be configured to receive an input from an automated process or a machine or to provide an output to an automated process or a machine
  • the system 200 also includes the analysis station 250
  • the analysis station 250 includes an input module 260, an interface generation module 270, an image interaction and retrieval module 270, a processor 280, and an input/output device 290
  • the analysis station 250 may be similar to the operator station 140 discussed above with respect to FIG IA
  • the input module 260 receives the two-dimensional image of the object of interest from the screening apparatus 210 or the image generation module 230
  • the two-dimensional image may be transferred over a wireless or wired network connection
  • the interface generation module 270 displays the
  • the analysis station 250 also includes a processor 270 and an mput/output device 280
  • the processor 270 executes instructions that cause the interface generation module 260 to generate and display the interface and process commands received from the input/output device 280
  • the input/output device 280 may be any device that allows a user to interact with the analysis station 250
  • the input/output device 280 may be a mouse, a keyboard, or a touch screen
  • the analysis station 250 and the screening apparatus 210 are shown as separate components that are in communication with each other, this is not necessarily the case In some implementations, the analysis station 250 is integrated into the screening apparatus 210
  • the screening apparatus 210 is a continuous image reconstruction system in which the source 222 continuously produces radiation and exposes the scan region 215 to the radiation, and the sensing module 224 continuously senses radiation from the source 222
  • the imaging system 220 produces volumetric image of the scan region 215 based on the radiation sensed by the sensing module 224
  • the volumetric image 226 and the two-dimensional radiograph 228 of the scan region 215 are generated regardless of whether the scan region 215 includes an object
  • the screening apparatus 210 is a non-contmuous image reconstruction system
  • the screening apparatus 210 also includes photocells (not shown) that detect the presence of a container in the scan region 215, and the presence of a container triggers the source 222 to produce radiation, the sensing module 224 senses radiation passing through the container, and the imaging system 220 generates the volumet ⁇ c image 226 and the two-dimensional radiograph 228 from the radiation sensed by the sensing module 224
  • the volumet ⁇ c image 228 and the two-dimensional radiograph are only created when an object is present m the scan region 215
  • an example process 300 that uses three- dimensional data and two-dimensional data to generate a high-resolution, two- dimensional image of an object of interest is illustrated
  • the process 300 maybe performed by one or more processors included in a screening system such as the system 100 or the system 200 discussed above with respect to FIGS IA, IB, and 2
  • the two-dimensional image generated by the process 300 includes a representation of an object of interest but does not include a representation of clutter objects
  • a volumetric image 405 and a two-dimensional image 410 are acquired from the screening system (310)
  • the volumetric image 405 and the two-dimensional radiograph 410 may be generated from sensed radiation as discussed above with respect to FIGS IA, IB, and 2
  • the volumetric image 405 is a three-dimensional representation of a bag that is in the scan region 215 of the screening system
  • the two-dimensional image 410 is a two-dimensional representation of the objects withm the bag
  • the volumetric image 405 may be voxelized to the volumetric image 420, in which the geomet ⁇ c objects 405A-405D represented m the volumetric image 405 are converted into voxel representations (e g , the objects 405A-405D are voxelized)
  • a voxel is a cubic unit of volume that represents a unit of volume, and a voxel may be regarded as the counterpart to a pixel that represents a unit of area in a two-dimensional image
  • the bag that is imaged in the example shown in FIG 4 includes four objects, a ball 405 A, a phone 405B, a personal digital assistant (PDA) 405C, and a plush toy 405D
  • the ball 405A is the object of interest
  • the phone 405B, the PDA 405C, and the plush toy 405D are considered clutter objects
  • the volumet ⁇ c image 405 and the voxelized reconstruction 410 include perspective information regarding the relative placement of the objects 405 A-405D in the bag
  • the PDA 405C is m front of and slightly lower than the ball 405 A
  • the phone 405B is above and to the left of the PDA 405C
  • the two-dimensional radiograph 410 In contrast to the volumetnc image 405 and the voxelized reconstruction 420, the two- dimensional radiograph 410 does not show depth information Thus, in the two- dimensional radiograph 410, the phone 405B appears to overlap the ball 405 A, and the ball 405A appears to overlap the PDA 405C
  • the two-dimensional radiograph 410 may be a higher spatial resolution image than the volumetric image 405
  • a pixel of the two-dimensional radiograph 410 may represent a smaller physical area than the a voxel of the voxehzed reconstruction 420
  • the two-dimensional radiograph 410 when displayed, the two-dimensional radiograph 410 may appear sharper and more detailed to a human operator as compared to a direct display of the voxehzed reconstruction 420
  • the two-dimensional radiograph 410 may appear sharper and more detailed to a human operator as compared to a direct display of the voxehzed reconstruction 420 Similarly, when
  • the object of interest (e g , the ball 405A), is identified in the voxehzed reconstruction 420 (320)
  • the object of interest may be identified using a variety of analysis techniques For example, objects of interest may be known to be round, and an edge detector followed by a filter to detect objects having round outlines may be applied to the volumetric image 405 to find round objects
  • volumetric image 405 includes voxels representing the bag and the objects 405A-405D within the bag
  • the volumet ⁇ c image 405 may be created by sensing x-ray radiation that passed through the bag to a detector
  • the volumet ⁇ c image 405 includes data that represents the entire bag, only high-density materials are visible in the volumet ⁇ c image 405 Because the voxels representing the high-density materials are the voxels that most useful for determining whether the bag includes items of interest, the voxels representing the low-density matenals may be disregarded as clutter objects and the voxels representing high-density materials may be associated with an object of interest
  • the object of interest may be identified within the voxehzed reconstruction 420 Additionally, because the portions or regions of the voxehzed reconstruction 420 other than those that include the object of interest may be considered clutter, the clutter objects and regions are also identified
  • a localized region of the voxehzed reconstruction 420 that includes the identified object of interest is removed to create a de-objectified volumetric image 430 (330)
  • the localized region of the voxehzed reconstruction 420 may include the identified object of interest and voxels in the neighborhood of the identified object of interest
  • the neighborhood of the identified object of interest may be, for example, voxels within a boundary between the identified object of interest or voxels just outside of the boundary of the identified object of interest
  • the neighborhood may include all voxels that fall within a region defined by the maximum and minimum spatial coordinates of the identified object of interest
  • the region may be approximated by, for example, a circle, ellipse, or rectangle defined by the coordinates
  • the neighborhood may include voxels that are adjacent to voxels that form a boundary of the identified object of interest and/or voxels that are connected to the identified object of interest
  • the de-objectified volumetric image 430 is created
  • the de-objectified volumetnc image 430 is forward projected to create a two- dimensional de-objectified image 440 (340)
  • Forward projection refers to the projection of the data in the voxehzed reconstruction 420 onto a two-dimensional projection space
  • the forward projection of the voxehzed reconstruction 420 may be considered to be the two-dimensional image that is perceived when viewing the voxehzed reconstruction 420 on a two-dimensional display
  • the de-objectified volumetnc image is a two-dimensional image that includes representations of the clutter objects 405B-405D, but does not include a representation of the object of interest 405 A (e g , the ball)
  • the de-objectified two-dimensional image 440 and the acquired two-dimensional radiograph 410 are compared (350) such that the clutter objects are removed from the acquired two-dimensional radiograph 410
  • Comparing the de- objectified two-dimensional image 440 and the two-dimensional radiograph 410 may include subtracting the de-objectified two-dimensional image 440 from the two- dimensional radiograph 410 (or visa versa)
  • the de-objectified two-dimensional image 440 includes the phone 405B, the PDA 405C, and the plush toy 405D (the clutter objects) but not the ball 405A (the object of interest)
  • subtracting the de-objectified two-dimensional image 440 from the two-dimensional radiograph 410 results in the clutter objects being removed from the two-dimensional radiograph 410 P ⁇ or to subtracting or otherwise comparing the de-objectified two- dimensional image 440 and the acquired two-dimensional radiograph 410, the de- objectified two-dimensional image 440 and the two-dimensional radiograph 410 are registered such that the clutter objects
  • the two-dimensional radiograph 410 may be processed before the removal of the clutter objects 405B-405D
  • a low- pass filter may be applied to everything outside of the boundaries of the object of interest
  • the low-pass filter is not applied to the object of interest, but the filter is applied to the clutter objects
  • Application of the low-pass filter may help to reduce or eliminate the occurrence of high-frequency "ghosts" that may otherwise appear in the two-dimensional radiograph
  • the de- objectified image 440 may be processed with the low-pass filter
  • a two-dimensional image 450 of the object of interest is generated based on the comparison (360) As shown in FIG 4, the two-dimensional image 450 includes a the ball 405A (e g , the object of interest), but not the phone 405B, the PDA 405C, or the plush toy 405D (e g , the clutter objects)
  • the two- dimensional image 450 is the two-dimensional radiograph 410 with the clutter objects removed
  • the two-dimensional image 450 is a separate image that is generated from the two-dimensional image 410
  • a high- resolution, two-dimensional image that includes a representation of the object of interest without the clutter objects is generated
  • low-resolution, two-dimensional radiographs that include only the object of interest may be created instead of high-resolution two- dimensional radiographs
  • the volumetric neighborhood of the object of interest identified in (320, 330) discussed above is forward projected to create a two-dimensional image of the object of interest Because the voxels
  • multiple volumetnc images such as the volumetnc image 108) and/or multiple two-dimensional radiographs (such as the two- dimensional radiograph 109) may be produced by the screening device 101
  • Each of the multiple volumetnc images and the two-dimensional radiographs may represent a different portion of the scan region 112 Accordingly, other implementations are within the scope of the following claims

Abstract

A volumetric image of a space is acquired from an imaging system. The space includes an object of interest and another object, and the volumetric image includes data representing the object of interest and the other object. A two-dimensional radiograph of the space is acquired from the imaging system. The two-dimensional radiograph of the space includes data representing the object of interest and the other object. The two-dimensional radiograph and the volumetric image are compared at the imaging system. A two-dimensional image is generated based on the comparison. The generated two-dimensional image includes the object of interest and excludes the other object.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application claims pnonty to U S Provisional Application Serial No 61/042,192, titled GENERATING IMAGES OF OBJECTS, and filed on Apπl 3, 2008, which is incorporated by reference in its entirety
TECHNICAL FIELD
This disclosure relates to techniques for generating a representation of an obj ect of interest
BACKGROUND
A screening system that is designed to screen objects (e g , packages, luggage, hand-camed items, and/or larger objects such as shipping containers and trucks) for the presence of explosives, hazardous matenals, contraband, or other types of objects of interest may produce a relatively low-resolution volumetric (e g , three- dimensional) image of a region However, direct visualization and/or analysis of the volumetric image may pose challenges in determining whether the volumetric image includes a representation of an object of interest
SUMMARY
In one general aspect, a high-resolution, two-dimensional image that includes an object of interest but not clutter objects is created from a volumetnc image and a two-dimensional radiograph The volumetnc image and the two-dimensional radiograph include representations of clutter objects and the object of interest The two-dimensional radiograph and the volumetnc image are both produced by a screening system that images the clutter objects and the object of interest
In another general aspect, a matenals screening system includes a scan region configured to receive an object, a source of radiation configured to illuminate the scan region, and a sensor configured to sense radiation from the scan region The system also includes a processor, and a computer-readable storage medium stoπng instructions for generating a two- dimensional image of the object of interest When executed, the instructions cause the processor to generate a volumetric image of the scan region based on the sensed radiation, the volumetric image including a representation of an object of interest and another object, to generate a two-dimensional radiograph of the scan region based on the sensed radiation, the two-dimensional radiograph including a representation of the object of interest and the other object, and to analyze the volumetric image to identify the object of interest or the other object Based on the analyzed volumetπc image, a two-dimensional image that excludes the object of interest is generated The two- dimensional radiograph and the two-dimensional image that excludes the identified object of interest are compared and a two-dimensional image based on the comparison is generated The generated two-dimensional image includes the object of interest and excludes the other object
Implementations may include one or more of the following features The source may be configured to produce x-ray radiation, and the sensor may be configured to sense x-ray radiation The volumetric image may be analyzed to identify the object of interest, and the identified object of interest may be removed from the volumetric image to generate a de-objectified volumetπc image Generating a two-dimensional image that excludes the object of interest may include forward- projecting the de-objectified volumetπc image The instructions to cause the processor to compare the two-dimensional radiograph and the two-dimensional image that excludes the identified object of interest may include instructions to cause the processor to subtract the two-dimensional radiograph from the two-dimensional image The system also may include a display module In another general aspect, an apparatus for generating images of an object of interest includes a source of radiation configured to emit radiation that illuminates a space and interacts with an object of interest in the space and another object in the space The apparatus also includes a sensor configured to sense radiation from the space, a processor, and a computer-readable storage medium stoπng instructions for generating a two-dimensional image of the object of interest, the instructions, when executed, causing the processor to acquire sensed data from the sensor to generate a two-dimensional radiograph of the space The two-dimensional radiograph includes a representation of the object of interest and a representation the other object Sensed data is acquired from the sensor to generate a volumetric image of the space, the volumetπc image being of lower spatial resolution than the two-dimensional radiograph, and the volumetπc image including a representation of the object of interest and a representation of the other object A two-dimensional image is generated from the two-dimensional radiograph and the volumetπc image The two- dimensional image includes the object of interest and excludes the other object
Implementations may include one or more of the following features The source of radiation may be a source of x-ray radiation, and the sensor configured to sense radiation may include a detector configured to sense x-ray radiation passing through the object of interest and the other object The space may be a cavity in a screening apparatus that is configured to image an object in the cavity The space may be an open region that is illuminated by the source of radiation
In another general aspect, a volumetπc image of a space is acquired from an imaging system The space includes an object of interest and another object, and the volumetπc image includes data representing the object of interest and the other object A two-dimensional radiograph of the space is acquired from the imaging system The two-dimensional radiograph of the space includes data representing the object of interest and the other object The two-dimensional radiograph and the volumetπc image are compared at the imaging system A two-dimensional image is generated based on the compaπson The generated two-dimensional image includes the object of interest and excludes the other object
Implementations may include one or more of the following features The generated two-dimensional image may be presented The object of interest may be identified in the volumetπc image, and a de-objectified image may be generated by removing the object of interest from the volumetπc image Comparing the two- dimensional radiograph and the volumetπc image may be achieved by compaπng the de-objectified image to the two-dimensional radiograph The de-objectified image may be a two-dimensional image that excludes the object of interest, and compaπng the two-dimensional radiograph and the volumetπc image may include subtracting the de-objectified image from the two-dimensional radiograph The de- objectified two-dimensional image and the acquired two-dimensional radiograph may be registered with each other pπor to subtracting the de-objectified two-dimensional image from the acquired two-dimensional radiograph The de-objectified two- dimensional image may be filtered The identified object of interest may be represented in the volumetric image by one or more voxels, and removing the identified object of interest from the volumetric image may include setting the one or more voxels equal to zero
In some implementations, the acquired two-dimensional radiograph may have a higher spatial resolution than the acquired volumetric image At least a portion of the object of interest may obscures at least a portion of the other object in the acquired two-dimensional radiograph
Two-dimensional radiographs may be repeatedly acquired and each of the two- dimensional radiographs may be compared to the volumetric image
Implementations of any of the techniques descπbed above may include a method, a process, a system, a device, an apparatus, or instructions stored on a computer-readable storage medium The details of one or more implementations are set forth in the accompanying drawings and the description below Other features will be apparent from the description and drawings, and from the claims
DESCRIPTION OF THE DRAWINGS FIQ IA illustrates an example of a screening system
FIG IB illustrates a side-view of the example screening system of FIG IA FIG 2 illustrates a block diagram of a screening system FIG 3 illustrates a process for generating a two-dimensional representation of an object of interest FIG 4 shows an illustration of volumetric images and two-dimensional images used to generate a two-dimensional representation of an object of interest
DETAILED DESCRIPTION
Referring to FIG IA, an example system 100 for detecting the presence of objects of interest such as explosives, hazardous materials, controlled substances (e g , illegal drugs and narcotics), or contraband in containers 102, 104, and 106 is illustrated The system 100 may be referred to as a mateπals screening system, and the system 100 includes a screening device 101 that produces a two-dimensional image of an object of interest without clutter objects The system 100 may be used to process, image, and/or analyze a large volume of containers at, for example, a civilian, military, or commercial airport, a rail station, a bus terminal, a seaport, a public gathering place, or a border checkpoint
As discussed in more detail below, the screening device 101 produces a two- dimensional image of an object of interest without clutter from a volumetπc (e g , three-dimensional) image 108 and a two-dimensional radiograph 109 The volumetπc image 108 and the two-dimensional radiograph 109 each include representations of objects that are in a scan region 112 of the screening device 101 The scan region 112 may include objects of interest and objects that are not of interest (e g , clutter objects) Thus, the volumetric image 108 and the two-dimensional radiograph 108 may include representations of the object of interest and clutter objects However, using the techniques discussed below, the volumetric image 108 and the two- dimensional radiograph 109 may be used to produce a two-dimensional image that only includes the object of interest This two-dimensional image of the object of interest may be presented to an operator of the system 100 and/or provided to an automated process for further analysis
As compared to techniques that rely on direct viewing and/or automated processing of the volumetπc image 108 (either with or without the clutter objects present), viewing or processing a two-dimensional image that includes only the object of interest, may result in improved performance due to easier viewing of the object of interest For example, the generated two-dimensional image does not include overlapping objects, whereas the volumetπc image 108 and the two-dimensional radiograph 109 usually do include overlapping objects Thus, the generated two- dimensional image may be easier to view and understand as compared to the two- dimensional radiograph 109 or the volumetπc image 108 Additionally, in some implementations, the generated two-dimensional image is a relatively high spatial resolution image as compared to the volumetπc image 108, and the generated two- dimensional image may provide a better representation of the region imaged In these implementations, the generated two-dimensional image is created from the two- dimensional radiograph 109, which has a higher spatial resolution than the volumetnc image 108 For example, the volumetric image 108 may include voxels that represent a cubic space that is 3 5 to 5 millimeters on a side The two-dimensional radiograph 109 may be an image that includes pixels that represent a square space that is 0 5 to 1 0 millimeters on a side, for example As discussed in greater detail with respect to FIGS 3 and 4, to generate the two-dimensional image of the object of interest, the object of interest may be identified in the volumetric image 108 and removed from the volumetric image 108 Identifying the object of interest also allows the clutter objects to be identified because the clutter in the volumetric image 108 may be the other portions of the volumetπc image 108 besides those that include the identified object of interest Objects other than the object of interest (e g , clutter objects) are identified m the volumetric image 108 and removed from the two-dimensional radiograph 109 to produce a high-resolution two-dimensional image that includes the object of interest but not the clutter objects The clutter objects may be removed from the two- dimensional radiograph 109 by, for example, subtracting the clutter objects from the two-dimensional radiograph 109
In greater detail, in the example shown in FIG IA, the system 100 includes a screening device 101 that images the containers 102, 104, and 106 while the containers 102, 104, and 106 are present in the scan region 112 The containers 102, 104, and 106 may be present in the scan region 112 as the containers pass through the scan region 112 on a conveyor belt 119, or the containers 102, 104, and 106 may be stationary in the scan region 112 In the example shown in FIG IA, the containers 102, 104, and 106 enter the scan region 112 at an entrance 115 The entrance 115 may be covered by a removable door or other type of cover (not shown) Thus, the scan region 112 may be considered to be a volumetπc region or space that is configured to receive objects that are imaged by the screening device 101 The scan region 112 maybe imaged by, for example, illuminating the scan region 112 with radiation from a radiation source 120 In some implementations, the source 120 is an x-ray source that illuminates the scan region, and any objects in the scan region, with x-ray radiation In these implementations, the scan region 112 may be imaged by sensing the x-ray radiation that passes through the scan region and any objects present in the scan region, at a sensor 125, and generating both the volumetric image 108 and the two-dimensional radiograph 109 from the sensed radiation
The volumetric image 108 may be, for example, a three-dimensional computed tomography image that is produced from a full volumetric reconstruction of the data collected by the sensor 125 The two-dimensional radiograph 109 may be an x-ray projection of a portion of the scan region 112 or the entire scan region 112 As discussed above, the two-dimensional radiograph 109 may have a higher spatial resolution than the volumetπc image 108 The volumetπc image 108 is a representation of the scan region 112 and objects withm the scan region 112, and the two-dimensional radiograph 109 is a two-dimensional image of the scan region 112 Referring to FIG IB, a side view of the screening device 101 is shown The screening device 101 includes the radiation source 120, which maybe an x-ray source, a first detector 160 and a second detector 165 The screening device 101 also may include a collimator 167 and a filter 169 The radiation source 120, the first detector 160, the second detector 165, the collimator 167, and the filter 169 are outside of the scan region 112, and the suitcase 104 is within the scan region 112
In some implementations, the radiation source 120 exposes an object of interest that is inside the scan region 112, such as the suitcase 104, to x-ray radiation of at least two energy levels The x-rays may be collimated by the collimator 167, which may be made of lead or another mateπal of sufficient thickness to block the x- rays The collimated x-rays pass through the suitcase 104, are attenuated by the suitcase 104 and the contents of the suitcase 104, and the attenuated x-rays are sensed by the first detector 160 The first detector 160 may be, for example, a scintillator, and the some or all of the attenuated x-rays may pass through the first detector 160 The filter 169 may be placed in front of the second detector 165 such that only x-rays having energies below a cut-off energy of the filter 169 reach the second detector 165 The filter 169 may be made from a metal material such as, for example, copper The arrangement of the first and second detectors shown in the example of FIG IB may be referred to as a front-to-back configuration In a front-to-back configuration, the detectors 160 and 165 image the same area of the scan region 112, thus data collected by the detectors 160 and 165 generally is aligned at the time of detection without further correction In some implementations, the first detector 160 and the second detector 165 may be placed next to each other in a side-by-side configuration In some implementations, the screening device 101 may include just one detector
Thus, the first and second detectors 160 and 165 sense attenuated x-rays that pass through the suitcase 106 The sensed x-rays are used to generate the volumetric image 108 and the two-dimensional image 109 of the scan region 112 and the contents of the scan region 112
Returning to FIG IA, an image generation module 135 processes the volumetric image 108 and the two-dimensional image 109 (both of which include the object of interest and clutter to produce a two-dimensional image that only mcludes the obj ect of interest The two-dimensional image of the obj ect of interest may be presented at an operator station 140 at a display 142 In the example shown in FIG IA, an alarm 144 may be triggered based on the presence of the explosive 152 Although in the example shown in FIG IA, the system 100 detects the presence of objects of interest m containers that are used in relation to commerce and/or transportation, in other examples, the techniques discussed below may be used to detect the presence of objects of mterest in other contexts For example, the techniques discussed below may be used m medical imaging applications to determine whether, for example, biological tissues of a human patient or a tissue sample are diseased or healthy, or to image hard structures such as bones m the patient
Referring to FIG 2, a block diagram of an example screening system 200 is shown The system 200 includes a screening apparatus 210 and an analysis station 250 that displays two-dimensional image data of an object of interest received from the screening apparatus 210 The system 200 may be similar to the system 100 discussed with respect to FIGS IA and IB
The screening apparatus 210 may be used to screen objects to determine whether the object includes items of interest The screemng apparatus 210 mcludes a scan region 215 that is configured to receive an object (such as a container or a human patient) to be imaged with the screemng apparatus 210 The screemng apparatus 210 also includes an imaging system 220, a image generation module 230, a processor 240, an input/output device 242, and an electronic storage 245 The screemng apparatus 210 generates a two-dimensional image that mcludes only a representation of an object of interest from a volumetric image and a two-dimensional radiograph, each of which include representations of the object of interest and clutter objects
The scan region 215 is appropnately sized depending on the types of objects to be screened For example, the scan region 215 may be large enough to receive a suitcase or other hand-transportable luggage item The scan region 215 may accommodate a truck or shipping container In other examples, the scan region 215 may be sized to accommodate a human patient The scan region 215 may pass through the screening apparatus 215, or the scan region 215 may be open at just one end of the screening apparatus 215 The screemng apparatus 210 also includes the imaging system 220, which includes a source 222 and a sensing module 224 The imaging system 220 images the inside of the scan region 215 and the objects within the scan region 215 to produce a volumetric image 226 of the scan region 215 and the objects inside of the scan region 215 The imaging system 220 also produces a two-dimensional image 228 of the scan region 215 The source 222 may be a source that emits x-rays, and the source 222 may be similar to the radiation source 120 discussed above with respect to FIG IB The sensing module 224 includes detectors that sense radiation produced by the source 222
The image generation module 230 generates a two dimensional image of an object of interest from the volumetric image of the scan region 215 and a two- dimensional radiograph of the scan region 215 The screemng apparatus 210 also includes the processor 240, the mput/output device 242, and the storage 245 The storage 245 stores instructions that, when executed by the processor 240, cause the image generation module 230 to perform operations such as identifying an object of interest m the volumetπc image 108 The storage 245 also may store data sensed by the sensing module 224, instructions for retπeving the data from the sensing module 224, and instructions for generating a volumetric image based on the data from the sensing module 224 The storage 245 is an electronic memory module, and the storage 245 may be a non-volatile or persistent memory The storage 245 may be volatile memory, such as RAM In some implementations, the storage 245 may include both non-volatile and volatile portions or components The processor 240 may be a processor suitable for the execution of a computer program such as a general or special purpose microprocessor, and any one or more processors of any kind of digital computer Generally, a processor receives instructions and data from a read-only memory or a random access memory or both The processor 240 receives instruction and data from the components of the screening apparatus 210, such as, for example, the imaging system 220 and/or the image generation module 230, to, for example, analyze data from the imaging system 220 to generate a two-dimensional image that includes only a representation of the object of interest but not clutter objects In some implementations, the screening apparatus 210 includes more than one processor
The input/output device 242 may be any device able to transmit data to, and receive data from, the screening apparatus 210 For example, the input/output device 242 may be a mouse, a touch screen, a stylus, a keyboard, or any other device that enables a user to interact with the screening apparatus 210 In some implementations, the input/output device 242 may be configured to receive an input from an automated process or a machine or to provide an output to an automated process or a machine The system 200 also includes the analysis station 250 The analysis station 250 includes an input module 260, an interface generation module 270, an image interaction and retrieval module 270, a processor 280, and an input/output device 290 The analysis station 250 may be similar to the operator station 140 discussed above with respect to FIG IA The input module 260 receives the two-dimensional image of the object of interest from the screening apparatus 210 or the image generation module 230 The two-dimensional image may be transferred over a wireless or wired network connection The interface generation module 270 displays the two- dimensional image that includes a representation of the object of interest but not the clutter objects on a display such as the display 142 discussed above with respect to FIG IA The analysis station also includes an image interaction and retrieval module 265 that allows interaction with the displayed image For example, the image interaction and retrieval module 265 may allow an operator to zoom in on an area of interest in the two-dimensional image
The analysis station 250 also includes a processor 270 and an mput/output device 280 The processor 270 executes instructions that cause the interface generation module 260 to generate and display the interface and process commands received from the input/output device 280 The input/output device 280 may be any device that allows a user to interact with the analysis station 250 For example, the input/output device 280 may be a mouse, a keyboard, or a touch screen Although m the example of FIG 2, the analysis station 250 and the screening apparatus 210 are shown as separate components that are in communication with each other, this is not necessarily the case In some implementations, the analysis station 250 is integrated into the screening apparatus 210
In one implementation, the screening apparatus 210 is a continuous image reconstruction system in which the source 222 continuously produces radiation and exposes the scan region 215 to the radiation, and the sensing module 224 continuously senses radiation from the source 222 The imaging system 220 produces volumetric image of the scan region 215 based on the radiation sensed by the sensing module 224 Thus, implementations in which the screening apparatus 210 is a continuous image reconstruction system, the volumetric image 226 and the two-dimensional radiograph 228 of the scan region 215 are generated regardless of whether the scan region 215 includes an object
In a second implementation, the screening apparatus 210 is a non-contmuous image reconstruction system In this implementation, the screening apparatus 210 also includes photocells (not shown) that detect the presence of a container in the scan region 215, and the presence of a container triggers the source 222 to produce radiation, the sensing module 224 senses radiation passing through the container, and the imaging system 220 generates the volumetπc image 226 and the two-dimensional radiograph 228 from the radiation sensed by the sensing module 224 Thus, in implementations in which the screening apparatus 210 is a non-contmuous image reconstruction system, the volumetπc image 228 and the two-dimensional radiograph are only created when an object is present m the scan region 215
Referring to FIGS 3 and 4, an example process 300 that uses three- dimensional data and two-dimensional data to generate a high-resolution, two- dimensional image of an object of interest is illustrated The process 300 maybe performed by one or more processors included in a screening system such as the system 100 or the system 200 discussed above with respect to FIGS IA, IB, and 2 The two-dimensional image generated by the process 300 includes a representation of an object of interest but does not include a representation of clutter objects
A volumetric image 405 and a two-dimensional image 410 are acquired from the screening system (310) The volumetric image 405 and the two-dimensional radiograph 410 may be generated from sensed radiation as discussed above with respect to FIGS IA, IB, and 2 Referring also to FIG 4, the volumetric image 405 is a three-dimensional representation of a bag that is in the scan region 215 of the screening system, and the two-dimensional image 410 is a two-dimensional representation of the objects withm the bag The volumetric image 405 may be voxelized to the volumetric image 420, in which the geometπc objects 405A-405D represented m the volumetric image 405 are converted into voxel representations (e g , the objects 405A-405D are voxelized) A voxel is a cubic unit of volume that represents a unit of volume, and a voxel may be regarded as the counterpart to a pixel that represents a unit of area in a two-dimensional image The volumetric image 420 may be referred to as the voxelized reconstruction of the volumetπc image 405
The bag that is imaged in the example shown in FIG 4 includes four objects, a ball 405 A, a phone 405B, a personal digital assistant (PDA) 405C, and a plush toy 405D In this example, the ball 405A is the object of interest, and the phone 405B, the PDA 405C, and the plush toy 405D are considered clutter objects In other examples, there may be more than one object of interest and more or fewer clutter objects As shown in FIG 4, the volumetπc image 405 and the voxelized reconstruction 410 include perspective information regarding the relative placement of the objects 405 A-405D in the bag For example, the PDA 405C is m front of and slightly lower than the ball 405 A, and the phone 405B is above and to the left of the PDA 405C
In the two-dimensional radiograph 410, the objects 405A-405D overlap In contrast to the volumetnc image 405 and the voxelized reconstruction 420, the two- dimensional radiograph 410 does not show depth information Thus, in the two- dimensional radiograph 410, the phone 405B appears to overlap the ball 405 A, and the ball 405A appears to overlap the PDA 405C However, although the two- dimensional radiograph 410 does not show the relative placement of the objects in the bag, the two-dimensional radiograph 410 may be a higher spatial resolution image than the volumetric image 405 In other words, a pixel of the two-dimensional radiograph 410 may represent a smaller physical area than the a voxel of the voxehzed reconstruction 420 Thus, when displayed, the two-dimensional radiograph 410 may appear sharper and more detailed to a human operator as compared to a direct display of the voxehzed reconstruction 420 Similarly, when processed by an automated process, the two-dimensional radiograph 410 may provide more information, in some respects, than the voxehzed reconstruction 420 As discussed below, using the information in the voxehzed reconstruction 420, the clutter objects 405B-405D may be removed from the radiograph 410 to produce a two-dimensional image 450 of the entire ball 405A (e g , the object of interest) without the objects
405B-405D (e g , the clutter objects) The portions of the ball 405A that are obscured by the phone 405 A in the radiograph 410 become visible in the two-dimensional image 450 after the clutter objects 405B-405D are removed from the radiograph 410 because the representation in the radiograph 410 includes a summation of radiation from the ball 405A and the phone 405A Thus, when the portion that represents the phone 405A is removed, only the ball 405A remains in the image 450
The object of interest (e g , the ball 405A), is identified in the voxehzed reconstruction 420 (320) The object of interest may be identified using a variety of analysis techniques For example, objects of interest may be known to be round, and an edge detector followed by a filter to detect objects having round outlines may be applied to the volumetric image 405 to find round objects
Additionally or alternatively, material characteristics of the objects in the volumetπc image 405 may be used to identify possible objects of interest For example, in some secuπty applications, high-density materials (such as lead and metal) are more likely to be objects of interest than low-density materials (such as cloth) In the example shown in FIG 4, the volumetric image 405 includes voxels representing the bag and the objects 405A-405D within the bag The volumetπc image 405 may be created by sensing x-ray radiation that passed through the bag to a detector Thus, although the volumetπc image 405 includes data that represents the entire bag, only high-density materials are visible in the volumetπc image 405 Because the voxels representing the high-density materials are the voxels that most useful for determining whether the bag includes items of interest, the voxels representing the low-density matenals may be disregarded as clutter objects and the voxels representing high-density materials may be associated with an object of interest Specifically, the volumetric image may be a computed tomography (CT) image that includes voxels that represent an imaged object (such as the ball 405A, the phone 405B, the PDC 405C, and the plush toy 405D) The voxels are each associated with a value that approximately corresponds to the average atomic weight of the imaged object The voxel values may be represented as CT values The CT values may be expressed in Hounsfield units, and the voxel values may be a value relative to a value that represents an amount of energy passing through a known volume of water and sensed by an x-ray detector Items of interest from an explosives-detection (and the detection of other contraband items) perspective tend to have a higher density and a higher atomic number as compared to items not of interest (such as air and clothing) Thus, because items of interest tend to be high-density materials, a range of values known to be associated with high-density mateπals may be determined Voxels having values within the range of values, or above a value are voxels that may represent items of interest In contrast, low-density items, such as a cloth, may be represented by voxels that have values below the range of values known to be values of voxels that represent high- density mateπals Additionally, the values of the voxels of low-density items such as cloth and air tend to be much less than the values of voxels that represent high-density items of interest Although items of interest may be higher-density items, in some examples the items of interest may have a low-density than background voxels In these implementations, voxels having a range of values below the range of values are voxels that represent items of interest
Thus, the object of interest may be identified within the voxehzed reconstruction 420 Additionally, because the portions or regions of the voxehzed reconstruction 420 other than those that include the object of interest may be considered clutter, the clutter objects and regions are also identified
Referring to FIG 3, a localized region of the voxehzed reconstruction 420 that includes the identified object of interest is removed to create a de-objectified volumetric image 430 (330) The localized region of the voxehzed reconstruction 420 may include the identified object of interest and voxels in the neighborhood of the identified object of interest The neighborhood of the identified object of interest may be, for example, voxels within a boundary between the identified object of interest or voxels just outside of the boundary of the identified object of interest In some implementations, the neighborhood may include all voxels that fall within a region defined by the maximum and minimum spatial coordinates of the identified object of interest In this example, the region may be approximated by, for example, a circle, ellipse, or rectangle defined by the coordinates In some implementations, the neighborhood may include voxels that are adjacent to voxels that form a boundary of the identified object of interest and/or voxels that are connected to the identified object of interest The de-objectified volumetric image 430 is created by removing the identified object of interest (any the localized volume that includes the identified object of interest) from the voxehzed reconstruction 420 The identified object of interest may be removed by, for example, setting the voxels that make up the localized region that includes the object of interest to zero Thus, the identified object of interest (the ball 405 A in this example) is not represented in the de-objectified volumetnc image 430, but the clutter objects (the phone 405B, the PDA 405C, and the plush toy 405D) are represented in the de-objectified volumetnc image
The de-objectified volumetnc image 430 is forward projected to create a two- dimensional de-objectified image 440 (340) Forward projection refers to the projection of the data in the voxehzed reconstruction 420 onto a two-dimensional projection space The forward projection of the voxehzed reconstruction 420 may be considered to be the two-dimensional image that is perceived when viewing the voxehzed reconstruction 420 on a two-dimensional display Thus, the de-objectified volumetnc image is a two-dimensional image that includes representations of the clutter objects 405B-405D, but does not include a representation of the object of interest 405 A (e g , the ball)
The de-objectified two-dimensional image 440 and the acquired two- dimensional radiograph 410 are compared (350) such that the clutter objects are removed from the acquired two-dimensional radiograph 410 Comparing the de- objectified two-dimensional image 440 and the two-dimensional radiograph 410 may include subtracting the de-objectified two-dimensional image 440 from the two- dimensional radiograph 410 (or visa versa) As shown in FIG 4, the de-objectified two-dimensional image 440 includes the phone 405B, the PDA 405C, and the plush toy 405D (the clutter objects) but not the ball 405A (the object of interest) Thus, subtracting the de-objectified two-dimensional image 440 from the two-dimensional radiograph 410 results in the clutter objects being removed from the two-dimensional radiograph 410 Pπor to subtracting or otherwise comparing the de-objectified two- dimensional image 440 and the acquired two-dimensional radiograph 410, the de- objectified two-dimensional image 440 and the two-dimensional radiograph 410 are registered such that the clutter objects and the object of interest align in the two images In some implementations, instead of identifying the object of interest, the clutter objects and/or clutter regions may be identified m the voxehzed reconstruction The identified clutter objects or clutter regions may be forward-projected and removed from the two-dimensional radiograph
In some implementations, the two-dimensional radiograph 410 may be processed before the removal of the clutter objects 405B-405D For example, a low- pass filter may be applied to everything outside of the boundaries of the object of interest Thus, the low-pass filter is not applied to the object of interest, but the filter is applied to the clutter objects Application of the low-pass filter may help to reduce or eliminate the occurrence of high-frequency "ghosts" that may otherwise appear in the two-dimensional radiograph In some implementations, in addition to, or instead of, processing the two-dimensional radiograph 410 with the low-pass filter, the de- objectified image 440 may be processed with the low-pass filter
A two-dimensional image 450 of the object of interest is generated based on the comparison (360) As shown in FIG 4, the two-dimensional image 450 includes a the ball 405A (e g , the object of interest), but not the phone 405B, the PDA 405C, or the plush toy 405D (e g , the clutter objects) In some implementations, the two- dimensional image 450 is the two-dimensional radiograph 410 with the clutter objects removed In some implementations, the two-dimensional image 450 is a separate image that is generated from the two-dimensional image 410 Thus, a high- resolution, two-dimensional image that includes a representation of the object of interest without the clutter objects is generated In some implementations, low-resolution, two-dimensional radiographs that include only the object of interest may be created instead of high-resolution two- dimensional radiographs In these implementations, the volumetric neighborhood of the object of interest identified in (320, 330) discussed above is forward projected to create a two-dimensional image of the object of interest Because the voxels in the volumetnc neighborhood are from the relatively low-resolution voxehzed image 420, this technique tends to produce an image with pixels that represent a larger area than the pixels of the two-dimensional radiograph 410 Thus, this implementation may produce a lower spatial resolution image of the object of interest as compared to the image 450 discussed above However, this implementation may result in a faster throughput
A number of implementations have been descπbed Nevertheless, it will be understood that various modifications may be made without departing from the scope of the disclosure For example, multiple volumetnc images (such as the volumetnc image 108) and/or multiple two-dimensional radiographs (such as the two- dimensional radiograph 109) may be produced by the screening device 101 Each of the multiple volumetnc images and the two-dimensional radiographs may represent a different portion of the scan region 112 Accordingly, other implementations are within the scope of the following claims

Claims

WHAT IS CLAIMED IS
1 A mateπals screening system comprising a scan region configured to receive an object, a source of radiation configured to illuminate the scan region, a sensor configured to sense radiation from the scan region, a processor, a computer-readable storage medium stoπng instructions for generating a two- dimensional image of the object of interest, the instructions, when executed, cause the processor to perform the following generate a volumetric image of the scan region based on the sensed radiation, the volumetric image including a representation of an object of interest and another object, generate a two-dimensional radiograph of the scan region based on the sensed radiation, the two-dimensional radiograph including a representation of the object of interest and the other object, analyze the volumetπc image to identify the object of interest or the other object, based on the analyzed volumetπc image, generate a two-dimensional image that excludes the object of interest, compare the two-dimensional radiograph and the two-dimensional image that excludes the identified object of interest, and generate a two-dimensional image based on the comparison, the two- dimensional image including the object of interest and excluding the other object
2 The system of claim 1, wherein the source is configured to produce x-ray radiation, and the sensor is configured to sense x-ray radiation
3 The system of claim 1 , wherein the volumetπc image is analyzed to identify the object of interest, and further compπsmg removing the identified object of interest from the volumetπc image to generate a de-objectified volumetπc image 4 The system of claim 3, wherein the instructions to cause the processor to generate a two-dimensional image that excludes the object of interest include instructions to forward-projecting the de-objectified volumetric image
5 The system of claim 1 , wherein the instructions to cause the processor to compare the two-dimensional radiograph and the two-dimensional image that excludes the identified object of interest are instructions to cause the processor to subtract the two-dimensional radiograph from the two-dimensional image
6 The system of claim 1 , further compπsing a display module
7 An apparatus for generating images of an object of interest, the apparatus composing a source of radiation configured to emit radiation that illuminates a space and interacts with an object of interest in the space and another object in the space, a sensor configured to sense radiation from the space, a processor, and a computer-readable storage medium stonng instructions for generating a two- dimensional image of the object of interest, the instructions, when executed, cause the processor to perform the following acquire sensed data from the sensor to generate a two-dimensional radiograph of the space, the two-dimensional radiograph including a representation of the object of interest and a representation the other object, acquire sensed data from the sensor to generate a volumetric image of the space, the volumetπc image being of lower spatial resolution than the two- dimensional radiograph, and the volumetπc image including a representation of the object of interest and a representation of the other object, and generate a two-dimensional image from the two-dimensional radiograph and the volumetπc image, the two-dimensional image including the object of interest and excluding the other object 8 The apparatus of claim 7, wherein the source of radiation is a source of x-ray radiation, and the sensor configured to sense radiation compπses a detector configured to sense x-ray radiation passing through the object of interest and the other object
9 The apparatus of claim 7, wherein the space is a cavity in a screening apparatus configured to image an object in the cavity
10 The apparatus of claim 7, wherein the space is an open region that is illuminated by the source of radiation
11 A method for generating an image of an object of interest, the method comprising acquiring, from an imaging system, a volumetric image of a space, the space including an object of interest and another object and the volumetric image including data representing the object of interest and the other object, acquiring, from the imaging system, a two-dimensional radiograph of the space, the two-dimensional radiograph of the space including data representing the object of interest and the other object, comparing, at the imaging system, the two-dimensional radiograph and the volumetric image, and generating a two-dimensional image based on the comparison, the generated two-dimensional image including the object of interest and excluding the other object
12 The method of claim 11, further comprising presenting the generated two- dimensional image
13 The method of claim 11 , further composing identifying the object of interest in the volumetnc image, generating a de-objectified image by removing the object of interest from the volumetnc image, and wherein companng the two-dimensional radiograph and the volumetric image is companng the de-objectified image to the two-dimensional radiograph
14 The method of claim 13, wherein the de-objectified image is a two-dimensional image that excludes the object of interest, and companng the two-dimensional radiograph and the volumetnc image compnses subtracting the de-objectified image from the two-dimensional radiograph
15 The method of claim 14, further compnsing registering the de-objectified two- dimensional image and the acquired two-dimensional radiograph pnor to subtracting the de-objectified two-dimensional image from the acquired two-dimensional radiograph
16 The method of claim 13, further composing filtenng the de-objectified two- dimensional image
17 The method of claim 13, wherein the identified object of interest is represented m the volumetnc image by one or more voxels, and removing the identified object of interest from the volumetnc image includes setting the one or more voxels equal to zero
18 The method of claim 11 , wherein the acquired two-dimensional radiograph has a higher spatial resolution than the acquired volumetnc image
19 The method of claim 11, wherein at least a portion of the object of interest obscures at least a portion of the other object in the acquired two-dimensional radiograph
20 The method of claim 9, further comprising repeatedly acquiring two- dimensional radiographs and comparing each of the two-dimensional radiographs to the volumetric image
PCT/US2009/039192 2008-04-03 2009-04-01 Generating a representation of an object of interest WO2009124141A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
ES09726675T ES2722850T3 (en) 2008-04-03 2009-04-01 Generation of a representation of an object of interest
EP09726675.3A EP2269162B1 (en) 2008-04-03 2009-04-01 Generating a representation of an object of interest

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US4219208P 2008-04-03 2008-04-03
US61/042,192 2008-04-03

Publications (1)

Publication Number Publication Date
WO2009124141A1 true WO2009124141A1 (en) 2009-10-08

Family

ID=41133285

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/039192 WO2009124141A1 (en) 2008-04-03 2009-04-01 Generating a representation of an object of interest

Country Status (4)

Country Link
US (4) US7885380B2 (en)
EP (1) EP2269162B1 (en)
ES (1) ES2722850T3 (en)
WO (1) WO2009124141A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2443441B1 (en) * 2009-06-15 2017-10-11 Optosecurity Inc. Method and apparatus for assessing the threat status of luggage

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8804899B2 (en) * 2003-04-25 2014-08-12 Rapiscan Systems, Inc. Imaging, data acquisition, data transmission, and data distribution methods and systems for high data rate tomographic X-ray scanners
ES2722850T3 (en) * 2008-04-03 2019-08-19 L 3 Communications Security And Detection Systems Inc Generation of a representation of an object of interest
EP2331944B1 (en) 2008-09-05 2014-03-12 Optosecurity Inc. Method and system for performing x-ray inspection of a liquid product at a security checkpoint
WO2010091493A1 (en) * 2009-02-10 2010-08-19 Optosecurity Inc. Method and system for performing x-ray inspection of a product at a security checkpoint using simulation
WO2011011894A1 (en) 2009-07-31 2011-02-03 Optosecurity Inc. Method and system for identifying a liquid product in luggage or other receptacle
CN103026214B (en) * 2010-02-26 2016-05-25 拉皮斯坎系统股份有限公司 The removable checkpoint system of one
WO2013173342A2 (en) * 2012-05-14 2013-11-21 Michael Tomkins Systems and methods of object recognition within a simulation
US9589188B2 (en) * 2012-11-14 2017-03-07 Varian Medical Systems, Inc. Method and apparatus pertaining to identifying objects of interest in a high-energy image
MY177646A (en) * 2014-02-28 2020-09-23 Icm Airport Technics Australia Pty Ltd Luggage processing station and system thereof
MX361149B (en) 2014-03-07 2018-11-28 Rapiscan Systems Inc Ultra wide band detectors.
US11280898B2 (en) 2014-03-07 2022-03-22 Rapiscan Systems, Inc. Radar-based baggage and parcel inspection systems
MX2017006913A (en) 2014-11-25 2017-11-30 Rapiscan Systems Inc Intelligent security management system.
US10345479B2 (en) 2015-09-16 2019-07-09 Rapiscan Systems, Inc. Portable X-ray scanner
CA3022215C (en) 2016-05-06 2024-03-26 L3 Security & Detection Systems, Inc. Systems and methods for generating projection images
FR3092187B1 (en) * 2019-01-30 2021-04-30 Alessandro Manneschi Luggage detector
CN111832433B (en) * 2020-06-24 2023-12-29 奇点微(上海)光电科技有限公司 Device for extracting object characteristics from image and working method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060187221A1 (en) * 2005-02-22 2006-08-24 Sarang Lakare System and method for identifying and removing virtual objects for visualization and computer aided detection
US20070172129A1 (en) * 2005-04-07 2007-07-26 L-3 Communications Security And Detection Systems, Inc. Method of registration in a contraband detection system
US20070297560A1 (en) * 2006-03-03 2007-12-27 Telesecurity Sciences, Inc. Method and system for electronic unpacking of baggage and cargo
US20080013819A1 (en) * 2004-11-10 2008-01-17 L-3 Communications Security And Detection Systems, Inc. Reconstruction of X-ray images into basis function components using multiple-energy sources

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6816571B2 (en) * 2002-02-06 2004-11-09 L-3 Communications Security And Detection Systems Corporation Delaware Method and apparatus for transmitting information about a target object between a prescanner and a CT scanner
US7672426B2 (en) * 2002-12-04 2010-03-02 Varian Medical Systems, Inc. Radiation scanning units with reduced detector requirements
US7587082B1 (en) * 2006-02-17 2009-09-08 Cognitech, Inc. Object recognition based on 2D images and 3D models
ES2722850T3 (en) * 2008-04-03 2019-08-19 L 3 Communications Security And Detection Systems Inc Generation of a representation of an object of interest

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080013819A1 (en) * 2004-11-10 2008-01-17 L-3 Communications Security And Detection Systems, Inc. Reconstruction of X-ray images into basis function components using multiple-energy sources
US20060187221A1 (en) * 2005-02-22 2006-08-24 Sarang Lakare System and method for identifying and removing virtual objects for visualization and computer aided detection
US20070172129A1 (en) * 2005-04-07 2007-07-26 L-3 Communications Security And Detection Systems, Inc. Method of registration in a contraband detection system
US20070297560A1 (en) * 2006-03-03 2007-12-27 Telesecurity Sciences, Inc. Method and system for electronic unpacking of baggage and cargo

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2443441B1 (en) * 2009-06-15 2017-10-11 Optosecurity Inc. Method and apparatus for assessing the threat status of luggage

Also Published As

Publication number Publication date
US8712008B2 (en) 2014-04-29
US20110129064A1 (en) 2011-06-02
EP2269162A1 (en) 2011-01-05
EP2269162B1 (en) 2019-01-23
US20140185756A1 (en) 2014-07-03
US20090252295A1 (en) 2009-10-08
ES2722850T3 (en) 2019-08-19
EP2269162A4 (en) 2017-04-05
US7885380B2 (en) 2011-02-08
US20140079283A1 (en) 2014-03-20
US8457273B2 (en) 2013-06-04

Similar Documents

Publication Publication Date Title
US7885380B2 (en) Generating a representation of an object of interest
AU2008283828B2 (en) Reducing latency in a detection system
US8005189B2 (en) Suitcase compartmentalized for security inspection and system
EP2676128B1 (en) System and method for multi-scanner x-ray inspection
US9390523B2 (en) Determination of z-effective value for set of voxels using CT density image and sparse multi-energy data
US8180139B2 (en) Method and system for inspection of containers
US10697903B2 (en) Combined image generation of article under examination and image of test item
US8254656B2 (en) Methods and system for selective resolution improvement in computed tomography
US11436735B2 (en) Three-dimensional object image generation
EP1875276B1 (en) Energy distribution reconstruction in ct
EP2227709B1 (en) System and method for inspecting containers for target material
US20080123895A1 (en) Method and system for fast volume cropping of three-dimensional image data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09726675

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2009726675

Country of ref document: EP