WO2017035032A1 - System and method for gesture activated responder lighting and information center - Google Patents

System and method for gesture activated responder lighting and information center Download PDF

Info

Publication number
WO2017035032A1
WO2017035032A1 PCT/US2016/047915 US2016047915W WO2017035032A1 WO 2017035032 A1 WO2017035032 A1 WO 2017035032A1 US 2016047915 W US2016047915 W US 2016047915W WO 2017035032 A1 WO2017035032 A1 WO 2017035032A1
Authority
WO
WIPO (PCT)
Prior art keywords
lighting
wrist
assembly
gesture
responder
Prior art date
Application number
PCT/US2016/047915
Other languages
French (fr)
Inventor
Henry J. WERRONEN
Isamu G. NAKAGAWA
Original Assignee
Extinqual Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Extinqual Inc. filed Critical Extinqual Inc.
Publication of WO2017035032A1 publication Critical patent/WO2017035032A1/en
Priority to US15/901,302 priority Critical patent/US20180233019A1/en

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/04Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438Sensor means for detecting
    • G08B21/0453Sensor means for detecting worn on the body to detect health condition by physiological monitoring, e.g. electrocardiogram, temperature, breathing
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/182Level alarms, e.g. alarms responsive to variables exceeding a threshold
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/016Personal emergency signalling and security systems
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/10Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B27/00Alarm systems in which the alarm condition is signalled from a central station to a plurality of substations
    • G08B27/001Signalling to an emergency team, e.g. firemen

Definitions

  • the present invention is a system and method for a programmable, gesture- activated lighting and information system for use by firefighters, police, rescue workers, military, miners, and others in emergency/high risk situations (collectively, "First Responders").
  • First Responders operate in a challenging environment that is often not only dark, but also often smoky, wet, noisy and lacking a floor plan or map. Operating in dark and smoky conditions, it is often difficult for First Responders (i) to see their team member ahead of them and know the direction they are going, (ii) to know if there is a potentially dangerous situation ahead and/or (iii) to know if the team needs to exit to replenish its supply of oxygen. As such, providing light in the space surrounding First Responders, in all directions, is critical for their safety and for their goal of protecting victims and property.
  • First Responders are often carrying other tools and equipment, such as a fire hose or axe, the ability to operate a hands-free lighting system overcomes the need to hold a separate flashlight that would otherwise limit overall effectiveness.
  • radio or smart device communication is not possible for First Responders in many cases; moreover, when First Responders are wearing an oxygen mask, it is not possible for them to call out to other members of their team.
  • a non- verbal communication system in the form of light sequences - which respond to user commands and sensor indications of hazardous conditions - is desirable.
  • the invention is an integrated and programmable, gesture-activated lighting and information system and related method that address the needs of First Responders, in dangerous and dark conditions, for (i) hands-free light, (ii) improved communications, and (iii) activity and data recordation.
  • the system of the invention is configured to communicate wirelessly with an incident control center, and the system includes (1) a responder information center that acts to receive and record information and data from First Responder, and (2) a responder lighting and information system.
  • the responder lighting and information system includes, for each First Responder user, (a) a wrist lighting assembly with area lights and at least one environmental sensor that mounts on one or both of the gloved hands of the First Responder and, through gestures and motions of the gloves, generates corresponding predetermined gesture patterns; (b) a belt assembly with lights and, optionally, at least one environmental sensor that is attached to the rear of the First Responder, preferably on his/her jacket; and (c) a programmable smart phone or similar device that is configured to communicate with the wrist lighting assembly and belt assembly of the same First Responder user, smart devices associated with other First Responder users, the incident command center, and the responder information center.
  • gesture patterns are communicated from the wrist lighting assembly to the smart device
  • data from the environmental sensors of the lighting wrist assembly and belt assembly is communicated to the smart device and, from the smart device, to the incident command center
  • the smart device processes the gesture patterns and sensor data and generates lighting activation and/or sequence commands to the wrist lighting assembly and belt assembly and corresponding messages to the incident command center.
  • sensor data such as an indication from a heat sensor that temperature has reached a certain level or increased over a predetermined range in a predetermined period of time, can trigger warning lights on the wrist lighting assembly and a warning light sequence on the belt assembly.
  • the lighting activation and pattern commands can activate the lights on the wrist lighting assembly and belt assembly and can generate light sequences on the belt assembly, with these sequences providing for gesture-based interaction and associated visual communications between First Responders in their immediate area.
  • the system and method of the present invention allows each First Responder to generate predetermined light sequences, which signal corresponding message, on his/her belt assembly, and those light sequences will be seen by other First Responders located adjacently and in a position to view the light sequences.
  • Corresponding messages can also be sent to an incident commander at the incident control center outside the rescue scene.
  • the activities, as based on gesture patterns, and operating environment, as based on sensor data, of each First Responder, together with associated messages and warnings can be recorded at the responder information center.
  • each First Responder will have a responder lighting and information system, including a wrist lighting assembly, a belt assembly and an associated smart device.
  • This system allows First Responders to carry out their jobs without having to hold a separate flashlight.
  • the system is programmable, thus allowing for changes to specific gestures and features of the system.
  • the gesture-activated lighting and information system and method of the present invention is analogous to the lighting system of the automobile which has twin head lights, high and low beams, left and right turn signals on the front and rear, back up lights, and an emergency flasher.
  • the lighting system on the wristband component preferably contains a heat sensor to monitor the temperature and issue warnings if dangerous conditions exist, such as the threat of a flashover.
  • the lighting system on the belt component can contain other environmental sensors, such as, for example, a smoke measurement unit or a biometric sensor, to monitor and record conditions and to allow for emergency warnings.
  • the lights on the wristband component preferably include high and low beams in order to provide the best possible combination of direct light, flood light and smoke-penetrating light.
  • a First Responder By pointing the glove-mounted lights on either or both hands, a First Responder can easily light adjacent space up and down and from side to side, which overcomes the inherent limitations of helmet-mounted lights - which only illuminate in the direction a First Responder is facing and can have a restricted range when a First Responder is crawling on his/her hands and knees. For example, if a user has wrist lighting assemblies mounted on the glove of each hand, areas lighting can be directed in two separate directions. The operation of the belt- mounted lighting strip on the rear of the First Responder' s jacket allows team members to see where the First Responder ahead of them is going. It can also provide the capability for warning signals of a possible danger ahead or if the team needs to back up and exit to replenish its oxygen supply.
  • one of the most important warning signals that can be provided would be one that indicates a dangerous rise in the temperature of the fire - which would correspond to the threat of a flashover and the need for an immediate exit.
  • Other hazardous conditions and biometric data can also be monitored for purposes of providing appropriate warnings and messages.
  • the smart phone or similar device allows First Responders to send messages and communicate with other First Responders and team members in the immediate or adjacent area and also to relay messages to the incident command center, including the incident commander, outside the rescue scene.
  • the communications to the incident command center and incident commander can include, but are not limited to, sensor data such as the temperature at various points in the rescue scene, the relative position and movement of First Responders within the rescue scene, and particular messages, such as calls for emergency assistance.
  • the smart device While the system is providing all of these important operating capabilities, the smart device is automatically creating a time-stamped record of the activities of the First Responders and the operating conditions within the rescue scene.
  • the gesture patterns, together with associated movement signals and other messages, as well as sensor data from the smart devices, is assembled and stored in a data repository at the responder information center, which is made available to application programs by an application programming interface.
  • this "black box" recording and the related data management applications can be used for post-rescue reporting and analysis of the incident, health and safety exposure reporting, and as a tool for training and education.
  • FIGURE 1 is a master systems block diagram of the present invention.
  • FIGURE 2 is a block diagram of the responder lighting system and method of the present invention.
  • FIGURE 3 is a top view of one embodiment of the wrist lighting assembly of the present invention.
  • FIGURE 3A is a front view of one embodiment of the wrist lighting assembly of the present invention.
  • FIGURE 3B is a front view of one embodiment of the wrist lighting assembly of the present invention.
  • FIGURE 4 is a block diagram of one embodiment of the internal components of the wrist lighting assembly of the present invention.
  • FIGURE 5 is a front view of one embodiment of the belt assembly of the present invention.
  • FIGURE 6 is a diagram of the wrist lighting assembly gestures of one embodiment of the present invention.
  • FIGURE 7 is a block diagram showing the flow of communications between and among First Responders and an incident command center through use of the present invention.
  • FIGURE 8 is a block diagram showing the flow of communications between and among First Responders and a responder information center through use of the present invention.
  • the system and method of the present invention allows for the following capabilities: (a) the activation by gestures of lights on the wristband of one First Responder (including the ability to turn LED lights on and off and to switch between a high and low beam); (b) the activation by gestures of light sequences on the belt mounted on the rear of the First Responder' s jacket to visually communicate messages, including by way of examples the ability to indicate the Responder is making a left turn or a right turn, an alarm that an emergency situation exists, a signal that the group needs to move out, and a signal that the group needs to meet; (c) the ability for a First Responder to communicate with other Responders in the immediate or adjacent area (including the ability to activate warning lights and send visual signals as described above); (d) the ability to record the activities of each First Responder using the system and method of the present invention, including the movements of the First Responder, the activation of the wristband and belt lights, the visual communication signals generated to other responders
  • a preferred embodiment of the present invention provides a responder lighting and information system 10 including a responder lighting system 11 configured to wirelessly communicate with an existing incident command center 12, and a responder information center 20.
  • the Responder lighting and information system 10 provides First Responders and other users with several innovative and useful system capabilities.
  • the gesture-activated responder lighting system 11 provides a First Responder with a hands-free means to light up adjacent space, and to communicate environmental sensor data and signal movements and warnings to other users in the same immediate area and also to the incident command center 12.
  • the responder information center 20 acquires data captured by the responder lighting system 11 and assembles it in a data repository that, in turn, can be made available to application programs through an application programming interface.
  • FIGS. 2 and 3 illustrate the components of one preferred embodiment of the responder lighting system 11 which enable First Responders to make gestures to activate lights 14 on the wrist lighting assembly 13 mounted on either or both hands of each First Responder user and lights 16 mounted on the belt assembly 15, which, in turn, is preferably located on the rear of the First Responder' s jacket (not shown).
  • the number, color and type of lights 14 and 16 and their positioning on the wrist lighting assembly 13 and belt assembly 15, as well as the method of attaching them, may vary while preserving the functionality of the invention.
  • the wrist lighting assembly 13 and belt assembly 15 can also include sensors that assimilate various types of information and convey the information to smart device 17.
  • the smart device is located on the user, and, in a preferred embodiment, is held in a protective pocket on the inside of the jacket of the First Responder.
  • the smart device 17 can be replaced by a similar device and the smart device operating system may also vary, including but not limited to Android and iOS or other compatible operating systems. All of the components used in the invention are suitable for use in the various operating environments of First Responders. All of the components utilize existing or known hardware and software operating systems generally available and known to those with skill in the art. As described in further detail below, the smart device 17 enables First Responders and other users to communicate with each other and with the incident command center 12 and also with the responder information center 20 to record contextual information related to the incident and the health and safety of First Responders.
  • FIG. 3 shows the exterior of one preferred embodiment of the wrist lighting assembly 13 as viewed from the top, with FIG. 3 A showing a top view, FIG. 3B showing a front view, and FIG. 3C showing a back or rear view.
  • the wrist lighting assembly lights 14 are shown as light emitting diodes (LEDs) in FIG. 3, but can also be comprised of other light sources and/or a combination of light sources.
  • Lights 14 are used to illuminate the space around a First Responder' s space and also can indicate the status of lights 16 on the belt assembly 15 on the rear of the jacket of a First Responder. More specifically, light 14 can indicate whether the lights 16 on belt assembly 15 are on or off.
  • the lights 14 on the wrist lighting assembly 13 can be switched from high to low beam in a preferred embodiment, depending on the situation and environment.
  • the lights 14 on the wrist lighting assembly 13 are normally operated by gestures of the user, described below in connection with FIG. 6, but can also be operated manually by a switch and button assembly 23, including button 18 that operates the high/low beam options of lights 14 and switch 19 that turns lights 14 on and off.
  • the lighting system assembly 11 preferably is battery operated and can be recharged by means of a charging port 20.
  • the lighting system assembly 11 can also be connected to external power by power connector 21.
  • the embodiment of the wrist lighting assembly 13 shown in FIGS. 2 and 3 are attached to user's wrist by wristband 22. The size and positioning of the components on the wrist lighting assembly 13 and the method of attaching the assembly 13 to a user's wrist may vary while preserving the functionality of the invention.
  • FIG. 4 shows the interior of one preferred embodiment of the wrist lighting assembly 13, including lights 14 (shown, without limitation as LEDs), an inertial measurement unit 30 for gesture control and measuring motion of the lighting assembly 13 as well as movement of the associated user, a micro controller 31 for controlling the operation of the components of the light assembly 13, the switch and button assembly 23 for manual control of lights 14, a wireless transceiver 32 for wireless communication with belt assembly 15, a transmitter/receiver 33 for communication with smart device 17 worn by other First Responders, a battery 34, a battery boost converter 35 for recharging the battery 34, and one or more environmental sensors 36, such as temperature sensors, smoke detection and measurement sensors, and biometric data sensors.
  • lights 14 shown, without limitation as LEDs
  • an inertial measurement unit 30 for gesture control and measuring motion of the lighting assembly 13 as well as movement of the associated user
  • a micro controller 31 for controlling the operation of the components of the light assembly 13, the switch and button assembly 23 for manual control of lights 14
  • a wireless transceiver 32 for wireless communication with belt assembly
  • leads may be used to locate related sensor components on parts of the user's body, such as the inner wrist, to assist in measuring vital signs, such as heart rate.
  • Transmitter/receiver 33 can be an RC transmitter/receiver or other suitable device.
  • the components used in the wrist lighting assembly 13 are standard for operation of the invention and are known to those with skill in the art. As other methods of use are encountered, the number and type of components and lights and their positioning may vary while preserving the functionality of the invention.
  • the components are suitable for use in the operating environment of First Responders.
  • FIG. 5 shows one preferred embodiment of the components of the belt assembly 15, which include lights 16 (shown, without limitation, as multicolor LEDs), a battery 40, an optional transmitter/receiver 41 for wireless communication with the wrist lighting assemblies 14, one or more environmental sensors 42, such as smoke detection and measurement, and a micro controller 43 for controlling the operations of the components of the belt assembly.
  • the lights 16 are activated by movement and specific gestures of the wrist lighting assembly 13 in various predetermined colors, sequences and directions to provide predetermined left and right turn signals or various warnings signals such as backing up or emergency.
  • a predetermined gesture by a first user of the wrist lighting assembly 13 can operate to cause lights 16 to light in a sequenced pattern from right to left as seen by someone standing behind the first user.
  • the same gesture can act to operate a corresponding light pattern from lights 14 on wrist lighting assembly 13.
  • the number, type and positioning of lights 16 and sensors 42 on the belt assembly 15 and the method of attaching the components to the belt assembly 15 and attaching the belt assembly 15 to the First Responder's jacket or other garments may vary while preserving the functionality of the invention.
  • the sensors 42 can, again, vary and include, without limitation, temperature sensors, smoke detection and measurement sensors, and biometric data sensors.
  • Transmitter/receive 41 can be an RC transmitter/receiver or other suitable device.
  • the components of the belt assembly 15 are standard for operation of the invention and are known to those with skill in the art and may vary as the invention is adapted to other operating environments and user requirements.
  • differing types of message can be conveyed among and between First Responders and also an incident command center 12.
  • One message system exists through the predetermined gesture-activated patterns created by wrist movements of a user's wrist.
  • Lighting activation commands can cause (i) the lights
  • the warning signal on the lighting wrist assembly 13 can be a flashing high beam, while the warning signal for the lights 16 of the belt assembly
  • the lighting activation and lighting sequence commands are transmitted directly, as applicable, to both the lighting wrist assembly 13 and the belt assembly 15.
  • the lighting activation and lighting sequence commands are transmitted directly to the lighting wrist assembly 13 and, from there, by wireless communication to the belt assembly 15.
  • This communication pathway can also be reversed such that the lighting activation and lighting sequence commands are transmitted directly to the belt assembly 15 and, from there, by wireless communication to the lighting wrist assembly 13.
  • these same lighting activation commands can be conveyed between user smart devices 17 to activate the lights 14 and 16 of the responder lighting and information systems 11 of all users in the area to be activated in a similar manner.
  • the system and method of the present invention also generates messages through transmission of sensor data. More specifically, sensors 36 and 42 located, respectively, on the wrist lighting assembly 13 and the belt assembly 15 generate data that is transmitted to the user's smart device 17. Preferably, there is at least environmental sensor 36 or 42 - a heat sensor - that is located on either of both of the wrist lighting assembly 13 and belt assembly 15. Environmental data is processed by the smart device 17 and, if a dangerous condition is observed - such as a high temperature or rapid temperature rise - the smart device 17 generates a warning signal that is transmitted wirelessly to either or both of the wrist lighting assembly 13 and belt assembly 15.
  • This warning signal triggers the warning lights 14 and 16 described above, and this same warning signal can be conveyed to the smart devices 17 of other users to triggers similar warning lights 14 and 16 in their respective responder lighting systems 11. Again, if the warning signal is directed to either the wrist lighting assembly 13 or belt assembly 15, this receiving assembly retransmits the signal to the other assembly.
  • certain specific warning signals such as a flashover in a fire (with associated high heat) can be generated by the controller 31 or 43 of a particular assembly in order to directly trigger warning lights 14 and 16 in both assemblies (i.e., both the wrist lighting assembly 13 and belt assembly 15) and also to other First Responders in the adjacent area.
  • Warning messages and other commands associated with lighting sequences can also be generated by an incident commander and/or an incident command center 12 based on review of the activity information and sensor data that is transmitted wirelessly be each user to the incident control center 12.
  • Such messages and commands can be directed to the smart devices 17 of particular users or all users and the smart devices 17 can transmit the messages and commands to the wrist lighting assembly 13 and belt assembly 15 in the same manner as described above in connection with communications between First Responder users.
  • FIG. 6 shows examples of various types of predetermined gestures 50 - 59 of wrist lighting assembly 13, as mounted on a hand 25, that activate the operation of the lights 14 and 16, respectively, mounted on the wrist lighting assembly 13 and belt assembly 15.
  • the lighting assembly 13 can be mounted on the right or left hand of a user, and the lights 16 on belt assembly 15 and/or the lights 14 of lighting wrist assembly 13 are activated by gestures of a single hand 25.
  • Each of the gestures on FIG. 6 consists of two movements, reading from left to right as illustrated on FIG. 6.
  • gesture 51 corresponds to an upward movement of the wrist 51a followed immediately by a second upward movement of the same wrist 51b to activate or turn on the lights 14 of the wrist lighting assembly to a high beam and also to activate or turn on the lights 16 of belt assembly 15.
  • the lights 14 on the wrist lighting assembly 13 are switched from the high beam to the low beam; by repeating gesture 51 again, the lights 14 on the wrist lighting assembly 13 are switched from the low beam to the high beam.
  • Gesture 58 turns off lights 14 and 16 and corresponds to a downward movement of the wrist 58a followed immediately by a second downward movement of the same wrist 58b.
  • Gesture 50 activates the lights 16 on the right side of the belt assembly 15 to signal a right turn and corresponds to a right counterclockwise twist of the wrist 50a followed immediately by an upward wrist movement 50b.
  • Gesture 53 generates a similar right turn signal and corresponds to an upward movement of the wrist 53a followed immediately by right movement of the wrist 53b.
  • Gesture 52 activates the lights 16 on the left side of the belt assembly 15 to signal a left turn and corresponds to a left clockwise twist of the wrist 52a followed immediately by an upward wrist movement 52b.
  • Gesture 54 generates a similar left turn signal and corresponds to an upward movement of the wrist 54a followed immediately by a left movement of the wrist 54b.
  • Gesture 55 signals an alarm or emergency signal through a predetermined pattern and or sequence of lights 16 and corresponds to a right counterclockwise twist of the wrist 55a followed immediately by another right counterclockwise twist of the wrist 55b.
  • Gesture 56 also signals an alarm or emergency through a predetermined pattern and or sequence of lights 16 and corresponds to a left clockwise twist of the wrist 56a followed immediately by another left clockwise twist of the wrist 56b.
  • Gesture 57 signals a move out of the rescue scene and corresponds to a right counterclockwise twist of the wrist 57a followed immediately by a downward movement of the wrist 57b.
  • Gesture 59 signals, through a predetermined pattern and or sequence of lights 16, for the crew in the immediate vicinity to come together and corresponds to a left clockwise twist of the wrist 59a followed immediately by a downward movement of the wrist 59b.
  • the lighting system 11 is programmable, through the programming capabilities of a standard smart phone/device (through loaded custom applications to be developed by a user of responder lighting and information system 10) such that these gestures can be easily modified or supplemented. It is anticipated that the gestures may be modified from time to time based on operating environments and user requirements.
  • FIG. 7 illustrates the interaction of the responder lighting system 11 with an incident control center 12.
  • the upper portion of FIG. 7 illustrates the ability for one First Responder 60 to use the smart device 17 in his/her responder lighting system 11 to communicate with the smart devices 17 and associated responder lighting systems 11 of other adjacent First Responder users or crew members 61 and 62 who are within short range wireless connectivity (normally thirty feet). Crew members 61 and 62 may also be able to communicate directly depending on the distance between them.
  • this communication network allows for certain warning signals and/or messages to trigger warning lights as to the responder lighting systems 11 of all proximate First Responder users.
  • First Responder 60 can send a signal with flashing lights of the lighting system and method of the present invention to First Responders 61 and 62 located behind First Responder 60 to indicate, for example, an emergency or low-oxygen situation that requires the crew to evacuate immediately.
  • the lower portion of Fig. 7 illustrates the ability of responder lighting and information system 10 to communicate with the incident command center 12 outside the rescue scene via a wireless communications network using smart devices 17. Such communications may be used, for example, to track the relative location and status of responders through the inertial measurement unit, to create an approximate heat map of the rescue scene, and to send emergency signals in either direction.
  • FIG. 8 illustrates the interaction of the responder lighting system 11 with an incident control center 20.
  • FIG. 8 illustrates the components and functionality of the responder information center 20, which, like an airplane "black box", stores the activity and environmental data captured by the adaptable programming capability of the smart device 17 or other similar device that is an integral part of the responder lighting system 11.
  • the responder lighting and information system 10 is used with an Android device, but can also be programmed for other smart devices using iOS and other operating systems.
  • the data captured by the sensors 36 and 42 and smart device 17 during the operation of the responder lighting system 11 is recorded on the smart device 17 and assembled into a data repository 63.
  • the data repository 63 corresponds to a custom- designed data set to be developed and implemented by users of system 10 that includes, by way of example, the status and relative location of responders, temperature and other environmental data such as smoke, and biometric data such as heart rate.
  • This data can be accessed by application programs through an application programming interface (“API") 64 and a related data management system that incorporates standard software and is configured for development of data fields for storage and retrieval of desired First Responder information and data.
  • API 64 and associated data management system can vary in design, hardware and software, provided that the stored data can be used for real time decision support and for later analysis and educational purposes. In particular, this information can be used to improve operational procedures and for training purposes.
  • application programs and associated data fields may include, by way of example, but not limitation, location and movement of responders in relation to each other and the rescue scene, a temperature map of the fire scene over time, early warnings of imminent danger (in addition to warning messages generated otherwise by the user, the lighting wrist assembly and/or the incident control center), analytical reports of environmental data, and responder exposure to high temperature and smoke.

Abstract

The integrated and programmable, gesture-activated lighting and information system and related method is disclosed. This system and method is configured to communicate wirelessly with an incident control center, and includes a responder information center that acts to receive and record data from a first responder user at an emergency scene, and a responder lighting and information system. The responder lighting and information system includes (i) a wrist lighting assembly with at least one environmental sensor that, through wrist gestures by the user, generates corresponding predetermined gesture patterns; (ii) a belt assembly with lights; and (iii) a programmable smart device configured to communicate with the wrist lighting and belt assemblies of the same user, and also with other users, the incident command center, and the responder information center. Gesture patterns are processed to convey messages, through light sequences on the belt assembly. Sensor data also is processed to generate messages.

Description

SYSTEM AND METHOD FOR GESTURE ACTIVATED RESPONDER LIGHTING
AND INFORMATION CENTER CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is a PCT International Application claiming priority to U.S.
Provisional Application serial number 62/207,953 filed on August 21, 2015; U.S. Provisional Application serial number 62/277,004 filed on January 11, 2016; and U.S. Provisional Application serial number 62/322,431 filed on April 14, 2016, each incorporated by reference herein in its entirety.
FIELD OF THE INVENTION
[0002] The present invention is a system and method for a programmable, gesture- activated lighting and information system for use by firefighters, police, rescue workers, military, miners, and others in emergency/high risk situations (collectively, "First Responders").
BACKGROUND
[0003] First Responders operate in a challenging environment that is often not only dark, but also often smoky, wet, noisy and lacking a floor plan or map. Operating in dark and smoky conditions, it is often difficult for First Responders (i) to see their team member ahead of them and know the direction they are going, (ii) to know if there is a potentially dangerous situation ahead and/or (iii) to know if the team needs to exit to replenish its supply of oxygen. As such, providing light in the space surrounding First Responders, in all directions, is critical for their safety and for their goal of protecting victims and property. Since First Responders are often carrying other tools and equipment, such as a fire hose or axe, the ability to operate a hands-free lighting system overcomes the need to hold a separate flashlight that would otherwise limit overall effectiveness. In addition, it is critical for First Responders to be able to communicate with each other and the incident commander outside the immediate rescue scene at an incident command center in order to provide for their safety and effective operation. However, radio or smart device communication is not possible for First Responders in many cases; moreover, when First Responders are wearing an oxygen mask, it is not possible for them to call out to other members of their team. As such, a non- verbal communication system in the form of light sequences - which respond to user commands and sensor indications of hazardous conditions - is desirable. Finally, while operating in the challenging environments that First Responders encounter, it is virtually impossible to create an accurate record of the activity of First Responders and the conditions they are facing. A "black box" system that would automatically record their activities and the operating conditions inside the rescue scene therefore would be useful in protecting the health and safety of First Responders, in creating a post-rescue analysis of the incident and in providing a tool for training and education of First Responders.
BRIEF SUMMARY OF THE INVENTION
[0004] The invention is an integrated and programmable, gesture-activated lighting and information system and related method that address the needs of First Responders, in dangerous and dark conditions, for (i) hands-free light, (ii) improved communications, and (iii) activity and data recordation. In one preferred embodiment, the system of the invention is configured to communicate wirelessly with an incident control center, and the system includes (1) a responder information center that acts to receive and record information and data from First Responder, and (2) a responder lighting and information system. The responder lighting and information system, in turn, includes, for each First Responder user, (a) a wrist lighting assembly with area lights and at least one environmental sensor that mounts on one or both of the gloved hands of the First Responder and, through gestures and motions of the gloves, generates corresponding predetermined gesture patterns; (b) a belt assembly with lights and, optionally, at least one environmental sensor that is attached to the rear of the First Responder, preferably on his/her jacket; and (c) a programmable smart phone or similar device that is configured to communicate with the wrist lighting assembly and belt assembly of the same First Responder user, smart devices associated with other First Responder users, the incident command center, and the responder information center. In operation, (i) gesture patterns are communicated from the wrist lighting assembly to the smart device, (ii) data from the environmental sensors of the lighting wrist assembly and belt assembly is communicated to the smart device and, from the smart device, to the incident command center; and (iii) the smart device processes the gesture patterns and sensor data and generates lighting activation and/or sequence commands to the wrist lighting assembly and belt assembly and corresponding messages to the incident command center. In particular, sensor data, such as an indication from a heat sensor that temperature has reached a certain level or increased over a predetermined range in a predetermined period of time, can trigger warning lights on the wrist lighting assembly and a warning light sequence on the belt assembly. In addition, the lighting activation and pattern commands can activate the lights on the wrist lighting assembly and belt assembly and can generate light sequences on the belt assembly, with these sequences providing for gesture-based interaction and associated visual communications between First Responders in their immediate area. More specifically, the system and method of the present invention allows each First Responder to generate predetermined light sequences, which signal corresponding message, on his/her belt assembly, and those light sequences will be seen by other First Responders located adjacently and in a position to view the light sequences. Corresponding messages can also be sent to an incident commander at the incident control center outside the rescue scene. In addition, the activities, as based on gesture patterns, and operating environment, as based on sensor data, of each First Responder, together with associated messages and warnings can be recorded at the responder information center. In operation, each First Responder will have a responder lighting and information system, including a wrist lighting assembly, a belt assembly and an associated smart device. This system allows First Responders to carry out their jobs without having to hold a separate flashlight. The system is programmable, thus allowing for changes to specific gestures and features of the system.
[0005] The gesture-activated lighting and information system and method of the present invention is analogous to the lighting system of the automobile which has twin head lights, high and low beams, left and right turn signals on the front and rear, back up lights, and an emergency flasher. The lighting system on the wristband component preferably contains a heat sensor to monitor the temperature and issue warnings if dangerous conditions exist, such as the threat of a flashover. The lighting system on the belt component can contain other environmental sensors, such as, for example, a smoke measurement unit or a biometric sensor, to monitor and record conditions and to allow for emergency warnings. The lights on the wristband component preferably include high and low beams in order to provide the best possible combination of direct light, flood light and smoke-penetrating light. By pointing the glove-mounted lights on either or both hands, a First Responder can easily light adjacent space up and down and from side to side, which overcomes the inherent limitations of helmet-mounted lights - which only illuminate in the direction a First Responder is facing and can have a restricted range when a First Responder is crawling on his/her hands and knees. For example, if a user has wrist lighting assemblies mounted on the glove of each hand, areas lighting can be directed in two separate directions. The operation of the belt- mounted lighting strip on the rear of the First Responder' s jacket allows team members to see where the First Responder ahead of them is going. It can also provide the capability for warning signals of a possible danger ahead or if the team needs to back up and exit to replenish its oxygen supply. In this respect, one of the most important warning signals that can be provided would be one that indicates a dangerous rise in the temperature of the fire - which would correspond to the threat of a flashover and the need for an immediate exit. Other hazardous conditions and biometric data can also be monitored for purposes of providing appropriate warnings and messages.
[0006] As described above, the smart phone or similar device allows First Responders to send messages and communicate with other First Responders and team members in the immediate or adjacent area and also to relay messages to the incident command center, including the incident commander, outside the rescue scene. The communications to the incident command center and incident commander can include, but are not limited to, sensor data such as the temperature at various points in the rescue scene, the relative position and movement of First Responders within the rescue scene, and particular messages, such as calls for emergency assistance.
[0007] While the system is providing all of these important operating capabilities, the smart device is automatically creating a time-stamped record of the activities of the First Responders and the operating conditions within the rescue scene. The gesture patterns, together with associated movement signals and other messages, as well as sensor data from the smart devices, is assembled and stored in a data repository at the responder information center, which is made available to application programs by an application programming interface. By way of example, but not limitation, this "black box" recording and the related data management applications can be used for post-rescue reporting and analysis of the incident, health and safety exposure reporting, and as a tool for training and education. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Embodiments of the present invention will now be described, by way of example only, with references to the accompanying drawings for the purpose of illustrating the embodiments, and not for the purpose of limiting the invention, wherein:
[0009] FIGURE 1 is a master systems block diagram of the present invention.
[0010] FIGURE 2 is a block diagram of the responder lighting system and method of the present invention.
[0011] FIGURE 3 is a top view of one embodiment of the wrist lighting assembly of the present invention.
[0012] FIGURE 3A is a front view of one embodiment of the wrist lighting assembly of the present invention.
[0013] FIGURE 3B is a front view of one embodiment of the wrist lighting assembly of the present invention.
[0014] FIGURE 4 is a block diagram of one embodiment of the internal components of the wrist lighting assembly of the present invention.
[0015] FIGURE 5 is a front view of one embodiment of the belt assembly of the present invention.
[0016] FIGURE 6 is a diagram of the wrist lighting assembly gestures of one embodiment of the present invention.
[0017] FIGURE 7 is a block diagram showing the flow of communications between and among First Responders and an incident command center through use of the present invention.
[0018] FIGURE 8 is a block diagram showing the flow of communications between and among First Responders and a responder information center through use of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0019] Referring to the Figures 1-8, the system and method of the present invention, in one preferred embodiment, allows for the following capabilities: (a) the activation by gestures of lights on the wristband of one First Responder (including the ability to turn LED lights on and off and to switch between a high and low beam); (b) the activation by gestures of light sequences on the belt mounted on the rear of the First Responder' s jacket to visually communicate messages, including by way of examples the ability to indicate the Responder is making a left turn or a right turn, an alarm that an emergency situation exists, a signal that the group needs to move out, and a signal that the group needs to meet; (c) the ability for a First Responder to communicate with other Responders in the immediate or adjacent area (including the ability to activate warning lights and send visual signals as described above); (d) the ability to record the activities of each First Responder using the system and method of the present invention, including the movements of the First Responder, the activation of the wristband and belt lights, the visual communication signals generated to other responders, and the environmental sensor data measured on the wristband and belt sensors); (e) the ability to monitor sensor data and issue corresponding warnings or messages when a dangerous situation exists; (f) the ability of the smart phone device to communicate with smart phone devices in the First Responder network; (g) the ability of the smart phone device to relay messages in both directions between First Responders and the incident commander, using light signals to First Responders as based on analysis of sensor and activity data from each First Responder; and (h) the ability of the system to store First Responder activity and sensor data in the responder information center and to access this data for other applications, such as accident scene recreation and analysis and related training.
[0020] In view of the above, it will be seen that the several objectives of the invention and other advantageous results are obtained. As various changes are or can be made in the above system and method of use without departing from the scope of the invention, it is intended that all matter contained in the description above and below, or shown in the accompanying diagrams, shall be interpreted as illustrative and not in a limiting sense. Specifically, that it is anticipated that the invention may be adapted to meet a range of operating requirements encountered by a variety of Responders. [0021] Referring to FIGS. 1 and 2, a preferred embodiment of the present invention provides a responder lighting and information system 10 including a responder lighting system 11 configured to wirelessly communicate with an existing incident command center 12, and a responder information center 20. Responder lighting and information system 10 provides First Responders and other users with several innovative and useful system capabilities. The gesture-activated responder lighting system 11 provides a First Responder with a hands-free means to light up adjacent space, and to communicate environmental sensor data and signal movements and warnings to other users in the same immediate area and also to the incident command center 12. The responder information center 20 acquires data captured by the responder lighting system 11 and assembles it in a data repository that, in turn, can be made available to application programs through an application programming interface. Each of these capabilities is described in more detail in the supporting diagrams that follow.
[0022] FIGS. 2 and 3 illustrate the components of one preferred embodiment of the responder lighting system 11 which enable First Responders to make gestures to activate lights 14 on the wrist lighting assembly 13 mounted on either or both hands of each First Responder user and lights 16 mounted on the belt assembly 15, which, in turn, is preferably located on the rear of the First Responder' s jacket (not shown). The number, color and type of lights 14 and 16 and their positioning on the wrist lighting assembly 13 and belt assembly 15, as well as the method of attaching them, may vary while preserving the functionality of the invention. As described below, the wrist lighting assembly 13 and belt assembly 15 can also include sensors that assimilate various types of information and convey the information to smart device 17. The smart device is located on the user, and, in a preferred embodiment, is held in a protective pocket on the inside of the jacket of the First Responder. The smart device 17 can be replaced by a similar device and the smart device operating system may also vary, including but not limited to Android and iOS or other compatible operating systems. All of the components used in the invention are suitable for use in the various operating environments of First Responders. All of the components utilize existing or known hardware and software operating systems generally available and known to those with skill in the art. As described in further detail below, the smart device 17 enables First Responders and other users to communicate with each other and with the incident command center 12 and also with the responder information center 20 to record contextual information related to the incident and the health and safety of First Responders.
[0023] FIG. 3 shows the exterior of one preferred embodiment of the wrist lighting assembly 13 as viewed from the top, with FIG. 3 A showing a top view, FIG. 3B showing a front view, and FIG. 3C showing a back or rear view. The wrist lighting assembly lights 14 are shown as light emitting diodes (LEDs) in FIG. 3, but can also be comprised of other light sources and/or a combination of light sources. Lights 14 are used to illuminate the space around a First Responder' s space and also can indicate the status of lights 16 on the belt assembly 15 on the rear of the jacket of a First Responder. More specifically, light 14 can indicate whether the lights 16 on belt assembly 15 are on or off. The lights 14 on the wrist lighting assembly 13 can be switched from high to low beam in a preferred embodiment, depending on the situation and environment. The lights 14 on the wrist lighting assembly 13 are normally operated by gestures of the user, described below in connection with FIG. 6, but can also be operated manually by a switch and button assembly 23, including button 18 that operates the high/low beam options of lights 14 and switch 19 that turns lights 14 on and off. The lighting system assembly 11 preferably is battery operated and can be recharged by means of a charging port 20. The lighting system assembly 11 can also be connected to external power by power connector 21. The embodiment of the wrist lighting assembly 13 shown in FIGS. 2 and 3 are attached to user's wrist by wristband 22. The size and positioning of the components on the wrist lighting assembly 13 and the method of attaching the assembly 13 to a user's wrist may vary while preserving the functionality of the invention.
[0024] FIG. 4 shows the interior of one preferred embodiment of the wrist lighting assembly 13, including lights 14 (shown, without limitation as LEDs), an inertial measurement unit 30 for gesture control and measuring motion of the lighting assembly 13 as well as movement of the associated user, a micro controller 31 for controlling the operation of the components of the light assembly 13, the switch and button assembly 23 for manual control of lights 14, a wireless transceiver 32 for wireless communication with belt assembly 15, a transmitter/receiver 33 for communication with smart device 17 worn by other First Responders, a battery 34, a battery boost converter 35 for recharging the battery 34, and one or more environmental sensors 36, such as temperature sensors, smoke detection and measurement sensors, and biometric data sensors. In the case of biometric sensors, leads may be used to locate related sensor components on parts of the user's body, such as the inner wrist, to assist in measuring vital signs, such as heart rate. Transmitter/receiver 33 can be an RC transmitter/receiver or other suitable device. The components used in the wrist lighting assembly 13 are standard for operation of the invention and are known to those with skill in the art. As other methods of use are encountered, the number and type of components and lights and their positioning may vary while preserving the functionality of the invention. The components are suitable for use in the operating environment of First Responders.
[0025] FIG. 5 shows one preferred embodiment of the components of the belt assembly 15, which include lights 16 (shown, without limitation, as multicolor LEDs), a battery 40, an optional transmitter/receiver 41 for wireless communication with the wrist lighting assemblies 14, one or more environmental sensors 42, such as smoke detection and measurement, and a micro controller 43 for controlling the operations of the components of the belt assembly. In a preferred embodiment, the lights 16 are activated by movement and specific gestures of the wrist lighting assembly 13 in various predetermined colors, sequences and directions to provide predetermined left and right turn signals or various warnings signals such as backing up or emergency. For example, a predetermined gesture by a first user of the wrist lighting assembly 13 can operate to cause lights 16 to light in a sequenced pattern from right to left as seen by someone standing behind the first user. Similarly, the same gesture can act to operate a corresponding light pattern from lights 14 on wrist lighting assembly 13. The number, type and positioning of lights 16 and sensors 42 on the belt assembly 15 and the method of attaching the components to the belt assembly 15 and attaching the belt assembly 15 to the First Responder's jacket or other garments may vary while preserving the functionality of the invention. The sensors 42 can, again, vary and include, without limitation, temperature sensors, smoke detection and measurement sensors, and biometric data sensors. In the case of biometric sensors, leads may be used to locate related sensor components on parts of the user's body, such as near the heart or neck, to assist in measuring vital signs, such as heart rate. Transmitter/receive 41 can be an RC transmitter/receiver or other suitable device. The components of the belt assembly 15 are standard for operation of the invention and are known to those with skill in the art and may vary as the invention is adapted to other operating environments and user requirements. [0026] In conjunction with the smart device 17 of the system and method of the present invention, differing types of message can be conveyed among and between First Responders and also an incident command center 12. One message system exists through the predetermined gesture-activated patterns created by wrist movements of a user's wrist. Such movements are made with only one wrist and generate corresponding gesture patterns that are transmitted to the user's smart device 17 and processed by the smart device 17 to generate lighting activation and/or lighting sequence commands. The lighting activation and/or lighting sequence commands are then transmitted wirelessly back to the lighting wrist assembly 13 and/or belt assembly 15. Lighting activation commands can cause (i) the lights
14 and 16, respectively, of a user's lighting wrist assembly 13 and belt assembly 15 to turn on and off, (ii) the lights 14 of a user's lighting wrist assembly 13 to switch between high or low beams, and (iii) the lights 14 and 16, respectively, of a user's lighting wrist assembly 13 and belt assembly 15 to signal a warning. The warning signal on the lighting wrist assembly 13 can be a flashing high beam, while the warning signal for the lights 16 of the belt assembly
15 is a predetermined sequence, such as the flashing of a particular color or alternating colors. In one embodiment of the present invention, the lighting activation and lighting sequence commands are transmitted directly, as applicable, to both the lighting wrist assembly 13 and the belt assembly 15. In another embodiment, the lighting activation and lighting sequence commands are transmitted directly to the lighting wrist assembly 13 and, from there, by wireless communication to the belt assembly 15. This communication pathway can also be reversed such that the lighting activation and lighting sequence commands are transmitted directly to the belt assembly 15 and, from there, by wireless communication to the lighting wrist assembly 13. In a further alternative embodiment, these same lighting activation commands can be conveyed between user smart devices 17 to activate the lights 14 and 16 of the responder lighting and information systems 11 of all users in the area to be activated in a similar manner.
[0027] The system and method of the present invention also generates messages through transmission of sensor data. More specifically, sensors 36 and 42 located, respectively, on the wrist lighting assembly 13 and the belt assembly 15 generate data that is transmitted to the user's smart device 17. Preferably, there is at least environmental sensor 36 or 42 - a heat sensor - that is located on either of both of the wrist lighting assembly 13 and belt assembly 15. Environmental data is processed by the smart device 17 and, if a dangerous condition is observed - such as a high temperature or rapid temperature rise - the smart device 17 generates a warning signal that is transmitted wirelessly to either or both of the wrist lighting assembly 13 and belt assembly 15. This warning signal triggers the warning lights 14 and 16 described above, and this same warning signal can be conveyed to the smart devices 17 of other users to triggers similar warning lights 14 and 16 in their respective responder lighting systems 11. Again, if the warning signal is directed to either the wrist lighting assembly 13 or belt assembly 15, this receiving assembly retransmits the signal to the other assembly.
[0028] In a further alternative embodiment of the system and method of the present invention, certain specific warning signals, such as a flashover in a fire (with associated high heat), can be generated by the controller 31 or 43 of a particular assembly in order to directly trigger warning lights 14 and 16 in both assemblies (i.e., both the wrist lighting assembly 13 and belt assembly 15) and also to other First Responders in the adjacent area.
[0029] Warning messages and other commands associated with lighting sequences can also be generated by an incident commander and/or an incident command center 12 based on review of the activity information and sensor data that is transmitted wirelessly be each user to the incident control center 12. Such messages and commands can be directed to the smart devices 17 of particular users or all users and the smart devices 17 can transmit the messages and commands to the wrist lighting assembly 13 and belt assembly 15 in the same manner as described above in connection with communications between First Responder users.
[0030] FIG. 6 shows examples of various types of predetermined gestures 50 - 59 of wrist lighting assembly 13, as mounted on a hand 25, that activate the operation of the lights 14 and 16, respectively, mounted on the wrist lighting assembly 13 and belt assembly 15. The lighting assembly 13 can be mounted on the right or left hand of a user, and the lights 16 on belt assembly 15 and/or the lights 14 of lighting wrist assembly 13 are activated by gestures of a single hand 25. Each of the gestures on FIG. 6 consists of two movements, reading from left to right as illustrated on FIG. 6. By way of example, but not limitation, gesture 51 corresponds to an upward movement of the wrist 51a followed immediately by a second upward movement of the same wrist 51b to activate or turn on the lights 14 of the wrist lighting assembly to a high beam and also to activate or turn on the lights 16 of belt assembly 15. By repeating this gesture 51 the lights 14 on the wrist lighting assembly 13 are switched from the high beam to the low beam; by repeating gesture 51 again, the lights 14 on the wrist lighting assembly 13 are switched from the low beam to the high beam. Gesture 58 turns off lights 14 and 16 and corresponds to a downward movement of the wrist 58a followed immediately by a second downward movement of the same wrist 58b. Gesture 50 activates the lights 16 on the right side of the belt assembly 15 to signal a right turn and corresponds to a right counterclockwise twist of the wrist 50a followed immediately by an upward wrist movement 50b. Gesture 53 generates a similar right turn signal and corresponds to an upward movement of the wrist 53a followed immediately by right movement of the wrist 53b. Gesture 52 activates the lights 16 on the left side of the belt assembly 15 to signal a left turn and corresponds to a left clockwise twist of the wrist 52a followed immediately by an upward wrist movement 52b. Gesture 54 generates a similar left turn signal and corresponds to an upward movement of the wrist 54a followed immediately by a left movement of the wrist 54b. Gesture 55 signals an alarm or emergency signal through a predetermined pattern and or sequence of lights 16 and corresponds to a right counterclockwise twist of the wrist 55a followed immediately by another right counterclockwise twist of the wrist 55b. Gesture 56 also signals an alarm or emergency through a predetermined pattern and or sequence of lights 16 and corresponds to a left clockwise twist of the wrist 56a followed immediately by another left clockwise twist of the wrist 56b. Gesture 57 signals a move out of the rescue scene and corresponds to a right counterclockwise twist of the wrist 57a followed immediately by a downward movement of the wrist 57b. Gesture 59 signals, through a predetermined pattern and or sequence of lights 16, for the crew in the immediate vicinity to come together and corresponds to a left clockwise twist of the wrist 59a followed immediately by a downward movement of the wrist 59b. The lighting system 11 is programmable, through the programming capabilities of a standard smart phone/device (through loaded custom applications to be developed by a user of responder lighting and information system 10) such that these gestures can be easily modified or supplemented. It is anticipated that the gestures may be modified from time to time based on operating environments and user requirements.
[0031] FIG. 7 illustrates the interaction of the responder lighting system 11 with an incident control center 12. The upper portion of FIG. 7 illustrates the ability for one First Responder 60 to use the smart device 17 in his/her responder lighting system 11 to communicate with the smart devices 17 and associated responder lighting systems 11 of other adjacent First Responder users or crew members 61 and 62 who are within short range wireless connectivity (normally thirty feet). Crew members 61 and 62 may also be able to communicate directly depending on the distance between them. As described above, this communication network allows for certain warning signals and/or messages to trigger warning lights as to the responder lighting systems 11 of all proximate First Responder users. In addition, First Responder 60 can send a signal with flashing lights of the lighting system and method of the present invention to First Responders 61 and 62 located behind First Responder 60 to indicate, for example, an emergency or low-oxygen situation that requires the crew to evacuate immediately. The lower portion of Fig. 7 illustrates the ability of responder lighting and information system 10 to communicate with the incident command center 12 outside the rescue scene via a wireless communications network using smart devices 17. Such communications may be used, for example, to track the relative location and status of responders through the inertial measurement unit, to create an approximate heat map of the rescue scene, and to send emergency signals in either direction.
[0032] FIG. 8 illustrates the interaction of the responder lighting system 11 with an incident control center 20. In particular, FIG. 8 illustrates the components and functionality of the responder information center 20, which, like an airplane "black box", stores the activity and environmental data captured by the adaptable programming capability of the smart device 17 or other similar device that is an integral part of the responder lighting system 11. In one preferred embodiment, the responder lighting and information system 10 is used with an Android device, but can also be programmed for other smart devices using iOS and other operating systems. The data captured by the sensors 36 and 42 and smart device 17 during the operation of the responder lighting system 11 is recorded on the smart device 17 and assembled into a data repository 63. The data repository 63 corresponds to a custom- designed data set to be developed and implemented by users of system 10 that includes, by way of example, the status and relative location of responders, temperature and other environmental data such as smoke, and biometric data such as heart rate. This data can be accessed by application programs through an application programming interface ("API") 64 and a related data management system that incorporates standard software and is configured for development of data fields for storage and retrieval of desired First Responder information and data. The API 64 and associated data management system can vary in design, hardware and software, provided that the stored data can be used for real time decision support and for later analysis and educational purposes. In particular, this information can be used to improve operational procedures and for training purposes. In addition, the application programs and associated data fields that can be developed for use with the present invention may include, by way of example, but not limitation, location and movement of responders in relation to each other and the rescue scene, a temperature map of the fire scene over time, early warnings of imminent danger (in addition to warning messages generated otherwise by the user, the lighting wrist assembly and/or the incident control center), analytical reports of environmental data, and responder exposure to high temperature and smoke.
[0033] It will be understood that each of the elements of the invention described above, or two or more together, may also find a useful application in other types of applications differing from the types described above. While the invention has been illustrated and described above, it is not limited to the details shown, since it will be understood that various omissions, modifications, substitutions and changes in the forms and details of the system illustrated and its method of operation can be made by those skilled in the art without departing in any way from the spirit of the present invention.

Claims

CLAIMS What is claimed is:
1. A gesture-activated lighting and information system for use by one or more emergency scene first responders as users and that is configured to communicate wirelessly with an incident control center, the system comprising: a responder information center configured to receive and store data relating to the activities of, and the environmental conditions around, the users in an emergency scene; and a responder lighting system for use by each user, each responder lighting system comprising: at least one wrist lighting assembly mounted on the wrist of each user, the wrist lighting assembly comprising lights configured to provide area lighting and a warning signal, a power supply, a controller for controlling the operation of the components of the at least one lighting wrist assembly, an inertial measurement unit for tracking gesture movements of the wrist lighting assembly and user movement, a wireless transmitter for transmitting predetermined gesture movement patterns and user movement, and a receiver for receiving lighting sequence commands and warning messages; a belt assembly attached to the rear of each user comprising lights configured to project predetermined lighting sequences to convey corresponding visual messages, a power supply, a controller for controlling the operation of the components of the belt assembly, a receiver for receiving lighting sequence commands and warning messages; at least one environmental sensor and a transmitter for transmitting environmental sensor data located on either one of the at least one lighting wrist assembly and the belt assembly; a programmable smart device that communicates wirelessly with the wrist lighting assembly, the belt assembly, the incident command center, and the responder information center, whereby: the wrist lighting assembly transmits the predetermined gesture patterns wirelessly to the smart device, the smart device processes the predetermined gesture patterns and generates corresponding predetermined lighting sequence commands, the smart device transmits the predetermined lighting sequence commands wirelessly to the belt assembly, and the lights of the belt assembly project predetermined lighting sequences, corresponding to the predetermined lighting sequence messages, to other users positioned in viewing range of the belt assembly lights; data from the at least one environmental sensor is communicated wirelessly to the smart device, and, based on processing of the data, the smart device wirelessly communicates a warning message to the responder lighting system of each user to activate corresponding warning lights on the wrist lighting assemblies and belt assemblies of all users; data from the at least one environmental sensor is communicated wirelessly from the smart device to the incident control center, and, based on this data, the incident control center wirelessly communicates a warning message to the smart device of each user for wireless transmission to the responder lighting system of each user to activate corresponding warning lights on the wrist lighting assemblies and belt assemblies of all users in the adjacent area; the predetermined gesture patterns and movements of the user and the data from the at least one environmental sensor are communicated wirelessly to the smart device, and the smart device wirelessly communicates the gesture patterns and environmental sensor data to the responder information center for data storage, management and retrieval.
2. The gesture-activated light and information system of Claim 1, wherein the lights of lighting wrist assembly are configured to turn on and off and between high and low beams, and whereby gestures of the lighting wrist assembly are configured to turn the lights on and off and between high and low beams.
3. The gesture-activated light and information system of Claims 1 and 2, wherein the lighting wrist assembly further comprises a switch and button assembly for manually turning the lights of the lighting wrist assembly on and off and between high and low beams.
4. The gesture-activated light and information system of Claim 1, wherein the at least one environmental sensor is a heat sensor and the lighting wrist assembly or belt assembly on which the heat sensor is located further comprises a wireless transmitter/receiver for direct communication of a heat warning message to the smart devices of other users to activate corresponding warning lights on the wrist lighting assemblies and belt assemblies of all users.
5. The gesture-activated light and information system of Claim 1, wherein the at least one environmental sensor is selected from the group consisting of a heat sensor, a smoke detector, and a biometric sensor.
6. The gesture-activated light and information system of Claim 1, wherein at least one environmental sensor is located on the lighting wrist assembly and the belt assembly.
7. The gesture-activated light and information system of Claim 1, wherein the predetermined lighting sequences correspond to predetermined lighting sequence messages selected from the group consisting of turning right, turning left, backing up, warning, exit the scene, and the need for a team of first responder users to come together.
8. The gesture-activated light and information system of Claim 1, wherein the programmable smart device is configured to be reprogrammable to allow for modifications and additions to the predetermined gesture patterns, the predetermined lighting sequence commands and the predetermined lighting sequence.
9. The gesture-activated and information system of Claim 1, wherein the responder information center comprises a data repository and an application programming interface, and wherein the data received by the responder information center wherein the data in the responder information is retrieved for purposes of accident scene recreation, analysis and user training.
10. A method of using a gesture-activated lighting and information system for use by one or more emergency scene first responders as users and that is configured to communicate wirelessly with an incident control center, the system comprising: a responder information center configured to receive and store data relating to the activities of, and the environmental conditions around, the users in an emergency scene; and a responder lighting system for use by each user, each responder lighting system comprising: at least one wrist lighting assembly mounted on the wrist of each user, the wrist lighting assembly comprising lights configured to provide area lighting and a warning signal, a power supply, a controller for controlling the operation of the components of the at least one lighting wrist assembly, an inertial measurement unit for tracking gesture movements of the wrist lighting assembly and user movement, a wireless transmitter for transmitting predetermined gesture movement patterns and user movement, and a receiver for receiving lighting sequence commands and warning messages; a belt assembly attached to the rear of each user comprising lights configured to project predetermined lighting sequences to convey corresponding visual messages, a power supply, a controller for controlling the operation of the components of the belt assembly, a receiver for receiving lighting sequence commands and warning messages; at least one environmental sensor and a transmitter for transmitting environmental sensor data located on either one of the at least one lighting wrist assembly and the belt assembly; a programmable smart device that communicates wirelessly with the wrist lighting assembly, the belt assembly, the incident command center, and the responder information center, whereby, in operation, the method comprises the steps of: transmitting the predetermined gesture patterns wirelessly from the wrist lighting assembly to the smart device, processing the predetermined gesture patterns and generates corresponding predetermined lighting sequence commands by the smart device, transmitting the predetermined lighting sequence commands wirelessly from the smart device to the belt assembly, and projecting predetermined lighting sequences, corresponding to the predetermined lighting sequence messages, from the lights of the belt assembly to other users positioned in viewing range of the belt assembly lights; communicating data from the at least one environmental sensor wirelessly to the smart device, and, based on processing of the data, wirelessly communicating a warning message from the smart device to the responder lighting system of each user to activate corresponding warning lights on the wrist lighting assemblies and belt assemblies of all users; wirelessly communicating data generated by the at least one environmental sensor from the smart device to the incident control center, and, based on this data, wirelessly communicating a warning message from the incident control center to the smart device of each user for wireless transmission to the responder lighting system of each user to activate corresponding warning lights on the wrist lighting assemblies and belt assemblies of all users in the adjacent area; wirelessly communicating the predetermined gesture patterns and movements of the user and the data from the at least one environmental sensor to the smart device, and wirelessly communicating the gesture patterns, user movements and environmental sensor data from the smart device to the responder information center for data storage, management and retrieval.
11. The method of using the gesture-activated light and information system of Claim 10, wherein the lights of lighting wrist assembly are configured to turn on and off and between high and low beams, and the method further comprises the step of using gestures of the lighting wrist assembly to turn the lights on and off and between high and low beams.
12. The method of using the gesture-activated light and information system of Claims 10 and 11, wherein the lighting wrist assembly further comprises a switch and button assembly for manually turning the lights of the lighting wrist assembly on and off and between high and low beams, and the method further comprises the step of using the switch and button assembly to turn the lights on and off and between high and low beams.
13. The method of using the gesture-activated light and information system of Claim 10, wherein the at least one environmental sensor is a heat sensor and the lighting wrist assembly or belt assembly on which the heat sensor is located further comprises a wireless transmitter/receiver, and the method further comprises the step of direct communicating a heat warning message to the smart devices of other users to activate corresponding warning lights on the wrist lighting assemblies and belt assemblies of all users.
14. The method of using the gesture-activated light and information system of Claim 10, wherein the at least one environmental sensor is selected from the group consisting of a heat sensor, a smoke detector, and a biometric sensor.
15. The method of using the gesture-activated light and information system of Claim 10, wherein at least one environmental sensor is located on the lighting wrist assembly and the belt assembly.
16. The method of using the gesture-activated light and information system of Claim 10, wherein the predetermined lighting sequences correspond to predetermined lighting sequence messages selected from the group consisting of turning right, turning left, backing up, warning, exit the scene, and the need for a team of first responder users to come together.
17. The method of using the gesture-activated light and information system of Claim 10, wherein the method further comprises the step of reprogramming programmable smart device to allow for modifications and additions to the predetermined gesture patterns, the predetermined lighting sequence commands and the predetermined lighting sequence.
18. The method of using the gesture-activated and information system of Claim 10, wherein the responder information center comprises a data repository and an application programming interface.
19. The method of using a gesture-activated lighting and information system of Claim 10, wherein the method further comprises the step of retrieving the data in the responder information center for purposes of accident scene recreation, analysis and user training.
PCT/US2016/047915 2015-08-21 2016-08-19 System and method for gesture activated responder lighting and information center WO2017035032A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/901,302 US20180233019A1 (en) 2015-08-21 2018-02-21 System and method for operational and exposure information recording and gesture activated communication

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201562207953P 2015-08-21 2015-08-21
US62/207,953 2015-08-21
US201662277004P 2016-01-11 2016-01-11
US62/277,004 2016-01-11
US201662322431P 2016-04-14 2016-04-14
US62/322,431 2016-04-14

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/901,302 Continuation-In-Part US20180233019A1 (en) 2015-08-21 2018-02-21 System and method for operational and exposure information recording and gesture activated communication

Publications (1)

Publication Number Publication Date
WO2017035032A1 true WO2017035032A1 (en) 2017-03-02

Family

ID=58100827

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/047915 WO2017035032A1 (en) 2015-08-21 2016-08-19 System and method for gesture activated responder lighting and information center

Country Status (2)

Country Link
US (1) US20180233019A1 (en)
WO (1) WO2017035032A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2551172B (en) * 2016-06-08 2019-02-20 Sts Defence Ltd Predicting temperature rise event
US20190034716A1 (en) * 2017-12-28 2019-01-31 Intel Corporation Privacy-preserving demographics identification
US10325485B1 (en) * 2018-09-11 2019-06-18 Rockwell Automation Technologies, Inc. System or process to detect, discriminate, aggregate, track, and rank safety related information in a collaborative workspace
CN113439290A (en) * 2018-11-28 2021-09-24 华为技术有限公司 Emergency call based on vehicle-to-vehicle communication
IT202100029501A1 (en) * 2021-11-22 2023-05-22 Intellitronika S R L WEARABLE MONITORING, SIGNALING AND SAFETY APPARATUS

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7245216B2 (en) * 2002-07-02 2007-07-17 Tri-Sentinel, Inc. First responder communications system
US20120236031A1 (en) * 2010-02-28 2012-09-20 Osterhout Group, Inc. System and method for delivering content to a group of see-through near eye display eyepieces
US8665087B2 (en) * 2004-11-10 2014-03-04 Bae Systems Information And Electronic Systems Integration Inc. Wearable or portable device including sensors and an image input for establishing communications interoperability and situational awareness of events at an incident site
US20150179038A1 (en) * 2009-08-27 2015-06-25 Simon R. Daniel Systems, Methods and Devices for the Rapid Assessment and Deployment of Appropriate Modular Aid Solutions in Response to Disasters
US20150185837A1 (en) * 2013-12-27 2015-07-02 Kofi C. Whitney Gesture-based waking and control system for wearable devices
US20150206419A1 (en) * 2012-12-18 2015-07-23 Jeffrey Douglas Johnson Systems, devices and methods to communicate public safety information

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7245216B2 (en) * 2002-07-02 2007-07-17 Tri-Sentinel, Inc. First responder communications system
US8665087B2 (en) * 2004-11-10 2014-03-04 Bae Systems Information And Electronic Systems Integration Inc. Wearable or portable device including sensors and an image input for establishing communications interoperability and situational awareness of events at an incident site
US20150179038A1 (en) * 2009-08-27 2015-06-25 Simon R. Daniel Systems, Methods and Devices for the Rapid Assessment and Deployment of Appropriate Modular Aid Solutions in Response to Disasters
US20120236031A1 (en) * 2010-02-28 2012-09-20 Osterhout Group, Inc. System and method for delivering content to a group of see-through near eye display eyepieces
US20150206419A1 (en) * 2012-12-18 2015-07-23 Jeffrey Douglas Johnson Systems, devices and methods to communicate public safety information
US20150185837A1 (en) * 2013-12-27 2015-07-02 Kofi C. Whitney Gesture-based waking and control system for wearable devices

Also Published As

Publication number Publication date
US20180233019A1 (en) 2018-08-16

Similar Documents

Publication Publication Date Title
WO2017035032A1 (en) System and method for gesture activated responder lighting and information center
CN107407932B (en) Condition response indication assembly and method
US10154401B2 (en) Safety device utilizing a beacon
KR102547048B1 (en) Personal protective equipment, methods and articles
KR101282669B1 (en) Smart ware for preventing an accident on workshop
US7245216B2 (en) First responder communications system
KR102142510B1 (en) Automated detection of firefighter teams
CN109275097B (en) Indoor positioning and monitoring system based on UWB
US20180109740A1 (en) Thermal imaging system
US8212211B2 (en) System for protecting and/or guiding persons in dangerous situations
KR101339928B1 (en) Integrated wireless ship management system based on local information of worker
US20100081411A1 (en) Multifunctional telemetry alert safety system (MTASS)
Liu et al. Robot-assisted smart firefighting and interdisciplinary perspectives
CA3028331C (en) Location systems using short-range communications
WO2013012445A1 (en) User navigation guidance and network system
JP2014521846A (en) Safety helmet or headpiece with improved safety features
KR101513896B1 (en) Apparatus for distinguishing sensing emergency situation and system for managing thereof
CN104602140A (en) Mobile terminal and system for rescue
CN106132290B (en) Monitoring apparatus and monitoring system
CN109833047A (en) Information acquisition terminal, system and the helmet
TWI738484B (en) Indoor positioning system
KR102582490B1 (en) Apparatus and method for safety management
KR101377706B1 (en) Local information based wireless ship management system
KR102015243B1 (en) Light-emitting helmet
US11011040B2 (en) Electronic personal dosimeter smart accessory system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16839914

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16839914

Country of ref document: EP

Kind code of ref document: A1