MOBILITY HAND CONTROL DEVICE AND METHOD
CROSS-REFERENCE TO RELATED PATENT APPLICATION [0001] This application claims the benefit of and priority to U.S. Provisional Patent Application No. 60/524,607, filed November 24, 2003.
FIELD OF THE INVENTION
[0002] The present invention relates generally to interface devices that facilitate human interface with a system. More particularly, the invention relates to a hand control for an electronically-controlled vehicle mobility access system.
BACKGROUND OF THE INVENTION
[0003] Control systems are used extensively in many different industries to execute application programs and control various equipment. Such control systems generally include a computer or the like that typically displays a visual "environment" (e.g., equipment status, warning indications, etc.) to a user on a display screen or other visual output device. Users may interact with the equipment through the use of a human-computer interface device, such as a joystick, "joypad" button controller, mouse, trackball, stylus and tablet, or the like, that is connected to the control system via the computer. In response to a user input via the interface device, a user may control or otherwise effect changes to the equipment that are reflected in the displayed visual environment of the equipment.
[0004] Many control systems now incorporate user interface devices that provide haptic (e.g., tactile, vibratory, etc.) feedback to a user or operator of the control system. Haptic feedback is well known in the gaming field for enhancing a virtual reality between a game computer and a gamer. One commonly employed haptic feedback is vibratory-force feedback (i.e., a feedback signal that provides a user with a vibration or kinesthetic sensation), which may be coordinated with other provided sensory feedback, such as images on a video screen, audio, and the like. In a computerized virtual gaming environment for example, a user can grasp and move a device such as joystick, steering wheel, or the like, to control a virtual car. If the user drives the virtual car over a virtual bumpy surface displayed on a screen, the game computer, which receives inputs from the user device and updates the display relative to the user inputs, should provide control signals to feedback actuators
within, coupled to or otherwise proximate the user device or user so that the user experiences a virtual car-driving experience that is as realistic (e.g., bumpy) as possible.
[0005] Interface devices with sensory feedback actuators such as the foregoing may be employed outside of the gaming field to advantageously provide physical sensations to a visually impaired or other control system operator. Typically, motors or other actuators are coupled to the user interface device, and the computer system can thus convey physical sensations to the user in conjunction with other supplied sensory feedback (e.g., visual and/or audible) as the user is grasping, holding, touching or otherwise proximate to the interface device. In this way, interface devices can provide a whole new modality for human-computer interaction.
[0006] In the automotive field, the operation of major systems, such as the engine, transmission, emissions, and convenience-type devices such as power locks, windows and sliding doors have become computerized. These systems are now usually controlled, either entirely or in part, by a microcomputer or microprocessor. To comply with the Americans with Disabilities Act (ADA), many public and private vehicles are being equipped with auxiliary devices, which are also known as mobility access devices, such as wheelchair lifts and ramps. Such auxiliary devices provide access for mobility challenged persons to vehicles such as vans, busses, and the like. Control systems for such auxiliary devices have generally relied on various operator-assisted control systems that have proven to be generally deficient in providing an adequate user interface.
[0007] Currently available auxiliary devices such as vehicle wheelchair lifts and ramps rely on a hand control device with one or more actuators such as switches, buttons and the like that are hardwired back to the control circuitry (e.g., a circuit board or controller) for controlling the operation (e.g., deploy and stow) of the auxiliary device. To provide for safe operation of the auxiliary device, such foregoing hand control devices generally require an operator of the auxiliary device to continuously operate an actuator while visually monitormg and supervising the operation of the auxiliary device. Disadvantageously, these hand control devices are input only devices, and cannot provide feedback to the operator regarding system status or operation, for example unsafe operating conditions, malfunctions and the like.
Moreover, these hand control devices often directly actuate relay circuits and therefore are required to handle significant electrical currents, which represents another disadvantage.
[0008] In view of the foregoing, a user-input device that provides safe operation of an auxiliary device is desired. Further, it is desirable for the user-input device to provide a user or operator with one or more sensory (e.g., visual, audio, haptic) indications relative to a user input and a state of the auxiliary device.
SUMMARY OF THE INVENTION
[0009] A user interface device and method are provided for controlling the operation of a vehicle auxiliary device such as a wheelchair lift or ramp and providing one or more sensory indications to a user operating the vehicle auxiliary device. One embodiment of the user interface device includes a housing with an ergonomic form factor. The user interface device includes a local microprocessor and is linked to an auxiliary device controller, which includes a host microprocessor for controlling the operation of the auxiliary device. The user interface device may communicate with the host computer via a wired or wireless interface and the local microprocessor is operative to receive and process signals as well as output feedback signals independently of the host computer, thus freeing up resources on the host microprocessor.
[0010] The local microprocessor outputs a control signal to the host microprocessor relative to a user input for a requested operation of the auxiliary device and receives status signals relative to a state of the auxiliary device, response to the status signal from the host microprocessor, the local microprocessor may selectively disable or otherwise ignore one or more user inputs that would result in improper operation of the auxiliary device. Additionally, the device may include one or more sensory indicators for providing the user of the interface device with auxiliary device operational feedback, such as a malfunction or interlock warning. In one embodiment, the interface device includes a vibrating motor coupled with the local microprocessor for providing vibratory force feedback to the auxiliary device operator indicative of an unsafe condition, request of an unsafe auxiliary device operation, or the like.
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] FIG. 1 is a perspective view of an exemplary embodiment of a mobility hand control device;
[0012] FIG. 2 is a front view of the device of FIG. 1 shown with an exemplary mounting unit including a visual display;
[0013] FIG. 3 is a block diagram for the exemplary embodiment of FIG. 1 ;
[0014] FIGs. 4A and 4B are schematic diagrams illustrating exemplary circuits and components for implementing the exemplary embodiment of FIGs. 1-3; and
[0015] FIG. 5 is a block diagram of an exemplary control system that may employ the exemplary embodiment of FIGs. 1-3.
DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS
[0016] With reference to the figures and particularly FIG. 1, an exemplary user interface device for operating an auxiliary device such as a vehicle wheelchair lift or ramp is provided. As shown in FIG. 1 the user interface device is embodied by a hand control device 10 including a housing 11 with an ergonomic form factor. As shown the hand control housing 11 includes an upper portion 1 la, a lower portion 1 lb and a seal 1 lc that couples the upper and lower portions 1 la, 1 lb. One or more of the portions 11a, 1 lb and seal l ie may be made of a textured material to facilitate handling and use of the device 10. In the illustrated embodiment the portions 11a, 1 lb are formed or otherwise made of a translucent or opaque durable plastic material and the seal 1 lc is made of a ribbed or otherwise textured rubber material. The housing material should be very durable and resist the type of wear and abuse that might result from rough use or harsh environments. The material may have the durometer of a stiff rubber, which also provides a good gripping surface for the user or operator. A number of user-operable actuators such as buttons or switches are disposed on the device 10, particularly on the upper portion 1 la for manipulation by a user or operator of the auxiliary device. One embodiment of the hand control 10 may employ a laminated style keypad with buttons 12-18 embodied by four metal snap-domes that, when depressed, will short two circuit traces together. This snap-dome construction will give a reasonably good
tactile feel to the operator and provide a robust mechanical construction that can hold up to physical abuse. Alternatively, the buttons 12-18 may be or include individual contact microswitches or the like. As one can appreciate, the device 10 illustrated in FIG. 1 is used for operating a wheelchair lift or the like and includes buttons 12-18 that may be pressed to activate the raise, lower, stow and deploy functions of the lift, respectively. Other embodiments of the device 10 may be used to operate other auxiliary devices and, to that end, may include fewer or additional buttons as required for operation of the auxiliary device. Since the subject interface device 10 may be adapted for use with various different auxiliary devices, the terms "lift", "wheelchair lift", "ramp" and "wheelchair ramp" used herein are not meant to limit the device 10 for operation with a particular auxiliary device.
[0017] Further, as shown in FIG. 1, each button 12-18 may include an indicia relative to the functionality of the respective button. As illustrated, the device 10 includes indicia on each button 12-18 as well as indicia 12a-18a proximate each respective button 12-18. As can be appreciated, the indicia on each button may help the user or operator identify each button 12-18 without looking at the hand control device 10. For example, the button indicia may be embodied by symbols that are raised or depressed relative to the surface of the button. As shown, the proximate indicia 12a- 18a are embodied by words "UP", "DOWN", "FOLD" and "UNFOLD", respectively, corresponding to the function of each button 12-18. As will be explained in further detail hereinafter, the proximate indicia 12a- 18a maybe selectively illuminated to help the user or operator safely operate the lift by providing an indication of which button 12-18 is active and safe to press. In the center of the buttons 12-18, a status indicia 19 is provided. The status indicia 19 as shown may be embodied by a stylized logo, but may alternatively be a word, symbol or the like. Similar to the proximate indicia 12a- 18a, the status indicia 19 may be selectively illuminated to provide the user or operator with a visual status indication of the lift. As such, the status indicia 19 may have a first state that indicates a safe status of the lift (e.g., all interlocks are satisfied) and a second state that indicates an unsafe status of the lift (e.g., a malfunction, fault or an interlock not being satisfied). For example, in one exemplary embodiment of the device 10, the status indicia 19 may be illuminated in a first color (e.g., green) in the first state and a second color (e.g., red) in the second state. In another exemplary embodiment of the device 10, the status indicia 19 may have a single color light that is constantly illuminated in the first state and flashes or strobes in the second state. In various embodiments, the hand control housing 11, or a
portion thereof, may be made of a translucent material so that an internal lighting scheme may be employed in addition to or instead of the status indicia 19.
[0018] As previously mentioned, the hand control 10 may operate a lift or ramp and includes features that remind the lift or ramp operator or user which controls are active at any particular point in the operation of the lift or ramp, and in cooperation with an auxiliary device controller that prevents unsafe operation of the auxiliary device, warn the operator or user when an unsafe condition is detected. For example, referring now to FIG. 4, a controller, control module, computer or the like as indicated by reference number 112 may operate to disable the lift from operating if a lift user is improperly positioned on a lift platform before or during a requested lift operation. Such a safety feature is known as an "interlock" in the art. Generally, in operating an interlock, the controller 112 receives a user input requesting the activation of an auxiliary device function (e.g., raise, lower, stow, deploy) from the hand control device indicated by reference number 114, checks the outputs of one or more sensors (not shown) relative to the requested function and allows or prevents the activation of the requested auxiliary device function. If, when checking the one or more sensor outputs, the conditions of an interlock are not satisfied, the controller 112 may output an indication thereof in the form of a visual, audible or other sensory warning. As previously mentioned, the status indicia 19 may illuminate, flash, strobe, change color or the like to provide a visual warning. Further, as shown in FIG. 2, the hand control device 10 may be accompanied by a mount 40 that may facilitate installation and use of the device 10. For example, the mount 40 may be attached to the vehicle's dash, door liner or any other suitable location within the vehicle for use by the user or operator of the auxiliary device. The hand control device 10 may be used when coupled to the mount 40 or may be removed therefrom and operated remotely from the mount 40, for example, outside the vehicle and proximate to a location where the auxiliary device is deployed. As shown, the mount 40 may include an alphanumeric or a graphic display 120 for providing status messages, warnings or other information that may be useful or helpful to the auxiliary device operator, user, maintenance technician or other individual. The hand control device 10 may communicate with the mount 40 via a hardwired or wireless connection and further may be tethered to the mount 40 with a wire, cable, string or the like to prevent the device 10 from becoming lost, stolen or damaged.
[0019] Referring now to FIG. 3, the hand control 10 is based on a microcontroller or microprocessor 22 discussed in further detail herein. As known in the art, the microprocessor 22 may have a memory and several input and output ports for implementing an enhanced user interface, among other things. As shown in FIG. 3, push buttons 12, 14, 16 and 18 are provided through keypad input module 20 to the control microprocessor 22, for example, herein a Microchip PIC18F248 microcontroller integrated circuit, as illustrated further in the schematics of FIGs. 4A and 4B. A backlight control module 24 provides selective illumination of one or more lights 12a-18a such as light emitting diodes (LEDs) corresponding to the aforementioned up, down, fold, and unfold push buttons 12-18 respectively, i addition, the hand control 10 includes a warning indicator 132. As previously mentioned and shown in FIG. 1, one exemplary warning indicator 132 is embodied as a stylized logo 19 in the center of the push buttons 12-18. The exemplary visual warning indicator 132 may include one or more lights, such as green and red LEDs, linked to the microprocessor 22 through a warning module 138. Further as shown in FIG. 3, warning module 138 also provides the microprocessor 22 with an interface to vibrating motor 130, which enhances the hand control device 10 by delivering a vibratory-force feedback signal to an individual handling the device 10. In some embodiments the warning module 138 may also control the display 120 (FIG. 2), which may be adapted to fit on or in the housing 11, to help the user of the hand control 10 to identify and troubleshoot various operating conditions. For example with reference to FIG. 5, in various embodiments, the display 120 may be incorporated into the warning indicator 132, or alternatively, the display 120 may be coupled to the module 138 separate from the warning indicator 132.
[0020] As one can appreciate, the hand control device 10 would include minimal electronics. With reference to FIG. 5, a block diagram illustrating an electronic control system 110 for a vehicle wheelchair access device is provided. The control system 110, which may be an aftermarket system, is integrated with or otherwise communicates seamlessly with an original equipment manufacturer (OEM) vehicle control system and operates to control OEM functions such as power locks and power sliding doors as well as various functions of the wheelchair access system such as ramp/lift deployment and stowage, lift raise/lower operations, and the like. As can be appreciated from FIG. 5, the hand control 10 includes interface device 114 that communicates with a host computer system or controller 112 in an effort to make the aforementioned wheelchair access device safer and
more user-friendly. Since such access devices may be closely integrated with the OEM control system, the access device control system 110, by way of the controller 112, may intercept, delay, and relay intercepted OEM communications to various OEM and wheelchair access subsystems to, for example, coordinate vehicle door unlocking and opening with access device deployment. To this end and referring to FIGs. 3, 4A-4B and 5, the device 10 only requires sufficient electronics to receive a user input from the buttons 12-18, operate the lights 12a-18a, warning indicator 132 and vibrating motor 130, and communicate with the host controller 112 (FIG. 5) and the majority of the control system 110 electronics would reside in the base unit or controller 112.
[0021] As shown in FIG. 3, a multiplexed physical interface 30 facilitates wired communication with a control system communication bus 32. As shown in FIGS. 4 A and 4B, the multiplexed physical interface 30 is provided as a fault tolerant CAN interface, herein employing a Motorola MC33388 which is optimized for harsh automotive environments and the like. Additionally as shown in FIG. 3, wireless communication with the host computer system 112 (FIG. 5) may be facilitated with a remote transceiver module 26 and a controller- based transceiver module 28. With reference to FIG. 4A, the schematic diagram shows the embedded control microprocessor PIC 18 microprocessor 22 of the inventive hand control 10 with the keypad input module 20 and CAN interface provided with the multiplex physical interface 30 via communications bus 32. In FIG. 4B, portions of the user interface are illustrated including backlight control module 24, vibrator motor 130 and red/green hand control illuminators 132. As mentioned briefly above and discussed in further detail hereafter, the warning module 138 and vibrating motor 130 provide vibratory-force feedback to the user.
[0022] During periods of nonuse, the microprocessor 22 may remain in a low power "sleep" mode until it is awakened by an interrupt caused by the closure of any one of the buttons 12-18 of the keypad. The processor 22 will then read its input port to determine which key is pressed. A message identifying the pressed button will be formatted and transmitted to the host computer 112 via the bi-directional interface 32. This bi-directional interface 32 can be implemented in two different ways. One interface method is a wired port that employs a multiplexed communications interface 30, which can be implemented as one or more of the industry standard systems such as CAN, LIN, J1850, etc. The second method
is a wireless application, which will use a RF Transmitter/Receiver pair 26 (e.g., transceiver) that communicates with a host Transmitter/Receiver pair 28 linked to the host computer 112.
[0023] The hand control 10 is also operable to receive messages through its bi-directional interface from the host computer 112. These messages will serve two functions. One function is to control the backlight of the keypad legends 12a-18a relative to the state (e.g., position or orientation) of the auxiliary device, and in some exemplary embodiments disable user inputs (i.e., push buttons), and the second function is to activate a warning signal whenever any predefined hazardous, unsafe or undesirable situations may arise. Moreover, as can be appreciated from the foregoing, the subject hand control device 10 provides one or more different types of warning indications, and more particularly at least one of a visual indication and a haptic indication. The visual indication requires the operator to look at the device 10, whereas the haptic (e.g., a sensory vibration) indication is applied to the operator's hand to alert the operator of a potential problem, fault, malfunction or otherwise unsafe operating condition. The haptic (e.g., vibration) warning allows the operator to maintain constant visual contact with the wheelchair lift or ramp and supervise its continuous operation.
[0024] (1) Visual - When all of the safety interlocks are satisfied and the system is ready for operation, the device 10 or a portion thereof (e.g., logo 19) will be illuminated in the first indication state (e.g., with a green color) by control illuminators 132. This provides a visual indication to the operator to help him or her understand that it is now safe to operate the lift. When the main lift controller such as host computer 112 (FIG. 5) senses a problem or detects that one or more interlocks (or conditions thereof) is inhibiting lift operation, the hand control (or portion thereof) will be illuminated in the second indication state (e.g., with a red color), thereby alerting the operator that a system error or an interlock has occurred. Additionally, the indicia 19 may flash or strobe in one or more of the indication states to ensure that the operator's attention is directed to the device 10.
[0025] (2) Physical - The vibrating motor 130, internal to the hand control 10, can be activated by the microprocessor 22 whenever the master controller such as host computer 112 commands it to do so. This allows direct and positive feedback to the operator when a fault
or potentially hazardous situation occurs without requiring the operator to look away from the lift that is in operation.
[0026] hi addition to the aforementioned visual and physical indications of the hand control device 10, it is conceivable that additional indicators may be provided by the interface device 114, such as an audio indication. Moreover, the host computer 112 may actuate one or more indicators separate from the hand control 10 within the vehicle or external to the vehicle (e.g., the display 120).
[0027] Back-lighting of the proximate indicia 12a-l 8a will serve a number of purposes. First, individual indicia can be lighted in low ambient light conditions (e.g., when the vehicle headlights are illuminated) to allow the operator to easily identify the function of any individual button 12-18. Second, the back-lighting of each of the indicia 12a-18a is selectively and individually controllable relative to the current state of the lift. As shown below in the operational chart for an exemplary vehicle wheelchair lift, the lift may only move as defined between discrete states:
Lift/Ramp Position: Buttons Backlit: Folded UnFold Between Folded and Floor Level UnFold, Fold Floor Level Fold, Down Between Floor Level and Ground Up, Down Ground Level Up
[0028] To properly operate the lift, one can appreciate that the controller (e.g., host computer 112 - FIG. 5) may function as a state machine with a state diagram that permits the lift to only move or operate in the aforementioned manner. As is well known in the art, the controller may receive outputs from various sensors coupled to the lift for detecting the position or orientation of the lift. In response to receiving the sensor outputs, the controller may discriminate the lift state and provide a lift status (i.e., state) signal to the hand control device 10 relative to or otherwise indicative of the state (i.e., position or orientation) of the lift so that the local microprocessor 22 can allow lighting of only the currently available (i.e., proper) lift function buttons 12-18. Further, if a legend backlight corresponding to a push button is not illuminated, the microprocessor 22 may "ignore" or otherwise discard signals
received relative to that "unavailable" push button so that the host microprocessor 116 (FIG. 5) need not waste valuable processing resources determining if the user input (i.e., operation request) is valid and safe. In some embodiments, the microprocessor 22 may disable, de- energize or otherwise deactivate one or more unavailable push buttons. Moreover, the microprocessor 22 may help the user or operator understand the proper operation of the lift by providing a visual, audible or other sensory warning (e.g., a vibration) to the operator that an improper operation was requested as described above. The microprocessor 22 may include or be in communication with a switch monitoring interface (not shown) such as module that filters contact bounce, and passes switch state information for a plurality of switches to the microprocessor 22. One exemplary switch monitoring interface is a Motorola MC33384 that operates to monitor the open/closed state of multiple switches used in a system.
[0029] As shown in FIG. 5, one embodiment of a host computer 112 that communicates or otherwise cooperates with a hand control device 10 includes a host microprocessor 116, random access memory (RAM), read-only memory (ROM), a system clock 118, a display screen 120, and an audio output device 121. Host microprocessor 116 maybe embodied by any one of a variety of available microprocessors from Intel, Motorola, or other manufacturers known in the art. Microprocessor 116 can be a single microprocessor chip, or can include multiple processors. Microprocessor 116 retrieves and stores instructions and other necessary data from RAM and ROM, as is well known to those skilled in the art, and in the foregoing described embodiment, host computer 112 is operable to receive and process sensor data signals via a bus (not shown) from a plurality of OEM and aftermarket sensors. In addition, host computer 112 receives user inputs (i.e., auxiliary device operational requests) from the hand control device 10 via interface device 114 through a wired connection (e.g., bus, communication pathway) 32 or wireless interface 125. Additionally, the two interfaces 32, 125 can be used simultaneously to provide an increased data bandwidth. In response to various sensor inputs and operator requests, the microprocessor 116 operates safety interlocks known in the art. The host computer 112 may indicate the status of such interlocks to an operator via at least one of audio device 121, display device 120 and interface device 114 (i.e., the hand control device 10). Further, as previously described, the host computer 112 may indicate a state of the lift (e.g., deployed, stowed, ground level, transfer level) to the operator by way of the interface device 114.
[0030] Clock 118 is a standard clock crystal or equivalent component used by host computer 112 to provide timing to electrical signals used by microprocessor 116 and other components of the computer system. Clock 118 is accessed by host computer system 112 in the control process. The display device 120 is coupled to host microprocessor 116 by suitable display drivers and can be used to display images generated by host computer system 112 or other computer systems.
[0031] Interface device 114 includes a local microprocessor 22, button array 128 (e.g., buttons 12, 14, 16, and 18), vibrator motor 130, a button interface 136, an actuator interface 138 and may include other optional input devices as discussed in further detail below. Interface device 114 may also include additional electronic components for communicating via standard protocols on bus 32. The microprocessor 22 can be provided with software instructions to wait for commands or requests from computer host 116, decode the command or request, and handle/control input and output signals according to the command or request. As previously mentioned, suitable microprocessors for use as local microprocessor 22 include the PIC16C18 by Microchip, for example. Microprocessor 22 can include one microprocessor chip, or multiple processors and/or co-processor chips. In other embodiments, microprocessor 22 can include a digital signal processor (DSP) chip. Local memory 127, such as RAM and/or ROM, is preferably coupled to microprocessor 22 in interface device 114 to store instructions for microprocessor 22 and store temporary and other data such as a lift state signal from the host microprocessor 116. A local clock 129 can be coupled to the microprocessor 22 to provide timing data. Microprocessor 22 can receive signals from button array 128 and provide signals to the vibration motor 130 and illuminators 132 of the interface device 114 in accordance with signals or instructions provided by host computer 112.
[0032] The vibration motor 130 of interface device 114 may be a typical vibration motor as known in the art. One exemplary motor for use with the interface device 114 is the 4TL1- 02WB available from VibratorMotor.com, although other similar motors may be suitable. Alternatively, other types of motors can also be used, such as a stepper motor controlled with pulse width modulation of an applied voltage. The motor may also include a brake which allows the rotation of the shaft to be halted in a short span of time.
[0033] As mentioned previously, other input devices can optionally be included in interface device 114 and send input signals to microprocessor 22. Such input devices can include buttons, dials, switches, or other mechanisms. For example, in embodiments where the operator uses one or more buttons, other input devices can include a joystick.
[0034] Embodiments of this invention are described herein. Variations of those embodiments may become apparent to those of ordinary skill in the art upon reading the foregoing description. The inventors expect skilled artisans to employ such variations as appropriate, and the inventors intend for the invention to be practiced otherwise than as specifically described herein. Accordingly, this invention includes all modifications and equivalents of the subject matter recited in the claims appended hereto as permitted by applicable law. Moreover, any combination of the above-described elements in all possible variations thereof is encompassed by the invention unless otherwise indicated herein or otherwise clearly contradicted by context.