DE102007005027B4 - Display and operating device for a motor vehicle with an interactive user interface - Google Patents

Abstract

Display and operating device (2) for a motor vehicle (1) comprising a display device (3) designed as a touch screen, a control unit (5) coupled to the display device (3) and a storage device (6), the storage device (6) comprising data , by means of which, in cooperation with the control unit (5), a user interface for operating at least one vehicle system (13-16), a vehicle function and / or a service can be implemented, with the control unit (5) a position determination unit (29) for determining a three-dimensional Position of an actuating element, in particular a body part, a user is coupled in space and the user interface is configured to be interactively influenced as a function of the determined position and relative to a display surface (4) of the display device (3) in a detection or detection range of the position determination unit (29) a core detection volume (30) de within which a presence of the user's operating element is detected, wherein an interactive response of the user interface is triggered upon detecting the presence in the core detection volume (30), and wherein the user interface is configured such that an interactive one based on the detected presence of the actuator Reaction occurs only upon detection of the actuator in the core detection volume (30), wherein the core detection volume (30) comprises a space area and a side surface of the space area adjacent to the display surface (4) is aligned parallel thereto and covers it, the position determination unit (29) is configured to uniquely associate a position of the actuator with one of a plurality of segment volumes (38-42) of the core detection volume (30) to enable position dependent, differentiated interactive manipulation of the user interface, the Se Part volumes of the core detection volume (30) and each one of the display surface (4) facing, parallel to the display surface (4) aligned base surface (43-47), wherein the base surfaces (43-47), the display surface (4 ), wherein the interactive response depends on the determined position associated with the respective segment volume, where ...

Description

The invention relates to a display and control device for a motor vehicle, comprising a display device designed as a touch screen, a control unit coupled to the display device and a memory device, wherein the memory device comprises data, by means of which in cooperation with the control unit a user interface for operating at least one vehicle system, a vehicle function and / or a service can be implemented.

From the prior art, it is known to use display devices designed as a touch screen, on which a user interface is formed, via which one or more vehicle functions, vehicle systems and / or in-vehicle or vehicle-external services can be operated. For example, is from the DE 10 2005 007 642 A1 an input device for a motor vehicle with a touch screen known. Also from the DE 10 2004 031 659 A1 a control element for a motor vehicle is known, which comprises a touch screen for visual display of information and for entering commands by touching the touch screen or by pressing on the touch screen, wherein the touch screen is round.

From the WO 02/16875 A1 A method is known for querying destination information within a map view, in which, based on a user input, a three-dimensional object is selected and data associated therewith are output. To navigate in the map view, the gestures of a user are preferably evaluated. This allows a user to navigate virtually in a map view and easily query object-related destination information.

From the DE 103 26 215 A1 is an operating device with concrete controls, with an arranged in the field of view of an operator screen and with a screen display, which is changeable depending on the operation of the respective control element known. The controls are associated with a sensor for contactless detection of the presence and / or movement of the operator, in the vicinity of the respective control element. The screen display then provides information about the operable with the control function.

The US 2004/0189720 A1 describes a computer system which is controllable via gestures and / or voice commands. For this purpose, an interaction region is monitored at a distance from a display surface.

Due to a limited installation space in a motor vehicle, a size of the touch screen is usually limited. Since the touch screen is to be used at the same time for displaying information and for operation, which usually requires a display of operating elements, a resource conflict occurs with regard to the available display area. In the devices known in the prior art, it is provided to switch over a first actuating action between a display mode in which information is preferably displayed and an operating mode in which virtual operating elements and / or operating element assignments are displayed. Control mappings are understood to be representations of information. which allow a function assignment for an operator action, for example, specify a function assigned to a control element formed separately from the display device in a current context.

The invention has for its object to provide an easier-to-use, adapted to the needs of a driver and / or passenger display and control device for a motor vehicle, which minimizes in particular a number of required actuating actions for triggering a vehicle function or operating a vehicle system or service.

The object is achieved by a display and control device with the features of claim 1. Advantageous embodiments of the invention will become apparent from the dependent claims.

For this purpose is provided in a display and control device of the type mentioned above, with the control unit, a position determining unit for determining a three-dimensional position of an actuating element of a user, which is preferably a body part, more preferably a hand and most preferably an extended finger to couple in space and the Design user interface so that it interactively influenced depending on the position determined. This makes it possible to include the movement of the user in the room with the control of the vehicle functions. The display and operating device thus utilizes actions of the user which precede an operation of a control element according to the prior art. This makes it possible to design the user interface in such a way that, for example, when the body part approaches the display device, the user interface changes from a display mode to an operating mode. While information about the vehicle system to be operated, the vehicle function and / or the service is preferably displayed in a display mode are in an operating mode Reproduced information that facilitates or enables operation of the corresponding vehicle system, the vehicle function and / or the service. For example, virtual controls can be displayed on the display device designed as a touch screen. Likewise, control element assignments can be displayed.

In the detection area of the position determination unit, there is provided a core detection volume defined relative to a display surface of the display device, within which presence of the user's operating part (body part) is detected, whereby an interactive response of the user interface is triggered upon detecting the presence in the core detection volume, and wherein the User interface is designed so that an interactive reaction based on the detected presence of the actuator takes place only upon detection of the actuating element in the core detection volume. As a result, the possibility is created to treat edge regions of the detection or detection region of the position determination unit as quasi non-detected regions. This means that a user outside the core detection volume can freely move his body parts without interactively affecting the user interface. This creates the possibility of arranging the display and operating device adjacent to components, such as a steering wheel, which projects at least partially into the detection area of the position-determining unit, but whose actuation is not intended to trigger interactive influencing of the user interface. Only a targeted, executed with control intent operation, in which a body part is moved into the core detection volume, thus leading to an interactive influencing the user interface.

A simple and intuitive operation of the display and operating device requires that the user can easily imagine the core detection volume in the room. The invention provides that the core detection volume comprises a space area and a side surface of the space area adjacent to the display area is aligned parallel thereto and covers it. Preferably, therefore, the display surface itself is a base of a parallelepiped-shaped space region encompassed by the core detection volume. As a rule, the core detection volume itself will be parallelepiped-shaped. It is thus easily possible for a user to estimate the area in the room in which he can move his body parts without causing an influence on the interactive user interface or in which room area he has to move his body part in order to influence the interactive user interface. A cuboidal space, which is virtually an extrusion body of the display surface, is particularly easy to imagine. Depending on the installation position in the vehicle, however, it may be advantageous that the resulting parallelepiped-shaped space region does not correspond to a surface normal of the display surface which is "extruded" but along a vector which corresponds to a preferred operating direction of a body part, in particular a finger, of a user. who moves his finger to the center of the display device is extruded.

In order to enable a position-dependent, differentiated interactive influencing of the user interface, it is provided according to the invention that the position determination unit is designed to uniquely associate a position of the body part with one of a plurality of segment volumes of the core detection volume, the segment volumes being partial volumes of the core detection volume and each facing the display surface , Have aligned parallel to the display surface base, the base areas segment the display surface.

In order to make it easy to assign a graphical content to the respective subvolume represented within the base area of one of the subvolumes for the user, it is preferably provided that the segment volumes comprise parallelepiped-shaped, preferably parallelepipedal, further space regions and particularly preferably parallelepiped-shaped, preferably parallelepipedal.

For certain functionalities of the user interface, it has proven to be advantageous to provide a subregion of the core detection volume which is not assigned to any of the segment volumes. The invention therefore provides that the core detection volume comprises spatial points at a greater distance from the display surface than the segment volumes, the distance being measured along a surface normal or parallel to a surface normal of the display surface. This means that according to the invention the core detection volume comprises points in space that are not covered by any of the segment volumes. These space points also have a greater distance from a virtual plane in which the display area is located than spatial points of the segment volumes. Here, the display area is assumed to be just. If the display area has a curvature, the virtual level is formed by the display area and, at the edge points, tangentially adjacent virtual areas.

In order to be able to design a driver and passenger-dependent user interface, it is provided in one embodiment of the invention that the position-determining unit has a Users can differentiate from another user and the user interface is designed user-specific interactive. A user-dependent interactive design means that the information displayed by the interface and / or operating elements differ in at least one operating context for a user and another user. Depending on whether in the core detection volume, the operating element (the body part) of the user is detected or another actuator (another body part) of another user is detected, the interactive user interface is influenced differently.

In a particularly preferred embodiment of the invention, an approach of the user and / or the other user to, for example, an actuating element, which is arranged adjacent to or at a predetermined distance from the display and control device, can be detected. A preferred embodiment therefore provides that the position determination unit is configured to detect a presence of the actuating element (of the body part) in at least one neighboring volume to the core detection volume. In particular, those embodiments are of particular advantage, in which a position determination unit is used which can distinguish a driver from a passenger. In such a case, an actuation of an operating element can likewise bring about a user-dependent influencing of the vehicle system, a vehicle function or a service associated with the actuation element.

Advantageously, the position determination unit is designed such that a position determination of the actuating element of the user or of the further actuating element of the further user is possible, provided that the actuating element of the user or the further actuating element of the further user respectively a body part, preferably a hand, most preferably a single extended finger , are. It is understood that a body part can also be dressed. Thus, a glove-clad finger is detected as an actuating element of the preferred position-determining unit according to the invention and determines its position in space.

The invention will be explained in more detail with reference to a drawing. Hereby show:

1 a schematic view of a display and control device for a motor vehicle; and

2 an exemplary embodiment of a core detection volume, segment volumes and adjacent space areas relative to a display area.

In 1 is a motor vehicle 1 shown schematically. The car 1 includes a display and control device 2 , The display and operating device 2 includes a display device 3 with a display area 4 , The display device 3 is designed as a touch screen. The graphical representation of information on the display area 4 is via a control unit 5 controlled with a storage device 6 is linked. In the storage device 6 Data are stored, the implementation of a user interface by means of the control unit 5 enable.

On the one hand, the display device designed as a touch screen 3 to capture user input. On the other hand, the display and operating device has 2 via an upper control element 7 and a lower control 8th which are arranged one below the other. The upper control element 7 and lower control 8th Both are designed as a turn-push button and with the control unit 5 coupled. The display and operating device 2 also includes two superimposed buttons 9 . 10 which also with the control unit 5 are coupled. As well as designed as a touch screen display device 3 can also use the top control 7 , the lower control 8th and the two buttons 9 . 10 to capture user input. Other embodiments of the display and operating device comprise, except for the display surface designed as a touch screen, no further operating elements.

The display and operating device 2 is via an interface 11 with a vehicle bus 12 connected. With the vehicle bus 12 are vehicle systems 13 - 16 connected. The vehicle systems 13 - 16 can via the display and control device 2 to be served. In some embodiments, further vehicle systems may be wholly or partially incorporated into the display and control device 2 be integrated, such as an MP3 player, etc.

The vehicle systems 13 - 16 include in the described embodiment, inter alia, a seat heater 16 , which is a driver's seat heating module 17 sitting at a driver's seat 18 is arranged, and a passenger seat heating module 19 includes that on a passenger seat 20 is arranged.

At the driver's seat 18 and the passenger seat 20 are also each a transmitter 21 respectively. 22 arranged in one on the respective driver's seat 18 seated user 23 (Driver) or one in the passenger seat 20 sitting another user 24 (Co-driver) capacitively couple different high-frequency signals.

Approach the users 23 or the other user 24 a body part of the display and operating device 2 On, so is the respectively coupled high frequency signal from sensors 25 - 28 detected and from a position determination unit 29 evaluated. The sensors 25 - 28 receive the high frequency signals contactless. Based on the different high-frequency signals is a reliable detection of the user 23 and the other user 24 possible.

In embodiments such as the in 1 shown, the multiple sensors 25 - 28 use, a non-contact position determination of the body part is possible. A detailed description of such a sensor can, for example, in WO 2004/078536 being found. The number of individual sensors used can be adjusted according to requirements.

In another embodiment, electrically arranged around the display surface, between which a preferably static electric field is formed. When a body part of a user approaches the display surface, the static electric field changes. About a change of the field, the position of the body part, in particular one of the display surface nearest the end of the body part, can be determined. A user recognition is realized via a tracking of the body part, whereby it is assumed here that the display and operating device is arranged between the user and the other user, for example in a center console. The electrical elements are preferably configured linearly and arranged in each case on opposite sides of the display surface. The electrical elements can be segmented and unsegmented.

Yet another embodiment uses optical sensors which detect a reflection rate of electromagnetic radiation preferably emitted in the non-visible wavelength range. A user distinction also takes place in such a system based on trajectory or movement tracking of the body part.

Such a position determining unit using an optical method may include, for example, sensors configured according to the following principle. A transmission LED emits a rectangular amplitude modulated light signal in the optical or infrared wavelength range. The light signal reflected on an object, for example the body part, is detected by a photodiode. A compensating LED sends a 180 ° out of phase, also rectangular amplitude modulated reference light signal to the photodiode via a fixed light path. The compensation LED is adjusted via a control loop by means of a control signal so that cancel the received reflected light signal of the transmit LED and the received reference light signal of the compensation LED to the photodiode and a DC signal is detected. A change in the control signal is a measure of the distance of the object. A designed according to this principle sensor is largely independent of temperature and brightness variations.

Other sensors, in particular ultrasound-based or camera systems based position determination units can be used.

In 2 is a core detection volume 30 , also referred to as coordinate block Q2, relative to a display area 4 shown. A whd coordinate system is relative to the display area 4 so defined that an origin 31 in a lower left corner of the display area 4 is arranged. A w axis 32 is along a longitudinal direction and an h-axis 33 along a transverse direction of the display surface 4 oriented. This means that the display area 4 lies in a wh-level. Perpendicular to the wh-plane extends the d-axis 34 , The core detection volume 30 has a width W 35 , a height H 36 and a depth D 37 on. In an exemplary display area having a width along the w direction of 12 cm and a height along the h direction of 4 cm, the core detection volume dimensions preferably have the following values: W = 12 cm, H = 4 cm and D = 6 cm. A footprint of the core detection volume 30 in the described embodiment congruent with the display surface 4 , The core detection volume 30 is cuboidal.

The core detection volume 30 includes segment volumes 38 - 42 , base areas 43 - 47 the segment volumes 38 - 42 are oriented parallel to the display area and adjoin it. The bases 43 - 47 segment the display area 4 , The segment volumes extend along the h-direction 38 - 42 over the entire height 36 the core detection volume 30 or the display area 4 , The latitudes 48 - 52 the segment volumes 38 - 42 are each the same size, so that the display area 4 in equal segments, the base areas 43 - 47 the segment volumes 38 - 42 correspond, is divided. The latitudes 48 - 52 (w1-w5) each have a value of wi = 2.4 cm (i = 1, ..., 5) in the preferred embodiment described. A depth D1 52 the segment volumes 38 - 42 is less than the depth D 37 the core detection volume 30 , The depth D1 53 the segment volume is preferably 2.5 cm. A depth difference D2 54 is thus 3.5 cm. Adjacent to the core detection volume 30 is a lower adjacent volume 55 (Coordinate block Q3) defined. Within In this volume, the position determination unit is capable of user discrimination in the presence of a body part within the lower adjacent volume 55 make. The same applies to an upper adjacent volume 56 (Coordinate block Q1). Preferably, the position-determining unit is designed such that it also determines the position of the body part, in particular when touching a volume which is adjacent thereto 55 . 56 arranged control element that is located in the wh-plane or extending from this determine. In such a case, operating elements which are not technically connected to a control unit and whose actuation can thus only be determined via the position determination unit can also be used with the user interface.

The position determination unit 29 is configured to receive the actuator, which will typically be an extended finger, such as a single extended index finger, of one of the segment volumes 38 - 42 can clearly assign, provided it is in one of the segment volumes 38 - 42 staying. For this purpose, of course, this is only possible if the actuator at an end facing the display surface has an extent parallel to the display surface, which is smaller than the extent of the display surface, preferably an extent parallel to the display surface having on the order of Extension of the base areas 43 - 47 lies. In the order of magnitude of the extension of the base areas, an extension of an actuating element lies parallel to the display surface 4 , provided a projection surface along the surface normal to the display surface 4 equal to or less than the sum of the base areas touching in at least one point 43 - 47 the segment volumes 38 - 42 is. In the projection, only the display area is 4 to consider the facing end of the actuator. In one finger, for example, the extension of the finger at the level of the fingernail.

Is the position determination unit a presence of the actuating element in a plurality, in particular not directly adjacent segment volumes 38 - 42 For example, if, for example, a flat hand is held in front of the display surface, it may be interpreted as a gesture associated with a user interface response. Likewise, a traversed trajectory, ie a movement, can be interpreted as a gesture.

Is the body part of a user or another user within the segment volumes 38 - 42 Thus, in a particularly preferred embodiment, the position determination unit is capable of a projection position along a surface normal of the display surface 4 on the display surface 4 to be determined with an accuracy of less than 1 cm. This creates the possibility to move a cursor on the display surface by means of the body part.

The described embodiment of the core detection volume and the segment volumes is merely exemplary. Other preferred embodiments provide that the display area is subdivided into a grid of 3 × 2 to 10 × 6 segments formed by base areas of the segment volumes. Other segmentations are possible. In the described embodiment, both the core detection volume 30 as well as the segment volumes 38 - 42 cuboid shaped. If an operation, ie an approach, to the display surface by means of the body part, preferably an index finger, along a surface normal of the display surface is not possible, it is advantageous to adapt the core detection volume and the segment volumes such that the d-axis of the whd coordinate system according to 2 the preferred operating direction, ie a preferred direction of approach of a finger is adapted by a user. This means that the core detection volume and the segment volumes change into "sheared" volumes that are parallelepiped-shaped.

LIST OF REFERENCE NUMBERS

1

motor vehicle

2

Display and operating device

3

display device

4

display area

5

control unit

6

storage device

7

upper control element

8th

lower control element

9, 10

button

11

interface

12

vehicle bus

13-15

vehicle systems

16

Vehicle system (seat heating)

17

Driver seat heated module

18

driver's seat

19

Front seat heating module

20

passenger seat

21, 22

transmitter

23

User (driver)

24

additional user (co-driver)

25-28

sensors

29

Position Determination Entity

30

Core detection volume (Q2)

31

Origin of the w-h-d coordinate system

32

w-axis

33

h-axis

34

d-axis

35

Width of core detection volume (W)

36

Height of the core detection volume (H)

37

Depth of core detection volume (D)

38-42

segment volumes

43-47

Base areas of the segment volumes

48-52

Widths of segment volumes (w1-w5)

53

Depth of segment volumes (D1)

54

Depth difference (D2)

55

lower adjacent volume (Q3)

56

Upper adjacent volume (Q1)

Claims (6)

Display and operating device ( 2 ) for a motor vehicle ( 1 ) comprising a display device designed as a touchscreen ( 3 ), one with the display device ( 3 ) coupled control unit ( 5 ) and a storage device ( 6 ), wherein the memory device ( 6 ) Data by means of which, in cooperation with the control unit ( 5 ) a user interface for operating at least one vehicle system ( 13 - 16 ), a vehicle function and / or a service is feasible, with the control unit ( 5 ) a position determination unit ( 29 ) is coupled to determine a three-dimensional position of an actuating element, in particular of a body part, of a user in the room and the user interface is designed to be interactively influenced as a function of the determined position and relative to a display area ( 4 ) of the display device ( 3 ) in a detection area of the position determination unit ( 29 ) a core detection volume ( 30 ), within which a presence of the user's operating element is detected, wherein an interactive reaction of the user interface upon detection of the presence in the core detection volume ( 30 ) and wherein the user interface is designed so that an interactive reaction based on the detected presence of the actuating element only upon detection of the actuating element in the core detection volume (FIG. 30 ), where the core detection volume ( 30 ) comprises a space area and a side surface of the space area adjacent to the display area (Fig. 4 ) is aligned parallel to this and covers it, wherein the position determination unit ( 29 ) is formed, a position of the actuating element uniquely one of a plurality of segment volumes ( 38 - 42 ) of the core detection volume ( 30 ) in order to enable a position-dependent, differentiated interactive influencing of the user interface, whereby the segment volumes ( 38 - 42 ) Partial volumes of the core detection volume ( 30 ) and one each of the display area ( 4 ), parallel to the display surface ( 4 ) oriented area ( 43 - 47 ), the bases ( 43 - 47 ) the display area ( 4 ), wherein the interactive response depends on the determined position associated with the respective segment volume, the core detection volume ( 30 ) Space points at a greater distance from the display area ( 4 ) than the segment volumes ( 38 - 42 ), wherein the distance along a surface normal of the display surface ( 4 ), so that the core detection volume includes space points that are not included in any of the segment volumes. Display and operating device ( 2 ) according to claim 1, characterized in that the segment volumes ( 38 - 42 ) are parallelepiped-shaped. Display and operating device ( 2 ) according to claim 1 or 2, characterized in that the core detection volume ( 30 ) is parallelepiped-shaped, preferably cuboid. Display and operating device ( 2 ) according to one of the preceding claims, characterized in that the position determination unit ( 29 ) may distinguish the actuator of the user from another actuator of another user and the user interface is designed user-specific interactive. Display and operating device ( 2 ) according to one of the preceding claims, characterized in that the position determination unit ( 29 ), a presence of the actuating element and / or the further actuating element in at least one neighboring volume ( 55 . 56 ) to the core detection volume ( 30 ) capture. Display and operating device ( 2 ) according to one of the preceding claims, characterized in that the actuating element of the user is a finger individually extended.

Images