DESCRIPTION:

The invention is concerned with an input unit for remotely providing user in put to an electronic user interface. The invention is also concerned with a motor vehicle comprising the inventive input device and the electronic user interface.

Input units comprising of devices such as keyboard devices or touchpads or touchscreen monitors can be used in vehicles, especially autonomous vehi cles, where the driver can use the driving time to write a text message or work on documents instead of concentrating on the steering wheel. However, typically available devices such as touchpads or touch screen monitors fail to provide a comfortable solution for the driver to write a text message or edit documents while driving.

Document US 2016/0375924 A1 discloses a steering wheel for a vehicle which includes a steering wheel hub. Also included is a first portion of the steering wheel hub having an electronic display. Further included is a second portion of the steering wheel hub having a keyboard, the keyboard being in operable communication with the electronic display. However, during auton omous driving, the steering wheel is often moved out of the way making the keyboard unavailable.

Document DE 10 2015 108 871 A1 discloses a vehicle computing system which includes at least one controller configured to communicate with an at tractable device. The at least one controller may be configured to receive data defining a first gesture made using the attractable wireless device. The controller may be further configured to determine a first predefined command to control a vehicle system that was previously stored in association with the first gesture. The controller may be further configured to control the vehicle system according to the first predefined command. Document KR 2004 0053523 A discloses a steering wheel with a keyboard in a vehicle which is provided to make the best use of the telematics system by using the keyboard, and to improve the appearance by folding and storing the keyboard, when not using. An attachment part is formed in the upper part of a hub of the steering wheel of the vehicle, and the keyboard is mounted in the attachment part. The keyboard is connected and folded by a hinge part. The hinge parts are installed at ¼ point and ¾ point of the entire length of the keyboard, and the keyboard is folded around the hinge parts. The attachment part of the keyboard is recessed inward to restrict the folded keyboard from being protruded out of the steering wheel. Lowering of the appearance is prevented by forming the folded outside of the keyboard with the same mate rial as the hub of the steering wheel. However, providing an extra keyboard in addition to other input devices consumes valuable space.

It is an object of the present invention to provide an input unit for remotely providing user input to an electronic user interface, e.g., in a vehicle.

The object is accomplished by the subject matter of the independent claims. Advantageous developments with convenient and non-trivial further embodi ments of the invention are specified in the following description, the depend ent claims and the figures.

The invention provides an input unit for remotely providing a user input to an electronic user interface. The electronic user interface can be for example, a display screen and/or a music system and/or a central electronic unit and/or an infotainment system. The input unit can be a part of the vehicle or an ac cessory. The input unit can comprise a keyboard device. The keyboard de vice can comprise a portable core element, which can comprise several sen sors and/or at least one battery for the keyboard and/or at least one socket and/or at least one plug which can enable an energy storage to be electrical ly charged, when the at least one socket and/or the at least one plug are connected or plugged to a charging unit. The keyboard device further com prises of a base plate arrangement that is attached to and foldable relative to the portable core element between a first state and a second state. The base plate arrangement can be a system and/or an arrangement of a plurality of plates, such that each plate is attached to the other in a foldable manner relative to the core element between the first state and the second state. The number of plates can be two, three, four or more than four. In the first state of the base plate arrangement, the plurality of the plates may be arranged in an aligned manner, such that the base plate arrangement forms a shape of a flat plate. Whereas in the second state of the base plate arrangement, the multitude of plates of the base plate arrangement are fold ed or wrapped around the portable core element, such that keyboard device obtains a shape of a pointing stick.

The keyboard device further comprises a plurality of key structures located on a first side of the base plate arrangement. The key structures preferably constitute of keys of a key board. In other words the key structures constitute of keys which are designed to enter an at least one specific alphabet and/or number and/or symbol. The plurality of key structures are designed to detect a first user input that is provided by the application of pressure and wirelessly send a first user input signal to the electronic user interface. The first user input signal provides information about which key structure has been pressed or which of the key structures have been pressed in succession. In other words the keyboard device is in electronic communication with the electronic user interface such that the inputs selected on the keyboard device can be reflected on the electronic display. For example, when an autonomous vehi cle steering system is activated, a driver of the autonomous vehicle does not need the steering wheel for vehicle control. In this situation the driver can take the keyboard device out of a docking station and unroll or unfold the base plate arrangement, such that the plurality of key structures are dis played or uncovered. The driver can use the keyboard device to write a text message or edit a document or generally enter text by pressing the corre sponding key structures of the keyboard device. Hence, the autonomous ve hicle can be used as a workspace for the driver while driving.

According to the invention, the keyboard device with the base plate arrange ment in the second state is designed to function as a wireless pointer tool to remotely send a second user input signal to at least one predefined se lectable element. The predefined selectable element can be a part of the in put unit such as the electronic user interface and/or an electronic display unit, e.g., in the vehicle. Further, the second user input signal comprises at least one of an activation signal and/or a functionality selection signal. Hence, in the second state of the base plate arrangement the keyboard device is de signed to function as a wireless pointer tool. This is of advantage because the driver of the autonomous vehicle can use the keyboard device as a wire- less pointer tool to remotely send the second user input to at least one pre defined selectable element. For example, the user can point the keyboard device to the electronic display unit of the vehicle, which can be a part of the input unit, and send an activation signal, this enables an electronic communi cation between the keyboard device and the electronic display unit. In other words the activation signal enables a motion of an electronic communication, e.g., a remote cursor on the electronic display unit, to be corresponding to the motion of the keyboard device with the base plate arrangement in the second state or motion of the hand of a user holding and moving the key board device with the base plate arrangement in the second state. For ex ample, the keyboard device can be used to operate as a remote cursor and/or be used to locate a selection option on the electronic display unit, for example, the selection option can be switching on of an electronic unit, e.g., a radio system. In this case, the user or the driver can move the remote cur sor on the display by moving the keyboard device. Once the cursor moves onto the selection option or button, for example, a selection option or button or symbol corresponding to the switching on of the radio system on the elec tronic display unit, the user can send a functionality selection signal.

The invention also comprises embodiments that provide features which af ford additional technical advantages.

In one embodiment, the base plate arrangement in the second state is wrapped around the portable core element. The first side of the base plate arrangement can be inside, that is facing the portable core element, such that the key structures on the first side of the base plate arrangement are covered. It enables the keyboard to obtain a shape of a pointing stick. This can be ergonomically desirable to use for a user such as the driver of the vehicle.

In one embodiment, the second side of the base plate arrangement opposite to the first side comprises at least one selection element which is designed to trigger the second user input signal. This enables the user to point the key board device towards a particular predefined selectable element. For exam ple, if the user wishes to ventilate the vehicle during driving, then the user can hold the keyboard with the base plate arrangement in the second state, which can be form of a pointing stick, and point towards a vehicle door, such as one of the vehicle door on the rear side. The user can point the keyboard device towards a windscreen of that particular door and press the at least one selection element, on the second side of the base plate arrangement to the second user input signal. The second user input signal in this case, can be the to open the windscreen of that particular door of the vehicle. It is fur ther thinkable that the at least one selection element can be in form of a press button, which can be pressed in order to send the second user input signal.

In one embodiment, the keyboard device can comprise at least one voice input sensor, wherein the keyboard device is designed to generate the sec ond user input signal at least partially on the basis of a sensor signal of the voice input signal. The at least one voice input sensor can be in form a mi crophone. The user can then provide a voice input, for example“turn on the radio”. In this case, the at least one voice input sensor captures the voice input from the user and transmits a voice input signal to a central electronic unit of the vehicle. The central electronic unit can convert the voice input into a machine input signal and sends an activation signal to a radio system of the vehicle accordingly. This is of advantage because this enables the user to provide use keyboard device as a voice user interface to perform required activities in hands free situations, such as driving where the driver’s hands are located on the steering wheel.

In one embodiment, the keyboard device can comprise at least one motion detection sensor, wherein the keyboard device is designed to generate the second user input signal at least partially on the basis of a sensor of the mo tion detection sensor. The second user input signal can thus be based on 3D dynamic gesture, e.g., waving of the key board device with the base plate arrangement in the second state. For example, the user can use the key board device with the base plate arrangement in the second state and point to a music system of in the vehicle. The user can then send the second user input signal comprising an activation signal, which enables the switching on of the music system to hear a first song. The user can further select a pre ferred song by means of the motion of the keyboard. For example, moving the keyboard to a right hand side and pressing the selection element can enable the selection of a next song relative to the first song. Furthermore, the user can move the keyboard to a left hand side and press the selection ele ment, which could enable the selection of the first song. Furthermore, the user can move the keyboard in an upward direction and press the selection element, which could enable an increase in the sound volume. Similarly, the user can move the keyboard in a downward direction and press the selection element, which could enable a decrease in the sound volume. This is of ad vantage because it enables an increase in comfort for the user in order to perform different operations by using the gestures of motion holding the key board device.

In one embodiment, the keyboard device with the base plate arrangement in the second state determines a position and/or spatial orientation by means of a sensor and provides information about the position and/or spatial orienta tion of the keyboard device in the second user input signal. This is of ad vantage because this enables the keyboard device to be used as a wireless pointer tool. On the basis of the information about the position and/or spatial orientation of the keyboard device in the second user input signal, the corre sponding selectable element, to which the user points by means of the key board device can be identified. Furthermore, the functionality selection signal directed to the corresponding selectable element can be interpreted by the central electronic unit on the basis of the information about the position and/or spatial orientation of the keyboard device in the second user input signal.

In one embodiment, the input unit can comprise a tracking unit that is de signed to detect a relative spatial position and/or orientation of the keyboard device with respect to the tracking unit. The tracking unit is located separate from the keyboard device. The tracking unit can be for example a time-of- flight camera and/or an infrared camera and/or a stereo camera and/or an array of antennas. This results in a calculation of the appropriate spatial posi tion and/or orientation of the keyboard device with respect to the tracking unit, which in turn may be used to interpret the appropriate second user input signal by the corresponding selectable element or the central electronic unit. Based on the calculation of the appropriate spatial position and/or orientation of the keyboard device with respect to the tracking unit, the tracking unit can interpret if the keyboard device is directed to a selectable element or the cen tral electronic unit in the vehicle or to a location outside the vehicle, e.g., a parking space of a parking place. This is of advantage, because in cases, such as, for example, if the keyboard device is directed towards a location outside the vehicle, e.g., a parking space of a parking place, then the track ing unit can send a tracking signal to the central electronic unit instead. The tracking signal can comprise the information about the relative spatial posi tion and/or orientation of the keyboard device with respect to the tracking unit. Based on the tracking signal to the central electronic unit, the second user input signal ( e.g. a voice signal to park the vehicle in the vehicle space) which in this case is directed towards the parking space can be redirected to the central electronic unit. Hence, based on the tracking signal and the sec ond user input signal, the vehicle can be driven autonomously to the parking space and parked accordingly.

In another embodiment, the input unit comprises a docking station, wherein the docking station is designed to mechanically support the keyboard device with the base plate arrangement in the second state. The docking station can be for example in form of an orthogonal hollow structure with an opening and located beside the steering wheel of the vehicle. The keyboard device with the base plate arrangement in the second state can be inserted through the opening into the orthogonal hollow structure, when the keyboard device is not in use. This ensures a mechanical support to the keyboard device and also provides protection to the keyboard device from wear in case of occa sional jerks during the driving of the vehicle.

In one embodiment, the docking station is designed to electrically charge the energy storage of the keyboard device by induction and/or conduction. This is of advantage because this ensures an uninterrupted and/or desired func tionality of the keyboard device in the first state as well as in the second state as a wireless pointer tool.

The invention further includes a motor vehicle comprising an electronic user interface and input unit for remotely providing input to the said electronic user interface.

The invention also comprises the various combinations of the features of the described embodiments, if not stated otherwise.

In the following an exemplary implementation of the invention is described. The figures show:

Fig. 1 a schematic illustration of an embodiment of an input unit;

Fig. 2 a schematic illustration of another embodiment of the input unit;

and

Fig. 3 a schematic illustration of another embodiment of the input unit. The embodiment explained in the following is a preferred embodiment of the invention. However, in the embodiment, the described components of the embodiment each represent individual features of the invention which are to be considered independently of each other and which each develop the in vention also independently of each other and thereby are also to be regarded as a component of the invention in individual manner or in another than the shown combination. Furthermore, the described embodiment can also be supplemented by further features of the invention already described.

In the figures elements that provide the same function are marked with iden tical reference signs.

Fig. 1 shows a schematic illustration of an embodiment of an input unit 10. The input unit 10 is incorporated in a vehicle 1 1 that may be a passenger vehicle. The vehicle 1 1 may comprise a driver assistance system (not shown in the figure), which can provide, for example, an auto-pilot functionality. In other words, the driver assistance system may drive the vehicle 1 1 autono mously or fully automatically. The input unit 10 may be designed for providing a user input to an electronic user interface 12. The input unit 10 can com prise a keyboard device 13. The keyboard device 13 can comprise a portable core element 14 which can comprise a plurality of sensors, for example a voice input sensor 15 and/or a motion detection sensor 16. The voice input sensor 15 can be a microphone whereas the motion detection sensor 16 can be an acceleration sensor and/or a passive infrared sensor and/or a micro- wave sensor and/or a ultrasonic sensor.

The keyboard device 13 can comprise a base plate arrangement 18. The base plate arrangement 18 can comprise of a plurality of plates P1 , P2, P3, P4, P5. The plates P 1 , P2, P3, P4, P5 can be connected to each other serial ly such that an edge of one plate is connected to an edge of a neighboring plate by means of a foldable material. As shown in Fig. 1 , an edge S1 of the plate P1 can connected to an edge SO of the portable core element 14 by means of hinge, which is not shown in the figures. An edge S2 of the plate P1 can be connected to an edge S3 of the plate P2, such that the plates P1 and P2 are rotatable relative to each other about the edges S2 and/or S3, wherein the edges S2 and S3 remain hinged or fixed relative to each other. Similarly an edge S4 of plate P2 and an edge S5 of plate P3, an edge S6 of plate P3 and an edge S7 of plate P4, an edge S8 of plate P4 and an edge S9 of plate P5 can be connected to each other such the respective plates P2, P3, P4 and P5 are rotatable relative to each other about their respective edges S2, S3, S4, S5, S6, S7, S8 and/or S9. The plates P1 , P2, P3, P4 and P5 of the base plate arrangement 18 can be arranged in such a manner that once the lateral edges L0, L1 , L2, L3, L4 and L5 of the portable core element 14 and the corresponding plates P1 , P2, P3, P4 and P5 are aligned relative to each other, then the plates P 1 , P2, P3, P4 and P5 cannot be rotated fur ther. In other words, the plate P2 can be rotated up to a maximum angle of 180 degrees about the edge S2 and/or S3, such that when the edges L1 and L2 are aligned, then the plate P2 cannot be rotated any further in that direc tion. The plates P3, P4 and P5 can be designed similar to P2, such that they can be rotated up to a maximum angle of 180 degrees about the correspond ing edges S2 and/or S3, edges S4 and/or S5, edges S6 and/or S7 and edges S8 and/or S9. However, the plate P1 can be rotated up to a maximum angle of 90 about the edge SO and/or S1 such that the edges L0 and L1 are aligned with respective to each other. Such an arrangement of the plates P1 , P2, P3, P4 and P5 ensures that the base plate arrangement 18 can be wrapped around the portable core element 14. Furthermore, the base plate arrangement 18 can be unwrapped about the edge SO of the portable core element 14 along a direction an arrow A1 , such that the base plate arrange ment 18 can form a flat surface.

A plurality of key structures K can be located a first side B1 of the base plate arrangement 18. For the sake of understandability and not all the key struc tures K are shown and/or marked in the Fig. 1 . The plurality of key structures K are designed to detect a first user input that is provided by the application of pressure. In other words, a user a can press a respective key structure and on the application of pressure, the respective key structure K gets pressed and the key board device 13 can send a first user input signal T1 wirelessly to the electronic user interface 12, which is shown by the arrow A2. The electronic user interface 12 can receive the first user input signal and process the signal by means of a processor, not shown in the figures, and can display the first user input signal in form of a text, for example “ABC...”, on a display screen 25 of the electronic user interface 12. The elec tronic user interface 12 can be in the form of an electronic display similar to a computer monitor. The key structures K can be spring loaded such that it automatically returns to its original position when a finger that has depressed the respective key structure K is released therefrom. Thus, the keyboard de vice 13 can function as a computer-keyboard. In the embodiment shown in Fig. 1 , the plates P1 , P2, P3 and P4 comprise the key structures K, whereas the plate P5 comprises a touchpad 19. The user can use the touchpad 19 to move a cursor 20 on the electronic user interface 12 or the electronic display.

Flence, in order to use the keyboard device 13 to type a message or to work, the user can unwrap place the keyboard device at an ergonomically suitable orientation and unwrap or unfold the base plate arrangement 18 relative to the portable core element 14 along the direction P1 . This state of the base plate arrangement 18 can be referred to as a first state M1 . The user can then use the keyboard device 13 with the base plate arrangement 18 in the first state M1 to type a message on the electronic user interface 12 and/or work.

After the usage of the keyboard device 13, the base plate arrangement 18 can be folded or wrapped, e.g. by a user, relative to the portable core ele ment 14 from the first state M1 to a second state M2. In the second state the plates P1 , P2, P3, P4 and P5 of the base plate arrangement 18 can be wrapped around the portable core element 14, such that the keyboard device 13 can take a shape of a pointing stick. The plates P1 , P2, P3, P4 and P5 can comprise of magnetic elements or material, such that the plates P 1 , P2, P3, P4 and P5 of the base plate arrangement 18 in the second state M2 can remain intact or attached to the portable core element 14.

The input unit 10 further comprises a docking station 21. The docking station can be for example in form of an orthogonal hollow structure, not shown in the figures, with an opening 22. After the usage of the keyboard device 13, the user can move the keyboard device 13 with the base plate arrangement 18 in the second state M2 towards the opening 22. The user can then insert the keyboard device into the docking station 21 through the opening 22, as shown by an arrow A3. This ensures a mechanical support to the keyboard device 13 and also provides protection to the keyboard device 13 from wear in case of occasional jerks during the driving of the vehicle 11 .

The portable core element 14 can comprise an energy storage 23 and a plug 24. When the keyboard device 13 is inserted into the docking station 21 , the energy storage 23 can be electrically charged from the docking station 21 through the plug 24 by induction and/or conduction.

Fig. 2 shows a schematic illustration of an embodiment of the input unit 10. The keyboard device 13 with the base plate arrangement 18 in the second state M2 can be designed to function as a wireless pointer tool. In the second state M2 of the base plate arrangement 18, the user can use the keyboard device 13 as a wireless pointer tool to remotely send a second user input signal T2 to at least one predefined selectable element, for example the elec tronic user interface 12, as shown by an arrow P4. The second input signal T2 can comprise at least one of an activation signal A and/or a functionality selection signal F1 , F2, F3, F4.

In addition to the voice input sensor 15 and/or the motion detection sensor 16, the portable core element 14 of the keyboard device 13 can further com prise of a first sensor Q1 and a second sensor Q2. The first sensor Q1 and the second sensor Q2 can determine a position and/or orientation of the key board device 13 and provide information about the position and/or spatial orientation of the keyboard device 13 in form of a position signal U1 in the second user input signal T2.

The user can hold the keyboard device 13 with the base plate arrangement 18 in the second state M2 with his hand 26 and point towards the electronic user interface 12. The user can press a first selection element X1 on a sec ond side B2 of the base plate arrangement 18 to trigger and send an activa tion signal A in the second input signal T2 wirelessly to the electronic user interface 12. Furthermore a second input signal T2 with the position signal U1 can be also sent to the electronic user interface 12. The electronic user interface 12 receives the activation signal A and the position signal U1 and displays contents on the electronic display screen 25 of the electronic user interface 12. The connection of the keyboard device 13 to the electronic user interface 12 can be shown by means of a cursor 20. The user can move the cursor 20 on the electronic display screen 25 to music play list symbol and press a second selection button X2 on a second side B2 of the base plate arrangement 18. Flence, a second user input signal T2 with a functionality selection signal F1 is sent wirelessly to the electronic user interface 12. Thus, a music play list M is displayed on the electronic display screen 25. The mu sic play list M can display a part of a list of names of songs M1 , M2, M3, M4 and M5. In Fig. 2, the name of the song M3 is displayed as a selectable song in middle of the display screen 25. The user can select this song M3 by pressing the section button X2 and there by sending a second user input sig nal T2 with a functionality selection signal F2 wirelessly to the electronic user interface 12. However, if the user prefers to select the song M2 instead of the song M3, then the user can move and/or rotate his hand 26 holding the keyboard de vice 13 towards the right, as shown by an arrow A5, and press the selection button X2. Due to the presence of the motion detection sensor 16, a second user input signal T2 with motion signal R1 can be sent to the electronic user interface 12. The electronic user interface 12 can receive the motion signal R1 , which provides information of the motion of the hand 26 relative to the original position and/or orientation of the hand 26 according to the position signal U1. The processor processes the motion signal R1 and the position signal U 1 , and identifies the desired song M2 by the user. The processor moves the name of the song M2 in the middle of the electronic display screen 25 of the electronic user interface 12. Hence, by pressing the selec tion button X2, the user can send a second user input signal T2 with a func tionality selection signal F3, in order to play the song M2.

Similarly, if the user prefers to select the song M4 instead of the song M3, then the user can move and/or rotate his hand 26 holding the keyboard de vice 13 towards the left, as shown by an arrow A6, and press the selection button X2. Due to the presence of the motion detection sensor 16, a second user input signal T2 with motion signal R2 can be sent to the electronic user interface 12. The electronic user interface 12 can the motion signal R2, which provides information of the motion of the hand 26 relative to the original posi tion and/or orientation of the hand 26 according to the position signal U1. The processor processes the motion signal R2 and the position signal U 1 , and identifies the desired song M4 by the user. The processor moves the name of the song M4 in the middle of the electronic display screen 25 of the elec tronic user interface 12. Hence, by pressing the selection button X2, the user can send a second user input signal T2 with a functionality selection signal F4, in order to play the song M2.

Furthermore, if the user prefers to increase the volume of the selected song M3, then the user can move and/or rotate his hand 26 holding the keyboard device 13 towards upward direction, as shown by an arrow A7, and press the selection button X2. Due to the presence of the motion detection sensor 16, a second user input signal T2 with motion signal R3 can be sent to the elec tronic user interface 12. The electronic user interface 12 can the motion sig nal R3, which provides information of the motion of the hand 26 relative to the original position and/or orientation of the hand 26 according to the posi- tion signal U1. The processor processes the motion signal R3 and the posi tion signal U1 , and identifies the desired action by the user, that is to in crease the volume of the selected song M3. The processor displays a vol ume bar 28 on the electronic display screen 25 of the electronic user inter face 12. Hence, by pressing the selection button X2, the user can send a second user input signal T2 with a functionality selection signal F5, in order to increase the volume of the selected song M3. Similarly, in order to de crease the volume of the selected song M2, the user can move and/or rotate his hand 26 holding the keyboard device 13 towards upward direction, as shown by an arrow A8, and press the selection button X2.

Fig. 3 shows a schematic illustration of an embodiment of the input unit 10.

In the second state M2 of the base plate arrangement 18, the user can use the keyboard device 13 as a wireless pointer tool and point towards a loca tion, for example a parking space P0 in a parking place P with vehicles V1 , V2, V3, V4 and V5. The user can provide a voice input signal V, shown by marked lines L, for example“drive to the parking space”. The input device can further comprise a tracking unit 17, which is designed to detect a relative spatial position and/or orientation of the keyboard device 13 with respect to the tracking unit 17.

The user can press a first selection element X1 on a second side B2 of the base plate arrangement 18 to trigger an activation signal A in a second input signal T2. Due to the voice input signal V, the second input signal T2 with the activation signal A and the voice input signal V, is sent or directed to a cen tral electronic unit 27. This is shown by an arrow A9.

The a tracking unit 17 can detect a relative spatial position and/or orientation of the keyboard device 13 with respect to the tracking unit 17 by detecting the relative positions of the first sensor Q1 and the second sensor Q2 . This can be achieved by means of, for example time-of-flight camera. The track ing unit 17 can send a tracking signal U2 to the central electronic unit 27. This is shown by an arrow A10. The tracking signal U2 can comprise the in formation about the relative spatial position and/or orientation of the key board device 13 with respect to the tracking unit 17. Based on the tracking signal U2 and the second user input signal with voice input signal V, the cen tral electronic unit can locate the parking space P0 and drive the vehicle 11 to the parking space P0 autonomously. Overall, the examples show how a user input may be provided to an elec tronic user interface remotely by means of an input unit.