Arrangement for creating an image of a scene

• US 10,460,186 B2
• Filed: 11/19/2014
• Issued: 10/29/2019
• Est. Priority Date: 12/05/2013
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Schiek, Ulrich, Ibele, Philipp
• Primary Examiner(s): Bekele, Mekonen T
• Application Number:
  US15/101,541
• Publication Number:
  US 20160307056A1
• Time in Patent Office: 1,805 Days
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/151 Instrument output devices for configurable output
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G03B 2213/025 Sightline detection
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness

Abstract

To enable a user who is moving through or past a scene, e.g., along a path through a landscape or surrounding environment, and who wishes to record an image thereof, and to acquire or keep images of interest to the user without separate actuations or handling of the named type, a system is provided for producing at least one image of the scene, having at least one device for recording the at least one image, a device for acquiring a behavior of at least one user, a control unit for evaluating the behavior of the at least one user and for obtaining therefrom at least one control signal for a controlling of the device, including a selection of a recording direction and of image segments or objects that are to be recorded, for recording the at least one image in accordance with the behavior of the at least one user.

Claims

1. A system for creating at least one image of a scene and/or object, comprising:

at least one device for recording the at least one image of the scene and/or object, which is of a surrounding of the at least one user;

a device for acquiring a behavior of at least one user in viewing the scene and/or object, which is of the surrounding of the at least one user; and

a control unit for evaluating the behavior of the at least one user and for obtaining therefrom at least one control signal for a controlling of the device, including a selection of a recording direction and of image segments or objects that are to be recorded, for recording the at least one image in accordance with the behavior of the at least one user;

wherein the control unit is configured to evaluate at least one of the following features of the behavior of the at least one user;

i) a pupil size or a temporal change in this pupil size of the at least one user, ii) a vocalization or speech expression of the at least one user, and iii) a gesture of the at least one user, and wherein the control unit is configured to evaluate a facial expression of the at least one user, the facial expressions excluding sleepiness,

wherein a change of the at least one user'"'"'s direction of view from a route to be followed to a differing direction results in a control signal for taking a picture of the scene viewed by the at least one user, and

wherein the control unit is configured to evaluate a pupil size or a temporal change in this pupil size of the at least one user.

2. The system as recited in claim 1, wherein the device for acquiring the behavior of the at least one user includes at least one of:

i) at least one optical acquisition device, ii) at least one acoustic acquisition device, and iii) at least one position acquisition device.

3. The system as recited in claim 1, wherein the control unit is configured to further evaluate a duration and a direction of a view of the at least one user.

4. The system as recited in claim 1, further comprising:

a memory device for storing at least a selection of the recorded images.

5. The system as recited in claim 1, further comprising:

a display unit for displaying at least a selection of the recorded images.

6. The system as recited in claim 1, further comprising:

an operating unit for operating the system by inputting operating commands to the control unit.

7. The system as recited in claim 1, wherein the system is connected to a navigation unit that is set up to ascertain a position or direction of movement of the at least one user, and to transmit the ascertained position or direction of movement to the control unit for the selection of an image to be recorded and/or for linkage to at least a selection of the recorded images.

8. The system as recited in claim 1, wherein the system is situated in a vehicle, and wherein the at least one user includes at least one of a driver of the vehicle and a passenger of the vehicle.

9. The system as recited in claim 1, wherein the system is connected to a transmission unit for transmitting at least a selection of the acquired images to or via a communication network.

10. The system as recited in claim 1, wherein the system is connected to a computing unit for at least one of:

transmission, optional processing, storing of at least a selection of the recorded images, and controlling the system through the computing unit.

11. The system as recited in claim 1, wherein the scene and/or object is external to the vehicle.

12. The system as recited in claim 1, wherein the device for acquiring the behavior of the at least one user includes at least one of:

i) at least one optical acquisition device, ii) at least one acoustic acquisition device, and iii) at least one position acquisition device, and wherein the control unit is configured to evaluate at least the following features of the behavior of the at least one user;

i) a duration and a direction of a view of the at least one user, ii) a facial expression of the at least one user, iii) a vocalization or speech expression of the at least one user, and iv) a gesture of the at least one user.

13. The system as recited in claim 1, further comprising:

a memory device for storing at least a selection of the recorded images;

a display unit for displaying at least a selection of the recorded images; and

an operating unit for operating the system by inputting operating commands to the control unit.

14. The system as recited in claim 13, wherein the system is connected to a navigation unit that is set up to ascertain a position or direction of movement of the at least one user, and to transmit the ascertained position or direction of movement to the control unit for the selection of an image to be recorded and/or for linkage to at least a selection of the recorded images.

15. The system as recited in claim 13, wherein the system is situated in a vehicle, and wherein the at least one user includes at least one of a driver of the vehicle and a passenger of the vehicle, and wherein the system is connected to a transmission unit for transmitting at least a selection of the acquired images to or via a communication network.

16. The system as recited in claim 13, wherein the system is connected to a computing unit for at least one of:

transmission, optional processing, storing of at least a selection of the recorded images, and controlling the system through the computing unit.