INTEGRATED INTERNAL AND EXTERNAL CAMERA SYSTEM IN VEHICLES

• US 20190325219A1
• Filed: 04/19/2019
• Published: 10/24/2019
• Est. Priority Date: 04/23/2018
• Status: Active Grant

• Current Assignee: Alpine Electronics of Silicon Valley, Inc. (Alps Alpine Co., Ltd.)
• Original Assignee: Alpine Electronics of Silicon Valley, Inc. (Alps Alpine Co., Ltd.)
• Inventors: Lin, Rocky Chau-Hsiung, Yamasaki, Thomas, Kanda, Koichiro, Risco, Diego Rodriguez, Ryan, Alexander Joseph, Najeeb, Samah, El Aouar, Samir
• Granted Patent: US 11,900,672 B2
• Time in Patent Office: Days
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Devices, systems and processes for an integrated internal and external camera system that enhances the passenger experience in vehicles are described. One example method for enhancing a passenger experiences includes capturing a first set of images of an area around the vehicle using an external camera system, capturing a second set of images of one or more passengers inside the vehicle using an internal camera system, recognizing at least one gesture made by the one or more passengers based on the second set of images, identifying an object or a location external to the vehicle based on the first set of images and the at least one gesture, and displaying information related to the object or the location to the one or more passengers.

Claims

1. A camera system for use with a vehicle, comprising:

a processor;

an external camera system coupled to the processor, wherein the external camera system is configured to capture a first set of images of an area around the vehicle;

an internal camera system coupled to the processor, wherein the internal camera system is configured to capture a second set of images of one or more passengers inside the vehicle; and

a display system coupled to the processor,

wherein the processor is configured to;

recognize, based on the second set of images, at least one gesture made by the one or more passengers,

identify, based on the first set of images and the at least one gesture, an object or location located outside the vehicle, and

display, using the display system, information related to the object or location to the one or more passengers.

2. The system of claim 1,

wherein the processor is further configured to determine a location of the vehicle, and

wherein the processor is configured to identify the object or location located outside the vehicle further based on the location of the vehicle.

3. The system of claim 1,

wherein the processor is further configured to determine a field of view of the one or more passengers, and

wherein the processor is configured to identify the object or location located outside the vehicle further based on the field of view.

4. The system of claim 1,

wherein the information related to the object or location is selected from a point-of-interest dataset.

5. The system of claim 4,

wherein the point-of-interest dataset is generated based on a location of the vehicle.

6. The system of claim 5,

wherein the point-of-interest dataset is generated further based on a direction of travel of the vehicle.

7. The system of claim 1,

wherein the at least one gesture includes a pointing gesture.

8. The system of claim 1,

wherein the at least one gesture includes a framing gesture.

9. The system of claim 1,

wherein the display system displays the information related to the object or location on a window surface of the vehicle.

10. The system of claim 9,

wherein the display system displays the information related to the object or location in an augmented reality format.

11. A method for use with a vehicle, comprising:

capturing a first set of images of an area around the vehicle;

capturing a second set of images of one or more passengers inside the vehicle;

recognizing, based on the second set of images, at least one gesture made by the one or more passengers;

identifying, based on the first set of images and the at least one gesture, an object or location located outside the vehicle; and

displaying information related to the object or location to the one or more passengers.

12. The method of claim 11, further comprising:

determining a location of the vehicle,

wherein the identifying the object or location located outside the vehicle is further based on the location of the vehicle.

13. The method of claim 11, further comprising:

determining a field of view of the one or more passengers, and

wherein the identifying the object or location located outside the vehicle is further based on the field of view.

14. The method of claim 11, further comprising:

wherein the information related to the object or location is selected from a point-of-interest dataset.

15. The method of claim 14,

wherein the point-of-interest dataset is generated based on a location of the vehicle.

16. The method of claim 15,

wherein the point-of-interest dataset is generated further based on a direction of travel of the vehicle.

17. The method of claim 11,

wherein the at least one gesture includes a pointing gesture.

18. The method of claim 11,

wherein the at least one gesture includes a framing gesture.

19. The method of claim 11,

wherein the displaying the information related to the object or location is performed so that the information related to the object or location is displayed on a window surface of the vehicle.

20. The method of claim 19,

wherein the displaying the information related to the object or location is performed so that the information related to the object or location is displayed in an augmented reality format.