Apparatus and method for connecting a mobile device camera

• US 10,346,689 B2
• Filed: 10/29/2015
• Issued: 07/09/2019
• Est. Priority Date: 10/30/2014
• Status: Active Grant

• Current Assignee: Volkswagen AG
• Original Assignee: Volkswagen AG
• Inventors: Max, Stephan, Brosig, Stefan, Katzwinkel, Reiner, Tanneberger, Volkmar, Beckmann, Mark, Kollmorgen, Stefan, Bosse, Stefan, Grummel, Thomas, Titze, Andreas
• Primary Examiner(s): Wilson, Nicholas R
• Application Number:
  US14/926,252
• Publication Number:
  US 20160125250A1
• Time in Patent Office: 1,349 Days
• Field of Search: None
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/55 Remote control arrangements
• CPC Class Codes: B60K 2360/563 Vehicle displaying mobile device information
• CPC Class Codes: B60K 2360/573 Mobile devices controlling vehicle functions
• CPC Class Codes: B60K 2360/589 Wireless data transfers
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments
• CPC Class Codes: B60K 35/85 Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/22 for viewing an area outside the vehicle, e.g. the exterior of the vehicle
• CPC Class Codes: B60R 1/29 for viewing an area inside the vehicle, e.g. for viewing passengers or cargo
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/108 using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B60R 2300/8013 for child monitoring
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 : including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control
• CPC Class Codes: H04W 4/046 : involving vehicles, e.g. floating traffic data [FTD] or vehicle traffic prediction
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]

Abstract

An apparatus and a method for connecting a mobile camera device to a vehicle-mounted display apparatus, wherein the mobile camera device is controlled both by the driver operating the mobile camera device as well as by additional information regarding the state of the vehicle, wherein the additional information is provided by vehicle sensors. The information from the driver and the vehicle is processed by an application program on the mobile camera device and the mobile camera device is controlled. The mobile camera device can display images and/or videos and process the images and/or videos by way of the application program. The information to be processed can be displayed on the display of the vehicle-mounted display apparatus.

Claims

1. A vehicle-mounted display apparatus for connecting a mobile camera device to a vehicle, the apparatus comprising:

a display;

an interface for connecting the vehicle-mounted display apparatus to the mobile camera device; and

a processing device for controlling an application program on the mobile camera device, wherein the processing device, by way of the interface, transmits vehicle sensor data to the application program, receives image data and displays said image data on the display,

wherein the vehicle-mounted display apparatus processes information provided by the vehicle and transmits said information to the application program on the mobile camera device, and the application program controls the mobile camera device based upon the information,

wherein the information provided to the application program on the mobile camera device is information regarding the vehicle state,

wherein the mobile camera device is an external mobile camera that is wirelessly connected to a smartphone, and

wherein the application program is configured to control cameras made by a plurality of different manufacturers so that no adjustments are made to the vehicle-mounted display apparatus in response to operation of a different external mobile camera,

wherein the information regarding the vehicle state is provided independent of driver input, and

wherein the vehicle state is determined by sensors in the vehicle,

wherein the sensors comprise brightness sensors, and wherein an aperture of the external mobile camera is controlled by the brightness sensors.

2. The vehicle-mounted display apparatus of claim 1, wherein the vehicle-mounted display apparatus is further configured to control, by way of the application program, the mobile camera device by operating elements on the vehicle-mounted display apparatus.

3. The vehicle-mounted display apparatus of claim 1, wherein the vehicle-mounted display apparatus is further configured to receive the image data from the mobile camera device by way of the application program in real time and to display said image data on the display.

4. The vehicle-mounted display apparatus of claim 1, wherein the vehicle-mounted display apparatus is further configured to receive, by way of the application program, the image data from the mobile camera device and to process said image data within a scope of an augmented reality analysis.

5. The vehicle-mounted display apparatus of claim 1, wherein the vehicle-mounted display apparatus is further configured to receive, by way of the application program, the image data from the mobile camera device and to process said data within a scope of a traffic and safety analysis.

6. The mobile device of claim 1, wherein the processing device stores film in a virtual ring memory storage, and in response to an emergency mechanism in the vehicle detecting an accident, information related to detecting the accident is relayed to the application program so that recording of images is stopped or the recording of images is continued until a duration of time of recorded image contents on the ring memory storage falls below a specific time.

7. A method for connecting a mobile camera device to a vehicle, the method comprising:

transmitting data by way of an interface from a vehicle-mounted display apparatus to an application program on a mobile camera device for controlling the mobile camera device;

processing, via a processing device, the data in the application program and controlling the mobile camera device by way of the interface;

transmitting image data from the mobile camera device to the application program on the mobile camera device; and

transmitting the image data from application program to the vehicle-mounted display apparatus and displaying the image data on a display; and

transmitting information from the vehicle-mounted display apparatus for processing to the application program on the mobile camera device for controlling the mobile camera device based upon the information from the vehicle-mounted display apparatus,

wherein the information from the vehicle-mounted display apparatus provided to the application program on the mobile camera device is information regarding the vehicle state,

wherein the mobile camera device is an external mobile camera that is wirelessly connected to a smartphone, and

wherein the application program is configured to control cameras made by a plurality of different manufacturers so that no adjustments are made to the vehicle-mounted display apparatus in response to operation of a different external mobile camera,

wherein the information regarding the vehicle state is provided independent of driver input, and

wherein the vehicle state is determined by sensors in the vehicle,

wherein the sensors comprise brightness sensors, and wherein an aperture of the external mobile camera is controlled by the brightness sensors.

8. The method of claim 7, wherein the vehicle-mounted display apparatus is controlled, by way of the application program, and the mobile camera device is controlled by operating elements on the vehicle-mounted display apparatus.

9. The method of claim 7, wherein the vehicle-mounted display apparatus receives the image data from the mobile camera device by way of the application program in real time and displays said image data on the display.

10. The method of claim 7, wherein the vehicle-mounted display apparatus receives, by way of the application program, the image data from the mobile camera device and to process said image data within a scope of an augmented reality analysis.

11. The method of claim 7, wherein the vehicle-mounted display apparatus receives, by way of the application program, the image data from the mobile camera device and to process said data within a scope of a traffic and safety analysis.

12. The method of claim 7, wherein the mobile camera device stores film in a virtual ring memory storage, and in response to an emergency mechanism in the vehicle detecting an accident, information related to detecting the accident is relayed to the application program so that recording of images is stopped or the recording of images is continued until a duration of time of recorded image contents on the ring memory storage falls below a specific time.