ENHANCED SAFETY THROUGH AUGMENTED REALITY AND SHARED DATA

• US 20180003965A1
• Filed: 06/30/2016
• Published: 01/04/2018
• Est. Priority Date: 06/30/2016
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: O'Toole, Christopher Diebold, Luk, Bryant Genepang, Das, Ananya, Ziaja, Jason, Warman, Shaun
• Granted Patent: US 10,088,676 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G08G 1/052 with provision for determining speed or overspeed speed measuring in general G01P
• CPC Class Codes: G08G 1/08 according to detected number or speed of vehicles
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

Systems and methods for enhancing traffic safety through augmented reality and shared data are disclosed. An example method includes, identifying a second transportation vehicle that at least partially blocks a first view of a first user associated with a first transportation vehicle; and obtaining second view data from the second transportation vehicle. The second view data is descriptive of a second view of a second user associated with the second transportation vehicle, and the second view includes an additional view that was blocked in the first view by the second transportation vehicle. In some implementations, the method includes presenting the second view on a first display associated with the first transportation vehicle. In other implementations, for example where the first transportation vehicle is a driver-less vehicle, the method includes providing an electronic signal identifying the second view to the first transportation vehicle.

Claims

1. A device, comprising:

a non-transitory memory; and

one or more hardware processors coupled to the non-transitory memory and configured to execute instructions from the non-transitory memory to cause the device to perform operations comprising;

identifying a second transportation vehicle that at least partially blocks a first view of a first user associated with a first transportation vehicle;

obtaining second view data from the second transportation vehicle, wherein the second view data corresponds to a second view of a second user associated with the second transportation vehicle, and wherein the second view includes an additional view that was blocked in the first view by the second transportation vehicle; and

presenting the second view on a first display associated with the first transportation vehicle.

2. The device of claim 1, wherein the operations further comprise:

obtaining verification data from a street device, wherein the verification data is descriptive of the second view;

verifying the second view in accordance with the verification data; and

in response to the verifying, presenting the second view on the first display associated with the first transportation vehicle.

3. The device of claim 2, wherein the street device includes one of:

a traffic control device, or a lighting device.

4. The device of claim 3, wherein the street device is a traffic control device, and the operations further comprise:

determining a traffic control signal shown by the traffic control device; and

determining that a second object present in the second view is not following the traffic control signal; and

in response to the determining that the second object present in the second view is not following the traffic control signal, presenting the second view on the first display associated with the first transportation vehicle.

5. The device of claim 1, wherein the operations further comprise:

obtaining rating data associated with the second view data; and

determining whether to present the second view on the first display in accordance with the rating data.

6. The device of claim 1, wherein the operations further comprise:

determining a travel speed associated with a second object present in the second view is more than a predetermined speed; and

in response to the determining, presenting the second view on the first display associated with the first transportation vehicle.

7. The device of claim 1, wherein the operations are performed without user input, in response to determining that the first transportation vehicle is moving below a predetermined speed.

8. The device of claim 1, wherein the operations are performed without user input, in response to determining that the second transportation vehicle is blocking the first view.

9. The device of claim 1, wherein the second view data is obtained from the second transportation vehicle through a directional Wi-Fi or Bluetooth communication channel between the first transportation vehicle and the second transportation vehicle.

10. The device of claim 1, wherein the second view data includes audio data and image data captured by a camera installed on the second transportation vehicle.

11. A method, comprising:

identifying a second transportation vehicle that at least partially blocks a first view of a first user associated with a first transportation vehicle;

obtaining second view data from the second transportation vehicle, wherein the second view data is descriptive of a second view of a second user associated with the second transportation vehicle, and wherein the second view includes an additional view that was blocked in the first view by the second transportation vehicle; and

providing an electronic signal identifying the second view to the first transportation vehicle.

12. The method of claim 11, wherein the first transportation vehicle is a driver-less vehicle.

13. The method of claim 11, further comprising:

obtaining verification data from a street device, wherein the verification data is descriptive of the second view;

verifying the second view in accordance with the verification data; and

in response to the verifying, presenting the second view on the first display associated with the first transportation vehicle.

14. The method of claim 13, wherein the street device includes one of:

a traffic control device, and a lighting device.

15. A device, comprising:

a non-transitory memory; and

one or more hardware processors coupled to the non-transitory memory and configured to execute instructions from the non-transitory memory to cause the device to perform operations comprising;

identifying a second transportation vehicle that at least partially blocks a first view of a first user associated with a first transportation vehicle;

obtaining second view data from the second transportation vehicle, wherein the second view data corresponds to a second view of a second user associated with the second transportation vehicle, and wherein the second view includes an additional view that was blocked in the first view by the second transportation vehicle;

obtaining verification data from a third source, wherein the verification view data overlaps at least a portion of the second view;

verifying the second view data in accordance with the verification data;

in response to the verifying, determining that the second view data is accurate; and

presenting the second view on a first display associated with the first transportation vehicle.

16. The device of claim 15, wherein verifying the second view data in accordance with the verification data includes:

applying an image recognition technique to a second image included in the second view data and to a verification image included in the verification data;

determining that the second image includes a second object;

determining that the verification image also includes the second object; and

determining the second view data as accurate.

17. The device of claim 15, wherein verifying the second view data in accordance with the verification data includes:

(A) applying an object recognition technique to a second image included in the second view data;

based on the applying (A), determining that the second image includes an object;

(B) applying an object detection technique to the verification data;

based on the applying (B), determining that the an object is present in the second view; and

determining the second view data as accurate.

18. The device of claim 15, wherein verifying the second view data in accordance with the verification data includes:

(A) applying an object recognition technique to a second image included in the second view data;

based on the applying (A), determining that the second image includes an object;

applying a sound analysis technique to the verification data;

identifying a vehicle sound in the verification data; and

in response to the identifying, determining the second view data as accurate.

19. The device of claim 15, wherein the third source includes one of:

a traffic control device, a lighting device, or a traffic speed measurement device.

20. The device of claim 15, wherein the verification data includes one of:

vehicle sound, human sound, traffic sound, traffic device sound, or movement sound.