Apparatus and method for transmitting and rendering augmented reality information

• US 10,235,123 B2
• Filed: 04/07/2017
• Issued: 03/19/2019
• Est. Priority Date: 04/07/2017
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Motorola Solutions, Inc.
• Inventors: Kreitzer, Stuart S., Corretjer, Jesus F.
• Primary Examiner(s): McCulley, Ryan
• Application Number:
  US15/482,077
• Publication Number:
  US 20180293040A1
• Time in Patent Office: 711 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/61 Scene description
• CPC Class Codes: G08G 1/00 Traffic control systems for road vehicles arrangement of road signs or traffic signals E01F9/00 ; automatic vehicle control B62D
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/017 identifying vehicles G08G1/015, G08G1/054 take precedence

Abstract

A method and apparatus for registering, by a first controller associated with a vehicle, at least one information device associated with an occupant when the occupant enters the vehicle. The first controller obtains vehicle information and obtains information associated with each registered occupant from the at least one information device associated with the registered occupant. The first controller transmits the vehicle information and information associated with each registered occupant of the vehicle to an augmented reality viewer, wherein transmitted information is overlaid on an image of the vehicle rendered on the augmented reality viewer.

Claims

1. A method for providing public safety officer information in an augmented reality environment, the method comprising:

registering, by a first controller associated with a public service vehicle, at least one information device associated with an occupant subsequent to the occupant entering the public service vehicle;

obtaining, by the first controller, vehicle information;

obtaining, by the first controller, information associated with each registered occupant from at least one information device associated with the registered occupant, wherein the information associated with the registered occupant includes a duty status associated with the registered occupant, the registered occupant being a public safety officer, wherein the duty status comprises one or more of whether the registered occupant is off-duty, on-duty, in-pursuit or in an undercover operation; and

transmitting, by the first controller to an augmented reality viewer, the vehicle information and the information associated with each registered occupant of the public service vehicle, wherein the transmitted information is overlaid on an image of the public service vehicle rendered on the augmented reality viewer.

2. The method of claim 1, wherein the registering comprises wirelessly connecting the first controller with at least one information device associated with each registered occupant of the public service vehicle.

3. The method of claim 1, wherein the transmitting further comprises:

transmitting, by the first controller, the vehicle information and the information associated with each registered occupant of the public service vehicle to a second controller associated with the augmented reality viewer.

4. The method of claim 1, wherein the transmitting further comprises:

determining that the public service vehicle is within a predefined proximity of the augmented reality viewer; and

transmitting, by the first controller to the augmented reality viewer, the vehicle information and the information associated with each registered occupant of the public service vehicle.

5. The method of claim 1, wherein the transmitting further comprises:

determining that the public service vehicle is within a predefined proximity of the augmented reality viewer; and

transmitting, by the first controller to the augmented reality viewer, the vehicle information and the information associated with each registered occupant of the public service vehicle subsequent to a line of sight between the public service vehicle and the augmented reality viewer becoming obstructed.

6. The method of claim 1, further comprising:

determining when an exiting occupant leaves the public service vehicle;

deleting, by the first controller, a registration of the exiting occupant subsequent to the exiting occupant leaving the public service vehicle; and

removing, by the first controller, information associated with the exiting occupant from information transmitted to the augmented reality viewer.

7. The method of claim 1, wherein the vehicle information transmitted to the augmented reality viewer is used to track the public service vehicle when the public service vehicle is within a predefined proximity of the augmented reality viewer.

8. The method of claim 1, further comprising filtering the information associated with the registered occupant based on whether the registered occupant is involved in the undercover operation.

9. The method of claim 1, wherein the information associated with the registered occupant further includes experience information.

10. A controller device for providing public safety officer information in an augmented reality environment, the controller device comprising:

a memory storing computer-executable instructions;

a transceiver; and

an electronic processor configured to perform a set of functions in response to executing the computer-executable instructions, the set of functions including;

registering, by the controller device associated with a public service vehicle, at least one information device associated with an occupant subsequent to the occupant entering the public service vehicle;

obtaining, by the controller device, vehicle information;

obtaining, by the controller device, information associated with each registered occupant from at least one information device associated with the registered occupant, wherein the information associated with the registered occupant includes a duty status associated with the registered occupant, the registered occupant being a public safety officer, wherein the duty status comprises one or more of whether the registered occupant is off-duty, on-duty, in-pursuit or in an undercover operation; and

transmitting, by the controller device to an augmented reality viewer, the vehicle information and the information associated with each registered occupant of the public service vehicle, wherein the transmitted information is overlaid on an image of the public service vehicle rendered on the augmented reality viewer.

11. The controller device of claim 10, further configured to wirelessly connect with at least one information device associated with each registered occupant of the public service vehicle.

12. The controller device of claim 10, further configured to transmit the vehicle information and the information associated with each registered occupant of the public service vehicle to another controller associated with the augmented reality viewer.

13. The controller device of claim 10, further configured to:

determine that the public service vehicle is within a predefined proximity of the augmented reality viewer; and

transmit, to the augmented reality viewer, the vehicle information and the information associated with each registered occupant of the public service vehicle.

14. The controller device of claim 10, further configured to:

determine when an exiting occupant leaves the public service vehicle

delete a registration of the exiting occupant subsequent to the exiting occupant leaving the public service vehicle; and

remove information associated with the exiting occupant from information transmitted to the augmented reality viewer.

15. The controller device of claim 10, wherein the set of functions further include filtering the information associated with the registered occupant based on whether the registered occupant is involved in the undercover operation.

16. The controller device of claim 10, wherein the information associated with the registered occupant further includes experience information.

17. An augmented reality controller associated with an augmented reality viewer, the augmented reality controller for providing public safety officer information in an augmented reality environment, the augmented reality controller comprising:

a memory storing computer-executable instructions;

a transceiver; and

an electronic processor configured to perform a set of functions in response to executing the computer-executable instructions, the set of functions including;

identifying a public service vehicle capable of transmitting augmented reality information;

determining that the public service vehicle is within a predetermined proximity from the augmented reality viewer;

transmitting a request to a vehicle controller device associated with the public service vehicle, wherein the request includes a viewer profile of a user of the augmented reality viewer;

receiving data from the vehicle controller device in compliance with the viewer profile and policy information accessed by the vehicle controller device, the data received from the vehicle controller device including information associated with each occupant of the public service vehicle including a duty status associated with each occupant, each occupant being a public safety officer, wherein the duty status comprises one or more of whether each occupant is off-duty, on-duty, in-pursuit or in an undercover operation, and wherein the information associated with each occupant is obtained by the vehicle controller device from an information device associated with each occupant;

generating augmented reality visual data based on the data received from the vehicle controller device; and

transmitting the augmented reality visual data to the augmented reality viewer, wherein the augmented reality visual data is overlaid on an image of the public service vehicle rendered on the augmented reality viewer.

18. The augmented reality controller of claim 17, wherein the determining comprises using a matching parameter associated with the public service vehicle to determine that the public service vehicle is within the predetermined proximity from the augmented reality viewer.

19. The augmented reality controller of claim 17, wherein the set of functions further include filtering the information associated with each occupant based on whether each occupant is involved in the undercover operation.

20. The augmented reality controller of claim 17, wherein the information associated with each occupant further includes experience information.