Methods and systems for multiple access to a single hardware data stream

• US 10,318,361 B2
• Filed: 07/01/2015
• Issued: 06/11/2019
• Est. Priority Date: 07/02/2014
• Status: Active Grant

• Current Assignee: West Texas Technology Partners LLC
• Original Assignee: Atheer, Inc.
• Inventors: Fink, Ryan, Phelps, Ryan, Peck, Gary, Ransil, Bryan
• Primary Examiner(s): Truong, Lechi
• Application Number:
  US14/789,797
• Publication Number:
  US 20160004575A1
• Time in Patent Office: 1,441 Days
• Field of Search: 719328
• CPC Class Codes: G06F 9/4411 Configuring for operating with peripheral devices; Loading of device drivers
• CPC Class Codes: G06F 9/44505 Configuring for program initiating, e.g. using registry, configuration files
• CPC Class Codes: G06F 9/541 via adapters, e.g. between incompatible applications
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes
• CPC Class Codes: G06F 9/545 where tasks reside in different layers, e.g. user- and kernel-space

Abstract

Methods for providing simultaneous access to a hardware data stream to multiple applications are disclosed. The first application to access a hardware device is responsible for providing and publishing an application programming interface (API) that provides access to the hardware device'"'"'s data stream, which other applications can then call to gain access to the data stream. In some examples, the first application may be a server process or daemon dedicated to managing the hardware device data stream and publishing the API. In some further examples, the first application may instead may carry out user functionality unrelated to managing the hardware device.

Claims

1. A method comprising:

initializing, by a first application, a camera that generates an image stream that includes a plurality of images;

establishing, by the first application, exclusive control of the camera, wherein;

the exclusive control of the camera comprise controlling settings of the camera; and

a second application cannot control the settings of the camera;

receiving, from the camera, the image stream at the first application;

establishing, by the first application, an application programming interface (API);

advertising, by the first application, the API;

receiving, at the API, a request from the second application to access the image stream;

sending, by the API, the image stream to the first application and the second application, wherein;

the image stream is a single image stream received from the camera; and

the image stream is the single image stream provided to both the first application and the second application at the same point in time;

analyzing, by the first application, the image stream to determine gesture information from a user;

analyzing, by the second application, the image stream to generate an augmented reality object to overlay onto the image stream;

executing, by the first application, an instruction based on the gesture information; and

overlaying, by the second application, the augmented reality object onto the image stream.

2. The method of claim 1, wherein the first application is a server daemon.

3. The method of claim 1, wherein the first application is a user application.

4. The method of claim 1, wherein initializing the camera further comprises:

querying the camera to determine capabilities and characteristics of the camera; and

initiating the image stream.

5. The method of claim 1, further comprising:

in response to receiving the request to access the image stream of the camera, initiating the first application; and

in response to no further applications accessing the image stream, terminating the first application.

6. The method of claim 1, further comprising:

receiving, at the first application, another request from the second application to change a first setting of the camera;

determining, by the first application, whether the other request conflicts with a second setting required by the first application;

in response to the other request not conflicting with the second setting required by the first application, changing the first setting of the camera as indicated in the other request; and

in response to the other request conflicting with the second setting required by the first application, maintaining the second setting of the camera.

7. A system, comprising:

a data storage device to store instructions;

a processor coupled to the data storage device, the processor operable to execute the instructions; and

a camera coupled to the processor, the camera to generate an image stream, wherein the processor is to;

establish a first application with exclusive control of the camera, wherein;

the exclusive control of the camera comprise controlling the settings of the camera; and

a second application cannot control the settings of the camera;

receive, at the first application, the image stream from the camera;

establish, by the first application, an application programming interface (API);

advertise, by the first application, the API receive, at the API, a request from the second application to access the image stream at the API;

send, by the API, the image stream to the first application and the second application, wherein;

the image stream is a single image stream received from the camera; and

the image stream is the single image stream provided to both the first application and the second application at the same point in time;

analyze, by the first application, the image stream to determine gesture information from a user;

analyze, by the second application, the image stream to generate an augmented reality object to overlay onto the image stream;

execute, by the first application, an instruction based on the gesture information; and

overlay, by the second application, the augmented reality object onto the image stream.

8. The system of claim 7 wherein the processor is further to:

initialize the camera in response to receiving the request from the first application access the camera.

9. The system of claim 7 wherein the processor is further to initialize the API in response to the initializing the camera, wherein the API is a server daemon.

10. The system of claim 7, wherein the processor is further to write the image stream into a buffer.

11. The system of claim 7, wherein the processor is further to write the image stream into a buffer, wherein the buffer is a circular buffer.

12. The system of claim 7, wherein the processor is to:

receive, at the first application, another request from the second application to change a first setting of the camera;

determine, by the first application, whether the other request conflicts with a second setting required by the first application;

in response to the other request not conflicting with the second setting required by the first application, change the first setting of the camera as indicated in the other request; and

in response to the other request conflicting with the second setting required by the first application, maintain the first setting of the camera.

13. A non-transitory computer-readable storage medium to store a set of instructions that when executed by a processor, cause the processor to:

initialize a hardware device;

receive a data stream from the hardware device;

establish a first application with exclusive control of the hardware device, wherein;

the exclusive control of the hardware device comprise controlling the settings of the hardware device; and

a second application cannot control the settings of the hardware device;

receive the data stream at the first application;

establish an application programming interface (API);

advertise the API to the second application;

receive a request from the second application to access the data stream;

send the data stream to the second application, wherein;

the data stream is a single data stream received from the hardware device; and

the data stream is the single data stream provided to both the first application and the second application at the same point in time;

analyze, by the first application, the data stream to determine gesture information from a user;

analyze, by the second application, the data stream to generate an augmented reality object to integrate into the data stream;

execute, by the first application, an instruction of the set of instructions based on the gesture information; and

integrate, by the second application, the augmented reality object into the data stream.

14. The non-transitory computer-readable storage medium of claim 13, wherein the processor is further to:

receive the data stream from the hardware device; and

store the data stream into a first buffer that is accessible by the first application and the second application.

15. The non-transitory computer-readable storage medium of claim 14, wherein the processor is further to copy the data stream from the first buffer to a second buffer, wherein the first buffer is accessible by the first application and the second buffer is accessible by the second application.

16. The non-transitory computer-readable storage medium of claim 13, wherein the processor is further to:

receive, at the first application, another request from the second application to change a first setting of the hardware device;

determine, by the first application, whether the other request conflicts with a second setting required by the first application;

in response to the other request not conflicting with the second setting required by the first application, change the setting of the hardware device as indicated in the other request; and

in response to the other request conflicting with the second setting required by the first application, maintain the first setting of the hardware device.