System for locating mobile display devices

• US 9,633,440 B2
• Filed: 10/27/2014
• Issued: 04/25/2017
• Est. Priority Date: 10/28/2013
• Status: Expired due to Fees

• Current Assignee: Raphael Holtzman
• Original Assignee: Raphael Holtzman
• Inventors: Holtzman, Raphael
• Primary Examiner(s): NAKHJAVAN, SHERVIN K
• Application Number:
  US14/525,153
• Publication Number:
  US 20150117710A1
• Time in Patent Office: 911 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

A system is provided in which a mobile display device, such as a cellular phone, a computing tablet, a mobile computer or any other portable device that incorporates a computing element and a display element, is adapted to display a predetermined pattern. The pattern can be either visible or invisible to human eye. An image sensor (most likely, but not necessarily, an optical one) detects said pattern, and the location of the MDD is determined in relation to the sensor. In one embodiment, the MDD displays a pattern on the device'"'"'s standard display, for example four points of unique character, such as color or blinking pattern. Such a method will allow a cost-effective way to implement the system, as it requires no additional cost in hardware. In another embodiment, the system recognizes the display unit of the MDD (instead of a specific pattern on the MDD'"'"'s display) and can determine location of the MDD without any change to the MDD'"'"'s hardware or software. In yet another embodiment, the system includes bi-directional wireless communication between the receiver and the MDD and software that allows the MDD to exchange information with the system, such as the exact dimensions of the display.

Claims

1. A system for determining the location and orientation of powered mobile display devices (MDDs), comprising:

a. a MDD configured with a powered display screen capable of displaying multiple patterns;

b. at least one sensor that is positioned to capture an image such that the powered display screens of said MDD are included in the image and that transmits the captured image to a data-extraction software component of the system;

c. a processor configured to execute;

i. a data-extraction software component that computes the size and shape data of the display screen of said MDD in said captured image;

ii. a triangulation software component that compares said screen size and shape data with screen size and shape information from a server and calculates the location and orientation of said MDD;

iii. and a data transmission module that transmits said location and orientation information to said MDD or to a server.

2. The system of claim 1, wherein the MDD displays multiple patterns on its powered display in a manner that can be detected by the system sensor(s).

3. The system of claim 1, wherein the MDD-powered display shows an active pattern that changes over time and can be detected by the system sensor(s).

4. The system of claim 1, wherein the sensor(s) of the system are built into or retrofitted to a ceiling-mounted or wall-mounted equipment.

5. The system of claim 1, wherein the sensor(s) of the system is/are contained in a physical module that can connect into any commercially available powered lighting fixture and draw power from said fixture.

6. The system of claim 1, wherein each MDD-powered display can be made to display a pattern that is unique to that specific MDD in a manner that can be detected by the system sensor(s).

7. A system for determining the location and orientation of powered mobile display devices (MDDs) comprising:

a. an MDD incorporating at least one sensor that captures an image of a reference target on a ceiling or walls;

b. a processor in the MDD or in a server configured to execute;

i. an image extraction software module that extracts from said image data the size and proportions of said reference target; and

ii. a triangulation software module comparing the data extracted by the image extraction software module with the known data of said reference target and calculates the location and orientation of said MDD.

8. The system of claim 7, wherein the reference target is active and changes over time.

9. The system of claim 7, wherein the server stores information about the reference target to be used in calculating the distance and orientation of the reference target.

10. The system of claim 7, wherein the reference target resides on or is built into the physical hardware containing the sensor(s).