Providing visualization data to a co-located plurality of mobile devices

• US 10,242,463 B2
• Filed: 10/26/2017
• Issued: 03/26/2019
• Est. Priority Date: 09/09/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hwang, Inseok, Kim, Myung-Chul, Taban, Gelareh, Yoo, Chungkuk
• Primary Examiner(s): Chu, David H
• Application Number:
  US15/795,140
• Publication Number:
  US 20180075624A1
• Time in Patent Office: 516 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G09G 2300/026 Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

A computer-implemented method according to one embodiment includes identifying, utilizing a hardware camera of a mobile device, vision code data from a plurality of additional devices, identifying an orientation of the mobile device, utilizing one or more sensors of the mobile device, calculating local observations utilizing the vision code data and the orientation, sending the local observations to a cloud-side service, receiving a timed tile sequence from the cloud-side service, in response to the sending of the local observations, and outputting the timed tile sequence, utilizing a display of the mobile device.

Claims

1. A computer-implemented method, comprising:

providing feedback by a mobile device to guide a placement of the mobile device to a predetermined orientation;

identifying, utilizing a hardware camera of the mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation;

identifying the actual orientation of the mobile device, utilizing one or more sensors of the mobile device;

calculating local observations at the mobile device utilizing the vision code data and the actual orientation;

sending the local observations from the mobile device to a cloud-side service;

receiving a timed tile sequence at the mobile device from the cloud-side service, in response to the sending of the local observations by the mobile device; and

outputting the timed tile sequence at the mobile device, utilizing a display of the mobile device.

2. The computer-implemented method of claim 1, wherein:

for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device,

the local observations include, for each of the plurality of additional devices, a relative angle between the mobile device and the additional device, and a relative orientation of the mobile device compared to the plurality of additional devices, and

the timed tile sequence is one of a plurality of timed tile sequences that create a composite image when displayed by the mobile device and the plurality of additional devices.

3. The computer-implemented method of claim 1, wherein the one or more sensors of the mobile device are selected from a group consisting of a magnetometer of the mobile device, a gravity sensor of the mobile device, and an accelerometer of the mobile device.

4. The computer-implemented method of claim 1, wherein for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device.

5. The computer-implemented method of claim 1, further comprising, during the calculating of the local observations:

compensating for a displacement of the hardware camera from a center of the mobile device; and

compensating for a discrepancy in a local measurement of a horizontal heading of the mobile device caused by one or more components of the mobile device.

6. The computer-implemented method of claim 1, further comprising sporadically toggling a wireless discoverability of the mobile device, in order to enable a detection of a new device within the plurality of additional devices.

7. The computer-implemented method of claim 1, wherein the local observations are sent to the cloud-side service utilizing a communications network.

8. The computer-implemented method of claim 1, further comprising:

displaying vision code data for the mobile device; and

adjusting a number of distinct colors included within the vision code data for the mobile device, based on external lighting conditions.

9. The computer-implemented method of claim 1, further comprising normalizing the actual orientation of the mobile device.

10. The computer-implemented method of claim 1, wherein the timed tile sequence is one of a plurality of timed tile sequences sent to the mobile device and the plurality of additional devices, and the plurality of timed tile sequences create a composite image when displayed by the mobile device and the plurality of additional devices.