Providing visualization data to a co-located plurality of mobile devices

• US 10,229,512 B2
• Filed: 09/09/2016
• Issued: 03/12/2019
• Est. Priority Date: 09/09/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hwang, Inseok, Kim, Myung-Chul, Taban, Gelareh, Yoo, Chungkuk
• Primary Examiner(s): Chu, David H
• Application Number:
  US15/261,809
• Publication Number:
  US 20180075623A1
• Time in Patent Office: 914 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G09G 2300/026 Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

According to another embodiment, a computer program product for implementing visualization data at a mobile device comprises a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, and where the program instructions are executable by a processor to cause the processor to perform a method comprising identifying, utilizing the processor and a hardware camera of the mobile device, vision code data from a plurality of additional devices, identifying an orientation of the mobile device, utilizing the processor and one or more sensors of the mobile device, calculating local observations utilizing the processor, the vision code data, and the orientation, sending the local observations to a cloud-side service, utilizing the processor, receiving, utilizing the processor, timed tile sequences from the cloud-side service, in response to the sending of the local observations, and outputting the timed tile sequences, utilizing the processor and a display of the mobile device.

Claims

1. A computer program product for implementing visualization data at a mobile device, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

providing, utilizing the processor, feedback by the mobile device to guide a placement of the mobile device to a predetermined orientation;

identifying, utilizing the processor and a hardware camera of the mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation;

identifying the actual orientation of the mobile device, utilizing the processor and one or more sensors of the mobile device;

calculating local observations at the mobile device utilizing the processor, the vision code data, and the actual orientation;

sending the local observations from the mobile device to a cloud-side service, utilizing the processor;

receiving, utilizing the processor, a timed tile sequence at the mobile device from the cloud-side service, in response to the sending of the local observations by the mobile device; and

outputting the timed tile sequence at the mobile device, utilizing the processor and a display of the mobile device.

2. The computer program product of claim 1, wherein:

for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device,

the local observations include, for each of the plurality of additional devices, a relative angle between the mobile device and the additional device, and a relative orientation of the mobile device compared to the plurality of additional devices, and

the timed tile sequence is one of a plurality of timed tile sequences that create a composite image when displayed by the mobile device and the plurality of additional devices.

3. The computer program product of claim 1, wherein the one or more sensors of the mobile device are selected from a group consisting of a magnetometer of the mobile device, a gravity sensor of the mobile device, and an accelerometer of the mobile device.

4. The computer program product of claim 1, wherein for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device.

5. The computer program product of claim 1, further comprising, during the calculation of the local observations:

compensating, utilizing the processor, for a displacement of the hardware camera from a center of the mobile device; and

compensating, utilizing the processor, for a discrepancy in a local measurement of a horizontal heading of the mobile device caused by one or more components of the mobile device.

6. The computer program product of claim 1, further comprising sporadically toggling a wireless discoverability of the mobile device, utilizing the processor, in order to enable a detection of a new device within the plurality of additional devices.

7. The computer program product of claim 1, wherein the local observations are sent to the cloud-side service utilizing a communications network.

8. The computer program product of claim 1, further comprising:

displaying, utilizing the processor, vision code data for the mobile device; and

adjusting, utilizing the processor, a number of distinct colors included within the vision code data for the mobile device, based on external lighting conditions.

9. The computer program product of claim 1, further comprising normalizing, utilizing the processor, the actual orientation of the mobile device.

10. A mobile device, comprising:

a processor; and

logic integrated with the processor, executable by the processor, or integrated with and executable by the processor, the logic being configured to;

provide feedback by the mobile device to guide a placement of the mobile device to a predetermined orientation;

identify, utilizing a hardware camera of a mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation;

identify the actual orientation of the mobile device, utilizing one or more sensors of the mobile device;

calculate local observations at the mobile device utilizing the vision code data and the actual orientation;

send the local observations from the mobile device to a cloud-side service;

receive a timed tile sequence at the mobile device from the cloud-side service, in response to the sending of the local observations by the mobile device; and

output the timed tile sequence at the mobile device, utilizing a display of the mobile device.