Providing visualization data to a co-located plurality of mobile devices

• US 10,559,094 B2
• Filed: 01/29/2019
• Issued: 02/11/2020
• Est. Priority Date: 09/09/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hwang, Inseok, Taban, Gelareh, Kim, Myung-Chul, Yoo, Chungkuk
• Primary Examiner(s): Chu, David H
• Application Number:
  US16/261,310
• Publication Number:
  US 20190156521A1
• Time in Patent Office: 378 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G09G 2300/026 Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

A computer-implemented method according to one embodiment includes providing feedback by a mobile device to guide a placement of the mobile device to a predetermined orientation, identifying, utilizing a hardware camera of a mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation, identifying the actual orientation of the mobile device, calculating local observations at the mobile device, sending the local observations from the mobile device to a cloud-side service, receiving a timed tile sequence at the mobile device from the cloud-side service, and outputting the timed tile sequence at the mobile device.

Claims

1. A computer-implemented method, comprising:

providing feedback by a mobile device to guide a placement of the mobile device to a predetermined orientation;

identifying, utilizing a hardware camera of a mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation;

identifying the actual orientation of the mobile device;

calculating local observations at the mobile device;

sending the local observations from the mobile device to a cloud-side service;

receiving a timed tile sequence at the mobile device from the cloud-side service; and

outputting the timed tile sequence at the mobile device.

2. The computer-implemented method of claim 1, wherein each of the plurality of additional devices is in a possession of a unique individual located within a single crowd of people.

3. The computer-implemented method of claim 1, wherein:

for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device,

the local observations include, for each of the plurality of additional devices, a relative angle between the mobile device and the additional device, and a relative orientation of the mobile device compared to the plurality of additional devices, and

the timed tile sequence is one of a plurality of timed tile sequences that create a composite image when displayed by the mobile device and the plurality of additional devices.

4. The computer-implemented method of claim 1, wherein the actual orientation of the mobile device is identified utilizing one or more sensors of the mobile device, where the one or more sensors are selected from a group consisting of a magnetometer of the mobile device, a gravity sensor of the mobile device, and an accelerometer of the mobile device.

5. The computer-implemented method of claim 1, wherein for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device.

6. The computer-implemented method of claim 1, further comprising, during the calculating of the local observations:

compensating for a displacement of the hardware camera from a center of the mobile device; and

compensating for a discrepancy in a local measurement of a horizontal heading of the mobile device caused by one or more components of the mobile device.

7. The computer-implemented method of claim 1, further comprising sporadically toggling a wireless discoverability of the mobile device in order to enable a detection of a new device within the plurality of additional devices.

8. The computer-implemented method of claim 1, wherein the local observations are sent to the cloud-side service utilizing a communications network.

9. The computer-implemented method of claim 1, further comprising:

displaying vision code data for the mobile device; and

adjusting a number of distinct colors included within the vision code data for the mobile device, based on external lighting condition.

10. The computer-implemented method of claim 1, further comprising normalizing the actual orientation of the mobile device.

11. A computer program product for implementing visualization data at a mobile device, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

providing, utilizing the processor, feedback by the mobile device to guide a placement of the mobile device to a predetermined orientation;

identifying, utilizing the processor and a hardware camera of the mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation;

identifying the actual orientation of the mobile device, utilizing the processor;

calculating local observations at the mobile device utilizing the processor;

sending the local observations from the mobile device to a cloud-side service, utilizing the processor;

receiving, utilizing the processor, a timed tile sequence at the mobile device from the cloud-side service; and

outputting the timed tile sequence at the mobile device, utilizing the processor.

12. The computer program product of claim 11, wherein:

for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device,

the local observations include, for each of the plurality of additional devices, a relative angle between the mobile device and the additional device, and a relative orientation of the mobile device compared to the plurality of additional devices, and

the timed tile sequence is one of a plurality of timed tile sequences that create a composite image when displayed by the mobile device and the plurality of additional devices.

13. The computer program product of claim 11, wherein the actual orientation of the mobile device is identified utilizing one or more sensors of the mobile device, where the one or more sensors are selected from a group consisting of a magnetometer of the mobile device, a gravity sensor of the mobile device, and an accelerometer of the mobile device.

14. The computer program product of claim 11, wherein for each of the plurality of additional devices, the vision code data includes a plurality of temporally coded single colored frames identifying the additional device.

15. The computer program product of claim 11, further comprising, during the calculation of the local observations:

compensating, utilizing the processor, for a displacement of the hardware camera from a center of the mobile device; and

compensating, utilizing the processor, for a discrepancy in a local measurement of a horizontal heading of the mobile device caused by one or more components of the mobile device.

16. The computer program product of claim 11, further comprising sporadically toggling a wireless discoverability of the mobile device, utilizing the processor, in order to enable a detection of a new device within the plurality of additional devices.

17. The computer program product of claim 11, wherein the local observations are sent to the cloud-side service utilizing a communications network.

18. The computer program product of claim 11, further comprising:

displaying, utilizing the processor, vision code data for the mobile device; and

adjusting, utilizing the processor, a number of distinct colors included within the vision code data for the mobile device, based on external lighting conditions.

19. The computer program product of claim 11, further comprising normalizing, utilizing the processor, the actual orientation of the mobile device.

20. A mobile device, comprising:

a processor; and

logic integrated with the processor, executable by the processor, or integrated with and executable by the processor, the logic being configured to;

provide feedback by the mobile device to guide a placement of the mobile device to a predetermined orientation;

identify, utilizing a hardware camera of a mobile device, vision code data from a plurality of additional devices that are within a field of view of the hardware camera of the mobile device at an actual orientation;

identify the actual orientation of the mobile device;

calculate local observations at the mobile device;

send the local observations from the mobile device to a cloud-side service;

receive a timed tile sequence at the mobile device from the cloud-side service; and

output the timed tile sequence at the mobile device.