Providing visualization data to a co-located plurality of mobile devices

• US 10,567,931 B2
• Filed: 08/23/2018
• Issued: 02/18/2020
• Est. Priority Date: 09/09/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hwang, Inseok, Kim, Myung-Chul, Taban, Gelareh, Yoo, Chungkuk
• Primary Examiner(s): Schwartz, Joshua L
• Application Number:
  US16/111,119
• Publication Number:
  US 20180367966A1
• Time in Patent Office: 544 Days
• Field of Search: 4554561-4566
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/08 User group management
• CPC Class Codes: H04W 4/21 for social networking applications
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management
• CPC Class Codes: H04W 84/18 Self-organising networks, e.g. ad-hoc networks or sensor networks

Abstract

A computer-implemented method according to one embodiment includes identifying a plurality of mobile devices, sending a unique identifier to each of the plurality of mobile devices, receiving results of mobile vision sensing from each of the plurality of mobile devices, where the results of mobile vision sensing include, for each of the plurality of mobile devices, an identification of the unique identifier of other mobile devices of the plurality of mobile devices that are within a field of view of the mobile device, determining a relative location of each of the plurality of mobile devices, utilizing the results of mobile vision sensing, and assigning visualization data to each of the plurality of mobile devices, based on the relative location of each of the plurality of mobile devices.

Claims

1. A computer-implemented method, comprising:

identifying a plurality of mobile devices;

sending a unique identifier to each of the plurality of mobile devices;

receiving results of mobile vision sensing from each of the plurality of mobile devices, where the results of mobile vision sensing include, for each of the plurality of mobile devices, an identification of the unique identifier of other mobile devices of the plurality of mobile devices that are within a field of view of the mobile device;

determining a relative location of each of the plurality of mobile devices, utilizing the results of mobile vision sensing;

resampling textual output, graphical output, or textual and graphical output to fit a number of the plurality of mobile devices to create visualization data; and

sending the visualization data to each of the plurality of mobile devices, based on the relative location of each of the plurality of mobile devices.

2. The computer-implemented method of claim 1, wherein each of the plurality of mobile devices is in a possession of a unique individual located within a single crowd of people.

3. The computer-implemented method of claim 1, wherein determining the relative location of each of the plurality of mobile devices includes performing relative localization on each of the plurality of mobile devices in order to determine a co-located group of the mobile devices.

4. The computer-implemented method of claim 1, wherein the results of mobile vision sensing further include a plurality of tuples, where each of the plurality of tuples includes the unique identifier of a first mobile device of the plurality of mobile devices, the unique identifier of a second mobile device that is within a field of view of the first mobile device, and a horizontal angle defined by:

a first line perpendicular to an image plane of a camera of the first mobile device, and

a horizontal projection of a second line connecting a center of the camera of the first mobile device and a center of a screen of the second mobile device.

5. The computer-implemented method of claim 1, further comprising assigning individual cues to each of the plurality of mobile devices, based on the relative location of each of the plurality of mobile devices, where the individual cues instruct a user of each of the plurality of mobile devices to manually display one or more cards.

6. The computer-implemented method of claim 1, wherein the visualization data includes a single tile or a timed sequence of tiles that are sent to each of the plurality of mobile devices.

7. The computer-implemented method of claim 1, wherein constrained nonlinear optimization is performed within a cloud computing environment, utilizing the results of mobile vision sensing, in order to determine the relative location of each of the plurality of mobile devices.

8. The computer-implemented method of claim 7, wherein determining the relative location of each of the plurality of mobile devices further comprises:

accelerating the constrained nonlinear optimization by formulating a linearly constrained quadratic polynomial programming problem,

solving the linearly constrained quadratic polynomial programming problem utilizing a quadratic programming algorithm to obtain an approximate solution, and

sending the approximate solution as initial values to the linearly constrained quadratic polynomial programming problem.

9. The computer-implemented method of claim 1, further comprising:

pixelating textual output, graphical output, or textual and graphical output into a matrix of tiles; and

assigning each tile to one of the plurality of mobile devices at a location matching a respective location within the matrix of tiles.

10. A computer program product for providing visualization data to a plurality of mobile devices, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

identifying the plurality of mobile devices, utilizing the processor;

sending a unique identifier to each of the plurality of mobile devices, utilizing the processor;

receiving, utilizing the processor, results of mobile vision sensing from each of the plurality of mobile devices, where the results of mobile vision sensing include, for each of the plurality of mobile devices, an identification of the unique identifier of other mobile devices of the plurality of mobile devices that are within a field of view of the mobile device;

determining, utilizing the processor, a relative location of each of the plurality of mobile devices, utilizing the results of mobile vision sensing;

resampling, utilizing the processor, textual output, graphical output, or textual and graphical output to fit a number of the plurality of mobile devices to create visualization data; and

sending, utilizing the processor, the visualization data to each of the plurality of mobile devices, based on the relative location of each of the plurality of mobile devices.

11. The computer program product of claim 10, wherein each of the plurality of mobile devices is in a possession of a unique individual located within a single crowd of people.

12. The computer program product of claim 10, wherein determining the relative location of each of the plurality of mobile devices includes performing, utilizing the processor, relative localization on each of the plurality of mobile devices in order to determine a co-located group of the mobile devices.

13. The computer program product of claim 10, wherein the results of mobile vision sensing further include a plurality of tuples, where each of the plurality of tuples includes the unique identifier of a first mobile device of the plurality of mobile devices, the unique identifier of a second mobile device that is within a field of view of the first mobile device, and a horizontal angle defined by:

a first line perpendicular to an image plane of a camera of the first mobile device, and

a horizontal projection of a second line connecting a center of the camera of the first mobile device and a center of a screen of the second mobile device.

14. The computer program product of claim 10, further comprising assigning, utilizing the processor, individual cues to each of the plurality of mobile devices, based on the relative location of each of the plurality of mobile devices, where the individual cues instruct a user of each of the plurality of mobile devices to manually display one or more cards.

15. The computer program product of claim 10, wherein the visualization data includes a timed sequence of tiles that are sent to each of the plurality of mobile devices.

16. The computer program product of claim 10, wherein constrained nonlinear optimization is performed within a cloud computing environment, utilizing the results of mobile vision sensing, in order to determine the relative location of each of the plurality of mobile devices.

17. The computer program product of claim 16, wherein determining the relative location of each of the plurality of mobile devices further comprises:

accelerating, utilizing the processor, the constrained nonlinear optimization by formulating a linearly constrained quadratic polynomial programming problem,

solving, utilizing the processor, the linearly constrained quadratic polynomial programming problem utilizing a quadratic programming algorithm to obtain an approximate solution, and

sending, utilizing the processor, the approximate solution as initial values to the linearly constrained quadratic polynomial programming problem.

18. The computer program product of claim 10, wherein the visualization data represents textual output, graphical output, or textual and graphical output that is pixelated into a matrix of tiles.

19. A system, comprising:

a processor; and

logic integrated with the processor, executable by the processor, or integrated with and executable by the processor, the logic being configured to;

identify a plurality of mobile devices;

send a unique identifier to each of the plurality of mobile devices;

receive results of mobile vision sensing from each of the plurality of mobile devices, where the results of mobile vision sensing include, for each of the plurality of mobile devices, an identification of the unique identifier of other mobile devices of the plurality of mobile devices that are within a field of view of the mobile device;

determine a relative location of each of the plurality of mobile devices, utilizing the results of mobile vision sensing;

resample textual output, graphical output, or textual and graphical output to fit a number of the plurality of mobile devices to create visualization data; and

send visualization data to each of the plurality of mobile devices, based on the relative location of each of the plurality of mobile devices.