Systems, methods, and computer program products for interacting with electronically displayed presentation materials

• US 10,078,435 B2
• Filed: 04/19/2016
• Issued: 09/18/2018
• Est. Priority Date: 04/24/2015
• Status: Active Grant

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: Thalmic Labs Inc.
• Inventors: Noel, Elliott W. G.
• Primary Examiner(s): Kumar, Srilakshmi K
• Assistant Examiner(s): Castiaux, Brent D
• Application Number:
  US15/133,091
• Publication Number:
  US 20160313899A1
• Time in Patent Office: 882 Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour

Abstract

Systems, methods, and computer program products for interacting with electronically displayed presentation materials are described. A display system includes, at least, a digital processor, an electronic display, and a non-transitory processor-readable storage medium into which is loaded a computer program product that includes, at least, processor-executable instructions and/or data. The processor-executable instructions and/or data, when executed by the processor, cause the display system to respond to user inputs indicative of pointer commands and magnification setting commands. In response to such commands, the display system causes; i) a dynamic cursor to display over top of content on the electronic display; and ii) a digital copy image of the content to be displayed over top of the content on the electronic display, the digital copy image displayed at a greater magnification level than the content.

Claims

1. A method of operation in a display system which comprises at least one processor, an electronic display communicatively coupled to the at least one processor, and at least one non-transitory processor-readable storage medium communicatively coupled to the at least one processor, wherein the at least one non-transitory processor-readable storage medium stores at least one of processor-executable instructions and data, the method comprising:

causing, by the at least one processor, a display of content at a first magnification level on the electronic display;

receiving, by the at least one processor, a user input indicative of a magnification setting command;

in response to the user input indicative of the magnification setting command;

capturing, by the at least one processor, a digital copy image of the content;

digitally magnifying, by the at least one processor, at least a portion of the digital copy image of the content;

causing, by the at least one processor, an overlay of a borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display, wherein the borderless window is transparent to both content and a majority of events;

causing, by the at least one processor, a display of the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display, the second magnification level greater than the first magnification level.

2. The method of claim 1 wherein capturing, by the at least one processor, a digital copy image of the content includes capturing, by the at least one processor, a screenshot of the content.

3. The method of claim 1 wherein:

digitally magnifying, by the at least one processor, at least a portion of the digital copy image of the content includes producing, by the at least one processor, a series of digital copy images of respective portions of the content at successive magnification levels; and

causing, by the at least one processor, a display of the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display includes causing, by the at least one processor, a sequential display of the series of digital copy images of respective portions of the content at successive magnification levels in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display.

4. The method of claim 1, further comprising:

receiving, by the at least one processor, a user input indicative of a display restoration command; and

in response to the user input indicative of the display restoration command;

stopping, by the at least one processor, the display of the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display.

5. The method of claim 4 wherein causing, by the at least one processor, a display of the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display includes causing, by the at least one processor, the digitally magnified at least a portion of the digital copy image of the content to completely overlay the display of content at the first magnification level and stopping by the at least one processor, the display of the content at the first magnification level on the electronic display, and wherein the method further comprises:

in response to the user input indicative of the display restoration command;

causing, by the at least one processor, a resumption of the display of the content at the first magnification level on the electronic display.

6. The method of claim 4 wherein:

digitally magnifying, by the at least one processor, at least a portion of the digital copy image of the content includes producing, by the at least one processor, a series of digital copy images of respective portions of the content at successively greater magnification levels; and

stopping, by the at least one processor, a display of the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display includes causing, by the at least one processor, sequential display of the series of digital copy images of respective portions of the content at successively lesser magnification levels in the borderless window over top of at least a portion of the display of content at the first magnification level on the electronic display.

7. The method of claim 1 wherein the display system further comprises a portable control device, the method further comprising:

detecting, by the portable control device, the user input indicative of the magnification setting command;

in response to detecting, by the portable control device, the user input indicative of the magnification command, transmitting a first signal by the portable control device; and

receiving the first signal by the at least one processor.

8. The method of claim 7 wherein the portable control device includes a gesture-based control device and wherein detecting, by the portable control device, the user input indicative of the magnification setting command includes detecting, by the gesture-based control device, a first physical gesture performed by a user of the display system.

9. The method of claim 1, further comprising:

receiving, by the at least one processor, a user input indicative of a pointer command;

in response to the user input indicative of the pointer command;

causing, by the at least one processor, a display of a dynamic cursor in the borderless window over top of a portion of the display of content at the first magnification level on the electronic display, and wherein;

digitally magnifying, by the at least one processor, at least a portion of the digital copy image of the content includes digitally magnifying, by the at least one processor, at least the portion of the content over which the dynamic cursor is displayed.

10. A display system comprising:

an electronic display;

at least one processor communicatively coupled to the electronic display; and

at least one non-transitory processor-readable storage medium communicatively coupled to the at least one processor, wherein the at least one non-transitory processor-readable storage medium stores at least one of processor-executable instructions and data that, when executed by the at least one processor, cause the display system to;

display a content at a first magnification level on the electronic display; and

in response to a user input indicative of a magnification setting command;

capture a digital copy image of the content;

digitally magnify at least a portion of the digital copy image of the content;

overlay a borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display, wherein the borderless window is transparent to both content and a majority of events; and

display the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display, the second magnification level greater than the first magnification level.

11. The display system of claim 10 wherein, in response to a user input indicative of a magnification setting command, when executed by the at least one processor, the at least one of processor-executable instructions and data cause the display system to:

digitally magnify at least a portion of the digital copy image of the content cause the display system to produce a series of digital copy images of respective portions of the content at successive magnification levels, and

sequentially display the series of digital copy images of respective portions of the content at successive magnification levels in the borderless window over top of at least a portion of the display of the content at the first magnification level.

12. The display system of claim 10 wherein, when executed by the at least one processor, the at least one of processor-executable instructions and data further cause the display system to:

in response to a user input indicative of a display restoration command;

stop displaying the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display.

13. The display system of claim 10, further comprising:

a portable control device responsive to at least the user input indicative of the magnification setting command, wherein in response to the user input indicative of the magnification setting command the portable control device transmits at least one signal to the at least one processor.

14. The display system of claim 13 wherein the portable control device includes a gesture-based control device responsive to at least a first physical gesture performed by a user of the display system.

15. The display system of claim 10 wherein, when executed by the at least one processor, the at least one of processor-executable instructions and data further cause the display system to:

in response to a user input indicative of a pointer command;

display a dynamic cursor in the borderless window over top of a portion of the display of the content at the first magnification level on the electronic display, and

in response to a user input indicative of a magnification setting command;

digitally magnify at least the portion of the content over which the dynamic cursor is displayed.

16. A non-transitory processor-readable storage medium of a digital computer system, comprising:

at least one of processor-executable instructions and data that, when executed by at least one processor of the digital computer system, cause the digital computer system to;

display a content at a first magnification level on an electronic display; and

in response to a user input indicative of a magnification setting command;

capture a digital copy image of the content;

digitally magnify at least a portion of the digital copy image of the content;

overlay a borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display, wherein the borderless window is transparent to both content and a majority of events; and

display the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display, the second magnification level greater than the first magnification level.

17. The non-transitory processor-readable storage medium of claim 16 wherein the at least one of processor-executable instructions and data that, when executed by the at least one processor of the digital computer system, cause the digital computer system to, in response to a user input indicative of a magnification setting command, digitally magnify at least a portion of the digital copy image of the content cause the digital computer system to produce a series of digital copy images of respective portions of the content at successive magnification levels, and wherein the at least one of processor-executable instructions and data that, when executed by the at least one processor of the digital computer system, cause the digital computer system to, in response to a user input indicative of a magnification setting command, display the digitally magnified at least a portion of the digital copy image of the content at a second magnification level in the borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display cause the digital computer system to sequentially display the series of digital copy images of respective portions of the content at successive magnification levels in the borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display.

18. The non-transitory processor-readable storage medium of claim 16, further comprising at least one of processor-executable instructions and data that, when executed by the at least one processor of the digital computer system, cause the digital computer system to, in response to a user input indicative of a display restoration command:

stop displaying the digitally magnified at least a portion of the digital copy image of the content at the second magnification level in the borderless window over top of at least a portion of the display of the content at the first magnification level on the electronic display.

19. The non-transitory processor-readable storage medium of claim 16, further comprising at least one of processor-executable instructions and data that, when executed by the at least one processor of the digital computer system, cause the digital computer system to, in response to a user input indicative of a pointer command:

display a dynamic cursor in the borderless window over top of a portion of the display of the content at the first magnification level on the electronic display, and wherein the at least one of processor-executable instructions and data that, when executed by the processor of the digital computer system, cause the digital computer system to, in response to a user input indicative of a magnification setting command, digitally magnify at least a portion of the digital copy image of the content cause the display system to digitally magnify at least the portion of the content over which the dynamic cursor is displayed.