Using motion sensing for controlling a display

• US 9,836,129 B2
• Filed: 08/06/2015
• Issued: 12/05/2017
• Est. Priority Date: 08/06/2015
• Status: Active Grant

• Current Assignee: Navico Incorporated (Brunswick Corporation)
• Original Assignee: Navico Holding A.S. (Brunswick Corporation)
• Inventors: Clark, Jeremiah
• Primary Examiner(s): Baghdasaryan, Hovhannes
• Application Number:
  US14/819,907
• Publication Number:
  US 20170038461A1
• Time in Patent Office: 852 Days
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/87 Combinations of sonar systems
• CPC Class Codes: G01S 15/96 for locating fish
• CPC Class Codes: G01S 7/52004 Means for monitoring or calibrating short-range imaging G01S7/5205
• CPC Class Codes: G01S 7/6218 providing two-dimensional coordinated display of distance and direction
• CPC Class Codes: G01S 7/6245 Stereoscopic displays; Three-dimensional displays; Pseudo-three dimensional displays
• CPC Class Codes: G01S 7/6281 Composite displays, e.g. split-screen, multiple images
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Various implementations described herein are directed to a device configured to use motion sensing for controlling a display. The device may include a motion sensing module configured to track orientation of a user on a watercraft and determine a direction of a cast executed by the user based on the tracked orientation of the user. The device may include a display module configured to display one or more sonar images based on the determined direction of the cast executed by the user.

Claims

1. A device, comprising:

a motion sensing module configured to track orientation of a user on a watercraft and determine a direction of a cast executed by the user based on the tracked orientation of the user; and

a display module configured to display one or more sonar images based on the determined direction of the cast executed by the user.

2. The device of claim 1, wherein the motion sensing module is configured to track movements of the user on the watercraft and detect intensity of the cast executed by the user based on the tracked movements of the user, and wherein the display module is configured to display the one or more sonar images based on the detected intensity of the cast along with the determined direction of the cast.

3. The device of claim 2, wherein the motion sensing module is configured to:

determine a range of the cast based on the detected intensity of the cast;

identify a target area of the cast based on the determined range of the cast along with the determined direction of the cast; and

automatically display the one or more sonar images that correspond to the identified target area of the cast.

4. The device of claim 2, wherein the intensity of the cast comprises a speed of a casting body part of the user during the cast, and wherein the speed is determined based on a rate of change of a transitional movement of the casting body part of the user over a distance from a first position to a second position during a time period of the cast, wherein the second position is different than the first position.

5. The device of claim 1, wherein the orientation of the user comprises a position of the user on the watercraft in relation to at least one of a bow (fore side), a stern (aft side), a port (left side), and a starboard (right side) of the watercraft.

6. The device of claim 1, wherein the orientation of the user comprises a forward facing direction of the user on the watercraft in relation to at least one of a bow (fore side), a stern (aft side), a port (left side), and a starboard (right side) of the watercraft.

7. The device of claim 1, wherein the motion sensing module is configured to track movement of the user on the watercraft, wherein the movement comprises transitioning from a first position of the user on the watercraft to a second position of the user on the watercraft, wherein the second position is different than the first position.

8. The device of claim 1, wherein the motion sensing module is configured to track gestures of the user on the watercraft, wherein the gestures comprise a casting gesture associated with the cast executed by the user, wherein the casting gesture comprises at least one of an overhead casting gesture and a side casting gesture.

9. The device of claim 1, wherein the motion sensing module comprises one or more image capture components including at least one of a video camera and a depth sensing camera.

10. The device of claim 1, wherein the one or more sonar images comprise one or more two-dimensional (2D) sonar images of an underwater environment.

11. The device of claim 1, wherein the one or more sonar images comprise one or more three-dimensional (3D) sonar images of an underwater environment.

12. An apparatus, comprising:

a motion sensor configured to track movement of an angler on a watercraft and determine a direction of a casting gesture performed by the angler based on the tracked movement of the angler; and

a display component configured to display one or more sonar images based on the determined direction of the casting gesture performed by the angler.

13. The apparatus of claim 12, wherein the motion sensor is configured to detect intensity of the casting gesture performed by the user, and wherein the display component is configured to display the one or more sonar images based on the tracked movement of the user and the detected intensity of the casting gesture performed by the user.

14. The apparatus of claim 12, wherein the motion sensor is configured to:

determine a range of the casting gesture based on the detected intensity of the casting gesture;

identify a target area of the casting gesture based on the determined range of the casting gesture along with the determined direction of the casting gesture; and

automatically display the one or more sonar images corresponding to the identified target area of the casting gesture.

15. A non-transitory computer-readable medium having stored thereon a plurality of computer-executable instructions which, when executed by a computer, cause the computer to:

receive motion capture data from one or more motion sensors configured to track movement of an angler on a watercraft;

determine a direction of a cast by the angler based on the motion capture data;

identify a target area of the cast based on the determined direction of the cast by the angler; and

automatically display one or more sonar images on a display component in relation to the identified target area of the cast by the angler.

16. The computer-readable medium of claim 15, wherein the motion capture data comprises full-body three-dimensional (3D) motion capture data in relation to movement of the angler on the watercraft, and wherein the motion capture data comprises facial recognition data of the angler to determine a forward facing orientation of the angler, and wherein tracking movement of the angler on the watercraft comprises tracking one or more gestures of the user on the watercraft including casting gestures.

17. A non-transitory computer-readable medium having stored thereon a plurality of computer-executable instructions which, when executed by a computer, cause the computer to:

receive first data from a first motion sensor configured to determine a direction of a cast by an angler;

receive second data from a second motion sensor configured to determine an intensity of the cast by the angler;

identify a target area of the cast based on the determined direction of the cast and the determined intensity of the cast; and

automatically display one or more sonar images on a display component in relation to the identified target area of the cast.

18. The computer-readable medium of claim 17, wherein the first data comprises full-body three-dimensional (3D) motion capture data in relation to orientation of the angler, and wherein the first data comprises facial recognition data associated with a forward facing position of the angler, and wherein the direction of the cast is based on at least one of the orientation of the angler and the forward facing position of the angler during the cast.

19. The computer-readable medium of claim 17, wherein the second data comprises full-body three-dimensional (3D) motion capture data in relation to movement of the angler, and wherein determining intensity of the cast comprises determining a range of the cast based on the detected intensity of the cast by the angler.

20. The computer-readable medium of claim 17, wherein receiving second data from the second motion sensor comprises receiving acceleration data from a wearable wrist sensor worn by the angler during the cast.