Handheld writing implement form factor mobile device

• US 10,341,478 B2
• Filed: 09/26/2017
• Issued: 07/02/2019
• Est. Priority Date: 07/03/2017
• Status: Active Grant

• Current Assignee: Essential Products, Inc.
• Original Assignee: Essential Products, Inc.
• Inventors: Li, Siqi, Evans, V, David John
• Primary Examiner(s): Trandai, Cindy
• Application Number:
  US15/716,276
• Publication Number:
  US 20190007537A1
• Time in Patent Office: 644 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04M 1/0262 for a battery compartment
• CPC Class Codes: H04M 1/0266 for a display module assembly
• CPC Class Codes: H04M 1/0285 Pen-type handsets
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector

Abstract

Presented here is a handheld writing implement form factor for a mobile device. The shape of the device can correspond to the shape of a whiteboard marker. Due to the small size, the device does not have a physical keyboard or an onscreen keyboard and instead relies on environmental cues, gestural input, voice input, and touch input to interpret user instructions. For example, when the device determines from environmental cues that it is resting on a tabletop, a touch input consisting of a single press from the user is interpreted as an instruction to scroll the display. In other embodiments, the device can be used as a handheld writing implement, such as a computer stylus, or to control the device by handwriting in the air. Other uses of the device are disclosed such as making a payment, communicating with other appliances enabled for electronic communication, recording images with a gesture, etc.

Claims

1. A method comprising:

receiving a user input by a handheld device having a display, a non-display surface the handheld device formed in a shape of a handheld writing implement having an elongated dimension at least half of whose length is occupied by the display, a chassis of the handheld device opposite the display formed into a plurality of angled surfaces, the chassis of the handheld device to enable viewing of the display in an inclined position;

determining an environment cue proximate to the handheld device, and a physical property of the handheld device, the environment cue comprising an amount of ambient light proximate to the handheld device, and the physical property comprising a velocity of the handheld device and an acceleration of the handheld device; and

interpreting the user input based on the environment cue proximate to the handheld device and the physical property of the handheld device.

2. The method of claim 1, comprising:

recording a plurality of images by a plurality of normal lenses disposed around a perimeter of the handheld device and beneath the non-display surface of the handheld device; and

based on the plurality of images creating a 360°

image.

3. A method comprising:

determining a physical property of a handheld device, the physical property comprising a motion of the handheld device; and

based on the physical property of the handheld device interpreting a user input received by the handheld device formed in a shape of a handheld writing implement having an elongated dimension at least half of whose length is occupied by a display as an instruction to the handheld device to perform an action, a chassis of the handheld device opposite the display formed into a plurality of angled surfaces, the chassis of the handheld device to enable viewing of the display in an inclined position.

4. The method of claim 3, comprising:

determining an environment cue proximate to the handheld device; and

based on the environment cue proximate to the handheld device and the physical property of the handheld device interpreting the user input received by the handheld device as the instruction to the handheld device to perform the action.

5. The method of claim 4, the environment cue comprising a presence of a face, the motion of the handheld device comprising a substantially still handheld device, said interpreting the user input comprising:

detecting an orientation of the handheld device at a predetermined angle; and

interpreting the orientation of the handheld device as the instruction to record an image of the face using a camera associated with the handheld device.

6. The method of claim 4, the environment cue comprising a presence of a face and a presence of an electronic communication enabled device, the motion of the handheld device comprising a substantially still handheld device, said interpreting the user input comprising:

detecting an orientation of the handheld device at a predetermined angle;

interpreting the orientation of the handheld device as the instruction to record an image of the face using a camera associated with the handheld device;

combining the image of the face with an image associated with the electronic communication enabled device.

7. The method of claim 3, the motion of the handheld device comprising a change in a velocity of the handheld device, said interpreting the user input comprising:

receiving a selection motion of the handheld device comprising a substantially circular portion and a substantially still portion; and

interpreting the selection motion as the instruction to record an image during the substantially still portion.

8. A system comprising:

a handheld device formed in a shape of a handheld writing implement having an elongated dimension at least half of whose length is occupied by a display, a chassis of the handheld device opposite the display formed into a plurality of angled surfaces, the chassis of the handheld device to enable viewing of the display in an inclined position;

a processor associated with the handheld device, the processor configured to;

determine a physical property of the handheld device, the physical property comprising a motion of the handheld device; and

based on the physical property of the handheld device interpret a user input received by the handheld device as an instruction to the handheld device to perform an action.

9. The system of claim 8, the processor configured to:

determine an environment cue proximate to the handheld device; and

based on the environment cue proximate to the handheld device and the physical property of the handheld device interpret the user input received by the handheld device as the instruction to the handheld device to perform the action.

10. The system of claim 9, the environment cue comprising a presence of a face and a presence of an electronic communication enabled device, the motion of the handheld device comprising a substantially still handheld device, the processor configured to:

detect an orientation of the handheld device at a predetermined angle;

interpret the orientation of the handheld device as the instruction to record an image of the face using a camera associated with the handheld device; and

combine the image of the face with an image associated with the electronic communication enabled device.

11. The system of claim 9, the environment cue comprising a presence of a face, the motion of the handheld device comprising a substantially still handheld device, the processor configured to:

detect an orientation of the handheld device at a predetermined angle; and

interpret the orientation of the handheld device as the instruction to record an image of the face using a camera associated with the handheld device.

12. The system of claim 8, the motion of the handheld device comprising a change in a velocity of the handheld device, the processor configured to:

receive a selection motion of the handheld device comprising a substantially circular portion and a substantially still portion; and

interpret the selection motion as the instruction to record an image during the substantially still portion.

13. The system of claim 8, the physical property of the handheld device comprising a change in a velocity of the handheld device and an image shown on a display screen of the handheld device, the processor configured to:

receive a shake of the handheld device; and

interpret the shake as the instruction to perform image processing on the image shown on the display screen.