Sensory Input for Mobile Devices

Mark Shkolnikov
President
KEYnetik, Inc
From Single Sensor -
- To Sensor Array

Traditional use of sensors

Ambient light – dim down display

Accelerometer – screen orientation

Proximity – lock down touch screen

New paradigm – Sensor Array

Integration of sensors

Quantity makes new quality

From automation of disparate functions to
intelligent device
 Array of Sensors
Sense what’s around…

…deduce what’s up…

…and help the user

Smartphone
+ Sensory Input
= Intelligent Device

Fewer Commands - Fewer Keys

Fewer Design
Better User Experience
Constraints

+ Sensors pay for themselves

Most expensive real estate is the front surface
of mobile device
Perceptive Filtering
All Data

Compensation of Errors
Synchronization and cross correlation of data

Situation Awareness
Where? What’s going on?

Task Awareness
What needs to done?

Actionable Data
Spatially Aware Inference Logic

Sensors work as an orchestra with motion

sensor being a conductor

High confidence data is analyzed, other
corrected or discarded

Data from disparate sources turns into
cohesive actionable profile

Example: Hi-N-Bye™ for Nokia 5800

Example: Disambiguation of Image
with Accelerometer

Really falling?

Cannot hold your

camera straight?

Both?
Importance and Challenges of
Motion Perception

Motion affects all other sensors
(pressure, image, sound, light, temperature, compass)

Motion is very complex
(six degrees of freedom = six time variables)

Orientation (roll, pitch and yaw angles)

Accelerations in 3D

Tri-axis accelerometer jams six variables
into three creating ambiguity
Perceptive Disambiguation -
- Strengths and Weaknesses

Assessment Vs. Precision

Very efficient for recognition

Cannot substitute accurate
measurements

Can separate high confidence and low
confidence data
Motion Sensors

Accelerometers

Sense both inertia and gravity

Consume little power

Cannot tell

Uniform rotation from lateral motion

Gravity from inertia

Gyroscopes

Immune to gravity and lateral forces

Sense only rotation over internal reference

Need time to start up and recover from impact

Draw substantial power
Gyro & Accelerometer Combo

A lot of math (double integration to build

up trajectory)

Need time to start up and recover from
impact

A lot of power
Accelerometer Pair

1+1=3
Two sensors + distance in between

Can triangulate radius of rotation and

build up trajectory with single integration

Can emulate gyroscope

Low power consumption

Instant to start and immune to impact
Accelerometers Vs Gyroscope

Single Dual
Gyroscope
Accelerometer Accelerometers
Orientation
Yes Yes No
towards gravity
Angular rotation
No Yes Yes
rate
Radius of rotation No Yes No
Reaction to Temporary
None None
impact blackout
Start up time None None Same as blackout
Power
Low 2 x Low 10 x Low
consumption
Price Low 2 x Low 5 x Low

13
Dual Accelerometer Platform

Support all motion input applications

Image stabilization, UI, athletic monitor, gaming

Unique ability to filter motion signals
based on radius of rotation

Cost less and consume less power than
gyroscopes

Immune to motion interference

Works with SAIL™

14
Use of Radius of Rotation for UI

Forgiving execution with precise

response guaranteed by
anthropometry (wrist length Vs.
elbow/hand)

Freedom to move device around

to stay comfortable and maintain
best possible viewing angle

Multitask: control the device with

motion and have pedometer
running
15
Turn Phone into Gaming Controller
Practice golf swings, fencing
lunges, tennis backhands and
bowling, put a spin on the ball!

Play with friends or alone

Measure radiuses and

accelerations as you ski or
bike, time out your jumps

Use your phone as personal

black box / emergency
beacon
16
www.keynetik.com