Professional Documents
Culture Documents
(19) United States (12) Patent Application Publication (10) Pub. No.: US 2013/0167159 A1
Ricci et al.
(54)
sional application No. 61/715,699, ?led on Oct. 18, 2012, provisional application No. 61/ 507,203, ?led on
(71) Applicant: Flextronics AP, LLC, Milpitas, CA (US) (72) Inventors: Christopher P. Ricci, Saratoga, CA
(US); Brian Reeves, Hamilton (CA);
Paul E. Reeves, Oakville (CA); Richard
?led on Jul. 13, 2011, provisional application No. 61/507,209, ?led on Jul. 13, 2011, provisional appli cation No. 61/389,117, ?led on Oct. 1, 2010, provi sional application No. 61/507,201, ?led on Jul. 13,
2011. Publication Classi?cation
Teltz, Hamilton (CA); David Reeves, Ancaster (CA); Sanjiv Sirpal, Oakville (CA); Chris Tyghe, Oakville (CA)
(51) (52)
(73) Assignee: Flextronics AP, LLC, Milpitas, CA (US) (21) Appl. No.: 13/679,459 (22)
Filed: Nov. 16, 2012
(2006.01)
(57)
ABSTRACT
(60)
A mobile computing device With a mobile operating system and personal computer or vehicle processing module operat ing system running concurrently and independently on a shared kernel Without virtualiZation. The mobile operating system provides a user experience for the mobile computing device that suits the mobile environment. The personal com puter operating system provides a full personal computer user experience When the mobile computing device is docked to a
secondary terminal environment. The vehicle processing module operating system provides a full vehicle processing module user experience When the mobile computing device is
docked to a secondary terminal environment. The mobile
Android kernel.
soo\
1304, MOBILE 0s DESKTOP 05 M60
3504
APPLICATION LAYER
APPLICATION LAYER
382
FRAMEWORK LAYER FRAMEWORK LAYER
MANAGER(S)
LIBRARIES LAYER USER LIBRARIES
SERVICE(S)
M344
372 '1
MANAGER(8)
LIBRARIES LAYER
SERVIOE(S)
USER LIBRARIES
322 Q
KERNEL
13v 312
HARDWARE
US 2013/0167159 A1
_ 1
_ _
22
ERD 0
41 / 2
mu \ku _
6 ~ 0O
_ > _
M MW 03
M
C D l )P E KO DI AU S 8 E TDI
w/ m n M 1
6 0
w w m E
_l|\
u W P _
_ _
n m H w
_ _
M _ m w o
n E E M _
_ _
_D _ D
H E < 4 _
H r _ > V
_ T
_ E E
n _
w M
Y
_
US 2013/0167159 A1
1 96
TOUCH~ SCREEN
238
STORAGE
236
MEMORY
PROCESSOR
1 e8
l/O
DISPLAY
DEVICE(S)
DEVICE(S)
112
TOUCH
A/
114
120
r/
SCREEN
DISPLAY LID
CONTROLLER
M204
CPU
EXT. DISPLAY
220
//
212
//
/214
POWER
INTERFACE Av:>
PORT
MANAGEMENT/F9
(3
16
CELLULAR
218
OTHER
24
DEVICE(S)
//222
COMM.
BATTERY
MODEM
DEVICE(S) AFID
FIG. 2
US 2013/0167159 A1
300
1304:
3504-
352"
MOBILE O8
APPLICATION LAYER
APP #1
I
APP #2
354
DESKTOP 05
APPLICATION LAYER
APP #3
L460
P380
384
II
I
I ~
~I
II
I
APP #4
s4o?JFRAMEwORI< LAYER
FFRAMEWORK LAYER
V370 v
342 w
L
MANAGER(S)
SERVICE(S)
1
h344
372 '1
MANAGER(S)
'LIBRARIEs LAYER
SERV|0E(S)
P374
sso?jLlsRARlEs LAYER
V360
332,1,UJSER LIBRARIES
L
]
J L
[usER LIBRARIES
R362
322%
320% KERNEL
322$
112,,(
HARDWARE
FIG. 3
15m
US 2013/0167159 A1
430
r
?
ANDRDID os
APPLICATION LAYER
450,,
k
N451
IFRAMEWORK LAYER
M452
M453
M442
J54
M443
J55
y
4404,
441"
J44
M446
445,. HARDWARE
&SYSTEM
M447
MuLTIREMOTE
COMM. DISPLAY
DESKTOP
MoNIToR '
sERvIcEs
SERVICE
MANAGER
SERVICE
ANDRoID RUNTIME
432,1,
'LIBRARIEs LAYER
M435
LIBRARIES
A536
#439
.IV 431
"433
DALV'KVIRTUAL
MACHINE
US 2013/0167159 A1
520
ANDROID KERNEL
N521
TOUCHSCREEN DISPLAY
DRIVER
F
N522
DRIVER(S)
N523
BLUETOOTH
DR|VER(S)
WIFI
M524
MEMORY
M525
DR Ems) (BINDER) N529
POWER
CAMERA
USB
SHARED
life
M526
M527
528
l/O DEVICE
DR|VER(S)
DR|VER(S)
DR|VER(S)
MGMT.
l
FIG. 5
US 2013/0167159 A1
660
HYDROID 0S
F APPLICATION LAYER
6804,
M681
WORD PROCESSOR
M682
Mass
SPREAD
684
A985
EMA'L
SHEET
BROWSER
M671
REMOTE COMM. SERVICE
L
M672
DESKTOP ENV.
M673
WINDOW MANAGER
[$374
x SERvER
'LIBRARIES LAYER
662
Ad
M661
UTILS
M662
GRAPHICS
A963
IPC LIBRARY
N664
GLIBC
_J
LIBRARIES
L
LIBRARIES
(BINDER)
FIG. 6
US 2013/0167159 A1
700
POWER ON
702
FRAMEWORK
+
SETUP ROOT FILE ,, 706
SYSTEM
SERVICES
i
INITIALIZE
W720
1
7 a
DESKTOP OS
MEMORY &
cosggvdggotq "
i
START DESKTOP
MONITOR ~ T22
I
710 START KERNEL /"
SERVICE
ESTABLISH
I
KERNEL 712
DESKTOP OS m 724
EXECUTION
~ ENVIRONMENT
IMITIALIZES
DRIVERS
I .1,
START DESKTOP
@
lNlTlALlZES MOBILE OS
OS SERVICES '726
KERNEL
" 714
US 2013/0167159 A1
s 2:
844 W I
1Wa-.
FIG. 8
US 2013/0167159 A1
300a
R _ "mm Y .R ON ERS_ mww a w m M1 s1u A L Y ) _ . A? 0M 2w ow ?kfw I_fL no EA0ARDI RR MM M qAOK VP 0 U_H 4L! E_(LE N8|. E_ _W B EDI_RP
45 WP6UOED0Sln?u
AYnA D R
W @ K 6 C _ A
MM B .y a
CBTJAWIE
4 T |\
R| M MN A DL
me7on4w00om
Li W Q _ 1/)
\4 M vNW1E/3 K.3 RP IE
_ IL E #M 2 ln\lv\ _
w7 1% n3DO Rl8nj 2_ AA
_ \I
2 42WR NR NT ? A IE NI YT
nIkRA?.LrAkFIL
RM 2 B
RP 0C/\E MWJ
9
:SM (R._\
Jwmvl v,
w \6r\1\r
FL I
6 948
I I l I l I l
II
I I
FIG. 9
US 2013/0167159 A1
Owmcrwv
a .8. .
3t823C 3.2.
O QF
US 2013/0167159 A1
180
l
12 Fig.
1240B
US 2013/0167159 A1
| |. Iil|_
DlwZ-OEUm
E
UFOs-Nu WDOZ
US 2013/0167159 A1
1501
\s\
DETECT STIMULUS
<----
1505
v
VEHICLE LOCAL AREA NETWORK
1 509
\
l
SELECT PROCESSING RESOURCE FOR
MULTl-OPERATING SYSTEM OPERATION
1513
\\
l
CONSTRUCT NETWORK LINK BETWEEN
SELECTED PROCESSING RESOURCE AND USER ACCESSED DEVICE
FIG. 15
US 2013/0167159 A1
[0001] The present application is a continuation-in-part of US. patent application Ser. No. 13/217,108, ?led Aug. 24,
2011, entitled MULTI-OPERATING SYSTEM, Which is
incorporated herein by this reference in its entirety. [0002] The present application claims the bene?ts of US. Provisional Application Ser. Nos. 61/560,509, ?led Nov. 16, 2011; 61/637,164, ?ledApr. 23, 2012; and 61/663,335, ?led
Jun. 22, 2012, all entitled COMPLETE VEHICLE ECO
SYSTEM, 61/646,747, ?led on May 14, 2012, entitled Branding of Electrically Propelled Vehicles Via the Genera tion of Speci?c Operating Sounds; 61/ 653,275, ?led on May 30, 2012, entitled Vehicle Application Store for Console; 61/653,264, ?led on May 30, 2012, entitled Control of
Device Features Based on Vehicle State; 61/653,563, ?led
2012, entitled Removable, Con?gurable Vehicle Console; 13/462,593, ?led on May 2, 2012, entitled Con?gurable
Dash Display; 13/462,596, ?led on May 2, 2012, entitled
Con?gurable Heads-Up Dash Display; , ?led on
Nov. 16, 2012, entitled Implementation of Conquest Func tionality in Automotive Console (Attorney Docket No.
6583 -228); , ?led on Nov. 16, 2012, entitled Gesture
Application Store for Console (Attorney Docket No. 6583 230); , ?led on Nov. 16, 2012, entitledSharing Appli cations/Media BetWeen Car and Phone (Hydroid) (Attorney
Docket No. 6583-231); ney Docket No. 6583-232); , ?led on Nov. 16, 2012, , ?led on Nov. 16, 2012,
[0004]
entitled Music
Streaming
(Attorney
Docket No.
6583-233); , ?led on Nov. 16, 2012, entitled Control of Device Features Based on Vehicle State (Attorney Docket No. 6583-234); , ?led on Nov. 16, 2012, entitled
[0005] Vehicles are moving progressively toWards higher levels of computerization. Most vehicle tasks, functions, and
operations are noW under computer control or monitored by
[0006]
announced vehicle infotainment systems having more dynamic user interfaces. The CUETM infotainment system of
information, communication navigation, and entertainment While simultaneously simplifying the interaction and tailor
ing it to the driving experience. Ford has introduced a SYNCTM and MYFORDTM systems offering features similar
to CUETM and also an in-car application store for games and other types of applications. MYFORDTM offers an open
US 2013/0167159A1
[0007] Automotive manufacturers, however, have failed to integrate personal electronic devices of occupants, such as smart phones, tablet computers, and laptop computers, with
[0024] The computing device can further include a physical storage device, and the second execution environment can be logically isolated from the ?rst execution environment on the
operating system and a desktop operating system, and the second operating system the other of a mobile operating
mands from the input device through the shared kernel. [0028] The computing device can be con?gured using a boot process that includes the steps of:
[0029] starting, in response to a power on event, a boot
loader;
[0030] establishing, by the boot loader, the ?rst execution
environment;
[0031] starting, by the boot loader, the shared kernel; [0032] initializing, by the shared kernel, the ?rst operating system; [0033] starting, by the shared kernel, the ?rst application
framework;
[0034] starting, in the ?rst operating system, a ?rst monitor
service;
[0035] establishing, by the ?rst monitor service, a second
execution environment within the ?rst execution environ ment; and
[0036] starting, by the ?rst monitor service, the second application framework.
[0037] A multi-operating system manager can select a pro cessing resource from among a plurality of processing resources to execute ?rst and second operating systems, the
puting device, a tablet computer, a laptop computer, a per sonal computer, and a processing module of a vehicle. [0016] The system can further include a secondary terminal
?rst operating system being a native operating system of the selected processing resource and the second operating system being a native operating system of a second processing resource, and execute, by the second operating system, an
application on the selected processing resource and providing the results to the second processing resource for presentation
to a user. By way of example, a tablet computer can execute a
[0018]
that includes a display interface and serial communications interface. [0019] The computing device can further include a physical memory device. [0020] The ?rst operating system can be associated with a
system.
[0038] The present disclosure can provide a number of
?rst frame buffer in the physical memory device, and the second operating system with a second frame buffer in the physical memory device.
[0021] The computing device can further include a ?rst display device, and the ?rst frame buffer can be associated with the ?rst display device. [0022] The computing device can further include a second ary terminal environment. The secondary terminal environ ment can include a second display device, and the second frame buffer can be associated with the second display device. [0023] The second application can be displayed on the sec
pants, such as smart phones, tablet computers, and laptop computers, with the in-vehicle computational system. For
example, occupants can execute a ?rst application on a
the vehicle console. Occupants can, alternatively, execute a ?rst application on the vehicle processing module and cause
the vehicle console user interface to appear on a mobile
US 2013/0167159A1
computing device or vehicle processing module operating system, a personal computing device application can execute
on the mobile computing device or vehicle processing mod
units map database. Using the road database, the unit can give directions to other locations along roads also in its data base. Dead reckoning using distance data from sensors
attached to the drivetrain, a gyroscope and an accelerometer
[0047] The terms communication device, smartphone, computing device, and mobile device, and variations
thereof, as used herein, are used interchangeably and include any type of device capable of communicating With one or
more of another device and/or across a communications net
Work, via a communications protocol, and the like. Exem plary communication devices may include but are not limited
together.
[0041] The term a or an entity refers to one or more of
that entity. As such, the terms a (or an), one or more and
at least one can be used interchangeably herein. It is also to
be noted that the terms comprising, including, and hav ing can be used interchangeably.
[0042] The term automatic and variations thereof, as used herein, refers to any process or operation done Without material human input When the process or operation is per formed. HoWever, a process or operation can be automatic, even though performance of the process or operation uses material or immaterial human input, if the input is received
(RAM), read only memory (ROM), and the like. Non volatile media includes, for example, NVRAM, or magnetic or optical disks. Volatile media includes dynamic memory,
such as main memory. Common forms of computer-readable
before performance of the process or operation. Human input is deemed to be material if such input in?uences hoW the process or operation Will be performed. Human input that
consents to the performance of the process or operation is not deemed to be material.
[0043]
Examples include satellite location and navigation softWare, social networking softWare, gaming softWare, Word process
bution medium equivalent to a tangible storage medium. When the computer-readable media is con?gured as a data base, it is to be understood that the database may be any type
[0044]
cation distribution platform that alloWs users to broWse and doWnload applications from an online store. Applications are available either for free or at a cost. Appli cations can be doWnloaded directly to a target device. [0045] The term automatic and variations thereof, as used herein, refers to any process or operation done Without material human input When the process or operation is per formed. HoWever, a process or operation can be automatic, even though performance of the process or operation uses material or immaterial human input, if the input is received
and prior art-recognized equivalents and successor media, in Which the softWare implementations of the present disclosure are stored. Computer-readable storage medium commonly
before performance of the process or operation. Human input is deemed to be material if such input in?uences hoW the process or operation Will be performed. Human input that
consents to the performance of the process or operation is not deemed to be material.
instrument housing, head unit, indicator, gauge, meter, light, audio equipment, computer, screen, display, HUD unit, and
graphical user interface. [0050] The term desktop environment is used to refer to a style of GUI through Which the user interfaces With the OS
[0046]
US 2013/0167159A1
gets, and is not limited to a personal computer OS. For example, a mobile OS could have a desktop device environ ment, referring to the look and feel of the mobile OS GUI.
[0051]
ably and include any type of methodology, process, math ematical operation or technique. [0052] The term digital distribution (also called content delivery, online distribution, electronic software distribution (ESD), among others) refers to the delivery of media content
such as audio, video, softWare and video games Without the use of physical media usually over online delivery mediums, such as the Internet. The term online distribution is typically
layers make contact in the contacted location, Whereby a change in electrical ?eld is noted and the coordinates of the
contacted location calculated. In a capacitive touch screen, a
decrease in the charge of the capacitive layer. The decrease is measured, and the contacted location coordinates deter
mined. In a surface acoustic Wave touch screen, an acoustic
content. An online service for distribution of application soft Ware is usually called an application store or app store.
Content distributed online may be streamed or doWnloaded.
tion coordinates.
[0059] Utility softWare is system softWare designed to help analyZe, con?gure, optimiZe and/or maintain a com puter. Utility softWare usually focuses on hoW the computer
infrastructure (including the computer hardWare, operating system, application softWare and data storage) operates.
[0060] The term vehicle refers to a device or structure for
[0054] The term displayed image refers to an image pro duced on the display. A typical displayed image is a WindoW or desktop. The displayed image may occupy all or a portion
or is capable of movement. Typical vehicles may include but are in no Way limited to cars, trucks, motorcycles, busses,
of the display.
[0055] The term means as used herein shall be given its
broadest possible interpretation in accordance With 35 US. C., Section 112, Paragraph 6. Accordingly, a claim incorpo
rating the term means shall cover all structures, materials, or acts set forth herein, and all of the equivalents thereof. Further, the structures, materials or acts and the equivalents thereof shall include all those described in the summary of the
WindoW may obscure the desktop. [0062] The preceding is a simpli?ed summary of the dis
closure to provide an understanding of some aspects of the
disclosure. This summary is neither an extensive nor exhaus
disclosure, brief description of the draWings, detailed description, abstract, and claims themselves.
[0056] The term module as used herein refers to any
knoWn or later developed hardWare, softWare, ?rmware, arti ?cial intelligence, fuZZy logic, or combination of hardWare and softWare that is capable of performing the functionality
associated With that element. Also, While the disclosure is presented in terms of exemplary embodiments, it should be
appreciated that individual aspects of the disclosure can be
tive overvieW of the disclosure and its various aspects, embodiments, and/ or con?gurations. It is intended neither to identify key or critical elements of the disclosure nor to delin
eate the scope of the disclosure but to present selected con cepts of the disclosure in a simpli?ed form as an introduction
separately claimed.
[0057] The term satellite positioning system receiver
refers to a Wireless receiver or transceiver to receive and/or
system, such as the Global Positioning System (GPS) (US), GLONASS (Russia), Galileo positioning system (EU), Com pass navigation system (China), and Regional Navigational Satellite System (India).
[0058] The term screen, touch screen, or touchscreen
refers to a physical structure that enables the user to interact
[0063]
trated in referenced ?gures of the draWings, in Which like numbers refer to like elements throughout the description of
the ?gures.
[0064] FIG. 1 illustrates a computing environment that pro
With the computer by touching areas on the screen and pro vides information to a user through a display. The touch
screen may sense user contact in a number of different Ways,
[0065] FIG. 2 illustrates an exemplary system architecture for a mobile computing device, according to various embodi
ments.