Chapter 1 - Introduction To Multimedia - 1

1.1 What is Multimedia?
When
Wh diff
differentt people
l mention
ti th
the tterm multimedia,
lti di th
they often
ft
have quite different, or even opposing, viewpoints.
Chapter 1
Introduction to Multimedia
1.1 What is Multimedia?
1.2 Multimedia
l
d and
d Hypermedia
d
1.3 World Wide Web
1.4 Overview of Multimedia Software Tools
1.5 Further Exploration
A PC vendor: a PC that has sound capability, a DVD-ROM drive, and

perhaps the superiority of multimedia-enabled
multimedia enabled microprocessors that
understand additional multimedia instructions.
A consumer entertainment vendor: interactive cable TV with hundreds
of digital channels available
available, or a cable TV-like
TV like service delivered over a
high-speed Internet connection.
A Computer Science (CS) student: applications that use multiple
g , drawings
g (graphics),
(g p
), animation,,
modalities,, includingg text,, images,
video, sound including speech, and interactivity.
Multimedia and Computer Science:

Graphics, HCI, visualization, computer vision, data compression, graph
theory, networking, database systems. Multimedia and Hypermedia
Multimedia Systems (eadeli@iust.ac.ir)
Fundamentals of Multimedia, Chapter 1
Components of Multimedia
Multimedia
M lti di iinvolves
l
multiple
lti l modalities
d liti off ttext,
t audio,
di
images, drawings, animation, and video.
Examples of how these modalities are put to use:
1.
2.
3.
4.
5.
Video teleconferencing.
g
Distributed lectures for higher education.
Tele-medicine.
Co-operative work environments.
Searching in (very) large video and image databases for
target visual objects
objects.
6. Augmented reality: placing real-appearing computer
ggraphics
p
and video objects
j
into scenes.
3
7 IIncluding
7.
l di audio
di cues ffor where
h
video-conference
id
f
participants are located.
8 Building searchable features into new video
8.
video, and
enabling very high- to very low-bit-rate use of new,
scalable multimedia products.
9. Making multimedia components editable.
10. Building inverse-Hollywood
inverse Hollywood applications that can
recreate the process by which a video was made.
g
to build an interactive
11. Usingg voice-recognition
environment, say a kitchen-wall web browser.
www.jntuworld.com
Multimedia Research Topics and Projects

To the computer science researcher
researcher, multimedia consists of a wide variety of topics:
1. Multimedia processing and coding: multimedia content analysis, contentbased multimedia retrieval, multimedia security, audio/image/video processing,
compression, etc.
2. Multimedia system support and networking: network protocols, Internet,
operating
i systems, servers and
d clients,
li
quality
li off service
i (Q
(QoS),
S) and
dd
databases.
b
3. Multimedia tools, end-systems and applications: hypermedia systems, user
interfaces authoring systems.
interfaces,
systems
4. Multi-modal interaction and integration: ubiquity web-everywhere
devices, multimedia education including Computer Supported Collaborative
Learning, and design and applications of virtual environments.
Current Multimedia Projects

Many
M
exciting
iti research
h projects
j t are currently
tl underway.
d
H
Here are a
few of them:
1. Camera-based object tracking technology: tracking of the control
objects provides user control of the process.
2 3D motion
2.
ti capture:
t
used
d ffor multiple
lti l actor
t capture
t
so that
th t multiple
lti l
real actors in a virtual studio can be used to automatically produce
realistic animated models with natural movement.
3. Multiple views: allowing photo-realistic (video-quality) synthesis of
virtual actors from several cameras or from a single camera under
differing lighting.
4. 3D capture technology: allow synthesis of highly realistic facial
animation from speech.
5 Specific
5.
S ifi multimedia
lti di applications:
li ti
aimed
i d att h
handicapped
di
d persons with
ith
low vision capability and the elderly a rich field of endeavor.
6. Digital fashion: aims to develop smart clothing that can communicate
with other such enhanced clothing using wireless communication, so
as to artificially enhance human interaction in a social setting.
1.2 Multimedia and Hypermedia

History
Hi t
off M
Multimedia:
lti di
1. Newspaper: perhaps the first mass communication medium,
uses text, graphics, and images.
7. Electronic Housecall system: an initiative for providing interactive

h lth monitoring
health
it i services
i
tto patients
ti t iin th
their
i homes
h
2. Motion p
pictures: conceived of in 1830s in order to observe
motion too rapid for perception by the human eye.
8. Augmented Interaction applications: used to develop interfaces

between real and virtual humans for tasks such as augmented
storytelling.
3. Wireless radio transmission: Guglielmo

g
Marconi,, at Pontecchio,,
Italy, in 1895.
4. Television: the new medium for the 20th century,
y, established
video as a commonly available medium and has since changed
the world of mass communications.
www.jntuworld.com
5 The connection between computers and ideas about multimedia covers what is actually
5.
only a short period:
1985 Negroponte
N
and
d Wiesner
Wi
co-founded
f
d d the
h MIT M
Media
di Lab.
L b
1989 Tim Berners-Lee proposed the World Wide Web
1990 Kristina Hooper Woolsey headed the Apple Multimedia Lab.
Lab
1991 MPEG-1 was approved as an international standard for digital
video led to the newer standards,
standards MPEG-2,
MPEG-2 MPEG-4,
MPEG-4 and further
MPEGs in the 1990s.
1991 The introduction of PDAs in 1991 began a new period in the
use of computers in multimedia.
1992 JPEG was accepted as the international standard for digital
i
image
compression
i led
l d tto th
the new JPEG2000 standard.
t d d
1992 The first MBone audio multicast on the Net was made.
1993 The University of Illinois National Center for Supercomputing
Applications produced NCSA Mosaicthe first full-fledged browser.
1945 Vannevar Bush wrote a landmark article describing what amounts to a

h
hypermedia
di system called
ll d Memex.
M
Link to full V. Bush 1945 Memex article, As We May Think
1960 Ted Nelson coined the term hypertext.
1967 Nicholas Negroponte
g p
formed the Architecture Machine Group.
p
1968 Douglas Engelbart demonstrated the On-Line System (NLS), another very early
hypertext program.
1969 Nelson and van Dam at Brown University created an early hypertext editor
called FRESS.
1976 The MIT Architecture Machine Group proposed a project entitled Multiple
Media resulted in the Aspen Movie Map, the first hypermedia videodisk, in 1978.
10
1994 Jim
Ji Cl
Clarkk and
dM
Marc A
Andreessen
d
created
d the
h Netscape
N
program.
1995 The JAVA language was created for platform-independent
platform independent
application development.
1996 DVD video was introduced; high quality full-length
movies were distributed on a single disk.
1998 XML 1.0 was announced as a W3C Recommendation.
1998 Hand-held MP3 devices first made inroads into
consumerist tastes in the fall of 1998,, with the introduction of
devices holding 32MB of flash memory.
2000 WWW size was estimated at over 1 billion pages.
11
Hypermedia and Multimedia

A hypertext
h perte t system:
t
meantt to
t be
b read
d nonlinearly,
li
l b
by ffollowing
ll i lilinks
k
that point to other parts of the document, or to other documents
(Fig. 1.1)
HyperMedia: not constrained to be text-based, can include other
media, e.g., graphics, images, and especially the continuous media
sound
d and
d video.
id
- The World Wide Web ((WWW)) the best example
p of a
hypermedia application.
Multimedia means that computer information can be represented
through audio, graphics, images, video, and animation in addition
to traditional media.
12
www.jntuworld.com
Examples of typical present multimedia applications include:
Figg 1.1: Hypertext

yp
is nonlinear
13
Digital video editing and production systems.

Electronic newspapers/magazines.
World Wide Web.
On-line reference works: e.g. encyclopedia, games, etc.
Home shopping.
Interactive TV.
Multimedia courseware.
Video conferencing.
Video-on-demand.
Interactive movies.
14
1.3 World Wide Web

The
Th W3C h
has lilisted
t d th
the ffollowing
ll i goals
l ffor th
the WWW
WWW:
1. Universal access of web resources (by everyone everywhere).
2. Effectiveness of navigating available information.
3. Responsible use of posted material.
History of the WWW
1960s Charles Goldfarb et al. developed the Generalized Markup
Language (GML) for IBM.
1986 The ISO released a final version of the Standard Generalized
Markup Language (SGML).
15
1990 Tim Berners-Lee invented the HyperText Markup

Language (HTML), and the HyperText Transfer Protocol
(HTTP).
(HTTP)
1993 NCSA released an alpha version of Mosaic based on the
version by Marc Andreessen for X-Windows the first
popular browser.
1994 Marc Andreessen et al. formed Mosaic Communications
Corporation later the Netscape Communications
Corporation.
1998 The W3C accepted XML version 1.0 specifications as a
Recommendation the main focus of the W3C and
supersedes HTML.
16
www.jntuworld.com
HTTP (HyperText Transfer Protocol)

HTTP:
HTTP a protocol that was originally designed for transmitting hypermedia
hypermedia,
but can also support the transmission of any file type.
Two
T popular
l methods:
h d GET and
d POST.
POST
The basic response format:
HTTP is a stateless request/response protocol: no information carried over

for the next request.
Version
i
Status-Code Status-Phrase
Additional-Headers
Message body
Message-body
The basic request format:

Method URI Version
Additi
Additional-Headers:
l H d
Message-body
Two commonly seen status codes:

1. 200 OK the request was processed successfully.
1
successfully
2. 404 Not Found the URI does not exist.
The
Th URI (Uniform
(U if
R
Resource Id
Identifier):
tifi ) an id
identifier
tifi ffor th
the resource
accessed, e.g. the host name, always preceded by the token http://.
17
18
HTML (HyperText Markup Language)

HTML:
HTML a language
l
ffor publishing
bli hi H
Hypermedia
di on th
the W
World
ld
Wide Web defined using SGML:
1 HTML uses ASCII,
1.
ASCII it is portable to all different (possibly
binary incompatible) computer hardware.
2. The current version of HTML is version 4.01.
3. The next generation of HTML is XHTML a
reformulation of HTML using XML.
HTML uses tags to describe document elements:
<token params> defining a starting point
point.
</token> the ending point of the element.
Some elements have no endingg tags.
g
19
A very simple
i l HTML page iis as ffollows:
ll
<HTML> <HEAD>
<TITLE>
A sample web page.
</TITLE>
<META NAME = "Author" CONTENT =
"Cranky Professor">
</HEAD> <BODY>
<P>
We can put any text we like here,
paragraph
g p element.
since this is a p
</P>
</BODY> </HTML>
Naturally, HTML has more complex structures and can be mixed in with
other standards.
20
www.jntuworld.com
XML (Extensible Markup Language)
The current XML version is XML 11.0,

0 approved by the W3C in
Feb. 1998.
XML:
XML a markup
k language
l
ffor th
the WWW iin which
hi h th
there iis modularity
d l it
of data, structure and view so that user or application can be able
to define the tags (structure).
XML syntax looks like HTML syntax, although it is much more

strict:
Example of using XML to retrieve stock information from a database

according to a user query:
All tags are in lower case, and a tag that has only inline
data has to terminate itself,
itself ii.e.,
e <token params />.
/>
1. First use a global Document Type Definition (DTD) that is already

defined.
2. The server side script will abide by the DTD rules to generate an XML
document according to the query using data from your database.
3. Finally send user the XML Style Sheet (XSL) depending on the type of
d
device
used
d to d
display
l the
h information.
f
Uses name spaces

p
so that multiple
p DTDs declaringg
different elements but with similar tag names can have
their elements distinguished.
DTDs can be imported from URIs as well.
21
22
An example of an XML document structure

the definition for a small XHTML document:
The following XML related specifications are also

standardized:
<?xml version="1.0" encoding="iso-8859-1"?>

<!DOCTYPE htmlPUBLIC "- //
//W3C//DTD
//
XHTML 1.0
"http://www.w3.org/TR/xhtml1/DTD/xhtml1transition.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
xmlns "http://www w3 org/1999/xhtml">
... [html that follows the above mentioned
XML rules]
</html>
23
XML Protocol: used to exchange XML information between

processes.
XML Schema: a more structured and powerful language for
defining XML data types (tags).
XSL: basically CSS for XML.
SMIL: Synchronized Multimedia Integration Language,
pronounced smilea particular application of XML (globally
predefined DTD)) that allows for specification
p
p
of interaction
among any media types and user input, in a temporally
scripted manner.
24
www.jntuworld.com
SMIL (Synchronized Multimedia Integration

Language)
Purpose
P
off SMIL
SMIL: it iis also
l d
desirable
i bl tto b
be able
bl tto publish
bli h
multimedia presentations using a markup language.
A multimedia markup language needs to enable scheduling
and synchronization of different multimedia elements, and
define their interactivity with the user
user.
The W3C established a Working Group in 1997 to come up
with specifications for a multimedia synchronization
language SMIL 2.0 was accepted in August 2001.
1 All SMIL elements are divided into modules sets of XML

1.
elements, attributes and values that define one conceptual
functionality.
2. In the interest of modularization, not all available modules need
to be included for all applications.
3. Language Profiles: specifies a particular grouping of modules,
and particular modules may have integration requirements that
a profile must follow.
SMIL 2.0 has a main language profile that includes
almost all SMIL modules.
Basic
B i elements
l
off SMIL as shown
h
iin the
h ffollowing
ll i example:
l
SMIL 2.0 is specified in XML using a modularization
approach
pp
similar to the one used in xhtml:
25
26
<!DOCTYPE
!DOCTYPE smil PUBLIC "
"-//W3C//DTD
//W3C//DTD SMIL 2
2.0"
0"
"http://www.w3.org/2001/SMIL20/SMIL20.dtd">
<smil xmlns="http://www.w3.org/2001/SMIL20/Language">
<head>
h d
<meta name="Author" content="Some Professor" />
</head>
<body>
b d
<par id="MakingOfABook">
<seq>
<video src="authorview.mpg" />
<img src="onagoodday.jpg" />
</seq>
1.4 Overview of Multimedia Software Tools

The
Th categories
t
i off software
ft
ttools
l b
briefly
i fl examined
i dh
here are:
1. Music Sequencing and Notation
2. Digital Audio
3. Graphics and Image Editing
4. Video Editing
<audio src="authorview.wav" />

<text src="http://www.cs.sfu.ca/mmbook/" />
</par>
</body>
</smil>
27
5 Animation
5.
6. Multimedia Authoring
28
www.jntuworld.com
Music Sequencing and Notation
Digital Audio
Digital
Di it l A
Audio
di ttools
l d
deall with
ith accessing
i and
d editing
diti th
the actual
t l
sampled sounds that make up audio:
Cakewalk:
Cakewalk now called Pro Audio
Audio.
The term sequencer comes from older devices that stored sequences of
notes (events
(events, in MIDI)
MIDI).
It is also possible to insert WAV files and Windows MCI commands (for
animation and video) into music tracks (MCI is a ubiquitous
component of the Windows API
API.))
Cool Edit: a very powerful and popular digital audio toolkit; emulates
a professional audio studio multitrack productions and sound file
editing including digital signal processing effects.
Cubase: another sequencing/editing program, with capabilities similar to

those of Cakewalk
Cakewalk. It includes some digital audio editing tools
tools.
Sound Forge: a sophisticated PC-based program for editing audio

WAV files.
Macromedia Soundedit: mature program for creating audio for multimedia

projects and the web that integrates well with other Macromedia
products such as Flash and Director.
Pro Tools: a high-end integrated audio production and editing

environment MIDI creation and manipulation; powerful audio
mixing, recording, and editing software.
29
30
Graphics and Image Editing

Adobe Illustrator:
Illustrator a powerful publishing tool from Adobe
Adobe. Uses vector
graphics; graphics can be exported to Web.
Adobe Photoshop: the standard in a graphics
graphics, image processing and
manipulation tool.
Allows layers of images,
images graphics,
graphics and text that can be separately
manipulated for maximum flexibility.
Filter factory permits creation of sophisticated lighting-effects filters.
Macromedia Fireworks: software for making graphics specifically for the
web.
Macromedia Freehand: a text and web graphics editing tool that supports
many bitmap formats such as GIF, PNG, and JPEG.
31
Video Editing
Adobe Premiere:
Premiere an intuitive,
i t iti simple
i l video
id editing
diti ttooll ffor nonlinear
li
editing, i.e., putting video clips into any order:
Video and audio are arranged in tracks.
Provides a large number of video and audio tracks,
superimpositions
p
p
and virtual clips.
p
A large library of built-in transitions, filters and motions for
clips effective multimedia productions with little effort.
Adobe After Effects: a powerful video editing tool that enables users
to add and change existing movies. Can add many effects: lighting,
shadows motion blurring; layers
shadows,
layers.
Final Cut Pro: a video editing tool by Apple; Macintosh only.
32
www.jntuworld.com
Rendering Tools:
Animation
Multimedia APIs:
APIs
Java3D: API used by Java to construct and render 3D graphics, similar to the
way in which the Java Media Framework is used for handling media files
files.
1. Provides a basic set of object primitives (cube, splines, etc.)
for building scenes
scenes.
2. It is an abstraction layer built on top of OpenGL or DirectX
(the user can select which)
which).
DirectX: Windows API that supports video, images, audio and 3-D animation
OpenGL: the highly portable, most popular 3-D API.
33
3D Studio Max: rendering tool that includes a number of very

high-end professional tools for character animation, game
development, and visual effects production.
Softimage XSI: a powerful modeling, animation, and rendering
package used for animation and special effects in films and
games.
Maya: competing product to Softimage; as well, it is a complete
modeling package.
RenderMan: rendering package created by Pixar.
GIF Animation Packages: a simpler approach to animation,

allows veryy quick
q
development
p
of effective small
animations for the web.
34
Multimedia Authoring
Macromedia Flash
Flash: allows
ll
users tto create
t iinteractive
t
ti movies
i b
by
using the score metaphor, i.e., a timeline arranged in parallel event
sequences.
Macromedia Director: uses a movie metaphor to create interactive
presentations very powerful and includes a built-in scripting
l
language,
Li
Lingo,
th t allows
that
ll
creation
ti off complex
l interactive
i t
ti movies.
i
Authorware: a mature,, well-supported
pp
authoringg p
product based on
the Iconic/Flow-control metaphor.
Quest: similar to Authorware in many ways,
ways uses a type of
flowcharting metaphor. However, the flowchart nodes can
encapsulate information in a more abstract way (called frames)
than simply subroutine levels.
35
Some Open-Source Multimedia Authoring Tools

Virtual Dub:
Dub A video capture/processing utility for 32-bit
32 bit Windows
platforms, licensed under the GNU GPL.
http://www.virtualdub.org/
http://virtualdub sourceforge net/
http://virtualdub.sourceforge.net/
Audacity: Audacity is a free, easy-to-use audio editor and recorder for
Windows Mac OS X,
Windows,
X GNU/Linux and other operating systems.
systems
http://audacity.sourceforge.net/
KompoZer: A complete
l
web
b authoring
h i
system that
h combines
bi
web
b file
fil
management and easy-to-use WYSIWYG web page editing. Designed to be
extremely easy to use.
http://www kompozer net/
http://www.kompozer.net/
And a lot more at: http://sourceforge.net/
36
www.jntuworld.com

Chapter 1 - Introduction To Multimedia - 1

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Chapter 1 - Introduction To Multimedia - 1

Uploaded by

Copyright:

Available Formats

1.1 What is Multimedia?

A PC vendor: a PC that has sound capability, a DVD-ROM drive, and

Multimedia and Computer Science:

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Fundamentals of Multimedia, Chapter 1

Multimedia Research Topics and Projects

Current Multimedia Projects

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

1.2 Multimedia and Hypermedia

7. Electronic Housecall system: an initiative for providing interactive

8. Augmented Interaction applications: used to develop interfaces

3. Wireless radio transmission: Guglielmo

Multimedia Systems (eadeli@iust.ac.ir)

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Fundamentals of Multimedia, Chapter 1

1945 Vannevar Bush wrote a landmark article describing what amounts to a

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Hypermedia and Multimedia

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Fundamentals of Multimedia, Chapter 1

Examples of typical present multimedia applications include:

Figg 1.1: Hypertext

Digital video editing and production systems.

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

1.3 World Wide Web

Multimedia Systems (eadeli@iust.ac.ir)

1990 Tim Berners-Lee invented the HyperText Markup

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Fundamentals of Multimedia, Chapter 1

HTTP (HyperText Transfer Protocol)

HTTP is a stateless request/response protocol: no information carried over

The basic request format:

Two commonly seen status codes:

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

HTML (HyperText Markup Language)

Multimedia Systems (eadeli@iust.ac.ir)

Multimedia Systems (eadeli@iust.ac.ir)

Fundamentals of Multimedia, Chapter 1

Fundamentals of Multimedia, Chapter 1

XML (Extensible Markup Language)

The current XML version is XML 11.0,

XML syntax looks like HTML syntax, although it is much more