MULTIMEDIA SYSTEMS
Lecturer
Adnan Ahmed
LECTURE 1
•Assignments………...20%
•Test/Quiz………10%
•Mid-Term………20%
SEMESTER PRESENTATION (10
MARKS)
At least once during the semester, each student will give a 15minute presentation on a Multimedia System topic. The presentations may consist of:
• A discussion on research work OR
• Demo (live software demo or video ) • A critique, covering some or all of
(a) Novelty
(b) Usefulness/impact
(c) Soundness of approach,
(d) Evaluation (soundness of evaluation and significance of findings)
•Limitations and future direction (one or two ideas regarding how the work could be extended)
TEXT BOOK
Multimedia : Making It Work, 8th Edition by Tay Vaughan, 2010
BOOK
S
REFERENCE BOOKS
•Introduction to Data Compression, Khalid Sayood, Morgane Kaufmann, 1 edition (2012)
•Multimedia Foundations: Core Concepts for Digital Design, Vic Costello, Susan Youngblood , Norman E. Youngblood, Focal Press, 1st Edition (2012)
•An Introduction to Digital Multimedia, T.M. Savag, K.E. Vogel, Jones and Barlett, 1st Edition (2013)
REFERENCE BOOKS
•Introduction to Multimedia System: Basic concept
of Multimedia,
•Kaliyaperumal Karthikeyan, Lap Lambert, 1st
edition (2011)
THE TERM “MULTIMEDIA”
Composed of 2 parts:
▪ Multi (multus) : “numerous, multiple”
▪ Media (medium): “middle, center” – agent for something. Used for dissemination (distribute) and representation of information.
▪ In general, multimedia could be defined as the usage of multiple agent (text, audio, video, images) for disseminating and presenting information to audience (target user)
Based on Edgar Dale (Cone Of Learning), on average, people remember:
•10% of what they read, •20% of what they hear, •30% of what they see,
•50% of what they hear and see, • Multimedia approach
• Multimedia rich elements, multi-sensory delivery system can facilitate greater retention of new knowledge
THE TERM “MEDIA”
Can be categorized based on a few criteria:
▪ Perception media
▪ Representation media
▪ Presentation media
▪ Storage media
PERCEPTION MEDIA
“How do humans perceive information”We perceive information from what we see and what we hear Visual media:
▪ Text, graphics, images, video Auditory media:
REPRESENTATION MEDIA
“How in information encoded in the computer”
Referring to how the information is represented internally to the computer.
The encoding used is of essential importance. Several options:
▪Text is encoded in ASCII
▪An audio data stream in PCM (Pulse Coded Modulation)
▪Image in JPEG format
PRESENTATION MEDIA
“Which medium is used to output information from the computer or input in the computer”
Refers to physical means used by systems to reproduce information for humans, e.g: audio and visual devices Input:
▪Keyboards, cameras, microphone, Head Mounted Device (for VR input)
Output:
STORAGE MEDIA
“Where is information stored”
Refer to various physical means for storing computer data, such as magnetic tapes, magnetic disks, or digital optical disks (CD-ROM, CD, DVD)
TRANSMISSION MEDIA
“Which medium is used to transmit data”
Refers to the physical means – cable of various type (coaxial cable, twisted pair, fiber optics), radio tower, satellite – that allow the transmission of telecommunication signals.
The difference between transmission media and storage media is the capability of transferring data continuously over networked computers.
SYSTEMS
The American Heritage® Dictionary of the English Language: Fourth Edition. 2000.
▪ The combined use of media, such as movies, music, lighting, CD-ROMs, and the Internet, as for education or entertainment
▪Multimedia is the presentation of a (usually interactive) computer application, incorporating media elements such as text graphics, video, animation, and sound, on a computer.
▪ It is the melding of the sensory power of television with the data manipulation and interactive capabilities of computer
SYSTEMS
• The presentation of a computer application, usually interactive, that incorporates media elements such as text, graphics, video, animation, and sound on a computer. Multimedia melds the sensory power of television with the data manipulation and interactive powers of computer.
• A multimedia system is characterized by computer-controlled, integrated production, manipulation, presentation, storage and communication of independent information, which is encoded at least through continuous (time-dependent) and a discrete (time-independent) medium.
SYSTEMS
Discrete and Continuous Media
▪ At least one discrete and continuous media Independent Media
▪ Separate each media independently Computer-Controlled Systems Integration
SYSTEMS
Interaction
▪Thought - Something that you do to yourself ~ internal process (mental state)
▪ Action - Something you do to an object in the world. The effect is that something in the world has changed. E.g.: pressing key, clicking mouse button
▪Interaction - Involves the participant in going outside the individual. Two way process. E.g.: give a query to search engine which can return an outcome of my search.
Properties
▪Various media integration
▪High level degree of interactivity between user and computer
APPLICATION AREAS OF IMS
Education
▪Computer Aided Learning (CAL)
▪E-Learning (World Wide Web)
Training
Point of Sales Information (Kiosk)
▪Direct visitors around the large complexes
News Delivery, Broadcasting and Advertising Commerce and Business Applications
1972 – A Game of Pong (first commercial multimedia product)
1973 – ATARI (laser disc, used in game cartridges) 1973 – IBM Disco vision (first multimedia interactive
kiosk products)
1978 – Apple II (with floppy drive) 1981 – Microsoft and IBM (IBM PC)
Christmas 1981 – Nintendo hit the market (30 million machines)
MULTIMEDIA
1980s – mouse was invented by Xerox Corp. 1984 – Macintosh using mouse
1984 – Virtual Reality was invented by NASA, input devices using HMD (Head-Mounted Display) and Data glove
1985 – Macro mind (Macromedia) produced Video Works, later changed to Director (the most widely used cross-platform
multimedia authoring tool)
1986 – first electronic encyclopaedia, first international conference on multimedia, first CD-ROM
1987 – Mac II (first color GUI) 1988 – CD-R (CD-Record)
MULTIMEDIA
1990s – Adobe released Photoshop.
1990s – Windows 3.0 multimedia enabled by Microsoft 1992 – first children ‘s interactive book title “Just
Grandma and Me”
1993 – double speed CD-ROM drives as a multimedia standard
1993 – Web Browser Mosaic 1994 – Web Browser Netscape
1995 – Multimedia PC, 32 bit, Windows 95. Later followed by Windows 98, Windows 2000
Multimedia
Modalities
Modalities are the sensory systems through which a
multimedia activity occurs
• This includes tactile (touch), gustatory (taste),
visual (sight), auditory (hearing), olfactory (smell).
• Based on the multimedia elements we have today,
• Multimedia systems must be computer
controlled.
• All multimedia components are integrated.
• The interface to the final user may permit
interactivity.
• Information must be represented digitally
Multimedia System
Characteristics
Hypertext
• text which contains links to other texts and is usually non-linear
• Invented by Ted Nelson around 1965
• Hypermedia is not constrained to be text-based.
• It can include other media, e.g., graphics, images, and continuous media (audio & video).
• Apparently, Ted Nelson was also the first to use this term. • The World Wide Web (WWW) is the best example of
hypermedia applications.
Hypertext and
Hypermedia
Types of Multimedia
Applications
1. Linear Multimedia• Users have little control over the presentation, just sit back and watches the presentation.
• The presentation normally plays from the start to end or even loops continually to present the information.
2. Interactive Multimedia
• Users dictate the flow of delivery, to control the what and
when.
•Users have the ability to move around or follow different path through the information presentation.
•Advantage: complex domain of information can be presented.
•Disadvantage: users might lost in the massive “information highway”.
•Useful for: information archive (encyclopedia), education, training and entertainment.
Multimedia
Applications
Examples of Multimedia Applications• Digital video editing and production systems • Electronic Newspapers/Magazines • Games • Groupware • Home shopping • Interactive TV • Multimedia courseware • Video conferencing • Video-on-Demand (VoD) • Virtual reality
• A fully functional multimedia project utilized
different tools and programming language
• Music Sequencing & notation
• Digital Audio
• Graphics & Image editing
• Video Editing
• Animation
• Multimedia Authoring
Multimedia Software
Tools
1. Audio/Music Sequencing & Notation/Digital Audio
Cakewalk
•Supports General MIDI.
•Provides several editing views (staff, piano roll, event list) and Virtual Piano.
•Can insert WAV files and Windows MCI commands (animation and video) into tracks.
Cool Edit Pro/Adobe Audition
•Used for wav file editing with a variety of filters and functions such as reverb, normalizing, noise reduction and amplification
Multimedia Software
Tools
2. Graphics & Image Editing
Adobe Photoshop
•An image & graphics editing tool.
•Supports many bitmap formats, e.g., GIF, PNG, JPEG, and BMP •Many filters and effects for photo enhancement
•Supports multiple layers Adobe Illustrator
• Powerful publishing tool for creating and editing vector graphics • Easily exported to use on the web
• Macromedia Fireworks
• Making graphics for the web (bitmap & vector editor, JavaScript generator)
Multimedia Software
Tools
3. Video Editing
Adobe Premiere
• Provides large number (up to 99) of video and audio tracks, superimpositions and virtual clips.
• Supports various transitions, filters and motions for clips. • A reasonable desktop video editing tool.
VirtualDub
• Freeware
• Flexible and expandable video editing software • Many features, filters and effects
• Supports several of the latest video and audio codecs
Multimedia Software
Tools
4. Animation
Multimedia APIs
• Java3D – used by Java to construct and render 3D graphics
• DirectX – windows API supports video, images, audio and 3D animation for computer games
• OpenGL – 1992, highly portable and multiplatform
Rendering Tools
• 3D Studio Max – high-end pro tools for character animation, game development, visual effects production.
• Softimage XSI – modelling, animation, rendering package for special effects in films and games
• Maya – complete modelling package.
• RenderMan – by Pixar, excels in creating complex surface appearances (Monsters Inc., Final Fantasy : The spirit within)
Multimedia Software
Tools
5. Multimedia Authoring - Tools for making a complete multimedia presentation, including animations, where users usually have a lot of interactive controls.
Macromedia Flash
• Create interactive movies or games for the web
Macromedia Director
• Movie metaphor (the cast includes bitmapped sprites, scripts, music, sounds, and palettes, etc).
• Can accept almost any bitmapped file formats.
• Lingo script language with own debugger allows more control including external devices, e.g., VCRs and video disk players.
• Web authoring features available for fully interactive Shockwave movies over the Web.
Multimedia Software
Tools
Macromedia Authorware
• Iconic/Flow-control metaphor, drag-and-drop interface. • Hyperlinks to link text, digital movies, graphics, and sound.
• Compatibility between files produced from PC version and MAC version. • Used mainly for developing courseware
Multimedia Software
Tools
The iconic/flow-control metaphor used by Authorware makes developing courseware easy
Why is multimedia so
important?
Technology Push• More processing power per chip • Progress in storage capacity
• Personal computer revolution • Progress in networking
• Progress in user interfaces, and software • Progress in compression techniques
Market Pull
• Large market - Revolutionizing film/video industry • Application challenges and competition
• Market opportunities