Fundamental Concepts in Text and Image
What is Multimedia?
When different people mention the term multimedia, they often have quite different, or even opposing, viewpoints.
A PC vendor: a PC that has sound capability, a DVD-ROM drive, and perhaps the superiority of multimediaenabled microprocessors that understand additional multimedia instructions.
A consumer entertainment vendor: interactive cable TV with hundreds of digital channels available, or a cable
TV-like service delivered over a high-speed Internet connection.
A Computer Science (CS) student: applications that use multiple modalities including text, images, drawings
(graphics), animation, video, sound including speech, and interactivity.
Multimedia and Computer Science: Graphics, HCI, visualization, computer vision, data compression, graph
theory, networking, database systems.
Components of Multimedia:
Multimedia involves multiple modalities of text, audio, images, drawings, animation, and video. Examples of how these
modalities are put to use:
Distributed lectures for higher education.
Co-operative work environments.
Searching in (very) large video and image databases for target visual objects.
Augmented reality: placing real-appearing computer graphics and video objects into scenes.
Including audio cues for where video-conference participants are located.
Building searchable features into new video, and enabling very high- to very low-bit-rate use of new, scalable
multi media products.
Making multimedia components editable.
Building inverse-Hollywood applications that can recreate the process by which a video was made.
Using voice-recognition to build an interactive environment, say a kitchen-wall web browser.
Multimedia Research Topics and Projects:
To the computer science researcher, multimedia consists of a wide variety of topics:
1. Multimedia processing and coding: multimedia content analysis, content-based multimedia retrieval,
multimedia security, audio/image/video processing, compression, etc.
2. Multimedia system support and networking: network protocols, Internet, operating systems, servers
and clients, quality of service (QoS), and databases.
3. Multimedia tools, end-systems and applications: hypermedia systems, user interfaces, authoring
4. Multi-model interaction and integration: web-everywhere devices, multimedia education including
Computer Supported Collaborative Learning, and design and applications of virtual environments.