LECTURE NOTES SUBJECT: DIGITAL IMAGE AND SPEECH PROCESSING SUBJECT CODE: ECS-702, BRANCH: EL&TCE SYLLABUS Module –I Digital Image (12 hours) 1. Different stages of Image processing & Analysis Scheme. Components of Image Processing System, Multiprocessor Interconnections. 2. A Review of various Mathematical Transforms. 3. Image Formation: Geometric Model, Photometric Model. 4. Image Digitization : A review of Sampling and quantization processes. A digital image. Module – II (12 Hours) Image Processing 5. Image Enhancement: Contrast Intensification, Smoothing, Image sharpening. 6. Restoration : Minimum Mean – Square Error Restoration by Homomorphic Filtering. 7. Image Compression : Schematic diagram of Data Compression Procedure, Lossless compression – coding. 8. Multivalued Image Processing, Multispectral Image Processing, Processing of color images. Module –III (8 Hours) Digital Speech Processing 1. The Fundamentals of Digital Speech Processing. A Review of Discrete-Time Signal & Systems , the Z-transform, the DFT, Fundamental of Digital Filters, FIR system, IIR Systems. 2. Time –Domain Methods for Speech Processing. Time-Dependent Processing of speech, short-time energy and Average Magnitude, Short time Average Zero- Crossing Rate. 3. Digital Representation of speech Waveform Sampling speech signals,statistical model,Instantaneous quantization, Instantaneous companding, quantization for optimum SNR,Adaptive quantization,Feed-forward Feedback adaptions. Module –IV (8 Hours) Linear Predictive Coding of Speech Block diagram of Simplified Model for Speech Production. Basic Principles of Linear Predictive Analysis- The Auto Correlation Method. The Prediction Error Signal. Digital Speech Processing for Man-Machine Communication by voice. Speaker Recognition Systems- Speaker verification and Speaker Identification Systems. .
MODULE-1 DIGITAL IMAGE INTRODUCTION The digital image processing deals with developing a digital system that performs operations on a digital image. An image is nothing more than a two dimensional signal. It is defined by the mathematical function f(x,y) where x and y are the two co-ordinates horizontally and vertically and the amplitude of f at any pair of coordinate (x, y) is called the intensity or gray level of the image at that point. When x, y and the amplitude values of f are all finite discrete quantities, we call the image a digital image. The field of image digital image processing refers to the processing of digital image by means of a digital computer. A digital image is composed of a finite number of elements, each of which has a particular location and values of these elements are referred to as picture elements, image elements and pixels. Motivation and Perspective Digital image processing deals with manipulation of digital images through a digital computer. It is a subfield of signals and systems but focus particularly on images. DIP focuses on developing a computer system that is able to perform processing on an image. The input of that system is a digital image and the system process that image using efficient algorithms, and gives an image as an output. The most common example is Adobe Photoshop. It is one of the widely used applications for processing digital images. Applications Some of the major fields in which digital image processing is widely used are 1. Gamma Ray Imaging- Nuclear medicine and astronomical observations. 2. X-Ray imaging – X-rays of body. 3. Ultraviolet Band –Lithography, industrial inspection, microscopy, lasers. 4. Visual And Infrared Band – Remote sensing. 5. Microwave Band – Radar imaging.
Components of Image Processing System i) Image Sensors With reference to sensing, two elements are required to acquire digital image. The first is a physical device that is sensitive to the energy radiated by the object we wish to image and second is specialized image processing hardware. ii) Specialize image processing hardware – It consists of the digitizer just mentioned, plus hardware that performs other primitive operations such as an arithmetic logic unit, which performs arithmetic such addition and subtraction and logical operations in parallel on images. iii) Computer It is a general purpose computer and can range from a PC to a supercomputer depending on the application. In dedicated applications, sometimes specially designed computer are used to achieve a required level of performance iv) Software It consist of specialized modules that perform specific tasks a well designed package also includes capability for the user to write code, as a minimum, utilizes the specialized module. More sophisticated so ft ware packages allow the integration of these modules. v) Mass storage This capability is a must in image processing applications. An image of size 1024 x1024 pixels, in which the intensity of each pixel is an 8- bit quantity requires one megabytes of storage space if the image is not compressed. Image processing applications falls into three principal categories of storage i) Short term storage for use during processing ii) On line storage for relatively fast retrieval iii) Archival storage such as magnetic tapes and disks
vi) Image displays Image displays in use today are mainly color TV monitors. These monitors are driven by the outputs of image and graphics displays cards that are an integral part of computer system vii) Hardcopy devices The devices for recording image includes laser printers, film cameras, heat sensitive devices inkjet units and digital units such as optical and CD ROM disk. Films provide the highest possible resolution, but paper is the obvious medium of choice for written applications. viii) Networking It is almost a default function in any computer system in use today because of the large amount of data inherent in image processing applications. The key consideration in image transmission bandwidth. Elements of Visual Perception Structure of the human Eye The eye is nearly a sphere with average approximately 20 mm diameter. The eye is enclosed with three membranes a) b) c) The cornea and sclera: it is a tough, transparent tissue that covers the anterior surface of the eye. Rest of the optic globe is covered by the sclera The choroid: It contains a network of blood vessels that serve as the major source of nutrition to the eyes. It helps to reduce extraneous light entering in the eye It has two parts (1) Iris Diaphragms- it contracts or expands to control the amount of light that enters the eyes. (2) Ciliary body Retina – it is innermost membrane of the eye. When the eye is properly focused, light from an object outside the eye is imaged on the retina. There are various light receptors over the surface of the retina The two major classes of the receptors are1) cones- it is in the number about 6 to 7 million. These are located in the central portion of the retina called the fovea. These are highly sensitive to color. Human can resolve fine details with these cones because each one is connected to its own nerve end. Cone vision is called photopic or bright light vision