×
When you want to succeed as bad as you want to breathe, then you’ll be successful.
--Your friends at LectureNotes
Close

Parallel and Distributed Systems

by Rishab SahooRishab Sahoo
Type: NoteSpecialization: Computer Science EngineeringOffline Downloads: 236Views: 7294Uploaded: 1 year ago

Share it with your friends

Suggested Materials

Leave your Comments

Contributors

Rishab Sahoo
Rishab Sahoo
MU Parallel Distributed Systems CBGS 2015-2016 Parallel & Distributed Systems B.E. COMPUTER ENGINEERING (CPC803) ANURADHA BHATIA M.E. Computer Engineering
Parallel & Distributed Systems Table of Contents 1. Introduction.................................................................................................................................................... 1 2. Pipeline Processing ................................................................................................................................... 36 3. Synchronous Parallel Processing ......................................................................................................... 52 4. Introduction to Distributed Systems .................................................................................................. 65 5. Communication .......................................................................................................................................... 88 6. Resource and Process Management.................................................................................................. 124 7. Synchronization ....................................................................................................................................... 153 8. Consistency and Replication ................................................................................................................ 177 Anuradha Bhatia
Parallel & Distributed Systems 1. Introduction CONTENTS 1.1 1.2 1.3 1.4 1.5 1.6 Parallel Computing. Parallel Architecture. Architectural Classification Scheme, Performance of Parallel Computers Performance Metrics for Processors Parallel Programming Models, Parallel Algorithms. Anuradha Bhatia
Parallel & Distributed Systems 1.1 1. Introduction Basics of Parallel Distributed Systems and Parallel Computing 1. What is Parallel Computing? i. Traditionally, software has been written for serial computation:  To be run on a single computer having a single Central Processing Unit (CPU);  A problem is broken into a discrete series of instructions.  Instructions are executed one after another.  Only one instruction may execute at any moment in time. Figure 1.1: Parallel Computing ii. In the simplest sense, parallel computing is the simultaneous use of multiple compute resources to solve a computational problem:  To be run using multiple CPUs  A problem is broken into discrete parts that can be solved concurrently  Each part is further broken down to a series of instructions  Instructions from each part execute simultaneously on different CPUs Anuradha Bhatia 2

Lecture Notes