Top Banner
Understanding Parallel Computers Parallel Processing EE 613
48

Understanding Parallel Computers Parallel Processing EE 613.

Jan 18, 2018

Download

Documents

Claude Norton

A Look At Six Parallel Computers Chip Multiprocessors –Intel Core Duo –AMD Dual Core Opteron Heterogeneous Chip Designs –GPU, FPGA, Cell –Vector Clusters –Node – processors, RAM, disk, memory not shared –Typical - eight nodes, control processor, switch –Blade server – includes com ports and cooling fans Supercomputers – BlueGene/L (440 PowerPC’s)
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Understanding Parallel Computers Parallel Processing EE 613.

Understanding Parallel Computers

Parallel ProcessingEE 613

Page 2: Understanding Parallel Computers Parallel Processing EE 613.

Balancing Machine Specifics With Portability

• How much do we need to know about the machine architecture– Performance goal

• Game developers, embedded systems, and hardware vendors

• Coding specific to machine– Lifetime goal

• Portability• Generalized code

Page 3: Understanding Parallel Computers Parallel Processing EE 613.

A Look At Six Parallel Computers

• Chip Multiprocessors– Intel Core Duo– AMD Dual Core Opteron

• Heterogeneous Chip Designs– GPU, FPGA, Cell– Vector

• Clusters– Node – processors, RAM, disk, memory not shared– Typical - eight nodes, control processor, switch– Blade server – includes com ports and cooling fans

• Supercomputers – BlueGene/L (440 PowerPC’s)

Page 4: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 5: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 6: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 7: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 8: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Now we can put multiple cores on a single chip.

Page 9: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

MESI – Modified, Exclusive, Shared, Invalid

Page 10: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 11: Understanding Parallel Computers Parallel Processing EE 613.
Page 12: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

MOESI – Modified, Owned, Exclusive, Shared, Invalid

Page 13: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Both designs implement a coherent shared memory.

Page 14: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 15: Understanding Parallel Computers Parallel Processing EE 613.

Symmetric Multiprocessor (SMP)• Each processor makes memory requests over the common memory bus• All cache controllers snoop the memory bus and adjust the tags on their

cached values to ensure coherent cache usage.

Page 16: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Example – po & p1 have copies of Block X, but p2 writes to Block X.

Page 17: Understanding Parallel Computers Parallel Processing EE 613.
Page 18: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 19: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 20: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 21: Understanding Parallel Computers Parallel Processing EE 613.
Page 22: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 23: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 24: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 25: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 26: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 27: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 28: Understanding Parallel Computers Parallel Processing EE 613.
Page 29: Understanding Parallel Computers Parallel Processing EE 613.
Page 30: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 31: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 32: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 33: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 34: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 35: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 36: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 37: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 38: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 39: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 40: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 41: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 42: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 43: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 44: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 45: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 46: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 47: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder

Page 48: Understanding Parallel Computers Parallel Processing EE 613.

CSE524 Parallel Algorithms Lawrence Snyder