YOU ARE DOWNLOADING DOCUMENT

Please tick the box to continue:

Transcript
Page 1: Understanding Parallel Computers

Understanding Parallel Computers

Parallel ProcessingEE 613

Page 2: Understanding Parallel Computers

Balancing Machine Specifics With Portability

• How much do we need to know about the machine architecture– Performance goal

• Game developers, embedded systems, and hardware vendors

• Coding specific to machine

– Lifetime goal• Portability• Generalized code

Page 3: Understanding Parallel Computers

A Look At Six Parallel Computers

• Chip Multiprocessors– Intel Core Duo– AMD Dual Core Opteron

• Heterogeneous Chip Designs– GPU, FPGA, Cell– Vector

• Clusters– Node – processors, RAM, disk, memory not shared– Typical - eight nodes, control processor, switch– Blade server – includes com ports and cooling fans

• Supercomputers – BlueGene/L (440 PowerPC’s)

Page 4: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 5: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 6: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 7: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 8: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Now we can put multiple cores on a single chip.

Page 9: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

MESI – Modified, Exclusive, Shared, Invalid

Page 10: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 11: Understanding Parallel Computers
Page 12: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

MOESI – Modified, Owned, Exclusive, Shared, Invalid

Page 13: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Both designs implement a coherent shared memory.

Page 14: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 15: Understanding Parallel Computers

Symmetric Multiprocessor (SMP)• Each processor makes memory requests over the common memory bus

• All cache controllers snoop the memory bus and adjust the tags on their cached values to ensure coherent cache usage.

Page 16: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Example – po & p1 have copies of Block X, but p2 writes to Block X.

Page 17: Understanding Parallel Computers
Page 18: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 19: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 20: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 21: Understanding Parallel Computers
Page 22: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 23: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 24: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 25: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 26: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 27: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 28: Understanding Parallel Computers
Page 29: Understanding Parallel Computers
Page 30: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 31: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 32: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 33: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 34: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 35: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 36: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 37: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 38: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 39: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 40: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 41: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 42: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 43: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 44: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 45: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 46: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 47: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder

Page 48: Understanding Parallel Computers

CSE524 Parallel Algorithms Lawrence Snyder


Related Documents