Top Banner
Images courtesy of Addison Wesley Longman, Inc. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Copyright © 2001 Chapter 9 Chapter 9 Memory Organization Memory Organization
58

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Dec 21, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Chapter 9Chapter 9Memory OrganizationMemory Organization

Page 2: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Chapter OutlineChapter Outline

• Hierarchical Memory SystemsHierarchical Memory Systems

• Cache MemoryCache Memory

• Virtual MemoryVirtual Memory

• Pentium/Windows Memory SystemPentium/Windows Memory System

Page 3: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Memory HierarchyMemory Hierarchy

Page 4: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Associative MemoryAssociative Memory

• Data RegisterData Register

Page 5: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Associative MemoryAssociative Memory

• Data RegisterData Register

• Mask RegisterMask Register

Page 6: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Associative MemoryAssociative Memory

• Data RegisterData Register

• Mask RegisterMask Register

• Match RegisterMatch Register

Page 7: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Associative MemoryAssociative Memory

Page 8: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Associative CacheAssociative Cache

Page 9: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Data Lines/BlocksData Lines/Blocks

• Multiple consecutive words form a lineMultiple consecutive words form a line

Page 10: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Data Lines/BlocksData Lines/Blocks

• Multiple consecutive words form a lineMultiple consecutive words form a line

• All data in a line is moved togetherAll data in a line is moved together

Page 11: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Data Lines/BlocksData Lines/Blocks

• Multiple consecutive words form a lineMultiple consecutive words form a line

• All data in a line is moved togetherAll data in a line is moved together

• Takes advantage of locality of referenceTakes advantage of locality of reference

Page 12: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Associative Cache with a Line Associative Cache with a Line Size of 4 BytesSize of 4 Bytes

Page 13: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Direct Mapped CacheDirect Mapped Cache

Page 14: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Direct Mapped Cache with a Direct Mapped Cache with a Line Size of 4 BytesLine Size of 4 Bytes

Page 15: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Drawbacks of Direct Mapped Drawbacks of Direct Mapped CacheCache

0000 0000 0000 0000: JUMP 1000H0000 0000 0000 0000: JUMP 1000H

0001 0000 0000 0000: JUMP 0000H0001 0000 0000 0000: JUMP 0000H

Page 16: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Set-Associative CacheSet-Associative Cache

Page 17: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Set-Associative Cache with a Set-Associative Cache with a Line Size of 4 BytesLine Size of 4 Bytes

Page 18: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Data Replacement PoliciesData Replacement Policies

• FIFOFIFO

Page 19: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Data Replacement PoliciesData Replacement Policies

• FIFOFIFO

• LRULRU

Page 20: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Data Replacement PoliciesData Replacement Policies

• FIFOFIFO

• LRULRU

• RandomRandom

Page 21: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

ExampleExample

Page 22: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

ExampleExample

Page 23: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

ExampleExample

Page 24: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

ExampleExample

Page 25: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Writing Data to CacheWriting Data to Cache

• Write backWrite back

• Write throughWrite through

• Write allocateWrite allocate

• Write no-allocateWrite no-allocate

Page 26: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache PerformanceCache Performance

• Hits and missesHits and misses

Page 27: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache PerformanceCache Performance

• Hits and missesHits and misses

• Hit ratioHit ratio

Page 28: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache PerformanceCache Performance

• Hits and missesHits and misses

• Hit ratioHit ratio

• Average memory access timeAverage memory access time

Page 29: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache Activity - Associative Cache Activity - Associative CacheCache

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 30: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache Activity - Associative Cache Activity - Associative CacheCache

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 31: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache Activity - Direct Cache Activity - Direct Mapped CacheMapped Cache

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 32: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache Activity - Direct Cache Activity - Direct Mapped CacheMapped Cache

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 33: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache Activity - 2-Way Set-Cache Activity - 2-Way Set-Associative CacheAssociative Cache

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 34: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Cache Activity - 2-Way Set-Cache Activity - 2-Way Set-Associative CacheAssociative Cache

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 35: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

2-Way Set-Associative Cache 2-Way Set-Associative Cache with a Line Size of 2with a Line Size of 2

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 36: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

2-Way Set-Associative Cache 2-Way Set-Associative Cache with a Line Size of 2with a Line Size of 2

0 0 2 0 1 0 4 5 0 2 1 0 3 2 7 6 0 0A B C A D B E F A C D B G C H I A B

Page 37: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Virtual MemoryVirtual Memory

• Memory Management Unit (MMU)Memory Management Unit (MMU)

Page 38: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Virtual MemoryVirtual Memory

• Memory Management Unit (MMU)Memory Management Unit (MMU)

• Swap disk/fileSwap disk/file

Page 39: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Virtual MemoryVirtual Memory

• Memory Management Unit (MMU)Memory Management Unit (MMU)

• Swap disk/fileSwap disk/file

• Logical addressLogical address

Page 40: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Virtual MemoryVirtual Memory

• Memory Management Unit (MMU)Memory Management Unit (MMU)

• Swap disk/fileSwap disk/file

• Logical addressLogical address

• Physical addressPhysical address

Page 41: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Paging - Pages and FramesPaging - Pages and Frames

Page 42: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

MMU ConfigurationMMU Configuration

Page 43: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Page TablePage Table

Page 44: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Address ConversionAddress Conversion

Page 45: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Translation Lookaside BufferTranslation Lookaside Buffer

Page 46: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

ExampleExample

Page 47: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

ExampleExample

Page 48: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

SegmentationSegmentation

Page 49: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

FragmentationFragmentation• Internal fragmentationInternal fragmentation

Page 50: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

FragmentationFragmentation• Internal fragmentationInternal fragmentation

• External fragmentationExternal fragmentation

Page 51: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

FragmentationFragmentation• Internal fragmentationInternal fragmentation

• External fragmentationExternal fragmentation

Page 52: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Beyond the BasicsBeyond the Basics

• Split cacheSplit cache

Page 53: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Beyond the BasicsBeyond the Basics

• Split cacheSplit cache

• Multilevel page tableMultilevel page table

Page 54: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Multilevel Page TableMultilevel Page Table

Page 55: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Pentium/Windows NT Memory Pentium/Windows NT Memory ManagementManagement

8 KB

8 KB

Page 56: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Pentium/Windows NT Cache Pentium/Windows NT Cache Memory ManagementMemory Management

• 16KB L1 split cache16KB L1 split cache– 2-way set-associative2-way set-associative– Line size of 32 bytesLine size of 32 bytes

• TLB used for cache and virtual memoryTLB used for cache and virtual memory

• Pseudo-LRU replacement policyPseudo-LRU replacement policy

• 256K L2 unified cache256K L2 unified cache– 4-way set-associative4-way set-associative

Page 57: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

Pentium/Windows NT Virtual Pentium/Windows NT Virtual Memory ManagementMemory Management

• 4 GB address space4 GB address space– Low-order 2 GB for individual processesLow-order 2 GB for individual processes– High-order 2 GB for Windows NT High-order 2 GB for Windows NT

componentscomponents

• Uses paging, not segmentationUses paging, not segmentation• 10-bit page directory pointer + 10-bit 10-bit page directory pointer + 10-bit

offsetoffset• Uses the same TLBs as cache memoryUses the same TLBs as cache memory

Page 58: Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization.

Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001

SummarySummary

• Hierarchical Memory SystemsHierarchical Memory Systems

• Cache MemoryCache Memory

• Virtual MemoryVirtual Memory

• Pentium/Windows Memory SystemPentium/Windows Memory System