Top Banner
Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent Beings', Zeitschrift für Physik 53, 840 ¯ 856. Feynman, Feynman Lectures on Physics, Ratchet and Pawl, Volume 1, Chapter 46. Landauer, R. (1961) `Irreversibility and Heat Generation in the Computing Process', Advances in Chemical Physics 5, 183 ¯ 191.
45

Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Dec 16, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Physics of Information

Yovav KalifonWeizmann Inst. 18 Nov 2008

Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent Beings', Zeitschrift für Physik 53, 840¯856.

Feynman, Feynman Lectures on Physics, Ratchet and Pawl, Volume 1, Chapter 46.

Landauer, R. (1961) `Irreversibility and Heat Generation in the Computing Process', Advances in Chemical Physics 5, 183¯191.

Page 2: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Physics of Information

•Making a measurement

Page 3: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Physics of Information

•What is information?

Page 4: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Physics of Information

•Information processing

Page 5: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

• Exorcise Maxwell’s (mechanical) demon

• Consider intelligent beings as demons

• “Universal law” of measurements

Page 6: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Second Law of Thermodynamics

Page 7: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Second Law of Thermodynamics

Page 8: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Maxwell:

“The 2nd law is only statistically valid.

“Could statistical fluctuations be exploited to run a perpetual motion machine?”

Page 9: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Maxwell’s DemonExploiting fluctuations

Page 10: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Ratchet and pawl

Page 11: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Getting hit means Getting heat!

Page 12: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Forward Step

Stretchε

LiftLθ

FluctuationLθ+ε

Page 13: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Forward Step Rate

Stretchε

LiftLθ

FluctuationLθ+ε

Page 14: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Backward Step

Fluctuationε

DropLθ

ReleaseLθ+ε

Page 15: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Backward Step Rate

Fluctuationε

DropLθ

ReleaseLθ+ε

Page 16: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Reversible process

Page 17: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

The engine keeps 2nd law

Page 18: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Trap door demon

Mechanical demons fluctuate

Page 19: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Ranque-Hilsch vortex tube (1933)

Page 20: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard:

“Under what circumstances could we construct a perpetual motion machine, utilizing intelligent beings?”

Page 21: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.
Page 22: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Concerns of intelligent demons

Page 23: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Concerns of intelligent demons

Making measurements

Processing information

Erasing information

Page 24: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s first machine

Intelligent being couples parameters

Page 25: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s first machine

Work done at the expense of heat

Page 26: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

• Ideal gas:

• Heat reservoir:

Page 27: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

• The frequency of each outcome:

• Overall we get:

Page 28: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.
Page 29: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

• Ansatz:

• Overall we get:

Page 30: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s second machine

Page 31: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s second machine

Page 32: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

• If parameter (x) thermalizes reversibly:

• Ansatz:

Page 33: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

• Overall we get:

• Szilard’s Universal Law:

Page 34: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

The entropy of erasure

Landauer (1961) and Bennet (1982): • A measurement is essentially copying• Computation can be made reversible• Erasing memory means compressing the

phase space of possible physical states, inevitably heating up the environment

Page 35: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s third machine

Page 36: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s third machine

Page 37: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s third machine

Page 38: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s third machine

Page 39: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Szilard’s third machine

Page 40: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

Page 41: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

ENTROPY BILL

Page 42: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Summary• Simple demons fail due to Brownian motion

• Intelligent demons are a part of the system

• Demons make up for the missing entropy

• No perpetual motion machine is known

Page 43: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Summary

• Szilard assumes the 2nd law

• A “universal law” of measurements

Page 44: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

Summary

• Szilard’s own work supports the claim that erasing memory is the only stage which necessarily raises the entropy of the system

• Inanimate automatic machines can measure parameters, store the information, process it, even print the result.

Page 45: Physics of Information Yovav Kalifon Weizmann Inst. 18 Nov 2008 Szilard, L. (1929) `On the Decrease of Entropy in a Thermodynamic System by the Intervention.

So what is intelligence?