Page 1
UCIrvineDEPARTMENT OFBIOMEDICAL ENGINEERING
The State of the ArtThe State of the ArtThe State of the ArtThe State of the Art
Joerg MeyerJoerg [email protected] @uci.edu
April 10, 2023April 10, 2023
Joerg MeyerJoerg [email protected] @uci.edu
April 10, 2023April 10, 2023
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
1500 ||||||||||||||||||||||||||||||||| 2003
Page 2
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Page 3
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Page 4
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
X-RayX-RayX-RayX-Ray
(Eberhart’s Manual of High Frequncy Currents, Ch. 10, 1911)(Eberhart’s Manual of High Frequncy Currents, Ch. 10, 1911)(Eberhart’s Manual of High Frequncy Currents, Ch. 10, 1911)(Eberhart’s Manual of High Frequncy Currents, Ch. 10, 1911)
(Gundelach Tube, 1898 – 1905)(Gundelach Tube, 1898 – 1905)
Oak Ridge Associated UniversitiesOak Ridge Associated Universities
Health PhysicsHealth PhysicsInstrumentation MuseumInstrumentation Museum
(Gundelach Tube, 1898 – 1905)(Gundelach Tube, 1898 – 1905)
Oak Ridge Associated UniversitiesOak Ridge Associated Universities
Health PhysicsHealth PhysicsInstrumentation MuseumInstrumentation Museum
Page 5
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Week 0 Week 4Week 0 Week 4Week 0 Week 4Week 0 Week 4
Page 6
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Scaphoid BoneScaphoid BoneScaphoid BoneScaphoid Bone
Week 0 Week 4Week 0 Week 4Week 0 Week 4Week 0 Week 4
Page 7
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Step 1: Incision MarkingStep 1: Incision MarkingStep 1: Incision MarkingStep 1: Incision Marking
Page 8
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Step 2: Exposure of Fracture LineStep 2: Exposure of Fracture LineStep 2: Exposure of Fracture LineStep 2: Exposure of Fracture Line
Page 9
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Step 3: Screw Insertion SiteStep 3: Screw Insertion SiteStep 3: Screw Insertion SiteStep 3: Screw Insertion Site
Page 10
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Step 4: X-RayStep 4: X-RayStep 4: X-RayStep 4: X-Ray
Before 2 months postopBefore 2 months postop Before 2 months postopBefore 2 months postop
(Images courtesy of: Electronic Textbook of Hand Surgery, http://www.eatonhand.com)(Images courtesy of: Electronic Textbook of Hand Surgery, http://www.eatonhand.com)(Images courtesy of: Electronic Textbook of Hand Surgery, http://www.eatonhand.com)(Images courtesy of: Electronic Textbook of Hand Surgery, http://www.eatonhand.com)
Page 11
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
High FrequencyHigh FrequencyX-Ray TubeX-Ray Tube
High FrequencyHigh FrequencyX-Ray TubeX-Ray Tube
(Eberhart’s Manual of High Frequncy Currents, Chap. 10, 1911)(Eberhart’s Manual of High Frequncy Currents, Chap. 10, 1911)(Eberhart’s Manual of High Frequncy Currents, Chap. 10, 1911)(Eberhart’s Manual of High Frequncy Currents, Chap. 10, 1911)
Portable SystemPortable SystemPortable SystemPortable System
Page 12
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Scaphoids Scaphoids (1mm)(1mm)
Scaphoids Scaphoids (1mm)(1mm)
MagneVu 1000MagneVu 1000(MRI)(MRI)
MagneVu 1000MagneVu 1000(MRI)(MRI)
Page 13
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Page 14
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
• Problems:Problems:– TimeTime– Cost factorCost factor
• Solution:Solution:– Correlate X-ray images with 3-D modelsCorrelate X-ray images with 3-D models– Database (typical bones)Database (typical bones)
• Problems:Problems:– TimeTime– Cost factorCost factor
• Solution:Solution:– Correlate X-ray images with 3-D modelsCorrelate X-ray images with 3-D models– Database (typical bones)Database (typical bones)
Page 15
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Various shapes and sizes (Zimmer, 1968)Various shapes and sizes (Zimmer, 1968)Various shapes and sizes (Zimmer, 1968)Various shapes and sizes (Zimmer, 1968)
Scaphoid BonesScaphoid BonesScaphoid BonesScaphoid Bones
Page 16
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
Classification (Herbert)Classification (Herbert)Classification (Herbert)Classification (Herbert)
Scaphoid Bone FracturesScaphoid Bone FracturesScaphoid Bone FracturesScaphoid Bone Fractures
Page 17
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
A - C: Scaphoid view 1 - with forearm pronated 45deg. to view profile of scaphoid & STT joint
D - Scaphoid view 2 (ulnar oblique view) showing radioscaphoid joint (from Rockwood & Green)
A - C: Scaphoid view 1 - with forearm pronated 45deg. to view profile of scaphoid & STT joint
D - Scaphoid view 2 (ulnar oblique view) showing radioscaphoid joint (from Rockwood & Green)
AA BB
CC DD
Page 18
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
• Solution:Solution:– SuperimposeSuperimpose
radiographicradiographic
scan andscan and
3-D model3-D model
– Select bestSelect best
model frommodel from
databasedatabase
• Solution:Solution:– SuperimposeSuperimpose
radiographicradiographic
scan andscan and
3-D model3-D model
– Select bestSelect best
model frommodel from
databasedatabase
Page 19
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Biomedical Image ProcessingBiomedical Image ProcessingBiomedical Image ProcessingBiomedical Image Processing
• General General Question:Question:
– How to combineHow to combine
differentdifferent
modalities?modalities?
• General General Question:Question:
– How to combineHow to combine
differentdifferent
modalities?modalities?
Page 20
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Visible Human (CT, frozen)Visible Human (CT, frozen)Visible Human (CT, frozen)Visible Human (CT, frozen)
Joseph Paul JerniganJoseph Paul JerniganJoseph Paul JerniganJoseph Paul Jernigan
Page 21
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Visible Human (CT, frozen)Visible Human (CT, frozen)Visible Human (CT, frozen)Visible Human (CT, frozen)
Slice 1125Slice 1125Slice 1125Slice 1125
Page 22
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Visible Human (MRI)Visible Human (MRI)Visible Human (MRI)Visible Human (MRI)
Slice 1125Slice 1125Slice 1125Slice 1125
Page 23
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Visible Human (RGB color)Visible Human (RGB color)Visible Human (RGB color)Visible Human (RGB color)
Slice 1125Slice 1125Slice 1125Slice 1125
Page 24
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Visible Human (RGB color)Visible Human (RGB color)Visible Human (RGB color)Visible Human (RGB color)
Page 25
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Visible Human Visible Human (3-D Reconstruction)(3-D Reconstruction)Visible Human Visible Human (3-D Reconstruction)(3-D Reconstruction)
Page 26
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 27
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 28
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 29
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 30
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 31
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 32
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 33
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 34
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 35
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 36
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 37
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 38
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
CT ScannerCT ScannerCT ScannerCT Scanner
Page 39
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 40
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 41
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 42
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 43
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 44
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Principle of a CT ScannerPrinciple of a CT ScannerPrinciple of a CT ScannerPrinciple of a CT Scanner
ObjectTranslation
Rotation
X-Ray Source
Detector
Object
X-Ray Source
Detector
a) Translation b) Rotation
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 45
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Principle of an MRI ScannerPrinciple of an MRI ScannerPrinciple of an MRI ScannerPrinciple of an MRI Scanner
a) Random Spin b) directional magnetic field
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 46
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
a) Directional Puls (orthogonal) b) Relaxation
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Principle of an MRI ScannerPrinciple of an MRI ScannerPrinciple of an MRI ScannerPrinciple of an MRI Scanner
Page 47
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 48
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Rhesus Monkey BrainRhesus Monkey BrainRhesus Monkey BrainRhesus Monkey Brain
• High-resolution large-scale image dataHigh-resolution large-scale image data
RGB image series (real-color, dyed), 5037 x 3871 x 1400, 76 GBRGB image series (real-color, dyed), 5037 x 3871 x 1400, 76 GB(data courtesy of Edward G. Jones, Center for Neuroscience, UC Davis)(data courtesy of Edward G. Jones, Center for Neuroscience, UC Davis)
• High-resolution large-scale image dataHigh-resolution large-scale image data
RGB image series (real-color, dyed), 5037 x 3871 x 1400, 76 GBRGB image series (real-color, dyed), 5037 x 3871 x 1400, 76 GB(data courtesy of Edward G. Jones, Center for Neuroscience, UC Davis)(data courtesy of Edward G. Jones, Center for Neuroscience, UC Davis)
• Resolution: 2666dpi Resolution: 2666dpi
Pixel spacing: 9 Pixel spacing: 9 mm
• Enables zoomingEnables zooming
down to the cell down to the cell
level.level.
• Total data size:Total data size:76 GB76 GB
Page 49
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 50
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
3-D Reconstruction3-D Reconstruction3-D Reconstruction3-D Reconstruction
Page 51
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Image AcquisitionImage AcquisitionImage AcquisitionImage Acquisition
Page 52
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
From 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-D
RGB image series (real-color, human brain), 1472 x 1152 x 753, 3.57 GBRGB image series (real-color, human brain), 1472 x 1152 x 753, 3.57 GB(data courtesy of Arthur W. Toga, Dept. of Neurology, UCLA School of Medicine)(data courtesy of Arthur W. Toga, Dept. of Neurology, UCLA School of Medicine)
RGB image series (real-color, human brain), 1472 x 1152 x 753, 3.57 GBRGB image series (real-color, human brain), 1472 x 1152 x 753, 3.57 GB(data courtesy of Arthur W. Toga, Dept. of Neurology, UCLA School of Medicine)(data courtesy of Arthur W. Toga, Dept. of Neurology, UCLA School of Medicine)
Page 53
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
3-D Reconstruction3-D Reconstruction3-D Reconstruction3-D Reconstruction
• 3-D Volume Rendering of a Human Brain3-D Volume Rendering of a Human Brain• 3-D Volume Rendering of a Human Brain3-D Volume Rendering of a Human Brain
RGB image series (real-color, human brain), 1472 x 1152 x 753, 3.57 GB(data courtesy of Arthur W. Toga, Dept. of Neurology, UCLA School of Medicine,
image courtesy of Eric B. Lum, Ikuko Takanashi, CIPIC, UC Davis)
RGB image series (real-color, human brain), 1472 x 1152 x 753, 3.57 GB(data courtesy of Arthur W. Toga, Dept. of Neurology, UCLA School of Medicine,
image courtesy of Eric B. Lum, Ikuko Takanashi, CIPIC, UC Davis)
Page 54
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
From 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-D
??
Page 55
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
From 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-D
Page 56
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
From 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-DFrom 2-D Cross-sections to 3-D
Page 57
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
3-D Reconstruction3-D Reconstruction3-D Reconstruction3-D Reconstruction
CT head (CT head (512 cross-sections, 1024 planes512 cross-sections, 1024 planes))rendered with different transparency transfer functions rendered with different transparency transfer functions
Page 58
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Human brainHuman brain((128 cross-sections,128 cross-sections,
220 planes220 planes))
Cancer cell Cancer cell ((256 cross-sections,256 cross-sections,
512 planes512 planes))
Ice BlockIce Block(Human brain)(Human brain)
((128 cryo-sections,128 cryo-sections,256 planes256 planes))
3-D Reconstruction3-D Reconstruction
Page 59
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
3-D Reconstruction3-D Reconstruction3-D Reconstruction3-D Reconstruction
MRI scan of a human skullMRI scan of a human skull
Page 60
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
3-D Reconstruction3-D Reconstruction3-D Reconstruction3-D Reconstruction
CT scan of a human skullCT scan of a human skull
Page 61
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
3-D Reconstruction3-D Reconstruction3-D Reconstruction3-D Reconstruction
CT scan of a human skullCT scan of a human skull
Page 62
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
How to scale down large-scale data?How to scale down large-scale data?How to scale down large-scale data?How to scale down large-scale data?
MM
120 CD-ROMs120 CD-ROMs 100k polygons100k polygons
Page 63
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Data arrangedData arranged
in slicesin slices• Data arrangedData arranged
in slicesin slices
Page 64
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Goal: extract subvolumeGoal: extract subvolume• Problem: data arranged in slices orProblem: data arranged in slices or
unstructured gridsunstructured grids• Necessity to touch a lot of files or dataNecessity to touch a lot of files or data• Solution: breaking up the data set into Solution: breaking up the data set into
bricksbricks• Data in bricks still too big for transmission/Data in bricks still too big for transmission/
interactive renderinginteractive rendering• Solution: multiresolution representationSolution: multiresolution representation idea: combination of octree/waveletidea: combination of octree/wavelet
• Goal: extract subvolumeGoal: extract subvolume• Problem: data arranged in slices orProblem: data arranged in slices or
unstructured gridsunstructured grids• Necessity to touch a lot of files or dataNecessity to touch a lot of files or data• Solution: breaking up the data set into Solution: breaking up the data set into
bricksbricks• Data in bricks still too big for transmission/Data in bricks still too big for transmission/
interactive renderinginteractive rendering• Solution: multiresolution representationSolution: multiresolution representation idea: combination of octree/waveletidea: combination of octree/wavelet
Page 65
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Data arrangedData arranged
in slicesin slices• Data arrangedData arranged
in slicesin slices
Page 66
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Data arrangedData arranged
in slicesin slices• Data arrangedData arranged
in slicesin slices
Page 67
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Breaking up theBreaking up the
data into bricksdata into bricks• Breaking up theBreaking up the
data into bricksdata into bricks
Page 68
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Breaking up theBreaking up the
data into bricksdata into bricks• Breaking up theBreaking up the
data into bricksdata into bricks
Page 69
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Breaking up theBreaking up the
data into bricksdata into bricks• Breaking up theBreaking up the
data into bricksdata into bricks
......
Page 70
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Breaking up theBreaking up the
data into bricksdata into bricks• Breaking up theBreaking up the
data into bricksdata into bricks
......
Page 71
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Breaking up theBreaking up the
data into bricksdata into bricks• Breaking up theBreaking up the
data into bricksdata into bricks
......
Page 72
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Space DecompositionSpace DecompositionSpace DecompositionSpace Decomposition• Breaking up theBreaking up the
data into bricksdata into bricks• Breaking up theBreaking up the
data into bricksdata into bricks
ROIROI......
Page 73
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Combination: Octree/WaveletCombination: Octree/WaveletCombination: Octree/WaveletCombination: Octree/Wavelet• Leaf encodingLeaf encoding• Leaf encodingLeaf encoding
Page 74
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Wavelet CompressionWavelet CompressionWavelet CompressionWavelet Compression
image pyramidimage pyramid
original (256 x 256)original (256 x 256) step 1step 1 step 2step 2
......
Page 75
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Wavelet CompressionWavelet CompressionWavelet CompressionWavelet Compression
MRI scanMRI scan
original (256 x 256)original (256 x 256) n = 8n = 8
n = 2n = 2n = 3n = 3n = 4n = 4n = 5n = 5
n = 7n = 7 n = 6n = 6
Page 76
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Wavelet CompressionWavelet CompressionWavelet CompressionWavelet Compression
Original image array
Original image array
Original VolumeOriginal Volume
L H L H
First run: x-directionFirst run: x-direction First run: x-directionFirst run: x-direction
HL HL LL LL
LH LH HL HL
HLLHLLLLLLLL
LHLLHL HLLHLL
LLH LLH
LHH LHH
HLHHLH
HHHHHH
Second run: y-directionSecond run: y-direction Third run: z-direction Third run: z-direction
Page 77
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
Progressive ReconstructionProgressive ReconstructionProgressive ReconstructionProgressive Reconstruction
Initial stage Second level of detailInitial stage Second level of detail
Third level of detail Final reconstructed imageThird level of detail Final reconstructed image
Page 78
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
• Cancer ResearchCancer Research
– Image processing (segmentation, classification)Image processing (segmentation, classification)
– Multi-modal imaging (CT/MRI/cryosection/confocal)Multi-modal imaging (CT/MRI/cryosection/confocal)
• NeuroscienceNeuroscience
– Rhesus Macaque Monkey Brain Atlas (NIMH)Rhesus Macaque Monkey Brain Atlas (NIMH)
– Scalable Visualization Toolkits for Bays to Brains (NPACI)Scalable Visualization Toolkits for Bays to Brains (NPACI)
• Cell PhysiologyCell Physiology
– Connectivity in Leech Giant Glial CellsConnectivity in Leech Giant Glial Cells
– Correspondence Analysis in Time-variant MicroscopicCorrespondence Analysis in Time-variant Microscopic3D Image Data3D Image Data
• Molecular DiagnosticsMolecular Diagnostics
– Genomics, Proteomics, Phylogenetic TreesGenomics, Proteomics, Phylogenetic Trees
• Cancer ResearchCancer Research
– Image processing (segmentation, classification)Image processing (segmentation, classification)
– Multi-modal imaging (CT/MRI/cryosection/confocal)Multi-modal imaging (CT/MRI/cryosection/confocal)
• NeuroscienceNeuroscience
– Rhesus Macaque Monkey Brain Atlas (NIMH)Rhesus Macaque Monkey Brain Atlas (NIMH)
– Scalable Visualization Toolkits for Bays to Brains (NPACI)Scalable Visualization Toolkits for Bays to Brains (NPACI)
• Cell PhysiologyCell Physiology
– Connectivity in Leech Giant Glial CellsConnectivity in Leech Giant Glial Cells
– Correspondence Analysis in Time-variant MicroscopicCorrespondence Analysis in Time-variant Microscopic3D Image Data3D Image Data
• Molecular DiagnosticsMolecular Diagnostics
– Genomics, Proteomics, Phylogenetic TreesGenomics, Proteomics, Phylogenetic Trees
Application AreasApplication AreasApplication AreasApplication Areas
Page 79
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
• Projection SystemsProjection Systems– Concave Reality Projection SystemConcave Reality Projection System– RealityCenterRealityCenter– Interactive White BoardsInteractive White Boards– Active/Passive Stereo ProjectorsActive/Passive Stereo Projectors
• Spatial Tracking HardwareSpatial Tracking Hardware– Nest-of-Birds (electro-magnetic)Nest-of-Birds (electro-magnetic)– VICON Motion Tracking SystemVICON Motion Tracking System
(vision)(vision)
• Interaction HardwareInteraction Hardware– PinchGloves (data gloves)PinchGloves (data gloves)– Stylus (6dof pointing device)Stylus (6dof pointing device)
• Projection SystemsProjection Systems– Concave Reality Projection SystemConcave Reality Projection System– RealityCenterRealityCenter– Interactive White BoardsInteractive White Boards– Active/Passive Stereo ProjectorsActive/Passive Stereo Projectors
• Spatial Tracking HardwareSpatial Tracking Hardware– Nest-of-Birds (electro-magnetic)Nest-of-Birds (electro-magnetic)– VICON Motion Tracking SystemVICON Motion Tracking System
(vision)(vision)
• Interaction HardwareInteraction Hardware– PinchGloves (data gloves)PinchGloves (data gloves)– Stylus (6dof pointing device)Stylus (6dof pointing device)
InfrastructureInfrastructureInfrastructureInfrastructure
Page 80
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
ConclusionsConclusionsConclusionsConclusions
• Engineering solutions can helpEngineering solutions can help
to make health care affordableto make health care affordable• Economic feasibilityEconomic feasibility• Data set size andData set size and
image quality increasesimage quality increases• Scalable solutionsScalable solutions
Page 81
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
AcknowledgementsAcknowledgementsAcknowledgementsAcknowledgements• Center for Neuroscience,UC DavisCenter for Neuroscience,UC Davis
• Engineering Research Center, Mississippi State UniversityEngineering Research Center, Mississippi State University
• Center for Image Processing and Integrated ComputingCenter for Image Processing and Integrated Computing
(CIPIC), UC Davis(CIPIC), UC Davis
• The Scripps Research Institute (TSRI), La Jolla, CAThe Scripps Research Institute (TSRI), La Jolla, CA
• San Diego Supercomputer CenterSan Diego Supercomputer Center
• These projects are funded in part by the National Institute These projects are funded in part by the National Institute
of Mental Health (NIMH) through the Center for of Mental Health (NIMH) through the Center for
Neuroscience at UC Davis, and the National Partnership Neuroscience at UC Davis, and the National Partnership
for Advanced Computational Infrastructure (NPACI)for Advanced Computational Infrastructure (NPACI)
(award #10195430 00120410).(award #10195430 00120410).
• Center for Neuroscience,UC DavisCenter for Neuroscience,UC Davis
• Engineering Research Center, Mississippi State UniversityEngineering Research Center, Mississippi State University
• Center for Image Processing and Integrated ComputingCenter for Image Processing and Integrated Computing
(CIPIC), UC Davis(CIPIC), UC Davis
• The Scripps Research Institute (TSRI), La Jolla, CAThe Scripps Research Institute (TSRI), La Jolla, CA
• San Diego Supercomputer CenterSan Diego Supercomputer Center
• These projects are funded in part by the National Institute These projects are funded in part by the National Institute
of Mental Health (NIMH) through the Center for of Mental Health (NIMH) through the Center for
Neuroscience at UC Davis, and the National Partnership Neuroscience at UC Davis, and the National Partnership
for Advanced Computational Infrastructure (NPACI)for Advanced Computational Infrastructure (NPACI)
(award #10195430 00120410).(award #10195430 00120410).
Page 82
UCIrvineBiomedical Image Processing – The State of the Art
Joerg Meyer - [email protected]
DEPARTMENT OF BIOMEDICAL ENGINEERING
That‘s all, folks!That‘s all, folks!That‘s all, folks!That‘s all, folks!
Joerg MeyerUniversity of California, IrvineBME/EECS Department644E Engineering TowerIrvine, CA 92697-2625
[email protected] ://www.eng.uci.edu/~jmeyer
Questions?