Workshop 'Big data' Machiel Jansen

Page 1 <img data-url='document/workshop-big-data-machiel-jansen.html?page=1' data-page='1' class='cut-thumb lazyload' alt='Page 1: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/1.jpg' width='140' height='200' /> Enabling Big Science

Machiel Jansen – SARA

machiel.jansen@sara.nl

Page 2 <img data-url='document/workshop-big-data-machiel-jansen.html?page=2' data-page='2' class='cut-thumb lazyload' alt='Page 2: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/2.jpg' width='140' height='200' /> Page 3 <img data-url='document/workshop-big-data-machiel-jansen.html?page=3' data-page='3' class='cut-thumb lazyload' alt='Page 3: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/3.jpg' width='140' height='200' /> Page 4 <img data-url='document/workshop-big-data-machiel-jansen.html?page=4' data-page='4' class='cut-thumb lazyload' alt='Page 4: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/4.jpg' width='140' height='200' /> Page 5 <img data-url='document/workshop-big-data-machiel-jansen.html?page=5' data-page='5' class='cut-thumb lazyload' alt='Page 5: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/5.jpg' width='140' height='200' /> Page 6 <img data-url='document/workshop-big-data-machiel-jansen.html?page=6' data-page='6' class='cut-thumb lazyload' alt='Page 6: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/6.jpg' width='140' height='200' /> Page 7 <img data-url='document/workshop-big-data-machiel-jansen.html?page=7' data-page='7' class='cut-thumb lazyload' alt='Page 7: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/7.jpg' width='140' height='200' /> Large Hadron Collider

Page 8 <img data-url='document/workshop-big-data-machiel-jansen.html?page=8' data-page='8' class='cut-thumb lazyload' alt='Page 8: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/8.jpg' width='140' height='200' /> Page 9 <img data-url='document/workshop-big-data-machiel-jansen.html?page=9' data-page='9' class='cut-thumb lazyload' alt='Page 9: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/9.jpg' width='140' height='200' /> Page 10 <img data-url='document/workshop-big-data-machiel-jansen.html?page=10' data-page='10' class='cut-thumb lazyload' alt='Page 10: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/10.jpg' width='140' height='200' /> The Life Science Grid

Page 11 <img data-url='document/workshop-big-data-machiel-jansen.html?page=11' data-page='11' class='cut-thumb lazyload' alt='Page 11: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/11.jpg' width='140' height='200' /> Slide from Jimmy Lin 2011

Page 12 <img data-url='document/workshop-big-data-machiel-jansen.html?page=12' data-page='12' class='cut-thumb lazyload' alt='Page 12: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/12.jpg' width='140' height='200' /> Page 13 <img data-url='document/workshop-big-data-machiel-jansen.html?page=13' data-page='13' class='cut-thumb lazyload' alt='Page 13: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/13.jpg' width='140' height='200' /> Page 14 <img data-url='document/workshop-big-data-machiel-jansen.html?page=14' data-page='14' class='cut-thumb lazyload' alt='Page 14: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/14.jpg' width='140' height='200' /> Page 15 <img data-url='document/workshop-big-data-machiel-jansen.html?page=15' data-page='15' class='cut-thumb lazyload' alt='Page 15: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/15.jpg' width='140' height='200' /> cheap commodity clusters + simple distributive programming models = data-intensive computing for the masses

Page 16 <img data-url='document/workshop-big-data-machiel-jansen.html?page=16' data-page='16' class='cut-thumb lazyload' alt='Page 16: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/16.jpg' width='140' height='200' /> Source: flickr (60in3/2338247189)

Chop problem into smaller parts Combine partial results

Page 17 <img data-url='document/workshop-big-data-machiel-jansen.html?page=17' data-page='17' class='cut-thumb lazyload' alt='Page 17: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/17.jpg' width='140' height='200' /> Page 18 <img data-url='document/workshop-big-data-machiel-jansen.html?page=18' data-page='18' class='cut-thumb lazyload' alt='Page 18: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/18.jpg' width='140' height='200' /> Page 19 <img data-url='document/workshop-big-data-machiel-jansen.html?page=19' data-page='19' class='cut-thumb lazyload' alt='Page 19: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/19.jpg' width='140' height='200' /> Slide from Jimmy Lin 2011

Page 20 <img data-url='document/workshop-big-data-machiel-jansen.html?page=20' data-page='20' class='cut-thumb lazyload' alt='Page 20: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/20.jpg' width='140' height='200' /> Page 21 <img data-url='document/workshop-big-data-machiel-jansen.html?page=21' data-page='21' class='cut-thumb lazyload' alt='Page 21: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/21.jpg' width='140' height='200' /> Page 22 <img data-url='document/workshop-big-data-machiel-jansen.html?page=22' data-page='22' class='cut-thumb lazyload' alt='Page 22: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/22.jpg' width='140' height='200' /> Page 23 <img data-url='document/workshop-big-data-machiel-jansen.html?page=23' data-page='23' class='cut-thumb lazyload' alt='Page 23: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/23.jpg' width='140' height='200' /> Page 24 <img data-url='document/workshop-big-data-machiel-jansen.html?page=24' data-page='24' class='cut-thumb lazyload' alt='Page 24: Workshop 'Big data' Machiel Jansen' loading='lazy' src='data:image/gif;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+P+/HgAFhAJ/wlseKgAAAABJRU5ErkJggg==' data-src='https://reader035.cupdf.com/reader035/viewer/2022062704/5561e4f6d8b42af10c8b4c83/html5/thumbnails/24.jpg' width='140' height='200' /> Questions ?

Workshop 'Big data' Machiel Jansen

Technology

jimmy lin

dataintensive computing

cheap commodity clusters

chop problem

flickr 60in32338247189

big sciencemachiel jansen

large hadron collider

life science grid