QAware GmbH +49 (0) 89 23 23 15 – 0 [email protected] qaware.de qaware.de/news/big-data-landscape For more big data know-how see: Ingestion Data Sources Data Lake Processing Data Warehouse Analytics User Interface Dashboards Distributed Filesystem NoSQL DB Efficient data serialization formats: Integated compression Column-oriented storage Predicate pushdown Data Workflows ETL Jobs Massive Parallelization Data Logistics Stream Processing Charting Libraries pandas linkedin / databus Thrift Index Machines: Fast aggregation and search. In-Memory Databases: Fast access. Apache Arrow Graph Databases Big Data Landscape 2016 GraphX NewSQL: SQL meets NoSQL. Kylin Time Series Databases Interactive Analysis Impala SQL TensorFlow Pig Streaming dc.js DataTables InfoVis Highcharts NVD3 D3 Flot Rickshaw RazorFlow Droptiles ChartJS Reporting & Dashboards Heroic Atlas Prometheus STRUCTURED DATA LAKE: The eternal memory. POLYGLOTT PERSISTENCE & ANALYTICS ANALYTICS FRONTENDS ALGORITHMS MICRO ANALYTICS SERVICES: Subsitutes for reporting servers. Data Science