Top Banner
TESTING BIG DATA Adoniram Mishra Benazeer Khan
21

Big data testing (1)

Jan 12, 2017

Download

Technology

vodqancr
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Big data testing (1)

TESTING BIG DATA

Adoniram MishraBenazeer Khan

Page 2: Big data testing (1)

Agenda

❖ What is Big Data?❖ Hadoop Ecosystem❖ Testing Challenges❖ Test Pyramid

Page 3: Big data testing (1)

What is Big Data?

Page 4: Big data testing (1)
Page 5: Big data testing (1)

What is Hadoop

Page 6: Big data testing (1)

Hadoop Ecosystem

Page 7: Big data testing (1)

HDFS

Page 8: Big data testing (1)

MapReduce

Page 9: Big data testing (1)

High Level Example

Data Source

HBase HiveData Source

Data Source

IMPORT HQL

UI

Reports

Other applications

MR

MR

MR

Page 10: Big data testing (1)

Testing Challenges

Page 11: Big data testing (1)

Long Feedback Cycle

Page 12: Big data testing (1)

Data

Page 13: Big data testing (1)

Deadlines

Page 14: Big data testing (1)

Automation

Page 15: Big data testing (1)

Countering Challenges

❖ Sampling.

❖ Basic testing concepts - Boundary Value testing, Equivalence class partitioning.

❖ Automation

Page 16: Big data testing (1)

Nightly Build Tests

Hive Query Validator

Unit Tests

UI Test

Test Pyramid

Page 17: Big data testing (1)

Hive Query Validator

Hive Query Validator

Query 1

Query 2

Query 3

Correct

Correct

Incorrect

Page 18: Big data testing (1)

Nightly tests & Smoke Tests

SMOKE

MODULE 3MODULE 1

MODULE 2MODULE 4

Page 19: Big data testing (1)
Page 20: Big data testing (1)

About Us

● Adoniram Mishra ([email protected])● Benazeer Khan ([email protected])

Follow us at:Facebook: https://www.facebook.com/groups/vodqa/Twitter: https://twitter.com/vodqancr

Page 21: Big data testing (1)