Analysis of Economic Data Using Bigdata Presented By SHIVUMANJESH P [4JC13MCA51] VI SEM MCA SJCE Internal Guide C J HARSHITHA Assistant Professor Dept. Of MCA SJCE External Guide Imran basha Senior Consultant JSS MAHAVIDYAPEETHA SRI JAYACHAMARAJENDRA COLLEGE OF ENGINEERING MYSURU-570006 AN AUTONOMOUS INSTITUTE AFFILIATED TO VISVESVARAYA TECHNOLOGICAL UNIVERSITY, BELGAVI. Presentation on
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Analysis of Economic Data Using Bigdata
Presented BySHIVUMANJESH P
[4JC13MCA51] VI SEM MCA
SJCE
Internal Guide C J HARSHITHA Assistant Professor
Dept. Of MCA SJCE
External Guide Imran basha Senior Consultant
Snipe IT Solutions
JSS MAHAVIDYAPEETHA SRI JAYACHAMARAJENDRA COLLEGE OF ENGINEERING MYSURU-570006
AN AUTONOMOUS INSTITUTE AFFILIATED TOVISVESVARAYA TECHNOLOGICAL UNIVERSITY, BELGAVI.
Presentation on
Problem Definition1. Inflation is rising as a serious threat for countries
development.
2. Unscientific farming
3. Big-picture problem, economic indicators and decision makers rely on the native economic transactions and on the data records.
Objective
To examine economic data and recording the increasing and decreasing vegetables and food items prices year to year.
Preferring the fresh and edible food products and to overcome various problems of deficiency and malnutrition.
To maintain the continuous connectivity between Demand-Supply Chain
•
Scope of The Project• The Economic data analysis make an immense impact on E-
commerce and also builds a potential to the business activities and also in the investments
• The analysis is limited to the particular products and can be future extended based on the requirements and developments.
• The big data analysis can be presented using the android application by providing simple and smart user interfaces about products they use in the daily life
• It requires high end specification of the system on which it is implementing, dealing with large data set with diversified features and functionalities.
User characteristics
• The system will provide a very precise and simple platform to the respective users.
• The admin will provide the access to the developer as well as to the user and provides data sets.
• The developer collects the data sets clusters the data based on the particular criteria and analyze the behavior of the data elements.
• The user gets the desired result by firing a query.
General constraints• The big data usage is efficient for large data sets and it is
not suitable for data with less volume.
• Since the main objective is based on data analysis user interface section is given least priority.
• Sometimes it may find tedious to deal with complete unstructured data items.
• The data which is obtained from the various source may not be of same parameters
Functional Requirements Storage • Hadoop Distributed File System is designed for storing very large
files with streaming data access patterns, running on clusters of commodity hardware.
• The economic data is a highly diversified data set which is both large and variety in nature.
• A dataset is typically generated or copied from source, and then various analyses are performed on that dataset over time.
• Applications that require low-latency access to data, in the tens of milliseconds range, will not work well with HDFS.
Computation• MapReduce is a processing technique that allows for
massive scalability across hundreds or thousands of servers in a Hadoop cluster.
• The MapReduce algorithm contains two important tasks, namely Map and Reduce.
• This algorithm in economic data analysis helps in finding the demand for the particular goods based on certain key words.
• The shuffle and sort process is dependent mainly on volume of the data sets.
Performance Requirements• The major aim for choosing the domain of big data for
economic analysis is for the velocity criteria of data processing.
• Connecting of the commodity systems and forming the node between them helps in quick retrieval of the data items.
• There is a vast development of flexibility in distributed system environment.
• Hardware Requirements
Processor : Core i3 onwards RAM : 4GB + Hard disk space : 40GB +