Big Data: A Review of Analytics Methods &
Techniques
YojnaArora
PhD scholar
Gyan Vihar School of Engineering & Technology
Suresh Gyan Vihar University, Rajasthan, India
yojanaI83@gmail.com
Abstract - In the current scenario, data is considered to be the
biggest assets. One who has maximum relevant data is
considered to be rich in the information industry. But only the
collection of data is not enough, it needs to be analyzed. This
huge amount of data which is termed ass Big Data cannot be
analyzed by traditional tools and techniques, rather it requires
more advanced
Techniques which can make data retrieval, management and
storage much faster are required. In this paper an introduction
to big data is explained along with a detailed comparative study
of various Big Data techniques which have already been
implemented. At the end various issues which still exist are
enlisted.
Keywords-Big Data, Analytic, Hadoop, Map Reduce
1. INTRODUCTION
A. Big Data Definitions
Big Data is defmed as amount of data just beyond
technology's capability to store manage and process
efficiently [1]
Big data that is too fast, too big or too hard for existing tools
to process [2]
Big Data is a term defining data that has three characteristics.
First is the great volume of data, second the data cannot be
structured into tables and third is velocity which means data
is generated rapidly and thus is need to be processed and
analyzed fast [3]
Big data concerns large volume, complex growing data sets
with multiple autonomous sources as stated by Xindong Wu
in [4]
In [5] Big data is defmed as large amount of data which
requires new technologies and architecture so that it becomes
possible to extract value from it by capturing and analyzing
process
Big Data is a massive volume of both structured and
unstructured data that is so large that it is difficult to process
using traditional database and software techniques [6]
Big Data concerns massive, heterogeneous, autonomous
sources with distributed and decentralized control [7]
Data sets that are growing exponentially and that are too
large, too raw or too unstructured for analysis using relational
database technique [8]
978-1-5090-5256-1116/$31.00 ©2016 IEEE
Dr Dinesh Goyal
Professor
Gyan Vihar School of Engineering & Technology
Suresh Gyan Vihar University, Rajasthan, India
dinesh8dg@gmail.com
Sources of big data include: transactions, scientific
experiments, genomic investigations, logs, events, emails,
social media, sensors, RFID scans, texts, geospatial data,
audio data, medical records, surveillance, images, and videos
[9]
+
BIG DATA ERA
The combination of growing torrent of data and on demand
computing has launched the Big Data era
It can be summarised as: Big Data is huge amount of data
coming from heterogeneous sources at a very high speed, that
it is not possible for the existing tools and techniques to
analyze and extract value from it. Thus, new technology is
required to analyze, manage and store this large amount of
Big Data
B. Characteristics ofBig Data
There are many defmitions of Big Data framed differently in
the past by various researchers, but all of them revolve
around the five characteristics of Big Data. These 5 V's of
Big Data are: [10]
1) Variety: The first characteristic of Big Data is
Variety, which addresses the various sources which are
generating this Big Data. They are classified into three
categories as :
a) Structured Data: Structured data concerns all data which
can be stored in table with rows and colunms. These data are
considered to be the most organised data but it accounts for
only 5-10% of the total data available.
b) Semi structured data: Semi-structured data is the
information that does not reside in tables but they posses
some properties which make them convertible into structured
data. These are the data coming from web server logs, XML
documents etc. Comparatively less organised than structured
data, they also make only 5-10% of data available.
225
 c) Unstructured data: Unstructured data constitutes the
biggest source of Big Data that is 80 - 90%. It includes data
in the fonn of text, images, video, voices, web pages, emails,
word documents and all other multimedia content. These data
are very difficult to store into database. These types of data
are both machine and human generated just like structured
and semi structured data.
d) Multi Structured Data: Data which is a mix of
Structured, semi structured and unstructured data. Example
operating system logs
2) Volume: Volume is the characteristic which
makes Data as Big Data It denotes to the large amount of data
which is generating in every second. The range of data has
highly increased, crossing the range of terabytes to Peta, Exa
and now till Zeta bytes. Big data can be measured in the
tenns of:
• Records per Area
• Transactions
• Table
4) Value: It is necessary to fetch meaningful
infonnation or patterns from this huge amount of Big Data
which can be used for analysis or detennining results on
application of queries. Thus, Value is the characteristic which
denotes fetching meaning from Big Data. The value can be
extracted from Big Data as:
• Statistical
• Events
• Correlation
• Hypothetical
5) Veracity: The fifth V of Big data ensures the
correctness and accuracy of infonnation. When dealing with
Big Data, along with maintaining its privacy and security, it
is also important to take care of Data quality, data governance
and metadata management. Factors which should be
considered are :
• Trustworthiness
• Authenticity
• Accountability
• Availability

3) Velocity: Data is coming from multiple sources C. Applications ofBig data

in huge amounts, as explained earlier. Also, Velocity is one
of the characteristics of Big Data which talks about the high The large number of big data applications as explained in
data rate at which it is being generated. Various applications [4] [II]
based on data rate are: [7]
• Healthcare
a) Batch: Batch means running the query in a • Public sector administration
scheduled and sequential way without any • Retail
intervention. Execution is on a batch of input • Manufacturing
b) Real Time: Real time data is defined as the • Personal location data
infonnation which is delivered immediately • Fact based decision making
after its collection. There is no delay in the • Improved customer experience
timeliness of infonnation provided. • Improved sales
c) Interactive means executing the tasks which • New product innovation
require frequent user interaction.
d) Streaming: The method of processing the data
as it comes in is called streaming. The insight
into the data is required as it arrives.

Fig 1. 5 v's of Big Data

226 2016 2nd 1nternational Conference on Contemporary Computing and 1nformatics (ic3i)
II. LITERATURE REVIEW OF EXISTING WORK
Tablel. Comparison of various Big Data Analytics techniques
Author's Name
Venkateswara Reddy Eluri,
Amima Salim & Mohd AL-
Jabri rI2l
R.A Fadnavis and Samrudhi
Tabhane [13]
Fatos Xhafa, Victor Naranjo
and Sanfi Caballe [14]
Poonam Vashisht and Vishal
Gupta( [15]
Kyounghyun Park, Minh Chau
Nguyen and Heesun Won [16]
Sruthika and N Tajunisha [17]
Bichitra MandaI, Ramesh
Kumar SahOG and Srinivas
Sethi rI8l
Parth Chandarana and M
Vijayalakshini( [19]
Dawei Jiang et. al [20]
Zoltan Prekopcsak et. a1. [21]
Alexander Alexendrov, Rico
Bergmann and Stephem even
r22f
Xindong Wu, Xingquan ZllU,
Gong Qing Wu and Wei Ding
[23]
Bama Saba and Divesh
Srivastava [24]
Jinsong Zhang, Yan Chen and
Taoyiog Li [25]
Seref Sagiroglu and Duygu
Sioang [26]
Janusz Weilki [27]
Du Zhang [28]
Katharina Ebner, Thilo Buhnen
and Nils Umach [29]
YouseefM Essa [30]
2016 2nd 1nternational Conference on Contemporary Computing and 1nformatics (ic3i)
Aim Technique Applied! Key Features Findings/Result
Explained
To integrate Big Data K means clustering & Mahout API works on K means clustering is better for
and Data Miniog Canopy Clusteriog top of Map Reduce globular data
To explain Hadoop Architecture Hadoop provides fault Hadoop provides a complete
programming & Ecosystem tolerance and distributed infrastructure to handle Big Data
paradigm ofHadoop processing feature
and Map Reduce
To implement Yahoo Map Reduce Software chain Able to do Real time analytics for
S4 software framework architecture system monitoring and decision
making
To explain Big Data Community detection, Video analytics Analytics on Audio and Video
Analytics Methods Social Influence architecture was done
analysis & liok
prediction
To explain Big Data Hadoop Web server portal & Big data analytics platform
analytics platfonn YARN Analytics Portal generated to support Big Data
Management tools
To explain meaning of Descriptive, Hadoop architecture Various analytics technique
Analytics & Big Data Predictive & traditional and new are explained
Analvtics Prescriptive analvtics
To explain all the Hadoop Architecture Programming Paradigm: Application ofHadoop io terms of
details about Big Data Map Reduce work processing is explained
To explain Batch Oriented, Various types of data The framework helps in Social
characteristic & OLTP, E commerce sources are identified media and interactive adhoc query
features ofBig Data & Stream Processing processing
Framework
To tackle with Big New framework ePic Concurrent Programs are parallelized and run
Data's Data Variety (extensible system) Programming model for time system takes care of fault
problem parallel computations tolerance
To implement a new Hadoop and Rapid Programming Model of Radoop is an excellent tool for
framework Radoop Miner tool Hadoop & User Interface Big Data Analytics
of Rapid Mioer
To ensure parallel data Data warehousing, Stratosphere framework Easy programmiog of analytical
analysis infOlmation extraction applications
and integration
To implement a model Infonnation --7 HACE theorem Data Driven revolution model
which will Mining---7 implemented
characterize features User Interest
of Big Data Modelling---7
Revolution Security & Privacy
To identify various Statistical & Logical Data quality issues and Rules were discovered in semi
issues related to Big methods of Data challenges were structured data based on value and
Data Quality Quality Monitoriog discussed in detail structure
To explain major InfOlmation Data Capture, Storage,
challenges & Integration, Data Management and Analytics are
Irmovation scope in visualization, identified as Big Data Challenges
Big Data Technical Irmovation, --------
Product Irmovation
etc
To get an overview Big data's content, Various advantages and Future scope: llinplementation of
about Big data methods & tools challenges enlisted better tools & methods for
explaioed analyzing data
To explaio the Hadoop & Map \Big Data's notion, tools,
growing role of data & Reduce ------- challenges & future scope
infOlmation discussed
To explain about Data Mioing methods Spatial, Tempoml, Text Data quality of Big data is
multidimensional are explained to & Functional increased by removing
issues and challenges remove inconsistencies inconsistencies
in Big Data & Big inconsistencies to
Data Analysis increase the data
qualitv
To explain the Eight contiogency Understandiog of The analysis of organizational
methods of handling factors identified Decision making decision makers need to start
Big Data by the grouped ioto three methods thirikiog about whether and how
corporate industry categories as Strategy, to facilitate Big Data analytics
Resource & Operating
environment
To implement new Mobile Agent & Map Hadoop provides MRAM improves Big Data
framework MRAM Reduce paradigm distributed parallel Analysis & overcome drawbacks
under JADE processing & Mobile of Hadoop
227

Sung HwanKim, Nam UK
Kim and Tai Myoung Chung
[31]
Zibin Zheng, Jiernrning Zhu
and Michael R Lyu [32]
Avita Katal, Mohammad
Wazid and R H Goudar [33]
Marcus R. Wigan and Roger
Clarke [34]
Agent provides mobility
To extract relevant Attribute selection Maintain & protect The relevance between attributes
information from Big method in Data important attributes of data sets is really important
Data Mining
To study Big data Service - generated Quality metric & The quality of service oriented
analytics Big Data and Big security considered systems is enhanced
Data as service
To explain importance Hadoop Good practices followed Defmitions, Tools, issues &
of Big Data in modem for Big Data challenges related to Big Data are
world discussed
To explain various Consumer Profile Various applications of Big Data
applications of Big Database, Loyality are explained
Data Cards, Social Media, --------

Yuri Demchenko, Paolo
Grosso andCees de Laat [35]
Dan Garlasu and Oana
Grigoriu [36]
Stephen Kaisler, Frank
Arrrnour, J. Alberto( [37]
To study about the Scientific Data Life Relationship of SDLM SDLM is implemented which
impact of Big data on cycle Management with modem e Science helps in data management
modem and future Model
Scientific Data
Infrastructure
To implement Big Grid Computing: A Grid Centre High storage capability & High
Data Analytics kind of distributed Computing element processing power is achieved y
computing Storage Element using Grid computing system
Worker Node
To explain various Storage, Management Big Data analytics Various issues, challenges and
issues in Big Data & Processing framework and design factors that may lead to future data
methodology analyse are identified

III Big Data Analytics Approach [34]

Big Data is important because it helps to Gather tore and
manipulate vast amount of data at a right speed at right time.
Big Data Analytics id\s an approach to identify hidden
patterns and uncover information from huge amount of Big
Data so that it may help to take better decisions. The two
analytics approaches are:
1) Reactive-In Reactive approach knowledge is gained from
the past which may have some usefulness or purpose in the
future. The use of Business intelligence in this approach ends
up in generating
standard business reports, ad hoc reports, OLAP, alerts and
notifications.
2) Proactive-Proactive approach means looking forward i.e.
proactive big data analytics is required for proactive decision
making such as optimisation, text mining, modelling. This
reveals the patterns and trends implemented for future decision
making. This can be used for extracting important information
from terabytes of data and using it for future decision making.
Proactive big data analytics is not easy, its impact is more of a
culture change and not just decision making. This can even
help the decision makers to have more insight and knowledge
about the problem and analytics to be applied on it

Collection

Big Analytics

Fast Data

Fig 2 Big Data Stack

228 2016 2nd International Conference on Contemporary Computing and Informatics (ic3i)
 A. Value afBig Data
Then
1. Data is in structured form
2. It is supported by Relational Database
3. Predictive models were build
4. Data Mining methods & techniques applied
i.e Clustering, Classification
5. It can store larger data sets in data warehouse
III. ISSUES IDENTIFIED IN BIG DATA PROCESSING
Issue 1: Working on data sampling methods which can help
in reducing the volume of data for analysis
Issue 2: Working on the parameter scaling, which means
with the changing increase in size of data set, the algorithms
are not able to adapt accordingly. Data Mining and Machine
Learning algorithms are the sample which cannot scale up to
zeta byte.
Issue 3: Not all the problems are map reducible, so
identifying the big data problems which are map reducible
Issue 4: To improve statistical and machine learning
algorithms to be more robust
Issue 5: Various technical issues which arise while
processing Big Data are Fault tolerance, Heterogeneity,
Quality and scalability
Issue 6 : When classified in a broad way, Security, Data
Management and Sharing of big data as explained in [7] are
the three major issues.
Issue 7: Issues related to change of Technology and lack of
appropriate people with analytical skills also needs
consideration.
Issue 8 Maintaining the Quality of data extracted for decision
making is important. Some of the issues related to data
quality are mentioned in [38]. Also, [7] explains various
inconsistencies found in data and its repair techniques.
Issue 9: Difficulties associated with analysis of ever
increasing uustructured data are still pertaining.
Issue 10: Data protection and Access control explained in
[31] are the security issues
Issue 11: Cost is also a major concern in dealing with Big
data
IV. CONCLUSION
Big Data has become the greatest assets in the current
scenario. Handling it is a difficult task. This paper explains
the definition and characteristics of Big Data along with Big
Data stack. It also includes a detailed comparative study
2016 2nd 1nternational Conference on Contemporary Computing and 1nformatics (ic3i)
Now
Data is raw, complex & Unstructured form
It is supported by Click streams
Analyze all data and run models on it
Big Data methods and techniques applied
i.e Hadoop, Map Reduce
t can store larger set on a cluster of computers
about various Big Data analytics techniques. The paper ends
by mentioning a few important issues which can be
considered as future aspects for further research.
REFERENCES
[I] Stephen Kaisler, Frank Amnour, J. Alberto," Big Data: Issues
and Challenges Moving Forward",46th Hawaii International
Conference on System Science, IEEE,2012
[2] Sam Padden, "From database to Big Data,", in IEEE Computer
Society, 2012
[3]Dan Garlasu, "Data Implementation Based on Grid Computing",
[4] Avita Katal, Mohammad Wazid and R H Goudar, "Big Data:
Issues, Challenges, Tools and good Practices", in IEEE 2013
[5] Seref Sagiroglu and Duygu Sinang, "Big Data A
Review",IEEE,2013
[6] Yuri Demchenko, Paolo Grosso andCees de Laat, "Addressing
Big Data Issues in Scientific Data Infrastructure", in IEEE 2013
[7] Parth Chandarana and M Vijayalakshrni, "Big Data Analytics
Framework", in International Conference on Circuits, System,
Communication and Information Technology Applications",IEEE,
2014
[8] Rich Adduci, Dave Blue and Guy Chiarello, "Big Data: Big
Opportunities to create Business value", in EMC2
[9] M. Schroeck, R. Shockley, J. Smart, D. Romero-Morales, and P.
Tufano, Analytics: the real-world use of big data: how innovative
enterprises extract value from uncertain data, Executive Report,
IBM Institute for Business Value and Said Business School at the
University of Oxford, 2012.
[10] Parth Chandarana and M Vijayalakshrni, "Big Data Analytics
Framework", in International Conference on Circuits, System,
Communication and Information Technology Applications" ,IEEE,
2014
[ll]Janusz Weilki, "Implementation of Big Data Concept in
organizations- possibilities, impediments and challenges",
proceeding of 2013 Federated conference on computer science and
information systems, pp985-989, IEEE, 2013
[12] Dr Venkateswara Reddy & MS. Arnina Salim, "A comparative
study of various clustering techniques on Big Data Sets using
Apache Mahout", in 3,d MEC International Conference on Big Data
Smart City, IEEE, 2016
229
 [13] Prof R A Fadnavis & Sannudhi Tabhane, "Big Data
Processing using Hadoop", in IJCSIT, Vol I, 2015
[14] Fatos Xhafa, Victor Naranjo and Sanfi Caballe, "A software
Chain approach to Big Data Stream Processing and Analytics", in
International Conference on Complex Intelligent and Software
Intensive systems, IEEE 2015
[30] Youseef MEssa, "Mobile Agent Based New Framework for
improving Big Data Analysis", in International Conference on
Cloud Computing and Big Data, IEEE, 2013
[31] Sung Hwan Kim, Nam UK Kim and Tai Myoung Chung,
"Attribute Relationship Evaluation Methodology for Big Data
Security", in IEEE, 2013

[15] Poonam Vashisht and Vishal Gupta, " Big Data Analytics [32] Zibin Zheng, Jiennning Zhu and Michael R Lyu, "Service
Techniques: A survey", in IEEE 2015. generated big data and big data as a service : An Overview", in
IEEE International Congress on Big Data, 2013

[16] Kyounghyun Park, Minh Chau Nguyen and Heesun Won,
"Web based Collaborative Big Data Analytics on Big Data as a
service platform", in ICACT, July 2015
[17] Sruthika and Dr. N. Tajunisha, "A study on evolution of Data
Analytics to Big Data Analytics & its research scope", in 2nd
International Conference on Innovations in Information Embedded
and communication system, IEEE, 2015
[33] Avita Katal, Mohammad Wazid and R H Goudar, "Big Data:
Issues, Challenges, Tools and good Practices", in IEEE 2013
[34] Marcus R. Wigan and Roger Clarke. "Big Data's big
unintended consequences", in IEEE Computer Society, 2013
[35] Yuri Demchenko, Paolo Grosso andCees de Laat, "Addressing
Big Data Issues in Scientific Data Infrastructure", in IEEE 2013

[18] Bichitra Mandai, Ramesh Kumar Sahoo and Srinivas Sethi, [36] Dan Garlasu, "Data Implementation Based on Grid
"Architecture of efficient word processing using Hadoop for Big Computing"
Data Applications", in International Conference on Man and
Machine Interfaccing",IEEE 2015 [37] Stephen Kaisler, Frank Arrmour, J. Alberto," Big Data: Issues
and Challenges Moving Forward",46 th Hawaii International
[19] Parth Chandarana and M Vijayalakslnni, "Big Data Analytics Conference on System Science, IEEE,20 12
Framework", in International Conference on Circuits, System,
Communication and Information Technology Applications",IEEE, [38] Barna Saba and Divesh Srivastava, "Data Quality : The other
2014 face of Big Data", in IEEE, 2014

[20] Dawei Jiang, Gang Chen, Beng Chin ooi and Sai Wu", "epiC:
An extensible and scalable system for processing Big Data",
Proceeding ofVLDB Endowment, Vol 7, No.

[21] Zoltan Prekopcsak, Garbar Makrai and Tamas Henk, "Radoop :

Analyzing Big Data with Rapid miner and Hadoop"

[22] Alexander Alexendrov, Rico Bergmann and Stephem even,"

The stratosphere platform for Big Data Analytics", Springer, 2014

[23] Xindong Wu, Xingquan Zhu, Gong Qing Wu and Wei Ding,
"Data Mining with Big Data", in IEEE transactions in knowledge
and data engineering, Vol 26, Number I, January 2014

[24] Barna Saha and Divesh Srivastava, "Data Quality: The other
face of Big Data", in IEEE, 2014

[25] Jinsong Zhang, Yan Chen and Taoying Li, "Opportunities of

Innovation under challenges of Big Data", in 10th International
Conference on Fuzzy Systems and Knowledge Discovery (FSKD),
IEEE, 2013///

[26] Seref Sagiroglu and Duygu Sinang, "Big Data : A

Review",IEEE,2013

[27] Janusz Weilki, "Implementation of Big Data Concept in

organizations- possibilities, impediments and challenges",
proceeding of 2013 Federated conference on computer science and
information systems, pp985-989, IEEE, 2013

[28] Du Zhang, " Inconsistencies in Big Data", in Proceeding of

IEEE international conference on Cognitive Informatics and
Cognitive Computing" IEEE, 2013

[29] Katharina Ebner, Thilo Buhnen and Nils Urbach, "Think Big
with Big Data: IdentifYing Suitable Big Data Strategies in Corporate
Environment", 47th Hawaii International Conference on System
Science", IEEE, 2014

230 2016 2nd 1nternational Conference on Contemporary Computing and 1nformatics (ic3i)