Thursday, May 23, 2019

What is Big Data?

Its a platform managed under the Apache Software Foundation, and its an open source, and its deal with big information and give the result in very short time . It allows to work with structured and unstructured info arrays of dimension from 10 to 100 Gb and eventide more (V.Burunova)And its structer is a group of clusters or one , each of them contains groups of nodes too and each cluster has two type of node name node and data node name node is a unique node on cluster and it knows any(prenominal) data block location on cluster and info node is the remining node in cluster . and that have done by using a set of servers which called a cluster.Hadoop has two layers cooperate together , initiative layer is MapReduce and it task is divided data processing across triple servers and the second one is Hadoop Distributed File System (HDFS) and its task is storing data on multiple clusters and these data are separated as a set of blocks.Hadoop make sure the work is correct on cluster s and it can detect and retrieve any error or failure for one or more of connecting nodes and by this way Hadoop efforts increasing in core processing and storage size and postgraduate availability. Hadoop is usually used in a large cluster or a public cloud service such as Yahoo, Facebook, Twitter, and virago (Hadeer Mahmoud, 2018).Hadoops FeaturesScalableHadoop able to work with huge applications and it can run ,analyze, store, process, distribute large amount of data across thousands of nodes and servers which handle thousands terabytes of data or more, in like manner it can add additional nodes to clusters And these servers work parallel.Hadoop better than traditional relational database systems because (RDBMS) cant expand to deal with huge data..Single write Multiple read The data on cluster can be read from multiple source at the same time .Data avalibilitywhen data is sent to a Data node, that Hadoop creates multiple copies of data on other nodes in the cluster, to keep da ta available if there a failure on one of nodes on cluster.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.