MapReduce | Learn for Master

  • Good articles to learn map reduce

    December 21, 2016 Author: david
    No comment yet

    Basics of Map Reduce Algorithm Explained with a Simple Example

    From: http://www.thegeekstuff.com/2014/05/map-reduce-algorithm/

     

     

    While processing large set of data, we should definitely address scalability and efficiency in the application code that is processing the large amount of data.

    Map reduce algorithm (or flow) is highly effective in handling big data.

    Let us take a simple example and use map reduce to solve a problem.

    Say you are processing a large amount of data and trying to find out what percentage of your user base where talking about games.

    First,

    [Read More...]

  • What is MapReduce and how it works

    June 22, 2016 Author: david
    1 Comment
    MapReduce for word count

    We usually develop programs based on open sourced MapReduce frameworks such as Hadoop, Apache Pig, Apache Hive, and Spark to solve Big Data problems. In this post, I will use an example to describe what MapReduce is and how it works. I hope this will help you learn those Big Data technologies such as Hadoop, Pig, Hive and Spark easier.

    What is MapReduce?

    MapReduce is the key of Big Data. It was invented by Google, and it is the heart of Hadoop.

    It is a programming paradigm that allows engineers or scientist build scalable systems that can run on hundreds or thousands of servers.

    [Read More...]