Organizational Research By

Surprising Reserch Topic

Question:How does fault tolerance work in mapreduce?



asked Sep 13, 2013 in Cloud-Computing by rajesh
edited Sep 12, 2013
0 votes
18 views



Related Hot Questions

2 Answers

0 votes
In a mapreduce job the master pings each worker periodically. In case a worker does not respond to that system then the system is marked as failed. Even completed tasks are rescheduled because the output was stored in a in a local disk of a worker which failed. Hence mapreduce is able to handle large-scale failures easily by simply restarting a task. The master node always saves itself at checkpoints and in case of any failure it simply restarts from that checkpoint.
answered Sep 13, 2013 by rajesh
edited Sep 12, 2013
0 votes
In a mapreduce job the master pings each worker periodically. In case a worker does not respond to that system then the system is marked as failed. Even completed tasks are rescheduled because the output was stored in a in a local disk of a worker which failed. Hence mapreduce is able to handle large-scale failures easily by simply restarting a task. The master node always saves itself at checkpoints and in case of any failure it simply restarts from that checkpoint.
answered Sep 13, 2013 by rajesh
edited Sep 12, 2013

...