Anyone who uses Hadoop on a regular basis knows that reliability of complex jobs is a mystery. The odds of a Hadoop job running according to plan every time are not 90 percent, or even 80 percent at most shops. Some Hadoop teams have turned this resignation into a sense of pride at their skill in managing the weaknesses of Hadoop. The question that interests me is: Why is this okay?
Source: www.forbes.com
Anyone who uses Hadoop on a regular basis knows that reliability of complex jobs is a mystery. The odds of a Hadoop job running according to plan every time are not 90 percent, or even 80 percent at most shops. Some Hadoop teams have turned this resignation into a sense of pride at their skill in managing the weaknesses of Hadoop. The question that interests me is: Why is this okay?