Saturday, February 23, 2013

Testing Hadoop Jobs


Advice on QA Testing Your MapReduce Jobs

Traditional Unit Tests – JUnit, PyUnit, Etc.

MRUnit – Unit Testing for MR Jobs

Local Job Runner Testing – Running MR Jobs on a Single Machine in a Single JVM

Pseudo-distributed Testing – Running MR Jobs on a Single Machine Using Daemons

Full Integration Testing – Running MR Jobs on a QA Cluster


No comments:

Post a Comment