eval Package

metrics Module

@package eWRT.ws.stat.eval.metrics Standard IR evaluation metrics such as

• precision
• recall
• F1 measure

class eWRT.stat.eval.metrics.TestEvaluationMetrics

Bases: object

tests the evaluation metrics

a = set([8, 1, 3, 9])

b = set([1, 10, 3, 12])

c = set([1, 3])

d = set([10, 11])

testFMeasure()

testPrecision()

testRecall()

eWRT.stat.eval.metrics.fMeasure(p, r, beta=1.0)

returns the F-measure for the given precision and recall @param[in] p precision @param[in] r recall @param[in] beta weight used to compute the f mesure @returns the F-Measure

eWRT.stat.eval.metrics.precision(relevant, retrieved)

returns the precision of the given sets @param[in] relevant set of relevant terms @param[in] retrieved set of retrieved terms @returns the precision

eWRT.stat.eval.metrics.recall(relevant, retrieved)

returns the recall of the given sets @param[in] relevant set of relevant terms @param[in] retrieved set of retrieved terms @returns the recall