Module: Vangrail::EvaluationStatistics

Included in:

StatisticalVerifier

Defined in:

lib/vangrail/evaluation_statistics.rb

Overview

Deterministic detection, calibration, selectivity, and outcome statistics.

Constant Summary

EPSILON =

1e-15

ECE_BINS =

10

PARTIAL_AUC_LIMIT =

0.1

FIXED_FALSE_POSITIVE_RATES =

[0.001, 0.01, 0.05].freeze

FIXED_TRUE_POSITIVE_RATES =

[0.8, 0.9, 0.95].freeze

STRATA =

%w[family language domain origin seed].freeze