Module: Vangrail::StatisticalValidation

Included in:

StatisticalVerifier

Defined in:

lib/vangrail/statistical_validation.rb

Overview

Structural, split, provenance, and artifact checks for evaluation inputs.

Constant Summary

ROLES =

%w[train calibration threshold test].freeze

LABELS =

%w[benign attack].freeze

STATUSES =

%w[ok error abstained].freeze

REQUIRED_PREDICTION_FIELDS =

%w[
  case_id parent_case_id group role label status score security_success
  utility_without_attack utility_under_attack secure_utility
].freeze

THRESHOLD_SCHEMA =

'vangrail-threshold-provenance-v1'

DIGEST =

/\A[0-9a-f]{64}\z/

BOOLEAN_VALUES =

[true, false].freeze

MAX_ARTIFACT_BYTES =

64 * 1024 * 1024