Skip to main content

Metric

  • Wrapper around a function intended to validate model outputs
  • Function returns scalar value
  • Used in Validation, Model and Trainer to measure Model performance

Usage pattern

from superduper import Metric

def example_comparison(x, y):
    return sum([xx == yy for xx, yy in zip(x, y)]) / len(x)

m = Metric(
    'accuracy',
    object=example_comparison,
)

db.apply(m)

See also