gaia.metrics package

GAIA Metrics Tracking

class gaia.metrics.MetricTracker(window_size=100)

Bases: object

Tracks and computes metrics during training

__init__(window_size=100)

update(metrics=None, prefix='', **kwargs)

Update metrics with new values.

get_current(name)

Get the current (most recent) value for a metric.

get_average(name)

Get the average value for a metric.

reset()

Reset all metrics

end_epoch()

Mark end of epoch and store epoch averages

get_epoch_summary()

Get summary of current epoch metrics

compute_accuracy(predictions, targets)

Compute classification accuracy

compute_categorical_coherence(functor_output)

Compute categorical coherence metric specific to GAIA

compute_horn_completion_rate(horn_results)

Compute horn completion success rate

compute(prefix='')

Compute and return current metrics summary

get_history()

Get complete metrics history