Custom Metrics

Ragrank allow to build custom metrics to evaluate your rag models.

⛏ Custom Metric

You can create custom metrics by inheriting the CustomMetric class. You’ll need to implement three methods for your metric.

⛏ Custom Instruct

Differs from predefined metrics. Initialize with config before use. Allows custom evaluation instructions as prompts.