Evaluate RESchemas

Operation

The user can apply a evaluation operation between two RESchemas in order to calculate the annotation recall, precision and f-score between a RESchema Gold Standard and a RESchema to compare. To start the evaluation process right click on the RESchema Datatype to be selected as RESchema Gold Standard and select "Evaluate -> NER Schema".

Select RESchema to compare

A GUI will be launched to choose RESchema Datatype (in blue) to be compared with the RESchema Gold Standard selected on clipboard.

NOTES: Only will appear RESchema with the same Normalization process present in RESchema Gold Standard.

Result

A information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.