Difference between revisions of "Evaluate RESchemas"
From Anote2Wiki
(Created page with "__TOC__ Category:HOWTOs") |
RRodrigues (talk | contribs) |
||
| Line 1: | Line 1: | ||
__TOC__ | __TOC__ | ||
[[Category:HOWTOs]] | [[Category:HOWTOs]] | ||
| + | |||
| + | == Operation == | ||
| + | |||
| + | The user can apply a evaluation operation between two RESchemas in order to calculate the annotation recall, precision and f-score between a RESchema Gold Standard and a RESchema to compare. To start the evaluation process right click on the RESchema Datatype to be selected as RESchema Gold Standard and select "Evaluate -> NER Schema". | ||
| + | |||
| + | [[File:RESchema Evaluate.png|center|1500px]] | ||
| + | |||
| + | == Select RESchema to compare == | ||
| + | |||
| + | A GUI will be launched to choose RESchema Datatype (in blue) to be compared with the RESchema Gold Standard selected on clipboard. | ||
| + | |||
| + | [[File:RESchema Evaluate GUI.png|center|500px]] | ||
| + | |||
| + | |||
| + | NOTES: Only will appear RESchema with the same Normalization process present in RESchema Gold Standard. | ||
| + | |||
| + | == Result == | ||
| + | |||
| + | A information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process. | ||
| + | |||
| + | [[File:RESchema Evaluate Result.png|center|200px]] | ||
Revision as of 13:56, 13 November 2014
Operation
The user can apply a evaluation operation between two RESchemas in order to calculate the annotation recall, precision and f-score between a RESchema Gold Standard and a RESchema to compare. To start the evaluation process right click on the RESchema Datatype to be selected as RESchema Gold Standard and select "Evaluate -> NER Schema".
Select RESchema to compare
A GUI will be launched to choose RESchema Datatype (in blue) to be compared with the RESchema Gold Standard selected on clipboard.
NOTES: Only will appear RESchema with the same Normalization process present in RESchema Gold Standard.
Result
A information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.
