Difference between revisions of "Evaluate NERSchemas"
From Anote2Wiki
(Created page with "__TOC__ Category:HOWTOs") |
RRodrigues (talk | contribs) |
||
| Line 1: | Line 1: | ||
__TOC__ | __TOC__ | ||
[[Category:HOWTOs]] | [[Category:HOWTOs]] | ||
| + | |||
| + | == Operation == | ||
| + | |||
| + | The user can apply a evaluation operation between two NERSchemas in order to calculate the annotation recall, precision and f-score between a NERSchema Gold Standard and a NERSchema to compare. To start the evaluation process right click on the NERSchema Datatype to be selected as NERSchema Gold Standard and select "Evaluate -> NER Schema". | ||
| + | |||
| + | [[File:NERSchema Evaluate.png|center|1500px]] | ||
| + | |||
| + | == Select NERSchema to compare == | ||
| + | |||
| + | A GUI will be launched to choose NERSchema Datatype (in blue) to be compared with the NERSchema Gold Standard selected on clipboard. | ||
| + | |||
| + | [[File:NERSchema Evaluate GUI.png|center|800px]] | ||
| + | |||
| + | |||
| + | NOTES: Only will appear NERSchemas with the same Normalization process present in NERSchema Gold Standard. | ||
| + | |||
| + | == Result == | ||
| + | |||
| + | A information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process. | ||
| + | |||
| + | [[File:RESchema Evaluate Result.png|center|400px]] | ||
Revision as of 12:24, 13 November 2014
Operation
The user can apply a evaluation operation between two NERSchemas in order to calculate the annotation recall, precision and f-score between a NERSchema Gold Standard and a NERSchema to compare. To start the evaluation process right click on the NERSchema Datatype to be selected as NERSchema Gold Standard and select "Evaluate -> NER Schema".
Select NERSchema to compare
A GUI will be launched to choose NERSchema Datatype (in blue) to be compared with the NERSchema Gold Standard selected on clipboard.
NOTES: Only will appear NERSchemas with the same Normalization process present in NERSchema Gold Standard.
Result
A information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.
