Difference between revisions of "Evaluate NERSchemas"
RRodrigues (talk | contribs) |
Anote2Wiki (talk | contribs) |
||
| Line 4: | Line 4: | ||
== Operation == | == Operation == | ||
| − | + | You can apply an evaluation operation comparing two NERSchemas to calculate the annotation recall, precision and f-score between a NERSchema taken as a gold standard (typically taken from a corpus with manual annotations) and a NERSchema to compare (typically from running a specific algorithm or pipeline). | |
| + | To start the evaluation process, right click on the NERSchema Datatype to be selected as gold standard and select "Evaluate -> NER Schema". | ||
| + | |||
[[File:NERSchema Evaluate.png|center|1500px]] | [[File:NERSchema Evaluate.png|center|1500px]] | ||
| + | |||
== Select NERSchema to compare == | == Select NERSchema to compare == | ||
| − | A GUI will be launched to choose NERSchema Datatype (in blue) to be compared with the | + | A GUI will be launched to choose the NERSchema Datatype (in blue) to be compared with the gold standard selected on the clipboard. |
| + | |||
[[File:NERSchema Evaluate GUI.png|center|500px]] | [[File:NERSchema Evaluate GUI.png|center|500px]] | ||
| − | NOTES: Only | + | NOTES: Only NERSchemas with the same Normalization process as the one NERSchema gold standard will appear. |
== Result == | == Result == | ||
| − | + | An information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process. | |
| + | |||
[[File:RESchema Evaluate Result.png|center|200px]] | [[File:RESchema Evaluate Result.png|center|200px]] | ||
Revision as of 16:21, 17 November 2014
Operation
You can apply an evaluation operation comparing two NERSchemas to calculate the annotation recall, precision and f-score between a NERSchema taken as a gold standard (typically taken from a corpus with manual annotations) and a NERSchema to compare (typically from running a specific algorithm or pipeline). To start the evaluation process, right click on the NERSchema Datatype to be selected as gold standard and select "Evaluate -> NER Schema".
Select NERSchema to compare
A GUI will be launched to choose the NERSchema Datatype (in blue) to be compared with the gold standard selected on the clipboard.
NOTES: Only NERSchemas with the same Normalization process as the one NERSchema gold standard will appear.
Result
An information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.
