Difference between revisions of "Create Corpus By PDF Directory"

From Anote2Wiki
Jump to: navigation, search
Line 24: Line 24:
 
* '''''Default (Without)''''' The PDF Meta-information will not be automatically loaded from PubMed (Workflow Diagram Step 1)
 
* '''''Default (Without)''''' The PDF Meta-information will not be automatically loaded from PubMed (Workflow Diagram Step 1)
  
* '''''Use File Name as PMID (Other ID)''''' For each PDF are associated a PMID for in further steps system find meta information like abstract,title or authors for PDF in Pubmed.(Workflow Diagram Step 2)
+
* '''''Use File Name as PMID (Other ID)''''' For each PDF file, the name is associated to a PMID; in further steps, @Note will find meta information (abstract, title or authors) for the article in Pubmed using this PMID (Workflow Diagram Step 2)
 +
 
 +
* '''''Import Document Meta information from TSV File''''' A tab-separated file (TSV) will be provided including columns with file name and PMID. In further steps, @Note will find meta information in PubMed using the defined PMIDs for each file (Workflow Diagram Step 3)
  
* '''''Import Document Meta information from TSV File''''' For each PDF will be associated a PMID by given a TSV file with file name and PMID combination. Further steps system find meta information like abstract,title or authors for PDF in PubMed. (Workflow Diagram Step 3)
 
  
 
[[File:Create_Corpus_By_PDF_Directrory_Step1.png|800px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Step1.png|800px|center]]
 +
  
 
== Select Corpus Name ==
 
== Select Corpus Name ==
Line 34: Line 36:
 
Select a name for the corpus, e.g “New Corpus” and press '''next'''.
 
Select a name for the corpus, e.g “New Corpus” and press '''next'''.
 
By Default the Corpus name as a the directory Name full path.
 
By Default the Corpus name as a the directory Name full path.
 +
  
 
[[File:Create_Corpus_By_PDF_Directrory_Step2.png|800px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Step2.png|800px|center]]
 +
  
 
== Import Meta-Information ==
 
== Import Meta-Information ==
Line 43: Line 47:
  
 
[[File:Create_Corpus_By_PDF_Directrory_Step2b.png|800px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Step2b.png|800px|center]]
 +
  
 
* General Delimiter: overall file delimiter to split the contents of different columns (in Blue)
 
* General Delimiter: overall file delimiter to split the contents of different columns (in Blue)
Line 52: Line 57:
  
 
A graphical interface is launched that allows you to edit the file PMID information. Pressing PDF button a GUI with PDF file is opening.
 
A graphical interface is launched that allows you to edit the file PMID information. Pressing PDF button a GUI with PDF file is opening.
 +
  
 
[[File:Create_Corpus_By_PDF_Directrory_Step3.png|800px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Step3.png|800px|center]]
 +
  
 
== Update Publication Meta Information and Full Text ==
 
== Update Publication Meta Information and Full Text ==
Line 62: Line 69:
  
 
After finished user must press '''Ok button''' and a new Corpus will be formed.
 
After finished user must press '''Ok button''' and a new Corpus will be formed.
 +
  
 
[[File:Create_Corpus_By_PDF_Directrory_Step4.png|800px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Step4.png|800px|center]]
 +
  
 
== Result ==
 
== Result ==
  
 
A new Corpus is now created and will be available in the clipboard, being visualized through the  [[Corpora Load Corpus|Corpora View]] and automatically open in clipboard.
 
A new Corpus is now created and will be available in the clipboard, being visualized through the  [[Corpora Load Corpus|Corpora View]] and automatically open in clipboard.
 +
  
 
[[File:Create_Corpus_By_PDF_Directrory_Result.png|1500px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Result.png|1500px|center]]
 +
  
 
Besides a Corpus Create will be launched
 
Besides a Corpus Create will be launched
 +
  
 
[[File:Create_Corpus_By_PDF_Directrory_Result_2.png|600px|center]]
 
[[File:Create_Corpus_By_PDF_Directrory_Result_2.png|600px|center]]

Revision as of 11:38, 23 April 2014

Operation

To create a Corpus based on a folder containing PDF files, click the Corpora datatype object in the clipboard and select the option Corpus -> Create -> PDF Directory.


Create Corpus By PDF Directrory.png


Selecting this option causes the Corpus Creation wizard to be launched. Below, we provide a brief overview of the steps.


Create Corpus By PDF Directrory Overview.png


Select Loader Options and Directory

A GUI appears allowing to select the folder where the PDF files are kept.

Here, you can opt for one of the following Loader Options:

  • Default (Without) The PDF Meta-information will not be automatically loaded from PubMed (Workflow Diagram Step 1)
  • Use File Name as PMID (Other ID) For each PDF file, the name is associated to a PMID; in further steps, @Note will find meta information (abstract, title or authors) for the article in Pubmed using this PMID (Workflow Diagram Step 2)
  • Import Document Meta information from TSV File A tab-separated file (TSV) will be provided including columns with file name and PMID. In further steps, @Note will find meta information in PubMed using the defined PMIDs for each file (Workflow Diagram Step 3)


Create Corpus By PDF Directrory Step1.png


Select Corpus Name

Select a name for the corpus, e.g “New Corpus” and press next. By Default the Corpus name as a the directory Name full path.


Create Corpus By PDF Directrory Step2.png


Import Meta-Information

A graphical interface is launched that allows you to select the file / view information about the first lines and select General Delimiter,Text Delimiter, DefaultValue and mapping between File name or full path and PMID.


Create Corpus By PDF Directrory Step2b.png


  • General Delimiter: overall file delimiter to split the contents of different columns (in Blue)
  • Text Delimiter: delimiter to encapsulate information
  • Default Value: default value used to represent empty records ( in orange )
  • Column Selection Options: select the column in the file for file Name or file full path and column for PMID

Update Document PMID (OtherID)

A graphical interface is launched that allows you to edit the file PMID information. Pressing PDF button a GUI with PDF file is opening.


Create Corpus By PDF Directrory Step3.png


Update Publication Meta Information and Full Text

In this last GUI it will possible change all meta-information about all PDF and also possible edit PDF to Text conversion. In left side user can inspect the list of documents index by document title ( if available after meta-information finder) or file name. Their are two color: green means that document meta-information is complete ( title,abstract and author are filled) otherwise the documents are red.

Select one document from list user can edit meta-information for this document and switching to "Full Text" tab user can also update the PDF to Text conversion that in most cases has errors.

After finished user must press Ok button and a new Corpus will be formed.


Create Corpus By PDF Directrory Step4.png


Result

A new Corpus is now created and will be available in the clipboard, being visualized through the Corpora View and automatically open in clipboard.


Create Corpus By PDF Directrory Result.png


Besides a Corpus Create will be launched


Create Corpus By PDF Directrory Result 2.png