-
Notifications
You must be signed in to change notification settings - Fork 1
MeSH Annual Updates
-
Download the official MeSH RDF dataset https://github.com/filak/MTW-MeSH/wiki/Loading-MeSH-datasets#get-the-official-mesh-rdf-dataset
-
ALWAYS perform the checks and resolve any issues in MTW - ie. duplicates, locks, pending changes etc.
-
Export required output files from MTW - ie. UMLS TSV, MARC file, stats etc.
-
BACKUP your <mesh> dataset using Fuseki interface
-
Extract the translation from the backup using mesh-nt2trx tool - run:
mesh-nt2trx %FUSEKI_BASE%/backups/mesh_YYYY-MM-DD_....nq.gz
-
Stop MTW Server and MTW Worker services
-
Go to your <FUSEKI_DATA_DIR> and DELETE the <mesh> directories under datatabases and indexes dirs
-
Update MTW config file for new target year/period
<MTW_HOME_DIR>/instance/conf/mtw.ini
-
Follow the steps in Import the RDF datasets
-
Clear the MTW cache - delete all files in instance/cache
-
Start MTW Server and MTW Worker services
-
Reset the Initial stats in Manage dashboard
NML Bethesda distributes the UMLS MeSH exports as CSV text files usually in autumn.
For better understanding all the data changes it is recommended to upload some of the files to Google Drive sheets and share it with the translating team.
-
Create a sheet in your Google Drive - ie. MeSH_UMLS_YYYY
-
Upload the files into lists:
-
deleted_mh.txt => MH_Deleted list
-
new_mh.txt => MH_New list
DescriptorUI;ConceptUI;Language;Term Type;String;TermUI;ScopeNote;Tree;Change Type;Browser;MTW;TrxTerm;TrxNotes;TrxScopeNote
-
conceptUI_diff.txt => Concepts_Changes - after adding Fx columns select values for TermType filter: MH, PEP, ET
DescriptorUI;ConceptUI;Language;Term Type;String;ScopeNote;Change Type;Browser;MTW;TrxTerm;TrxNotes
-
changed_marked.txt => MH_Changed list - after adding Fx columns select values for ChangeType filter: UPDATED_MH, UPDATED_MH/UPDATED_ScopeNote, UPDATED_ScopeNote, DELETED_ROW, NEW_ROW
DescriptorUI;ConceptUI;Language;Term Type;String;TermUI;ScopeNote;Tree;Change Type;Browser;MTW;TrxTerm;TrxNotes
-
ScopeNote_changes.txt => remove empty rows => ScopeNotes_Changed list
DescriptorUI;ConceptUI;Language;Term Type;String;TermUI;ScopeNote;Tree;Change Type;Browser;MTW;TrxScopeNote;TrxNotes
Add filters - Data > Add filter
-
Browser
=HYPERLINK(CONCAT("https://meshb-prev.nlm.nih.gov/record/ui?ui=",A2),"view")
-
MTW
=HYPERLINK(CONCAT("https://YOUR-MTW-INSTANCE-HOST/mtw/search/dui:",A2),"mtw")
You can use the following strategy to prioritize the work on the translation (in combination with the MTW Dashboard):
- MH_New - Term Type MH - translate main heading term (and scope note if applicable)
- MH_New - Term Type PEP - translate terms
- MH_Changed - Term Type MH - revise main heading term (and scope note if applicable)
- MH_Changed - Term Type PEP - revise terms
- MH_New - Term Type ET - translate terms
- MH_Changed - Term Type ET - revise terms