-
Notifications
You must be signed in to change notification settings - Fork 75
Introduction
The availability of very large-scale clinical databases in electronic form has opened the possibility to generate systematic and large-scale evidence and insights about healthcare. This discipline is called Observational Outcome Research, and it uses longitudinal patient level clinical data in order to describe and understand the onset of disease and the effect of other clinical events as well as treatment interventions on the progression of the disease. Often, this research constitutes secondary use of the data, as they are being collected for purposes other than research: administrative data such as insurance reimbursement claims and Electronic Health or Medical Records (EHR, EMR).
Because of the collection purpose for primary use, the format and representation of the data follows that primary use. It also introduces artifacts and bias into the data. In addition, all source datasets differ from each other in format and content representation. Since healthcare systems differ between countries, the problem becomes even harder for research carried out internationally. All this makes robust, reproducible and automated research a significant challenge.
The solution is the standardization of the data model (syntax) and a standardization of the representation (coding). This allows methods and tools to operate on data of disparate origin, freeing the analyst from having to dissect the idiosyncrasies of a particular dataset and manipulating the data to make it fit for research. It also allows to develop analytical methods on one dataset, and applying it an any other dataset. Which means, patient-level data available in OMOP CDM explicitly require the representation of all facts, events and information using concepts from the Standardized Vocabularies. With few exceptions, there are no verbatim pieces of information in the CDM tables.
Initially, the Standardized Vocabularies were constructed together with the Common Data Model during the OMOP Partnership for the conduct of the OMOP experiments. That use case called for a very simple design, facilitating the minimum functionality necessary to conduct observational outcome studies. After OMOP ended in November 2013, the OMOP Standardized Vocabularies are now supported by OHDSI. The simplicity and pragmatism while allows to maintain this resource in an Open Source Project and its limited resources.
The Standardized Vocabularies are constructed with a few principles in mind. Not every principle has been executed to perfection, but it represents a general motivation and direction of the ongoing improvement and development process:
- Standardization: Different vocabularies used in observational data are consolidated into a common format. Their entries or codes, called concepts, are stored in one single data table, CONCEPT. This relieves the researchers from having to understand and handle multiple different formats and life cycle conventions of the originating Vocabularies.
- Unique Standard Concepts: For each Clinical Entity there is only one concept representing it, called the Standard Concept. Other equivalent or similar concepts are designated non-Standard and mapped to the Standard ones.
- Domains: Each concept is assigned one of a list of predefined domains. “Dirty”, i.e. not well defined concepts, which are mostly non-Standard, can also belong to more than one domain. This also defines in which CDM table a clinical entity should be placed into or looked up in at query time.
- Comprehensive coverage: Every event in a patient's healthcare experience (e.g. Conditions, Procedures, Exposures to Drug, etc.) and some of the administrative artifacts of the healthcare system (e.g. Visits, Care Sites, etc.) are covered within the domain.
-
Hierarchy: Within a domain all concepts are organized in a hierarchical structure. This allows to query for all concepts (e.g. drug products) that are hierarchically subsumed under a higher level concept (e.g. a drug class). This entails addressing two separate problems:
- Each concept should have one or more classifications (bottom up).
- Each classification should contain all the relevant concepts (top down).
- Relationships between concepts within and across vocabularies and Mappings from non-Standard to Standard Concepts.
- Life cycle keeping data representation up to date but supporting the processing of deprecated and upgraded concepts and relationships.
Work still needs to be done to achieve all the criteria in all of the domains. Currently, for the most important domains we can achieve the following compliance:
Domain | Standardization | Unique Concepts | Reliable Domains | Comprehensive Coverage | Hierarchy | Mapping |
---|---|---|---|---|---|---|
Drug | x | x | for most countries with data | x | x | x |
Condition | x | x | mostly | x | x | mostly |
Procedure | x | heavily overlapping | x | x | x | |
Measurement | x | somewhat | mostly | x | minimal | |
Device | mostly | |||||
Unit | x | x | x | x |
The life cycle is implemented for all concepts, and its rules are described in the CONCEPT table and in the discussion of the individual vocabularies.
It is important to note that these criteria have the purpose to serve observational research. In that regard the Standardized Vocabularies differ from large collections with equivalence mappings of concepts such as the UMLS, which supports indexing and searching of the biomedical literature. UMLS resources have been used heavily as a basis for constructing many of the Standardized Vocabulary components, but significant additional efforts have been made to adjust the framework:
- Additional Vocabularies, mostly for metadata purposes, are established.
- Mappings and relationships are being added to achieve comprehensive coverage. If equivalence cannot be achieved, “uphill” relationships from more granular non-standard to higher level Standard Concepts are created.
Quick access:
- Home
- News
- Introduction
- Glossary
- The Vocabulary Team
- Roadmap
- Release Notes
- Upcoming Changes
- Community Contribution
- General Structure, Download and Use
- Domains
- Vocabularies
- Vocabulary Statistics
- Vocabulary Development Process
- Vocabulary Metadata
- Quality Assurance and Control
- Known Issues in Vocabularies
- Articles
- COVID-19 Vocabulary/ETL Instructions
- Historical Versions