Difference between revisions of "User:Shawndouglas/sandbox/sublevel1"

From LIMSWiki
Jump to navigationJump to search
(Replaced content with "COVID-19 is at the forefront of the consciousness of humanity, by and large, and the informatics tools we implement for managing, treating, and surveilling the disease are...")
Tag: Replaced
Line 1: Line 1:
COVID-19 is at the forefront of the consciousness of humanity, by and large, and the informatics tools we implement for managing, treating, and surveilling the disease are of great import. From disease databases to [[electronic health record]]s, from [[bioinformatics]] tools for peptide and protein modeling to laboratory tools such as LIMS and LIS, we continue to fight back against the threat of the SARS-CoV-2 virus. Yet despite the gravity of the pandemic, this is neither the first nor the last time [[Laboratory informatics|laboratory]] and scientific informatics will play a positive role in testing for disease and improving public health outcomes.
[[File:Electronic medical record.jpg|right|460px]]System interoperability also poses benefits and challenges to clinical disease testing and prevention. Interoperability is defined as “the ability of different information systems, devices and applications (‘systems’) to access, exchange, integrate and cooperatively use data in a coordinated manner” to ensure timely, portable information and improved health outcomes.<ref name=”HIMSSInterop20”>{{cite web |url=https://www.himss.org/resources/interoperability-healthcare |title=Interoperability in Healthcare |author=Healthcare Information and Management Systems Society |publisher=Healthcare Information and Management Systems |date=2020 |accessdate=28 April 2020}}</ref> Improving interoperability among clinical informatics systems is recognized as an important step towards improving health outcomes.<ref name="KunImprov08">{{cite journal |title=Improving outcomes with interoperable EHRs and secure global health information infrastructure |journal=Studies in Health Technology and Informatics |author=Kun, L.; Coatrieux, G.; Quantin, C. et al. |volume=137 |pages=68–79 |year=2008 |pmid=18560070}}</ref><ref name="GCHIImproving">{{cite web |url=http://s3.amazonaws.com/rdcms-himss/files/production/public/Improving-Patient-Carethrough-Interoperability.pdf |format=PDF |title=Improving Patient Care through Interoperability |author=Global Center for Health Innovation |publisher=Global Center for Health Innovation |date=n.d. |accessdate=17 September 2021}}</ref> The National Academies of Sciences, Engineering, and Medicine had much to say on this topic in their 2015 publication ''Improving Diagnosis in Health Care''<ref name="NASEMImprov15">{{cite book |url=https://www.nap.edu/read/21794/chapter/7 |chapter=Chapter 5: Technology and Tools in the Diagnostic Process |title=Improving Diagnosis in Health Care |author=National Academies of Sciences, Engineering, and Medicine |publisher=The National Academies Press |pages=217–62 |year=2015 |doi=10.17226/21794 |isbn=9780309377720}}</ref> :


Health informatics technology, when used responsibly, has already proven to be useful in studying and treating contagious diseases. In a 2013 research paper published in the journal ''BMJ Quality & Safety'', El-Kareh ''et al.'' analyzed and described the state of diagnostic health information technology (HIT). They noted that without the aid of HIT, clinicians are more error-prone, leaving them "vulnerable to fallible human memory, variable disease presentation, clinical processes plagued by communication lapses, and a series of well-documented ‘heuristics,’ biases, and disease-specific pitfalls."<ref name="El-KarehUseOf13">{{cite journal |title=Use of health information technology to reduce diagnostic errors |journal=BMJ Quality & Safety |author=El-Kareh, R.; Hasan, O.; Schiff, G.D. |volume=22 |issue=Suppl. 2 |pages=ii40–ii51 |year=2013 |doi=10.1136/bmjqs-2013-001884 |pmid=23852973 |pmc=PMC3786650}}</ref> Appropriate, well-designed HIT systems are capable of helping clinicians and laboratorians by providing more timely access to information, improved communication, better clinical reasoning and decision making, and improved workflows, as well as a reduction in diagnostic errors, and, as a result, improved patient safety and health outcomes.<ref name="NASEMImprov15">{{cite book |url=https://www.nap.edu/read/21794/chapter/7 |chapter=Chapter 5: Technology and Tools in the Diagnostic Process |title=Improving Diagnosis in Health Care |author=National Academies of Sciences, Engineering, and Medicine |publisher=The National Academies Press |pages=217–62 |year=2015 |doi=10.17226/21794 |isbn=9780309377720}}</ref>  
<blockquote>Improved interoperability across different health care organizations—as well as across laboratory and [[radiology information system]]s—is critical to improving the diagnostic process. Challenges to interoperability include the inconsistent and slow adoption of standards, particularly among organizations that are not subject to EHR certification programs, as well as a lack of incentives, including a business model that generates revenue for health IT vendors via fees associated with transmitting and receiving data.</blockquote>


From a public health perspective, the application of informatics to disease surveillance, reporting, and health habit promotion is also vital. Winters-Miner ''et al.'' note in particular the value of using informatics tools and methods to implement predictive analytics and data mining into public health. They use disease prevention and biosurveillance as major examples. We could, for example "analyze large populations of people to quantify risks related to public health, and help physicians to develop intervention programs for those patients at highest risk of some ailment or medical condition."<ref name="Winters-MinerBiomedical15">{{cite book |chapter=Chapter 3: Biomedical Informatics |title=Practical Predictive Analytics and Decisioning Systems for Medicine |author=Winters-Miner, L.A.; Bolding, P.S.; Hilbe, J.M. et al. |publisher=Academic Press |pages=42–59 |year=2015 |doi=10.1016/B978-0-12-411643-6.00003-X |isbn=9780124116436}}</ref> Additionally, through the use of syndromic surveillance systems (tools aiding in the detection of indicators leading up to disease diagnosis for individuals and populations<ref name="MandlImplement04">{{cite journal |title=Implementing syndromic surveillance: A practical guide informed by the early experience |journal=JAMIA |author=Mandl, K.D.; Overhage, J.M.; Wagner, M.M. et al. |volume=11 |issue=2 |pages=141–50 |year=2004 |doi=10.1197/jamia.M1356 |pmid=14633933 |pmc=PMC353021}}</ref>), they suggest that outbreaks can be better detected at local and national levels, and public health measures can be better implemented, increasing public awareness and hindering the spread of disease.<ref name="Winters-MinerBiomedical15" />
In particular, they discuss an additional concern, one that still causes issues today: interfaces between [[electronic health record]]s (EHR) and the laboratory and other clinical information systems that feed medical diagnostic information into the EHRs<ref name="NASEMImprov15" />:


In the clinical laboratory, informatics systems have been influencing workflow improvements and improved service delivery for more than five decades.<ref name="JonesInform14">{{cite journal |title=Informatics and the Clinical Laboratory |journal=The Clinical Biochemist Reviews |author=Jones, R.G.; Johnson, O.A.; Baststone, G. |volume=35 |issue=3 |pages=177–192 |year=2014 |pmid=25336763 |pmc=PMC4204239}}</ref> And while improvements have been seen in the laboratory from not only the introduction of computerized systems<ref name="El-KarehUseOf13" /><ref name="NASEMImprov15" /><ref name="RaeenHowLab18">{{cite journal |title=How laboratory informatics has impacted healthcare overall |journal=Applied Research Projects |author=Raeen, M.R. |volume=54 |year=2018 |url=https://dc.uthsc.edu/hiimappliedresearch/54 |doi=10.21007/chp.hiim.0056}}</ref> but also the realization of quality control<ref name="ChawlaEval10">{{cite journal |title=Evaluating laboratory performance with quality indicators |journal=Laboratory Medicine |author=Chawla, R.; Goswami, B.; Singh, B. et al. |volume=41 |issue=5 |pages=297–300 |year=2010 |doi=10.1309/LMS2CBXBA6Y0OWMG}}</ref> and point-of-care testing<ref name="PricePoint01">{{cite journal |title=Poing of care testing |journal=BMJ |author=Price, C.P. |volume=322 |issue=7297 |pages=1285–8 |year=2001 |doi=10.1136/bmj.322.7297.1285 |pmid=11375233 |pmc=PMC1120384}}</ref>, more challenges remain. For example, quality management in the laboratory is still often a manual, time-consuming activity. While the LIMS and LIS have some tools to assist with this task, the inclusion of laboratory analytics and business intelligence tools into those systems may lead to even further improvements in quality and efficiency in the lab.<ref name="ZiaguraUsing19">{{cite web |url=https://www.mlo-online.com/information-technology/lis/article/13017560/using-analytics-to-manage-qa-and-reduce-laboratory-errors |title=Using analytics to manage QA and reduce laboratory errors |author=Ziaugra, K.; Hawrylak, V.; Bickley, T. et al. |work=Medical Laboratory Observer |date=20 March 2019 |accessdate=25 April 2020}}</ref> And in the realm of point-of-care testing, oversight and control of instruments can be lost when connectivity and training is lacking. Proper interfacing of these lab instruments could lead to improvements in those areas, says Siemens Healthineers' Daniel Gundler. "Maintaining POC instruments and overseeing the operators performing POC tests would be much easier if all the information and data from each instrument were accessible through one user interface in which coordinators could manage both the instruments and operators."<ref name="GundlerPOCT19">{{cite web |url=https://www.mlo-online.com/home/article/13017228/poct-made-easier-with-informatics |title=POCT made easier with informatics |author=Gundler, D. |work=Medical Laboratory Observer |date=23 January 2019 |accessdate=25 April 2020}}</ref>
<blockquote>Additionally, the interface between EHRs and laboratory and radiology information systems typically has limited clinical information, and the lack of sufficiently detailed information makes it difficult for a pathologist or radiologist to determine the proper context for interpreting findings or to decide whether diagnostic testing is appropriate. For example, one study found that important non-oncological conditions (such as Crohn’s disease, human immunodeficiency virus, and diabetes) were not mentioned in 59 percent of radiology orders and the presence of cancer was not mentioned in 8 percent of orders, demonstrating that the complete patient context is not getting received. Insufficient clinical information can be problematic as radiologists and pathologists often use this information to inform their interpretations of diagnostic testing results and suggestions for next steps. In addition, the Centers for Disease Control and Prevention’s Clinical Laboratory Improvement Advisory Committee (CLIAC) expressed concern over the patient safety risks regarding the interoperability of laboratory data and display discrepancies in EHRs. They recommended that laboratory health care professionals collaborate with other stakeholders to “develop effective solutions to reduce identified patient safety risks in and improve the safety of EHR systems” regarding laboratory data.</blockquote>
 
In fact, interoperability issues have come up during the global laboratory response to the COVID-19 pandemic. In early April 2020, a report from ''Nature'' revealed that academic research laboratories wanting to assist with COVID-19 testing efforts have at times been stymied by the incompatibility between academic informatics systems and hospital EHRs. Not only do hospitals use EHRs of differing types, but many of those EHRs were not designed to talk to other EHRs, let alone to academic and research laboratories' informatics systems. Combine this with strict account procedures and the costs of developing interfaces on-the-fly, more than a few medical systems have turned away the offer of help from academic and research labs.<ref name="MaxmenThousands20">{{cite journal |title=Thousands of coronavirus tests are going unused in US labs |journal=Nature |author=Maxmen, A. |volume=580 |issue=7803 |pages=312–13 |year=2020 |doi=10.1038/d41586-020-01068-3 |pmid=32273619}}</ref> As it turns out, [[HL7]]- and other standard-based interfaces have long been expensive for many vendors to implement<ref name="John3504HL7_11">{{cite web |url=https://community.spiceworks.com/topic/175107-hl7-interface-cost-and-maintenance |title=HL7 Interface cost and maintenance |author=John3504 |work=Spiceworks |date=07 December 2011 |accessdate=25 April 2020}}</ref>, the cost justified typically when high volumes of samples are involved. Additionally, in more normal, non-pandemic circumstances, the requirement to interface with EHRs and [[hospital information system]]s (HIS) is almost exclusively found in the LIS and LIMS used in patient settings, i.e., in the hospitals, medical offices, and laboratories catering to diagnosing disease in patients. Academic labs have not been equipped at any level (software, hardware, or personnel) to do high volume clinical testing, nor have they had reason to ensure their informatics systems can interface with clinical systems.
 
Interoperability benefits and challenges show up elsewhere too. Take for example the value of phenotypes, a representation of the genetic analysis of the collective observable traits of an organism, traits caused by the interaction of its genome with the environment. The value of patient phenotyping data is increasingly useful in the fight against known and novel viruses, as well as a broad variety of non-viral diseases. As Ausiello and Shaw note, in order for medicine to advance and produce improved patient outcomes, "traditional clinical information must be combined with genetic data and non-traditional phenotypes and analyzed in a manner that yields actionable insights into disease diagnosis, prevention, or treatment."<ref name="AusielloQuant14">{{cite journal |title=Quantitative Human Phenotyping: The Next Frontier in Medicine |journal=Transactions of the American Clinical and Climatological Association |author=Ausiello, D.; Shaw, S. |volume=125 |pages=219–26 |year=2014 |pmid=25125736 |pmc=PMC4112685}}</ref> Whether it's identifying "the measurable phenotypic characteristics of patients that are most predictive of individual variation" in treatment outcomes for chronic pain<ref name="EdwardsPatient16">{{cite journal |title=Patient phenotyping in clinical trials of chronic pain treatments: IMMPACT recommendations |journal=Pain |author=Edwards, R.R.; Dworkin, R.H.; Turk, D.C. et al. |volume=157 |issue=9 |pages=1851–71 |year=2016 |doi=10.1097/j.pain.0000000000000602 |pmid=27152687 |pmc=PMC5965275}}</ref> or COVID-19<ref name="MousavizadehGenotype20">{{cite journal |title=Genotype and phenotype of COVID-19: Their roles in pathogenesis |journal=Journal of Microbiology, Immunology, and Infection |author=Mousavizadeh, L.; Ghasemi, S. |pages=30082-7 |year=2020 |doi=10.1016/j.jmii.2020.03.022 |pmid=32265180 |pmc=PMC7138183}}</ref><ref name="GattinoniCOVID20">{{cite journal |title=COVID-19 pneumonia: Different respiratory treatments for different phenotypes? |journal=Intensive Care Medicine |author=Gattinoni, L.; Chiumello, D.; Caironi, P. |year=2020 |doi=10.1007/s00134-020-06033-2 |pmid=32291463 |pmc=PMC7154064}}</ref>, phenotypes have utility in the clinical sector.
 
Here again interoperability between EHRs and laboratory informatics systems comes into play. In a 2019 paper published by Zhang ''et al.'' in ''nph Digital Medicine'', the topic of extracting patient phenotypes from laboratory test results fed into EHRs is addressed.<ref name="ZhangSemantic19">{{cite journal |title=Semantic integration of clinical laboratory tests from electronic health records for deep phenotyping and biomarker discovery |journal=npj Digital Medicine |author=Zhang, X.A.; Yates, A.; Vasilevsky, N. et al. |volume=2 |at=32 |year=2019 |doi=10.1038/s41746-019-0110-4 |pmid=31119199 |pmc=PMC6527418}}</ref> The authors state that one of the more difficult aspects of their research is that while "[l]aboratory tests have broad applicability for translational research ... EHR-based research using laboratory data have been challenging because of their diversity and the lack of standardization of reporting laboratory test results." They add<ref name="ZhangSemantic19" />:
 
<blockquote>Despite the great potential of EHR data, patient phenotyping from EHRs is still challenging because the phenotype information is distributed in many EHR locations (laboratories, notes, problem lists, imaging data, etc.) and since EHRs have vastly different structures across sites. This lack of integration represents a substantial barrier to widespread use of EHR data in translational research.</blockquote>
 
The answer to the clinical and laboratory interoperability question is unclear. A 2019 article in the American Association for Clinical Chemistry's ''CLN Stat'' addressed remaining roadblocks, including lack of standards development, data quality issues, clinical data matching, lack of incentivizing health IT optimization, text-based reporting formats, differences in terminology, and HL7 messaging issues. They add that proposals from the Office of the National Coordinator for Health Information Technology (ONC) and the Centers for Medicare and Medicaid Services include possible fixes such as standardized [[application programming interface]]s (API). They also note that middleware may pick up the slack in connecting more laboratory devices, rather than depending on the LIS to handle all the interfacing.<ref name="AACCStrength19">{{cite web |url=https://www.aacc.org/cln/cln-stat/2019/february/21/strengthening-the-chain-of-interoperability |title=Strengthening the Chain of Interoperability |author=American Association for Clinical Chemistry |work=CLN Stat |date=21 February 2019 |accessdate=17 September 2021}}</ref> On a more positive note, the Office of the National Coordinator for Health Information Technology (ONC) updated its Interoperability Standards Advisory (ISA) [https://www.healthit.gov/isa/covid-19 Vocabulary/Code Set/Terminology page] in November to better "highlight critical public health interoperability needs on COVID-19 in an easily accessible way." Replying to the ONC, HIMSS's Senior Director Jeff Coughlin goes on to add<ref name="CoughlinCOVID20">{{cite web |url=https://www.healthit.gov/isa/covid-19 |archiveurl=https://web.archive.org/web/20201110225342/https://www.healthit.gov/isa/covid-19 |title=COVID-19 Novel Coronavirus Pandemic |author=Coughlin, J. |work=ISA - Vocabulary/Code Set/Terminology |publisher=Office of the National Coordinator |archivedate=10 November 2020 |accessdate=17 September 2021}}</ref>:
 
<blockquote>There is a growing need to consider data exchange for home settings and considerations around device interoperability. There are a number of applications in use and this setting requires work across a number of systems (emergency medical services, hospital electronic health records, telemedicine system [synchronous and asynchronous] and, remote patient monitoring and device management). ISA should provide guidance on specific standards to assist in exchange with this setting."</blockquote>
 
Even so, it remains obvious that more work needs to be done in the development and standard use of clinical and laboratory informatics applications if the promise of personalized medicine and the need for improved disease testing and response are to be fulfilled. In particular, how we responsibly protect personal health information while putting its anonymized variants to beneficial use for disease testing and prevention remains a critical question that must be solved in order to better prepare for the next COVID-19.


==References==
==References==
{{Reflist|colwidth=30em}}
{{Reflist|colwidth=30em}}

Revision as of 20:40, 3 February 2022

Electronic medical record.jpg

System interoperability also poses benefits and challenges to clinical disease testing and prevention. Interoperability is defined as “the ability of different information systems, devices and applications (‘systems’) to access, exchange, integrate and cooperatively use data in a coordinated manner” to ensure timely, portable information and improved health outcomes.[1] Improving interoperability among clinical informatics systems is recognized as an important step towards improving health outcomes.[2][3] The National Academies of Sciences, Engineering, and Medicine had much to say on this topic in their 2015 publication Improving Diagnosis in Health Care[4] :

Improved interoperability across different health care organizations—as well as across laboratory and radiology information systems—is critical to improving the diagnostic process. Challenges to interoperability include the inconsistent and slow adoption of standards, particularly among organizations that are not subject to EHR certification programs, as well as a lack of incentives, including a business model that generates revenue for health IT vendors via fees associated with transmitting and receiving data.

In particular, they discuss an additional concern, one that still causes issues today: interfaces between electronic health records (EHR) and the laboratory and other clinical information systems that feed medical diagnostic information into the EHRs[4]:

Additionally, the interface between EHRs and laboratory and radiology information systems typically has limited clinical information, and the lack of sufficiently detailed information makes it difficult for a pathologist or radiologist to determine the proper context for interpreting findings or to decide whether diagnostic testing is appropriate. For example, one study found that important non-oncological conditions (such as Crohn’s disease, human immunodeficiency virus, and diabetes) were not mentioned in 59 percent of radiology orders and the presence of cancer was not mentioned in 8 percent of orders, demonstrating that the complete patient context is not getting received. Insufficient clinical information can be problematic as radiologists and pathologists often use this information to inform their interpretations of diagnostic testing results and suggestions for next steps. In addition, the Centers for Disease Control and Prevention’s Clinical Laboratory Improvement Advisory Committee (CLIAC) expressed concern over the patient safety risks regarding the interoperability of laboratory data and display discrepancies in EHRs. They recommended that laboratory health care professionals collaborate with other stakeholders to “develop effective solutions to reduce identified patient safety risks in and improve the safety of EHR systems” regarding laboratory data.

In fact, interoperability issues have come up during the global laboratory response to the COVID-19 pandemic. In early April 2020, a report from Nature revealed that academic research laboratories wanting to assist with COVID-19 testing efforts have at times been stymied by the incompatibility between academic informatics systems and hospital EHRs. Not only do hospitals use EHRs of differing types, but many of those EHRs were not designed to talk to other EHRs, let alone to academic and research laboratories' informatics systems. Combine this with strict account procedures and the costs of developing interfaces on-the-fly, more than a few medical systems have turned away the offer of help from academic and research labs.[5] As it turns out, HL7- and other standard-based interfaces have long been expensive for many vendors to implement[6], the cost justified typically when high volumes of samples are involved. Additionally, in more normal, non-pandemic circumstances, the requirement to interface with EHRs and hospital information systems (HIS) is almost exclusively found in the LIS and LIMS used in patient settings, i.e., in the hospitals, medical offices, and laboratories catering to diagnosing disease in patients. Academic labs have not been equipped at any level (software, hardware, or personnel) to do high volume clinical testing, nor have they had reason to ensure their informatics systems can interface with clinical systems.

Interoperability benefits and challenges show up elsewhere too. Take for example the value of phenotypes, a representation of the genetic analysis of the collective observable traits of an organism, traits caused by the interaction of its genome with the environment. The value of patient phenotyping data is increasingly useful in the fight against known and novel viruses, as well as a broad variety of non-viral diseases. As Ausiello and Shaw note, in order for medicine to advance and produce improved patient outcomes, "traditional clinical information must be combined with genetic data and non-traditional phenotypes and analyzed in a manner that yields actionable insights into disease diagnosis, prevention, or treatment."[7] Whether it's identifying "the measurable phenotypic characteristics of patients that are most predictive of individual variation" in treatment outcomes for chronic pain[8] or COVID-19[9][10], phenotypes have utility in the clinical sector.

Here again interoperability between EHRs and laboratory informatics systems comes into play. In a 2019 paper published by Zhang et al. in nph Digital Medicine, the topic of extracting patient phenotypes from laboratory test results fed into EHRs is addressed.[11] The authors state that one of the more difficult aspects of their research is that while "[l]aboratory tests have broad applicability for translational research ... EHR-based research using laboratory data have been challenging because of their diversity and the lack of standardization of reporting laboratory test results." They add[11]:

Despite the great potential of EHR data, patient phenotyping from EHRs is still challenging because the phenotype information is distributed in many EHR locations (laboratories, notes, problem lists, imaging data, etc.) and since EHRs have vastly different structures across sites. This lack of integration represents a substantial barrier to widespread use of EHR data in translational research.

The answer to the clinical and laboratory interoperability question is unclear. A 2019 article in the American Association for Clinical Chemistry's CLN Stat addressed remaining roadblocks, including lack of standards development, data quality issues, clinical data matching, lack of incentivizing health IT optimization, text-based reporting formats, differences in terminology, and HL7 messaging issues. They add that proposals from the Office of the National Coordinator for Health Information Technology (ONC) and the Centers for Medicare and Medicaid Services include possible fixes such as standardized application programming interfaces (API). They also note that middleware may pick up the slack in connecting more laboratory devices, rather than depending on the LIS to handle all the interfacing.[12] On a more positive note, the Office of the National Coordinator for Health Information Technology (ONC) updated its Interoperability Standards Advisory (ISA) Vocabulary/Code Set/Terminology page in November to better "highlight critical public health interoperability needs on COVID-19 in an easily accessible way." Replying to the ONC, HIMSS's Senior Director Jeff Coughlin goes on to add[13]:

There is a growing need to consider data exchange for home settings and considerations around device interoperability. There are a number of applications in use and this setting requires work across a number of systems (emergency medical services, hospital electronic health records, telemedicine system [synchronous and asynchronous] and, remote patient monitoring and device management). ISA should provide guidance on specific standards to assist in exchange with this setting."

Even so, it remains obvious that more work needs to be done in the development and standard use of clinical and laboratory informatics applications if the promise of personalized medicine and the need for improved disease testing and response are to be fulfilled. In particular, how we responsibly protect personal health information while putting its anonymized variants to beneficial use for disease testing and prevention remains a critical question that must be solved in order to better prepare for the next COVID-19.

References

  1. Healthcare Information and Management Systems Society (2020). "Interoperability in Healthcare". Healthcare Information and Management Systems. https://www.himss.org/resources/interoperability-healthcare. Retrieved 28 April 2020. 
  2. Kun, L.; Coatrieux, G.; Quantin, C. et al. (2008). "Improving outcomes with interoperable EHRs and secure global health information infrastructure". Studies in Health Technology and Informatics 137: 68–79. PMID 18560070. 
  3. Global Center for Health Innovation (21 November 2024). "Improving Patient Care through Interoperability" (PDF). Global Center for Health Innovation. http://s3.amazonaws.com/rdcms-himss/files/production/public/Improving-Patient-Carethrough-Interoperability.pdf. Retrieved 17 September 2021. 
  4. 4.0 4.1 National Academies of Sciences, Engineering, and Medicine (2015). "Chapter 5: Technology and Tools in the Diagnostic Process". Improving Diagnosis in Health Care. The National Academies Press. pp. 217–62. doi:10.17226/21794. ISBN 9780309377720. https://www.nap.edu/read/21794/chapter/7. 
  5. Maxmen, A. (2020). "Thousands of coronavirus tests are going unused in US labs". Nature 580 (7803): 312–13. doi:10.1038/d41586-020-01068-3. PMID 32273619. 
  6. John3504 (7 December 2011). "HL7 Interface cost and maintenance". Spiceworks. https://community.spiceworks.com/topic/175107-hl7-interface-cost-and-maintenance. Retrieved 25 April 2020. 
  7. Ausiello, D.; Shaw, S. (2014). "Quantitative Human Phenotyping: The Next Frontier in Medicine". Transactions of the American Clinical and Climatological Association 125: 219–26. PMC PMC4112685. PMID 25125736. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4112685. 
  8. Edwards, R.R.; Dworkin, R.H.; Turk, D.C. et al. (2016). "Patient phenotyping in clinical trials of chronic pain treatments: IMMPACT recommendations". Pain 157 (9): 1851–71. doi:10.1097/j.pain.0000000000000602. PMC PMC5965275. PMID 27152687. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5965275. 
  9. Mousavizadeh, L.; Ghasemi, S. (2020). "Genotype and phenotype of COVID-19: Their roles in pathogenesis". Journal of Microbiology, Immunology, and Infection: 30082-7. doi:10.1016/j.jmii.2020.03.022. PMC PMC7138183. PMID 32265180. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7138183. 
  10. Gattinoni, L.; Chiumello, D.; Caironi, P. (2020). "COVID-19 pneumonia: Different respiratory treatments for different phenotypes?". Intensive Care Medicine. doi:10.1007/s00134-020-06033-2. PMC PMC7154064. PMID 32291463. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7154064. 
  11. 11.0 11.1 Zhang, X.A.; Yates, A.; Vasilevsky, N. et al. (2019). "Semantic integration of clinical laboratory tests from electronic health records for deep phenotyping and biomarker discovery". npj Digital Medicine 2: 32. doi:10.1038/s41746-019-0110-4. PMC PMC6527418. PMID 31119199. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6527418. 
  12. American Association for Clinical Chemistry (21 February 2019). "Strengthening the Chain of Interoperability". CLN Stat. https://www.aacc.org/cln/cln-stat/2019/february/21/strengthening-the-chain-of-interoperability. Retrieved 17 September 2021. 
  13. Coughlin, J.. "COVID-19 Novel Coronavirus Pandemic". ISA - Vocabulary/Code Set/Terminology. Office of the National Coordinator. Archived from the original on 10 November 2020. https://web.archive.org/web/20201110225342/https://www.healthit.gov/isa/covid-19. Retrieved 17 September 2021.