Difference between revisions of "Laboratory information system"

From LIMSWiki
Jump to navigationJump to search
m (Grammar)
 
(One intermediate revision by the same user not shown)
Line 95: Line 95:
3. An LIS was usually most competitive in patient-centric settings (dealing with "subjects" and "specimens") and clinical labs, whereas a LIMS was most competitive in group-centric settings (dealing with "batches" and "samples") that often deal with mostly anonymous research-specific laboratory data.<ref name="analytica" /><ref name="lislims2">{{cite web |url=http://labsoftnews.typepad.com/lab_soft_news/2008/11/lis-vs-lims.html |title=LIS vs. LIMS: Some New Insights |author=Friedman, B. |work=Lab Soft News |date=19 November 2008 |accessdate=14 March 2024}}</ref><ref name="starlims">{{cite web |url=http://blog.starlims.com/2009/07/01/swimming-in-the-clinical-pool-why-lims-are-supplanting-old-school-clinical-lis-applications/ |archiveurl=https://web.archive.org/web/20110313145726/http://blog.starlims.com/2009/07/01/swimming-in-the-clinical-pool-why-lims-are-supplanting-old-school-clinical-lis-applications/ |title=Swimming in the Clinical Pool: Why LIMS are supplanting old-school clinical LIS applications |author=Hice, R. |publisher=STARLIMS Corporation |date=01 July 2009 |archivedate=13 March 2011 |accessdate=14 March 2024}}</ref>
3. An LIS was usually most competitive in patient-centric settings (dealing with "subjects" and "specimens") and clinical labs, whereas a LIMS was most competitive in group-centric settings (dealing with "batches" and "samples") that often deal with mostly anonymous research-specific laboratory data.<ref name="analytica" /><ref name="lislims2">{{cite web |url=http://labsoftnews.typepad.com/lab_soft_news/2008/11/lis-vs-lims.html |title=LIS vs. LIMS: Some New Insights |author=Friedman, B. |work=Lab Soft News |date=19 November 2008 |accessdate=14 March 2024}}</ref><ref name="starlims">{{cite web |url=http://blog.starlims.com/2009/07/01/swimming-in-the-clinical-pool-why-lims-are-supplanting-old-school-clinical-lis-applications/ |archiveurl=https://web.archive.org/web/20110313145726/http://blog.starlims.com/2009/07/01/swimming-in-the-clinical-pool-why-lims-are-supplanting-old-school-clinical-lis-applications/ |title=Swimming in the Clinical Pool: Why LIMS are supplanting old-school clinical LIS applications |author=Hice, R. |publisher=STARLIMS Corporation |date=01 July 2009 |archivedate=13 March 2011 |accessdate=14 March 2024}}</ref>


However, these distinctions began to fade somewhat in the early 2010s as some LIMS vendors began to adopt the case-centric information management normally reserved for an LIS, blurring the lines between the two components further.<ref name="starlims" /> [[Thermo Scientific]]'s Clinical LIMS was an example of this merger of the LIS with LIMS, with Dave Champagne, informatics vice president and general manager, stating: "Routine molecular diagnostics requires a convergence of the up-to-now separate systems that have managed work in the lab (the LIMS) and the clinic (the LIS). The industry is asking for, and the science is requiring, a single lab-centric solution that delivers patient-centric results."<ref name="ConvergeLimsLis">{{cite web |url=https://clpmag.com/lab-essentials/information-technology/convergence-of-lims-and-lis/ |title=Convergence of LIMS and LIS |author=Tufel, G. |work=Clinical Lab Products |publisher=MEDQOR |date=01 February 2012 |accessdate=14 March 2024}}</ref> [[Abbott Informatics Corporation]]'s STARLIMS product was another example of this LIS/LIMS merger.<ref name="StarlimsLimsLis" /> With the distinction between the two entities becoming less clear, discussions within the laboratory informatics community began to includes the question of whether or not the two entities should be considered the same.<ref name="LinkedInDifLisLims">{{cite web |url=https://www.linkedin.com/feed/update/urn:li:groupPost:2069898-98494737/ |title=What is the difference between a LIS and a LIMS? |author=Jones, J. |publisher=LinkedIn |date=March 2012 |accessdate=13 March 2024}}</ref><ref name="LinkedInLisLimsSame">{{cite web |url=http://www.linkedin.com/groups/Are-LIMS-LIS-same-thing-2069898.S.147132083 |title=Are LIMS and LIS the same thing? |author=Jones, John |publisher=LinkedIn |date=September 2012 |accessdate=07 November 2012}}{{Dead link}}</ref> {{As of|2024}}, vendors continue to recognize the historical differences between the two products while also continuing to acknowledge that some developed LIMS are taking on more of the clinical aspects usually reserved for a LIS.<ref name="AgilabFAQ">{{cite web |url=http://agilab.com/faq/ |archiveurl=https://web.archive.org/web/20190325075813/http://agilab.com/faq/ |title=FAQ: What is the difference between a LIMS and a medical laboratory quality system? |publisher=AgiLab SAS |archivedate=25 March 2019 |accessdate=13 March 2024}}</ref><ref name="ReisenwitzWhatIs17">{{cite web |url=https://www.capterra.com/resources/what-is-a-laboratory-information-management-system/ |title=What Is a Laboratory Information Management System? |author=Reisenwitz, C. |work=Capterra Medical Software Blog |publisher=Capterra, Inc |date=11 May 2017 |accessdate=13 March 2024}}</ref><ref name="CloudLISDifference16">{{cite web |url=https://cloudlims.com/lims-vs-lis/ |title=LIS vs LIMS: Uncover the Difference & Choose the Right Informatics Solution |publisher=CloudLIMS.com, LLC |date=12 October 2023 |accessdate=13 March 2024}}</ref>
However, these distinctions began to fade somewhat in the early 2010s as some LIMS vendors began to adopt the case-centric information management normally reserved for an LIS, blurring the lines between the two components further.<ref name="starlims" /> [[Vendor:Thermo Scientific|Thermo Scientific]]'s Clinical LIMS was an example of this merger of the LIS with LIMS, with Dave Champagne, informatics vice president and general manager, stating: "Routine molecular diagnostics requires a convergence of the up-to-now separate systems that have managed work in the lab (the LIMS) and the clinic (the LIS). The industry is asking for, and the science is requiring, a single lab-centric solution that delivers patient-centric results."<ref name="ConvergeLimsLis">{{cite web |url=https://clpmag.com/lab-essentials/information-technology/convergence-of-lims-and-lis/ |title=Convergence of LIMS and LIS |author=Tufel, G. |work=Clinical Lab Products |publisher=MEDQOR |date=01 February 2012 |accessdate=14 March 2024}}</ref> [[Vendor:Abbott Informatics Corporation|Abbott Informatics Corporation]]'s STARLIMS product was another example of this LIS/LIMS merger.<ref name="StarlimsLimsLis" /> With the distinction between the two entities becoming less clear, discussions within the laboratory informatics community began to includes the question of whether or not the two entities should be considered the same.<ref name="LinkedInDifLisLims">{{cite web |url=https://www.linkedin.com/feed/update/urn:li:groupPost:2069898-98494737/ |title=What is the difference between a LIS and a LIMS? |author=Jones, J. |publisher=LinkedIn |date=March 2012 |accessdate=13 March 2024}}</ref><ref name="LinkedInLisLimsSame">{{cite web |url=http://www.linkedin.com/groups/Are-LIMS-LIS-same-thing-2069898.S.147132083 |title=Are LIMS and LIS the same thing? |author=Jones, John |publisher=LinkedIn |date=September 2012 |accessdate=07 November 2012}}{{Dead link}}</ref> {{As of|2024}}, vendors continue to recognize the historical differences between the two products while also continuing to acknowledge that some developed LIMS are taking on more of the clinical aspects usually reserved for a LIS.<ref name="AgilabFAQ">{{cite web |url=http://agilab.com/faq/ |archiveurl=https://web.archive.org/web/20190325075813/http://agilab.com/faq/ |title=FAQ: What is the difference between a LIMS and a medical laboratory quality system? |publisher=AgiLab SAS |archivedate=25 March 2019 |accessdate=13 March 2024}}</ref><ref name="ReisenwitzWhatIs17">{{cite web |url=https://www.capterra.com/resources/what-is-a-laboratory-information-management-system/ |title=What Is a Laboratory Information Management System? |author=Reisenwitz, C. |work=Capterra Medical Software Blog |publisher=Capterra, Inc |date=11 May 2017 |accessdate=13 March 2024}}</ref><ref name="CloudLISDifference16">{{cite web |url=https://cloudlims.com/lims-vs-lis/ |title=LIS vs LIMS: Uncover the Difference & Choose the Right Informatics Solution |publisher=CloudLIMS.com, LLC |date=12 October 2023 |accessdate=13 March 2024}}</ref>


==Regulations, standards, and best practices affecting LIS development and use==
==Regulations, standards, and best practices affecting LIS development and use==

Latest revision as of 22:15, 4 April 2024

Hospitals and labs around the world depend on a laboratory information system to manage and report patient data and test results.

A laboratory information system (LIS) is a software system that records, manages, and stores data for clinical laboratories. An LIS has traditionally been most adept at sending laboratory test orders to lab instruments, tracking those orders, and then recording the results, typically to a searchable database.[1] The standard LIS has supported the operations of public health institutions (like hospitals and clinics) and their associated labs by managing and reporting critical data concerning "the status of infection, immunology, and care and treatment status of patients."[2]

History of the LIS

Advances in computational technology in the early 1960s led some to experiment with time and data management functions in the healthcare setting. Company Bolt Beranek Newman and the Massachusetts General Hospital worked together to create a system that "included time-sharing and multiuser techniques that would later be essential to the implementation of the modern LIS."[3] At around the same time General Electric announced plans to program a hospital information system (HIS), though those plans eventually fell through.[4]

Aside from the Massachusetts General Hospital experiment, the idea of a software system capable of managing time and data management functions wasn't heavily explored until the late 1960s, primarily because of the lack of proper technology and of communication between providers and end-users. The development of the Massachusetts General Hospital Utility Multi-Programming System (MUMPS) in the mid-'60s certainly helped as it suddenly allowed for a multi-user interface and a hierarchical system for persistent storage of data.[3] Yet due to its advanced nature, fragmented use across multiple entities, and inherent difficulty in extracting and analyzing data from the database, development of healthcare and laboratory systems on MUMPS was sporadic at best.[4] By the 1980s, however, the advent of Structured Query Language (SQL), relational database management systems (RDBMS), and Health Level 7 (HL7) allowed software developers to expand the functionality and interoperability of the LIS, including the application of business analytics and business intelligence techniques to clinical data.[5]

In the early 2010s, web-based and database-centric internet applications of laboratory informatics software changed the way researchers and technicians interacted with data, with web-driven data formatting technologies like Extensible Markup Language (XML) making LIS and electronic medical record (EMR) interoperability a much-needed reality.[6] SaaS and cloud computing technologies have since further changed how the LIS is implemented, while at the same time raising new questions about security and stability.[3]

The modern LIS has evolved to take on new functionalities not previously seen, including configurable clinical decision support rules, system integration, laboratory outreach tools, and support for point-of-care testing (POCT) data. LIS modules have also begun to show up in EMR and EHR products, giving some laboratories the option to have an enterprise-wide solution that can cover multiple aspects of the lab.[7] Additionally, the distinction between an LIS and a laboratory information management system (LIMS) has blurred somewhat, with some vendors choosing to use the "LIMS" acronym to market their clinical laboratory data management system.

Purpose and functionality

An LIS is a software solution designed to allow end users to better manage a wide variety of operational and quality management aspects of the academic, government, and commercial clinical laboratories appearing in and around public, private, and mobile healthcare facilities. The reasons for adopting an LIS and other laboratory informatics solutions varies by laboratory, but a December 2019 survey by Medical Laboratory Observer, consisting of 273 respondents, is somewhat revealing of the common purposes for adopting an LIS. Ninety-five percent of respondents indicated they use it to streamline their electronic order entry and result management, with medical data connectivity being the second most popular use. Automation tools, customer relationship management, scheduling, inventory management, revenue management, quality management, and reporting were all also mentioned as important to users.[8] When asked to select from five choices (or provide some other reason) in regard to what their top priority was in selecting an LIS, respondents indicated that their most important priority was providing data analysis mechanisms for all types of pathology, followed by multi-lab interoperability, integration with electronic medical records (EMRs), flexible laboratory management functionality, and real-time automated inventory management.[8]

These responses help paint a picture of what a LIS can do, but there's definitely more to it. Through regulatory, market, patient, and technological pressures, many laboratories have decided that increasingly digitizing the laboratory makes sense in its efforts towards greater compliance, competitiveness, patient outcomes, and efficiency.[9][10] An LIS deployment primarily focuses on specimen and patient management, data acquisition, and reporting activities; however, its scope can expand much further depending on the scientific discipline (e.g., clinical vs. anatomic pathology) or role the lab plays (e.g., commercial clinical diagnostics vs. government public health).

LIS functionality

An LIS can have a complex list of features, or it may have minimal functionality. Software developers with competent and experienced personnel usually do well with a collection of the required base features, plus any industry-specific features a laboratory may need. But not all developers get it right. The following is a list of LIS functionality that is considered by a variety of experts to be vital to almost any clinical diagnostic or research laboratory.[11][12][13][14]

Test, experiment, and patient management

  • specimen log-in and management, with support for unique IDs
  • batching support
  • barcode and RFID support
  • specimen tracking
  • clinical decision support, including test ordering tools and duplicate test checks
  • custom test management
  • event and instrument scheduling
  • templates, forms, and data fields that are configurable
  • analytical tools, including data visualization, trend analysis, and data mining features
  • data import and export
  • robust query tools
  • document and image management
  • project and experiment management
  • workflow management
  • patient management
  • case management
  • physician and supplier management

Quality, security, and compliance

  • quality assurance / quality control mechanisms, including tracking of nonconformance
  • data normalization and validation
  • results review and approval
  • version control
  • user qualification, performance, and training management
  • audit trails and chain of custody support
  • configurable and granular role-based security
  • configurable system access and use (log-in requirements, account usage rules, account locking, etc.)
  • electronic signature support
  • configurable alarms and alerts
  • data encryption and secure communication protocols
  • data archiving and retention support
  • configurable data backups
  • environmental monitoring and control

Operations management and reporting

  • customizable rich-text reporting, with multiple supported output formats
  • synoptic reporting
  • industry-compliant labeling
  • email integration
  • internal messaging system
  • revenue management
  • instrument interfacing and data management
  • instrument calibration and maintenance tracking
  • inventory and reagent management
  • third-party software and database interfacing
  • mobile device support
  • voice recognition capability
  • results portal for external parties
  • integrated (or online) system help
  • configurable language

Discipline-specific LIS

Through the early 2010s, the laboratory information system had been roughly segmented into two broad categories (though other variations existed): the clinical pathology and anatomic pathology LIS.[15][16][17]

In clinical pathology the chemical, hormonal, and biochemical components of body fluids are analyzed and interpreted to determine if a disease is present, while anatomic pathology tends to focus on the analysis and interpretation of a wide variety of tissue structures, from small slivers via biopsy to complete organs from a surgery or autopsy.[18] These differences may appear to be small, but the differentiation in laboratory workflow of these two medical specialties led to the creation of different functionalities within LISs. Specimen collection, receipt, and tracking; work distribution; and report generation varies—sometimes significantly—between the two types of labs, requiring targeted functionality in the LIS.[17][19] Other differences among these two disciplines include[3]:

  • Specific dictionary-driven tests are found in clinical pathology environments but not so much in anatomic pathology environments.
  • Ordered anatomic pathology tests typically require more information than clinical pathology tests.
  • A single anatomic pathology order may be comprised of several tissues from several organs; clinical pathology orders usually do not.
  • Anatomic pathology specimen collection may be a very procedural, multi-step process, while clinical pathology specimen collection is routinely more simple.

Over time, the LIS has evolved to address a wide variety of other clinical disciplines, including toxicology, blood banking, molecular diagnostics, public health and epidemiology, and clinical research. Each has their own set of analyses, workflows, operational requirements, and regulatory considerations[20], in turn requiring specialty functionality in an LIS to address the needs of each. Examples include support for stain panels and histology worksheets in pathology, supporting surge capacity for high-priority analyses in public health, providing medication-based compliance monitoring and interpretive reporting for toxicology, and allowing for electronic crossmatch of human-based medical products in blood banking and transfusion.[21]

Differences between an LIS and a LIMS

There is often confusion regarding the difference between an LIS and a LIMS. While the two laboratory informatics components are related, their purposes diverged early in their existences. Up until recently, the LIS and LIMS have historically exhibited a few key differences[22]:

1. An LIS was traditionally designed primarily for processing and reporting data related to individual patients in a clinical setting. A LIMS was traditionally designed to process and report data related to batches of samples from drug trials, water treatment facilities, and other entities that handle complex batches of data.[23][24]

2. An LIS would need to satisfy the reporting and auditing needs of hospital accreditation agencies, HIPAA, and other clinical medical practitioners. A LIMS, however, would need to satisfy good manufacturing practice (GMP) and meet the reporting and audit needs of the U.S. Food and Drug Administration and research scientists in many different industries.[23]

3. An LIS was usually most competitive in patient-centric settings (dealing with "subjects" and "specimens") and clinical labs, whereas a LIMS was most competitive in group-centric settings (dealing with "batches" and "samples") that often deal with mostly anonymous research-specific laboratory data.[24][25][26]

However, these distinctions began to fade somewhat in the early 2010s as some LIMS vendors began to adopt the case-centric information management normally reserved for an LIS, blurring the lines between the two components further.[26] Thermo Scientific's Clinical LIMS was an example of this merger of the LIS with LIMS, with Dave Champagne, informatics vice president and general manager, stating: "Routine molecular diagnostics requires a convergence of the up-to-now separate systems that have managed work in the lab (the LIMS) and the clinic (the LIS). The industry is asking for, and the science is requiring, a single lab-centric solution that delivers patient-centric results."[27] Abbott Informatics Corporation's STARLIMS product was another example of this LIS/LIMS merger.[22] With the distinction between the two entities becoming less clear, discussions within the laboratory informatics community began to includes the question of whether or not the two entities should be considered the same.[28][29] As of 2024, vendors continue to recognize the historical differences between the two products while also continuing to acknowledge that some developed LIMS are taking on more of the clinical aspects usually reserved for a LIS.[30][31][32]

Regulations, standards, and best practices affecting LIS development and use

A LIS' development and use is affected by regulations, standards, and best practices such as:

  • 21 CFR Part 11 Electronic records; Electronic signature: Regulated clinical-focused labs—particularly medical research labs—are expected to comply with U.S. Food and Drug Administration (FDA) regulations like 21 CFR Part 11, which address matters of software validation, data integrity, data retention, audit trails, signed records, and secured access to data. These matters pertain to software systems like the LIS, as well as other systems employed in modern clinical laboratories.[33][34][35]
  • ASTM E1578 Standard Guide for Laboratory Informatics: This standard is geared towards a variety of stakeholders having some sort of professional interest in laboratory informatics. It intends to educate on and recommend approaches to laboratory software development, acquisition, implementation, and maintenance, including as how they relate to an LIS.[36]
  • Clinical Laboratory Improvement Amendments (CLIA): These U.S.-based clinical laboratory requirements affect clinical laboratories at many touch points, designed to better ensure that analytical testing is accurate, precise, and timely. Software systems like the LIS can help these labs better meet CLIA requirements and goals towards quality. The LIS designed with CLIA requirements in mind should also be able to assist with the documentation and audit-readiness required for CLIA compliance.[37]
  • Good clinical laboratory practice (GCLP): GCLP takes good laboratory practice (GLP)— a quality- and data-driven approach to ensuring the safety, consistency, high quality, and reliability of developed and produced goods—and adds clinical elements found in CLIA, as well as from the College of American Pathologists (CAP) and the International Organization for Standardization's (ISO's) ISO 15189 standard (below).[38] The objective behind them is "of providing a single, unified document that encompasses [investigational new drug] sponsor requirements to guide the conduct of laboratory testing for human clinical trials."[38] GCLP has many touch points with an LIS, from workflow requirements to how a LIS is used.[38]
  • ISO/CAP 15189 Medical laboratories — Requirements for quality and competence: ISO 15189 specifies quality management approaches to clinical laboratory settings. It pulls inspiration from ISO/IEC 17025 while acknowledging the unique characteristics and needs of the clinical lab. The standard's requirements on laboratory need for addressing cybersecurity, system validation, and more apply directly to LMS development and implementation.[39] Additional takes on ISO 15189 can be seen in CAP's CAP 15189 Accreditation Program, which delves into more granular detail of clinical laboratory work, looking at how specific tests are ran and their quality ensured through specific proficiency testing processes, whereas ISO 15189 "seeks to inform the processes from a broad perspective."[40] Even labs providing clinical trials research services have begun turning to ISO/CAP 15189 accreditation, affecting their operations and the informatics systems they choose to employ.[40]

See also

Further reading

References

  1. "Laboratory Information Systems". Biohealthmatics.com. Biomedical Informatics Ltd. 10 August 2006. Archived from the original on 06 January 2020. https://web.archive.org/web/20180106000403/http://www.biohealthmatics.com/technologies/his/lis.aspx. Retrieved 13 March 2024. 
  2. "Quick Start Guide to Laboratory Information System (LIS) Implementation" (PDF). Association of Public Health Laboratories. October 2005. Archived from the original on 19 September 2017. https://web.archive.org/web/20170919184029/https://www.aphl.org/MRC/Documents/GH_2005Oct_LIS-Quick-Start-Guide.pdf. Retrieved 13 March 2024. 
  3. 3.0 3.1 3.2 3.3 Park, S.L.; Pantanowitz, L.; Sharma, G.; Parwani, A.V. (2012). "Anatomic Pathology Laboratory Information Systems: A Review". Advances in Anatomic Pathology 19 (2): 81–96. doi:10.1097/PAP.0b013e318248b787. 
  4. 4.0 4.1 Blum, B.I.; Duncan, K.A. (1990). A History of Medical Informatics. ACM Press. pp. 141–53. ISBN 9780201501287. https://books.google.com/books/about/A_History_of_medical_informatics.html?id=AR5rAAAAMAAJ. 
  5. Sinard, J.H. (2006). Practical Pathology Informatics: Demstifying Informatics for the Practicing Anatomic Pathologist. Springer. pp. 393. ISBN 0387280588. https://books.google.com/books?id=WerUyK618fcC. 
  6. Kumar, S.; Aldrich, K. (2011). "Overcoming barriers to electronic medical record (EMR) implementation in the US healthcare system: A comparative study". Health Informatics Journal 16 (4). doi:10.1177/1460458210380523. 
  7. Futrell, K. (23 January 2017). "What's new in today's LIS?". Medical Laboratory Observer. NP Communications, LLC. https://www.mlo-online.com/continuing-education/article/13009013/whats-new-in-todays-lis. Retrieved 13 March 2024. 
  8. 8.0 8.1 Silva, B. (19 December 2019). "IT solutions in the clinical lab". Medical Laboratory Observer. https://www.mlo-online.com/information-technology/article/21117759/it-solutions-in-the-clinical-lab. Retrieved 18 November 2021. 
  9. "2022 Laboratory Informatics: Progress Snapshot on Enabling the Digital Lab of the Future" (PDF). Astrix Technology, LLC. June 2022. pp. 18–23. https://astrixinc.com/wp-content/uploads/2022/06/Progress-Snapshot-on-Enabling-the-Digital-Lab-of-the-Future-v4a.pdf. Retrieved 12 March 2024. 
  10. Liscouski, J. (July 2023). "1. Introduction to LIMS and its acquisition and deployment". In Douglas, S.E.. Justifying LIMS Acquisition and Deployment within Your Organization. LIMSwiki. https://www.limswiki.org/index.php/LII:Justifying_LIMS_Acquisition_and_Deployment_within_Your_Organization/Introduction_to_LIMS_and_its_acquisition_and_deployment. Retrieved 13 March 2024. 
  11. Association of Public Health Laboratories (May 2019). "Laboratory Information Systems Project Management: A Guidebook for International Implementations" (PDF). APHL. https://www.aphl.org/aboutAPHL/publications/Documents/GH-2019May-LIS-Guidebook-web.pdf. Retrieved 13 March 2024. 
  12. Kyobe, S.; Musinguzi, H.; Lwanga, N. et al. (2017). "Selecting a Laboratory Information Management System for Biorepositories in Low- and Middle-Income Countries: The H3Africa Experience and Lessons Learned". Biopreservation and Biobanking 15 (2): 111–15. doi:10.1089/bio.2017.0006. PMC PMC5397240. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5397240. 
  13. List, M.; Schmidt, S.; Trojnar, J. et al. (2014). "Efficient sample tracking with OpenLabFramework". Scientific Reports 4: 4278. doi:10.1038/srep04278. PMC PMC3940979. PMID 24589879. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3940979. 
  14. Splitz, A.R.; Balis, U.J.; Friedman, B.A. et al. (20 September 2013). "LIS Functionality Assessment Toolkit". Association for Pathology Informatics. Archived from the original on 01 August 2021. https://web.archive.org/web/20210801175420/https://www.pathologyinformatics.org/toolkit.php. Retrieved 13 March 2024. 
  15. Pantanowitz, L.; Henricks, W.H.; Beckwith, B.A. (2007). "Medical Laboratory Informatics". Clinics in Laboratory Medicine 27 (4): 823–43. doi:10.1016/j.cll.2007.07.011. 
  16. "Medical laboratory informatics". ClinfoWiki. 19 November 2011. http://clinfowiki.org/wiki/index.php/Medical_laboratory_informatics. Retrieved 13 March 2024. 
  17. 17.0 17.1 Henricks, W.H. (9 October 2012). "LIS Basics: CP and AP LIS Design and Operations" (PDF). Pathology Informatics 2012. University of Pittsburgh. Archived from the original on 10 September 2015. https://web.archive.org/web/20150910050825/http://www.pathinformatics.pitt.edu/sites/default/files/2012Powerpoints/01HenricksTues.pdf. Retrieved 13 March 2024. 
  18. Adelman, H.C. (2009). Forensic Medicine. Infobase Publishing. pp. 3–4. ISBN 1438103816. https://books.google.com/books?id=x5FftcZOv1UC&pg=PA3. Retrieved 13 March 2024. 
  19. Clifford, L.-J. (1 August 2011). "The evolving LIS needs to be "everything" for today's laboratories". Medical Laboratory Observer. NP Communications, LLC. https://www.mlo-online.com/home/article/13004085/the-evolving-lis-needs-to-be-everything-for-todays-laboratories. Retrieved 13 March 2024. 
  20. Douglas, S.E. (January 2022). "1. Introduction to medical diagnostics and research laboratories". Laboratory Informatics Buyer's Guide for Medical Diagnostics and Research. LIMSwiki. https://www.limswiki.org/index.php/LII:Laboratory_Informatics_Buyer%27s_Guide_for_Medical_Diagnostics_and_Research/Introduction_to_medical_diagnostics_and_research_laboratories. Retrieved 13 March 2024. 
  21. Douglas, S.E.; Vaughn, A. (January 2022). "2. Choosing laboratory informatics software for your lab". Laboratory Informatics Buyer's Guide for Medical Diagnostics and Research. LIMSwiki. https://www.limswiki.org/index.php/LII:Laboratory_Informatics_Buyer%27s_Guide_for_Medical_Diagnostics_and_Research/Choosing_laboratory_informatics_software_for_your_lab. Retrieved 13 March 2024. 
  22. 22.0 22.1 "Adding "Management" to Your LIS". STARLIMS Corporation. 2012. Archived from the original on 28 April 2014. https://web.archive.org/web/20140428060811/http://www.starlims.com/en-us/resources/white-papers/lis-vs-lims/. Retrieved 14 March 2024. 
  23. 23.0 23.1 Friedman, B. (4 November 2008). "LIS vs. LIMS: It's Time to Blend the Two Types of Lab Information Systems". Lab Soft News. http://labsoftnews.typepad.com/lab_soft_news/2008/11/liss-vs-limss-its-time-to-consider-merging-the-two-types-of-systems.html. Retrieved 14 March 2024. 
  24. 24.0 24.1 "LIMS/LIS Market and POCT Supplement". analytica-world.com. 20 February 2004. https://www.analytica-world.com/en/news/35566/lims-lis-market-and-poct-supplement.html. Retrieved 14 March 2024. 
  25. Friedman, B. (19 November 2008). "LIS vs. LIMS: Some New Insights". Lab Soft News. http://labsoftnews.typepad.com/lab_soft_news/2008/11/lis-vs-lims.html. Retrieved 14 March 2024. 
  26. 26.0 26.1 Hice, R. (1 July 2009). "Swimming in the Clinical Pool: Why LIMS are supplanting old-school clinical LIS applications". STARLIMS Corporation. Archived from the original on 13 March 2011. https://web.archive.org/web/20110313145726/http://blog.starlims.com/2009/07/01/swimming-in-the-clinical-pool-why-lims-are-supplanting-old-school-clinical-lis-applications/. Retrieved 14 March 2024. 
  27. Tufel, G. (1 February 2012). "Convergence of LIMS and LIS". Clinical Lab Products. MEDQOR. https://clpmag.com/lab-essentials/information-technology/convergence-of-lims-and-lis/. Retrieved 14 March 2024. 
  28. Jones, J. (March 2012). "What is the difference between a LIS and a LIMS?". LinkedIn. https://www.linkedin.com/feed/update/urn:li:groupPost:2069898-98494737/. Retrieved 13 March 2024. 
  29. Jones, John (September 2012). "Are LIMS and LIS the same thing?". LinkedIn. http://www.linkedin.com/groups/Are-LIMS-LIS-same-thing-2069898.S.147132083. Retrieved 07 November 2012. [dead link]
  30. "FAQ: What is the difference between a LIMS and a medical laboratory quality system?". AgiLab SAS. Archived from the original on 25 March 2019. https://web.archive.org/web/20190325075813/http://agilab.com/faq/. Retrieved 13 March 2024. 
  31. Reisenwitz, C. (11 May 2017). "What Is a Laboratory Information Management System?". Capterra Medical Software Blog. Capterra, Inc. https://www.capterra.com/resources/what-is-a-laboratory-information-management-system/. Retrieved 13 March 2024. 
  32. "LIS vs LIMS: Uncover the Difference & Choose the Right Informatics Solution". CloudLIMS.com, LLC. 12 October 2023. https://cloudlims.com/lims-vs-lis/. Retrieved 13 March 2024. 
  33. "CFR - Code of Federal Regulations Title 21, Part 11 Electronic Records; Electronic Signatures". U.S. Food and Drug Administration. 22 December 2023. https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfCFR/CFRSearch.cfm?CFRPart=11&showFR=1. Retrieved 12 March 2024. 
  34. "ICH GCP and FDA 21 CFR Part 11 Compliance Statements" (PDF). Dynacare. April 2017. https://www.dynacare.ca/DYN/media/DYN/eng/ICH_GCP-and-FDA-21-CFR-Part-11-Compliance-Statement.pdf. Retrieved 14 March 2024. 
  35. "Whitepaper: FDA's 21 CFR Part 11" (PDF). Labforward GmbH. January 2020. https://labfolder.com/wp-content/uploads/2020/01/Labfolder-CFR21-Part11-Whitepaper.docx-2.pdf. Retrieved 12 March 2024. 
  36. "ASTM E1578-18 Standard Guide for Laboratory Informatics". ASTM International. 23 August 2019. https://www.astm.org/e1578-18.html. Retrieved 13 March 2024. 
  37. Futrell, K. (23 January 2023). "Leveraging LIS tools to keep your lab inspection-ready". Medical Laboratory Observer. https://www.mlo-online.com/information-technology/lis/article/21292910/leveraging-lis-tools-to-keep-your-lab-inspection-ready. Retrieved 14 March 2024. 
  38. 38.0 38.1 38.2 Ezzelle, J.; Rodriguez-Chavez, I.R.; Darden, J.M.; Stirewalt, M.; Kunwar, N.; Hitchcock, R.; Walter, T.; D'Souza, M.P. (1 January 2008). "Guidelines on good clinical laboratory practice: Bridging operations between research and clinical research laboratories" (in en). Journal of Pharmaceutical and Biomedical Analysis 46 (1): 18–29. doi:10.1016/j.jpba.2007.10.010. PMC PMC2213906. PMID 18037599. https://linkinghub.elsevier.com/retrieve/pii/S0731708507005754. 
  39. Ilinca, Radu; Chiriac, Ionuț A.; Luțescu, Dan A.; Ganea, Ionela; Hristodorescu-Grigore, Smaranda; Dănciulescu-Miulescu, Rucsandra-Elena (1 April 2023). "Understanding the key differences between ISO 15189:2022 and ISO 15189:2012 for an improved medical laboratory quality of service" (in en). Revista Romana de Medicina de Laborator 31 (2): 77–82. doi:10.2478/rrlm-2023-0011. ISSN 2284-5623. https://www.sciendo.com/article/10.2478/rrlm-2023-0011. 
  40. 40.0 40.1 Dawson, J. (13 August 2019). "Navigating ISO 15189 for US Laboratories". Omni-Assistant Software. https://blog.omni-assistant.net/en/posts/navigating-iso-15189-for-us-laboratories. Retrieved 14 March 2024.