User:Shawndouglas/sandbox/sublevel2

Sandbox begins below

The intention of this document is 1. to assist labs searching for a laboratory informatics product with identifying their system needs and 2. to help labs better determine if a specific vendor/product meets their requirements in the form of a request for information (RFI). The idea is to allow users to incorporate a standardized specifications sheet in their comparison of various laboratory informatics products.

This questionnaire lists the extensive requirements of an electronic laboratory notebook (ELN). It attempts to be comprehensive and includes many items that do not apply to every lab. Additionally, some laboratories' requirements include a functionality item not common to other labs. The last section, 1.5 "Custom functions," is designed for the vendor to insert any additional functionality that doesn't fall under the categories provided.

When referencing a particular item for someone else, use the section number followed by the requirement letter, e.g. 1.4.2.a for "The system architecture is modular or extensible and can easily and efficiently be modified to facilitate the addition of new functionality as business needs change."

Requirement code and notes

In responding to each requirement, the vendor must select a requirement code from the following:

• Y: Meets requirement in commercial off-the-shelf solution as delivered/configured (or vendor provides service)
• YC: Meets requirement only with customization (additional code, using a third-party application, etc.)
• N: Does not meet requirement
• I: Informational response only, N/A

The vendor should ideally enter a requirement code and a response for each functionality question.

Printing or saving

The print/export options in the navigation on the far left give you a few options for saving this and other pages, printing them for later.

Note: Tables are currently not being rendered in PDFs as we like through the MediaWiki Collection extension. While we sure would love for you to make a PDF of this document, be warned: the tables don't format as intended, using either the "Create a book" or "Download as PDF" processes. For now you're best off selecting "Printable version" and printing that instead.

1.0 Vendor information

1.0 Vendor information Company name Physical address Website LIMSwiki web page Contact name and title Contact e-mail Contact phone and fax Years in business

1.1 Vendor services

1.1 Vendor services Request for information Requirement code Vendor response a. The vendor offers an online and/or on-site demonstration. b. The vendor provides a detailed project plan that includes the project team, timeline, deliverables, and risk and issue management procedures. c. The vendor explains their overall project approach, deliverables, time constraints, and any other criteria for the project. d. The vendor provides reliable cost estimates and pricing schedules, including all products and services in the scope of work. e. The vendor details the amount of time and staff that the purchaser will have to provide for the implementation process. f. The vendor can explain the maintenance and support offered during and after implementation, including times and methods of availability, issue escalation and management, etc. g. The vendor provides a support schedule for the implementation process, including optional support levels, their function, and availability. h. The vendor provides support during the "go-live" period between system validation/operational deployment and final acceptance/beginning of maintenance and support agreements. i. The vendor provides a gap analysis after initial system installation, identifying the deliverables or tasks remaining. j. The vendor provides a table linking each deliverable to the corresponding user requirement specification it fulfills. k. The vendor uses a consistent training methodology for educating new users. l. The vendor supplies ELN-specific training program curricula. m. The vendor provides user, administrator, developer, installation, and reference manuals. n. The vendor provides design qualification documentation. o. The vendor provides installation qualification documentation. p. The vendor provides operation qualification documentation. q. The vendor provides performance qualification documentation during implementation. r. The vendor provides well-documented system upgrades that authorized users can independently install. s. The vendor provides source code for the system. t. The vendor provides an optional comprehensive set of test codes suitable for use by the purchaser.

1.2 Information technology

1.2.1 General IT 1.2.1 General IT Request for information Requirement code Vendor response a. The system operates with a traditional client-server architecture, with software installed on each machine that needs to access the system. b. The system operates with a web-based interface, hosted on a server and accessed via a web browser on most any machine. c. The system contains a single, centralized database that supports multiple sites and departments. d. The system's database conforms to the Open Database Connectivity Standard (ODBC). e. The system is designed so upgrades to the back-end database do not require extensive reconfiguration or effectively cripple the system. f. The system is designed to not be impacted by multiple users or failover processes. g. The system applies security features to all system files. h. The system applies log-in security to all servers and workstations accessing it. i. The system provides a workstation and server authentication mechanism. j. The system applies Secured Socket Layer (SSL) encryption on the web client interface. k. The system encrypts client passwords in a database, with support for multi-case and special characters. l. The system uses TCP/IP as its network transport. m. The system allows automated backup and restore capability without support intervention, as well as manual backups. n. The system maintains the transactional history of system administrators. 1.2.2 Hardware environment 1.2.2 Hardware environment Request for information Requirement code Vendor response a. The system proves compatible with a variety of hardware environments. b. The system can be utilized with a touch-screen. 1.2.3 Software environment 1.2.3 Software environment Request for information Requirement code Vendor response a. The system proves compatible with a variety of software environments. b. The system utilizes a non-proprietary database such as Oracle or Microsoft SQL Server.

1.3 Regulatory compliance and security

1.3.1 Regulatory compliance 1.3.1 Regulatory compliance Request for information Requirement code Vendor response a. The system supports 21 CFR Part 11 requirements, including log-in security, settable automatic logouts, periodic requirements for mandatory password changes, limits on reusability of passwords, and full electronic signature. b. The system supports the requirements of 37 CFR rules like 1.671, 41.152, and 41.207. c. The system supports the requirements of Federal Rules of Evidence (FRE) like Rule 803 and 901. d. The system supports HIPAA requirements. e. The system supports GALP and/or GAMP standards. f. The system meets government requirements for handling classified information and documents. g. The system maintains date- and time-stamped audit trails of all data manipulation — such as changes to results, data analysis parameters, and methods — as consistent with all applicable regulations and standards, making the information available for review, copying, and reporting to authorized users. h. The system audit log retains all data, prohibits any deletions, and allows user comments. i. The system provides additional persistent auditing capabilities, such as the audit of cancelled tests and scheduled system functions. j. The system provides the ability to both automatically and manually add secure electronic signature to documents and other data. k. The system provides the option of a double signature scheme for the purpose of patent protection. l. The system keeps all data and its format intact and captures modifications of that data as a version, including date and time of those modifications, for regulatory purposes. m. The system can automatically validate and approve data prior to being moved to the main database. 1.3.2 Security 1.3.2 Security Request for information Requirement code Vendor response a. The system allows administrators and other authorized users to configure multiple levels of user rights and security by site location, department, group, role, and/or specific function. b. The system allows administrators and users to reset user passwords. c. The system features and enforces adjustable rules concerning password complexity, reuse, and expiration. d. The system can lock a user out after a specified number of consecutive failed log-in attempts. e. The system provides the option for automatic user logout based on keyboard or mouse inactivity. f. The system makes authority checks to ensure only authorized individuals can use the system to perform an operation. g. The system allows authorized users to modify records, while also maintaining an audit trail of such actions. h. The system allows authorized users to manually delete records, while also maintaining an audit trail of such actions. i. The system prompts users to declare a reason for making changes to or deleting data in the system. j. The system allows authorized users to generate a detailed user access record. k. The system provides email notification of lockout, security access, and improper workstation access. l. The system provides a mechanism to allow a user read-only access to stored data. m. The system allows automatic and/or manual holds or locks to be placed on data to ensure it goes unaltered or remains retrievable during a retention period. n. The system can first feed data from connected non-CFR-compliant instruments through a virtual environment that is compliant (audit trailed, secure, versioned, etc.) before being stored. o. The system can control whether users are able to export data to portable long-term storage media like a USB flash drive or recordable DVD. p. The system employs automatic file encryption on stored data. q. The system employs checks to enforce permitted sequencing of steps and events.

1.4 General system functions

1.4.1 General functions 1.4.1 General functions Request for information Requirement code Vendor response a. The system offers non-ELN trained personnel the ability to easily access system data via an intuitive, user-friendly Windows-type graphical user interface (GUI) which permits the display of stored data. b. The system allows authorized users to configure their GUI to a specific language, character set, and time zone. c. The system permits remote access for users, system admins, and support agents? d. The system allows for the use of navigation keys to freely move from field to field. e. The system allows data tables to be sorted. f. The system can send on-screen output to a printer or file without contradicting view-only statuses. g. The system supports multiple users and instruments entering data simultaneously, without disruption. h. The system contains one or more spell-check dictionaries that allow authorized users to add, edit, or remove entries. i. The system integrates chemical drawing and computational tools. j. The system includes a synthesis sheet parser and generator. k. The system allows the import of chemical structure and spectroscopic files? l. The system provides full metadata, keyword, and field search capability, including the use of multiple search criteria. m. The system allows for advanced queries of molecular patterns and properties, like those associated with the SMARTS language. n. The system permits users to query by functional group or designed structure. o. The system allows users to build, save, and edit queries for future use. p. The system includes the ability to search and import from multiple databases, including those containing legacy data. q. The system provides data archival and retention functionality for both paper-based and electronic laboratory records, effectively maintaining the archives as technology changes. r. The system allows bookmarking of pages, images, experiments, and other content. s. The system notifies users of events like the scheduling and completion of tasks. t. The system includes the ability to set up alerts via email. u. The system supports scheduling of tasks like analysis requests, instrument maintenance, and group meetings. v. The system has real-time messaging capabilities for experiment and project collaborators. w. The system supports the use of a voice recognition system (for navigation or transcription) or has that functionality. x. The system offers integrated or online user help screens. 1.4.2 Configuration and customization 1.4.2 Configuration and customization Request for information Requirement code Vendor response a. The system architecture is modular or extensible and can easily and efficiently be modified to facilitate the addition of new functionality as business needs change. b. The system has an application programming interface (API) or a similar software development toolkit (SDK). If web-based, the API should support Simple Object Access Protocol (SOAP), representational state transfer (REST), or both. c. The system supports customized screens with user-definable information specific to a customer, department, analysis, etc. d. The system allows a user to independently add fields without requiring reconfiguration of the system, even after routine upgrades and maintenance. e. The system permits users to create personal and sharable experiment templates. f. The system allows for the integration of additional printers and scanners both locally and externally. 1.4.3 Pre-experiment 1.4.3 Receiving and scheduling Request for information Requirement code Vendor response a. The system supports barcoded sample labeling and tracking. b. The system provides compound and batch registration. c. The system provides extensive experiment management tools to create, manage, and run single-step, multi-step, and other types of experiments. d. The system provides tools for making advanced chemical calculations, including stoichiometric, titration, and reaction yield calculations. e. The system allows editing of biological sequences at the molecular level. f. The system allows the creation of searchable image annotations. 1.4.4 Post-experiment 1.4.4 Analysis and data entry Request for information Requirement code Vendor response a. The system can manage and store both sample- and non-sample-related data, including images from microscopes, GCMS scans of peaks, PDF files, spreadsheets, or even raw data files from instrument runs for later processing. b. The system can manage and store media objects like digital photos, bitmaps, movies, and audio files. o. The system can link objects to other objects, e.g. linking a specification to an experimental result. k. Does your system provide a searchable repository for user notebooks present and past? h. Can your system process text-to-structure conversions automatically? g. The system can process automated uploading of field-derived sample data. o. Does your system allow file transfer of data from instruments via intelligent interfaces or multi-sample/multi-test ASCII files, with full on-screen review prior to database commitment? p. Does your system permit manual data entry into an electronic worksheet of test measurements and results? q. Does your system allow incorrectly inputted data to be manually corrected? r. Does your system provide colored visual indication of previously entered data as well as new data associated with a single sample when a result is entered, with the indicator changing color if the value is out of specification? s. Does your system allow automated or semi-automated data insertion? t. Does your system store non-narrative textual results in searchable fields? 1.4.5 Post-analysis and validation 1.4.5 Post-analysis and validation Request for information Requirement code Vendor response a. Does your system update sample/item status when tests are completed? b. Can your system automatically reorder a test or order additional tests if results don't meet lab-defined criteria? c. Does your system read results from previously entered tests to calculate a final result and immediately display the calculated result? d. Does your system allow authorized users to review all analytical results, including pricing, spec violations, history or trend analysis by analyte, and comments? e. Can your system graphically display the results of one or more tests in a graph (normalized or otherwise) for the purpose of visualizing data or searching for possible trends? f. Does your system allow on-screen review of the stored test result, diluted result with corrected method detection limits (MDLs), and qualifiers after running samples for multiple dilutions as in gas chromatography–mass spectrometry (GC-MS)? g. Does your system display the standard operating procedure (SOP) associated with each test result to ensure proper techniques were used? h. Does your system store test-related analysis comments with the test? i. Does your system provide auto-commenting for common laboratory result comments? j. Does your system provide for high-volume multi-component transfers of test results, with the ability to automatically match samples to data files in either a backlog mode or a designated file mode, to parse the data, and to review and commit the sample data? k. Does your system's results validation process access all information about a sample or group of samples, including comments or special information about the sample? l. Does your system's results validation process check each result against its individual sample location specifications (both warning and specification limits)? m. Does your system support validation at the analysis and sample level, while also prohibiting sample validation when analysis validation is incomplete? n. Does your system use a menu-driven process for results validation? o. Does your system provide secure electronic peer review of results? p. Can your system clearly differentiate released preliminary data from fully validated results? q. Does your system validate/approve data prior to being moved to the main database? r. Does your system fully manage all aspects of laboratory quality control, including the reporting and charting of all quality control data captured in the lab? Please explain how. s. Does your system provide a base for a quality assurance program, including proficiency testing, scheduled maintenance of equipment, etc.? Please explain how. t. Does your system distinguish QA/QC duplicates from normal samples? u. Does your system allow QA/QC tests to be easily created and associated with the primary analytical test? v. Does your system allow manual entry of QA and QC data not captured as part of the system's regular processes? w. Does your system calculate monthly QA/QC percentages for testing? x. Does your system automatically flag out-of-range quality control limits? y. Does your system check data files for specification and corrects them for specific reporting and analyte limits and qualifiers like dilution factor, automatically assigning qualifiers based on project analyte limiting? 1.4.6 Instruments 1.4.6 Instruments Request for information Requirement code Vendor response a. Does your system bilaterally interface with instruments and related software? If so, please provide details. b. Can your system download data directly from laboratory instruments? c. Does your system permit the defining and exporting of sequences to instruments? d. Does your system track and report on laboratory equipment usage? e. Does your system allow automatic or manual reservation/scheduling of laboratory instruments? f. Does your system automatically (or manually allow an authorized user to) remove an instrument from potential use when it falls out of tolerance limit or requires scheduled calibration? g. Does your system provide a database of preventative maintenance, calibration, and repair records for laboratory equipment, preferably supported by standardized reporting? h. Can your system schedule calibration, verification, and maintenance tasks in the worksheets or work flow process and make that schedule available for viewing? i. Does your system allow users to create and edit instrument maintenance profiles? 1.4.7 External system interfaces 1.4.7 External system interfaces Request for information Requirement code Vendor response a. Does your system support a library of common and/or basic electronic data deliverable (EDD) formats? If so, which? b. Can your system transfer data to and from another record management system? If so, how? c. Does your system integrate with Microsoft Exchange services? d. Can your system import data from and export data to Microsoft Word, Excel, and/or Access? e. Can your system interface with non-Microsoft programs? If so, which? f. Can your system interface with external billing systems? If so, how? g. Can your system interface with enterprise resource planning (ERP) systems? If so, how? h. Can your system interface with external contract or reference laboratories to electronically send or retrieve datasheets, analysis reports, and other related information? i. Can your system exchange data with National Identification System (NAIS) tracking systems? j. Can your system generate and exchange data with other systems using Health Level 7 (HL7) standards? k. Can your system leverage the application programming interface (API) of other systems to establish integration between systems? l. Does your system provide a real-time interface for viewing live and stored data transactions and errors generated by interfaced instruments and systems? m. Can your system transmit status changes of samples, inventory, equipment, etc. to an external system? n. Can your system direct output from ad-hoc queries to a computer file for subsequent analysis by other software? o. Does your system support the manual retransmission of data to interfaced systems? p. Does your system support dockable mobile devices and handle information exchange between them and the system? q. Does your system support the use of optical character recognition (OCR) software? 1.4.8 Reporting 1.4.8 Reporting Request for information Requirement code Vendor response a. Does your system include a versatile report writer and forms generator that can generate reports from any data in tables? If so, please provide details. b. Does your system include a custom graphic generator for forms? c. Does your system interface with a third-party reporting application? d. Does your system allow the development of custom templates for different types of reports? e. Does your system maintain template versions and renditions, allowing management and tracking of the template over time? f. Can your system generate template letters for semi-annual reports? g. Does your system support report queries by fields/keys, status, completion, or other variables? h. Does your system use Microsoft Office tools for formatting reports? i. Does your system support multiple web browsers for viewing online reports? If so, list which ones. j. Can your system generate, store, reproduce, and display laboratory, statistical, and inventory reports on demand, including narrative? k. Does your system include several standard reports and query routines to access all samples with the pending status through a backlog report that includes the following criteria: all laboratory, department, analysis, submittal date, collection date, prep test complete, location, project, sample delivery group, and other user-selectable options? l. Can your system indicate whether a report is preliminary, amended, corrected, or final while retaining revision history? m. Does your system support both structured and synoptic reporting? n. Can your system generate management and turn-around time reports and graphs? o. Can your system generate customized final reports? p. Can your system automatically generate laboratory reports of findings and other written documents? q. Can your system automatically generate individual and aggregate workload and productivity reports on all operational and administrative activities? r. Can your system automatically generate and transmit exception trails and exception reports for all entered and/or stored out-of-specification data? s. Can your system generate a read-only progress report that allows for printed reports of sample status and data collected to date? t. Does your system provide an ad-hoc web reporting interface to report on user-selected criteria? u. Can your system automatically generate and update control charts? v. Can your system generate QA/QC charts for all recovery, precision, and lab control samples via a full statistics package, including Levy-Jennings plots and Westgard multi-rule? w. Does your system display history of previous results for an analyte's sample point in a tabular report, graphic trend chart, and statistical summary? x. Can your system automatically generate and post periodic static summary reports on an internal web server? y. Does your system transmit results in a variety of ways including fax, e-mail, print, and website in formats like RTF, PDF, HTML, XML, DOC, XLS, and TXT? Please explain. z. Does your system electronically transmit results via final report only when all case reviews have been completed by the case coordinator? aa. Does your system include a rules engine to determine the recipients of reports and other documents based on definable parameters? ab. Does your system allow database access using user-friendly report writing and inquiry tools? 1.4.9 Laboratory management 1.4.9 Laboratory management Request for information Requirement code Vendor response d. Does your system provide multi-lab management tools? a. Does your system allow the creation, modification, and duplication of user profiles? b. Does your system allow entry, maintenance, and administration of customers, suppliers, and other outside entities? c. Does your system allow the creation, modification, and maintenance of user training records and associated training materials? d. Does your system allow the management of information workflow, including notifications for requests and exigencies? e. Does your system allow the management of documents like SOPs, MSDS, etc. to better ensure they are current and traceable? f. Does your system allow the management and monitoring of resources by analyst, priority, analysis, and instrument? g. Does your system allow authorized persons to select and assign tasks by analysts, work group, instrument, test, sample, and priority? h. Does your system allow authorized persons to review unassigned work by discipline and by lab? i. Does your system allow authorized persons to review pending work by analyst prior to assigning additional work? j. Does your system manage and report on reference samples, reagents, and other inventory, including by department? If so, to what extent? k. Does your system automatically warn specified users when inventory counts reach a definable threshold and either prompt for or process a reorder? l. Does your system allow authorized users to monitor and report on reference and reagent creation, use, and expiration? m. Does your system allow authorized users to search invoice information by invoice number, account number, accession, payment types, client, or requested diagnostic test(s)? n. Does your system include performance assessment tracking? o. Can your system receive, record, and maintain customer and employee feedback and apply tools to track the investigation, resolution, and success of any necessary corrective action? p. Does your system monitor proficiency test assignment, completion, and casework qualification for analytical staff? q. Does your system provide analysis tools to better support laboratory functions like resource planning, productivity projections, workload distribution, and work scheduling? Do those tools display information in a consolidated view, with the ability to drill down to more detailed data? Please explain. r. Does your system calculate administrative and lab costs? s. Does your system capture and maintain patient, submitter, supplier, and other client demographics and billing information for costing, invoicing, collecting, reporting, and other billing activities? t. Does your system support multiple customer payment sources (e.g. grants}? Please explain the extent. u. Does your system track number of visits per specific industry?

1.5 System-specific

The system-specific addendum can be found here.

1.6 Industry-specific

The industry-specific addendum can be found here.

1.7 Custom requirements

1.7 Custom requirements Request for information Requirement code Vendor response a. b. c. d. e. f. g. h. i. h. i. j.