|
|
| (234 intermediate revisions by the same user not shown) |
| Line 3: |
Line 3: |
| | type = notice | | | type = notice |
| | style = width: 960px; | | | style = width: 960px; |
| | text = This is sublevel2 of my sandbox, where I play with features and test MediaWiki code. If you wish to leave a comment for me, please see [[User_talk:Shawndouglas|my discussion page]] instead.<p></p> | | | text = This is sublevel9 of my sandbox, where I play with features and test MediaWiki code. If you wish to leave a comment for me, please see [[User_talk:Shawndouglas|my discussion page]] instead.<p></p> |
| }} | | }} |
|
| |
|
| ==Sandbox begins below== | | ==Sandbox begins below== |
| {{Infobox journal article
| |
| |name =
| |
| |image =
| |
| |alt = <!-- Alternative text for images -->
| |
| |caption =
| |
| |title_full = The development and application of bioinformatics core competencies to improve bioinformatics training and education
| |
| |journal = ''PLOS Computational Biology''
| |
| |authors = Mulder, Nicola; Schwartz, Russell; Brazas, Michelle, D.; Brooksbank, Carth; Gaeta, Bruno; Morgan, Sarah L.;<br />Pauley, Mark A.; Rosenwald, Anne; Rustici, Gabriella; Sierk, Michael; Warnow, Tandy; Welch, Lonnie
| |
| |affiliations = University of Cape Town, Carnegie Mellon University, Ontario Institute for Cancer Research, Wellcome Genome Campus, University of New South Wales, University<br />of Nebraska at Omaha, Georgetown University, University of Cambridge, Saint Vincent College, University of Illinois at Urbana-Champaign, Ohio University
| |
| |contact = Email: nicola dot mulder at uct dot ac dot za
| |
| |editors =
| |
| |pub_year = 2018
| |
| |vol_iss = '''14'''(2)
| |
| |pages = e1005772
| |
| |doi = [http://10.1371/journal.pcbi.1005772 10.1371/journal.pcbi.1005772]
| |
| |issn = 1553-7358
| |
| |license = [http://creativecommons.org/licenses/by/4.0/ Creative Commons Attribution 4.0 International]
| |
| |website = [http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005772 http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005772]
| |
| |download = [http://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1005772&type=printable http://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1005772&type=printable] (PDF)
| |
| }}
| |
| {{ombox
| |
| | type = content
| |
| | style = width: 500px;
| |
| | text = This article should not be considered complete until this message box has been removed. This is a work in progress.
| |
| }}
| |
| ==Abstract==
| |
| [[Bioinformatics]] is recognized as part of the essential knowledge base of numerous career paths in biomedical research and healthcare. However, there is little agreement in the field over what that knowledge entails or how best to provide it. These disagreements are compounded by the wide range of populations in need of bioinformatics training, with divergent prior backgrounds and intended application areas. The Curriculum Task Force of the International Society of Computational Biology (ISCB) Education Committee has sought to provide a framework for training needs and curricula in terms of a set of bioinformatics core competencies that cut across many user personas and training programs. The initial competencies developed based on surveys of employers and training programs have since been refined through a multiyear process of community engagement. This report describes the current status of the competencies and presents a series of use cases illustrating how they are being applied in diverse training contexts. These use cases are intended to demonstrate how others can make use of the competencies and engage in the process of their continuing refinement and application. The report concludes with a consideration of remaining challenges and future plans.
| |
|
| |
| ==Introduction==
| |
| The need for bioinformatics education and training is immense, but it is also diverse. There is a wide range of audiences who are potential recipients of training, each of which has different needs in terms of what skills or knowledge they require and at what depth. For example, someone training to be a bioinformatics engineer (which we define as someone who will actively be involved in the development and application of bioinformatics algorithms) requires in-depth knowledge of existing algorithms, how they work, how to critically evaluate them, and how to interpret the results. By contrast, a bioinformatics user (which we define as someone making use of bioinformatics resources in an applied context, such as in medical practice) would need a basic level of understanding of the methods and a stronger focus on the interpretation of the outputs. In a recent publication<ref name="WelchApplying16">{{cite journal |title=Applying, Evaluating and Refining Bioinformatics Core Competencies (An Update from the Curriculum Task Force of ISCB's Education Committee) |journal=PLOS Computational Biology |author=Welch, L.; Brooksban, C.; Schwartz, R. et al. |volume=12 |issue=5 |page=e1004943 |year=2016 |doi=10.1371/journal.pcbi.1004943 |pmid=27175996 |pmc=PMC4866758}}</ref>, the ISCB Education Committee’s Curriculum Task Force described the potential for refinement and application of bioinformatics core competencies for different user groups. Here, we describe the further refinement of these competencies and provide a series of use cases illustrating their applications to different bioinformatics education and training programs globally.
| |
|
| |
| ==Development of core competencies for bioinformatics==
| |
| The ISCB Curriculum Task Force undertook the task of identifying some of the breadth of needs for bioinformatics education, as described in a series of reports from the task force. This effort arose first from a series of surveys of current training practice and desired training needs<ref name="WelchAReport12">{{cite journal |title=A report of the Curriculum Task Force of the ISCB Education Committee |journal=PLOS Computational Biology |author=Welch, L.R.; Schwartz, R.; Lewitter, F. |volume=8 |issue=6 |page=e1002570 |year=2012 |doi=10.1371/journal.pcbi.1002570 |pmid=22761560 |pmc=PMC3386154}}</ref>, which identified a set of broad categories of training needs but also widespread disparities across programs in what was taught, how, and for what intended target audiences. An outcome of these surveys was the need for identifying a set of core competencies as broad categories of skills and training that cross different programs and training needs and that can provide a basis for discussing similarities and differences between programs and desired outcomes. This led to a further effort to define a set of initial core competencies<ref name="WelchBioinformatics14">{{cite journal |title=Bioinformatics curriculum guidelines: toward a definition of core competencies |journal=PLOS Computational Biology |author=Welch, L.; Lewitter, F; Schwartz, R. et al. |volume=10 |issue=3 |page=e1003496 |year=2014 |doi=10.1371/journal.pcbi.1003496 |pmid=24603430 |pmc=PMC3945096}}</ref> that in turn led to an intensive program of community engagement to refine these competencies to better serve the breadth of needs of the bioinformatics training community.
| |
|
| |
| There were three major steps in the development of the core competencies: (1) defining the competencies needed for using bioinformatics, (2) defining a variety of user profiles describing distinct subgroups in need of training, and (3) defining how the competencies will apply to each user profile (scoring). The core competency framework was developed through an iterative process with input from multiple parties from diverse backgrounds with a connection to bioinformatics. In order to gain a broader appreciation of which competencies the bioinformatics community considers relevant for different bioinformatics user profiles, the ISCB Curriculum Task Force has run several competency workshops (discussion sessions for defining the competencies and their applications) both at ISCB conferences and at other bioinformatics education venues such as the GOBLET (Global Organisation for Bioinformatics Learning, Education and Training) Annual General Meeting. Each iteration of a competency workshop has greatly enhanced not only the competencies themselves but also the definitions of the user profiles<ref name="WelchApplying16" /> and the competency-use case scoring mechanism.
| |
|
| |
| Initially, the mapping of bioinformatics competencies to audiences considered three major user profiles: (1) the bioinformatics user; (2) the bioinformatics scientist; and (3) the bioinformatics engineer. Early competency workshops quickly surmised that these user profiles were too narrow and did not adequately capture the breadth of roles requiring bioinformatics competency and curriculum. Participants spent much of the workshop time defining a bioinformatics user or distinguishing a bioinformatics scientist from a bioinformatics engineer. The use case roles were subsequently expanded to better embody the breadth of bioinformatics users, including physicians, lab technicians, ethicists and biocurators, scientists (which include the discovery biologist, academic bioinformatics researcher, and core facility scientist), and engineers (which may be a bioinformatician in academia, bioinformatician in research institute, or software engineer). This change allowed for subsequent workshop participants to self-select according to the category of user with which they most identified.
| |
|
| |
| With user profiles better defined, competency workshops then struggled with the competencies themselves and their definitions. Several early competency definitions appeared to overlap. For example, “Apply knowledge of computing appropriate to the discipline (e.g., effectively utilize bioinformatics tools)” closely resembled “Analyze a problem and identify and define the computing requirements appropriate to its solution (e.g., define algorithmic time and space complexities and hardware resources required to solve a problem).” Workshop participants helped to reduce the redundancy in our initial set of bioinformatics competencies from 20 competencies to a refined set of 16 competencies.
| |
|
| |
| Competency workshops have additionally helped to revise the scoring of competencies for each user profile. Early workshops scored the applicability of a bioinformatics competency to a particular profile with a simple yes/no response, which did not allow for an appreciation of the depth of the competency necessary for a given profile. Such a scoring approach, while better than no score, would not be helpful when developing a curriculum for a specific user profile. Subsequent workshops used a graded scoring approach, with grades ranging from 1 (no competency required) to 4 (specialist knowledge required). This, too, proved too ambiguous to allow for meaningful discussion and classification. The scoring approach was thus revised again to the current model, which uses the Bloom’s Revised Taxonomy<ref name="AndersonATax01">{{cite book |title=A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives |editor=Anderson, L.W.; Krathwohl, D.R. |publisher=Pearson |pages=336 |year=2001 |isbn=9780801319037}}</ref> terms: knowledge, comprehension, application, analysis, synthesis, and evaluation. While the use of Bloom’s Taxonomy has been useful in mapping competency levels to each of the user profiles, this change required refinement of the competency list as several of the earlier competencies incorporated Bloom’s Taxonomy terms.
| |
|
| |
| Overall, competency workshops have been invaluable to the enhancement and refinement of the bioinformatics competencies. Through these workshops, the ISCB Curriculum Task Force has been able to construct a useful set of bioinformatics competencies that curriculum developers can use to develop, compare, and assess impactful bioinformatics training programs for a wide range of audiences and ultimately help establish bioinformatics skills in such audiences.<ref name="WelchBioinformatics14" />
| |
|
| |
| Table 1 reports the current state of the competencies developed and refined through this community engagement process. Tables 2–4 map these refined competencies to a broader set of personas, suggested over the course of the Task Force’s community engagement efforts, via Bloom’s Taxonomy terms. For reference, Table 5 provides examples and definitions of the Bloom's Revised Taxonomy terms. In the next section, we provide some examples of how the competencies have been applied in a variety of training contexts.
| |
|
| |
|
| | [[File:|right|500px]] |
|
| |
|
| [[File:Tab1 Mulder PLOSCompBio2018 14-2.png|800px]]
| | '''Title''': ''LIMS Selection Guide for Materials Testing Laboratories'' |
| {{clear}}
| |
| {|
| |
| | STYLE="vertical-align:top;"|
| |
| {| border="0" cellpadding="5" cellspacing="0" width="800px"
| |
| |-
| |
| | style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Table 1.''' Bioinformatics core competencies. This table provides the current competency list following a process of community engagement. It specifically reflects a significant refinement of the competencies designed to accommodate scoring in terms of Bloom’s Taxonomy.</blockquote>
| |
| |-
| |
| |}
| |
| |}
| |
|
| |
|
| [[File:Tab2 Mulder PLOSCompBio2018 14-2.png|900px]]
| | '''Edition''': First Edition |
| {{clear}}
| |
| {|
| |
| | STYLE="vertical-align:top;"|
| |
| {| border="0" cellpadding="5" cellspacing="0" width="900px"
| |
| |-
| |
| | style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Table 2.''' Mapping of competencies to bioinformatics user personas via Bloom’s Taxonomy</blockquote>
| |
| |-
| |
| |}
| |
| |}
| |
|
| |
|
| [[File:Tab3 Mulder PLOSCompBio2018 14-2.png|900px]]
| | '''Author for citation''': Shawn E. Douglas |
| {{clear}}
| |
| {|
| |
| | STYLE="vertical-align:top;"|
| |
| {| border="0" cellpadding="5" cellspacing="0" width="900px"
| |
| |-
| |
| | style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Table 3.''' Mapping of competencies to bioinformatics scientist personas via Bloom’s Taxonomy</blockquote>
| |
| |-
| |
| |}
| |
| |}
| |
|
| |
|
| [[File:Tab4 Mulder PLOSCompBio2018 14-2.png|900px]] | | '''License for content''': [https://creativecommons.org/licenses/by-sa/4.0/ Creative Commons Attribution-ShareAlike 4.0 International] |
| {{clear}}
| |
| {|
| |
| | STYLE="vertical-align:top;"|
| |
| {| border="0" cellpadding="5" cellspacing="0" width="900px"
| |
| |-
| |
| | style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Table 4.''' Mapping of competencies to bioinformatics engineer personas via Bloom’s Taxonomy</blockquote>
| |
| |-
| |
| |}
| |
| |}
| |
|
| |
|
| [[File:Tab5 Mulder PLOSCompBio2018 14-2.png|900px]]
| | '''Publication date''': ??? 2023 |
| {{clear}}
| |
| {|
| |
| | STYLE="vertical-align:top;"|
| |
| {| border="0" cellpadding="5" cellspacing="0" width="900px"
| |
| |-
| |
| | style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Table 5.''' Bloom’s revised Taxonomy. The table provides, for each term, illustrative examples of skills demonstrating the given level of competency and a general definition.</blockquote>
| |
| |-
| |
| |}
| |
| |}
| |
|
| |
|
| ==Use cases==
| |
| To better illustrate the use of the competencies, we present here a series of brief use cases—scenarios in which the competencies have proven valuable already in defining, refining, or assessing a bioinformatics training mechanism. These use cases were selected to highlight a diverse set of training needs, user personas, types of training programs, and educational settings. In this spirit, we present examples grouped into three categories: (1) complete degree programs for which the competencies have proven valuable to overall curriculum design or refinement; (2) supplements to existing degree programs (i.e., specializations, tracks, certificates); and (3) training resources outside the context of specific degree programs.
| |
|
| |
|
| ===Degree programs===
| | Description goes here... |
| ====Introductory and masters bioinformatics training in Africa: H3ABioNet====
| |
| H3ABioNet (www.h3abionet.org), a Pan African bioinformatics network for H3Africa<ref name="MulderH3ABioNet16">{{cite journal |title=H3ABioNet, a sustainable pan-African bioinformatics network for human heredity and health in Africa |journal=Genome Research |author=Mulder, N.J.; Adebiyi, E.; Alami, R. et al. |volume=26 |issue=2 |pages=271-7 |year=2016 |doi=10.1101/gr.196295.115 |pmid=26627985 |pmc=PMC4728379}}</ref>, has developed a bioinformatics training program for African scientists from the Human Heredity and Health in Africa (www.h3africa.org) consortium. This involves bioinformatics training for a broad range of audiences, primarily in [[genomics]] [[data analysis]], and the development of new bioinformatics degrees to train bioinformatics scientists. Though there are some institutions in Africa offering bioinformatics postgraduate degrees, this was limited to a handful of countries, and many additional institutions expressed a desire to develop and offer such degrees in order to build the next generation of bioinformatics academics. An African Bioinformatics Education Committee was established along with a Curriculum Task Force, which set about designing a bioinformatics master’s program. Topic areas were selected from existing master’s courses and those proposed by Welch ''et al.''.<ref name="WelchBioinformatics14" /> From these, core modules were defined and augmented with additional elective modules relevant to specific institutions, based on their research priorities. The Curriculum Task Force then fleshed out the detailed content of each module and started mapping these to core competencies required of a bioinformatics specialist. Though the focus of some master’s programs may vary from the more biological to a stronger emphasis on software engineering, there were common competencies with which all bioinformatics master’s graduates should be equipped. While some African institutions have specific research focus areas, the feeling was that all students training to be bioinformaticians should be exposed to a set of core subjects, which are in line with the ISCB’s recommendations, and the elective subjects then tend to be dependent on the research focus. The proposed curriculum has been put into practice, with at least two universities in Africa starting their first master’s programs in the last two years.
| |
|
| |
|
| For bioinformatics users, H3ABioNet has successfully run several specialist short courses to train researchers on next generation sequence analysis, metagenomics, genome-wide association studies, and other topics. However, through interactions with users, there emerged a need for more basic “introduction to bioinformatics” training. In response, H3ABioNet developed an Introduction to Bioinformatics course delivered remotely to classrooms across multiple countries. The curriculum was derived primarily from topics used for the master’s courses, but this time mapping it to competencies for bioinformatics users and removing topics with a modelling or programming focus. The competencies for this audience are thus more focused on a basic understanding of the topic, example algorithms, and how the tools can be applied to answer biological questions. The practicals are also designed to enable users to navigate their way through the tools and learn to interpret the outputs. This course was run successfully for the first time in 2016 and was assessed to determine whether the required core competencies were acquired.
| | The table of contents for ''LIMS Selection Guide for Materials Testing Laboratories'' is as follows: |
|
| |
|
| Using core competencies for both cases described above enabled course organizers to better define the detailed content, contact hours, and focus for each module, based on the intended audience. We could also use the competencies to define learning outcomes and refine module assessments.
| | :[[User:Shawndouglas/sandbox/sublevel10|1. Introduction to materials and materials testing laboratories]] |
| | ::1.1 Materials testing labs, then and now |
| | :::1.1.1 Materials testing 2.0 |
| | ::1.2 Industries, products, and raw materials |
| | ::1.3 Laboratory roles and activities in the industry |
| | :::1.3.1 R&D roles and activities |
| | :::1.3.2 Pre-manufacturing and manufacturing roles and activities |
| | :::1.3.3 Post-production quality control and regulatory roles and activities |
|
| |
|
| ====Undergraduate and graduate degree programs in a U.S. research university: Computational biology education at Carnegie Mellon====
| | :[[User:Shawndouglas/sandbox/sublevel11|2. Standards, regulations, and test methods affecting materials testing labs]] |
| Carnegie Mellon University has long been active in education in computational biology and bioinformatics, providing several opportunities for considering how a general set of competencies can apply to diverse populations. These experiences include degree programs in computational biology at several levels, including a bachelor's of science (BS) in computational biology (since 1989), a masters of science (MS) in computational biology (since 1999), a doctorate (PhD) in computational biology (offered jointly with the University of Pittsburgh since 2005), and required training in computational biology as part of the core of the BS in biological sciences, the university's general undergraduate biology major. While all of these programs predate the ISCB competencies, the competencies provide a basis for considering how well these programs prepare students for work involving computational biology to differing degrees. Two of these programs—the BS in biological sciences and the PhD in computational biology—are discussed as examples of programs with very different student populations and training needs that can be evaluated in light of the competencies.
| | ::2.1 Globally recognized materials manufacturing standards |
| | :::2.1.1 American Society of Civil Engineers (ASCE) materials standards |
| | :::2.1.2 ASTM International Volume 15.04 |
| | :::2.1.3 Canadian Standards Association (CSA) A3000 series |
| | :::2.1.4 International Organization for Standardization (ISO) 10993 |
| | :::2.1.5 Metal Powder Industries Federation (MPIF) Standard 35 family |
| | ::2.2 Regulations and laws around the world |
| | :::2.2.1 21 CFR Part 175 and 176 - United States |
| | :::2.2.2 Building Standard Law - Japan |
| | :::2.2.3 The Furniture and Furnishings (Fire) (Safety) Regulations 1988 - United Kingdom |
| | :::2.2.4 National Environment Protection (Used Packaging Materials) Measure 2011 - Australia |
| | :::2.2.5 Surface Coating Materials Regulations (SOR/2016-193) - Canada |
| | ::2.3 Standardized test methods for materials |
| | ::2.4 Materials laboratory accreditation |
| | :::2.4.1 A note about engineering and construction materials testing |
|
| |
|
| Carnegie Mellon's BS in biological sciences illustrates one kind of bioinformatics training: for students primarily training for work in experimental biology. Carnegie Mellon took the still unusual step in 2013 of making Introduction to Computational Biology (ICB) a core requirement of every undergraduate biological sciences major, providing an opportunity to explore how one would design a class to be accessible but rigorous and useful to a population of general biology students. Applying these competencies, then, requires working in the context of students who are typically taking a single class on computational biology but within a full undergraduate biology curriculum. Some competencies, primarily those focused on technical aspects of computational biology, can be covered reasonably well at the level needed by an experimental biologist within a single computational biology class (C,D,F,I,J; see Table 1). Other important areas, such as more conventional biological knowledge, are covered thoroughly in other areas of an undergraduate biological sciences curriculum, e.g., in more traditional core classes such as genetics, biochemistry, or cell biology (A,B). Still others, such as the topics that fall broadly under communications and professional development, are covered elsewhere in the curriculum by a variety of mechanisms inside and outside the classroom (M,N,O,P). Still other areas go beyond what can fit in one introductory class but are also not covered elsewhere. Some of these (G,H,K) are competencies that may not be needed by this population but can be flagged for consideration in revisions of ICB. The most interesting topics are those that are crucial for experimental biologists, cannot be covered sufficiently in ICB, and are not covered elsewhere (E, i.e., biostatistics). ICB gives this latter area enough coverage to convey the key ideas needed for bioinformatics work, but the competencies flag it as an area in need of further development in the curriculum as a whole.
| | :[[User:Shawndouglas/sandbox/sublevel12|3. Choosing laboratory informatics software for your materials testing lab]] |
| | ::3.1 Evaluation and selection |
| | :::3.1.1 Technology considerations |
| | ::::3.1.1.1 Laboratory informatics options |
| | :::3.1.2 Features and functions |
| | ::::3.1.2.1 Base features |
| | ::::3.1.2.2 Specialty features |
| | :::3.1.3 Cybersecurity considerations |
| | :::3.1.4 Regulatory compliance considerations |
| | :::3.1.5 System flexibility |
| | :::3.1.6 Cost considerations |
| | ::3.2 Implementation |
| | :::3.2.1 Internal and external integrations |
| | ::3.3 MSW, updates, and other contracted services |
| | ::3.4 How a user requirements specification fits into the entire process (LIMSpec) |
|
| |
|
| The Carnegie Mellon/University of Pittsburgh joint PhD in computational biology offers an example at another extreme of the spectrum: a full multi-year training program for students expected to become experts in computational biology, who are expected to graduate competent to lead independent research programs in the area, teach computational biology, run bioinformatics core facilities, or pursue similarly demanding jobs. Computational biology programs face a special challenge compared with more traditional degree programs, in that the lack of clear standards for training at the undergraduate level means that there is little one can assume or enforce about background knowledge of incoming students beyond basic competencies in biology, computing, and mathematics. Furthermore, since a PhD program is research-focused and under pressure to limit time to degree, formal training can occupy only a finite amount of a student's time, equivalent to roughly a year of full-time coursework. To a limited degree, the program can rely on admissions standards, remediation, and self-teaching to assume some basics of all students (A,F,I,J). Some competencies can be handled by flexible menu-based requirements to meet a competency in ways appropriate to each student’s individual needs and background (B). In others, every student needs a high level of competency, and this must be met with specialized core classes designed for this population (C,D,E,G,H). Others must be met within the curriculum through specialized professional development mechanisms as well as one-on-one mentorship by the thesis advisor (K,L,M,N,O,P). Nonetheless, some competencies, especially those that depend on the mentorship of the research advisor, may be acquired much more effectively by some students than others. The competencies again suggest that these topics should be flagged for consideration for more formal training in the future. Furthermore, the challenges faced by this program with respect to knowledge of incoming students make clear the value that accepted standards for competencies at the undergraduate level could have in making most effective use of time in graduate school for specialists in the field.
| | :[[User:Shawndouglas/sandbox/sublevel13|4. Resources for selecting and implementing informatics solutions]] |
| | ::4.1 LIMS vendors |
| | ::4.2 Consultants |
| | ::4.3 Professional |
| | :::4.3.1 Trade organizations |
| | :::4.3.2 Conferences and trade shows |
| | ::4.4 LIMSpec |
|
| |
|
| ==References==
| | :[[User:Shawndouglas/sandbox/sublevel14|5. Taking the next step]] |
| {{Reflist|colwidth=30em}}
| | ::5.1 Conduct initial research into a specification document tailored to your lab's needs |
| | ::5.2 Issue some of the specification as part of a request for information (RFI) |
| | ::5.3 Respond to or open dialogue with vendors |
| | :::5.3.1 The value of demonstrations |
| | ::5.4 Finalize the requirements specification and choose a vendor |
|
| |
|
| ==Notes==
| | :[[User:Shawndouglas/sandbox/sublevel15|6. Closing remarks]] |
| This presentation is faithful to the original, with only a few minor changes to presentation, spelling, and grammar. PMCID and DOI were added when they were missing from the original reference.
| |
|
| |
|
| <!--Place all category tags here-->
| | :[[User:Shawndouglas/sandbox/sublevel16|Appendix 1. Blank LIMSpec template for manufacturing labs]] |
| [[Category:LIMSwiki journal articles (added in 2018)]] | | ::A1. Introduction and methodology |
| [[Category:LIMSwiki journal articles (all)]]
| | ::A2. Primary laboratory workflow |
| [[Category:LIMSwiki journal articles on bioinformatics]]
| | ::A3. Maintaining laboratory workflow and operations |
| [[Category:LIMSwiki journal articles on education]]
| | ::A4. Specialty laboratory functions |
| | ::A5. Technology and performance improvements |
| | ::A6. Security and integrity of systems and operations |
| | ::A7. Putting those requirements to practical use and caveats |
| | ::A8. LIMSpec in Microsoft Word format |
