Journal:The FAIR Guiding Principles for scientific data management and stewardship
| Full article title | The FAIR Guiding Principles for scientific data management and stewardship |
|---|---|
| Journal | Scientific Data |
| Author(s) |
List of authors
|
| Author affiliation(s) |
List of author affiliations
|
| Primary contact | E-mail: Barend Mons (must log in) |
| Year published | 2016 |
| Volume and issue | 3 |
| Page(s) | 160018 |
| DOI | 10.1038/sdata.2016.18 |
| ISSN | 2052-4463 |
| Distribution license | Creative Commons Attribution 4.0 International |
| Website | https://www.nature.com/articles/sdata201618 |
| Download | https://www.nature.com/articles/sdata201618.pdf (PDF) |
 |
This article should not be considered complete until this message box has been removed. This is a work in progress. |
Abstract
There is an urgent need to improve the infrastructure supporting the reuse of scholarly data. A diverse set of stakeholders — representing academia, industry, funding agencies, and scholarly publishers — have come together to design and jointly endorse a concise and measureable set of principles that we refer to as the FAIR Data Principles. The intent is that these may act as a guideline for those wishing to enhance the reusability of their data holdings. Distinct from peer initiatives that focus on the human scholar, the FAIR Principles put specific emphasis on enhancing the ability of machines to automatically find and use the data, in addition to supporting its reuse by individuals. This comment article represents the first formal publication of the FAIR Principles, and it includes the rationale behind them as well as some exemplar implementations in the community.
Comment
Supporting discovery through good data management
Good data management is not a goal in itself but rather the key conduit leading to knowledge discovery and innovation, and to subsequent data and knowledge integration and reuse by the community after the data publication process. Unfortunately, the existing digital ecosystem surrounding scholarly data publication prevents us from extracting maximum benefit from our research investments (e.g., Roche et al.[1]). Partially in response to this, science funders, publishers and governmental agencies are beginning to require data management and stewardship plans for data generated in publicly funded experiments. Beyond proper collection, annotation, and archival purposes, data stewardship includes the notion of "long-term care" of valuable digital assets, with the goal that they should be discovered and re-used for downstream investigations, either alone, or in combination with newly generated data. The outcomes from good data management and stewardship, therefore, are high-quality digital publications that facilitate and simplify this ongoing process of discovery, evaluation, and reuse in downstream studies. What constitutes "good data management" is, however, largely undefined, and is generally left as a decision for the data or repository owner. Therefore, bringing some clarity around the goals and desiderata of good data management and stewardship, and defining simple guideposts to inform those who publish and/or preserve scholarly data, would be of great utility.
This article describes four foundational principles — findability, accessibility, interoperability, and reusability — that serve to guide data producers and publishers as they navigate around these obstacles, thereby helping to maximize the added value gained by contemporary, formal scholarly digital publishing. Importantly, it is our intent that the principles apply not only to "data" in the conventional sense, but also to the algorithms, tools, and workflows that led to that data. All scholarly digital research objects[2] — from data to analytical pipelines — benefit from application of these principles, since all components of the research process must be available to ensure transparency, reproducibility, and reusability.
There are numerous and diverse stakeholders who stand to benefit from overcoming these obstacles: researchers wanting to share, get credit, and reuse each other’s data and interpretations; professional data publishers offering their services; software and tool-builders providing data analysis and processing services such as reusable workflows; funding agencies (private and public) increasingly concerned with long-term data stewardship; and a data science community mining, integrating, and analyzing new and existing data to advance discovery. To facilitate the reading of this manuscript by these diverse stakeholders, we provide definitions for common abbreviations in Box 1. Humans, however, are not the only critical stakeholders in the milieu of scientific data. Similar problems are encountered by the applications and computational agents that we task to undertake data retrieval and analysis on our behalf. These "computational stakeholders" are increasingly relevant, and the demand as much, or more, attention as their importance grows. One of the grand challenges of data-intensive science, therefore, is to improve knowledge discovery through assisting both humans and their computational agents in the discovery of, access to, and integration and analysis of task-appropriate scientific data and other scholarly digital objects.
|
For certain types of important digital objects, there are well-curated, deeply integrated, special-purpose repositories such as GenBank[3], worldwide Protein Data Bank (wwPDB)[4], and UniProt[5] in the life sciences; Space Physics Data Facility (SPDF; http://spdf.gsfc.nasa.gov/) and Set of Identifications, Measurements and Bibliography for Astronomical Data (SIMBAD)[6] in the space sciences.
These foundational and critical core resources are continuously curating and capturing high-value reference datasets and fine-tuning them to enhance scholarly output, provide support for both human and mechanical users, and provide extensive tooling to access their content in rich, dynamic ways. However, not all datasets or even data types can be captured by, or submitted to, these repositories. Many important datasets emerging from traditional, low-throughput bench science don’t fit in the data models of these special-purpose repositories, yet these datasets are no less important with respect to integrative research, reproducibility, and reuse in general. Apparently in response to this, we see the emergence of numerous general-purpose data repositories, at scales ranging from institutional (for example, a single university), to open globally-scoped repositories such as Dataverse[7], FigShare (http://figshare.com), Dryad[8], Mendeley Data (https://data.mendeley.com/), Zenodo (http://zenodo.org/), DataHub (http://datahub.io), DANS (http://www.dans.knaw.nl/), and EUDAT.[9] Such repositories accept a wide range of data types in a wide variety of formats, generally do not attempt to integrate or harmonize the deposited data, and place few restrictions (or requirements) on the descriptors of the data deposition. The resulting data ecosystem, therefore, appears to be moving away from centralization and is becoming more diverse and less integrated, thereby exacerbating the discovery and re-usability problem for both human and computational stakeholders.
A specific example of these obstacles could be imagined in the domain of gene regulation and expression analysis. Suppose a researcher has generated a dataset of differentially selected polyadenylation sites in a non-model pathogenic organism grown under a variety of environmental conditions that stimulate its pathogenic state. The researcher is interested in comparing the alternatively polyadenylated genes in this local dataset to other examples of alternative polyadenylation as well as the expression levels of these genes — both in this organism and related model organisms — during the infection process. Given that there is no special-purpose archive for differential polyadenylation data and no model organism database for this pathogen, where does the researcher begin?
We will consider the current approach to this problem from a variety of data discovery and integration perspectives. If the desired datasets existed, where might they have been published, and how would one begin to search for them, using what search tools? The desired search would need to filter based on specific species, tissues, types of data (Poly-A, microarray, NGS), conditions (infection), and genes; is that information ("metadata") captured by the repositories, and if so, what format is it in, is it searchable, and how? Once the data is discovered, can it be downloaded? In what format(s)? Can that format be easily integrated with private in-house data (the local dataset of alternative polyadenylation sites) as well as other data publications from third parties and with the community’s core gene/protein data repositories? Can this integration be done automatically to save time and avoid copy/paste errors? Does the researcher have permission to use the data from these third-party researchers, under what license conditions, and who should be cited if a data-point is reused?
Questions such as these highlight some of the barriers to data discovery and reuse, not only for humans, but even more so for machines; yet it is precisely these kinds of deeply and broadly integrative analyses that constitute the bulk of contemporary e-Science. The reason that we often need several weeks (or months) of specialist technical effort to gather the data necessary to answer such research questions is not the lack of appropriate technology; the reason is, that we do not pay our valuable digital objects the careful attention they deserve when we create and preserve them. Overcoming these barriers, therefore, necessitates that all stakeholders — including researchers, special-purpose, and general-purpose repositories — evolve to meet the emergent challenges described above. The goal is for scholarly digital objects of all kinds to become "first class citizens" in the scientific publication ecosystem, where the quality of the publication — and more importantly, the impact of the publication — is a function of its ability to be accurately and appropriately found, re-used, and cited over time, by all stakeholders, both human and mechanical.
With this goal in-mind, a workshop was held in Leiden, Netherlands, in 2014, named Jointly Designing a Data Fairport. This workshop brought together a wide group of academic and private stakeholders all of whom had an interest in overcoming data discovery and reuse obstacles. From the deliberations at the workshop the notion emerged that through the definition of, and widespread support for, a minimal set of community-agreed guiding principles and practices, all stakeholders could more easily discover, access, appropriately integrate and re-use, and adequately cite, the vast quantities of information being generated by contemporary data-intensive science. The meeting concluded with a draft formulation of a set of foundational principles that were subsequently elaborated in greater detail: namely, that all research objects should be findable, accessible, interoperable and reusable (FAIR) both for machines and for people. These are now referred to as the FAIR Guiding Principles. Subsequently, a dedicated FAIR working group, established by several members of the FORCE11 community[10] fine-tuned and improved the Principles. The results of these efforts are reported here.
The significance of machines in data-rich research environments
The emphasis placed on FAIRness being applied to both human-driven and machine-driven activities, is a specific focus of the FAIR Guiding Principles that distinguishes them from many peer initiatives (discussed in the subsequent section). Humans and machines often face distinct barriers when attempting to find and process data on the web. Humans have an intuitive sense of "semantics" (the meaning or intent of a digital object) because we are capable of identifying and interpreting a wide variety of contextual cues, whether those take the form of structural/visual/iconic cues in the layout of a web page, or the content of narrative notes. As such, we are less likely to make errors in the selection of appropriate data or other digital objects, although humans will face similar difficulties if sufficient contextual metadata is lacking. The primary limitation of humans, however, is that we are unable to operate at the scope, scale, and speed necessitated by the scale of contemporary scientific data and complexity of e-Science. It is for this reason that humans increasingly rely on computational agents to undertake discovery and integration tasks on their behalf. This necessitates machines to be capable of autonomously and appropriately acting when faced with the wide range of types, formats, and access-mechanisms/protocols that will be encountered during their self-guided exploration of the global data ecosystem. It also necessitates that the machines keep an exquisite record of provenance such that the data they are collecting can be accurately and adequately cited. Assisting these agents, therefore, is a critical consideration for all participants in the data management and stewardship process — from researchers and data producers to data repository hosts.
Throughout this paper, we use the phrase "machine actionable" to indicate a continuum of possible states wherein a digital object provides increasingly more detailed information to an autonomously acting, computational data explorer. This information enables the agent — to a degree dependent on the amount of detail provided — to have the capacity, when faced with a digital object never encountered before, to: a) identify the type of object (with respect to both structure and intent); b) determine if it is useful within the context of the agent’s current task by interrogating metadata and/or data elements; c) determine if it is usable, with respect to license, consent, or other accessibility or use constraints; and d) take appropriate action, in much the same manner that a human would.
For example, a machine may be capable of determining the data-type of a discovered digital object, but not capable of parsing it due to it being in an unknown format; or it may be capable of processing the contained data, but not capable of determining the licensing requirements related to the retrieval and/or use of that data. The optimal state — where machines fully "understand" and can autonomously and correctly operate, on a digital object — may rarely be achieved. Nevertheless, the FAIR principles provide "steps along a path" toward machine-actionability; adopting, in whole or in part, the FAIR principles, leads the resource along the continuum towards this optimal state. In addition, the idea of being machine-actionable applies in two contexts, first, when referring to the contextual metadata surrounding a digital object ("what is it?"), and second, when referring to the content of the digital object itself ("how do I process it/integrate it?"). Either or both of these may be machine-actionable, and each forms its own continuum of actionability.
Finally, we wish to draw a distinction between data that is machine-actionable as a result of specific investment in software supporting that data-type, for example, bespoke parsers that understand life science wwPDB files or space science Space Physics Archive Search and Extract (SPASE) files, and data that is machine-actionable exclusively through the utilization of general-purpose, open technologies. To reiterate the earlier point—ultimate machine-actionability occurs when a machine can make a useful decision regarding data that it has not encountered before. This distinction is important when considering both (a) the rapidly growing and evolving data environment, with new technologies and new, more complex data-types continuously being developed, and (b) the growth of general-purpose repositories, where the data-types likely to be encountered by an agent are unpredictable. Creating bespoke parsers, in all computer languages for all data-types and all analytical tools that require those data-types, is not a sustainable activity. As such, the focus on assisting machines in their discovery and exploration of data through application of more generalized interoperability technologies and standards at the data/repository level becomes a top-level priority for good data stewardship.
The FAIR Guiding Principles in detail
Representatives of the interested stakeholder groups, discussed above, coalesced around four core desiderata — the FAIR Guiding Principles — and limited elaboration of these, which have been refined (Box 2) from the meeting’s original draft, available at https://www.force11.org/node/6062. A separate document that dynamically addresses community discussion relating to clarifications and explanations of the principles, and detailed guidelines for and examples of FAIR implementations, is currently being constructed (http://datafairport.org/fair-principles-living-document-menu). The FAIR Guiding Principles describe distinct considerations for contemporary data publishing environments with respect to supporting both manual and automated deposition, exploration, sharing, and reuse. While there have been a number of recent, often domain-focused publications advocating for specific improvements in practices relating to data management and archival[1][11][12], FAIR differs in that it describes concise, domain-independent, high-level principles that can be applied to a wide range of scholarly outputs. Throughout the Principles, we use the phrase "(meta)data" in cases where the Principle should be applied to both metadata and data.
|
The elements of the FAIR Principles are related, but independent and separable. The Principles define characteristics that contemporary data resources, tools, vocabularies and infrastructures should exhibit to assist discovery and reuse by third parties. By minimally defining each guiding principle, the barrier-to-entry for data producers, publishers, and stewards who wish to make their data holdings FAIR is purposely maintained as low as possible. The Principles may be adhered to in any combination and incrementally, as data providers’ publishing environments evolve to increasing degrees of "FAIRness." Moreover, the modularity of the Principles, and their distinction between data and metadata, explicitly support a wide range of special circumstances. One such example is highly sensitive or personally identifiable data, where publication of rich metadata to facilitate discovery, including clear rules regarding the process for accessing the data, provides a high degree of "FAIRness" even in the absence of FAIR publication of the data itself. A second example involves the publication of non-data research objects. Analytical workflows, for example, are a critical component of the scholarly ecosystem, and their formal publication is necessary to achieve both transparency and scientific reproducibility. The FAIR principles can equally be applied to these non-data assets, which need to be identified, described, discovered, and reused in much the same manner as data.
Specific exemplar efforts that provide varying levels of FAIRness are detailed later in this document. Additional issues, however, remain to be addressed. First, when community-endorsed vocabularies or other (meta)data standards do not include the attributes necessary to achieve rich annotation, there are two possible solutions: either publish an extension of an existing, closely related vocabulary, or — in the extreme case — create and explicitly publish a new vocabulary resource, following FAIR principles ("I2"). Second, for explicitly identifying the standard chosen when more than one vocabulary or other (meta)data standard is available, and given that for instance in the life sciences there are over 600 content standards, the BioSharing registry (https://biosharing.org/) can be of use as it describes the standards in detail, including versions where applicable.
The Principles precede implementation
These high-level FAIR Guiding Principles precede implementation choices and do not suggest any specific technology, standard, or implementation-solution; moreover, the Principles are not, themselves, a standard or a specification. They act as a guide to data publishers and stewards to assist them in evaluating whether their particular implementation choices are rendering their digital research artifacts findable, accessible, interoperable, and reusable. We anticipate that these high-level principles will enable a broad range of integrative and exploratory behaviors, based on a wide range of technology choices and implementations. Indeed, many repositories are already implementing various aspects of FAIR using a variety of technology choices, and several examples are detailed in the next section; examples include scientific data itself and how narrative data articles are anchored to a progressively FAIR structured metadata.
Examples of FAIRness, and the resulting value-added Dataverse
Dataverse[7] is an open-source data repository software installed in dozens of institutions globally to support public community repositories or institutional research data repositories. Harvard Dataverse, with more than 60,000 datasets, is the largest of the current Dataverse repositories and is open to all researchers from all research fields. Dataverse generates a formal citation for each deposit, following the standard defined by Altman and King.[13] Dataverse makes the Digital Object Identifier (DOI) or other persistent identifiers (Handles) public when the dataset is published ("F"). This resolves to a landing page, providing access to metadata, data files, dataset terms, waivers or licenses, and version information, all of which is indexed and searchable ("F," "A," and "R"). Deposits include metadata, data files, and any complementary files (such as documentation or code) needed to understand the data and analysis ("R"). Metadata is always public, even if the data are restricted or removed for privacy issues ("F," "A"). This metadata is offered at three levels, extensively supporting the "I" and "R" FAIR principles: 1) data citation metadata, which maps to DataCite schema or Dublin Core Terms; 2) domain-specific metadata, which when possible maps to metadata standards used within a scientific domain; and 3) file-level metadata, which can be deep and extensive for tabular data files (including column-level metadata). Finally, Dataverse provides public machine-accessible interfaces to search the data, access the metadata, and download the data files, using a token to grant access when data files are restricted ("A").
FAIRDOM (http://fair-dom.org/about): integrates the SEEK[14] and openBIS[15] platforms to produce a FAIR data and model management facility for Systems Biology. Individual research assets (or aggregates of data and models) are identified with unique and persistent HTTP URLs, which can be registered with DOIs for publication ("F"). Assets can be accessed over the internet in a variety of formats appropriate for individuals and/or their computers (RDF, XML) ("I"). Research assets are annotated with rich metadata, using community standards, formats and ontologies ("I"). The metadata is stored as RDF to enable interoperability and assets can be downloaded for reuse ("R").
ISA: is a community-driven metadata tracking framework to facilitate standards-compliant collection, curation, management and reuse of life science datasets.[16] ISA provides progressively FAIR structured metadata to Nature Scientific Data’s Data Descriptor articles, and many GigaScience data papers, and underpins the EBI MetaboLights database among other data resources. At the core is a general-purpose, extensible ISA model, originally only available as a tabular representation but subsequently enhanced as an RDF-based representation[17], and JSON serializations to enable the "I" and "R," becoming "FAIR" when published as linked data (http://elixir-uk.org/node-events/201cisa-as-a-fair-research-object201d-hack-the-spec-event-1) and complementing other research objects.[18]
Open PHACTS: Open PHACTS[19] is a data integration platform for information pertaining to drug discovery. Access to the platform is mediated through a machine-accessible interface[20] which provides multiple representations that are both human (HTML) and machine readable (RDF, JSON, XML, CSV, etc.), providing the "A" facet of FAIRness. The interface allows multiple URLs to be used to access information about a particular entity through a mapping service ("F" and "A"). Thus, a user can provide a ChEMBL URL to retrieve information sourced from, for example, Chemspider or DrugBank. Each call provides a canonical URL in its response ("A" and "I"). All data sources used are described using standardized dataset descriptions, following the global VoID standard, with rich provenance ("R" and "I"). All interface features are described using RDF following the Linked Data API specification ("A"). Finally, a majority of the datasets are described using community agreed upon ontologies ("I").
wwPDB: wwPDB[4][21] is a special-purpose, intensively curated data archive that hosts information about experimentally determined 3D structures of proteins and nucleic acids. All wwPDB entries are stably hosted on an FTP server ("A") and represented in machine-readable formats (text and XML); the latter are machine-actionable using the metadata provided by the wwPDB conforming to the Macromolecular Information Framework (mmCIF)[22], a data standard of the International Union of Crystallography (IUCr) ("F," "I" for humans and IUCr-aware machines). The wwPDB metadata contains cross-references to common identifiers such as PubMed and NCBI Taxonomy, and their wwPDB metadata are described in data dictionaries and schema documents (http://mmcif.wwpdb.org and http://pdbml.wwpdb.org) which conform to the IUCr data standard for the chemical and structural biology domains ("R"). A variety of software tools are available to interpret both wwPDB data and meta-data ("I," "R" for humans and machines with this software). Each entry is represented by a DOI ("F," "A" for humans and machines). The DOI resolves to a zipped file which requires special software for further interrogation/interpretation. Other wwPDB access points[23][24][25] provide access to wwPDB records through URLs that are likely to be stable in the long-term ("F"), and all data and metadata is searchable through one or more of the wwPDB-affiliated websites ("F").
UniProt: UniProt[5] is a comprehensive resource for protein sequence and annotation data. All entries are uniquely identified by a stable URL, that provides access to the record in a variety of formats, including a web page, plain-text, and RDF ("F" and "A"). The record contains rich metadata ("F") that is both human-readable (HTML) and machine-readable (text and RDF), where the RDF-formatted response utilizes shared vocabularies and ontologies such as UniProt Core, FALDO, and ECO ("I"). Interlinking with more than 150 different databases, every UniProt record has extensive links into, for example, PubMed, enabling rich citation. These links are machine-actionable in the RDF representation ("R"). Finally, in the RDF representation, the UniProt Core Ontology explicitly types all records, leaving no ambiguity — neither for humans nor machines — about what the data represents ("R"), enabling fully-automated retrieval of records and cross-referencing information.
In addition to, and in support of, communities and resources that are already pursuing FAIR objectives, the Data Citation Implementation Group of Force11 has published specific technical recommendations for how to implement many of the principles[26], with a particular focus on identifiers and their resolution, persistence, and metadata accessibility especially related to citation. In addition, the "Skunkworks" group that emerged from the Lorentz Workshop has been creating software supporting infrastructures[27] that are, end-to-end, compatible with FAIR principles, and can be implemented over existing repositories. These code modules have a particular focus on metadata publication and searchability, compatibility in cases of strict privacy considerations, and the extremely difficult problem of data and metadata interoperability (manuscript in preparation). Finally, there are several emergent projects, some listed in Box 3, for which FAIR is a key objective. These projects may provide valuable advice and guidance for those wishing to become more FAIR.
|
References
- ↑ 1.0 1.1 Roche, D.G.; Kruuk, L.E.; Lanfear, R.; Binning, S.A. (2015). "Public data archiving in ecology and evolution: How well are we doing?". PLOS Biology 13: e1002295. doi:10.1371/journal.pbio.1002295. PMC PMC4640582. PMID 26556502. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4640582.
- ↑ Bechhofer, S.; De Roure, D.; Gamble, M. et al. (2010). "Research objects: Towards exchange and reuse of digital knowledge". Nature Precedings. doi:10.1038/npre.2010.4626.1.
- ↑ Benson, D.A.; Cavanaugh, M.; Clark, K. et al. (2013). "GenBank". Nucleic Acids Research 41 (D1): D36-42. doi:10.1093/nar/gks1195. PMC PMC4640582. PMID PMC3531190. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4640582.
- ↑ 4.0 4.1 Berman, H.; Henrick, K.; Nakamura, H. (2003). "Announcing the worldwide Protein Data Bank". Nature Structural Biology 10 (12): 980. doi:10.1038/nsb1203-980. PMID 14634627.
- ↑ 5.0 5.1 UniProt Consortium (2015). "UniProt: A hub for protein information". Nucleic Acids Research 43 (D1): D204-12. doi:10.1093/nar/gku989. PMC PMC4384041. PMID 25348405. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4384041.
- ↑ Wenger, M.; Ochsenbein, F.; Egret, D. et al. (2000). "The SIMBAD astronomical database: The CDS reference database for astronomical objects". Astronomy and Astrophysics Supplement Series 143 (1): 9–22. doi:10.1051/aas:2000332.
- ↑ 7.0 7.1 Crosas, M. (2011). "The Dataverse Network: An open-source application for sharing, discovering and preserving data". D-Lib Magazine 17 (1/2): 2. doi:10.1045/january2011-crosas.
- ↑ White, H.C.; Carrier, S.; Thompson, A. et al. (2008). "The Dryad Data Repository: A Singapore Framework metadata architecture in a DSpace environment". DC-2008--Berlin Proceedings 2008: 157–162. http://dcpapers.dublincore.org/pubs/article/view/928.
- ↑ Lecarpentier, D.; Wittenburg, P.; Elbers, W. (2013). "EUDAT: A new cross-disciplinary data infrastructure for science". International Journal of Digital Curation 8 (1): 279–287. doi:10.2218/ijdc.v8i1.260.
- ↑ Martone, M.E. (2015). "FORCE11: Building the Future for Research Communications and e-Scholarship". BioScience 65 (7): 635. doi:10.1093/biosci/biv095.
- ↑ White, E.P.; Baldridge, E.; Brym, Z.T. et al. (2013). "Nine simple ways to make it easier to (re)use your data". Ideas in Ecology and Evolution 6 (2). http://ojs.library.queensu.ca/index.php/IEE/article/view/4608/0.
- ↑ Sandve, G.K.; Nekrutenko, A.; Taylor, J.; Hovig, E. (2013). "Ten simple rules for reproducible computational research". PLOS Computational Biology 9 (10). doi:10.1371/journal.pcbi.1003285. PMC PMC3812051. PMID 24204232. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3812051.
- ↑ Altman, M.; King, G. (2007). "A proposed standard for the scholarly citation of quantitative data". D-Lib Magazine 13 (3/4). doi:10.1045/march2007-altman.
- ↑ Wolstencroft, K.; Owen, S.; Krebs, O. et al. (2015). "SEEK: A systems biology data and model management platform". BMC Systems Biology 9: 33. doi:10.1186/s12918-015-0174-y. PMC PMC4702362. PMID 26160520. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4702362.
- ↑ Bauch, A.; Adamczyk, I.; Buczek, P. et al. (2011). "openBIS: A flexible framework for managing and analyzing complex data in biology research". BMC Bioinformatics 12: 468. doi:10.1186/1471-2105-12-468. PMC PMC3275639. PMID 22151573. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3275639.
- ↑ Sansone, S.A.; Rocca-Serra, P.; Field, D. et al. (2012). "Toward interoperable bioscience data". Nature Genetics 44 (2): 121–6. doi:10.1038/ng.1054. PMC PMC3428019. PMID 22281772. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3428019.
- ↑ Lam, K.K.; Khalak, A.; Tse, D. (2014). "Near-optimal assembly for shotgun sequencing with noisy reads". BMC Bioinformatics 15 (Supp. 9): S4. doi:10.1186/1471-2105-15-S9-S4. PMC PMC4168708. PMID 25252708. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4168708.
- ↑ González-Beltrán, A.; Li, P.; Zhao, J. et al. (2015). "From peer-reviewed to peer-reproduced in scholarly publishing: The complementary roles of data models and workflows in bioinformatics". PLOS One 10 (7): e0127612. doi:10.1371/journal.pone.0127612. PMC PMC4495984. PMID 26154165. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4495984.
- ↑ Harland, L. (2012). "Open PHACTS: A semantic knowledge infrastructure for public and commercial drug discovery research". Knowledge Engineering and Knowledge Management - EKAW 2012 7603: 1–7. doi:10.1007/978-3-642-33876-2_1.
- ↑ Groth, P.; Loizou, A.; Gray, A.J.G. et al. (2014). "API-centric Linked Data integration: The Open PHACTS Discovery Platform case study". Web Semantics: Science, Services and Agents on the World Wide Web 29: 12–18. doi:10.1016/j.websem.2014.03.003.
- ↑ Berman, H.M.; Westbrook, J.; Feng, Z. et al. (2000). "The Protein Data Bank". Nucleic Acids Research 28 (1): 235-42. PMC PMC102472. PMID 10592235. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC102472.
- ↑ Bourne, P.E.; Berman, H.M.; McMahon, B. et al. (1997). "Macromolecular Crystallographic Information File". Methods in Enzymology 277: 571–90. PMID 18488325.
- ↑ Rose, P.W.; Prlić, A.; Bi, C. et al. (2015). "The RCSB Protein Data Bank: Views of structural biology for basic and applied research and education". Nucleic Acids Research 43 (D1): D345-56. doi:10.1093/nar/gku1214. PMC PMC4383988. PMID 25428375. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4383988.
- ↑ Kinjo, A.R.; Suzuki, H.; Yamashita, R. et al. (2012). "Protein Data Bank Japan (PDBj): Maintaining a structural data archive and resource description framework format". Nucleic Acids Research 40 (D1): D453-60. doi:10.1093/nar/gkr811. PMC PMC3245181. PMID 21976737. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3245181.
- ↑ Gutmanas, A.; Alhroub, Y.; Battle, G.M. et al. (2014). "PDBe: Protein Data Bank in Europe". Nucleic Acids Research 42 (D1): D285-91. doi:10.1093/nar/gkt1180. PMC PMC3965016. PMID 24288376. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3965016.
- ↑ Starr, J.; Castro, E.; Crosas, M. et al. (2015). "Achieving human and machine accessibility of cited data in scholarly publications". PeerJ Computer Science 1: e1. doi:10.7717/peerj-cs.1. PMC PMC4498574. PMID 26167542. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4498574.
- ↑ Wilkinson, M.; Dumontier, M.; Durbin, P. (10 November 2015). "DataFairPort: The Perl libraries version 0.231". Zenodo. doi:http://doi.org/10.5281/zenodo.33584.
- ↑ Ohno-Machado, L.; Alter, G.; Fore, I. et al. (8 March 2015). "bioCADDIE White Paper: Vision and Implementation". figshare. doi:10.6084/m9.figshare.1362572. https://figshare.com/articles/bioCADDIE_white_paper_Data_Discovery_Index/1362572.
- ↑ WG3 Members (14 August 2015). "WG3-MetadataSpecifications: NIH BD2K bioCADDIE Data Discovery Index WG3 Metadata Specification v1". Zenodo. doi:10.5281/zenodo.28019.
- ↑ Musen, M.A.; Bean, C.A.; Cheung, K.H. et al. (2015). "The center for expanded data annotation and retrieval". JAMIA 22 (6): 1148-52. doi:10.1093/jamia/ocv048. PMC PMC5009916. PMID 26112029. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5009916.
Notes
This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. In the original, reference 26 accidentally duplicates reference five; 26 was omitted and five used in its place. The original put references 30–32 before reference 29; because this wiki puts references in order of appearance, order will slightly differ from the original.
