Workshop on Metadata Catalogues
Presentations from the Workshop on Metadata Catalogues, which took place virtually via Zoom on the 4th April 2022.
Keywords: data catalogue, SciCat, ICAT, expands, panet, PaNOSC, metadata, data management, data processing
Resource type: slides, video
Workshop on Metadata Catalogues
https://zenodo.org/record/6414117
https://pan-training.eu/materials/workshop-on-metadata-catalogues
Presentations from the Workshop on Metadata Catalogues, which took place virtually via Zoom on the 4th April 2022.
data catalogue, SciCat, ICAT, expands, panet, PaNOSC, metadata, data management, data processing
data curator
data managers
research data engineer
ExPaNDS and PaNOSC project members
PaN users
PaN Community
ExPaNDS mid-term review
Slides of the presentations done during the ExPaNDS midterm review.
Keywords: expands
Resource type: slides
ExPaNDS mid-term review
https://indico.desy.de/event/30039/
https://pan-training.eu/materials/expands-mid-term-review
Slides of the presentations done during the ExPaNDS midterm review.
expands
ExPaNDS and PaNOSC project members
Demonstrate ICAT and SciCat released with APIs compatible with ExPaNDS federated EOSC services
Demonstration release of ICAT and SciCat with APIs compatible with ExPaNDS federated EOSC services and its connection to milestone Metadata catalogue as EOSC service in the domain of photon and neutron (PaN) science
Demonstrate ICAT and SciCat released with APIs compatible with ExPaNDS federated EOSC services
https://zenodo.org/record/6363591
https://pan-training.eu/materials/demonstrate-icat-and-scicat-released-with-apis-compatible-with-expands-federated-eosc-services
Demonstration release of ICAT and SciCat with APIs compatible with ExPaNDS federated EOSC services and its connection to milestone Metadata catalogue as EOSC service in the domain of photon and neutron (PaN) science
D3.3
PaNET implementation by the pan-ontologies-API RESTful service
The application provides a data catalogue independent implementation retrieval and processing of ontologies from an external source. Currently, only the PaNET ontology is implemented. Below is a schematic data flow depicting the role of the pan-ontologies-api.
Keywords: expands, PaNOSC, data catalogue, ontology
Resource type: git, github, Git Project
PaNET implementation by the pan-ontologies-API RESTful service
https://github.com/ExPaNDS-eu/pan-ontologies-api
https://pan-training.eu/materials/pan-ontologies-api
The application provides a data catalogue independent implementation retrieval and processing of ontologies from an external source. Currently, only the PaNET ontology is implemented. Below is a schematic data flow depicting the role of the pan-ontologies-api.
expands, PaNOSC, data catalogue, ontology
PaN Community
ExPaNDS and PaNOSC project members
ExPaNDS Guidance Note: Key Policy Elements within a Photon and Neutron Research Infrastructure Data Policy Framework (revised - final version)
The text of this ExPaNDS Guidance Note is extracted from ExPaNDS deliverable [D2.3: Final data policy framework for Photon and Neutron RIs](https://doi.org/10.5281/zenodo.5205824). The Guidance Note covers the 21 elements that comprise the final version of the ExPaNDS data policy framework. These...
Keywords: data policy, expands, FAIR
Resource type: Document
ExPaNDS Guidance Note: Key Policy Elements within a Photon and Neutron Research Infrastructure Data Policy Framework (revised - final version)
https://doi.org/10.5281/zenodo.6090282
https://pan-training.eu/materials/expands-guidance-note-key-policy-elements-within-a-photon-and-neutron-research-infrastructure-data-policy-framework-revised-final-version
The text of this ExPaNDS Guidance Note is extracted from ExPaNDS deliverable [D2.3: Final data policy framework for Photon and Neutron RIs](https://doi.org/10.5281/zenodo.5205824). The Guidance Note covers the 21 elements that comprise the final version of the ExPaNDS data policy framework. These elements fall under nine broad themes:
1. General drivers and principles
2. Roles and responsibilities
3. Scope
4. Enabling FAIR data
5. Necessary restrictions to data sharing
6. Availability of infrastructure and responsibility for costs
7. Data management planning requirements
8. Recognition and reward for data usage
9. Reporting requirements, compliance monitoring, and any possible sanctions
The Guidance Note is intended as a short-form, ready-access tool for policy makers working on data policy within Photon and Neutron Research Infrastructures. For additional context around the development of the ExPaNDS data policy framework, see the D2.3 deliverable and its earlier, draft version [D2.1: Draft extended data policy framework for photon and neutron RIs](https://doi.org/10.5281/zenodo.4014811).
data policy, expands, FAIR
Develop common rules and best practices between national RI’s and harmonize the provision of the EOSC services
Slides (and other resources) of the presentations done at this workshop.
How is ExPaNDS delivering its data services to PaNOSC and EOSC?
- Day 1. Data catalogues: getting our open datasets harvested by the community
- Day 2. Data analysis: getting our software in the PaN software...
Keywords: expands, workshop, SciCat, ICAT, B2FIND, OpenAIRE, EOSC, OAI-PMH, data catalogue
Develop common rules and best practices between national RI’s and harmonize the provision of the EOSC services
https://indico.desy.de/event/29297/
https://pan-training.eu/materials/develop-common-rules-and-best-practices-between-national-ri-s-and-harmonize-the-provision-of-the-eosc-services
Slides (and other resources) of the presentations done at this workshop.
How is ExPaNDS delivering its data services to PaNOSC and EOSC?
- Day 1. Data catalogues: getting our open datasets harvested by the community
- Day 2. Data analysis: getting our software in the PaN software catalogue, getting pipelines to run, ensuring their quality over time
expands, workshop, SciCat, ICAT, B2FIND, OpenAIRE, EOSC, OAI-PMH, data catalogue
PaN Community
ExPaNDS and PaNOSC project members
Metadata Catalogue Release
Self-contained, stand-alone metadata catalogue release that facilities can download to test/try and play with.
Keywords: ICAT, SciCat, PaNOSC, data catalogue, expands
Resource type: docker, docker-compose, software, git
Metadata Catalogue Release
https://zenodo.org/record/5205909#.YYE4fb_MKV5
https://pan-training.eu/materials/metadata-catalogue-release
Self-contained, stand-alone metadata catalogue release that facilities can download to test/try and play with.
ICAT, SciCat, PaNOSC, data catalogue, expands
PaN Community
ExPaNDS and PaNOSC project members
engineers
research data engineer
ExPaNDS mapping dcat ontology and Nexus
Different communities have developed their terminology and are maintaining their metadata schemata or lists of vocabulary. In order to facilitate sharing of data across communities and allow collaboration between heterogeneous systems, interoperability of these vocabularies is required. In ...
Keywords: expands, ontology, mapping, NeXus, DCAT, semantic integration
Resource type: git, tool
ExPaNDS mapping dcat ontology and Nexus
https://github.com/ExPaNDS-eu/ExPaNDS-nexus-dcat-mapping-ontology
https://pan-training.eu/materials/expands-mapping-dcat-ontology-and-nexus
Different communities have developed their terminology and are maintaining their metadata schemata or lists of vocabulary. In order to facilitate sharing of data across communities and allow collaboration between heterogeneous systems, interoperability of these vocabularies is required. In order to increase data interoperability and enable data integration, these vocabularies need to be semantically integrated with other vocabularies and their terms have to be aligned. This enables the development of a common shared vocabulary.
expands, ontology, mapping, NeXus, DCAT, semantic integration
PaN Community
ExPaNDS NeXusOntology
NeXusOntology: Machine-readable ontology of the NeXus definitions.
The published ontology describes the NeXus standard, it does not define the standard.
This ontology extracts information about NeXus classes and fields from NeXus nxdl definition files on the NeXus GitHub site.
This...
Keywords: NeXus, ontology, expands
Resource type: git, tool
ExPaNDS NeXusOntology
https://github.com/nexusformat/NeXusOntology/tree/main
https://pan-training.eu/materials/expands-nexusontology-machine-readable-ontology-of-the-nexus-definitions
NeXusOntology: Machine-readable ontology of the NeXus definitions.
The published ontology describes the NeXus standard, it does not define the standard.
This ontology extracts information about NeXus classes and fields from NeXus nxdl definition files on the NeXus GitHub site.
This project was undertaken under ExPaNDS WP3.2.
The ontology is designed to fulfil several purposes. First, it creates unique identifiers for each of the NeXus fields which would normally exist only within the namespaces of the defining NeXus classes. This is the primary goal and provides PIDs for annotation and tagging. The second purpose is to allow, via separate ontologies, NeXus fields and classes to be mapped onto equivalent or related terms defined elsewhere.
Finally, we hope that this ontology, when used with a tool such as Protege, will provide a useful 'NeXus Explorer' tool to gain a quick overview of NeXus with links to official NeXus documentation.
NeXus, ontology, expands
PaN Community
ExPaNDS Photon and Neutron Experimental Techniques (PaNET) ontology
The Photon and Neutron Experimental Technique (PaNET) ontology provides a taxonomy of experimental techniques relevant for the Photon and Neutron (PaN) community. This ontology is being developed as part of the Work Package 3 on EOSC Data Catalogue Services for PaN national Research...
Keywords: panet, expands, ontology, experimental techniques
Resource type: git, tool
ExPaNDS Photon and Neutron Experimental Techniques (PaNET) ontology
https://github.com/ExPaNDS-eu/ExPaNDS-experimental-techniques-ontology
https://pan-training.eu/materials/expands-photon-and-neutron-experimental-techniques-panet-ontology
The Photon and Neutron Experimental Technique (PaNET) ontology provides a taxonomy of experimental techniques relevant for the Photon and Neutron (PaN) community. This ontology is being developed as part of the Work Package 3 on EOSC Data Catalogue Services for PaN national Research Infrastructures of the ExPaNDS project.
The ontology allows to add semantic tags to datasets, and other related research objects, to indicate the experimental technique(s) that was (or were) used to create them.
panet, expands, ontology, experimental techniques
PaN Community
ExPaNDS D3.2: Ontologies v1.0
We present ontologies for the domain of photon and neutron (PaN) science. With the primary goal of supporting PaN FAIR data catalogue services, we have developed three ontologies: PaN experimental techniques (PaNET), an ontology of NeXus definitions (NeXusOntology), and a semantic integration...
Keywords: expands, ontology, EOSC, Photon science, experimental techniques, Neutron science, deliverable, D3.2
Resource type: Document
ExPaNDS D3.2: Ontologies v1.0
https://doi.org/10.5281/zenodo.4806026
https://pan-training.eu/materials/expands-d3-2-ontologies
We present ontologies for the domain of photon and neutron (PaN) science. With the primary goal of supporting PaN FAIR data catalogue services, we have developed three ontologies: PaN experimental techniques (PaNET), an ontology of NeXus definitions (NeXusOntology), and a semantic integration ontology for the PaN domain (PaNmapping). The ontologies are presented as initial versions, supported by community development workflows. The work represents deliverable D3.2 of the Horizon 2020 ExPaNDS project.
expands, ontology, EOSC, Photon science, experimental techniques, Neutron science, deliverable, D3.2
ExPaNDS D2.3: Final data policy framework for Photon and Neutron RIs
ExPaNDS deliverable D2.3: Final data policy framework for photon and neutron RIs, considers how data policies for research infrastructures providing photon and neutron facilities should be framed, in particular in the light of supporting open science and FAIR data. It builds on and revises the...
Keywords: expands, data policy
Resource type: Document
ExPaNDS D2.3: Final data policy framework for Photon and Neutron RIs
https://doi.org/10.5281/zenodo.5205825
https://pan-training.eu/materials/expands-d2-3-final-data-policy-framework-for-photon-and-neutron-ris
ExPaNDS deliverable D2.3: Final data policy framework for photon and neutron RIs, considers how data policies for research infrastructures providing photon and neutron facilities should be framed, in particular in the light of supporting open science and FAIR data. It builds on and revises the initial policy framework presented in ExPaNDS deliverable D2.1: Draft extended data policy framework for photon and neutron RIs.To produce the final, revised version of our data policy framework, ExPaNDS undertook a series of detailed consultation meetings with all ten of our partner PaN RIs. Drawing extensively on quotes from the write ups of those conversations, this report presents the themes that emerged from the consultation, focusing especially on those that featured most often and most strongly.Based on the consultation feedback, we present a revised version of the ExPaNDS data policy framework, which now proposes 21 elements for RIs to consider when formulating data policy.Overall, the consultation provided an opportunity to engage deeply in discussion with ExPaNDS partners about data policy and policy making. The consultation feedback and the level of engagement with the consultation process itself highlight ExPaNDS partners’ strong interest in data policy. There is a clear recognition that having an appropriate data policy is fundamental to supporting good research data management. While some differing views exist, ExPaNDS partners express consensus on key fundamental aspects of the data policy framework, especially the importance of a high level commitment to FAIR data. There is also the strong recognition that flexibility in a data policy framework is vital to accommodating the diversity found across national PaN RIs.As well as incorporating the final version ExPaNDS data policy framework as a key output, our report concludes with two overarching points:Data policy diversity will remain across ExPaNDS partner facilitiesData policy is a powerful and important tool for national PaN RIs.It is clear from the consultation feedback that the ExPaNDS data policy framework is already having an impact on facilities’ plans for future work, especially around ensuring that key implementations are in place to support FAIR data. Further work within ExPaNDS, for example, around PIDs, metadata, and FAIR assessment, will provide guidance to support these activities.
expands, data policy
Delivering data services to EOSC
Wiki page recording the ExPaNDS training workshop on data services for EOSC (06/04/2021)
Keywords: OAI-PMH, metadata, harvesting, SciCat, ICAT, B2FIND, OpenAIRE, research data
Resource type: wiki
Delivering data services to EOSC
https://github.com/ExPaNDS-eu/ExPaNDS/wiki/Delivering-data-services-to-EOSC
https://pan-training.eu/materials/delivering-data-services-to-eosc
Wiki page recording the ExPaNDS training workshop on data services for EOSC (06/04/2021)
OAI-PMH, metadata, harvesting, SciCat, ICAT, B2FIND, OpenAIRE, research data
data curator
research data scientist