ExPaNDS Workshop - Follow a user story! A journey through the PaN data services.
The ExPaNDS Workshop "Follow a user story", which took place on the 24th of January in Hamburg, Germany (hybrid), aimed to provide a "User Journey", taking the audience on the road of the "European Open Science Cloud Photon and Neutron Data Services".
The objective was to demonstrate how as...
Keywords: expands, EOSC, data services, FAIR, VISA, PaN portal
Resource type: slides, video
ExPaNDS Workshop - Follow a user story! A journey through the PaN data services.
https://zenodo.org/record/7599600
https://pan-training.eu/zenodomaterials/expands-workshop-follow-a-user-story-a-journey-through-the-pan-data-services
The ExPaNDS Workshop "Follow a user story", which took place on the 24th of January in Hamburg, Germany (hybrid), aimed to provide a "User Journey", taking the audience on the road of the "European Open Science Cloud Photon and Neutron Data Services".
The objective was to demonstrate how as a user, one can benefit from the services developed during the project.
The story began with a FAIR journey presented by Brian Matthews, an EOSC demo from Marta Gutierrez, followed by a demo of the training platform from Oliver Knodel. The last two stops of the journey were two demos from the VISA portal (Silvan Schoen and Michael Schuh) and the search API/Harvesting services (PaN Portal, etc) presented by Carlo Minotti. The session was chaired by Clara Albert.
Find the presentations & prerecorded demos on Zenodo.
The recording will be available very soon.
expands, EOSC, data services, FAIR, VISA, PaN portal
ETH Lib4RI: Research Data Management – The Basics
Research data management best practices in the ETH Lib4RI, the Library for the Research Institutes within the ETH Domain: Eawag, Empa, PSI & WSL
Keywords: data catalogue, data management, metadata, SciCat
Resource type: slides
ETH Lib4RI: Research Data Management – The Basics
https://www.lib4ri.ch/sites/default/files/media/documents/2023_05_PhD-Training_RDM_PSI_web.pdf
https://pan-training.eu/materials/eth-lib4ri-research-data-management-the-basics
Research data management best practices in the ETH Lib4RI, the Library for the Research Institutes within the ETH Domain: Eawag, Empa, PSI & WSL
data catalogue, data management, metadata, SciCat
research scientists
postdocs
PhD students
ExPaNDS and PaNOSC project members
PaN users
PaN Community
researchers
Self-evaluation Photon and Neutron RIs for FAIR data certification
This ExPaNDS project deliverable describes a FAIR self-assessment undertaken by the ten
ExPaNDS partner Photon and Neutron Research Infrastructures (PaN RIs) over the
three-month period July – September 2022. After reviewing selected examples of existing
FAIR evaluation frameworks designed to...
Keywords: FAIR, metadata, expands, European Photon and Neutron facilities , wp2-ExPaNDS
Resource type: Document
Self-evaluation Photon and Neutron RIs for FAIR data certification
https://zenodo.org/record/7246802
https://pan-training.eu/materials/self-evaluation-photon-and-neutron-ris-for-fair-data-certification
This ExPaNDS project deliverable describes a FAIR self-assessment undertaken by the ten
ExPaNDS partner Photon and Neutron Research Infrastructures (PaN RIs) over the
three-month period July – September 2022. After reviewing selected examples of existing
FAIR evaluation frameworks designed to enable assessment at different levels (dataset,
repository, and organisation), the report describes the evaluation approach adopted for the
ExPaNDS FAIR self-assessment. As no existing framework met our specific need to focus
on FAIR workflows and processes in PaN RIs, it was necessary to select, combine, and
adapt existing frameworks. Supported by four underlying guiding principles, our approach
drew heavily on the FAIR Principles, the RDA FAIR Data Maturity Model, and FAIRsFAIR’s
CoreTrustSeal+FAIRenabling framework. Post-evaluation feedback from ExPaNDS partners
indicated that they found the FAIR self-assessment a useful and valuable exercise for
understanding current levels of FAIRness at their facilities and for articulating what
implementations they have in progress or planned to support FAIR in future. A key output of
the ExPaNDS FAIR evaluation is the collected self-assessment reports from the ten partner
facilities. These reports are published openly and in full as part of the deliverable. In addition,
the self-assessments are supplemented with some high-level observations on the state of
the FAIR journey across the ExPaNDS facilities.
FAIR, metadata, expands, European Photon and Neutron facilities , wp2-ExPaNDS
PaN Community
Joint Public Session ExPaNDS/PaNOSC on metadata catalogues (SciCat implementation) and future perspectives
Presentations from public joint WP3 Meeting for ExPaNDS and PaNOSC, which took place in hybrid format from SOLEIL (France) and via Zoom on the 3rd November 2022.
A recording of the event can be found on the ExPaNDS website: https://expands.eu/presentations/
Video recording (direct link to...
Keywords: expands, PaNOSC, open data, wp3-ExPaNDS
Resource type: slides
Joint Public Session ExPaNDS/PaNOSC on metadata catalogues (SciCat implementation) and future perspectives
https://expands.eu/presentations/#WP3PublicMeeting
https://pan-training.eu/materials/work-package-3-public-meeting
Presentations from public joint WP3 Meeting for ExPaNDS and PaNOSC, which took place in hybrid format from SOLEIL (France) and via Zoom on the 3rd November 2022.
A recording of the event can be found on the ExPaNDS website: https://expands.eu/presentations/
Video recording (direct link to vimeo) will be available soon.
expands, PaNOSC, open data, wp3-ExPaNDS
data managers
Final recommendations for FAIR Photon and Neutron Data Management
The present deliverable pursues the work initiated in ExPaNDS deliverable 2.2, which established a common metadata framework for FAIR data generated in Photon and Neutron (PaN) facilities. The modalities of implementation of this framework across facilities are examined and current practices and...
Keywords: expands, wp2-ExPaNDS, FAIR, data management
Resource type: Document
Final recommendations for FAIR Photon and Neutron Data Management
https://zenodo.org/record/6821676#.YwiWdnHP02w
https://pan-training.eu/materials/final-recommendations-for-fair-photon-and-neutron-data-management
The present deliverable pursues the work initiated in ExPaNDS deliverable 2.2, which established a common metadata framework for FAIR data generated in Photon and Neutron (PaN) facilities. The modalities of implementation of this framework across facilities are examined and current practices and tools for metadata capture, storage and exposure are highlighted. This work is also the occasion to examine the commonalities of the framework with other initiatives developed inside and outside ExPaNDS such as the common search API, the data catalogues (ExPaNDS WP3), the EOSC discovery platforms B2FIND and OpenAire as well as the NeXus data format. It also provides the reader with guidelines on current tools and schemata available to record provenance and digital preservation information. The essence of these discussions is summarised as a list of practical recommendations at the end.
expands, wp2-ExPaNDS, FAIR, data management
PaN Community
Workshop on Metadata Catalogues
Presentations from the Workshop on Metadata Catalogues, which took place virtually via Zoom on the 4th April 2022.
Keywords: data catalogue, SciCat, ICAT, expands, panet, PaNOSC, metadata, data management, data processing, wp3-ExPaNDS
Resource type: slides, video
Workshop on Metadata Catalogues
https://zenodo.org/record/6414117
https://pan-training.eu/materials/workshop-on-metadata-catalogues
Presentations from the Workshop on Metadata Catalogues, which took place virtually via Zoom on the 4th April 2022.
data catalogue, SciCat, ICAT, expands, panet, PaNOSC, metadata, data management, data processing, wp3-ExPaNDS
data curator
data managers
research data engineer
ExPaNDS and PaNOSC project members
PaN users
PaN Community
ExPaNDS mid-term review
Slides of the presentations done during the ExPaNDS midterm review.
Keywords: expands
Resource type: slides
ExPaNDS mid-term review
https://indico.desy.de/event/30039/
https://pan-training.eu/materials/expands-mid-term-review
Slides of the presentations done during the ExPaNDS midterm review.
expands
ExPaNDS and PaNOSC project members
Demonstrate ICAT and SciCat released with APIs compatible with ExPaNDS federated EOSC services
Demonstration release of ICAT and SciCat with APIs compatible with ExPaNDS federated EOSC services and its connection to milestone Metadata catalogue as EOSC service in the domain of photon and neutron (PaN) science
Keywords: D3.3, wp3-ExPaNDS
Demonstrate ICAT and SciCat released with APIs compatible with ExPaNDS federated EOSC services
https://zenodo.org/record/6363591
https://pan-training.eu/materials/demonstrate-icat-and-scicat-released-with-apis-compatible-with-expands-federated-eosc-services
Demonstration release of ICAT and SciCat with APIs compatible with ExPaNDS federated EOSC services and its connection to milestone Metadata catalogue as EOSC service in the domain of photon and neutron (PaN) science
D3.3, wp3-ExPaNDS
PaNET implementation by the pan-ontologies-API RESTful service
The application provides a data catalogue independent implementation retrieval and processing of ontologies from an external source. Currently, only the PaNET ontology is implemented. Below is a schematic data flow depicting the role of the pan-ontologies-api.
Keywords: expands, PaNOSC, data catalogue, ontology, wp3-ExPaNDS
Resource type: git, github, Git Project
PaNET implementation by the pan-ontologies-API RESTful service
https://github.com/ExPaNDS-eu/pan-ontologies-api
https://pan-training.eu/materials/pan-ontologies-api
The application provides a data catalogue independent implementation retrieval and processing of ontologies from an external source. Currently, only the PaNET ontology is implemented. Below is a schematic data flow depicting the role of the pan-ontologies-api.
expands, PaNOSC, data catalogue, ontology, wp3-ExPaNDS
PaN Community
ExPaNDS and PaNOSC project members
ExPaNDS Guidance Note: Key Policy Elements within a Photon and Neutron Research Infrastructure Data Policy Framework (revised - final version)
The text of this ExPaNDS Guidance Note is extracted from ExPaNDS deliverable [D2.3: Final data policy framework for Photon and Neutron RIs](https://doi.org/10.5281/zenodo.5205824). The Guidance Note covers the 21 elements that comprise the final version of the ExPaNDS data policy framework. These...
Keywords: data policy, expands, FAIR, wp2-ExPaNDS
Resource type: Document
ExPaNDS Guidance Note: Key Policy Elements within a Photon and Neutron Research Infrastructure Data Policy Framework (revised - final version)
https://doi.org/10.5281/zenodo.6090282
https://pan-training.eu/materials/expands-guidance-note-key-policy-elements-within-a-photon-and-neutron-research-infrastructure-data-policy-framework-revised-final-version
The text of this ExPaNDS Guidance Note is extracted from ExPaNDS deliverable [D2.3: Final data policy framework for Photon and Neutron RIs](https://doi.org/10.5281/zenodo.5205824). The Guidance Note covers the 21 elements that comprise the final version of the ExPaNDS data policy framework. These elements fall under nine broad themes:
1. General drivers and principles
2. Roles and responsibilities
3. Scope
4. Enabling FAIR data
5. Necessary restrictions to data sharing
6. Availability of infrastructure and responsibility for costs
7. Data management planning requirements
8. Recognition and reward for data usage
9. Reporting requirements, compliance monitoring, and any possible sanctions
The Guidance Note is intended as a short-form, ready-access tool for policy makers working on data policy within Photon and Neutron Research Infrastructures. For additional context around the development of the ExPaNDS data policy framework, see the D2.3 deliverable and its earlier, draft version [D2.1: Draft extended data policy framework for photon and neutron RIs](https://doi.org/10.5281/zenodo.4014811).
data policy, expands, FAIR, wp2-ExPaNDS
Develop common rules and best practices between national RI’s and harmonize the provision of the EOSC services
Slides (and other resources) of the presentations done at this workshop.
How is ExPaNDS delivering its data services to PaNOSC and EOSC?
- Day 1. Data catalogues: getting our open datasets harvested by the community
- Day 2. Data analysis: getting our software in the PaN software...
Keywords: expands, workshop, SciCat, ICAT, B2FIND, OpenAIRE, EOSC, OAI-PMH, data catalogue, wp1-ExPaNDS
Develop common rules and best practices between national RI’s and harmonize the provision of the EOSC services
https://indico.desy.de/event/29297/
https://pan-training.eu/materials/develop-common-rules-and-best-practices-between-national-ri-s-and-harmonize-the-provision-of-the-eosc-services
Slides (and other resources) of the presentations done at this workshop.
How is ExPaNDS delivering its data services to PaNOSC and EOSC?
- Day 1. Data catalogues: getting our open datasets harvested by the community
- Day 2. Data analysis: getting our software in the PaN software catalogue, getting pipelines to run, ensuring their quality over time
expands, workshop, SciCat, ICAT, B2FIND, OpenAIRE, EOSC, OAI-PMH, data catalogue, wp1-ExPaNDS
PaN Community
ExPaNDS and PaNOSC project members
Metadata Catalogue Release
Self-contained, stand-alone metadata catalogue release that facilities can download to test/try and play with.
Keywords: ICAT, SciCat, PaNOSC, data catalogue, expands, wp3-ExPaNDS
Resource type: docker, docker-compose, software, git
Metadata Catalogue Release
https://zenodo.org/record/5205909#.YYE4fb_MKV5
https://pan-training.eu/materials/metadata-catalogue-release
Self-contained, stand-alone metadata catalogue release that facilities can download to test/try and play with.
ICAT, SciCat, PaNOSC, data catalogue, expands, wp3-ExPaNDS
PaN Community
ExPaNDS and PaNOSC project members
engineers
research data engineer
ExPaNDS mapping dcat ontology and Nexus
Different communities have developed their terminology and are maintaining their metadata schemata or lists of vocabulary. In order to facilitate sharing of data across communities and allow collaboration between heterogeneous systems, interoperability of these vocabularies is required. In ...
Keywords: expands, ontology, mapping, NeXus, DCAT, semantic integration, wp3-ExPaNDS
Resource type: git, tool
ExPaNDS mapping dcat ontology and Nexus
https://github.com/ExPaNDS-eu/ExPaNDS-nexus-dcat-mapping-ontology
https://pan-training.eu/materials/expands-mapping-dcat-ontology-and-nexus
Different communities have developed their terminology and are maintaining their metadata schemata or lists of vocabulary. In order to facilitate sharing of data across communities and allow collaboration between heterogeneous systems, interoperability of these vocabularies is required. In order to increase data interoperability and enable data integration, these vocabularies need to be semantically integrated with other vocabularies and their terms have to be aligned. This enables the development of a common shared vocabulary.
expands, ontology, mapping, NeXus, DCAT, semantic integration, wp3-ExPaNDS
PaN Community
ExPaNDS NeXusOntology
NeXusOntology: Machine-readable ontology of the NeXus definitions.
The published ontology describes the NeXus standard, it does not define the standard.
This ontology extracts information about NeXus classes and fields from NeXus nxdl definition files on the NeXus GitHub site.
This...
Keywords: NeXus, ontology, expands, wp3-ExPaNDS
Resource type: git, tool
ExPaNDS NeXusOntology
https://github.com/nexusformat/NeXusOntology/tree/main
https://pan-training.eu/materials/expands-nexusontology-machine-readable-ontology-of-the-nexus-definitions
NeXusOntology: Machine-readable ontology of the NeXus definitions.
The published ontology describes the NeXus standard, it does not define the standard.
This ontology extracts information about NeXus classes and fields from NeXus nxdl definition files on the NeXus GitHub site.
This project was undertaken under ExPaNDS WP3.2.
The ontology is designed to fulfil several purposes. First, it creates unique identifiers for each of the NeXus fields which would normally exist only within the namespaces of the defining NeXus classes. This is the primary goal and provides PIDs for annotation and tagging. The second purpose is to allow, via separate ontologies, NeXus fields and classes to be mapped onto equivalent or related terms defined elsewhere.
Finally, we hope that this ontology, when used with a tool such as Protege, will provide a useful 'NeXus Explorer' tool to gain a quick overview of NeXus with links to official NeXus documentation.
NeXus, ontology, expands, wp3-ExPaNDS
PaN Community
ExPaNDS Photon and Neutron Experimental Techniques (PaNET) ontology
The Photon and Neutron Experimental Technique (PaNET) ontology provides a taxonomy of experimental techniques relevant for the Photon and Neutron (PaN) community. This ontology is being developed as part of the Work Package 3 on EOSC Data Catalogue Services for PaN national Research...
Keywords: panet, expands, ontology, experimental techniques, wp3-ExPaNDS
Resource type: git, tool
ExPaNDS Photon and Neutron Experimental Techniques (PaNET) ontology
https://github.com/ExPaNDS-eu/ExPaNDS-experimental-techniques-ontology
https://pan-training.eu/materials/expands-photon-and-neutron-experimental-techniques-panet-ontology
The Photon and Neutron Experimental Technique (PaNET) ontology provides a taxonomy of experimental techniques relevant for the Photon and Neutron (PaN) community. This ontology is being developed as part of the Work Package 3 on EOSC Data Catalogue Services for PaN national Research Infrastructures of the ExPaNDS project.
The ontology allows to add semantic tags to datasets, and other related research objects, to indicate the experimental technique(s) that was (or were) used to create them.
panet, expands, ontology, experimental techniques, wp3-ExPaNDS
PaN Community
ExPaNDS D3.2: Ontologies v1.0
We present ontologies for the domain of photon and neutron (PaN) science. With the primary goal of supporting PaN FAIR data catalogue services, we have developed three ontologies: PaN experimental techniques (PaNET), an ontology of NeXus definitions (NeXusOntology), and a semantic integration...
Keywords: expands, ontology, EOSC, Photon science, experimental techniques, Neutron science, deliverable, D3.2, wp3-ExPaNDS
Resource type: Document
ExPaNDS D3.2: Ontologies v1.0
https://doi.org/10.5281/zenodo.4806026
https://pan-training.eu/materials/expands-d3-2-ontologies
We present ontologies for the domain of photon and neutron (PaN) science. With the primary goal of supporting PaN FAIR data catalogue services, we have developed three ontologies: PaN experimental techniques (PaNET), an ontology of NeXus definitions (NeXusOntology), and a semantic integration ontology for the PaN domain (PaNmapping). The ontologies are presented as initial versions, supported by community development workflows. The work represents deliverable D3.2 of the Horizon 2020 ExPaNDS project.
expands, ontology, EOSC, Photon science, experimental techniques, Neutron science, deliverable, D3.2, wp3-ExPaNDS
ExPaNDS D2.3: Final data policy framework for Photon and Neutron RIs
ExPaNDS deliverable D2.3: Final data policy framework for photon and neutron RIs, considers how data policies for research infrastructures providing photon and neutron facilities should be framed, in particular in the light of supporting open science and FAIR data. It builds on and revises the...
Keywords: expands, data policy, wp2-ExPaNDS
Resource type: Document
ExPaNDS D2.3: Final data policy framework for Photon and Neutron RIs
https://doi.org/10.5281/zenodo.5205825
https://pan-training.eu/materials/expands-d2-3-final-data-policy-framework-for-photon-and-neutron-ris
ExPaNDS deliverable D2.3: Final data policy framework for photon and neutron RIs, considers how data policies for research infrastructures providing photon and neutron facilities should be framed, in particular in the light of supporting open science and FAIR data. It builds on and revises the initial policy framework presented in ExPaNDS deliverable D2.1: Draft extended data policy framework for photon and neutron RIs.To produce the final, revised version of our data policy framework, ExPaNDS undertook a series of detailed consultation meetings with all ten of our partner PaN RIs. Drawing extensively on quotes from the write ups of those conversations, this report presents the themes that emerged from the consultation, focusing especially on those that featured most often and most strongly.Based on the consultation feedback, we present a revised version of the ExPaNDS data policy framework, which now proposes 21 elements for RIs to consider when formulating data policy.Overall, the consultation provided an opportunity to engage deeply in discussion with ExPaNDS partners about data policy and policy making. The consultation feedback and the level of engagement with the consultation process itself highlight ExPaNDS partners’ strong interest in data policy. There is a clear recognition that having an appropriate data policy is fundamental to supporting good research data management. While some differing views exist, ExPaNDS partners express consensus on key fundamental aspects of the data policy framework, especially the importance of a high level commitment to FAIR data. There is also the strong recognition that flexibility in a data policy framework is vital to accommodating the diversity found across national PaN RIs.As well as incorporating the final version ExPaNDS data policy framework as a key output, our report concludes with two overarching points:Data policy diversity will remain across ExPaNDS partner facilitiesData policy is a powerful and important tool for national PaN RIs.It is clear from the consultation feedback that the ExPaNDS data policy framework is already having an impact on facilities’ plans for future work, especially around ensuring that key implementations are in place to support FAIR data. Further work within ExPaNDS, for example, around PIDs, metadata, and FAIR assessment, will provide guidance to support these activities.
expands, data policy, wp2-ExPaNDS
Delivering data services to EOSC
Wiki page recording the ExPaNDS training workshop on data services for EOSC (06/04/2021)
Keywords: OAI-PMH, metadata, harvesting, SciCat, ICAT, B2FIND, OpenAIRE, research data, wp3-ExPaNDS
Resource type: wiki
Delivering data services to EOSC
https://github.com/ExPaNDS-eu/ExPaNDS/wiki/Delivering-data-services-to-EOSC
https://pan-training.eu/materials/delivering-data-services-to-eosc
Wiki page recording the ExPaNDS training workshop on data services for EOSC (06/04/2021)
OAI-PMH, metadata, harvesting, SciCat, ICAT, B2FIND, OpenAIRE, research data, wp3-ExPaNDS
data curator
research data scientist