Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “FAIR data principles”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

HPC-FAIR: A Framework Managing Data and AI Models for Analyzing and Optimizing Scientific Applications

The increasing reliance on machine learning (ML) to analyze and optimize large-scale scientific applications on supercomputers faces a significant bottleneck: the lack of readily available, high-quality training datasets and the difficulty in reusing existing AI models. This project was motivated by the urgent need to address the “FAIR” principles (Findability, Accessibility, Interoperability, Reusability) for both training datasets and AI models in the high-performance computing (HPC) domain. The project developed HPC-FAIR, a high-performance computing data management framework designed to centralize HPC-related datasets and AI models within a unified hub. To ensure interoperability, the framework established a standardized representation and vocabulary (ontology) for both data and models. HPC-FAIR also implemented automated workflows to streamline data processing, model access, and benchmarking. Additionally, the project focused on optimizing data harnessing efficiency through advanced techniques like deep reuse and compression-based analytics.

97 MATHEMATICS AND COMPUTING↗

Making digital objects FAIR in high energy physics: An implementation for Universal FeynRules Output (UFO) models

Research in the data-intensive discipline of high energy physics (HEP) often relies on domain-specific digital contents. Reproducibility of research relies on proper preservation of these digital objects. This paper reflects on the interpretation of principles of Findability, Accessibility, Interoperability, and Reusability (FAIR) in such context and demonstrates its implementation by describing the development of an end-to-end support infrastructure for preserving and accessing Universal FeynRules Output (UFO) models guided by the FAIR principles. UFO models are custom-made python libraries used by the HEP community for Monte Carlo simulation of collider physics events. Our framework provides simple but robust tools to preserve and access the UFO models and corresponding metadata in accordance with the FAIR principles.

Neubauer, Mark S.↗

Building the I (Interoperability) of FAIR for performance reproducibility of large-scale composable workflows in RECUP

Abstract-Scientific computing communities increasingly run their experiments using complex data- and compute-intensive workflows that utilize distributed and heterogeneous architectures targeting numerical simulations and machine learning, often executed on the Department of Energy Leadership Computing Facilities (LCFs). We argue that a principled, systematic approach to implementing FAIR principles at scale, including fine-grained metadata extraction and organization, can help with the numerous challenges to performance reproducibility posed by such workflows. We extract workflow patterns, propose a set of tools to manage the entire life cycle of performance metadata, and aggregate them in an HPC-ready framework for reproducibility (RECUP). We describe the challenges in making these tools interoperable, preliminary work, and lessons learned from this experiment.

97 MATHEMATICS AND COMPUTING↗

Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science

This paper summarizes the current state of reproducibility and replicability in the fields of climate and paleoclimate science, including brief histories of their development and applications in climate science, new and recent approaches towards improvement of reproducibility and replicability, and challenges. Recommendations for addressing those challenges include: development of searchable, auto-updated, interlinked, multi-archive public paleoclimate repositories for raw and processed digital datasets; cross-center standardized code base cases, improved data storage techniques, and a focus on replicability for climate simulation storage and access; and support of the development and community awareness of findable, accessible, interoperable and reusable (FAIR) principles by funding agencies and publishers. This paper is largely based on the May 2018 presentations of a panel of researchers to the Committee on Reproducibility and Replicability in Science, part of the National Academies of Science, Engineering, and Medicine. The commentary and recommendations made here are in alignment with those of its Consensus Study Report on Reproducibility and Replicability in Science (2019).

data repositories↗

A Motion-Compensating Image-Compression Scheme

Chrominance used (in addition to luminance) in estimating motion. Variable-rate digital coding scheme for compression of color-video-image data designed to deliver pictures of good quality at moderate compressed-data rate of 1 to 2 bits per pixel, or of fair quality at rate less than 1 bit per pixel. Scheme, in principle, implemented by use of commercially available application-specific integrated circuits. Incorporates elements of some prior coding schemes, including motion compensation (MC) and discrete cosine transform (DCT).

Wong, Carol↗

FAIR principles and the IEDB: short-term improvements and a long-term vision of OBO-foundry mediated machine-actionable interoperability

The Immune Epitope Database (IEDB), at www.iedb.org, has the mission to make published experimental data relating to the recognition of immune epitopes easily available to the scientific public. By presenting curated data in a searchable database, we have liberated it from the tables and figures of journal articles, making it more accessible and usable by immunologists. Recently, the principles of Findability, Accessibility, Interoperability and Reusability have been formulated as goals that data repositories should meet to enhance the usefulness of their data holdings. We here examine how the IEDB complies with these principles and identify broad areas of success, but also areas for improvement. We describe short-term improvements to the IEDB that are being implemented now, as well as a long-term vision of true ‘machine-actionable interoperability’, which we believe will require community agreement on standardization of knowledge representation that can be built on top of the shared use of ontologies.

59 BASIC BIOLOGICAL SCIENCES↗

AGES AND METALLICITIES OF CLUSTER GALAXIES IN A779 USING MODIFIED STROeMGREN PHOTOMETRY

In the quest for the formation and evolution of galaxy clusters, Rakos and co-workers introduced a spectrophotometric method using modified Stroemgren photometry, but with the considerable debate toward the project's abilities, we re-introduce the system by testing for the repeatability of the modified Stroemgren colors and compare them with the Stroemgren colors, and check for the reproducibility of the ages and metallicities (using the Principle Component Analysis (PCA) technique and the GALEV models) for the six common galaxies in all three A779 data sets. As a result, a fair agreement between two filter systems was found to produce similar colors (with a precision of 0.09 mag in (uz - vz), 0.02 mag in (bz - yz), and 0.03 mag in (vz - vz)) and the generated ages and metallicities are also similar (with an uncertainty of 0.36 Gyr and 0.04 dex from PCA and 0.44 Gyr and 0.2 dex using the GALEV models). We infer that the technique is able to relieve the age-metallicity degeneracy by separating the age effects from the metallicity effects, but it is still unable to completely eliminate it. We further extend this paper to re-study the evolution of galaxies in the low mass, dynamically poor A779 cluster (as it was not elaborately analyzed by Rakos and co-workers in their previous work) by correlating the luminosity (mass), density, and radial distance with the estimated age, metallicity, and the star formation history. Our results distinctly show the bimodality of the young, low-mass, metal-poor population with a mean age of 6.7 Gyr ({+-} 0.5 Gyr) and the old, high-mass, metal-rich galaxies with a mean age of 9 Gyr ({+-} 0.5 Gyr). The method also observes the color evolution of the blue cluster galaxies to red (Butcher-Oemler phenomenon), and the downsizing phenomenon. Our analysis shows that modified Stroemgren photometry is very well suited for studying low- and intermediate-z clusters, as it is capable of observing deeper with better spatial resolution at spectroscopic redshift limits, and the narrowband filters estimate the age and metallicity with fewer uncertainties compared to other methods that study stellar population scenarios.

79 ASTRONOMY AND ASTROPHYSICS↗

Coulomb sum rule for 4 He and 16 O from coupled-cluster theory

We demonstrate the capability of coupled-cluster theory to compute the Coulomb sum rule for the 4 He and 16 O nuclei using interactions from chiral effective field theory. We perform several checks, including a few-body benchmark for 4He. We provide an analysis of the center-of-mass contaminations, which we are able to safely remove. We then compare with other theoretical results and experimental data available in the literature, obtaining a fair agreement. This is a first and necessary step towards initiating a program for computing neutrino-nucleus interactions from first principles in coupled-cluster theory and supporting the experimental long-baseline neutrino program with a state-of-the-art theory that can reach medium-mass nuclei.

6 ≤ A ≤ 19A ≤ 5↗

Design Principles for Smallsat SARs

Synthetic Aperture Radar (SAR) is by now a mature remote sensing technique to obtain spatially-resolved radar measurements of terrain. Currently, SAR image data are readily available from an ever-expanding multitude of SAR satellites in Earth orbit. Many spaceborne SAR systems currently in use or planned for the near-term are multifunctional: their designs tend to maximize the menu of image modes available to the end user. They also follow fairly conventional design principles, laid down decades ago, that lead almost inevitably to large antennas and even larger spacecraft. This raises the question: how does one go about designing a SAR system that fits in a Smallsat (<200 kg) form factor? The design principles for Smallsat SARs outlined in this paper have been developed over a twenty-year period in architecting Earth-orbiting SARs such as NASA/JPL’s NISAR and ESA’s Biomass mission, as well as planetary SAR mission concepts. Example mission concepts following this approach will be presented at the end of the paper. These include an S-Band Smallsat geodetic constellation to measure surface deformation, as called for by the 2018 National Academy Decadal Survey for Earth Observation from Space. Another example is a Ka-band cubesat-sized system designed to detect changes on Earth’s surface.

Freeman, Anthony↗

CAMELSH: A Large-Sample Hourly Hydrometeorological Dataset and Attributes at Watershed-Scale for CONUS

We present CAMELSH (Catchment Attributes and Hourly HydroMeteorology for Large-Sample Studies), the first large-sample hydrometeorological dataset at the hourly scale for the contiguous United States. CAMELSH intergrates hourly meteorological time series, catchment attributes and boundaries from GAGES-II and HydroATLAS for 9,008 catchments across diverse climatic, hydrological, and anthropogenic conditions. In addition, hourly streamflow time series is provided for 3,166 catchments. The dataset spans 45 years (1980–2024) with 11 meteorological variables from the NLDAS-2 forcing dataset, from which we compute nine climate indices related to precipitation, evapotranspiration, seasonality, and snow fraction. Additionally, CAMELSH includes two sets of catchment attributes: 439 from GAGES-II and 195 derived from HydroATLAS. These attributes include factors related to climate, geology, hydrology, river/stream morphology, landscape, nutrient, soil, topography, and anthropogenic influences. Developed in accordance with FAIR (Findability, Accessibility, Interoperability, and Reusability) principles, CAMELSH is the first large-sample dataset at an hourly timescale, supporting machine learning applications for short-term streamflow (flood) prediction and advancing data-driven hydrological research across multiple timescales.

54 ENVIRONMENTAL SCIENCES↗

Implementation of FAIR principles in the IPCC: the WGI AR6 Atlas repository

The Sixth Assessment Report (AR6) of the Intergovernmental Panel on Climate Change (IPCC) has adopted the FAIR Guiding Principles. We present the Atlas chapter of Working Group I (WGI) as a test case. We describe the application of the FAIR principles in the Atlas, the challenges faced during its implementation, and those that remain for the future. We introduce the open source repository resulting from this process, including coding (e.g., annotated Jupyter notebooks), data provenance, and some aggregated datasets used in some figures in the Atlas chapter and its interactive companion (the Interactive Atlas), open to scrutiny by the scientific community and the general public. We describe the informal pilot review conducted on this repository to gather recommendations that led to significant improvements. Finally, a working example illustrates the re-use of the repository resources to produce customized regional information, extending the Interactive Atlas products and running the code interactively in a web browser using Jupyter notebooks.

54 ENVIRONMENTAL SCIENCES↗

FAIRness and Usability for Open-Access Omics Data Systems

Omics data sharing is especially crucial to the biological research community, and the last decade or two has seen a huge rise in collaborative analysis systems, databases, and knowledge bases for omics and other systems biology data. We assessed the "FAIRness" of NASA's GeneLab Data Systems (GLDS) along with four similar kinds of systems in the research omics data domain, using 14 FAIRness metrics. 14 metrics. The range of Pass ratings was 29-79% of the 14 metrics, Partial Pass 0-21%, and Fail 7-50%. The range of overall FAIRness scores was 5-12 (out of 14). The systems we evaluated performed the best in the areas of data findability and accessibility, and worst in the area of data interoperability. We propose two new principles that Big Data systems, in particular, should consider for increasing data accessibility. We relate our experiences implementing semantic integration of omics data from several systems for the federated querying and retrieval functions of the GLDS, given the shortcomings in data interoperability of these systems.

Berrios, Daniel C.↗

Codebase release 2.0 for UFOManager

Research in the data-intensive discipline of high energy physics (HEP) often relies on domain-specific digital contents. Reproducibility of research relies on proper preservation of these digital objects. This paper reflects on the interpretation of principles of Findability, Accessibility, Interoperability, and Reusability (FAIR) in such context and demonstrates its implementation by describing the development of an end-to-end support infrastructure for preserving and accessing Universal FeynRules Output (UFO) models guided by the FAIR principles. UFO models are custom-made python libraries used by the HEP community for Monte Carlo simulation of collider physics events. Our framework provides simple but robust tools to preserve and access the UFO models and corresponding metadata in accordance with the FAIR principles.

Neubauer, Mark S.↗

Open-Source and FAIR Research Software for Proteomics

Scientific discovery relies on innovative software as much as experimental methods, especially in proteomics, where computational tools are essential for mass spectrometer setup, data analysis, and interpretation. Since the introduction of SEQUEST, proteomics software has grown into a complex ecosystem of algorithms, predictive models, and workflows, but the field faces challenges, including the increasing complexity of mass spectrometry data, limited reproducibility due to proprietary software, and difficulties integrating with other omics disciplines. Closed-source, platform-specific tools exacerbate these issues by restricting innovation, creating inefficiencies, and imposing hidden costs on the community. Open-source software (OSS), aligned with the FAIR Principles (Findable, Accessible, Interoperable, Reusable), offers a solution by promoting transparency, reproducibility, and community-driven development, which fosters collaboration and continuous improvement. In this manuscript, we explore the role of OSS in computational proteomics, its alignment with FAIR principles, and its potential to address challenges related to licensing, distribution, and standardization. Drawing on lessons from other omics fields, we present a vision for a future where OSS and FAIR principles underpin a transparent, accessible, and innovative proteomics community.

97 MATHEMATICS AND COMPUTING↗

Sample preparation and biomass determination of SRF model mixture using cryogenic milling and the adapted balance method

Highlights: • An alternative sample comminution procedure for SRF is tested. • Proof of principle is shown on a SRF model mixture. • The biogenic content of the SRF is analyzed with the adapted balance method. • The novel method combines combustion analysis and a data reconciliation algorithm. • Factors for the variance of the analysis results are statistically quantified. - Abstract: The biogenic fraction of a simple solid recovered fuel (SRF) mixture (80 wt% printer paper/20 wt% high density polyethylene) is analyzed with the in-house developed adapted balance method (aBM). This fairly new approach is a combination of combustion elemental analysis (CHNS) and a data reconciliation algorithm based on successive linearisation for evaluation of the analysis results. This method shows a great potential as an alternative way to determine the biomass content in SRF. However, the employed analytical technique (CHNS elemental analysis) restricts the probed sample mass to low amounts in the range of a few hundred milligrams. This requires sample comminution to small grain sizes (<200 μm) to generate representative SRF specimen. This is not easily accomplished for certain material mixtures (e.g. SRF with rubber content) by conventional means of sample size reduction. This paper presents a proof of principle investigation of the sample preparation and analysis of an SRF model mixture with the use of cryogenic impact milling (final sample comminution) and the adapted balance method (determination of biomass content). The so derived sample preparation methodology (cutting mills and cryogenic impact milling) shows a better performance in accuracy and precision for the determination of the biomass content than one solely based on cutting mills. The results for the determination of the biogenic fraction are within 1–5% of the data obtained by the reference methods, selective dissolution method (SDM) and {sup 14}C-method ({sup 14}C-M)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Inversion of vegetation canopy reflectance models for estimating agronomic variables. III - Estimation using only canopy reflectance data as illustrated by the suits model. IV - Total inversion of the SAIL model

The possibility of estimating agronomic and spectral parameters for a vegetation canopy from the canopy reflectance (CR) data in the infrared region is investigated for a set of solar/view directions. It is shown that such an estimation is possible, in principle, for the Suits (1972) model for a homogeneous canopy. The technique is then applied to a more complex model, the SAIL (scattering by arbitrarily inclined leaves) model which explicitly includes the leaf angle distribution in the computation of the canopy reflectance. It is concluded that, given the expected accuracy of CR measurements and the accuracy of the SAIL model in representing CR in the infrared region, the agronomic parameters, leaf area index, and leaf angle distribution can be estimated fairly accurately using ancillary data on spectral parameters.

Goel, N. S.↗