Standardized Algorithm Documentation for Improved Scientific Data Understanding: The Algorithm Publication Tool Prototype
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Astronauts are subject to unique stressors during spaceflight, leading to changes in their cellular function. However, neither astronauts nor model organisms respond the same to spaceflight, and research implicates a contribution of omics components in differential responses. Understanding how gene expression affects astronaut health is critical for the success of long-term space missions, prompting interest in developing personalized predictive models leveraging artificial intelligence (AI) and machine learning (ML) techniques. Developing such models requires extensive data, which is challenging to obtain and share. This study explores the use of conditional variational autoencoders (CVAEs) to synthetically generate single-nuclei RNA-seq (snRNA-seq) data. CVAEs build on standard variational autoencoders (VAEs) by conditioning data generation on covariates like sample identity and mission parameters, enhancing the relevance of generated data for specific contexts. For our work, we built two CVAEs with varying degrees of sparsity to optimize both interpretability and generative power. We train and validate models on existing snRNA-seq data collected from the brain tissue of mice subjected to spaceflight conditions and their ground control counterparts. We evaluate model performance using statistical tests and visualizations to compare synthetic data to real data. We aim to demonstrate that these prototype CVAE architectures could be used in future space biology work and that this is a method worth further exploring.
Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.
The Crew Earth Observations (CEO) Facility within the Earth Science and Remote Sensing Unit at NASA’s Johnson Space Center supports the acquisition, analysis, and curation of astronaut photography of Earth’s surface and atmosphere. Astronauts on the International Space Station (ISS) respond to requests from CEO to acquire imagery of scientific and education targets, to include high profile targets in response to activations from the International Charter for Space & Major Disasters (also known as the International Disaster Charter, or IDC) and NASA’s Disasters Program. CEO facilitates the acquisition of astronaut photography in response to IDC events and delivers georeferenced data products to the United States Geological Survey (USGS) for distribution to the disaster community. Using GeoRef, an internal web-based tool developed in collaboration with NASA’s Ames Research Center, CEO generates data packages of georeferenced imagery, uncertainty images for assessing control and tie point accuracy, and metadata documenting raw and processed data. Operational experience with the Georef software identified vulnerabilities to internal code and server errors that can significantly increase time of data production. As such, CEO developed a backup procedure in case the GeoRef software experiences front-end or back-end errors. A system using OSGEO’s open-source QGIS software combined with a semi-automated pipeline using the object-oriented Python language and the Geospatial Abstract Library for generating metadata is quantitatively compared to GeoRef’s data package for quality and productivity. Root Mean Square Error (RMSE) provides a standard measurement of data quality as it relates to ground error. Assessing RMSE measurements generated from georeferenced astronaut photographs acquired with different obliquity and focal length offers a comprehensive accuracy assessment of the software’s transformation algorithms. This assessment will indicate the software's ability to produce data products with the least ground-error or highest data quality regarding ground accuracy. In addition, a comparison of the software’s efficiency in generating a data package that includes georeferenced images, metadata, and uncertainty images for measuring tie/ground point error was performed. Initial results, based on the comparison of three nadir-facing astronaut photographs acquired with a 95mm focal length, reveal the QGIS-based system's average RMSE is 2.36 (pixels) suggesting its georectification system produces data products that meet and perhaps improve upon Georef solution's average RMSE of 32.99 (pixels). However, the QGIS system was unable to reproduce two unique Georef data products, uncertainty images for measuring tie and control point errors and a translated unwrapped image. In addition, the Georef software is designed to accept handheld camera pose information from a hardware component (Geosens) scheduled for deployment on the ISS in late 2018; this information is intended to provide increased accuracy and auto-registration capability for astronaut photographs. Future work is expected to determine the QGIS-based georectification system’s potential as an open-source alternative (and operational backup) to Georef for georeferencing the full range of resolutions and viewing angles unique to handheld digital camera imagery in support of ISS disaster response activities.
Long-term data sets with data from many missions are needed to study trends and validate model results that are typical in Earth System Science research. Data and derived products originate from multiple missions (spaceborne, airborne and/or in situ) and from multiple organizations. During the missions as well as well past their termination, it is essential to preserve the data and products to support future studies. Key aspects of preservation are: preserving bits and ensuring data are uncorrupted, preserving understandability with appropriate documentation, and preserving reproducibility of science with appropriate documentation and other artifacts. Computer technology provides adequate standards to ensure that, with proper engineering, bits are preserved as hardware evolves. However, to ensure understandability and reproducibility, it is essential to plan ahead to preserve all the relevant data and information. There are currently no standards to identify the content that needs to be preserved, leading to non-uniformity in content and users not being sure of whether preserved content is comprehensive. Each project, program or agency can specify the items to be preserved as a part of its data management requirements. However, broader community consensus that cuts across organizational or national boundaries would be needed to ensure comprehensiveness, uniformity and long-term utility of archived data. The Federation of Earth Science Information Partners (ESIP), a diverse network of scientists, data stewards and technology developers, has a forum for ESIP members to collaborate on data preservation issues. During early 2011, members discussed the importance of developing a Provenance and Context Content Standard (PCCS) and developed an initial list of content items. This list is based on the outcome of a NASA and NOAA meeting held in 1998 under the auspices of the USGCRP, documentation requirements from NOAA and our experience with some of the NASA Earth science missions. The items are categorized into the following 8 high level categories: Preflight/Pre-Operations, Products (Data), Product Documentation, Mission Calibration, Product Software, Algorithm Input, Validation, Software Tools.
The US Department of Energy Office of Nuclear Energy (DOE-NE) Office of Spent Fuel and High-Level Waste Disposition is examining a set of system options and conducting supporting analyses to inform the development of an integrated waste management system, which may include one or more federal staging facilities (FSFs) for used nuclear fuel (UNF ) sited using a collaborative siting process. This paper focuses on the ongoing activities in two systems engineering and analysis work areas: (1) data and tools development, validation, and maintenance and (2) systems engineering execution. Within the first work area, the STANDARDS 5.0 UNF data and analysis tool, formerly known as UNF-ST&DARDS, is being developed as a foundational resource to assist in the management of UNF data. It has the key capability to model UNF throughout the entire back end of the fuel cycle. STANDARDS also includes several compatible analysis tools for the time-dependent characterization of UNF and related systems by interfacing with the SCALE code system for nuclear analysis and COBRA-SFS for thermal analysis. Also, within the data and tools area is the Next Generation System Analysis Model (NGSAM), which is an agent-based simulation software tool expressly designed to be capable of modeling the waste management system, including the transportation of UNF to and from a FSF. NGSAM has been developed to enable informed decision-making by providing the capability to analyze various potential system options for the management of UNF and high-level radioactive waste. Finally, in the systems engineering execution area, the team has begun to apply a disciplined systems engineering approach at the system level along with supporting analysis to guide the development of the FSF project requirements (including associated transportation infrastructure). Systems engineering principles and practices and their adaptation/application to design and development activities will ensure that the waste management system is effectively implemented as work proceeds. Other activities include investigating the implications of changes in various assumptions and parameters related to waste management systems, such as UNF acceptance rates, receipt logic, facility capacities and capabilities, use of standardized canisters, and different assumed facility operation start dates. Keywords: federal staging facility (FSF), used nuclear fuel (UNF), integrated waste management (IWM) system, Next Generation System Analysis Model (NGSAM), STANDARDS, systems engineering
It is shown that the use of a two-parameter limbshift and a meridional flow velocity fits solar velocity data better than the standard analysis defined by Howard et al. (1980). The data used are the coarse residual velocity arrays, with 34 equal intervals in both sine latitude and sine longitude. There are a total of 2899 full-disk observations between January 1, 1967, and December 12, 1980. The original velocity fields are reconstructed by adding into the residual arrays the large-scale patterns that were measured and removed on a daily basis by a standard reduction. Tests of this reconstituded data set show that no significant errors are introduced in the analysis of large-scale velocity fields. The results of the analysis presented here imply that the study of solar velocity pattern at the level of a few m/s requires that magnetic regions be treated separately from nonmagnetic regions.
Benchmarking is essential for high-performance software development, particularly for monitoring performance across code iterations. This project focused on enhancing the benchmarking process for Lamellar, an asynchronous runtime for High-Performance Computing (HPC) systems developed at Pacific Northwest National Laboratory. Prior to this work, benchmark results were difficult to track and compare across code versions, presenting significant challenges in identifying performance regressions and long-term trends. The primary objective was to establish a systematic, reproducible approach for measuring performance and detecting regressions following code commits. Our methodology involved three key components: standardizing benchmark outputs, implementing data versioning, and developing analysis tools. We standardized the benchmark output format to JSON Line records containing specific fields (execution time, hardware specifications, and environmental variables). To address data management challenges, we evaluated several options and eventually chose a git repository dedicated to benchmark data. We developed a suite of Python tools that processed benchmark results, enriched them with metadata, and facilitated search in the repository. The resulting system enables more efficient filtering and comparison of performance metrics across commit histories, hardware configurations, and benchmark variants through a unified query interface. Our implementation reduces computational overhead by first checking for existing results through configuration matching before initiating new benchmark runs, thereby conserving resources. The system has been validated by Lamellar developers. It organizes results by benchmark type and build configurations for efficient retrieval. Future developments include a planned Large Language Model interface for predicting benchmark performance, incorporating the criterion package for statistical analysis, which will enable automated detection of statistically significant performance changes, and integration with continuous integration pipelines. Despite these enhancements being reserved for future work, this project has successfully provided the Lamellar development team with a framework for maintaining consistent performance standards and identifying optimization opportunities across workloads and hardware environments.
The International Criticality Safety Benchmark Evaluation Project (ICSBEP) is an initiative to provide high-quality benchmark data in a standardized format for criticality safety analysts to use to validate calculational tools and nuclear data. In the last released 2022 version, the ICSBEP handbook contains over 5,000 critical experiment descriptions, results, and associated models. This paper describes the critical configurations proposed and calculations performed as part of the conceptual design phase of Integral Experiment Request (IER) 554 (IER-554). The goal of IER-554 is to add to the benchmark experiments available to the criticality safety community by designing critical experiments that can analyze how adding commercially available Boralcan plates to an assembly of low-enriched UO2 fuel rods affects the effective neutron multiplication factor (k eff ). Boralcan, a neutron absorber product developed by Rio Tinto, is made of B4C in an Al 1100 matrix and is commonly used for criticality suppression in fuel storage pools. In the current version of the ICSBEP handbook, only a few dated critical experiments involve B4C materials, and none involve Boralcan in a thin plate shape. The experiments designed as part of IER-554 are intended to be performed at the Sandia Pulsed Reactor Facility/Critical Experiments (SPRF/CX) apparatus at Sandia National Laboratories. SPRF/CX is a well-characterized assembly considered trustworthy by the benchmarking community because of the numerous high-quality evaluations with very low experimental uncertainties included in the ICSBEP handbook. Figure 1 illustrates the assembly for a particular configuration from LCT-078, one of the published benchmarks in the ICSBEP handbook. The experiments will be moderated and reflected by light water at ambient atmospheric pressure. Before the plates are inserted in the critical assembly, they will be characterized with x-ray computed tomography (XCT) to identify the sizes and distribution of the B 4 C powder particles inside the plates. The preliminary design calculations were performed with SCALE 6.3.0 using the KENO V.a sequence for the criticality calculations, the CE-TSUNAMI-3D sequence for the sensitivity and uncertainty studies, and the ENDF/B-VII.1 Continuous Energy cross section library. All the calculation results presented have 10 pcm statistical uncertainties. A set of critical experiments with Boralcan plates could increase the confidence of the criticality safety community in its modeling methods when using this type of neutron absorber material. Experiments would also help validate k eff calculations, and the industry could use these validations to change the B loading credit limits from the US Nuclear Regulatory Commission standard review plan for dry cask storage of spent nuclear fuel. This paper summarizes only part of the analysis documented in the preliminary design report.
A method for determining the fast-ion population density in magnetically confined plasmas as a function of pitch-radius, (λ, R), using a solid-state neutral-particle analyzer (ssNPA) signal and neutral-beam injection (NBI) power-output data has been developed. Oscillations in the NBI power output are replicated only in the active part of the ssNPA signal, allowing this to be separated from the passive and background signals, which usually complicate data from this diagnostic. Results obtained using this method are compared with those from standard techniques using data from the Mega-Amp Spherical Tokamak Upgrade spherical tokamak.
Ground based pyranometer measurements were combined with meteorological data from the Tiros N satellite in order to estimate clear-sky insolations at five U.S. sites for five weeks during the spring of 1979. The estimates were used to develop a semi-empirical model of clear-sky insolation for the interpretation of input data from the Tiros Operational Vertical Sounder (TOVS). Using only satellite data, the estimated standard errors in the model were about 2 percent. The introduction of ground based data reduced errors to around 1 percent. It is shown that although the errors in the model were reduced by only 1 percent, TOVS data products are still adequate for estimating clear-sky insolation.
The Consultative Committee for Space Data Systems (CCSDS) Recommendations for Packet Telemetry (PT) and Advanced Orbiting Systems (AOS) propose standard solutions to data handling problems common to many types of space missions. The Recommendations address only space/ground and space/space data handling systems. Goddard Space Flight Center's (GSFC's) AOS Testbed (AOST) Program was initiated to better understand the Recommendations and their impact on real-world systems, and to examine the extended domain of ground/ground data handling systems. The results and products of the Program will reduce the uncertainties associated with the development of operational space and ground systems that implement the Recommendations.
Across the Earth, both civilian and government endeavors enjoy a built-in reliance on a position, navigation, and timing (PNT) infrastructure to which they are largely blind. Whether walking, driving, flying, or orbiting, Earth-centric PNT systems that have evolved over decades provide a core functionality to which we have grown accustomed for these pursuits. As NASA joins with other government space agencies and commercial partners to return humans to the Moon in a sustained manner within the current decade, expectations for PNT knowledge and timeliness at the Moon rival those on Earth. The need exists to develop a viable lunar-centric PNT infrastructure to support the planned human and robotic exploits. Navigating within the influence of the Moon presents its own set of challenges. Identification, understanding, and use of a unified reference frame and time system on which navigation is based becomes a fundamental need at the Moon. In addition to the unified foundational elements, measurement liability, dynamic conditions that require Earth-independent autonomous operations, and standards for PNT signals and message-based data exchange each represent distinct challenges to navigation in a burgeoning operational lunar environment. The PNT services planned as part of the lunar communications and navigation relay architecture known as LunaNet aid in surmounting the challenges. LunaNet interoperability specifications stipulate standards for signal parameters, messages, and lunar reference systems for PNT services. Within LunaNet’s defined interoperability resides the concept of a Reference Signal to provide communication signals specifically structured to enable measurement of pseudorange, Doppler, and time transfer by the recipient. One such signal type, the Augmented Forward Signal (AFS), functions as the mainstay for LunaNet PNT, while also serving the data needs for ubiquitous broadcast of network access and rapid unscheduled dissemination of alerts and messages. The presence of a geometrically distributed network of orbiting nodes transmitting the AFS forms the basis for the Lunar Augmented Navigation System (LANS), that delivers both radio navigation and data to multiple users in the lunar environment simultaneously. After reviewing the challenges associated with lunar navigation, this paper will describe the concepts and rationale behind the LunaNet PNT services. By borrowing techniques from Earth-centric Global Navigation Satellite Services (GNSS), the Tracking and Data Relay Satellite System, and the Consultative Committee for Space Data Standards, PNT from LunaNet aids to overcome challenges faced for accurate lunar navigation.
Across the Earth, both civilian and government endeavors enjoy a built-in reliance on a position, navigation, and timing (PNT) infrastructure to which they are largely blind. Whether walking, driving, flying, or orbiting, Earth-centric PNT systems that have evolved over decades provide a core functionality to which we have grown accustomed for these pursuits. As NASA joins with other government space agencies and commercial partners to return humans to the Moon in a sustained manner within the current decade, expectations for PNT knowledge and timeliness at the Moon rival those on Earth. The need exists to develop a viable lunar-centric PNT infrastructure to support the planned human and robotic exploits. Navigating within the influence of the Moon presents its own set of challenges. Identification, understanding, and use of a unified reference frame and time system on which navigation is based becomes a fundamental need at the Moon. In addition to the unified foundational elements, measurement liability, dynamic conditions that require Earth-independent autonomous operations, and standards for PNT signals and message-based data exchange each represent distinct challenges to navigation in a burgeoning operational lunar environment. The PNT services planned as part of the lunar communications and navigation relay architecture known as LunaNet aid in surmounting the challenges. LunaNet interoperability specifications stipulate standards for signal parameters, messages, and lunar reference systems for PNT services. Within LunaNet’s defined interoperability resides the concept of a Reference Signal to provide communication signals specifically structured to enable measurement of pseudorange, Doppler, and time transfer by the recipient. One such signal type, the Augmented Forward Signal (AFS), functions as the mainstay for LunaNet PNT, while also serving the data needs for ubiquitous broadcast of network access and rapid unscheduled dissemination of alerts and messages. The presence of a geometrically distributed network of orbiting nodes transmitting the AFS forms the basis for the Lunar Augmented Navigation System (LANS), that delivers both radio navigation and data to multiple users in the lunar environment simultaneously. After reviewing the challenges associated with lunar navigation, this paper will describe the concepts and rationale behind the LunaNet PNT services. By borrowing techniques from Earth-centric Global Navigation Satellite Services (GNSS), the Tracking and Data Relay Satellite System, and the Consultative Committee for Space Data Standards, PNT from LunaNet aids to overcome challenges faced for accurate lunar navigation.
This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks.
An effort is now underway to produce a new evaluation of the neutron standards. It is important to maintain experimental programs to increase the quality and extend the database for the neutron cross section standards in order to improve evaluations of them that will be used to convert cross section measurements made relative to those standards. Measurements have been made for most of the standard cross sections since the last evaluation of the standards. The improved database includes the cross sections for the H(n,n), 6Li(n,t), 10B(n,αγ), 10B(n,α), C(n,n), Au(n,γ), 235U(n,f) and 238U(n,f) standard reactions and ratios among them. The database also includes the 238U(n,γ) and 239Pu(n,f) cross sections in addition to the standard cross sections. Those data were included since there are many ratio measurements of those cross sections with the standards and absolute data are available for them.
The following tasks were prioritized: software acquisition management plan; space station flight data system architectural study; space station user data system interface; automation of software development process; automation of software testing; distributed data base management; ADA (automated data acquisition) evaluation and transition and planning; network operating system software; fault tolerant computer validation methodology for onboard data management system; systems integration; artificial intelligence/expert systems; space station data network concept; space station standard interface protocols; space station data networks systems; integrated software development facility; and language trade studies.