Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Issues and approach to develop validated analysis tools for hypersonic flows: One perspective

Critical issues concerning the modeling of low density hypervelocity flows where thermochemical nonequilibrium effects are pronounced are discussed. Emphasis is on the development of validated analysis tools, and the activity in the NASA Ames Research Center's Aerothermodynamics Branch is described. Inherent in the process is a strong synergism between ground test and real gas computational fluid dynamics (CFD). Approaches to develop and/or enhance phenomenological models and incorporate them into computational flowfield simulation codes are discussed. These models were partially validated with experimental data for flows where the gas temperature is raised (compressive flows). Expanding flows, where temperatures drop, however, exhibit somewhat different behavior. Experimental data for these expanding flow conditions is sparse and reliance must be made on intuition and guidance from computational chemistry to model transport processes under these conditions. Ground based experimental studies used to provide necessary data for model development and validation are described. Included are the performance characteristics of high enthalpy flow facilities, such as shock tubes and ballistic ranges.

Deiwert, George S.↗
NASA NTRS2013

Assessment and Applications of NASA Ozone Data Products Derived from Aura OMI-MLS Satellite Measurements in Context of the GMI Chemical Transport Model

Measurements from the Ozone Monitoring Instrument (OMI) and Microwave Limb Sounder (MLS), both onboard the Aura spacecraft, have been used to produce daily global maps of column and profile ozone since August 2004. Here we compare and evaluate three strategies to obtain daily maps of tropospheric and stratospheric ozone from OMI and MLS measurements: trajectory mapping, direct profile retrieval, and data assimilation. Evaluation is based upon an assessment that includes validation using ozonesondes and comparisons with the Global Modeling Initiative (GMI) chemical transport model (CTM). We investigate applications of the three ozone data products from near-decadal and inter-annual timescales to day-to-day case studies. Zonally averaged inter-annual changes in tropospheric ozone from all of the products in any latitude range are of the order 1-2 Dobson Units while changes (increases) over the 8-year Aura record investigated http://eospso.gsfc.nasa.gov/atbd-category/49 vary approximately 2-4 Dobson Units. It is demonstrated that all of the ozone products can measure and monitor exceptional tropospheric ozone events including major forest fire and pollution transport events. Stratospheric ozone during the Aura record has several anomalous inter-annual events including stratospheric warming split events in the Northern Hemisphere extra-tropics that are well captured using the data assimilation ozone profile product. Data assimilation with continuous daily global coverage and vertical ozone profile information is the best of the three strategies at generating a global tropospheric and stratospheric ozone product for science applications.

GMI↗
NASA NTRSDate not supplied

Neural Network Atmospheric Correction of Remote Sensing Imagery Over Water Using a Synthetic Dataset

Remote sensing atmospheric correction methods have primarily focused on imagery over land. However, accurate correction over water is important for monitoring and research of aquatic environments. More research in this area is ongoing, though one of the biggest challenges is enough quality data to develop and validate correction methods. This is especially true for neural network (NN) -based models which have shown promise in this area given enough quality data. To address this deficiency of data, we are leveraging a synthetic dataset produced by a model called SWIPE that uses radiative transfer modeling to simulate the atmospheric effects on water-leaving (WL) reflectance to estimate top-of-atmosphere (TOA) reflectance. This allows us to produce almost unlimited pairs of WL reflectance and corresponding TOA reflectance for model training across a variety of atmospheric conditions. We use two approaches for our atmospheric correction model. One uses a conditional variational autoencoder (VAE) to estimate a single WL reflectance value from a single TOA reflectance value. The second is based on a UNET architecture and estimates an array of WL reflectance values from an array of TOA reflectance values. The goal of the second method is to capture atmospheric effects that occur spatially between values within the array as compared to the first method.

deep learning↗
DOE OSTI2023

Predeployment progress of the Canister Deposition Field Demonstration

This report updates the high-level test plan for evaluating surface deposition on three commercial 32PTH2 spent nuclear fuel (SNF) canisters inside NUTECH Horizontal Modular Storage (NUHOMS) Advanced Horizontal Storage Modules (AHSMs) from Orano (formerly Transnuclear Inc.) and provides a summary of the surface sampling activities that have been conducted to date. The details contained in this report represent the best designs and approaches explored for testing as of this publication. Given the rapidly developing nature of this test program, some of these plans may change to accommodate new objectives or requirements. One goal of this testing is to collect defensible and detailed dust deposition measurements from the surface of dry storage canisters in a marine coastal environment to guide chloride-induced stress corrosion cracking (CISCC) research. Another goal is to provide data for the validation of computational fluid dynamics (CFD) based deposition modeling. To facilitate surface sampling, the otherwise highly prototypic dry storage systems will not contain SNF but rather will be electrically heated to mimic the decay heat and thermal hydraulic environment. Test and heater design is supported by detailed CFD modeling. Instrumentation throughout the canister, storage module, and environment will provide extensive information about the thermal-hydraulic behavior of horizontal dry cask storage systems. Manual sampling over a comprehensive portion of the canister surface at regular time intervals will offer detailed quantification and composition of the deposited particulates from a realistic storage environment. Discussions of a potential host site for the Canister Deposition Field Demonstration (CDFD) are ongoing. Until a host site is chosen, testing of key CDFD hardware components including the heater assemblies, power skid, and remote data acquisition system will continue. Functional testing of the finalized heater assemblies and test apparatus started this fiscal year. These initial heater tests have shown the assemblies are performing within design specifications. Staged surface sampling of a mockup of a canister outside the AHSM on a transfer skid was also performed. Refinements to the sampling procedures and techniques were captured from observation of these activities and lessons-learned debriefs. These updated sampling procedures and techniques are planned to be tested again in the field using the mockup in order to assure personnel are using the most accurate and repeatable methods possible prior to deployment for actual CDFD testing.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2018

Validation of Model-Based Prognostics for Pneumatic Valves in a Cryogenic Fueling Demonstration Testbed

Because valves control many critical operations, they are prime candidates for deployment of prognostic algorithms. But, similar to the situation with most other components, examples of failures experienced in the field are hard to come by. This lack of data impacts the ability to test and validate prognostic algorithms. A solution sometimes employed to overcome this shortcoming is to perform run to failure experiments in a lab. However, the mean time to failure of valves is typically very high (possibly lasting decades), preventing evaluation within a reasonable time frame. Therefore, a mechanism to observe development of fault signatures considerably faster is sought. Described here is a testbed that addresses these issues by allowing the physical injection of leakage faults (which are the most common fault mode) into pneumatic valves. What makes this testbed stand out is the ability to modulate the magnitude of the fault almost arbitrarily fast. With that, the performance of end-of-life estimation algorithms can be tested. Further, the testbed is mobile and can be connected to valves in the field. This mobility helps to bring the overall process of prognostic algorithm development for this valve a step closer to validation. The paper illustrates the development of a model-based prognostic approach that uses data from the testbed for partial validation.

Kulkarni, Chetan S.↗
DOE OSTI2026

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗
NASA NTRSDate not supplied

Modeling and Simulation Credibility Assessment of Finite Element Models for Fall From Heights Injury Scenarios

Finite element (FE) computational models of the whole human body are being used to investigate the injury modalities and mechanisms arising from suited astronauts’ ExtraVehicular Activities (EVAs). These FE whole body models – simplified Elemance and THUMS pedestrian versions – have undergone a series of verification and validation (V&V) assessments for applications in automotive, domestic, and contact sports arenas. However, the FE models’ Modeling and Simulation (M&S) credibility assessments for simulating suited astronaut injuries due to fall from heights in altered gravity environments are limited. The current study evaluates the M&S credibility of simplified Elemance and THUMS pedestrian FE models based on eight credibility factors – data pedigree, input pedigree, code verification, solution verification, conceptual validation, referent validation, results uncertainty, and results robustness – as per NASA-STD-7009A [1]. These credibility factors were assigned ordinal scores ranging between 0 to 4, with a score of 0 in the case of insufficient evidence and 4 when all data for the model is known, used appropriately, and traceable to the Real-World System (RWS) with acceptable accuracy, precision, and uncertainty. The credibility factor sufficiency thresholds were assigned upon guidance from NASA EVA subject matter experts. The factor scores were ascertained through the evaluation of M&S credibility assessment procedures described in the published literature and FE model reports. The M&S credibility scores for the Elemance and THUMS FE models vary between 1 and 3 for data pedigree, input pedigree, and referent validation credibility factors, and between 0 and 1 for code verification, solution verification, conceptual validation, results uncertainty and results robustness. The results show that these FE models are credible for simulating fall from heights injury scenarios in specific kinematic and kinetic ranges that correlate with highway and contact sports-related external conditions. Multiple credibility elevation strategies are prescribed to improve the Elemance and THUMS models’ credibility for use in the EVA fall from height injury scenarios.

R A Perkins↗
DOE OSTI2023

Data Validation Experiments with a Computer-Generated Imagery Dataset for International Nuclear Safeguards

Computer vision models have great potential as tools for international nuclear safeguards verification activities, but off-the-shelf models require fine-tuning through transfer learning to detect relevant objects. Because open-source examples of safeguards-relevant objects are rare, and to evaluate the potential of synthetic training data for computer vision, we present the Limbo dataset. Limbo includes both real and computer-generated images of uranium hexafluoride containers for training computer vision models. Here, we generated these images iteratively based on results from data validation experiments that are detailed here. The findings from these experiments are applicable both for the safeguards community and the broader community of computer vision research using synthetic data.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

LinkML: an open data modeling framework

Background Scientific research relies on well-structured, standardized data; however, much of it is stored in formats such as free-text lab notebooks, nonstandardized spreadsheets, or data repositories. This lack of structure challenges interoperability, making data integration, validation, and reuse difficult. Findings LinkML (Linked Data Modeling Language) is an open framework that simplifies the process of authoring, validating, and sharing data. LinkML can describe a range of data structures, from flat, list-based models to complex, interrelated, and normalized models that utilize polymorphism and compound inheritance. It offers an approachable syntax that is not tied to any one technical architecture and can be integrated seamlessly with many existing frameworks. The LinkML syntax provides a standard way to describe schemas, classes, and relationships, allowing modelers to build well-defined, stable, and optionally ontology-aligned data structures. Once defined, LinkML schemas may be imported into other LinkML schemas. These key features make LinkML an accessible platform for interdisciplinary collaboration and a reliable way to define and share data semantics. Conclusions LinkML helps reduce heterogeneity, complexity, and the proliferation of single-use data models while simultaneously enabling compliance with FAIR (Findable, Accessible, Interoperable, and Reusable) data standards. LinkML has seen increasing adoption in various fields, including biology, chemistry, biomedicine, microbiome research, finance, electrical engineering, transportation, and commercial software development. In short, LinkML makes implicit models explicitly computable and allows data to be standardized at their origin. LinkML documentation and code are available at https://linkml.io/.

AI-ready data↗
DOE OSTI2025

Conformal Hierarchical Simulation-Based Inference with Local Validity

Trustworthy and interpretable uncertainty quantification is a long-standing challenge in artificial intelligence. Simulation-based inference (SBI) comprises a broad swath of approaches for estimating latent parameters with uncertainties. Although flexible neural density estimators in SBI can be remark- ably expressive capturing highly structured, high-dimensional posteriors their credible regions can be badly mis-calibrated and are often only accompanied by heuristic coverage checks. We present the first SBI framework that delivers finite-sample local valid coverage guarantees that hold in the neighborhood of each observation. Our framework can couple any off-the-shelf hierarchical SBI engine with a confor- mal Bayesian post-processing step that operates on the posterior predictive density. A kernel-weighted conformity score adapts the conformal quantile to the local geometry of the data, yielding prediction sets that are simultaneously (i) marginally calibrated, (ii) locally valid, and (iii) hierarchical, handling global and observation-specific parameters in a single pass. Through experiments on synthetic data and benchmarks from neuroscience and physics, we show that our approach attains 1 − α coverage, where prior SBI methods under- or over-cover. Our approach also maintains a competitive, credible set size with minimal computational overhead. Finally, our approach can be used to make predictions on real data and give valid credible regions modulo weight-initialization-based model mis-specification.

Trivedi, Shubhendu [Fermilab]↗
NASA NTRSDate not supplied

Validation of Decompression Sickness Risk Mitigation Protocols for Planetary Spaceflight Missions

BACKGROUND: Apollo missions used a 100% O2 cabin atmosphere which effectively eliminated the risk of decompression sickness (DCS) during extravehicular activity (EVA) on the moon. NASA’s future missions to the moon and Mars are expected to use nitrox gas mixtures of up to 34% O2, 66% N2, which will reduce flammability risk compared with Apollo, but will necessitate Oxygen prebreathe prior to EVA to reduce DCS risk to acceptable levels. Prebreathe protocols used on the space shuttle and International Space Station are validated for microgravity EVAs, but the significantly increased risk of DCS during equivalent ambulatory EVAs make these protocols inapplicable to planetary EVA. An “exploration atmosphere” of 56.5 kPa (8.2 psia), 34% O2, 66% N2 has been recommended by NASA as a compromise that balances prebreathe duration, hypoxia, and flammability risk, assuming a 29.6 kPa (4.3 psi) spacesuit. However, this atmosphere may not be used for vehicles that do not support frequent EVA, and with commercial providers and international providers expected to provide landers, pressurized rovers, habitats, and spacesuits, different combinations of vehicle and spacesuit atmospheres are possible and will each require validated prebreathe protocols. OVERVIEW: Key components of a multi-year strategic roadmap include: 1) Establish hypobaric chamber facility capable of supporting 8-person EVA prebreathe validation tests at saturation atmospheres up to 36% O2; 2) validate an EVA physical workload simulation for use during prebreathe validation testing; 3) validate the recommended “exploration atmosphere” prebreathe protocol; 4) validate prebreathe protocols for additional atmospheric combinations that bound the most likely potential operating ranges of future vehicles and spacesuits; and 5) update DCS risk estimation models based on results of prebreathe validation studies. DISCUSSION: Details and data from completion of the first two steps of the strategic roadmap will be presented; the third step is currently underway, with pilot results provided in a companion presentation. Steps four and five will require a multi-year series of chamber tests; collaborations are being pursued.

Andrew F. J. Abercromby↗
NASA NTRS2018

Improved Hydrology over Peatlands in a Global Land Modeling System

Peatlands of the Northern Hemisphere represent an important carbon pool that mainly accumulated since the last ice age under permanently wet conditions in specific geological and climatic settings. The carbon balance of peatlands is closely coupled to water table dynamics. Consequently, the future carbon balance over peatlands is strongly dependent on how hydrology in peatlands will react to changing boundary conditions, e.g. due to climate change or regional water level drawdown of connected aquifers or streams. Global land surface modeling over organic-rich regions can provide valuable global-scale insights on where and how peatlands are in transition due to changing boundary conditions. However, the current global land surface models are not able to reproduce typical hydrological dynamics in peatlands well. We implemented specific structural and parametric changes to account for key hydrological characteristics of peatlands into NASA's GEOS-5 Catchment Land Surface Model (CLSM, Koster et al. 2000). The main modifications pertain to the modeling of partial inundation, and the definition of peatland-specific runoff and evapotranspiration schemes. We ran a set of simulations on a high performance cluster using different CLSM configurations and validated the results with a newly compiled global in-situ dataset of water table depths in peatlands. The results demonstrate that an update of soil hydraulic properties for peat soils alone does not improve the performance of CLSM over peatlands. However, structural model changes for peatlands are able to improve the skill metrics for water table depth. The validation results for the water table depth indicate a reduction of the bias from 2.5 to 0.2 m, and an improvement of the temporal correlation coefficient from 0.5 to 0.65, and from 0.4 to 0.55 for the anomalies. Our validation data set includes both bogs (rain-fed) and fens (ground and/or surface water influence) and reveals that the metrics improved less for fens. In addition, a comparison of evapotranspiration and soil moisture estimates over peatlands will be presented, albeit only with limited ground-based validation data. We will discuss strengths and weaknesses of the new model by focusing on time series of specific validation sites.

Bechtold, M.↗
NASA NTRS1993

Operational characterisation of requirements and early validation environment for high demanding space systems

The definition of some modern high demanding space systems requires a different approach to system definition and design from that adopted for traditional missions. System functionality is strongly coupled to the operational analysis, aimed at characterizing the dynamic interactions of the flight element with its surrounding environment and its ground control segment. Unambiguous functional, operational and performance requirements are to be defined for the system, thus improving also the successive development stages. This paper proposes a Petri Nets based methodology and two related prototype applications (to ARISTOTELES orbit control and to Hermes telemetry generation) for the operational analysis of space systems through the dynamic modeling of their functions and a related computer aided environment (ISIDE) able to make the dynamic model work, thus enabling an early validation of the system functional representation, and to provide a structured system requirements data base, which is the shared knowledge base interconnecting static and dynamic applications, fully traceable with the models and interfaceable with the external world.

Barro, E.↗
DOE OSTI2023

Multi-decade high-resolution regional hindcasts for wave energy resource characterization in U.S. coastal waters

Long-term, high-resolution, regional wave hindcast datasets were generated using unstructured-grid Simulating WAves Nearshore (SWAN) models for the U.S. coastal waters to support nearshore wave energy development in the U.S. including those bordering U.S. territorial islands. The model domains resolved the entire U.S. exclusive economic zones, with a spatial resolution of approximately 200 m nearshore. The regional SWAN models were driven by the global WAVEWATCH III® model outputs and run for a 42-year period from 1979 to 2020. Extensive model validations were performed using buoy observations and altimeter data. Regional resource characterization was performed based on hindcast data points at 2 km from shore and along the 100 m isobath. Aggregations of wave resource parameters were produced, and spatial and seasonal variations were analyzed for all the regions. Wave resource metrics recommended by international standards, including a 3-hour time series of six resource parameters, hourly frequency- and directionally resolved wave spectra at selected “virtual buoy” locations, and average-annual values of omni-directional wave power, significant wave height, and energy period are publicly disseminated through an Amazon Web Service and a Marine Energy Atlas web application tool to facilitate wave energy research and a wide range of coastal ocean applications.

16 TIDAL AND WAVE POWER↗
NASA NTRS2017

Pilot Wave Model for Impulsive Thrust from RF Test Device Measured in Vacuum

A physics model is developed in detail and its place in the taxonomy of ideas about the nature of the quantum vacuum is discussed. The experimental results from the recently completed vacuum test campaign evaluating the impulsive thrust performance of a tapered RF test article excited in the TM212 mode at 1,937 megahertz (MHz) are summarized. The empirical data from this campaign is compared to the predictions from the physics model tools. A discussion is provided to further elaborate on the possible implications of the proposed model if it is physically valid. Based on the correlation of analysis prediction with experimental data collected, it is proposed that the observed anomalous thrust forces are real, not due to experimental error, and are due to a new type of interaction with quantum vacuum fluctuations.

White, Harold↗
DOE OSTI2024

Validation Exercise of a Coarse Finite Element Model of Laser Welds

The objective of this project is to validate low-fidelity models of 304L to 304L stainless steel partial-penetration laser welds for thin sheets. Low-fidelity means that the weld is represented by coarsely meshed element blocks. Here, the hexahedral element size is approx imately half the weld penetration depth. The material behavior of the block is represented by a J2 plasticity model with a Voce hardening function. The source of the data used in this work is an extensive experimental study conducted by Sharlotte Kramer (1528) and published in 2015. Figure 1 shows a cross-section of the weld of interest. The nominal thickness of the sheets is 0.063 in. while the target penetration depth of the weld is in the range of 0.028 to 0.032 in., extending about half the sheet thickness. Uniaxial tension tests provided data for calibration of base material and weld models. Results of two validation geometries were also provided. The principal validation geometry is shown in Fig. 2. It consists of a plate specimen with in-plane dimensions 6 in × 2.875 in loaded in tension. A circular plug with a 1.5 in. diameter was cut from the center of the plate and then welded in place. The details of the welding schedule are given. An important assumption is that the welds in the calibration and validation specimens have similar geometric and material properties as those in the validation tests. The task was to first calibrate models for the base material and the welds and then simulate the validation tests until the point of weld first failure.

36 MATERIALS SCIENCE↗
NASA NTRS1997

On the Directional Dependence and Null Space Freedom in Uncertainty Bound Identification

In previous work, the determination of uncertainty models via minimum norm model validation is based on a single set of input and output measurement data. Since uncertainty bounds at each frequency is directionally dependent for multivariable systems, this will lead to optimistic uncertainty levels. In addition, the design freedom in the uncertainty model has not been utilized to further reduce uncertainty levels. The above issues are addressed by formulating a min- max problem. An analytical solution to the min-max problem is given to within a generalized eigenvalue problem, thus avoiding a direct numerical approach. This result will lead to less conservative and more realistic uncertainty models for use in robust control.

Lim, K. B.↗
NASA NTRS2009

Serial Network Flow Monitor

Using a commercial software CD and minimal up-mass, SNFM monitors the Payload local area network (LAN) to analyze and troubleshoot LAN data traffic. Validating LAN traffic models may allow for faster and more reliable computer networks to sustain systems and science on future space missions. Research Summary: This experiment studies the function of the computer network onboard the ISS. On-orbit packet statistics are captured and used to validate ground based medium rate data link models and enhance the way that the local area network (LAN) is monitored. This information will allow monitoring and improvement in the data transfer capabilities of on-orbit computer networks. The Serial Network Flow Monitor (SNFM) experiment attempts to characterize the network equivalent of traffic jams on board ISS. The SNFM team is able to specifically target historical problem areas including the SAMS (Space Acceleration Measurement System) communication issues, data transmissions from the ISS to the ground teams, and multiple users on the network at the same time. By looking at how various users interact with each other on the network, conflicts can be identified and work can begin on solutions. SNFM is comprised of a commercial off the shelf software package that monitors packet traffic through the payload Ethernet LANs (local area networks) on board ISS.

Robinson, Julie A.↗