Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Predicting RNA structure and dynamics with deep learning and solution scattering

Advanced deep learning and statistical methods can predict structural models for RNA molecules. However, RNAs are flexible, and it remains difficult to describe their macromolecular conformations in solutions where varying conditions can induce conformational changes. Small-angle x-ray scattering (SAXS) in solution is an efficient technique to validate structural predictions by comparing the experimental SAXS profile with those calculated from predicted structures. There are two main challenges in comparing SAXS profiles to RNA structures: the absence of cations essential for stability and charge neutralization in predicted structures and the inadequacy of a single structure to represent RNA’s conformational plasticity. We introduce a solution conformation predictor for RNA (SCOPER) to address these challenges. This pipeline integrates kinematics-based conformational sampling with the innovative deep learning model, IonNet, designed for predicting Mg 2+ ion binding sites. Validated through benchmarking against 14 experimental data sets, SCOPER significantly improved the quality of SAXS profile fits by including Mg 2+ ions and sampling of conformational plasticity. We observe that an increased content of monovalent and bivalent ions leads to decreased RNA plasticity. Therefore, carefully adjusting the plasticity and ion density is crucial to avoid overfitting experimental SAXS data. SCOPER is an efficient tool for accurately validating the solution state of RNAs given an initial, sufficiently accurate structure and provides the corrected atomistic model, including ions.

59 BASIC BIOLOGICAL SCIENCES↗

The Role of Snowmelt Temporal Pattern in Flood Estimation for a Small Snow‐Dominated Basin in the Sierra Nevada

Abstract Prior research confirmed the substantial bias from using precipitation‐based intensity‐duration‐frequency curves (PREC‐IDF) in design flood estimates and proposed next‐generation IDF curves (NG‐IDF) that represent both rainfall and snow processes in runoff generation. This study improves the NG‐IDF technology for a snow‐dominated test basin in the Sierra Nevada. A well‐validated physics‐based hydrologic model, the Distributed Hydrology Soil Vegetation Model (DHSVM), is used to continuously simulate snowmelt and streamflow that are used as benchmark data sets to systematically assess the NG‐IDF technology. We find that, for the studied small snow‐dominated basin, the use of standard rainfall hyetographs in the NG‐IDF technology leads to substantial underestimation of design floods. Thus, we propose probabilistic hyetographs that can represent unique patterns of events with different underlying mechanisms. For the test basin where flooding events are generated entirely by snowmelt, we develop a hyetograph that characterizes snowmelt temporal patterns, which greatly improves the performance of NG‐IDF technology in design flood estimates. In contrast to the standard rainfall hyetographs characterized by a symmetrically peaked, bell‐shaped curve, the snowmelt hyetograph displays a more rapid rise (i.e., greater intensity) and a distinct diurnal pattern influenced by solar energy input. The results also show that the uncertainty of hyetography plays an important role in design flood estimation and can have important implications for future flood projections.

54 ENVIRONMENTAL SCIENCES↗

A Hybrid Biophysical‐Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing

Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy ( LE ) and sensible heat ( H ) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R 2 = 0.81–0.94) and H (R 2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

evapotranspiration↗

Aboveground Biomass Estimation Using NISAR Simulated ALOS-2 Time Series Data

Aboveground biomass (AGB) is a critical parameter to better understand the global carbon cycle and to develop sustainable forest management. However, a large uncertainty prevails. L-band SAR data have demonstrated strong potential to accurately retrieve AGB over low-biomass regions (<100 Mg ha-1). The upcoming NASA-ISRO Synthetic Aperture Radar mission will collect data at L- and S-band over earth’s landmass with a repeat period of 12 days, allowing us to have ample data for monitoring biomass and its dynamics. One of the key science requirements of the mission is to produce annual AGB maps at 1-ha resolution with RMS accuracy of 20 Mg/ha for 80 percentage of area over low-biomass regions in Calibration/Validation sites. The NISAR biomass algorithm will generate AGB maps based on the parameterization of semi-empirical model along with NISAR time-series dual pol data (HH and HV). To calibrate and validate the model for mission requirements, the mission will use reference estimates of AGB produced from ground inventory plots and airborne LiDAR data collected over selected sites distributed across different global ecoregions. This paper presents the initial results of the calibration/validation of the NISAR AGB retrieval algorithm over the Lenoir Landing (LENO), Alabama, USA site using NISAR simulated ALOS-2 time series data. Five multi-temporal dual-pol HH and HV NISAR Simulated ALOS 2 data collections were used as input to assess the performance of the model. The model AGB retrieval results shows that the NISAR model was able to achieve RMS accuracy within 20 Mg/ha.

Ramachandran, Naveen [Jet Propulsion Laboratory, C↗

Quantifying Variability and Controls of Riverine Dissolved Organic Carbon Exported to Arctic Coastal Margins of North America (Final Report)

This project involved implementation and application of a coupled permafrost hydrology and dissolved organic carbon process models to investigate how spatial and seasonal variations in terrestrial hydrology and soil freeze/thaw dynamics influence the mobilization, loading, and export of organic carbon to the stream network for selected arctic basins across northern Alaska and northwest Canada. The model simulations were constrained by detailed observations of in- stream chemistry, soil active layer profile moisture and temperature dynamics, streamflow, soil carbon inventories and satellite microwave remote sensing based assessments of surface soil freeze-thaw dynamics. We developed and applied the numerical modeling and data analysis, incorporating observed data for calibration and validation, in order to investigate the terrestrial hydrology, permafrost dynamics, and associated DOC production and loading to rivers across a region encompassing watersheds draining to the coast. The project produced six publications and three datasets archived in public repositories.

54 ENVIRONMENTAL SCIENCES↗

WEC-SIM Support for an Innovative Zero Discharge Supercritical Water Based Wave Energy Desalination System (CRADA Final Report)

NREL will assist East Carolina University in its development of the foundational knowledge and proof of concept that are needed for future process scale up and commercialization of a sustainable wave-to-water (direct pressurization) desalination unit powered by a wave energy converter. NREL will provide guidance and support to East Carolina University on its: use of the NREL developed WEC-Sim based wave to water system, exploring the WEC-Sim/ASPEN Plus data exchange communication, and using experimental data to hopefully provide validation of analytical models.

16 TIDAL AND WAVE POWER↗

Large Eddy Simulation of Externally Induced Ingress about an Axial Seal by Stator Vanes

Turbine inlet temperatures in advanced gas turbines could be as high as 2000 °C. To prevent ingress of this hot gas into the wheelspace between the stator and rotor disks, whose metals can only handle temperatures up to 850 °C, rim seals and sealing flows are used. This study examines the abilities of large eddy simulation (LES) based on the WALE subgrid model and Reynolds-averaged Navier–Stokes (RANS) based on the SST model in predicting ingress in a rotor–stator configuration with vanes but no blades, a configuration with experimental data for validation. Results were obtained for an operating condition, where the ratio of the external Reynolds number to the rotational Reynolds number is 0.538. At this operating condition, both LES and RANS were found to correctly predict the coefficient of pressure, C p , located downstream of the vanes and upstream of the seal, but only LES was able to correctly predict the sealing effectiveness. This shows C p by itself is inadequate in quantifying externally induced ingress. RANS was unable to predict the sealing effectiveness because it significantly under predicted the pressure drop in the hot gas path along the axial direction, especially about the seal region. This affected the pressure difference across the seal in the radial direction, which ultimately drives ingress.

42 ENGINEERING↗

DSCOVR/EPIC-derived global hourly and daily downward shortwave and photosynthetically active radiation data at 0.1° × 0.1° resolution

Downward shortwave radiation (SW) and photosynthetically active radiation (PAR) play crucial roles in Earth system dynamics. Spaceborne remote sensing techniques provide a unique means for mapping accurate spatiotemporally continuous SW–PAR, globally. However, any individual polar-orbiting or geostationary satellite cannot satisfy the desired high temporal resolution (sub-daily) and global coverage simultaneously, while integrating and fusing multisource data from complementary satellites/sensors is challenging because of co-registration, intercalibration, near real-time data delivery and the effects of discrepancies in orbital geometry. The Earth Polychromatic Imaging Camera (EPIC) on board the Deep Space Climate Observatory (DSCOVR), launched in February 2015, offers an unprecedented possibility to bridge the gap between high temporal resolution and global coverage and characterize the diurnal cycles of SW–PAR globally. In this study, we adopted a suite of well-validated data-driven machine-learning models to generate the first global land products of SW–PAR, from June 2015 to June 2019, based on DSCOVR/EPIC data. The derived products have high temporal resolution (hourly) and medium spatial resolution (0.1°×0.1°), and they include estimates of the direct and diffuse components of SW–PAR. We used independently widely distributed ground station data from the Baseline Surface Radiation Network (BSRN), the Surface Radiation Budget Network (SURFRAD), NOAA's Global Monitoring Division and the U.S. Department of Energy's Atmospheric System Research (ASR) program to evaluate the performance of our products, and we further analyzed and compared the spatiotemporal characteristics of the derived products with the benchmarking Clouds and the Earth's Radiant Energy System Synoptic (CERES) data. We found both the hourly and daily products to be consistent with ground-based observations (e.g., hourly and daily total SWs have low biases of -3.96 and -0.71 W m -2 and root-mean-square errors (RMSEs) of 103.50 and 35.40 W m -2 , respectively). The developed products capture the complex spatiotemporal patterns well and accurately track substantial diurnal, monthly, and seasonal variations in SW–PAR when compared to CERES data. They provide a reliable and valuable alternative for solar photovoltaic applications worldwide and can be used to improve our understanding of the diurnal and seasonal variabilities of the terrestrial water, carbon and energy fluxes at various spatial scales.

54 ENVIRONMENTAL SCIENCES↗

Report of the panel on theoretical aerodynamics

Interactions between theoretical aerodynamics and the NTF are discussed. The development and validation of computational fluid dynamics computer codes, the determination of Reynolds number scaling laws, and extension of the data bases of entrainment type turbulence models to include high Reynolds number data are recommended areas of study. The major benefit theoretical aerodynamics could have on the NTF is in the quantitative description of wind tunnel wall interference effects.

South, J. C., Jr.↗

Satellite and correlative measurements of the stratospheric aerosol. I An optical model for data conversions

A description is presented of an empirically based model of stratospheric aerosol optical properties (size distributions and refractive indices) and their variations. The need for such a model arose in the data validation and archival programs for two satellite sensors, SAM II and SAGE. These programs require the ability to convert measurements of a given aerosol macroproperty (e.g., volume extinction coefficient, volume backscatter coefficient, particle number or mass per unit volume) to best estimates of other aerosol macroproperties, and to assess quantitatively the uncertainties in the conversion process. The described model provides the information on size distributions, refractive indices and their variations necessary for these tasks, and also defines a procedure for combining the model information with empirical data in a way that facilitates automatic data processing. Although the model was developed for use in the satellite validation and archival programs, it also has proven useful in other studies of stratospheric aerosol.

Russell, P. B.↗

Initial Shuttle external tank flight evaluation

The objective of this paper is to evaluate aerothermal flight measurements made on the Space Shuttle External Tank (ET) during its initial flights. The ETs have been adequately instrumented to measure various quantities during flight including heat transfer, pressure, and structural temperature. The flight data have been compared with mathematical models based on an extensive wind tunnel data base, realistic flowfields, and empirical heat-transfer relationships. An analysis of the results points out the validity of the current aeroheating methodology and existing data base, and identifies problem areas in the methodology as indicated by the flight data.

Praharaj, S. C.↗

Influence of bulk turbulence and entrance boundary layer thickness on the curved duct flow field

The influence of bulk turbulence and boundary layer thickness on the secondary flow development in a square, 90 degree turning duct was investigated. A three-dimensional laser velocimetry system was utilized to measure the mean and fluctuating components of velocity at six cross-planes in the duct. The results from this investigation, with entrance boundary layer thickness of 20 percent, were compared with the thin boundary layer results documented in NASA CR-174811. The axial velocity profiles, cross-flow velocities, and turbulence intensities were compared and evaluated with regard to the influence of bulk turbulence intensity and boundary layer thickness, and the influence was significant. The results of this investigation expand the 90 degree curved duct experimental data base to higher turbulence levels and thicker entrance boundary layers. The experimental results provide a challenging benchmark data base for computational fluid dynamics code development and validation. The variation of inlet bulk turbulence intensity provides additional information to aid in turbulence model evaluation.

Crawford, R. A.↗

Influence of Dust and Black Carbon on the Snow Albedo in the NASA Goddard Earth Observing System Version 5 Land Surface Model

Present-day land surface models rarely account for the influence of both black carbon and dust in the snow on the snow albedo. Snow impurities increase the absorption of incoming shortwave radiation (particularly in the visible bands), whereby they have major consequences for the evolution of snowmelt and life cycles of snowpack. A new parameterization of these snow impurities was included in the catchment-based land surface model used in the National Aeronautics and Space Administration Goddard Earth Observing System version 5. Validation tests against in situ observed data were performed for the winter of 2003.2004 in Sapporo, Japan, for both the new snow albedo parameterization (which explicitly accounts for snow impurities) and the preexisting baseline albedo parameterization (which does not). Validation tests reveal that daily variations of snow depth and snow surface albedo are more realistically simulated with the new parameterization. Reasonable perturbations in the assigned snow impurity concentrations, as inferred from the observational data, produce significant changes in snowpack depth and radiative flux interactions. These findings illustrate the importance of parameterizing the influence of snow impurities on the snow surface albedo for proper simulation of the life cycle of snow cover.

Yasunari, Teppei J.↗

Application of Machine Learning Techniques to Aviation Operations: NASA Case Studies

There is an increasing interest in applying methods based on Machine Learning Techniques(MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues relating to data, feature selection and validation of the models are illustrated by examining case studies of the application of MLT to problems in air traffic management at NASA. Further research is needed in the application of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗

Quantifying Boreal Forest Structure and Composition Using UAV Structure from Motion

The vast extent and inaccessibility of boreal forest ecosystems are barriers to routine monitoring of forest structure and composition. In this research, we bridge the scale gap between intensive but sparse plot measurements and extensive remote sensing studies by collecting forest inventory variables at the plot scale using an unmanned aerial vehicle (UAV) and a structure from motion (SfM) approach. At 20 Forest Inventory and Analysis (FIA) subplots in interior Alaska, we acquired overlapping imagery and generated dense, 3D, RGB (red, green, blue) point clouds. We used these data to model forest type at the individual crown scale as well as subplot-scale tree density (TD), basal area (BA), and aboveground biomass (AGB). We achieved 85% cross-validation accuracy for five species at the crown level. Classification accuracy was maximized using three variables representing crown height, form, and color. Consistent with previous UAV-based studies, SfM point cloud data generated robust models of TD (r(sup 2) = 0.91), BA (r(sup 2) = 0.79), and AGB (r(sup 2) = 0.92), using a mix of plot- and crown-scale information. Precise estimation of TD required either segment counts or species information to differentiate black spruce from mixed white spruce plots. The accuracy of species-specific estimates of TD, BA, and AGB at the plot scale was somewhat variable, ranging from accurate estimates of black spruce TD (+/−1%) and aspen BA (−2%) to misallocation of aspen AGB (+118%) and white spruce AGB (−50%). These results convey the potential utility of SfM data for forest type discrimination in FIA plots and the remaining challenges to develop classification approaches for species-specific estimates at the plot scale that are more robust to segmentation error.

aboveground biomass↗

Bringing Back the Social Affordances of the Paper Memo to Aerospace Systems Engineering Work

Model-based systems engineering (MBSE) is a relatively new field that brings together the interdisciplinary study of technological components of a project (systems engineering) with a model-based ontology to express the hierarchical and behavioral relationships between the components (computational modeling). Despite the compelling promises of the benefits of MBSE, such as improved communication and productivity due to an underlying language and data model, we observed hesitation to its adoption at the NASA Jet Propulsion Laboratory. To investigate, we conducted a six-month ethnographic field investigation and needs validation with 19 systems engineers. This paper contributes our observations of a generational shift in one of JPL's core technologies. We report on a cultural misunderstanding between communities of practice that bolsters the existing technology drag. Given the high cost of failure, we springboard our observations into a design hypothesis - an intervention that blends the social affordances of the narrative-based work flow with the rich technological advantages of explicit data references and relationships of the model-based approach. We provide a design rationale, and the results of our evaluation.

design↗

Effective Uncertainty Quantification for Multi-Angle Polarimetric Aerosol Remote Sensing Over Ocean

Multi-angle polarimetric (MAP) measurements can enable detailed characterization of aerosol microphysical and optical properties and improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere–ocean system. Theoretical pixel-wise retrieval uncertainties based on error propagation have been used to quantify retrieval performance and determine the quality of data products. However, standard error propagation techniques in high-dimensional retrievals may not always represent true retrieval errors well due to issues such as local minima and the nonlinear dependence of the forward model on the retrieved parameters near the solution. In this work, we analyze these theoretical uncertainty estimates and validate them using a flexible Monte Carlo approach. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on efficient neural network forward models, is used to conduct the retrievals and uncertainty quantification on both synthetic HARP2 (Hyper-Angular Rainbow Polarimeter 2) and AirHARP (airborne version of HARP2) datasets. In addition, for practical application of the uncertainty evaluation technique in operational data processing, we use the automatic differentiation method to calculate derivatives analytically based on the neural network models. Both the speed and accuracy associated with uncertainty quantification for MAP retrievals are addressed in this study. Pixel-wise retrieval uncertainties are further evaluated for the real AirHARP field campaign data. The uncertainty quantification methods and results can be used to evaluate the quality of data products, as well as guide MAP algorithm development for current and future satellite systems such as NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission.

PACE↗

HDSense: An efficient method for ranking observable sensitivity

Identifying which observables most effectively constrain model parameters can be computationally prohibitive when considering full likelihoods of many correlated observables. This is especially important for, e.g., hadronization models, where high precision is required to interpret the results of collider experiments. We introduce the High-Dimensional Sensitivity (HDSense) score, a computationally efficient metric for ranking observable sets using only one-dimensional histograms. Derived by profiling over unknown correlations in the Fisher information framework, the score balances total information content against redundancy between observables. We apply HDSense to rank a set observables in terms of their constraining power with respect to five parameters of the Lund string model of hadronization implemented in Pythia using simulated leptonic collider events at the $Z$ pole. Validation against machine-learning--based full-likelihood approximations demonstrates that HDSense successfully identifies near-optimal observable subsets. The framework naturally handles data from multiple experiments with different acceptances and incorporates detector effects. While demonstrated on hadronization models, the methodology applies broadly to generic parameter estimation problems where correlations are unknown or difficult to model.

Assi, Benoît [Cincinnati U.] (ORCID:00000003092433↗