Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Deep Point Cloud Building Envelope Segmentation (DeeP-CuBES) using Deep Learning

Building Information Modeling (BIM) plays an important role in building design and construction, particularly for achieving energy-efficient retrofits. Building envelope retrofits using panelized prefabricated system, such as those popularized by the Energiesprong program, need accurate as-built dimensions of facade features (windows, doors, etc.) to achieve the desired thermal and air tightness. Traditionally, building surveying is done manually, resulting in a time-consuming and labor-intensive process. Recently, 3D point clouds from terrestrial LiDAR have been used to automate the generation of as-built dimensions of existing buildings. However, automated BIM using LiDAR relies on solving the point cloud semantic segmentation (PCSS) problem. In this work, we propose a robust pipeline for solving the PCSS problem using deep neural networks, focusing on overcoming challenges posed by imbalanced datasets and complex architectural features. We introduce the first high-density, labeled, and validated building envelope point cloud dataset derived from multiple building scans, specifically curated to tackle challenges in facade-level segmentation. Results from the trained neural networks show that advanced attention-based architectures and incorporating radiometry (light intensity and RGB) features significantly boost segmentation accuracy for windows and doors.

Selvakumar, Balaji [ORNL]↗

CIS Project 22359, Final Technical Report. Discretized Posterior Approximation in High Dimensions

Our primary aim in this work is to understand how to efficiently obtain reliable uncertainty quantification in automatic learning algorithms with limited training datasets. Standard approaches rely on cross-validation to tune hyper parameters. Unfortunately, when our datasets are too small, holdout datasets become unreliable—albeit unbiased—measures of prediction quality due to the lack of adequate sample size. We should not place confidence in holdout estimators under conditions wherein the sample variance is both large and unknown. More poigniantly, our training experiments on limited data (Duersch and Catanach, 2021) show that even if we could improve estimator quality under these conditions, the typical training trajectory may never even encounter generalizable models.

97 MATHEMATICS AND COMPUTING↗

Pre-Launch Tasks Proposed in our Contract of December 1991

We propose, during the pre-EOS phase to: (1) develop, with other MODIS Team Members, a means of discriminating different major biome types with NDVI and other AVHRR-based data. (2) develop a simple ecosystem process model for each of these biomes, BIOME-BGC (3) relate the seasonal trend of weekly composite NDVI to vegetation phenology and temperature limits to develop a satellite defined growing season for vegetation; and (4) define physiologically based energy to mass conversion factors for carbon and water for each biome. Our final core at-launch product will be simplified, completely satellite driven biome specific models for net primary production. We will build these biome specific satellite driven algorithms using a family of simple ecosystem process models as calibration models, collectively called BIOME-BGC, and establish coordination with an existing network of ecological study sites in order to test and validate these products. Field datasets will then be available for both BIOME-BGC development and testing, use for algorithm developments of other MODIS Team Members, and ultimately be our first test point for MODIS land vegetation products upon launch. We will use field sites from the National Science Foundation Long-Term Ecological Research network, and develop Glacier National Park as a major site for intensive validation.

Running, Steven W.↗

Pre-Launch Tasks Proposed in our Contract of December 1991

We propose, during the pre-EOS phase to: (1) develop, with other MODIS Team Members, a means of discriminating different major biome types with NDVI and other AVHRR-based data; (2) develop a simple ecosystem process model for each of these biomes, BIOME-BGC; (3) relate the seasonal trend of weekly composite NDVI to vegetation phenology and temperature limits to develop a satellite defined growing season for vegetation; and (4) define physiologically based energy to mass conversion factors for carbon and water for each biome. Our final core at-launch product will be simplified, completely satellite driven biome specific models for net primary production. We will build these biome specific satellite driven algorithms using a family of simple ecosystem process models as calibration models, collectively called BIOME-BGC, and establish coordination with an existing network of ecological study sites in order to test and validate these products. Field datasets will then be available for both BIOME-BGC development and testing, use for algorithm developments of other MODIS Team Members, and ultimately be our first test point for MODIS land vegetation products upon launch. We will use field sites from the National Science Foundation Long-Term Ecological Research network, and develop Glacier National Park as a major site for intensive validation.

Source record↗

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in-situ and remote sensing datasets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

54 ENVIRONMENTAL SCIENCES↗

Understanding the Uncertainty and Variability of Earth’s Radiation Budget Components Over the Past 3 Decades from the NASA’s GEWEX Surface Radiation Budget Release 4 Integrated Product

The NASA/GEWEX Surface Radiation Budget (SRB) project produced a 30+ year time series of 3-hourly Top-of-Atmosphere (TOA) and surface radiative flux components at a 1x1 degree resolution. This SRB Release 4 Integrated Productare derived using imager data products from the cross-calibrated from ISCCP (International Satellite Cloud Climatology Project) “HSeries” radiance, cloud and surface property data products. The ISCCP HXS product replaces ISCCP DX with a ninefold increase in pixel count (10km instead of 30km). ISCCP also provides an atmospheric temperature and moisture dataset known as nnHIRS which we use and discuss radiative flux sensitivities to in this presentation. Total solar irradiance is now variable consistent with SORCE measurements. Sea surface (SeaFlux v2.0) and land surface products (LandFlux) are utilized to achieve an radiative flux estimatesintegrated with global data sets from these GEWEX projects. The variable aerosol composition are specified using a detailed aerosol history from the Max Planck Institute Aerosol Climatology (MAC) also used for background aerosol in the ISCCP HX. Numerous other improvements were made to the SW and LW algorithms including improved cloud optical property treatments and specification of surface spectral albedo and emissivity for various surface conditions. Here we analyze the new SWand LWSRB datasets, comparing them to the previous Release 3, BSRN, GEBA and PMEL surface measurements, and ERBE and CERES satellite datasets. For surface flux validation besides ensemble comparisons, we show the variability of SRB vs surface measurements from BSRN beginning in 1992 and GEBA SW from 1983. We assess the variability of the surface flux anomalies, particularly the net fluxes and the cloud radiative effects, over the entire time period including the period containing CERES overlap. For the TOA fluxes, the anomalies of the fluxes in the early period are compared to the MEaSURES ERBE and the latter period to CERES EBAF/SYN1Deg datasets for a benchmark. Long-term changes in the surface radiation budget components and cloud radiative effects are shown and discussed relative to CERES and surface measurements. This includes a change point analysis that helps associate various changes in the ISCCP GEO/LEO configurations and other inputs to variations in the radiative budget components.

Earth Radiation Budget↗

Data for: A hybrid biophysical-machine learning framework for diurnal surface energy flux estimation using proximal sensing

Thermal-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal datasets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for specific surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of an ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81-0.94) and H (R2 = 0.46-0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical – machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

Agricultural Sciences↗

A statistical and simulation-informed model for estimating permeability from pore size distribution in saturated geomaterials

Accurate permeability estimation is essential across subsurface engineering applications but remains challenging due to the complex pore structures of natural geomaterials. Traditional empirical methods and simplified theoretical models often inadequately capture the role of pore size distribution and connectivity. Here, this study develops a statistical and simulation-informed permeability model that collapses pore-scale complexity into a compact scaling of the form k = αϕμ d 2 , where ϕ is porosity, μ d is mean pore size, and α is a weakly varying coefficient. By combining pore network simulations with statistical analysis of unimodal and bimodal pore size distributions, we identify three key findings: (i) permeability is much more sensitive to mean pore size than to porosity; (ii) across extensive datasets, the ratio σ d /μ d (standard deviation to mean) clusters around a characteristic value ∼0.4, allowing the effects of the full pore size distribution to be represented by μ d and a narrowly varying α ≈ 0.05; and (iii) for bimodal systems, there exists a critical fraction of small pores ∼0.78 above which flow becomes small-pore dominated, enabling the definition of an effective flow-controlling pore population and facilitating simplified permeability estimation for such systems. The resulting model, which requires only porosity and a representative mean pore size as inputs, is validated against comprehensive experimental datasets (>1700 samples) spanning diverse soils and rocks and achieves good predictive accuracy. Overall, this work provides a physically grounded yet practically simple permeability estimator suitable for subsurface engineering, environmental protection, and resource management applications.

Permeability↗

Simulating Virtual Terminal Area Weather Data Bases for Use in the Wake Vortex Avoidance System (Wake VAS) Prediction Algorithm

During the research project, sounding datasets were generated for the region surrounding 9 major airports, including Dallas, TX, Boston, MA, New York, NY, Chicago, IL, St. Louis, MO, Atlanta, GA, Miami, FL, San Francico, CA, and Los Angeles, CA. The numerical simulation of winter and summer environments during which no instrument flight rule impact was occurring at these 9 terminals was performed using the most contemporary version of the Terminal Area PBL Prediction System (TAPPS) model nested from 36 km to 6 km to 1 km horizontal resolution and very detailed vertical resolution in the planetary boundary layer. The soundings from the 1 km model were archived at 30 minute time intervals for a 24 hour period and the vertical dependent variables as well as derived quantities, i.e., 3-dimensional wind components, temperatures, pressures, mixing ratios, turbulence kinetic energy and eddy dissipation rates were then interpolated to 5 m vertical resolution up to 1000 m elevation above ground level. After partial validation against field experiment datasets for Dallas as well as larger scale and much coarser resolution observations at the other 8 airports, these sounding datasets were sent to NASA for use in the Virtual Air Space and Modeling program. The application of these datasets being to determine representative airport weather environments to diagnose the response of simulated wake vortices to realistic atmospheric environments. These virtual datasets are based on large scale observed atmospheric initial conditions that are dynamically interpolated in space and time. The 1 km nested-grid simulated datasets providing a very coarse and highly smoothed representation of airport environment meteorological conditions. Details concerning the airport surface forcing are virtually absent from these simulated datasets although the observed background atmospheric processes have been compared to the simulated fields and the fields were found to accurately replicate the flows surrounding the airport where coarse verification data were available as well as where airport scale datasets were available.

Kaplan, Michael L.↗

Atomistic Simulation of Glasses and Amorphous Materials: Challenges and Opportunities for the Next Decade

Atomistic simulations have become indispensable tools for understanding glass structure, dynamics, and properties, yet persistent challenges limit their predictive power. This perspective examines three interconnected issues, namely glass formation procedures, interatomic potential development, and machine learning applications, which emerged from the 5th International Workshop on Challenges of Atomistic Simulations of Glasses and Amorphous Materials. We identify convergent community priorities for (i) standardized validation protocols, (ii) curated benchmark datasets with complete metadata, and (iii) open repositories for glasses. A systematic was forward is provided by a hierarchical validation framework for assessing the structural fidelity, property prediction, and behavioral realism of simulation techniques. Looking ahead, transformative advances are promised by the fusion of classical techniques with machine learning based approaches, for instance, by integrating swap Monte Carlo with machine-learning (ML) potentials, leveraging foundation models through transfer learning, and finetuning ML potentials with experimental data. Progress depends on the community committing to validated models, reproducible protocols, and sustained data sharing.

Krishnan, N. M. Anoop↗

Estimation of constituent properties of concrete materials with an artificial neural network based method

Multi-scale models are developed for heterogeneous concrete materials to estimate their macroscopic mechanical properties in terms of micro-structural data. One crucial challenge of those models is the identification of local properties of constituent phases. In this paper, we present an efficient method based on Artificial Neural Networks (ANN). Typical concrete materials are taken as example. A macroscopic analytical strength criterion is established from three steps of nonlinear homogenization procedure. The macroscopic strength of materials is determined as a function of the frictional coefficient and cohesion of solid cement particles at nanometer scale, intra-particle pores, inter-particle pores and aggregates (inclusions). The objective is to identify the nanoscopic frictional coefficient and cohesion of cement particle from measured macroscopic values of uniaxial compression and tensile strengths. For this purpose, a numerical method based on the ANN is developed. With the analytical macroscopic strength criterion, sensitivity studies are first realized to identify the most important micro-structural parameters influencing the macroscopic strength of concrete. A simplified analytical macroscopic strength criterion is then proposed. A large dataset is further constructed through the inversion of the analytical strength criterion by using the aggregates volume fraction, porosity, macroscopic uniaxial tensile and compressive strengths as input variables and the frictional coefficient and cohesion of cement particles as output unknowns. An ANN model containing four hidden layers and 100 neurons in each layer is constructed and trained by using this dataset. Various types of validation of the ANN model are performed. It is found that the proposed ANN based model can effectively predict the frictional coefficient and cohesion of porous cement paste at the microscopic scale with a very good accuracy.

36 MATERIALS SCIENCE↗

Neural Posterior Estimation for Scalable and Accurate Inverse Parameter Inference in Li-Ion Batteries

Diagnosing the internal state of Li-ion batteries is critical for battery research, operation of real-world systems, and prognostic evaluation of remaining lifetime. By using physics-based models to perform probabilistic parameter estimation via Bayesian calibration, diagnostics can account for the uncertainty due to model fitness, data noise, and the observability of any given parameter. However, Bayesian calibration in Li-ion batteries using electrochemical data is computationally intensive even when using a fast surrogate in place of physics-based models, requiring many thousands of model evaluations. A fully amortized alternative is neural posterior estimation (NPE). NPE shifts the computational burden from the parameter estimation step to data generation and model training, reducing the parameter estimation time from minutes to milliseconds, enabling real-time applications. The present work shows that NPE can infer parameters equally or more accurately than Bayesian calibration, even if it leads to higher voltage reconstruction errors. We also demonstrate that the higher computational costs for data generation are tractable even in high-dimensional cases (ranging from 6 to 27 estimated parameters). The NPE method also offers several interpretability advantages over Bayesian calibration, such as local parameter sensitivity to specific regions of the voltage curve. The NPE method is demonstrated using an experimental fast charge dataset, with parameter estimates validated against measurements of loss of lithium inventory and loss of active material. The implementation is made available in a companion repository (https://github.com/NatLabRockies/BatFIT).

25 ENERGY STORAGE↗

A non-isothermal breakage-damage model for plastic-bonded granular materials incorporating temperature, pressure, and rate dependencies

Plastic-bonded granular materials (PBM) are widely used in industrial sectors, including building construction, abrasive applications, and defense applications such as plastic-bonded explosives. The mechanical behavior of PBM is highly nonlinear, irreversible, rate dependent, and temperature sensitive governed by various micromechanical attributions such as grain crushing and binder damage. This paper presents a thermodynamically consistent, microstructure-informed constitutive model to capture these characteristic behaviors of PBM. Key features of the model include a breakage internal variable to upscale the grain-scale information to the continuum level and to predict grain size evolution under mechanical loading. In addition, a damage internal state variable is introduced to account for the damage, deterioration, and debonding of the binder matrix upon loading. Temperature is taken as a fundamental external state variable to handle non-isothermal loading paths. The proposed model is able to capture with good accuracy several important aspects of the mechanical properties of PBM, such as pressure-dependent elasticity, pressure-dependent yield strength, brittle-to-ductile transition, temperature dependency, and rate dependency in the post-yielding regime. Furthermore, the model is validated against multiple published datasets obtained from confined and unconfined compression tests, covering various PBM compositions, confining pressures, temperatures, and strain rates.

Breakage↗

Non-destructive measurement and real-time monitoring of apple hardness during ultrasonic contact drying via portable NIR spectroscopy and machine learning

Portable near-infrared spectrometer in the spectral range of 900–1700 nm was evaluated for the first time to assess and monitor apple hardness in real-time during ultrasonic drying. Calibration models were developed using PLS and ANN, and their performances were evaluated by internal leave-one-out cross-validation and an external dataset. Several pre-treatments including standard normal variate (SNV), multiplicative scatter correction (MSC), Savitzky–Golay first and second derivatives were employed to examine the effects of spectral variations in hardness prediction. Seven important wavelengths were selected using weighted regression coefficients to develop a simple MLR model to facilitate the model interpretation and circumvent noise. The models using PLS, MLR, and ANN with selected wavelengths predicted the apple hardness with R 2 p of 0.91, 0.91, 0.95, and RMSEP of 14.78, 14.85, and 12.46 N, respectively. Finally, the results indicate that portable NIR spectrometers are quite promising for real-time monitoring of apple hardness during ultrasonic drying.

47 OTHER INSTRUMENTATION↗

Tangent functional connectomes uncover more unique phenotypic traits

Functional connectomes (FCs) containing pairwise estimations of functional couplings between pairs of brain regions are commonly represented by correlation matrices. As symmetric positive definite matrices, FCs can be transformed via tangent space projections, resulting into tangent-FCs. Tangent-FCs have led to more accurate models predicting brain conditions or aging. Motivated by the fact that tangent-FCs seem to be better biomarkers than FCs, we hypothesized that tangent-FCs have also a higher fingerprint. We explored the effects of six factors: fMRI condition, scan length, parcellation granularity, reference matrix, main-diagonal regularization, and distance metric. Our results showed that identification rates are systematically higher when using tangent-FCs across the “fingerprint gradient” (here including test-retest, monozygotic and dizygotic twins). Highest identification rates were achieved when minimally (0.01) regularizing FCs while performing tangent space projection using Riemann reference matrix and using correlation distance to compare the resulting tangent-FCs. Such configuration was validated in a second dataset (resting-state).

59 BASIC BIOLOGICAL SCIENCES↗

Characterization of the optical model of the T2K 3D segmented plastic scintillator detector unit cube

The magnetized near detector (ND280) of the T2K long-baseline neutrino oscillation experiment has been recently upgraded aiming to satisfy the requirement of reducing the systematic uncertainty from measuring the neutrino–nucleus interaction cross section, which is the largest systematic uncertainty in the search for leptonic charge-parity symmetry violation. A key component of the upgrade is SuperFGD, a 3D segmented plastic scintillator detector made of approximately 2,000,000 optically-isolated 1 cm 3 cubes. The SuperFGD cube unit shows promising optical performance, including a high light yield of about 40 photoelectrons (p.e.) per channel, a low cube-to-cube crosstalk rate below 3%, and a sub-nanosecond time resolution of 0.96 ns. By combining tracking and stopping power measurements of final state particles, this novel detector enables precise 3D-imaging of GeV neutrino interactions with reduced systematic uncertainties. A detailed Geant4 based optical simulation of the SuperFGD building block, i.e. a plastic scintillating cube read out by three wavelength shifting fibers, has been developed and validated with the different datasets collected in various beam tests. In this manuscript the description of the optical model as well as the comparison with data are reported.

Neutrino oscillations↗

Conditioned quantum-assisted deep generative surrogate for particle-calorimeter interactions

Particle collisions at accelerators like the Large Hadron Collider (LHC), recorded by experiments such as ATLAS and CMS, enable precise standard model measurements and searches for new phenomena. Simulating these collisions significantly influences experiment design and analysis but incurs immense computational costs, projected at millions of CPU-years annually during the high luminosity LHC (HL-LHC) phase. Currently, simulating a single event with Geant4 consumes around 1000 CPU seconds, with calorimeter simulations especially demanding. To address this, we propose a conditioned quantum-assisted generative model, integrating a conditioned variational autoencoder (VAE) and a conditioned restricted Boltzmann machine (RBM). Our RBM architecture is tailored for D-Wave’s Pegasus-structured advantage quantum annealer for sampling, leveraging the flux bias for conditioning. This approach combines classical RBMs as universal approximators for discrete distributions with quantum annealing’s speed and scalability. We also introduce an adaptive method for efficiently estimating effective inverse temperature, and validate our framework on Dataset 2 of CaloChallenge.

97 MATHEMATICS AND COMPUTING↗

Heterogeneous estimations of non-pharmaceutical mitigation behavior during the COVID-19 pandemic

The COVID-19 pandemic highlighted the importance of human behavior in mitigating the spread of disease. Nonetheless, human behavior is often overlooked in models of disease spread, particularly by underutilizing real-world data. We address this by estimating probabilities that individuals engage in behaviors that influence SARS-CoV-2 transmission risk during the COVID-19 pandemic, between September 2020 and June 2022. These behaviors include wearing a mask, using public transportation, spending time with others, avoiding contact with others, and going to work. Our estimates account for the age and sex of individuals and are generated for every county in the United States. We utilized multiple open-source datasets and United States Census data to produce these estimates. Multiple datasets were used for validation, showing our estimates demonstrated comparable accuracy and robustness. Our estimates aid in understanding human behavior dynamics during the COVID-19 pandemic and could be used to inform monthly or longer-term behavior in simulations of COVID-19. Moreover, the methods presented can be applied to other behaviors and features for future simulations of infectious disease.

97 MATHEMATICS AND COMPUTING↗