Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Validating induced seismicity forecast models—Induced Seismicity Test Bench

Abstract Induced earthquakes often accompany fluid injection, and the seismic hazard they pose threatens various underground engineering projects. Models to monitor and control induced seismic hazard with traffic light systems should be probabilistic, forward‐looking, and updated as new data arrive. In this study, we propose an Induced Seismicity Test Bench to test and rank such models; this test bench can be used for model development, model selection, and ensemble model building. We apply the test bench to data from the Basel 2006 and Soultz‐sous‐Forêts 2004 geothermal stimulation projects, and we assess forecasts from two models: Shapiro and Smoothed Seismicity (SaSS) and Hydraulics and Seismics (HySei). These models incorporate a different mix of physics‐based elements and stochastic representation of the induced sequences. Our results show that neither model is fully superior to the other. Generally, HySei forecasts the seismicity rate better after shut‐in but is only mediocre at forecasting the spatial distribution. On the other hand, SaSS forecasts the spatial distribution better and gives better seismicity rate estimates before shut‐in. The shut‐in phase is a difficult moment for both models in both reservoirs: the models tend to underpredict the seismicity rate around, and shortly after, shut‐in.

Király‐Proag, Eszter↗

Adoption of image-driven machine learning for microstructure characterization and materials design: A Perspective

Microstructure characterization enables the development of structure-processing-property relationships critical to several research areas within the broad field of materials science, from alloy design to the assessment of corrosion resistance, and failure analysis. Conventional approaches to material characterization have relied on either qualitative inference by the human ex-pert or software applications that can extract high-level features from images, such as boundary segmentation, average grain diameter, etc. Such approaches rely heavily on subject matter expert user intervention and knowledge of what phases or more generally, what microstructural features, are of interest. The recent surge in the adoption of machine learning techniques to address problems in materials engineering has brought with it an increased interest and application of Image Driven Machine Learning (IDML) approaches. In this work, we review the applications of IDML to the field of materials characterization. A canonical hierarchy of stages is defined, which when put sequentially together completes an IDML study: problem definition, dataset building, model selection and training, model evaluation, and integration with existing instrumentation or simulation workflow. The studies reviewed in this work are analyzed from the perspective of each of these stages. Such a review permits agranular assessment of the field, for example the impact of IDML on materials characterization at the nanoscale, the size of a typical dataset required to train a semantic segmentation model on electron microscopy images, ubiquitousness of transfer learning in the domain, etc. Finally, we discuss the importance of interpretability and explainability in the field of IDML for materials characterization, and provide an overview of two emerging techniques in the field: semantic segmentation and generative adversarial networks.

Baskaran, Arun↗

Structure retrieval from four-dimensional scanning transmission electron microscopy: Statistical analysis of potential pitfalls in high-dimensional data

Four-dimensional (4D) scanning transmission electron microscopy is one of the most rapidly growing modes of electron microscopy imaging. The advent of fast pixelated cameras and the associated data infrastructure have greatly accelerated this process. Yet conversion of the 4D datasets into physically meaningful structure images in real space remains an open issue. In this work, we demonstrate that it is possible to systematically create filters that will affect the apparent resolution or even qualitative features of the real-space structure image, reconstructing artificially generated patterns. As initial efforts, we explore statistical model selection algorithms, aiming for robustness and reliability of estimated filters. This statistical model selection analysis demonstrates the need for regularization and cross validation of inversion methods to robustly recover structure from high-dimensional diffraction datasets.

36 MATERIALS SCIENCE↗

Modeling of Spacecraft Advanced Chemical Propulsion Systems

This paper outlines the development of the Advanced Chemical Propulsion System (ACPS) model for Earth and Space Storable propellants. This model was developed by the System Technology Operation of SAIC-Huntsville for the NASA MSFC In-Space Propulsion Project Office. Each subsystem of the model is described. Selected model results will also be shown to demonstrate the model's ability to evaluate technology changes in chemical propulsion systems.

Benfield, Michael P. J.↗

Modeling of Spacecraft Advanced Chemical Propulsion Systems

This paper outlines the development of the Advanced Chemical Propulsion System (ACPS) model for Earth and Space Storable propellants. This model was developed by the System Technology Operation of SAIC-Huntsville for the NASA MSFC In-Space Propulsion Project Office. Each subsystem of the model is described. Selected model results will also be shown to demonstrate the model's ability to evaluate technology changes in chemical propulsion systems.

Benfield, Michael P. J.↗

Evaluating the accuracy of common γ-Al 2 O 3 structure models by selected area electron diffraction from high-quality crystalline γ-Al 2 O 3

Single crystal and textured polycrystalline γ-Al 2 O 3 thin films were synthesized by oxidation of NiAl(110) in air at 850 °C for 1 and 2 hours, respectively, and used to evaluate the accuracy of two spinel-based and two nonspinel models by comparison of selected-area electron diffraction (SAED). The lattice interplanar distances derived from the polycrystalline SAED pattern most closely matched the cubic spinel γ-Al 2 O 3 model. The single-crystal SAED spot pattern reflected symmetry consistent with both the cubic spinel and tetragonal nonspinel models, yet, the Al cation distribution better matched the cubic spinel model based on the relative intensities of diffraction spots. Our work indicates that the traditional cubic spinel model is a more accurate model of γ-Al 2 O 3 than the other models considered. Furthermore, the spinel-based monoclinic model is more accurate than the monoclinic nonspinel model. The understanding of the relative accuracy of the different models is key for simulating γ-Al 2 O 3 containing systems and is of general interest for the metal oxide and ceramic communities.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Model validation and selection in metabolic flux analysis and flux balance analysis

13C-Metabolic Flux Analysis (13C-MFA) and Flux Balance Analysis (FBA) are widely used to investigate the operation of biochemical networks in both biological and biotechnological research. Both methods use metabolic reaction network models of metabolism operating at steady state so that reaction rates (fluxes) and the levels of metabolic intermediates are constrained to be invariant. They provide estimated (MFA) or predicted (FBA) values of the fluxes through the network in vivo, which cannot be measured directly. These fluxes can shed light on basic biology and have been successfully used to inform metabolic engineering strategies. Several approaches have been taken to test the reliability of estimates and predictions from constraint-based methods and to compare alternative model architectures. Despite advances in other areas of the statistical evaluation of metabolic models, such as the quantification of flux estimate uncertainty, validation and model selection methods have been underappreciated and underexplored. We review the history and state-of-the-art in constraint-based metabolic model validation and model selection. Applications and limitations of the χ 2 -test of goodness-of-fit, the most widely used quantitative validation and selection approach in 13C-MFA, are discussed, and complementary and alternative forms of validation and selection are proposed. A combined model validation and selection framework for 13C-MFA incorporating metabolite pool size information that leverages new developments in the field is presented and advocated for. Finally, we discuss how adopting robust validation and selection procedures can enhance confidence in constraint-based modeling as a whole and ultimately facilitate more widespread use of FBA in biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗

Group Projected subspace pursuit for IDENTification of variable coefficient differential equations (GP-IDENT)

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from the noisy observation of a single solution trajectory. Identifying unknown differential equations from noisy data is a difficult task, and it is even more challenging with space and time varying coefficients in the PDE. The proposed algorithm, GP-IDENT, has three ingredients: (i) we use B-spline bases to express the unknown space and time varying coefficients, (ii) we propose Group Projected Subspace Pursuit (GPSP) to find a sequence of candidate PDEs with various levels of complexity, and (iii) we propose a new criterion for model selection using the Reduction in Residual (RR) to choose an optimal one among a pool of candidates. The new GPSP considers group projected subspaces which is more robust than existing methods in distinguishing correlated group features. We test GP-IDENT on a variety of PDEs and PDE systems, and compare it with the state-of-the-art parametric PDE identification algorithms under different settings to illustrate its outstanding performance. Furthermore, our experiments show that GP-IDENT is effective in identifying the correct terms from a large dictionary, and our model selection scheme is robust to noise.

Data-driven method↗

Use-Inspired, Process-Oriented GCM Selection: Prioritizing Models for Regional Dynamical Downscaling

Dynamical downscaling is a crucial process for providing regional climate information for broad uses, using coarser-resolution global models to drive higher-resolution regional climate simulations. The pool of global climate models (GCMs) providing the fields needed for dynamical downscaling has increased from the previous generations of the Coupled Model Intercomparison Project (CMIP). However, with limited computational resources, the need for prioritizing the GCMs for subsequent downscaling studies remains. GCM selection for dynamical downscaling should focus on evaluating processes relevant for providing boundary conditions to the regional models and be inspired by regional uses such as the response of extremes to changes in the boundary conditions. This leads to the need for metrics representing processes of relevance to diverse stakeholders and subregions of a domain. Procedures to account for metric redundancy and the statistical distinguishability of GCM rankings are required. Further, procedures for selecting realizations from ensembles of top-performing GCM simulations can be used to span the range of climate change signals in multiple ways. As a result, distinct weighting of metrics and prioritization of particular realizations may depend on user needs. We provide high-level guidelines for such region-specific evaluations and address how CMIP7 might enable dynamical downscaling of a representative sample of high-quality models across representative shared socioeconomic pathways (SSPs).

54 ENVIRONMENTAL SCIENCES↗

A Computational Information Criterion for Particle-Tracking with Sparse or Noisy Data

Traditional probabilistic methods for the simulation of advection-diffusion equations (ADEs) often overlook the entropic contribution of the discretization, e.g., the number of particles, within associated numerical methods. Many times, the gain in accuracy of a highly discretized numerical model is outweighed by its associated computational costs or the noise within the data. Herein, we address the question of how many particles are needed in a simulation to best approximate and estimate parameters in one-dimensional advective-diffusive transport. To do so, we use the well-known Akaike Information Criterion (AIC) and a recently-developed correction called the Computational Information Criterion (COMIC) to guide the model selection process. Random-walk and mass-transfer particle tracking methods are employed to solve the model equations at various levels of discretization. Numerical results demonstrate that the COMIC provides an optimal number of particles that can describe a more efficient model in terms of parameter estimation and model prediction compared to the model selected by the AIC even when the data is sparse or noisy, the sampling volume is not uniform throughout the physical domain, or the error distribution of the data is non-IID Gaussian.

97 MATHEMATICS AND COMPUTING↗

Database-wide hazard modelling of the onset of DIII-D tearing modes with field features

The rate of onset (hazard) of tearing modes is modelled probabilistically using statistical learning algorithms. Axisymmetric energy-density equilibrium fields are taken as raw high-dimensional input features which are reduced with principal component analysis. Signal processing of non-axisymmetric magnetics fluctuation array data provides the target information from which to learn. Model selection, visualization and calibration assessment procedures are detailed. Here, the analysis is deployed at large scale across the DIII-D tokamak database. Standard model selection criteria suggest that the energy-density post-processed feature is a better choice for modelling the onset rate compared to the non-processed equilibrium reconstruction solution. Two example applications of the learned rate function are demonstrated: (i) proximity-to-onset discharge monitoring and (ii) database analysis showing an (expected) observational global trend that the general hazard increases as a plasma performance metric increases. An important connection between the hazard function and its use as a conditional probability generator is reviewed in the Appendix.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A theoretical model for the cross spectra between pressure and temperature downstream of a combustor

A theoretical model developed to calculate pressure-temperature cross spectra, pressure spectra, temperature spectra and pressure cross spectra in a ducted combustion system is presented. The model assumes the presence of a fluctuating-volumetric-heat-release-rate disk source and takes into account the spatial distribution of the steady-state volumetric-heat flux. Using the model, pressure, velocity, and temperature perturbation relationships can be obtained. The theoretical results show that, at a given air mass flow rate, the calculated pressure-temperature cross spectra phase angle at the combustor exit depends on the model selected for the steady-state volumetric-heat flux in the combustor. Using measurements of the phase angle, an appropriate source region model was selected. The model calculations are compared with the data. The comparison shows good agreement and indicates that with the use of this model the pressure-temperature cross spectra measurements provide useful information on the physical mechanisms active at the combustion noise source.

Miles, J. H.↗

Modeling Spectrally-Selective Reflection for Thermal Management in Monofacial and Bifacial Modules

Parasitic absorption in photovoltaic modules is a major source of waste heat, which drives operating temperatures 20-30K above ambient. Spectrally-selective sub-bandgap reflection can reduce parasitic absorption, thereby improving module efficiency and power output. Here, we investigate the performance of 1-D spectrally-selective mirrors in monofacial Al BSF and PERC modules, and bifacial PERC modules. In monofacial modules, these mirrors offer >1.2% increase in energy yield compared to single-layer anti-reflection coatings, while cooling by over 1K on average. Mirrors reduced bifacial module parasitic absorption by up to 34 W/m2 out of 1240 W/m2 incident.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Optimizing Optical Searches for Supermassive Black Hole Binaries in Active Galactic Nuclei Light Curves: Fourier versus Bayesian Periodicity Detection

Simulations predict that supermassive black hole binaries (SMBHBs) will exhibit periodic brightness variations that may exceed the stochastic variability intrinsic to active galactic nuclei (AGN). In this paper, we simulate SMBHBs with damped random walk (DRW) AGN variability and an added sinusoidal signal from the orbital motion, and test three methods—a generalized Lomb–Scargle periodogram (GLSP), a nested Bayesian sampler (NBS), and a weighted wavelet z-transform (or WWZ)—to determine which is best at recovering the periodicity. Our simulated light curves follow the properties of the Catalina Real-Time Transient Survey (or CRTS), Legacy Survey of Space and Time (LSST), and Zwicky Transient Facility (ZTF) to best inform current and future SMBHB searches. We map a broad range of parameter space and identify which DRW-only light curves best mimic periodicity and pass each method’s model selection. The NBS performs best at detecting periodicity and filtering out DRW-only light curves. Combined candidate selection with both the NBS and GLSP significantly reduces false-positive rates (FPRs) with marginal impact on true-positive rates (TPRs). With this joint model selection pipeline, we find the lowest FPRs in ZTF-like simulations and the highest detection rates in LSST-like simulations. Using a modified computation of the false-alarm probability with GLSP, we efficiently triage LSST AGN light curves (∼10 7 light curves in ∼10–30 hr) and achieve TPRs and FPRs of ∼40% and ∼0.5%, respectively.

Banaszak, Sebastian M. [Vanderbilt Univ., Nashvill↗

Data for "Divergent urban land trajectories under alternative population projections within the shared socioeconomic pathways"

Datasets supporting findings and visualizations behind McManamay et al. (2024) Divergent urban land trajectories under alternative population projections within the shared socioeconomic pathways. Environmental Research Letters, DOI: 10.1088/1748-9326/ad2eec Using a spatial modeling experiment at high resolution (1-km), this study compared how two alternative US population projections, varying in the spatially explicit nature of demographic patterns and migration, affect urban land dynamics simulated by the Spatially Explicit, Long-term, Empirical City development (SELECT) model for SSP2, SSP3, and SSP5. The numerical experiment, inputs and outputs are fully described in McManamay et al. (2024). The datasets summarize SELECT model simulations within urban areas and rural areas of the conterminous United States. For code to reproduce the results, please refer to https://github.com/IMMM-SFA/mcmanamay_etal_2024_erl Please refer to the README file provided in Files for more details. Descriptions of the datasets are provided below. Dataset(s) Descriptions: Urban_Land_delta_UA_County.csv: Urban land area for original (default) population, updated population, and urban land delta (difference between the two) according to Shared Socioeconomic Pathways (SSPs) and year. Urban land is summarized for U.S. counties (FIPS code) and urban areas (GEOID) as unique areas within various counties. JO_Gao_pop_ufdelta.csv: Comparison of population differences and urban land differences between the origial (default) and updated population projections. City_Case_studies.csv: Differences in urban land areas arising from different population projections summarized for selected cities (Atlanta, Los Angeles, Houston, and New York) and their surrounding rural areas UA_county_FID.zip: Zipped folder of .tiff file depicting unique combination of urban areas and US counties used for summarizing urban land differences in urban and rural areas based on different population projections. ULD_clusters.zip: Zipped folder of .csv files depicting normalized changes in urban land delta (difference in urban land arising from population projections) and the respective Ward's hierarchical clusters, which group urban and rural areas based on similarities in temporal trends. Urban_Percent_change_2100.zip: Zipped folder of .csv files depicting percent changes in urban land area for year 2100 based on differences in the original (default) population and updated population. Each file is for SSPs and urban or rural areas.

Land↗

ESMs Latent Space Exploration for Uncertainty Quantification and Spatiotemporal Downscaling

This final report for DOE Award DE-SC0023044 presents advances in two key areas of climate modeling: (1) representative climate model selection and (2) Earth System Model (ESM) downscaling using hybrid AI methods. The first section introduces a reordered, three-stage workflow to select representative GCM runs that more effectively balance historical skill with ensemble spread, validated across Texas, Bihar, and New York. The second section introduces two novel super-resolution frameworks, ViSIR and ViFOR, that integrate Vision Transformers with sinusoidal and Fourier-based implicit neural representations. These models achieve state-of-the-art reconstruction accuracy for ESM variables including surface temperature and heat fluxes. The report includes detailed methodology, benchmarks, and results, demonstrating significant gains in uncertainty quantification, spatial fidelity, and scalability for climate-impact studies.

54 ENVIRONMENTAL SCIENCES↗