Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Mapping tree height in complex terrain of northern China using ultra-high-resolution images

Tree height is a key parameter for estimating forest biomass and carbon sequestration. In recent years, notable progress has been made in mapping tree height using satellite imagery. However, existing tree height products show low accuracy in mountainous and complex terrains, and few studies typically addressed tree height estimations in mountain areas. This study examines the Mentougou district of Beijing, China, characterized by complex terrain and mountainous landscapes. We analyzed two methods for estimating tree height: one using only spectral features and another combining spectral features with topographic factors (elevation, slope, aspect). We used 3-m resolution PlanetScope 8-band multispectral imagery, with 710 field-measured individual tree heights averaged to obtain 471 pixel-level tree height values as ground-truth, to develop tree height prediction models using eXtreme Gradient Boosting (XGBoost), Random Forest (RF), and Gradient Boosting Machine (GBM) models. The results show that the XGBoost model consistently presented the highest accuracy for both methods evaluated. Specifically, the XGBoost model that combined spectral data with elevation and slope variables with an R² of 0.75 and an RMSE of 2.69 m. Using the XGBoost model, we generated the tree height map for the Mentougou area at 3 m resolution, showing tree heights ranging from 0.5 to 30.4 m, and the model’s prediction error standard deviations ranged from 2.50 to 4.71 m, indicating reliable performance across varied terrain. Additionally, we compared and evaluated the global tree height products, identifying limitations in the accuracy within complex terrains. This study demonstrates the potential for accurately predicting tree heights by combining high-resolution multispectral satellites with a terrain factor modeling approach.

Complex terrain↗

Reconstructing porous media using generative flow networks

One area of intense scientific interest for the study of sandstones, carbonates, and shale at the pore scale is the use of limited image and petrophysical data to generate multiple realizations of a rock’s pore structure. Such images aid efforts to quantify uncertainty in petrophysical properties, including porosity–permeability transforms. We develop and evaluate a deep learning-based method to synthesize porous media volumes using a so-called generative flow model trained on x-ray microscope images of rock texture and pore structure. These models are optimized on a log-likelihood objective and they synthesize large and realistic three-dimensional images. Further, we demonstrate the rapid generation of sandstone image volumes that display realism as gauged by quantitative comparison of topological features using Minkowski functionals of porosity, specific surface area, and the Euler–Poincaré characteristic (i.e., pore connectivity). We also evaluate the single-phase permeability using Navier–Stokes and lattice Boltzmann methods and show that transport properties of the generated samples match measured trends.

58 GEOSCIENCES↗

DEM simulation of the compression of crushable sand: does the initial particle shape matter?

Advances in DEM modeling, combined with high-resolution X-ray tomography, opened the way for computer models based on virtual replicas of the particles which preserve nearly all facets of their geometry. This leads to simulation advantages, but also high computational costs. Here we tackle a question stemming from this trend: how accurate should particle models be to ensure accuracy? We address this question for the case of the compression of crushable sand. LS-DEM was used to generate three models of Ottawa sand (exact replicas, ellipsoids, and spheres) from digital images of its grains. Compression-induced crushing was simulated for all sets by tracking evolving size and shape distribution. The results confirm that exact replicas provide the closest match of the measurements. However, intermediate degrees of rendering (e.g. ellipsoids preserving volume and aspect ratio of the real grains) led to satisfactory results only marginally different from those of exact replicas. In conclusion, these findings provide an example of the protocols that may be followed to identify the optimal degree of particle approximation which should be regarded as mandatory to achieve a conscious, sustainable use of computational resources.

58 GEOSCIENCES↗

Land-use analysis using infrastructure representations and high-resolution flood inundation mapping techniques

In the face of climate change and population growth in coastal regions, land-use analysis efforts are more challenging than ever. Land-use decision-makers in coastal communities are burdened with the difficult choices of where to place new homes versus other assets. While there has been an increased focus on hazard mitigation and disaster resilience in the field of planning, evidence points towards continued development in risk-prone areas including flood zones. Residential development within flood zones specifically continues to be a major issue. To help counter this trend, this study introduces a novel land-use analysis method, coupling topographic flood inundation mapping techniques with digital elevation model (DEM) adaptations. This Topographic Model Scenario Generation workflow can be used by planners early in the land-use decision making process and provides an alternative to high-computational hydraulic models. The analysis also includes the identification of strengths and weaknesses of topographic models' recognition of built infrastructure assets, adding to a limited body of knowledge addressing recommended uses of such models. Levees and canals prove particularly functional in this context while detention ponds less so, likely due to a lack of total water mass accountability. Lastly, we provide a functional demonstration in Southeast Texas to illustrate the workflow's ability to create multiple infrastructure scenarios and visualize their effects across different flood events.

42 ENGINEERING↗

A Hierarchical Optimization Method for Electric Vertical Takeoff and Landing Aircraft Network Design

Electric vertical takeoff and landing aircraft (eVTOLs) are expected to serve urban air mobility in a station-to-station configuration, which makes the optimal network design of eVTOL stations a critical question to explore. Existing approaches often face limitations, such as the inability to interact station locations with demand or difficulty in finding the optimal solution for large study regions. Here, this paper first proposes a mathematical model to generate optimal eVTOL station locations while considering associated potential eVTOL demand, and then proposes a heuristic algorithm, Hierarchical Optimization MEthod (HOME), to efficiently solve the model. With a case study of Southern California, HOME was compared to 1) directly solving the original integer linear programming-based network design problem, and 2) employing the widely used genetic algorithm. Results suggest that HOME can find optimal solutions with limited computational resources. The proposed framework powered by HOME provides a computationally efficient way to support urban air mobility planning.

97 MATHEMATICS AND COMPUTING↗

Perspectives on AI Architectures and Codesign for Earth System Predictability

Abstract Recently, the U.S. Department of Energy (DOE), Office of Science, Biological and Environmental Research (BER), and Advanced Scientific Computing Research (ASCR) programs organized and held the Artificial Intelligence for Earth System Predictability (AI4ESP) workshop series. From this workshop, a critical conclusion that the DOE BER and ASCR community came to is the requirement to develop a new paradigm for Earth system predictability focused on enabling artificial intelligence (AI) across the field, laboratory, modeling, and analysis activities, called model experimentation (ModEx). BER’s ModEx is an iterative approach that enables process models to generate hypotheses. The developed hypotheses inform field and laboratory efforts to collect measurement and observation data, which are subsequently used to parameterize, drive, and test model (e.g., process based) predictions. A total of 17 technical sessions were held in this AI4ESP workshop series. This paper discusses the topic of the AI Architectures and Codesign session and associated outcomes. The AI Architectures and Codesign session included two invited talks, two plenary discussion panels, and three breakout rooms that covered specific topics, including 1) DOE high-performance computing (HPC) systems, 2) cloud HPC systems, and 3) edge computing and Internet of Things (IoT). We also provide forward-looking ideas and perspectives on potential research in this codesign area that can be achieved by synergies with the other 16 session topics. These ideas include topics such as 1) reimagining codesign, 2) data acquisition to distribution, 3) heterogeneous HPC solutions for integration of AI/ML and other data analytics like uncertainty quantification with Earth system modeling and simulation, and 4) AI-enabled sensor integration into Earth system measurements and observations. Such perspectives are a distinguishing aspect of this paper. Significance Statement This study aims to provide perspectives on AI architectures and codesign approaches for Earth system predictability. Such visionary perspectives are essential because AI-enabled model-data integration has shown promise in improving predictions associated with climate change, perturbations, and extreme events. Our forward-looking ideas guide what is next in codesign to enhance Earth system models, observations, and theory using state-of-the-art and futuristic computational infrastructure.

54 ENVIRONMENTAL SCIENCES↗

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗

Perspectives on AI Architectures and Co-design for Earth System Predictability

Recently, the U.S. Department of Energy (DOE), Office of Science, Biological and Environmental Research (BER), and Advanced Scientific Computing Research (ASCR) programs organized and held the Artificial Intelligence for Earth System Predictability (AI4ESP) workshop series. From this workshop, a critical conclusion that the DOE BER and ASCR community came to is the requirement to develop a new paradigm for Earth system predictability focused on enabling artificial intelligence (AI) across the field, laboratory, modeling, and analysis activities, called model experimentation (ModEx). BER’s ModEx is an iterative approach that enables process models to generate hypotheses. The developed hypotheses inform field and laboratory efforts to collect measurement and observation data, which are subsequently used to parameterize, drive, and test model (e.g., process based) predictions. A total of 17 technical sessions were held in this AI4ESP workshop series. This paper discusses the topic of the AI Architectures and Codesign session and associated outcomes. The AI Architectures and Codesign session included two invited talks, two plenary discussion panels, and three breakout rooms that covered specific topics, including 1) DOE high-performance computing (HPC) systems, 2) cloud HPC systems, and 3) edge computing and Internet of Things (IoT). We also provide forward-looking ideas and perspectives on potential research in this codesign area that can be achieved by synergies with the other 16 session topics. These ideas include topics such as 1) reimagining codesign, 2) data acquisition to distribution, 3) heterogeneous HPC solutions for integration of AI/ML and other data analytics like uncertainty quantification with Earth system modeling and simulation, and 4) AI-enabled sensor integration into Earth system measurements and observations. Such perspectives are a distinguishing aspect of this paper.

58 GEOSCIENCES↗

ASME Code change proposal to implement new universal high temperature constitutive models for Section III, Division 5

This report completes work on a universal high temperature constitutive model suitable for use with the ASME Boiler & Pressure Vessel Code Section III, Division 5 rules for the design by inelastic analysis of Class A nuclear reactor components. The goals of this work are to provide a simple model form that adequately captures the high temperature response of materials and can be applied to any future Code material. Additionally, the report describes an automated process for calibrating a model against test data. The idea is to simplify the effort required to generate a constitutive model for an arbitrary material, provided test data is available. This will accelerate the process of qualifying new Code materials in the future. In addition, the report provides calibrated models and detailed validation comparisons to test data for five currently-qualified or soon-to-be qualified materials: 316H, Grade 91, Alloy 800H, Alloy 617, and Alloy 709. The report surveys the available data for the remaining two ASME Class Materials --- 2.25Cr-1Mo and 304H --- concluding that there is enough data data to generate a model for 2.25Cr-1Mo steel provided some additional sources of non-public data can be included in the test database, but that a dedicated cyclic test campaign would be needed for 304H. Supplemental material includes the full text of an ASME Code change proposal to incorporate the models for the four currently-qualified Class A material, detailed validation comparisons to test data for the five material models, and input files for reference implementations of the constitutive models in the NEML and NEML2 modeling frameworks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Methods to Evaluate Subcolumn Profiles Based on Two-Point Diagnostics

In atmospheric models, stochastic generation of subgrid-scale profiles or “subcolumns” has been used for a variety of purposes. Such subcolumns can be generated from subgrid probability density functions (PDFs) at different vertical levels, when such PDFs are available. To do so, the generator needs to decide how strongly points should be correlated in the vertical, that is, how much the values should be overlapped. This is sometimes called “PDF overlap.” To assess vertical correlation in a simplified, observable setting, here the vertical correlation of vertical velocity in subcloud layers is examined. Doppler lidar is used to evaluate the vertical profiles of vertical velocity produced by a large-eddy simulation (LES) model and the Subgrid Importance Latin Hypercube Sampler (SILHS) subcolumn generator. In order to diagnose unrealistic features in subcolumn profiles, various statistical diagnostics are examined here, including the bivariate PDF of vertical velocity at two separated points (i.e., altitudes), the two-point velocity correlation, the integral correlation length, the PDF of two-point velocity differences, and the skewness and kurtosis of two-point velocity differences. The profiles produced by LES match lidar well, except that they are too smooth at small scales. The profiles produced by SILHS exhibit sharp jumps from updraft to downdraft that are not observed in the lidar data. To reduce the generation of these unrealistically sharp jumps, the SILHS sampling method is revised. The diagnostics confirm that the revised sampling method reduces the overprediction of sharp jumps.

54 ENVIRONMENTAL SCIENCES↗

Optimisation of the Kaplan hydropower system via PID 2 and digital twin

Here, this paper proposes a proportional–integral-double–derivative (PID 2 ) optimisation method for the Kaplan hydropower system by building a digital twin. The study first uses one multilayer perceptron (MLP) to model the hydroturbine dynamic and then adopts three connected MLPs to model the generator dynamic, both in an open-loop fashion. Inspired by stochastic distribution control (SDC) theory, we regard the training of the turbine's neural network model as a process control problem, and we propose minimising entropy loss to update the network parameters. The next step is to build the digital twin by connecting the neural network models with a PID 2 controller and a lead-lag exciter and run the whole model in a closed-loop fashion. After that, a binary search approach is applied to optimise the PID 2 parameters based on the obtained digital twin model. The simulation results show that the proposed method can reduce the mean square tracking error by more than 90%. Furthermore, the method is extended to jointly optimise the PID 2 controller and excitation system gains through multiobjective optimisation, leveraging Pareto frontier analysis to balance active power and voltage tracking performance. Simulation results confirm the effectiveness of the proposed method, achieving a 83.46% reduction in relative mean square error of active power, a 47.13% reduction in terminal voltage tracking error, and an 82.78% improvement in the overall scalarized objective.

Hydropower system↗

Data‐Efficient Generation of Synthetic Microstructures of Polymer‐Bonded Energetic Material With Fine‐Tuned Stable Diffusion

Among current deep learning approaches for synthetic image generation, diffusion-based models stand out in terms of algorithmic stability and ability to retain high-fidelity image features with detailed resolution. Here, in this work, we employ Dreambooth, a method for fine-tuning Stable Diffusion, on X-ray CT images of microstructure of the polymer-bonded form (PBX) of a commonly used high explosive, Pentaerythritol tetranitrate (PETN), which yields generative models for creating synthetic PBX images. The models developed here represent five classes (or ‘lots’) of microstructures and demonstrate successful generation of images of each class with high fidelity, as verified by computed classification accuracy of ∼ 94% or higher. Data augmentation afforded by such image synthesis can be used to more reliably decipher underlying statistics, build processing-structure correlations, recognize off-normal structural anomalies, and identify age-related changes. Ideas related to converting image data into appropriate density mapping and performing mesoscale simulation or surrogate modeling of detonation are also discussed.

Dreambooth↗

Engineering a modular 44 Ti/ 44 Sc generator: eluate evaluation in preclinical models and estimation of human radiation dosimetry

Background: 44 Sc/ 47 Sc is an attractive theranostic pair for targeted in vivo positron emission tomographic (PET) imaging and beta-particle treatment of cancer. The 44 Ti/ 44 Sc generator allows daily onsite production of this diagnostic isotope, which may provide an attractive alternative for PET facilities that lack in-house irradiation capabilities. Early animal and patient studies have demonstrated the utility of 44 Sc. In our current study, we built and evaluated a novel clinical-scale 44 Ti/ 44 Sc generator, explored the pharmacokinetic profiles of 44 ScCl 3 , [ 44 Sc]-citrate and [ 44 Sc]-NODAGA (1,4,7-triazacyclononane,1-glutaric acid-4,7-acetic acid) in naïve mice, and estimated the radiation burden of 44 ScCl 3 in humans. Methods: 44 Ti/ 44 Sc (101.2 MBq) in 6 M HCl solution was utilized to assemble a modular ZR resin containing generator. After assembly, 44 Sc was eluted with 0.05 M HCl for further PET imaging and biodistribution studies in female Swiss Webster mice. Based on the biodistribution data, absorbed doses of 44 / 47 ScCl 3 in human adults were calculated for 18 organs and tissues using the IDAC-Dose software. Results: 44 Ti in 6 M HCl was loaded onto the organic resin generator with a yield of 99.97%. After loading and initial stabilization, 44 ScCl 3 was eluted with 0.05 M HCl in typical yields of 82.9 ± 5.3% (N = 16), which was normalized to the estimated generator capacity. Estimated generator capacity was computed based on elution time interval and the total amount of 44 Ti loaded on the generator. Run in forward and reverse directions, the 44 Sc/ 44 Ti ratio from a primary column was significantly improved from 1038 ± 440 to 3557 ± 680 (Bq/Bq) when a secondary, replaceable, ZR resin cartridge was employed at the flow outlet. In vivo imaging and ex vivo distribution studies of the reversible modular generator for 44 ScCl 3 , [ 44 Sc]-citrate and [ 44 Sc]-NODAGA show that free 44 Sc remained in the circulation significantly longer than the chelated 44 Sc. The dose estimation of 44 ScCl 3 reveals that the radiation burden is 0.146 mSv/MBq for a 70 kg adult male and 0.179 mSv/MBq for a 57 kg adult female. Liver, spleen and heart wall will receive the highest absorbed dose: 0.524, 0.502, and 0.303 mGy/MBq, respectively, for the adult male. Conclusions: A clinical-scale 44 Ti/ 44 Sc generator system with a modular design was developed to supply 44 ScCl 3 in 0.05 M HCl, which is suitable for further radiolabeling and in vivo use. Our data demonstrated that free 44 ScCl 3 remained in the circulation for extended periods, which resulted in approximately 10 times greater radiation burden than stably chelated 44 Sc. Stable 44 Sc/ 47 Sc-complexation will be more favorable for in vivo use and for clinical utility.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Analytical and numerical modeling of optical second harmonic generation in anisotropic crystals using #SHAARP package

Electric-dipole optical second harmonic generation (SHG) is a second-order nonlinear process that is widely used as a sensitive probe to detect broken inversion symmetry and local polar order. Analytical modeling of the SHG polarimetry of a nonlinear optical material is essential to extract its point group symmetry and the absolute nonlinear susceptibilities. Current literature on SHG analysis involves numerous approximations and a wide range of (in)accuracies. We have developed an open-source package called the Second Harmonic Analysis of Anisotropic Rotational Polarimetry (#SHAARP.si) which derives analytical and numerical solutions of reflection SHG polarimetry from a single interface (.si) for bulk homogeneous crystals with arbitrary symmetry group, arbitrary crystal orientation, complex and anisotropic linear dielectric tensor with frequency dispersion, a general SHG tensor and arbitrary light polarization. #SHAARP.si enables accurate modeling of polarimetry measurements in reflection geometry from highly absorbing crystals or wedge-shaped transparent crystals. The package is extendable to multiple interfaces.

36 MATERIALS SCIENCE↗

Probing the Extragalactic Mid-infrared Background with HAWC

The extragalactic background light (EBL) contains all the radiation emitted by nuclear and accretion processes in stars and compact objects since the epoch of recombination. Measuring the EBL density directly is challenging, especially in the near-to-far-infrared wave band, mainly due to the zodiacal light foreground. Instead, gamma-ray astronomy offers the possibility to indirectly set limits on the EBL by studying the effects of gamma-ray absorption in the very high energy (VHE: >100 GeV) spectra of distant blazars. The High Altitude Water Cherenkov Gamma Ray Observatory (HAWC) is one of the few instruments sensitive to gamma rays with energies above 10 TeV. This offers the opportunity to probe the EBL in the near/mid-IR region: λ = 1–100 μm. In this study, we fit physically motivated emission models to Fermi-LAT gigaelectronvolt data to extrapolate the intrinsic teraelectronvolt spectra of blazars. We then simulate a large number of absorbed spectra for different randomly generated EBL model shapes and calculate Bayesian credible bands in the EBL intensity space by comparing and testing the agreement between the absorbed spectra and HAWC extragalactic observations of two blazars. The resulting bands are in agreement with current EBL lower and upper limits, showing a downward trend toward higher wavelength values λ > 10 μm also observed in previous measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Battery models, systems, and methods using robust fail-safe iteration free approach for solving differential algebraic equations

Battery models using robust fail-safe iteration free approach for solving Differential Algebraic Equations, and associated systems and methods are disclosed. In one embodiment, a method includes generating a model of the rechargeable battery; determining one or more initial conditions for one or more algebraic variables of the model using a solver; holding differential variables of the model static by a switch function while determining the one or more initial conditions; applying the initial conditions to the model by the switch function; and determining one or more parameters for the rechargeable battery by solving the algebraic and differential equations.

25 ENERGY STORAGE↗

Grid-Supportive Loads - A New Approach to Increasing Renewable Energy in Power Systems

This paper demonstrates the potential of inverter-based loads to support grid reliability during power system transients thereby enabling reliable integration of renewable energy in power systems. Such loads are referred to in this paper as grid-supportive loads (GSLs). A new GSL model is developed that simulates the transient response capabilities that can be programmed in electronic loads. The model’s design enables it to be easily integrated in widely used commercial power system transient analysis software. Theoretical expressions are derived that explain the workings of the GSL model. The performance, numerical stability, and impact of the GSL model is validated on 9-bus and 2000-bus synthetic power system models using generator tripping and bus fault disturbances. Results on the 2000 bus system show that in the absence of frequency support from wind/solar generation resources, just 20% of loads with grid-supportive capabilities can improve frequency response by up to 2000 MW/0.1 Hz and reduce deviation in frequency at nadir by up to 60% compared to the situation when GSLs are absent. Power system reliability also improves under fault events. Here, it is further shown that GSLs can aid in integrating more renewable generation without degrading the overall transient response of the power system.

24 POWER TRANSMISSION AND DISTRIBUTION↗