Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

xSDK: Building an ecosystem of highly efficient math libraries for exascale

Current efforts to build increasingly powerful computer architectures are opening up new avenues for more complex and higher fidelity simulations coupled with data analytics and learning, leading to new scientific insights and deeper understanding. At one extreme, exascale computers will be much faster than previous computer generations (performing 10 18 operations per second—that is, 1,000 times faster than petascale). To achieve these performance improvements, computer architectures are becoming increasingly complex, with deep memory hierarchies, very high node and core counts, and heterogeneous features such as graphics processing units (GPUs). Such architectural changes impact the full breadth of computing scales, as heterogeneity pervades even current-generation laptops, workstations, and moderate-sized clusters. While emerging advanced architectures provide unprecedented opportunities, they also present significant challenges for developers of scientific applications, such as multiphysics and multiscale codes, who must adapt their software to handle disruptive changes in architectures and new programming models that have not yet stabilized. Developers must consider increasing concurrency while reducing communication and synchronization, and other complexities such as the potential for using mixed precision to leverage the compute power available in low-precision tensor cores. On one hand, developers must implement new scientific capabilities, which in turn increase code complexity. On the other hand, the codes must be ported to new architectures, requiring the inclusion of new programming models and the restructuring of code to achieve good performance. Addressing these issues is beyond the capability of any single person or team—leading to the need for collaboration among many teams, who encapsulate their expertise in reusable software and work together to create sustainable software ecosystems.

97 MATHEMATICS AND COMPUTING↗

Deep learning-enabled probing of irradiation-induced defects in time-series micrographs

Modeling time-series data with convolutional neural networks (CNNs) requires building a model to learn in batches as opposed to training sequentially. Coupling CNNs with in situ or operando techniques opens the possibility of accurately segmenting dynamic reactions and mass transport phenomena to understand how materials behave under the conditions in which they are used. In this article, in situ ion irradiation transmission electron microscopy (TEM) images are used as inputs into the CNN to assess the defect generation rate, defect cluster density, and saturation of defects. We then use the output segmentation maps to correlate with conventional TEM micrographs to assess the model’s ability to detail nanoscale interactions. Next, we discuss the implications of preprocessing and hyperparameters on model variability, accuracy when expanded to other datasets, and the role of regularization when controlling model variance. Ultimately, we eliminate human bias when extrapolating physical metrics, speed up analysis time, decouple reactions that happen at 100 ms intervals, and deploy models that are both accurate and transferable to similar experiments.

Burns, Kory (ORCID:0000000158019909)↗

Building an EPA Class VI Permit Application

Summary To accelerate the commercialization of carbon capture and storage (CCS), the US Department of Energy (US DOE) is building on decades of characterization efforts and pilot-scale projects through their CarbonSAFE program. Administered through their National Energy Technology Laboratory, this program seeks to bring fully integrated projects to the sector that can store more than 50 million tonnes of CO2 over a 30-year period. The program, which was enacted before the enhancement of Internal Revenue Code Section 45Q, is in the capture assessment, characterization, and permitting phase. The objectives of this paper are to discuss (a) the injection permitting requirements of the CarbonSAFE projects; (b) information gathering in support of the permit; (c) the timelines of field development and permit-related activities; (d) the major technical components of the field development plan; and (e) early feedback from the regulators toward acceptance of the permit. In Mississippi, more than 30,000 acres have been characterized by six deep characterization wells, a deep groundwater well, and 92 line miles of 2D seismic as part of the CarbonSAFE Project ECO2S. During the acquisition of seismic data, all receiver lines were live, which resulted in the generation of a pseudo-3D seismic design. The incorporation of a 3D seismic survey was not included as part of this project due to logistical difficulties presented by the undulating, wooded surface terrain. A suite of openhole geophysical logs was taken from each well, allowing for a detailed interpretation of prospective storage reservoirs and confining intervals to complement the analysis carried out on the 290 ft of a whole core that was cut through the prospective confining zone and storage reservoir. The detailed geologic and reservoir data were assembled and entered into a 3D model to assess the injection capacity and the area of review (AoR). This information fed into the detailed corrective action, monitoring, testing, and postinjection site care (PISC) modeling. The results have been exceptional. The geologic assessment has revealed three primary storage targets, ranging in depth from 3,500 ft to 6,000 ft. These storage reservoirs net 1,300 ft of sandstone, with mean porosity and permeability of 29% and 3.6 darcies, respectively. Together, these reservoirs have storage capacities that may exceed 20 million tonnes per square mile, making this a gigatonne prospect. Forward modeling of the project resulted in an AoR of 16 sq miles, injecting about 8000 t/d, for 30 years, via two deep injection wells. The excellent confining characteristics of the caprock, relatively simple geologic structure, and lack of historical well drilling activity in this area provide excellent containment of the injected CO2. Based on this work, the project has proposed 20 years of PISC. To date, only two US CO2 injection permits have been granted. These projects relied on a singular capture point feeding a singular sequestration point (source to sink), and considerations have not been made to garner CO2 emissions from other industrial sources. The Kemper County Storage Complex is a first-of-its-kind storage hub concept that looks to develop an area capable of storing significant quantities of CO2 from the region. Also, this work will show how characterization efforts, geological and numerical modeling efforts, and plan development were constructed in support of permit and incentives acceptance.

Energy & Fuels↗

Machine learning the spectral function of a hole in a quantum antiferromagnet

Understanding charge motion in a background of interacting quantum spins is a fundamental problem in quantum many-body physics. The most extensively studied model for this problem is the so-called t-t'-t''-J model, where the determination of the parameter t' in the context of cuprate superconductors is challenging. Here we present a theoretical study of the spectral functions of a mobile hole in the t-t'-t''-J model using two machine-learning techniques: K-nearest neighbor regression (KNN) and a feed-forward neural network (FFNN). We employ the self-consistent Born approximation to generate a dataset of about 1.3 x 10 5 spectral functions. Here we show that, for the forward problem, both methods allow for the accurate and efficient prediction of spectral functions, allowing, e.g., rapid searches through parameter space. Furthermore, we find that for the inverse problem (inferring Hamiltonian parameters from spectra), the FFNN can, but the KNN cannot, accurately predict the model parameters using merely the density of states. Our results suggest that it may be possible to use deep-learning methods to predict materials parameters from experimentally measured spectral functions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Improving neutrino oscillation measurements through event classification

Precise neutrino energy reconstruction is essential for next-generation long-baseline oscillation experiments, yet current methods remain limited by large uncertainties in neutrino-nucleus interaction modeling. Even so, it is well established that different interaction channels produce systematically varying amounts of missing energy and therefore yield different reconstruction performance–information that standard calorimetric approaches do not exploit. We introduce a strategy that incorporates this structure by classifying events according to their underlying interaction type prior to energy reconstruction. Using supervised machine-learning techniques trained on labeled generator events, we leverage intrinsic kinematic differences among quasielastic scattering, meson-exchange current, resonance production, and deep-inelastic scattering processes. A cross-generator testing framework demonstrates that this classification approach is robust to microphysics mismodeling and, when applied to a simulated DUNE 𝜈 𝜇 disappearance analysis, yields improved accuracy and sensitivity at the 10%–20% level. These results highlight a practical path toward reducing reconstruction-driven systematics in future oscillation measurements.

Ellis, Sebastian A. R. [King's College, London (Un↗

Status and Plan of DUNE at Fermilab

The discovery and the solid confirmation of neutrino flavor oscillation have been made throughout late 1990 to 2000s. Such oscillation is the clear proof of non-zero neutrino mass since this is caused by the fact that the neutrino mass eigenstates differ from that of the flavor. The neutrinos in the Standard Model, however, are massless leptons, and thus the neutrino flavor oscillation necessitates either the Standard Model to be significantly modified or a new theoretical paradigm to describe the universe better. In order to provide experimental information, it is essential for the properties of the neutrino oscillation be well understood through precision measurements of oscillation parameters, including the mixing angles, determination of the mass hierarchy between the three mass eigenstates and determination of the CP phase (Delta_CP) between neutrino and anti-neutrino oscillations. Among the several next generation neutrino experiments, this presentation covers the Deep Underground Neutrino Experiment (DUNE) which, with the high intensity neutrino beam facility, will help accomplish these goals. In this report, I will discuss the current status and plan of the DUNE experiment, including the results of the detector performance studies from the large scale prototype detectors operating at CERN and the timeline for construction and data taking of the experiment, as well as its physics prospects.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

GW-PINN: A deep learning algorithm for solving groundwater flow equations

Machine learning methods provide new perspective for more convenient and efficient prediction of groundwater flow. In this study, a deep learning method “GW-PINN” without labeled data for solving groundwater flow equations with wells was proposed. GW-PINN takes the physics inform neural network (PINN) as the backbone and uses either the hard or soft constraint in the loss function for training. A locally refined sampling strategy (LRS) is adopted to generate the consistent spatial sampling points for problems with strong hydraulic head change, and then combined with an appropriate temporal sampling scheme to obtain the final spatial-temporal sampling points. A snowball-style two-stage training strategy by dividing the temporal domain into two subdomains is designed to decrease the sampling points. Five cases were designed to test the training performance of GW-PINN under different sampling strategies and two constraints. The predicted results of GW-PINN were compared with MODFLOW and the analytical solution. The results demonstrate that GW-PINN possesses strong ability in capturing the hydraulic head change for both confined and un-confined aquifers. The hard constraint owns more robust learning ability than the soft constraint. The LRS strategy can generate more accurate results with much fewer sampling points than traditional sampling strategies, and the snowball-style two-stage training strategy is significantly efficient for problems with the drastic change of hydraulic head. Additionally, the application of GW-PINN as a surrogate model for parameterized groundwater flow equations is illustrated. This study provides an option tool for efficient groundwater flow simulation, especially for those with local refinements are needed.

54 ENVIRONMENTAL SCIENCES↗

Future energy infrastructure, energy platform and energy storage

Today fossil energy dominates energy consumption across the world. There has been an increasing momentum to reduce fossil energy consumption and increase renewable energy utilization to more than 70%. Such high penetrations of distributed renewable resources bring large uncertainty and complexity that cannot be easily handled by the current infrastructure. For the last two decades, telecommunication industry has gone through a similar transition from centralized to distributed systems, and more recently to platform approaches, which become the corner stone of today’s vibrant platform economy. Based on telecommunication history, we believe that a platform-based approach, called the energy platform, is a viable solution for addressing the renewable energy challenges. The energy platform consists of an array of computational algorithms, sensing and control technologies for key industry, energy generators and users to jointly manage and control the complex energy infrastructure. It includes the following key components: (1) the hardware and software to generate, store, control and transmit electricity/data (the energy cloud), (2) the digital platforms and tools for key energy producers, digital, service and communication industry to share the assets, participate in and manage the complex infrastructure, and for customers to participate in energy transactions, (3) the transaction platform for new service and business models. Additionally, the energy platform requires breakthroughs in large scale energy storage and many other areas including efficient power electronics, sensors and controls, new mathematical and computational tools, and deep integration of energy technologies and information sciences to control and stabilize such complex chaotic systems.

25 ENERGY STORAGE↗

OpenUniverse2024: a shared, simulated view of the sky for the next generation of cosmological surveys

The OpenUniverse2024 simulation suite is a cross-collaboration effort to produce matched simulated imaging for multiple surveys as they would observe a common simulated sky. Both the simulated data and associated tools used to produce it are intended to uniquely enable a wide range of studies to maximize the science potential of the next generation of cosmological surveys. We have produced simulated imaging for approximately 70 deg 2 of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) Wide-Fast-Deep survey and the Nancy Grace Roman Space Telescope High-Latitude Wide-Area Survey, as well as overlapping versions of the ELAIS-S1 Deep-Drilling Field for LSST and the High-Latitude Time-Domain Survey for Roman. OpenUniverse2024 includes (i) an early version of the updated extragalactic model called Diffsky, which substantially improves the realism of optical and infrared photometry of objects, compared to previous versions of these models; (ii) updated transient models that extend through the wavelength range probed by Roman and Rubin; and (iii) improved survey, telescope, and instrument realism based on up-to-date survey plans and known properties of the instruments. It is built on a new and updated suite of simulation tools that improves the ease of consistently simulating multiple observatories viewing the same sky. The approximately 400 TB of synthetic survey imaging and simulated universe catalogs are publicly available, and we preview some scientific uses of the simulations.

large-scale structure of Universe↗

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples.

Cherukara, Mathew J↗

Automatic Detection and Classification of Radio Galaxy Images by Deep Learning

Abstract Surveys conducted by radio astronomy observatories, such as SKA, MeerKAT, Very Large Array, and ASKAP, have generated massive astronomical images containing radio galaxies (RGs). This generation of massive RG images has imposed strict requirements on the detection and classification of RGs and makes manual classification and detection increasingly difficult, even impossible. Rapid classification and detection of images of different types of RGs help astronomers make full use of the observed astronomical image data for further processing and analysis. The classification of FRI and FRII is relatively easy, and there are more studies and literature on them at present, but FR0 and FRI are similar, so it is difficult to distinguish them. It poses a greater challenge to image processing. At present, deep learning has made breakthrough progress in the field of image analysis and processing and has preliminary applications in astronomical data processing. Compared with classification algorithms that can only classify galaxies, object detection algorithms that can locate and classify RGs simultaneously are preferred. In target detection algorithms, YOLOv5 has outstanding advantages in the classification and positioning of small targets. Therefore, we propose a deep-learning method based on an improved YOLOv5 object detection model that makes full use of multisource data, combining FIRST radio with SDSS optical image data, and realizes the automatic detection of FR0, FRI, and FRII RGs. The innovation of our work is that on the basis of the original YOLOv5 object detection model, we introduce the SE Net attention mechanism, increase the number of preset anchors, adjust the network structure of the feature pyramid, and modify the network structure, thereby allowing our model to demonstrate galaxy classification and position detection effects. Our improved model produces satisfactory results, as evidenced by experiments. Overall, the mean average precision (mAP@0.5) of our improved model on the test set reaches 89.4%, which can determine the position (R.A. and decl.) and automatically detect and classify FR0s, FRIs, and FRIIs. Our work contributes to astronomy because it allows astronomers to locate FR0, FRI, and FRII galaxies in a relatively short time and can be further combined with other astronomically generated data to study the properties of these galaxies. The target detection model can also help astronomers find FR0s, FRIs, and FRIIs in future surveys and build a large-scale star RG catalog. Moreover, our work is also useful for the detection of other types of galaxies.

Astronomy & Astrophysics↗

Experimental Soil Warming Impacts Soil Moisture and Plant Water Stress and Thereby Ecosystem Carbon Dynamics (Blodgett, CA)

This dataset contains data on daily soil temperature, moisture and flux, and soil carbon stock and root biomass across a soil profile down to 100 cm depth at Blodgett Forest Research Station, CA, USA. These data were generated to determine if modeling of an experimental soil warming of 4C showed increased soil CO2 emissions and changes in bulk soil carbon stocks with depth consistent with field observations, as part of the study: Riley et al. (2025) Experimental Soil Warming Impacts Soil Moisture and Plant Water Stress and Thereby Ecosystem Carbon Dynamics in Journal of Advances in Modeling Earth Systems. This research was performed within the framework of the TES Belowground Biogeochemistry SFA project, in particular association with a 1 m-deep experimental soil heating experiment at the University of California Blodgett Forest Research Station, California (120 ° 39′40′′W; 38 ° 54′43′′N). Continuous data were collected at the plot level, and bulk soil carbon and root biomass were sampled once a year from each plot from 0-100 cm, in 10 cm intervals. Measurements relevant to the current study include soil temperature and soil volumetric water content measured continuously at multiple depths in the top meter; fine root biomass and SOC stocks measured from annual soil cores. Soil flux was continuously monitored using a LI-8100 Automated CO2 Flux System in conjunction with the LI-8150 Multiplexer (Licor, Nebraska, USA). Soil flux was determined using SoilFluxPro software, with flux values showing an R² fit of less than 0.9 being excluded from the analysis. Data were collected from each paired plot (1-3): one control (C) and one heated (H).

54 ENVIRONMENTAL SCIENCES↗

Deep Learning for Full Waveform Inversion of Elastic Active-Source Seismic Data to Estimate P-Wave Velocity Models

Seismic imaging methods are critical for Global Security and Energy & Homeland Security missions and activities that rely on subsurface characterization, but traditional methods remain computationally expensive and require significant labor hours and expertise to execute. Within the past few years, machine learning (ML), namely deep learning (DL), has been used to develop data-driven end-to-end full waveform inversion (FWI) methods to estimate 2D P-wave velocity (Vp) models in a fraction of the time as conventional FWI. These methods, however, are trained on simplistic acoustic wave seismic data and Vp models that are not realistic nor representative of real-world observations, leaving a large gap between the state-of-the-art and deployable, feasible, and practical DL FWI methods. Here, we generate a synthetic active-source, 3D, elastic wave seismic data set and a variety of Vp models with realistic geologic structure for training DL FWI methods. We evaluate six different methods that have performed well for acoustic DL FWI or medical imaging tasks using our more realistic dataset. We find that these six trained models do not match the performance of published acoustic end-to-end DL FWI methods, indicating more training data may be needed, physics may need to be incorporated to achieve good accuracy at the sacrifice of the end-to-end advantage, and/or novel methods need to be developed to enable end-to-end DL FWI methods to perform well for real-world seismic data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Computer-aided Abnormality Detection in Chest Radiographs in a Clinical Setting via Domain-adaptation

Deep learning (DL) models are being deployed at medical centers to aid radiologists for diagnosis of lung conditions from chest radiographs. Such models are often trained on a large volume of publicly available labeled radiographs. These pre-trained DL models’ ability to generalize in clinical settings is poor because of the changes in data distributions between publicly available and privately held radiographs. In chest radiographs, the heterogeneity in distributions arises from the diverse conditions in X-ray equipment and their configurations used for generating the images. In the machine learning community, the challenges posed by the heterogeneity in the data generation source is known as domain shift, which is a mode shift in the generative model. In this work, we introduce a domain-shift detection and removal method to overcome this problem. Our experimental results show the proposed method’s effectiveness in deploying a pre-trained DL model for abnormality detection in chest radiographs in a clinical setting.

Dubey, Abhishek↗

Thermal Equations of State of Magnesite: Implication for the Complex Mid‐Lower Mantle Seismic Scatterers

Abstract Magnesite (MgCO 3 ) entering the lower mantle together with the subducted oceanic crust is an important carbon carrier. The reaction between magnesite and mantle minerals has been documented, but its influence on the density and velocity profiles of lower mantle remains unexplored. To decipher the deep carbon transportation and its associated effect, here we determined the thermal equations of state of magnesite up to 120 GPa and 2600 K using X‐ray diffraction in laser‐heated diamond anvil cells. The obtained thermal elastic parameters of magnesite facilitated a comprehensive understanding on the influence of magnesite‐SiO 2 reaction, variation of carbon and SiO 2 content, and temperature on the origin of lower‐mantle scatterers at 1,000–1,800 km depth. Our modeling revealed that the depth of the lower‐mantleV S scatterers is mainly controlled by the Al 2 O 3 content in SiO 2 , while its magnitude depends on the SiO 2 content. Along normal geotherm, the magnesite‐SiO 2 reaction would occur before the post‐stishovite transition, consuming substantial SiO 2 in the subducted oceanic crust. Depending on the amount of residual SiO 2 , the post‐stishovite transition can produce a 2.5–5.2 (2)%V S reduction, compatible with the observed seismic scatterers in Izu‐Bonin and Mariana subduction zones. Along slab geotherm, this reaction occurs after the post‐stishovite transition, generating a greaterV S reduction of 4.4–6.4 (4)%. We thus propose that the reaction between sinking MgCO 3 and SiO 2 in the slab is one of the potential factors influencing the magnitude of the lower‐Vs scatterers at 1,000–1,900 km depth. Our results provide new insights into the deep‐mantle carbonate transportation influencing regional geophysics.

Geochemistry & Geophysics↗

Bi-fidelity modeling of uncertain and partially unknown systems using DeepONets

Recent advances in modeling large-scale, complex physical systems have shifted research focuses towards data-driven techniques. However, generating datasets by simulating complex systems can require significant computational resources. Similarly, acquiring experimental datasets can prove difficult. For these systems, often computationally inexpensive, but in general inaccurate models, known as the low-fidelity models, are available. Here in this paper, we propose a bi-fidelity modeling approach for complex physical systems, where we model the discrepancy between the true system's response and a low-fidelity response in the presence of a small training dataset from the true system's response using a deep operator network, a neural network architecture suitable for approximating nonlinear operators. We apply the approach to systems that have parametric uncertainty and are partially unknown. Three numerical examples are used to show the efficacy of the proposed approach to model uncertain and partially unknown physical systems.

MATHEMATICS AND COMPUTING↗

Adaptive Reinforcement Learning (ARL) Control of a Multi-port Resonant Converter in UAV Systems

This study presents an adaptive reinforcement learning (ARL) control framework for a multi-port resonant converter used in hybrid unmanned aerial vehicle (UAV) power systems. The converter integrates high-frequency half-bridge input ports connected to a rectified engine–generator set and a battery energy storage system, along with a semi-bridgeless active rectifier supplying the propulsion load. A deep RL agent is trained to dynamically regulate inter-port phase-shift commands in real time based on flight conditions and load power demand. The ARL controller autonomously identifies phase-shift combinations that maximize conversion efficiency while maintaining stable and coordinated power flow, even under rapidly varying operating scenarios. This data-driven approach eliminates the need for explicit system modeling or extensive manual tuning and enables coordinated control among multiple power ports without inter-port communication. Experimental results validate that the ARL based strategy achieves reliable power sharing and consistently high-efficiency operation across diverse UAV operating conditions.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗

Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation

Non-intrusive reduced-order models (ROMs) have recently generated considerable interest for constructing computationally efficient counterparts of nonlinear dynamical systems emerging from various domain sciences. They provide a low-dimensional emulation framework for systems that may be intrinsically high-dimensional. This is accomplished by utilizing a construction algorithm that is purely data-driven. It is no surprise, therefore, that the algorithmic advances of machine learning have led to non-intrusive ROMs with greater accuracy and computational gains. However, in bypassing the utilization of an equation-based evolution, it is often seen that the interpretability of the ROM framework suffers. This becomes more problematic when black-box deep learning methods are used which are notorious for lacking robustness outside the physical regime of the observed data. In this article, we propose the use of a novel latent-space interpolation algorithm based on Gaussian process regression. Notably, this reduced-order evolution of the system is parameterized by control parameters to allow for interpolation in space. The use of this procedure also allows for a continuous interpretation of time which allows for temporal interpolation. The latter aspect provides information, with quantified uncertainty, about full-state evolution at a finer resolution than that utilized for training the ROMs. This research assesses the viability of this algorithm for an advection-dominated system given by the inviscid shallow water equations.

97 MATHEMATICS AND COMPUTING↗