Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Fracture Characterization Via AI‐Assisted Analysis of Temperature Logs

Abstract Fractures control fluid flow, mass transport, and heat transfer in a geothermal reservoir. This makes accurate characterization of fracture networks a prerequisite for optimal design and control of a reservoir's exploitation. We develop a deep‐learning procedure to identify fracture locations via interpretation of temporally and spatially continuous downhole temperature measurements. A long short‐term memory fully convolutional network (LSTM‐FCN) is used both to capture long‐term dependencies in sequential temperature data and to distill local features around fractures. A wellbore and fractured‐reservoir thermal model is established to generate temperature data for network training. The trained LSTM‐FCN exhibits a unique ability to detect multiple fractures intersecting a borehole. We use the LSTM‐FCN algorithm to evaluate the effectiveness of different‐stage wellbore temperature measurements on fracture detection in a complex fractured system. Our experiments reveal that the use of various‐stage temperature information as an input feature set improves the robustness of fracture detection to noise interference. This study indicates the practical feasibility of obtaining accurate fracture‐network reconstructions from temperature signals, at reasonable computational cost.

Yang, Xiaoyu↗

TwinMe4AD: WGAN-based Digital Twins for Anomaly Detection

SAND2024-08373O TwinMe4AD is a Python-based software tool designed for anomaly detection using digital twins that closely mimic real, wearable healthcare datasets. The tool is invaluable for scenarios where collecting data is either expensive or impractical, serving as a privacy-preserving solution. Sensitive information is protected by training deep learning models on synthetic data derived from real datasets. One of TwinMe4AD's key features is its anomaly detection capability, which is based on fourth-order moments of parameters. This versatile approach can be applied across a range of datasets, from univariate to multivariate, making it compatible with various types of data. It also generates synthetic twins using Wasserstein Generative Adversarial Networks (WGANs), allowing users to create a small cohort of a population similar to that of a village population. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Poorey, Kunal↗

A study of lens opacification for a Mars mission

A method based on risk-related cross sections is used to estimate risks of 'stationary' cataracts caused by radiation exposures during extended missions in deep space. Estimates of the even more important risk of late degenerative cataractogenesis are made on the basis of the limited data available. Data on lenticular opacification in the New Zealand white rabbit, an animal model from which such results can be extrapolated to humans, are analyzed by the Langley cosmic ray shielding code (HZETRN) to generate estimates of stationary cataract formation resulting from a Mars mission. The effects of the composition of shielding material and the relationship between risk and LET are given, and the effects of target fragmentation on the risk coefficients are evaluated explicitly.

Shinn, J. L.↗

How is statistical thinking useful for evaluating foundation models?

Good’s statement appears to be rather prescient – while humanity has marched on through to the 21st century, modern artificial intelligence (AI), driven by a menagerie of immense deep-neural-network architectures aided with parallel computation, seems positioned to change life as we know it. It would be an understatement to say that the world has been captivated by AI. Recent engineering feats, such as autonomous vehicles and generative AI, have gripped the public sphere, and AI is poised to disrupt a host of industries – including software, pharmaceuticals, healthcare, manufacturing, entertainment, and a slew of others; indeed, one is hard pressed to find any industry that does not claim to bear an impact from the so-called AI revolution.

97 MATHEMATICS AND COMPUTING↗

Deep Cyber-Physical Situational Awareness for Energy Systems: A Secure Foundation for Next-Generation Energy Management

This document provides the final report for the CYPRES project. The purpose is (1) to highlight and summarize its major accomplishments and (2) to provide guidance on how its outcomes have informed and can inform important additional research and technology transfer. The goal of CYPRES was the research, development, and demonstration of a security-oriented next generation cyber-physical EMS for electric power systems that detects malicious and abnormal events through the fusion of cyber and physical data. To achieve this, the CYPRES project team researched, developed, and built a prototype of the solution, referred to as the CYPRES EMS. The CYPRES EMS is a proof-of-concept cyber-physical platform that demonstrates the management of the energy system, communications, security, and cyber-physical grid modeling and analytics. As part of the capabilities of the CYPRES EMS, the team designed and developed a suite of power system applications for monitoring, risk analyses, detection, and control that are inherently cyberaware. At its core, the project aimed to research, develop, and demonstrate a security-oriented next-generation cyber-physical Energy Management System (EMS) capable of detecting malicious and abnormal events through the innovative fusion of cyber and physical data. This approach represents a fundamental shift from traditional EMS, reimagining how critical infrastructure can be protected through unified cyber-aware and physics-aware secure data flow pipelines. The project’s cornerstone deliverable, the CYPRES EMS, serves as a proof-of-concept cyber-physical platform that revolutionizes the management of energy systems, communications, security, and cyber-physical grid modeling and analytics. This prototype implements a comprehensive suite of power system applications for monitoring, risk analyses, detection, and control, all designed with inherent cyber awareness. The system’s architecture extends from end-devices in the field through to control center applications, establishing a secure and resilient control framework that addresses the challenges posed by diverse devices of unknown trustworthiness connecting to modern power systems. Through this innovative approach to deep cyber-physical situational awareness, the CYPRES project not only advances the state-of-the-art in energy infrastructure protection but also establishes a new paradigm for how EMS can be designed, deployed, and operated in an increasingly complex threat landscape. The findings and developments from this project provide crucial insights for stakeholders across the energy sector, offering a blueprint for enhancing the reliability and resilience of our nation’s critical energy infrastructure in the face of evolving cyber threats.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Mapping Post-Climate Change Biogeographical Regions with Deep Latent Variable Models

Forecasting future changes to biodiversity due to shifts in climate is challenging due to nonlinear interactions between species as recorded in their presence/absence data. This work proposes using variational autoencoders with environmental covariates to identify low-dimensional structure in species’ joint co-occurrence patterns and leveraging this simplified representation to provide multivariate predictions of their habitat extent under future climate scenarios. We pursue a latent space clustering approach to map biogeographical regions of frequently co-occurring species and apply this methodology to a dataset from northern Belgium, generating predictive maps illustrating how these regions may expand or contract with changing temperature under a future climate scenario.

Krapu, Chris↗

IoT Intrusion Detection Taxonomy, Reference Architecture, and Analyses

This paper surveys the deep learning (DL) approaches for intrusion-detection systems (IDSs) in Internet of Things (IoT) and the associated datasets toward identifying gaps, weaknesses, and a neutral reference architecture. A comparative study of IDSs is provided, with a review of anomaly-based IDSs on DL approaches, which include supervised, unsupervised, and hybrid methods. All techniques in these three categories have essentially been used in IoT environments. To date, only a few have been used in the anomaly-based IDS for IoT. For each of these anomaly-based IDSs, the implementation of the four categories of feature(s) extraction, classification, prediction, and regression were evaluated. We studied important performance metrics and benchmark detection rates, including the requisite efficiency of the various methods. Four machine learning algorithms were evaluated for classification purposes: Logistic Regression (LR), Support Vector Machine (SVM), Decision Tree (DT), and an Artificial Neural Network (ANN). Therefore, we compared each via the Receiver Operating Characteristic (ROC) curve. The study model exhibits promising outcomes for all classes of attacks. The scope of our analysis examines attacks targeting the IoT ecosystem using empirically based, simulation-generated datasets (namely the Bot-IoT and the IoTID20 datasets).

97 MATHEMATICS AND COMPUTING↗

Application of Machine-Learning Algorithms for On-Board Asteroid Shape Model Determination

The Application of Machine-learning Algorithms for On-board Asteroid Shape Model Determination project will develop an innovative system for spacecraft navigation to expand the capability of small spacecraft to meet the critical challenges associated with small-body exploration. Such challenges include accurate navigation in a microgravity environment and precision targeting of particular locations on an asteroid surface for sample collection. This on-board system will cut the computational "umbilical" back to Earth-currently necessary for the generation of a global shape model that requires thousands of images with sufficient resolution and adequate variation of incidence and emission angles, processed manually by a team of experts on Earth for several months. Small satellites have limited bandwidth and are unable to downlink the data volume required for this processing, restricting their ability to perform deep-space asteroid exploration.

Machine learning algorithms↗

Pre-Equilibrium De-Excitations for Neutrino-Nucleus Interactions

The Deep Underground Neutrino Experiment (DUNE) is sensitive to MeV-scale energy depositions from low-energy astrophysical neutrinos, including those from core-collapse supernovae. Interpreting these detector signals requires accurate modeling of the nuclear de-excitation that follows from the neutrino-nucleus interaction. The MARLEY (Model of Argon Reaction Low-Energy Yields) event generator specializes in the low-energy regime. MARLEY currently assumes the residual nucleus equilibrates immediately after the primary interaction. This omits the intermediate pre-equilibrium stage in which energy redistributes among nucleons until statistical equilibrium is reached. While pre-equilibrium effects are well established for nucleon-induced reactions, they have not previously been studied for neutrino-nucleus interactions. This work addresses that gap by implementing a two-component exciton model, which is the first dedicated treatment of pre-equilibrium de-excitation for neutrino-nucleus interactions, restructured around MARLEY's existing class hierarchy to prepare for direct integration, including particle-hole state densities, internal transition rates, and pre-equilibrium particle emission. The calculations show encouraging agreement with the TALYS-2.2 nuclear reaction code for neutron-nucleus interactions. We further propose a concrete integration path into the full MARLEY event generator, including derived class structure and an extended event record for pre-equilibrium vertices in support of future reweighting. Remaining work focuses on refining the emission width calculation, adding $\gamma$-ray emission, and completing this integration to quantify the impact of pre-equilibrium effects on the expected low-energy neutrino signals in DUNE and similar experiments.

Visser, Erin [Michigan State U., East Lansing (mai↗

James Webb Space Telescope Navigation Optimization Challenges

The James Webb Space Telescope (JWST) is a NASA flagship mission launched on December 25, 2021. The early orbit phase was highlighted by three midcourse correction burns that were performed to maneuver the vehicle into a libration orbit at the second Sun-Earth-Moon (SEM) libration point (L2). During the coast to L2, the vehicle’s primary observatory and sunshield were deployed. Once the tennis-court-sized sunshield was unfurled and tensioned into place, the large area exposed to solar radiation pressure (SRP) dictated that the SRP force model would need to account for the vehicle’s geometry, reflective properties, and orientation relative to the Sun. Following the insertion of JWST into its L2 libration orbit on January 24, 2022, the commissioning phase for the vehicle’s observatory commenced along with the first cycle of routine station-keeping maneuvers. The NASA Goddard Space Flight Center’s Flight Dynamics Facility (FDF) provides navigation services for the JWST mission. The FDF serves as the prime or backup navigation operations center for more than 30 active missions spanning a wide array of flight regimes performing orbit determination, maneuver planning, trajectory optimization, and tracking data evaluation. Definitive orbit determination for JWST is performed by the FDF using an Extended Kalman Filter (EKF) to estimate the vehicle’s trajectory and reflective properties using Deep Space Network (DSN) TRK-2-34 tracking data and spacecraft attitude telemetry. For the purposes of orbit prediction and station-keeping maneuver targeting, the sensitivity of the SRP force to the vehicle’s orientation requires that predictive attitude information must be incorporated to generate accurate orbit predictions and maneuver plans. Predictive attitude plans are provided to the FDF by the JWST Spacecraft Operations Center (SOC). Short-term (28 day) orbit predictions are propagated using a Short Range Attitude Plan (SRAP) to model the vehicle’s future attitude states for up to a week. SRAP attitude data is highly reliable, as it reflects finalized planned attitude states that the vehicle will be commanded to attain during the ensuing week. A Long Range Attitude Plan (LRAP) can be implemented to model predicted attitude states beyond one week, but these predictions are tentative and subject to revision due to changes in science operations plans. Instead, a conservative approach of applying a Sun-Pointing Neutral (SPN) attitude configuration is utilized for long-term (2 year) orbit predictions where reliable planned attitude data is not available. SPN attitude mode aligns the net SRP force along the JWST-to-Sun vector where it becomes independent of the vehicle’s angle of rotation about this vector, defined as the Sun yaw. Given the dynamic instability of the libration orbit, station-keeping thrust must be applied in either the sunward or anti-sunward direction to balance the resulting orbit. The attitude constraints of the vehicle also impose limits on the available pointing directions for station-keeping thrusters. The thrusters cannot be aligned with the optimal pointing direction for sunward maneuvers, rendering sunward maneuvers to be significantly less fuel efficient than anti-sunward maneuvers. Consequently, station-keeping maneuvers must be targeted to balance the orbit while ensuring that the next maneuver will also be performed in the anti-sunward direction to optimize propellant usage. When targeting a station-keeping maneuver, the attitude and SRP modeling configuration which is applied to the predicted post-maneuver trajectory will dictate the direction of the subsequent station-keeping maneuver, assuming nominal propulsion system performance. If the predicted post-maneuver attitude states result in an SRP model which under-predicts the cumulative SRP impact on the post-maneuver orbit, a targeted anti-sunward maneuver will be larger than necessary and the next maneuver will need to be executed sunward in order to compensate. In contrast, an anti-sunward maneuver which is targeted using an SRP model which over-predicts the cumulative SRP impact will achieve station-keeping while ensuring that the next maneuver will likewise be performed anti-sunward. For this reason, station-keeping maneuvers are targeted while applying the SPN attitude mode, as this mode entails the largest possible SRP area cross-section and therefore a larger modeled cumulative SRP impact. This paper documents the NASA Goddard Space Flight Center’s FDF support for JWST on-orbit operations and the analysis projects undertaken utilizing the experiences and data accumulated throughout the first full year of routine science operations. The results of these analysis efforts have been used to implement improvements to orbit prediction accuracy and maneuver efficiency which have the potential to prolong the lifespan of JWST to continue to conduct ground-breaking infrared astronomy for decades to come.

Flight Dynamics↗

Deep Impact Sequence Planning Using Multi-Mission Adaptable Planning Tools With Integrated Spacecraft Models

The Deep Impact mission was ambitious and challenging. JPL's well proven, easily adaptable multi-mission sequence planning tools combined with integrated spacecraft subsystem models enabled a small operations team to develop, validate, and execute extremely complex sequence-based activities within very short development times. This paper focuses on the core planning tool used in the mission, APGEN. It shows how the multi-mission design and adaptability of APGEN made it possible to model spacecraft subsystems as well as ground assets throughout the lifecycle of the Deep Impact project, starting with models of initial, high-level mission objectives, and culminating in detailed predictions of spacecraft behavior during mission-critical activities.

Deep Impact Mission↗

Venus cloud models

Remote observations of Venus are reviewed. The strongest inferences of cloud properties can be drawn from polarization data which provide information about cloud particles near 68 km. Particle properties are not as well determined at higher and lower levels. If the clouds are generated photochemically from reduced sulfur species, the supply of O2 may be an important constraint on cloud production. Vapor-pressure data reviewed, and it is shown that deep clouds cannot be H2SO4-H2O aerosols unless the mixing ratios of both H2SO4 and H2O approach 0.001 below 50 km.

Wofsy, S. C.↗

Understanding neutrinos with accelerator beams and liquid argon time-projection chambers: ICARUS and DUNE

A global program of experiments has worked towards characterizing neutrino oscillation over the past few decades. However, important parameters remain to be measured, and mysteries remain to be elucidated. Current and upcoming experiments are targeting the open questions and probing the consistency of the neutrino oscillation paradigm. Likewise, the liquid argon (LAr) time-projection chamber (TPC) has emerged as a sensitive particle detection technology for neutrino experiments. A current generation of LAr TPC detectors are being used to study neutrinos while also gaining important experience in operating and analyzing with this technology. SBND, MicroBooNE, and ICARUS have collected or are collecting data from beams at Fermilab (near Chicago) to explore the possibility of a sterile neutrino and/or other beyond Standard Model (BSM) physics. SBND and ICARUS will be used to conduct a two-detector analysis as part of the Short Baseline Neutrino (SBN) Program. Additionally, these detectors are enabling important neutrino interaction studies necessary to prepare for the next generation of oscillation experiments. One such oscillation experiment that will come online over the next years is the Deep Underground Neutrino Experiment (DUNE), which will install multiple 10 kiloton LAr TPCs underground in South Dakota (south of Saskatchewan) to conduct oscillation measurements with neutrinos originating in a beamline at Fermilab. A detector complex will be installed at Fermilab as well, to study the beam before the expected flavour oscillations. This “near detector” will also employ a LAr TPC, with a segmented and pixel-based design, as well as other technologies to constrain uncertainties in the oscillation measurement by characterizing the beam and neutrino interactions. This talk will discuss the ICARUS and DUNE experiments, the LAr TPC detector technology, and the efforts to realize and leverage these experiments to better understand the properties of neutrinos.

Howard, Bruce L. [Fermilab]↗

Hydrodynamic Impact-Load Alleviation with a Penetrating Hydro-Ski

A penetrating hydro-ski was mounted below a model tested previously in the study reported in NACA Technical Note 4401, and a series of impacts were made in the Langley impact basin to determine load alleviation with this type of hydro-ski. The hydro-ski was designed to penetrate through seaway irregularities with a minimum of drag and with small impact loads. The penetrating hydro-ski was small (beam-loading coefficient of 111) and of a streamline shape with the bottom designed for flush retraction into the main model. A series of impacts at fixed trim angles of 8, 16, and 30 deg were made in smooth water and at a fixed trim angle of 8 deg in rough water. The loads and motions of the model were recorded, and photographic observations of the flow and cavities generated in the water by the penetrating hydro-ski were made. The data are presented and the maximum impact loads and maximum drafts of the model with the penetrating hydro-ski are compared with those of the model obtained without the penetrating hydro-ski. Maximum load reductions of 30 to 70 percent in smooth water and of 50 to 80 percent in rough water are indicated. Cavity and flow generation by the penetrating hydro-ski are discussed, and it is indicated that the penetrating hydro-ski moved smoothly through the water and generated deep cavities which are shown by stereophotographs.

Edge, Philip M., Jr.↗

Towards Neutron Transformation Searches

To probe the origins of the baryon asymmetry, baryon number violation, the last unconfirmed Sakharov condition, must be definitively observed experimentally. Similarly, the nature of dark matter is currently unknown, and calls out for new candidates to be investigated. Each of these issues can be considered through the study of neutron transformations.Some rare baryon number violating processes, such as neutron-antineutron transformations, are expected to probe baryogenesis. Here, I show progress on this discovery target through construction of more accurate Monte Carlo models, the design of future detectors, creation of more complete atmospheric neutrino background simulations, and use of automated analysis techniques within the the NNBAR/HIBEAM experimental program at the European Spallation Source (ESS) and the Deep Underground Neutrino Experiment (DUNE). First simulation-based sensitivities for these experiments will be discussed. Modeling of rare neutron-antineutron transformation and subsequent annihilation will be discussed at length for multiple nuclei useful to these and other collaborations. To go along with this work, more comprehensive lepton-scattering nuclear models must be integrated into neutrino event generators for proper atmospheric neutrino background simulations. I discuss the first furnishing of these backgrounds for DUNE, and I highlight a potential path forward for the community in this vein using precisionmore » electron scattering modeling as a facsimile.Aspects of other potentially related neutron – mirror-neutron oscillations pertinent to dark matter and the neutron lifetime anomaly will also be considered for the ESS HIBEAM experiment. Here, I will present the first experimental sensitivity calculations for a broad range of modular experimental setups which will serve as research and design stepping stones toward NNBAR while producing a multitude of physics results over short time scales.« less

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Synthetic galaxy clusters and observations based on Dark Energy Survey Year 3 Data

ABSTRACT We develop a novel data-driven method for generating synthetic optical observations of galaxy clusters. In cluster weak lensing, the interplay between analysis choices and systematic effects related to source galaxy selection, shape measurement, and photometric redshift estimation can be best characterized in end-to-end tests going from mock observations to recovered cluster masses. To create such test scenarios, we measure and model the photometric properties of galaxy clusters and their sky environments from the Dark Energy Survey Year 3 (DES Y3) data in two bins of cluster richness $\lambda \in [30; 45)$, $\lambda \in [45; 60)$ and three bins in cluster redshift ($z\in [0.3; 0.35)$, $z\in [0.45; 0.5)$ and $z\in [0.6; 0.65)$. Using deep-field imaging data, we extrapolate galaxy populations beyond the limiting magnitude of DES Y3 and calculate the properties of cluster member galaxies via statistical background subtraction. We construct mock galaxy clusters as random draws from a distribution function, and render mock clusters and line-of-sight catalogues into synthetic images in the same format as actual survey observations. Synthetic galaxy clusters are generated from real observational data, and thus are independent from the assumptions inherent to cosmological simulations. The recipe can be straightforwardly modified to incorporate extra information, and correct for survey incompleteness. New realizations of synthetic clusters can be created at minimal cost, which will allow future analyses to generate the large number of images needed to characterize systematic uncertainties in cluster mass measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

AI-Driven Crack Detection for Remanufacturing Cylinder Heads Using Deep Learning and Engineering-Informed Data Augmentation

Detecting cracks in cylinder heads traditionally relies on manual inspection, which is time-consuming and susceptible to human error. As an alternative, automated object detection utilizing computer vision and machine learning models has been explored. However, these methods often face challenges due to a lack of sufficiently annotated training data, limited image diversity, and the inherently small size of cracks. Addressing these constraints, this paper introduces a novel automated crack-detection method that enhances data availability through a synthetic data generation technique. Unlike general data augmentation practices, our method involves copying cracks from one location to another, guided by both random and informed engineering decisions about likely crack formations due to cyclic thermomechanical loads. The innovative aspect of our approach lies in the integration of domain-specific engineering knowledge into the synthetic generation process, which substantially improves detection accuracy. We evaluate our method’s effectiveness using two metrics: the F2 score, which emphasizes recall to prioritize detecting all potential cracks, and mean average precision (MAP), a standard measure in object detection. Experimental results demonstrate that, without engineering insights, our method increases the F2 score from 0.40 to 0.65, while maintaining a stable MAP. Incorporating detailed engineering knowledge further enhances the F2 score to 0.70 and improves MAP to 0.57, representing increases of 63% and 43%, respectively. These results confirm that our approach not only mitigates the limitations of traditional data augmentation but also significantly advances the reliability and precision of crack detection in industrial settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Hybrid geological modeling: Combining machine learning and multiple-point statistics

Accurately modeling and constructing a geologically realistic subsurface model remains an outstanding problem as the morphology controls the flow behaviors. Particularly, one of the pattern-based methods, namely cross-correlation based simulation, has been proved to be an effective way to reconstruct a realistic model, at both small and large scales. However, conditioning to point data in the large-scale problems is still a crucial issue in these algorithms, since there is always a trade-off between the quality of the realizations and the degree of point data reproduction. Specifically, it is not practical to build a training image (TI) which includes all the possibilities and variabilities. Therefore, finding a pattern that can represent the point data and, at the same time, preserving the connectivities is difficult. This leads to producing highly-connected realizations with a significant mismatch or poor models with a reasonable degree of point data reproduction. To accurately reproduce the densely distributed hard data, pixel-based methods can also produce some unrealistic artifacts around the hard data. In this paper, to overcome this challenge, however, we use pattern-based methods as they often produce more disconnected geobodies when dealing with dense hard data, and proposed a hybrid algorithm using the pattern-based methods and convolutional neural network (CNN). The trained CNN model is utilized to improve the quality of conditioning to point data for the original realizations generated by the pattern-based algorithm. As such, the mismatch locations are identified, and the same regions are used in the training of CNN to mimic the procedure through which a missing region can be filled. To evaluate the performance of the proposed hybrid algorithm, it is tested on cases with different dimensions and different numbers of facies. Then, the newly improved realizations are compared with the initial realizations generated by the pattern-based algorithm. The comparison is also conducted by the flow simulation test. And it indicates that the proposed hybrid algorithm can better reproduce the point data, while the connectivities are better preserved.

58 GEOSCIENCES↗