Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep Direct Use”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Casing Annulus Monitoring of CO 2 Injection Using Wireless Autonomous Distributed Sensor Networks

Effective and secure carbon subsurface storage, involving the deep underground injection of CO 2 into geological formations where it is permanently trapped, is paramount to mitigating CO 2 emissions (Figure I). Ensuring the integrity of these storage sites and detecting potential leakage through the casing annulus necessitates robust monitoring. This work provides the first integrated demonstration of a wireless casing-annulus monitoring architecture that can operate in highly attenuating cement-brine environments relevant to CO 2 storage. This project focused on developing and validating a novel sensor system for integration with autonomous monitoring near the cement reservoir interface. The goal was a fully integrated Technology Readiness Level (TRL) 4/5 field validation of a distributed wireless intelligent sensor system providing real-time, direct subsurface formation measurements to enhance fluid movement monitoring in the cemented casing annulus. Achieving this objective required the development and integration of 1) wireless autonomous microsensor technology by California Institute of Technology (Caltech); 2) sensor packaging and emplacement technology by Research Triangle Institute (RTI); and 3) smart well completions using wireless active casing collars and NOV pipe by the Sandia National Lab (SNL). The collaboration with the Caltech team in this project aimed to develop millimeter-scale radio frequency identification (RFID) sensors capable of detecting CO 2 , pH, and/or methane levels. These sensors are engineered to be impervious to fluids, allowing them to be mixed with cement and installed within the casing annulus. They operate using RFID protocols at frequencies of 902–928 MHz for both power and communication. A Sandia National Laboratories’ team engaged their expertise in the development of a Smart Collar system designed for the wireless data collection from these RFID sensors embedded in the cement annulus and transmission of this information to the ground surface via IntelliPipe/IntelliServ NOV drill pipe. This is accomplished through inductive coupling at the collar, which facilitates data transfer through each segment of the pipe. Because the system cannot transmit a direct current signal to power the Smart Collar, both power and communication were implemented using alternating current and electromagnetic signals at varying frequencies. Furthermore, the developed microsensor technology had to be demonstrated and validated in comparison with reference transducer measurements in a field test site at The University of Texas at Austin (UT-Austin). Although the full sensor suite did not reach field-deployment readiness, the system-level integration achieved in this project establishes a validated pathway for future incorporation of advanced microsensors.

47 OTHER INSTRUMENTATION↗

Ecological Assembly Processes Are Coordinated between Bacterial and Viral Communities in Fractured Shale Ecosystems

The ecological drivers that concurrently act upon both a virus and its host and that drive community assembly are poorly understood despite known interactions between viral populations and their microbial hosts. Hydraulically fractured shale environments provide access to a closed ecosystem in the deep subsurface where constrained microbial and viral community assembly processes can be examined. Here, we used metagenomic analyses of time-resolved-produced fluid samples from two wells in the Appalachian Basin to track viral and host dynamics and to investigate community assembly processes. Hypersaline conditions within these ecosystems should drive microbial community structure to a similar configuration through time in response to common osmotic stress. However, viral predation appears to counterbalance this potentially strong homogeneous selection and pushes the microbial community toward undominated assembly. In comparison, while the viral community was also influenced by substantial undominated processes, it assembled, in part, due to homogeneous selection. When the overall assembly processes acting upon both these communities were directly compared with each other, a significant relationship was revealed, suggesting an association between microbial and viral community development despite differing selective pressures. These results reveal a potentially important balance of ecological dynamics that must be in maintained within this deep subsurface ecosystem in order for the microbial community to persist over extended time periods. More broadly, this relationship begins to provide knowledge underlying metacommunity development across trophic levels.

54 ENVIRONMENTAL SCIENCES↗

AGNet: weighing black holes with deep learning

Supermassive black holes (SMBHs) are commonly found at the centres of most massive galaxies. Measuring SMBH mass is crucial for understanding the origin and evolution of SMBHs. Traditional approaches, on the other hand, necessitate the collection of spectroscopic data, which is costly. We present an algorithm that weighs SMBHs using quasar light time series information, including colours, multiband magnitudes, and the variability of the light curves, circumventing the need for expensive spectra. We train, validate, and test neural networks that directly learn from the Sloan Digital Sky Survey (SDSS) Stripe 82 light curves for a sample of 38 939 spectroscopically confirmed quasars to map out the non-linear encoding between SMBH mass and multiband optical light curves. We find a 1σ scatter of 0.37 dex between the predicted SMBH mass and the fiducial virial mass estimate based on SDSS single-epoch spectra, which is comparable to the systematic uncertainty in the virial mass estimate. Our results have direct implications for more efficient applications with future observations from the Vera C. Rubin Observatory. Our code, AGNet, is publicly available at https://github.com/snehjp2/AGNet.

79 ASTRONOMY AND ASTROPHYSICS↗

Neutron Diffraction Analysis of Residual Strain in High-Pressure Die Cast A383 Engine Blocks

The residual strains in three high-pressure die cast A383 engine blocks were measured using neutron diffraction. Residual strains and stresses can be generated during high-pressure die casting process due to high thermal gradients and may cause fatigue failure or dimensional distortion. Neutron diffraction can measure the residual strain distributions deep inside castings with complex geometries, because neutrons can penetrate substantially more material than x-rays. In this paper, the residual strains (in the axial and hoop directions) along the whole cylinder bridge of high-pressure die cast A383 engine blocks in as-cast and heat-treated conditions were measured by neutron diffraction methods. The effect of heat treatment on the distribution and magnitude of residual strains was also investigated. The results indicate that the residual strain in the cylinder bridge is tensile in both the axial and hoop components for both the as-cast and the heat-treated engine blocks. The residual strain in the hoop direction is bigger in magnitude than the residual strain in the axial direction. Heat treatment significantly relaxes the residual strain in the axial direction but only slightly relaxes the residual strain in the hoop direction.

36 MATERIALS SCIENCE↗

Using Ambient Noise Seismic Interferometry and Local and Teleseismic Earthquakes to Determine Crustal Thickness and Moho Structure of the Northwestern Gulf of Mexico Margin

Abstract The northwestern part of the Gulf of Mexico has undergone two episodes of continental rifting and collision and produced structural artifacts that are now buried under many kilometers of sediments, complicating investigations of the region. The deep sedimentary package precludes outcrops and points to a need for the application of seismic techniques, but low rates of seismicity in the region and sparse seismic monitoring limit the utility of traditional seismic methods. We therefore use diverse data to perform two‐dimensional seismic tomography across the dry land portion of the margin. Data are gleaned from teleseismic and regional earthquakes, postcritical SsPmp arrivals, and direct P wave energy identified with seismic interferometry that were recorded by a broadband, three‐component array and partially overlapping short‐period, vertical‐component array. The Pn and postcritical SsPmp phase help constrain the Moho discontinuity, which a previous receiver function study suggested was absent beneath the seaward portion of this transect. A high‐velocity body is observed in the crust at the same location as the Houston Magnetic Anomaly, possibly marking rocks from the Alleghenian continental assembly. The crust thins from NW to SE, indicating that extension occurred mostly to the south of the Ouachita orogeny. Our model indicates that the margin's sediment package reaches a maximum thickness of ~15 km at the coast and becomes unresolvably thin near the Llano Uplift.

58 GEOSCIENCES↗

FutureTense

Protective vaccines and reliable diagnostics are essential tools for controlling viral diseases. However, the efficacy of these tools can be diminished by mutations in viral genomes. The delay between the emergence of new viral strains and the redesign of vaccines and diagnostics allows for continued viral transmission. Is it possible to address this challenge by computationally predicting viral genome sequence evolution? Can we “future-proof” vaccines and diagnostics by targeting both current and anticipated future sequence variants? While predicting viral evolution is still an unsolved, “grand challenge” problem in biology, the large, and rapidly growing, number of SARS-CoV-2 genome sequences provide an opportunity to quantify the ability of machine learning to predict viral genome sequence evolution. Towards this end, we have developed a simple computational model for predicting viral evolution at the level of individual nucleotides. The key metric for quantifying the per-base, prediction accuracy for viral evolution is the Mann-Whitney U statistic (or, equivalently, the area under the receiver operator curve). Since the Mann-Whitney U statistic is not a differentiable function, existing deep leaning packages (like Pytorch and Keras/TensorFlow) are not useful, as they require that the accuracy metric/objective function be analytically differentiable with respect to the model parameters. To overcome this challenge, we have implemented custom software, “FutureTense”, that can train a machine learning model by maximizing the non-differentiable Mann-Whitney U statistic. This software trains a machine learning model by exploring along the direction of the discrete gradient of the Mann-Whitney U statistic in the model parameter space. Parallel computing and genome sequence-specific optimizations are used to accelerate model training. The resulting machine learning model learns the observed high C->U mutation rates in the SARS-CoV-2 genome (which are potentially induced by host defenses) and provides prediction accuracies that are significantly better than one would expect from random chance. While predicting viral evolution is still quite far from a solved problem, the surprising performance of this simple model gives hope that the accuracy of predicting viral genome evolution can be further increased by more sophisticated approaches.

Gans, Jason↗

Spin-transparent storage rings for quantum computing

Spin-transparent storage rings, where any spin direction repeats after one full turn, can be used in conjunction with ion traps as a new quantum computing platform [1]. Advantages of spin-transparent rings for quantum computing include: large numbers of stored qubits; long quantum coherence times of up to several hours; long storage lifetimes; and room temperature operation. These exceptional qualities mean rings could provide a scalable way to implement algorithms with deep complexity requiring many quantum operations while simultaneously providing a large number of qubits. This new platform where the qubit has long quantum coherence time can also be used as a quantum sensor or a part of a quantum memory.

Accelerator Physics↗

Exploring switch II pocket conformation of KRAS(G12D) with mutant-selective monobody inhibitors

The G12D mutation is among the most common KRAS mutations associated with cancer, in particular, pancreatic cancer. Here, we have developed monobodies, small synthetic binding proteins, that are selective to KRAS(G12D) over KRAS(wild type) and other oncogenic KRAS mutations, as well as over the G12D mutation in HRAS and NRAS. Crystallographic studies revealed that, similar to other KRAS mutant-selective inhibitors, the initial monobody bound to the S-II pocket, the groove between switch II and α3 helix, and captured this pocket in the most widely open form reported to date. Unlike other G12D-selective polypeptides reported to date, the monobody used its backbone NH group to directly recognize the side chain of KRAS Asp12, a feature that closely resembles that of a small-molecule inhibitor, MTRX1133. The monobody also directly interacted with H95, a residue not conserved in RAS isoforms. These features rationalize the high selectivity toward the G12D mutant and the KRAS isoform. Structure-guided affinity maturation resulted in monobodies with low nM KD values. Deep mutational scanning of a monobody generated hundreds of functional and nonfunctional single-point mutants, which identified crucial residues for binding and those that contributed to the selectivity toward the GTP- and GDP-bound states. When expressed in cells as genetically encoded reagents, these monobodies engaged selectively with KRAS(G12D) and inhibited KRAS(G12D)-mediated signaling and tumorigenesis. These results further illustrate the plasticity of the S-II pocket, which may be exploited for the design of next-generation KRAS(G12D)-selective inhibitors.

59 BASIC BIOLOGICAL SCIENCES↗

Embedded training of neural-network subgrid-scale turbulence models

We report that the weights of a deep neural-network model are optimized in conjunction with the governing flow equations to provide a model for subgrid-scale stresses in a temporally developing plane turbulent jet at Reynolds number Re 0 = 6000 . The objective function for training is first based on the instantaneous filtered velocity fields from a corresponding direct numerical simulation, and the training is by a stochastic gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields. In-sample and out-of-sample testing on multiple dual-jet configurations show that its required mesh density in each coordinate direction for prediction of mean flow, Reynolds stresses, and spectra is half that needed by the dynamic Smagorinsky model for comparable accuracy. The same neural-network model trained directly to match filtered subgrid-scale stresses, without the constraint of being embedded within the flow equations during the training, fails to provide a qualitatively correct prediction. The coupled formulation is generalized to train based only on mean-flow and Reynolds stresses, which are more readily available in experiments. The mean-flow training provides a robust model, which is important, though a somewhat less accurate prediction for the same coarse meshes, as might be anticipated due to the reduced information available for training in this case. The anticipated advantage of the formulation is that the inclusion of resolved physics in the training increases its capacity to extrapolate. This is assessed for the case of passive scalar transport, for which it outperforms established models due to improved mixing predictions.

42 ENGINEERING↗

Dynamic asymmetric strain imprinted into substrates by an oxide thin film

In film-substrate systems, the substrate role is often considered to be limited to providing static mechanical constraints. Dynamic film-substrate interactions when a structural change in the film modifies the substrate are generally disregarded. Here, using combined x-ray and electron microscopies, we observed that an electrically induced filament in a vanadium dioxide film created strong asymmetric strain in an underlying sapphire substrate. This asymmetric substrate strain fed back into the film and defined the filament expansion direction, revealing the importance of film-substrate dynamic interactions in determining film functionality. Furthermore, the strain imprint propagated at least tens of micrometers deep into the substrate, exceeding the film thickness by more than 200-fold, potentially enabling substrate functionalization as an active mechanical coupling media in three-dimensional integrated microelectronic architectures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Even Higher-Level Synthesis: An Exploration of AI Hardware Accelerators using HLS4ML

With the rise of artificial intelligence, the popularization of deep learning, and a constantly evolving industry, the demand for flexible and efficient tools has never been greater. As algorithms grow more complex, their runtime and energy consumption increase exponentially. Customized hardware accelerators, long used for specific mathematical operations, remain essential for managing modern applications' computational and power demands. Hardware accelerators can speed up complex computations by orders of magnitude, but their manual design and verification processes are often challenging and time-consuming. High-Level Synthesis (HLS) provides a solution by transforming high-level algorithm descriptions, typically written in C++ or SystemC, into synthesizable RTL suitable for hardware implementation. This approach reduces development time for RTL engineers while offering flexibility beyond what traditional handwritten RTL can provide. We extended this capability to the machine-learning domain with the open-source framework hls4ml, which allows neural networks trained in Python frameworks like Tensorflow or PyTorch to be synthesized into efficient hardware representations for the traditional FPGA and ASIC flows. This breakthrough addresses the growing need for reduced design turnaround and easy verification of ML hardware accelerators with low latency and power efficiency constraints. During this tutorial, we will demonstrate how Python complements HLS by simplifying the ML design process, bridging the gap between software and hardware development. Attendees will explore how we translate neural networks modeled in Python into fixed-point C++ models suitable for HLS workflows. We will dive into strategies like Value-Range Analysis and Quantization-Aware Training, which optimize these designs for deployment and evaluate their accuracy, power consumption, and energy efficiency. To exemplify these concepts, experts from Fermilab will share their experiences applying this technology to high-energy physics experiments, where real-time, low-latency processing is critical. Over the years, Fermilab engineers have demonstrated how deep neural networks, optimized for hardware using hls4ml, can meet the stringent requirements of trigger systems at the CERN Large Hadron Collider. These systems rely on rapid decision-making to process immense data volumes while retaining only the most relevant events for further analysis. The application of hls4ml has also been extended to innovative technologies like smart pixel arrays. These smart pixels integrate ML inference capabilities directly into sensor devices, enabling localized data processing at the pixel level. This approach drastically reduces the need to transmit raw data to external processing units, significantly decreasing power consumption and latency. By embedding neural networks within the pixel architecture, the smart pixels can identify and prioritize relevant data in real time, providing a highly efficient solution for edge computing in scenarios such as particle detectors and imaging systems. Fermilab's work highlights the potential of hardware-accelerated ML in scenarios where both speed and power efficiency are mission-critical. Through this tutorial, attendees will gain valuable insights into the challenges and solutions of deploying ML in hardware. Understanding how HLS and hls4ml streamline the development of neural network-based hardware accelerators is fundamental for the industry's future. Participants will learn how these technologies are shaping the future of AI and scientific computing.

Di Guglielmo, Giuseppe [Fermilab]↗

Deep Learning for In-Situ Layer Quality Monitoring during Laser-Based Directed Energy Deposition (LB-DED) Additive Manufacturing Process

Defects are a leading issue for the rejection of parts manufactured through the Directed Energy Deposition (DED) Additive Manufacturing (AM) process. In an attempt to illuminate and advance in situ quality monitoring and control of workpieces, we present an innovative data-driven method that synchronously collects sensing data and AM process parameters with a low sampling rate during the DED process. The proposed data-driven technique determines the important influences that individual printing parameters and sensing features have on prediction at the inter-layer qualification to perform feature selection. Three Machine Learning (ML) algorithms including Random Forest (RF), Support Vector Machine (SVM), and Convolutional Neural Network (CNN) are used. During post-production, a threshold is applied to detect low-density occurrences such as porosity sizes and quantities from CT scans that render individual layers acceptable or unacceptable. This information is fed to the ML models for training. Training/testing are completed offline on samples deemed “high-quality” and “low-quality”, utilizing only features recorded from the build process. CNN results show that the classification of acceptable/unacceptable layers can reach between 90% accuracy while training/testing on a “high-quality” sample and dip to 65% accuracy when trained/tested on “low-quality”/“high-quality” (respectively), indicating over-fitting but showing CNN as a promising inter-layer classifier.

36 MATERIALS SCIENCE↗

NH 3 -Mediated Reactive Capture and Conversion: Integrating CO 2 Absorption from Flue Gas with CO Production via NH 4 HCO 3 Electrolysis

Efficient carbon capture and utilization require strategies that minimize energy penalties of CO 2 regeneration and compression. Reactive capture and conversion (RCC) address this challenge by integrating capture with direct electrochemical conversion. Here, we show an NH3-mediated tandem RCC system that couples capture of CO 2 from simulated flue gas (10% v/v CO 2 in N 2 ) with electroreduction of NH 4 HCO 3 to CO over a Ni single-atom catalyst (Ni-SAC). Speciation modeling and capture experiments revealed that a deep CO 2 capture with C/N ratio of 0.65 was achieved using 2.5 M NH 3 from simulated flue gas. Electrolysis of the resulting NH 4 HCO 3 on the Ni- SAC delivered an 85% CO Faradaic efficiency at 100 mA/cm 2 with excellent tolerance to NH 3 /NH 4 + as confirmed by DFT calculations and ab initio molecular dynamics (AIMD) simulations. Further, the technoeconomic analysis established a levelized total cost of CO manufacturing of $25.43/kmol, gauging the practical viability. Overall, this study holds great potential to decarbonize the chemical manufacturing industry while reducing synthetic production costs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Physics-Informed Deep Neural Networks for Learning Parameters and Constitutive Relationships in Subsurface Flow Problems

In this paper, we present a physics informed deep neural network (DNN) method for estimating parameters and unknown physics (constitutive relationships) in partial differential equation (PDE) models. We use PDEs in addition to measurements to train DNNs to approximate unknown parameters and constitutive relationships as well as states. The proposed approach increases the accuracy of DNN approximations of partially known functions when a limited number of measurements is available and allows for training DNNs when no direct measurements of the functions of interest are available. We employ physics informed DNNs to estimate the unknown space-dependent diffusion coefficient in a linear diffusion equation and an unknown constitutive relationship in a non-linear diffusion equation. For the parameter estimation problem, we assume that partial measurements of the coefficient and states are available and demonstrate that under these conditions, the proposed method is more accurate than state-of-the-art methods. For the non-linear diffusion PDE model with a fully unknown constitutive relationship (i.e., no measurements of constitutive relationship are available), the physics informed DNN method can accurately estimate the non-linear constitutive relationship based on state measurements only. Finally, we demonstrate that the proposed method remains accurate in the presence of measurement noise.

42 ENGINEERING↗

Detecting deviations from Gaussianity in high-redshift CMB lensing maps

ABSTRACT While the probability density function of the cosmic microwave background (CMB) convergence field approximately follows a Gaussian distribution, primordial non-Gaussianities, and small contributions from structures at low redshifts make the overall distribution slightly non-Gaussian. Some of the late-time component can be modelled using the distribution of galaxies and subtracted off from the original CMB lensing map to produce a map of matter distribution at high redshifts. Using this high-redshift mass map, we are able to directly study the early phases of structure formation. In this work, we forecast the detectability of signatures of non-Gaussianity due to non-linear structure formation at z > 1.2. Assuming the optimal case of no systematics, we find that it is challenging to detect such signatures in current surveys, but future experiments such as the deep field of CMB-S4 will be able to make detections of ∼7σ.

Astronomy & Astrophysics↗

Neural network emulation of flow in heavy-ion collisions at intermediate energies

Applications of new techniques in machine learning are speeding up progress in research in various fields. In this work, we construct and evaluate a deep neural network (DNN) to be used within a Bayesian statistical framework as a faster and more reliable alternative to the Gaussian process (GP) emulator of an isospin-dependent Boltzmann-Uehling-Uhlenbeck (IBUU) transport model simulator of heavy-ion reactions at intermediate beam energies. We found strong evidence of the DNN being able to emulate the IBUU simulator's prediction on the strengths of protons' directed and elliptical flow very efficiently even with small training datasets and with accuracy about ten times higher than the GP. Here, limitations of our present work and future improvements are also discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Exploring Classification of Topological Priors With Machine Learning for Feature Extraction

In many scientific endeavors, increasingly abstract representations of data allow for new interpretive methodologies and conceptualization of phenomena. For example, moving from raw imaged pixels to segmented and reconstructed objects allows researchers new insights and means to direct their studies toward relevant areas. Thus, the development of new and improved methods for segmentation remains an active area of research. With advances in machine learning and neural networks, scientists have been focused on employing deep neural networks such as U-Net to obtain pixel-level segmentations, namely, defining associations between pixels and corresponding/referent objects and gathering those objects afterward. Topological analysis, such as the use of the Morse-Smale complex to encode regions of uniform gradient flow behavior, offers an alternative approach: first, create geometric priors, and then apply machine learning to classify. This approach is empirically motivated since phenomena of interest often appear as subsets of topological priors in many applications. Using topological elements not only reduces the learning space but also introduces the ability to use learnable geometries and connectivity to aid the classification of the segmentation target. Here, in this article, we describe an approach to creating learnable topological elements, explore the application of ML techniques to classification tasks in a number of areas, and demonstrate this approach as a viable alternative to pixel-level classification, with similar accuracy, improved execution time, and requiring marginal training data.

97 MATHEMATICS AND COMPUTING↗