Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “experimental learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Learning effective SDEs from Brownian dynamic simulations of colloidal particles

We construct a reduced, data-driven, parameter dependent effective stochastic differential equation (eSDE) for electric-field mediated colloidal crystallization using data obtained from Brownian dynamics simulations. We use diffusion maps (a manifold learning algorithm) to identify a set of useful latent observables. In this latent space we identify an eSDE using a deep learning architecture inspired by numerical stochastic integrators and compare it with the traditional Kramers–Moyal expansion estimation. We show that the obtained variables and the learned dynamics accurately encode the physics of the Brownian dynamic simulations. We further illustrate that our reduced model captures the dynamics of corresponding experimental data. Further, our dimension reduction/reduced model identification approach can be easily ported to a broad class of particle systems dynamics experiments/models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hydra: Computer Vision for Online Data Quality Monitoring

Hydra is a system utilizing computer vision for near real-time data quality monitoring. Currently operational across all of Jefferson Lab’s experimental halls, it reduces the workload of shift takers by autonomously monitoring diagnostic plots during experiments. Hydra uses "off-the-shelf" supervised learning technologies and is supported by a comprehensive MySQL database. To simplify access, web apps have been developed to facilitate both labeling and monitoring of Hydra’s inferences. Hydra can connect with the alarm system and incorporates complete historical tracking, enabling it to identify issues that shift takers could miss. When issues are detected, a natural first question is: "Why does Hydra think there is a problem?" To answer, Hydra employs Gradient-weighted Class Activation Maps (GradCAM) to identify regions of the image that are important for the specific classification. This interpretive layer enhances transparency and trustworthiness, which is essential for integration with experiment workflows and operation. The Hydra system, results, and sociological considerations for deployment will be discussed.

Jeske, Torri↗

A unified understanding of minimum lattice thermal conductivity

Here, we propose a first-principles model of minimum lattice thermal conductivity ($κ^{min}_L$) based on a unified theoretical treatment of thermal transport in crystals and glasses. We apply this model to thousands of inorganic compounds and find a universal behavior of $κ^{min}_L$ in crystals in the high-temperature limit: The isotropically averaged $κ^{min}_L$ is independent of structural complexity and bounded within a range from ~0.1 to ~2.6 W/(m K), in striking contrast to the conventional phonon gas model which predicts no lower bound. We unveil the underlying physics by showing that for a given parent compound, $κ^{min}_L$ is bounded from below by a value that is approximately insensitive to disorder, but the relative importance of different heat transport channels (phonon gas versus diffuson) depends strongly on the degree of disorder. Moreover, we propose that the diffuson-dominated $κ^{min}_L$ in complex and disordered compounds might be effectively approximated by the phonon gas model for an ordered compound by averaging out disorder and applying phonon unfolding. With these insights, we further bridge the knowledge gap between our model and the well-known Cahill–Watson–Pohl (CWP) model, rationalizing the successes and limitations of the CWP model in the absence of heat transfer mediated by diffusons. Finally, we construct graph network and random forest machine learning models to extend our predictions to all compounds within the Inorganic Crystal Structure Database (ICSD), which were validated against thermoelectric materials possessing experimentally measured ultralow κ L . Our work offers a unified understanding of $κ^{min}_L$, which can guide the rational engineering of materials to achieve .

42 ENGINEERING↗

Optimizing Direct Air Capture Solvents to Minimize Energy Consumption of CO 2 Release in a Carbonate Electrolyzer

Addressing climate change by carbon management is critical to achieving the goal of net zero carbon emissions by 2050. In this work, we examined the electrochemically-driven recovery of CO 2 during alkaline solvent regeneration for solvent-based direct air capture. A mathematical model was developed by incorporating carbonate chemistry with water electrolysis to predict the energy consumption per unit of CO 2 released. The predicted results were consistent with the experimental data, in which the experimental work was achieved by characterizing alkalinity and carbon loading values of solvent collected from a flow carbonate electrolyzer. Through this study, we learned that minimizing the energy expended on CO 2 release can be achieved by using an anolyte with a lower alkalinity, increasing the electric charge input to the electrolyzer, and reducing the ohmic resistance of the electrolyzer. Furthermore, using a supporting electrolyte, e.g., Na 2 SO 4 in the present work, effectively compensates for the higher ohmic resistance from using an anolyte with a lower alkalinity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Data from: "Responses of alpine plant communities to climate warming"

The Alpine Treeline Warming Experiment (ATWE) was a common garden-climate manipulation experiment set up across an elevation gradient in Niwot Ridge, in the Front Range of the Colorado Rocky Mountains, USA. The project sought to learn more about the effects of climate change on alpine and subalpine ecosystems, namely tree species ranges and alpine plant communities. Plots were experimentally manipulated using infrared heaters set up to warm plots to temperatures comparable to those projected for the year 2100. Other treatments include watering, and a combination of watering and heating. Three sites were set up at different elevations to study three tree species, with the highest-elevation “Alpine” site ( ~3540 m) containing twenty additional plots to study alpine plant communities. Data in this package originate from these unseeded alpine plots. To evaluate soil nitrogen availability given site treatments, resin bags were deployed, removed, and extracted annually to produce ammonium and nitrate/nitrite readings.--------------------------------------------------Data files within this archive are in comma-separated-values (.csv) and Microsoft Excel (.xlsx) formats. .csvs can be read and opened by Microsoft Excel, R, or any other simple text-editing software, and .xlsx files can be opened using Microsoft Excel. Geospatial data associated with this package are in .kml and ESRI shapefile (.shp) formats. .kml files can be read using Google Earth or Google Maps, and shapefiles can be read with any software compatible with the file type, such as QGIS or ESRI’s ArcMap suite.Data files in this package - excluding “Winkler_2019_ALPO_inorganic_N_allyears.csv” - are provided in both Microsoft Excel and .csv formats, for added accessibility and flexibility in workflows. File contents are identical.

54 ENVIRONMENTAL SCIENCES↗

Multisensor Agile Adaptive Sampling of Convective Storms Driven by Real-time Analytics

Convective storms vertically transport water vapor and condensate from Earth’s surface to the upper troposphere. Life on Earth is fundamentally linked to this transport which determines the hydrological cycle, and the intensity of severe weather responsible for the destruction of life and property. Despite advances in high-resolution modeling and better observational capabilities, the scientific community continues to be confronted with knowledge gaps about convective storms that limit our predictive capabilities. The ongoing developments in the high-resolution Energy Exascale Earth System Model (E3SM), large eddy simulations, and AI-based analytics to evaluate uncertainties are expected to provide a comprehensive framework for new scientific discovery. The model-experiment (MODEX) approach suggests that the aforementioned advancements in model development and AI-based inference techniques should be complemented by similar advancements in the experimental (observational) side so that the former does not outstrip the ability of the latter to provide meaningful constraints. What are the recent advancements in observations that will provide the necessary leap forward in improving our predictive capabilities? To address this question, we propose a new experimental paradigm called Multisensor Agile Adaptive Sampling (MAAS) that capitalizes on advancements in communications (5G), computational resources (edge/fog computing), sensor capabilities, and machine learning (ML) and AI techniques (Kollias et al., 2020). The MAAS framework allows for the collection of higher spatiotemporal resolution and quality observations of convective storms than is traditionally possible. The MAAS framework is scalable and applicable to atmospheric observatories such as those operated by the Department of Energy (DoE) Atmospheric Radiation Measurement (ARM) facility.

54 ENVIRONMENTAL SCIENCES↗

Predicting Catalyst Surface Stability Under Reaction Conditions Using Deep Reinforcement Learning and Machine Learning Potentials

Catalysts are critical for most large-scale energy intensive chemical transformation processes, such as energy storage, liquid fuel production, and the formation of chemical building blocks. The catalyst composition, structure, and morphology impact the performance under reaction conditions and influences properties like activity and selectivity. Many industrial catalysts offer imperfect activity/selectivity, or contain expensive metals. Further, catalysts can deactivate over time as the morphology changes or harsh reactive environments alter the surface structure. Methods to automatically model and predict the kinetics of how catalyst surfaces will restructure would enable engineers to design around these challenges, improve performance, increase longevity. This project investigated a specific type of machine learning model, deep reinforcement learning, machine learning models to act as surrogates for the physical system, and compared the results of these approaches with a specialized high-throughput experimental synthesis and measurement platform.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

1981 LTA technology assessment - Past and present

A four-part presentation is made of (1) lessons learned from the design and operation of the 'classic' airships of the 1920s and 30s, with respect to such issues as construction, propulsion, control, instrumentation, ground handling, habitability, aerodynamics, and structure and construction; (2) lessons learned from the development of such specialized lighter-than-air (LTA) concepts as metal-clad airships, semi-buoyant lifting bodies, experimental, sport and commercial free balloons, high-altitude platforms, and tethered aerostats; (3) the current status of LTA technology in various countries, with emphasis on significant developments in configuration, dynamics, control, structures, materials, and propulsion; and (4) a projection of future trends. It is concluded that socio-economic factors will strongly influence and encourage LTA development in the 1990s.

Ashford, R. L.↗

Magnetospheric studies using the UKS data

The magnetic field data from the UKS spacecraft were analyzed to learn more about the solar wind interaction with the Earth's magnetosphere and about the magnetosphere itself. The data was reduced from raw experimenter data records to engineering units. The evolution of the waves in the foreshock, the varying structure of the bow shock along the boundary, simultaneous behavior of the magnetopause in the north and south hemisphere and MHD waves in the magnetosphere and magnetosheath were examined.

Russell, C. T.↗

Advances in Molecular Beam Epitaxy Growth of Ultra-Wide Bandgap Ga2O3 Based Alloys

Gallium oxide (Ga2O3) is an emerging ultra-wide bandgap semiconductor material that has attracted attention for its potential to outperform existing SiC and GaN based devices operating at high breakdown voltages and high temperature. Isovalent alloying of In and Al in Ga2O3 provides the ability to engineer bandgap energy and strain of the material. Alloying with Al increases the bandgap energy and the theoretically achievable Baliga's figure of merit, a key measure of a material's ultimate performance limits for high power switching devices. Alloying with In introduces compressive strain and can be used to counteract the tensile strain of Al incorporation. The resulting (AlxGa1-x-yIny)2O3 alloy can be lattice-matched to commercially available Ga2O3 wafers and has a tunable bandgap energy greater than that of Ga2O3, 4.76 eV. Such lattice-matched material can be grown arbitrarily thick without the detrimental effects of elastic strain and relaxation, making it suitable for high voltage diodes and transistors. However, efforts to synthesize isovalent alloys are complicated by their tendency to phase separate into corundum Al2O3 or bixbyite In2O3. Literature reports of the quaternary (AlxGa1-x-yIny)2O3 are limited to <1% unintentional indium incorporation in In-catalyzed (AlxGa1-x)2O3. The primary limitation to quaternary growth is the limited incorporation of indium at elevated growth temperatures. This limited incorporation is due to both the volatility of indium oxide and Al and Ga cation exchange reactions which replace indium in In2O3. We report on the development of a novel high-throughput molecular beam epitaxy (MBE) technique to screen the growth conditions for the ternary alloy (InyGa1-y)2O3, and the application of these findings to the first successful synthesis of phase pure monoclinic (AlxGa1-x-yIny)2O3 by MBE. By leveraging the unique sub-oxide chemistry of Ga2O3 and in-situ monitoring of crystal properties by reflection high-energy electron diffraction (RHEED), a cyclical growth and etch-back method is developed and applied to rapidly characterize the (InyGa1-y)2O3 growth space. This cyclical method provides approximately 10x increase in experimental throughput and up to 46x improvement in Ga2O3 substrate utilization. Appropriate growth conditions for monoclinic (InyGa1- y)2O3 are identified by machine learning analysis of RHEED patterns and targeted growths are characterized ex-situ to confirm improved In incorporation. These growth conditions are then combined with established (AlxGa1-x)2O3 growth conditions to grow quaternary (AlxGa1-x-yIny)2O3 with Al mole fractions ranging from 1.4% - 24.4% and In mole fractions ranging from 3.1% to 15.5%. The chemical and optical properties of the alloys are investigated by XRD, XPS, and spectroscopic ellipsometry. A lattice-matched (AlxGa1-x-yIny)2O3 alloy is examined by 4D-STEM and the chemical and physical uniformity of Al and In incorporation are discussed.

alloy↗

Adaptive learning-driven high-throughput synthesis of oxygen reduction reaction Fe–N–C electrocatalysts

Reducing human reliance on inefficient energy systems and fossil fuels has become more urgent due to the consequences of global climate change. However, traditional trial-and-error approaches have hampered our ability to accelerate the discovery and implementation of functional materials for efficient energy conversion devices, such as polymer electrolyte fuel cells (PEFCs). To address this, we develop an adaptive learning framework that integrates machine learning and state-of-the-art capabilities in high-throughput synthesis to achieve expedited optimization of iron-nitrogen-carbon PEFC oxygen reduction reaction (ORR) electrocatalysts. We use statistical inference, uncertainty quantification, and global optimization to build a computational design-of-experiment tool that identifies the optimum compositions to be investigated next to reduce the demands placed on experimental materials discovery. We benchmark the ability of the proposed strategy to discover optimum catalyst synthesis conditions in a six-dimensional search space when starting with a thirty-six-sample database. By following the adaptive learning strategy, we synthesize fourteen new catalysts from approximately ten billion unique compositions and discover four catalysts that outperform all original samples. The best machine learning-optimized catalyst is 33% more active than the highest-performing one in the initial database, showing an ORR activity seven times larger than those typically reported for the same class of materials.

36 MATERIALS SCIENCE↗

Precision Polishing of Spheres Via In-Situ Process Monitoring and Machine-Learning-Based Optimization

Precision polishing for high surface finish is a vital step in the making of many high-tech components for optical and semiconductor modules as well as for wide ranging experimental samples for HED science that is at the core of LLNL’s mission. In particular, the fabrication of extremely smooth and round spheres comprised of low atomic number materials (low-Z such as high-density carbon or HDC, beryllium, hydrocarbon polymers, etc.) for Inertial Confinement Fusion (ICF) is entirely reliant on specialized polishing processes to achieve the surface smoothness.

36 MATERIALS SCIENCE↗

Lowering the barrier to access information-rich transient kinetic data for machine learning methods

Transient kinetic data contain a wealth of information about intrinsic features of a catalyst as well as the reaction mechanism. Currently, high volume transient data is underutilized, and data science methods could both increase the value of information that can be extracted from this data, integrate experimental with theoretical data sources, and accelerate the pace of catalyst technology advancement. Transient kinetic characterizations with simple probe molecules exhibiting reversible adsorption, irreversible adsorption and bulk-surface diffusion are presented as training components for similar experiments with more complex surface reactions. In conclusion, by increasing the availability and accessibility of transient kinetic data through details of its structure and acquisition, we aim to decrease the barrier for data scientists to apply machine learning methods to this valuable data source.

Catalysis↗

Predictive Data Analytics Framework Using Advanced Test Reactor Acoustic Data

Although a nuclear reactor is a hostile environment for sensing and electrical communications, the reactor core is amenable to acoustic communication. An acoustic measurement infrastructure (AMI) has been installed at the Advanced Test Reactor (ATR) nozzle trench area to record acoustic signals that has the ability to capture different operating regime of the reactor. This AMI includes ATR in-pile structural components, coolant, acoustic receivers, primary coolant pumps (PCP) as signal sources, a data acquisition system, and signal-processing algorithms, enabling real-time. This report will discusses development of recursive Fast Fourier Transform approach to process in real-time acoustic signals, application of short time Fast Fourier Transform to the ATR brush data to understand the vibration level and to develop spectrograms for different primary coolant pump combinations. The combination of primary coolant pumps for normal and power axial locator mechanism of ATR are different and generates different signatures. These acoustic signatures were used to develop machine learning approaches to automatically classify different operating regimes. This lay the foundation for predictive analytic framework that can be leverage by ATR to optimize their operation and maintenance. The path forward involves continued engagement with ATR and expanded implementation of AMI and predictive framework at ATR and other facilities within INL and at other experimental reactors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Analyzing Deep Learning Model Inferences for Image Classification using OpenVINO

It may be desirable to execute deep learning model inferences on an integrated GPU at the edge. While such GPUs are much less powerful than discrete GPUs, it is able to deliver higher floating-point operations per second than a CPU located on the same die. For edge devices, the benefit of moving to lower precision with minimal loss of accuracy to obtain higher performance is also attractive. Hence, we chose 14 deep learning models for image classification to evaluate their inference performance with the OpenVINO toolkit. Then, we analyzed the implementation of the fastest inference model of all the models. The experimental results are promising. Compared to the performance of full-precision (FP32) models, the speedup of the 8-bit (INT8) quantization ranges from 1.02 to 1.56 on an Intel (R) Xeon (R) 4-core CPU, and the speedup of the FP16 models ranges from 1.1 to 2 on an Intel (R) Iris (TM) Pro GPU. For the FP32 models, the GPU is on average 1.5X faster than the CPU.

CPU↗

Physics augmented machine learning discovery of composition-dependent constitutive laws for 3D printed digital materials

Multi-material 3D printing, particularly through polymer jetting, enables the fabrication of digital materials by mixing distinct photopolymers at the micron scale within a single build to create a composite with tunable mechanical properties. Here, this work presents an integrated experimental and computational investigation into the composition-dependent mechanical behavior of 3D printed digital materials. We experimentally characterize five formulations, combining soft and rigid UV-cured polymers under uniaxial tension and torsion across three strain and twist rates. The results reveal nonlinear and rate-dependent responses that strongly depend on composition. To model this behavior, we develop a physics-augmented neural network (PANN) that combines a partially input convex neural network (pICNN) for learning the composition-dependent hyperelastic strain energy function with a quasi-linear viscoelastic (QLV) formulation for time-dependent response. The pICNN ensures convexity with respect to strain invariants while allowing non-convex dependence on composition. To enhance interpretability, we apply $L_0$ sparsification. For the time-dependent response, we introduce a multilayer perceptron (MLP) to predict viscoelastic relaxation parameters from composition. The proposed model accurately captures the nonlinear, rate-dependent behavior of 3D printed digital materials in both uniaxial tension and torsion, achieving high predictive accuracy for interpolated material compositions. This approach provides a scalable framework for automated, composition-aware constitutive model discovery for multi-material 3D printing.

Constitutive modeling↗

Bottom-up design of actinide materials from molecular clusters: Demonstration of a general-purpose simulation capability leveraging machine-learned atomic potentials

Actinide thin-film coatings such as uranium dioxide (UO 2 ) play an important role in nuclear reactors and other mission-relevant applications, but realization of their potential requires a deep fundamental understanding of the chemical vapor deposition (CVD) processes used for their growth. The slow experimental progress can be attributed, in part, to the standard safety guidelines associated with handling uranium byproducts, which are often corrosive, toxic, and radioactive. Accurate simulation techniques, when used in concert with experiment, can improve laboratory safety, material durability, and deliverable timeframes. However, state-of-the-art computational methods are either insufficiently accurate or intractably expensive. To remedy this situation, in this project we suggested a machine-learning (ML) accelerated workflow for simulating molecular clustering toward deposition. As a benchmark test case, we considered molecular clustering in steam and assessed independent components of our workflow by comparing with measured thermodynamic properties of water. After analyzing each component individually and finding no fundamental barrier to realization of the workflow, we attempted to integrate the ML component, a Sandia-developed tool called FitSNAP. As this was the first application of FitSNAP to atoms and molecules in the gas phase at Sandia, the method required more fitting data than was originally anticipated. Systematic improvements were made by including in the fit data diatomic potentials, molecular single-bond-breaking curves, and symmetry-constrained intermolecular potentials. We concluded that our strategy provides a feasible pathway toward modeling CVD and related processes, but that extensive training data must be generated before it can be of practical use.

36 MATERIALS SCIENCE↗

QuadConv: Quadrature-based convolutions with applications to non-uniform PDE data compression

We present a new convolution layer for deep learning architectures which we call QuadConv — an approximation to continuous convolution via quadrature. Our operator is developed explicitly for use on non-uniform, mesh-based data, and accomplishes this by learning a continuous kernel that can be sampled at arbitrary locations. Moreover, the construction of our operator admits an efficient implementation which we detail and construct. As an experimental validation of our operator, we consider the task of compressing partial differential equation (PDE) simulation data from fixed meshes. Here, we show that QuadConv can match the performance of standard discrete convolutions on uniform grid data by comparing a QuadConv autoencoder (QCAE) to a standard convolutional autoencoder (CAE). Further, we show that the QCAE can maintain this accuracy even on non-uniform data. In both cases, QuadConv also outperforms alternative unstructured convolution methods such as graph convolution.

Compression↗