Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Massively parallel and universal approximation of nonlinear functions using diffractive processors

Nonlinear computation is essential for a wide range of information processing tasks, yet implementing nonlinear functions using optical systems remains a challenge due to the weak and power-intensive nature of optical nonlinearities. Overcoming this limitation without relying on nonlinear optical materials could unlock unprecedented opportunities for ultrafast and parallel optical computing systems. Here, we demonstrate that large-scale nonlinear computation can be performed using linear optics through optimized diffractive processors composed of passive phase-only surfaces. In this framework, the input variables of nonlinear functions are encoded into the phase of an optical wavefront—e.g., via a spatial light modulator (SLM)—and transformed by an optimized diffractive structure with spatially varying point-spread functions to yield output intensities that approximate a large set of unique nonlinear functions–all in parallel. We provide proof establishing that this architecture serves as a universal function approximator for an arbitrary set of bandlimited nonlinear functions, also covering wavelength-multiplexed nonlinear functions as well as multi-variate and complex-valued functions that are all-optically cascadable. Our analysis also indicates the successful approximation of typical nonlinear activation functions commonly used in neural networks, including the sigmoid, tanh, ReLU (rectified linear unit), and softplus. We numerically demonstrate the parallel computation of one million distinct nonlinear functions, accurately executed at wavelength-scale spatial density at the output of a diffractive optical processor. Furthermore, we experimentally validated this framework using in situ optical learning and approximated 35 unique nonlinear functions in a single shot using a compact setup consisting of an SLM and an image sensor. These results establish diffractive optical processors as a scalable platform for massively parallel universal nonlinear function approximation, paving the way for new capabilities in analog optical computing based on linear materials.

Rahman, Md Sadman Sakib [University of California,↗

SBND Analysis using ML Reconstruction Chain

As part of the Short Baseline Neutrino (SBN) Program at Fermilab, the Short Baseline Near Detector (SBND) is positioned in the Booster Neutrino Beam (BNB) and explores neutrino-argon interactions with unprecedented statistics. SBND is a Liquid Argon Time Projection Chamber (LArTPC). Electrons produced through ionization drift toward three wire planes, providing signals that form 2D images of particle trajectories. I introduce the Scalable Particle Imaging using Neural Embeddings (SPINE) framework, which employs a Machine Learning (ML)-based 3D reconstruction using a series of neural networks. Here, we present SPINE’s reconstruction chain, analysis approaches, and results from our latest simulation samples.

43 PARTICLE ACCELERATORS↗

Exploring Professor Motivations and Implementations of a Real-World Problem-Solving Project

Engineering education literature offers a variety of theoretical and conceptual frameworks for project-based learning. This study explores the implementation of real-world problem-solving projects in engineering education. The research team analyzed the motivations and methods behind professors' adoption of such projects through exploratory qualitative interviews with seven professor participants who integrated a nation-wide student competition into their courses. We analyzed the resulting data using a constructivist grounded theory approach to identify key themes of professor practices. Findings reveal that the real-world aspect of the projects and alignment with values and research interests were primary motivators for implementation. While implementation methods varied significantly based on context (i.e., university setting, course type), we found that these projects could be effectively integrated into various classroom settings. The findings support the recommendation for non-academic institutions to develop and manage competitions that can be integrated into classrooms and which offer a point of engagement that is available to professors from a wide range of disciplines.

42 ENGINEERING↗

Utilizing CellBox to Describe Varied Dynamical Systems

CellBox is a hybrid modeling framework that integrates machine-learning approaches with explicit mathematical modeling to determine the behavior of dynamical systems, intended for determining the complex interactions of molecule and phenotype within a cellular environment using perturbation/response-based data. The original work utilized analysis of a melanoma cell line, SK-Mel-133, which we sought to expand to and evaluate effectiveness in describing other nonlinear systems both within and outside of biology. We evaluated with two models. One model is based upon the free-fall of an object under a velocity-dependent drag force; this produced inherent perturbation/response data. The other model is based upon a form of mass-action molecular kinetics; for this, we ran the simulation to steady state in each species for each perturbation and select the steady state as input for CellBox. We determined that CellBox, outside of its original use case, can still strongly predict even non-biological dynamical systems in the small-perturbation regime, with r = 0.99977 to 0.85123, p < 0.05 for freefall. However, CellBox cannot accurately predict behavior within large-perturbation regimes, p >> 0.05 for freefall. In addition, we performed a naïve comparison of CellBox network structure to known network structure in the mass-action model to assess accuracy.

97 MATHEMATICS AND COMPUTING↗

MADE3D: Enabling the Next-Generation High-Torque- Density Wind Generators by Additive Design and 3D Printing

Direct-drive wind turbine generators are increasing in popularity, thanks to recent project developments - especially offshore, where reliability and efficiency are major cost drivers. Yet, high capital costs are forcing many original equipment manufacturers to consider lightweight, high-torque density generators for next-generation multi-megawatt turbines that may be difficult to realize by traditional design or manufacturing methods. In this study, we present a new design framework enabled by advanced machine learning and multimaterial additive manufacturing to perform a magnetic topology optimization that maximizes the torque per rotor active mass for a 15-megawatt direct-drive permanent magnet wind generator. A comparison of the proposed approach against conventional topology optimization demonstrated a significant increase in computational efficiency and accuracy in performance predictions. Results using single and multimaterial compositions for rotor core and magnets identify a wider choice of 3D printable designs for a given specification. A hybrid combination of sintered and dysprosium-free polymer-bonded magnets shows good potential for torque performance by saving material costs up to 8.75%. More than 30% improvement in rotor torque densities is identified which can marginally improve the overall generator torque density. With the rapid evolution of multipowder deposition technologies, this study can greatly inspire a new paradigm for design-driven manufacturing with novel material compositions and lightweight, low-cost, high-strength multimaterial geometries that were previously unexplored for direct-drive generators.

3D printing↗

Interactive automated Bragg peak identification with 3D neutron scattering data

Neutron scattering experiments have undergone significant technological development through large area detectors with concurrent enhancements in neutron transport and electronic functionality. Data collected for neutron events include detector pixel location in 3D, time and associated metadata, such as, sample orientation, neutron wavelength, and environmental conditions. RadiaSoft and Oak Ridge National Laboratory personnel are considering single-crystal diffraction data from the TOPAZ instrument. We are leveraging a new method for rapid, interactive analysis of neutron data using NVIDIA’s IndeX 3D volumetric visualization framework. We have implemented machine learning techniques to automatically identify Bragg peaks and separate them from diffuse backgrounds and analyze the crystalline lattice parameters for further analysis. The implementation of automatic peak identification into IndeX allows scientists to visualize and analyze data in real-time. Our methods include a robust comparison with current analysis techniques which show improvement in a variety of aspects. These improvements will be incorporated into IndeX for visualization to allow scientists an interactive tool for crystal analysis.

Kilpatrick, Matthew↗

Autonomous Navigation and Control of UGVs' in Nuclear Power Plants - 20381

The purpose of the husky A200 ground robot is to autonomously navigate through the places where it is very hazardous for human beings to reach and operate, like nuclear power plants, chemical industries. The aim is to navigate the ground robot autonomously with an Arm mounted on the robot along with the different sensors as camera, and Lidar. The autonomous motion of the robot is controlled by the controller which uses path planner for trajectory generation of the robot. The mission planner uses the current position of the husky A200, given the way points of the initial and the destination it would extract a best possible route based on the current events provided using GMapping. The global reference frame is used for planning the way points. Creating the appropriate path and the actions required to follow the path are given by the motion planner. The motion planner depends on the active sensor data such as obstacles, lanes, based on the sensor data feasible path is generated. Feasibility of the path is determined by the dynamics of the husky and a series of points generated with certain velocity and acceleration profile. The controller adjusts the lateral, longitudinal and yaw motion of the husky to command the behaviors. The kinematic model is developed for kinematic motion of the husky and the dynamic model is developed for transient and steady state characteristics. The images and other type of data captured by the camera are processed through the computational framework used to build machine learning models. TensorFlow will be used for deep learning and to identify and classify different objects around the husky. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Exploring Professor Motivations and Implementations of a Real-World Problem-Solving Project: A Case Study in Preparing Students for the Emerging Building Science Industry: Preprint

Engineering education literature offers a variety of theoretical and conceptual frameworks for project-based learning. This study explores the implementation of real-world problem-solving projects in engineering education. The research team analyzed the motivations and methods behind professors' adoption of such projects through exploratory qualitative interviews with seven professor participants who integrated a nation-wide student competition into their courses. We analyzed the resulting data using a constructivist grounded theory approach to identify key themes of professor practices. Findings reveal that the real-world aspect of the projects and alignment with values and research interests were primary motivators for implementation. While implementation methods varied significantly based on context (i.e., university setting, course type), we found that these projects could be effectively integrated into various classroom settings. The findings support the recommendation for non-academic institutions to develop and manage competitions that can be integrated into classrooms and which offer a point of engagement that is available to professors from a wide range of disciplines.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

OPFLearn.jl v0.1.2 5/18/2023 [SWR-21-109]

OPFLearn.jl is a Julia package for creating datasets for machine learning approaches to solving AC optimal power flow (AC OPF). It was developed to provide researchers with a standardized way to efficiently create AC OPF datasets that are representative of more of the AC OPF feasible load space compared to typical dataset creation methods. The OPFLearn dataset creation method uses a relaxed AC OPF formulation to reduce the volume of the unclassified input space throughout the dataset creation process. Over time this input space tightens around the relaxed AC OPF feasible region to increase the percentage of feasible load profiles found while uniformly sampling the input space. Load samples are processed using AC OPF formulations from PowerModels.jl. More information on the dataset creation method can be found in our publication, "OPF-Learn: An Open-Source Framework for Creating Representative AC Optimal Power Flow Datasets". To use OPFLearn.jl a PowerModels network data dictionary is required (can be loaded from Matpower ".m" files) to define the network the dataset is being created for.

Joswig-Jones, Trager↗

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗

Materials representation and transfer learning for multi-property prediction

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements as well as the relationships among multiple properties to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates: (i) prediction using only a material's composition, (ii) learning and exploitation of correlations among target properties in multi-target regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 three-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data are available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with transfer learning [H-CLMP(T)] wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well suited for multi-target regression across the physical sciences.

36 MATERIALS SCIENCE↗

Geometry-complete diffusion for 3D molecule generation and optimization

Abstract Generative deep learning methods have recently been proposed for generating 3D molecules using equivariant graph neural networks (GNNs) within a denoising diffusion framework. However, such methods are unable to learn important geometric properties of 3D molecules, as they adopt molecule-agnostic and non-geometric GNNs as their 3D graph denoising networks, which notably hinders their ability to generate valid large 3D molecules. In this work, we address these gaps by introducing the Geometry-Complete Diffusion Model (GCDM) for 3D molecule generation, which outperforms existing 3D molecular diffusion models by significant margins across conditional and unconditional settings for the QM9 dataset and the larger GEOM-Drugs dataset, respectively. Importantly, we demonstrate that GCDM’s generative denoising process enables the model to generate a significant proportion of valid and energetically-stable large molecules at the scale of GEOM-Drugs, whereas previous methods fail to do so with the features they learn. Additionally, we show that extensions of GCDM can not only effectively design 3D molecules for specific protein pockets but can be repurposed to consistently optimize the geometry and chemical composition of existing 3D molecules for molecular stability and property specificity, demonstrating new versatility of molecular diffusion models. Code and data are freely available on GitHub .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A database of ultrastable MOFs reassembled from stable fragments with machine learning models

High-throughput screening of hypothetical metal-organic framework (MOF) databases can uncover new materials, but their stability in real-world applications is often unknown. We leverage community knowledge and machine learning (ML) models to identify MOFs that are thermally stable and stable upon activation. We separate these MOFs into their building blocks and recombine them to make a new hypothetical MOF database of over 50,000 structures with orders of magnitude more (1) connectivity nets and (2) inorganic building blocks than were present in prior databases. Further, this database shows a 10-fold enrichment of ultrastable MOF structures that are stable upon activation and more than 1 standard deviation more thermally stable than the average experimentally characterized MOF. For nearly 10,000 ultrastable MOFs, we compute elastic moduli to confirm that these materials have good mechanical stability, and we report methane deliverable capacities. We identify privileged metal nodes in ultrastable MOFs that optimize gas storage and mechanical stability simultaneously.

36 MATERIALS SCIENCE↗

Quantitative Analysis and Prediction of Thermal Runaway Metrics of High-Nickel Oxide Cathodes by Machine Learning Models

The pursuit of higher energy density in lithium-ion batteries has made high-nickel (Ni) layered oxides leading cathode candidates for next-generation electric vehicles. However, their poor thermal stability, particularly at Ni contents ≥ 90%, increases the risk of cathode-initiated thermal runaway. Furthermore, we present a data-driven framework combining linear and nonlinear machine learning models to predict key thermal runaway descriptors from a high-throughput differential scanning calorimetry database. With cathode composition and state of charge (SOC) as input features, the ensemble model accurately predicts peak temperature, heat release, and peak heat flow. SHAP analysis identifies Ni content and SOC as the dominant factors controlling thermal runaway temperature, while SOC primarily governs heat release and peak heat flow. Al, Mg, and Mn improve thermal stability by strengthening metal–oxygen bonding and delaying structural transformation, whereas B mainly reduces heat release through surface passivation. Validation with a new cathode composition confirms accurate prediction of SOC-dependent thermal runaway behavior and critical SOC.

25 ENERGY STORAGE↗

Physics-informed machine learning exploration of Na storage mechanisms in disordered carbon

Sodium-ion batteries are a cost-effective, sustainable alternative to lithium-ion systems for large-scale energy storage. However, optimizing sodium storage in carbon-based anodes with microstructural complexity and atomic disorder remains a major challenge. The intrinsic inhomogeneity of these materials produces diverse local environments, making it difficult for conventional methods to predict and control ion dynamics. Hard carbon (HC) anodes, composed of ranges of ordered-to-disordered graphitic and amorphous nanodomains, offer tunable ion storage and rate capacity, yet rationale design remains a challenge due to poorly understood correlation between local atomic feature and ion transport mechanism. Here, to address this challenge, we introduce a data-driven framework that integrates validated machine-learned interatomic potentials, large-scale molecular dynamics simulations, and machine learning to elucidate sodium transport mechanisms as a function of carbon and sodium loading densities. By computing per-ion structural descriptors and applying unsupervised learning, we identify distinct diffusion modes governed by microscopic features. Supervised analysis and correlation mapping then establish quantitative links between these transport regimes and processing variables such as bulk carbon density and sodium content. This physics-informed approach establishes quantitative structure–transport relationships and offers actionable design principles for engineering high-performance HC anodes.

Data-driven framework↗