SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Automatic log analysis with NLP for the CMS workflow handling

The central Monte-Carlo production of the CMS experiment utilizes the WLCG infrastructure and manages daily thousands of tasks, each up to thousands of jobs. The distributed computing system is bound to sustain a certain rate of failures of various types, which are currently handled by computing operators a posteriori. Within the context of computing operations, and operation intelligence, we propose a Machine Learning technique to learn from the operators with a view to reduce the operational workload and delays. This work is in continuation of CMS work on operation intelligence to try and reach accurate predictions with Machine Learning. We present an approach to consider the log files of the workflows as regular text to leverage modern techniques from Natural Language Processing (NLP). In general, log files contain a substantial amount of text that is not human language. Therefore, different log parsing approaches are studied in order to map the log files’ words to high dimensional vectors. These vectors are then exploited as feature space to train a model that predicts the action that the operator has to take. This approach has the advantage that the information of the log files is extracted automatically and the format of the logs can be arbitrary. In this work the performance of the log file analysis with NLP is presented and compared to previous approaches.

Layer, Lukas↗

DOE OSTI2025

Learning nuclear cross sections across the chart of nuclides with graph neural networks

We explore the use of deep learning techniques to learn how nuclear cross sections change as we add or remove protons and neutrons. As a proof of principle, we focus on the neutron-induced reactions in the fast energy regime. Our approach follows a two-stage learning framework. First, we apply representation learning to encode cross section data into a latent space using either variational autoencoders (VAEs) or implicit neural representations (INRs). Then, we train graph neural networks (GNNs) on the resulting embeddings to predict missing values across the nuclear chart by leveraging the topological structure of neighboring isotopes. We demonstrate accurate cross section predictions within a 9 × 9 block of missing nuclei. We also find that the optimal GNN training strategy depends on the type of latent representation used, with VAE embeddings performing best under end-to-end optimization in the original space, while INR embeddings achieve better results when the GNN is trained only in the latent space. Furthermore, using clustering algorithms, we map groups of latent vectors into regions of the nuclear chart and show that VAEs and INRs can discover some of the neutron magic numbers. These findings suggest that deep-learning models based on the representation encoding of cross sections combined with graph neural networks hold significant potential in augmenting nuclear theory models, e.g., by providing reliable estimates of covariances of cross sections, including cross-material covariances.

Machine learning↗

DOE OSTI2024

Detecting Anomalies for Fire Prevention in Distribution Systems: Challenges and Analytical Techniques

Electric utilities in California have historically been linked to up to 10% of wildfires. To mitigate this risk, Southern California Edison has invested significantly in wildfire prevention strategies, including undergrounding cables and enhancing equipment inspections. This article explores a novel approach to fire prevention by detecting anomalies in the distribution system that may indicate potential fire hazards. The focus is on identifying arcing conditions through high-resolution point-on-wave (POW) measurements. Arcing, a precursor to fires, is challenging to detect due to its subtle transients and complex system topology. The article discusses the use of advanced signal processing and machine learning techniques, such as spectral correlation function and discrete wavelet transform, to extract features from POW data and accurately identify arcing events. The study demonstrates a high accuracy rate in detecting arcing, paving the way for improved fire prevention measures in electric distribution systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Accelerating Large-Format Metal Additive Manufacturing: How Controls R&D is Driving Speed, Scale, and Efficiency

This article highlights work at Oak Ridge National Laboratory’s Manufacturing Demonstration Facility to develop closed-loop, feedback control for laser-wire based Directed Energy Deposition, a form of metal Big Area Additive Manufacturing (m-BAAM), a process being developed in partnership with GKN Aerospace specifically for the production of Ti-6Al-4V pre-forms for aerospace components. A large-scale structural demonstrator component is presented as a case-study in which not just control, but the entire 3D printing workflow for m-BAAM is discussed in detail, including design principles for large-format metal AM, toolpath generation, parameter development, process control, and system operation, as well as post-print net-shape geometric analysis and finish machining. In terms of control, a multi-sensor approach has been utilized to measure both layer height and melt pool size, and multiple modes of closed-loop control have been developed to manipulate process parameters (laser power, print speed, deposition rate) to control these variables. Layer height control and melt pool size control have yielded excellent local (intralayer) and global (component-level) geometry control, and the impact of melt pool size control in particular on thermal gradients and material properties is the subject of continuing research. Further, these modes of control have allowed the process to advance to higher deposition rates (exceeding 7.5 lb/hr), larger parts (1-meter scale), shorter build times, and higher overall efficiency. The control modes are examined individually, highlighting their development, demonstration, and lessons learned, and it is shown how they operate concurrently to enable the printing of a large-scale, near net shape Ti-6Al-4V component.

Gibson, Brian↗

DOE OSTI2022

A Multi-Objective Approach for Optimizing Edge-Based Resource Allocation Using TOPSIS

Existing approaches for allocating resources on edge environments are inefficient and lack the support of heterogeneous edge devices, which in turn fail to optimize the dependency on cloud infrastructures or datacenters. To this extent, we propose in this paper OpERA, a multi-layered edge-based resource allocation optimization framework that supports heterogeneous and seamless execution of offloadable tasks across edge, fog, and cloud computing layers and architectures. By capturing offloadable task requirements, OpERA is capable of identifying suitable resources within nearby edge or fog layers, thus optimizing the execution process. Throughout the paper, we present results which show the effectiveness of our proposed optimization strategy in terms of reducing costs, minimizing energy consumption, and promoting other residual gains in terms of processing computations, network bandwidth, and task execution time. We also demonstrate that by optimizing resource allocation in computation offloading, it is then possible to increase the likelihood of successful task offloading, particularly for computationally intensive tasks that are becoming integral as part of many IoT applications such robotic surgery, autonomous driving, smart city monitoring device grids, and deep learning tasks. The evaluation of our OpERA optimization algorithm reveals that the TOPSIS MCDM technique effectively identifies optimal compute resources for processing offloadable tasks, with a 96% success rate. Moreover, the results from our experiments with a diverse range of use cases show that our OpERA optimization strategy can effectively reduce energy consumption by up to 88%, and operational costs by 76%, by identifying relevant compute resources.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1993

Low-gravity electrodeposition and growth of polymer thin films with large third-order optical nonlinearities by electrochemical processes for devices: Thiophene-based polymers

It has been proposed that NLO thin film properties may be improved by low-gravity processing. Strong candidates for NLO thin film applications are the polythiophenes. Polymeric thiophenes are attractive materials due to their ease of preparation, stability, and high X(exp 3). A simple and convenient method for preparation of polythiophenes is electrochemical oxidation. We will apply some of our experience and lessons learned in low-gravity metal, metal/cermet electrode position to improve the quality of polythiophene(s) thin films. In low gravity electrode position of Ni at a high rate on an Au substrate often results in the production of an x-ray non diffracting surface. Cobalt metal deposition does not give this result nor does Ni when deposited similarly on a glassy carbon substrate. Co/Ni alloy composition produced during electrode position is strongly dependent upon the amount of convection. Code position of neutral inert cermets with metals is influenced significantly by the presence of gravity and the size of the cermets. Tracks left in the 1-g surfaces by unsuccessful particle occlusion indicate suspension of the large particles is not the only reason for poor volume percentages of the larger particles in the deposits. All size particles are more homogeneously distributed in the deposits in low-gravity electrocodeposition than in 1-g. Low gravity gives larger volume percentages for the larger particles in the deposits, while 1-g gives larger volume percentages for the smaller particles. Intermediate size particles give mixed results. The experimental cells were constructed with flat electrode end plates such that 1-g bench reference electrode positions could be carried out at various orientations with respect to gravity. A series of bench studies using similar designed cells are suggested so that convection modification can be applied to electrochemical thin film preparation. Convection effects can then be coupled with other parameter variations in current, temperature, concentration, solvent, electrolyte, and anode substrates to optimize the properties of NLO thin films before resorting to low-gravity processing.

Penn, Benjamin G.↗

NASA NTRS2012

Plant Science in Reduced Gravity: Lessons Learned

The effect of gravity on the growth and development of plants has been the subject of scientific investigation for over a century. The results obtained in space to test specific hypotheses on gravitropism, gene expression, seed formation, or growth rate are affected by both the primary effect of the microgravity and secondary effects of the spaceflight environment. The secondary effects of the spaceflight environment include physical effects arising from physical changes, such as the absence of buoyancy driven convective mixing, altered behavior of liquids and gases, and the environmental conditions in the spacecraft atmosphere. Thus, the design of biological experiments (e.g. cells, plants, animals, etc.) conducted in microgravity must account for changes in the physical forces, as well as the environmental conditions, imposed by the specific spaceflight vehicle and experimental hardware. In addition, researchers must become familiar with other aspects of spaceflight experiments: payload integration with hardware developers, safety documentation and crew procedures, and the logistics of conducting flight and ground controls. This report reviews the physical and environmental factors that directly and indirectly affect the results of plant science experiments in microgravity and is intended to serve as a guide in the design and implementation plant experiments in space.

Stutte, Gary W.↗

NASA NTRS2019

Demisability of GFRP and CFRP Components of Reentering Orbital Debris: Phase I Test Results

Observations of surviving reentry debris on the ground and research performed by Hyperschall Technologie Göttingen (HTG) [1] indicated that significantly more glass fiber-reinforced polymer (GFRP) and carbon fiber-reinforced polymer (CFRP) components survive reentry than current models predict. NASA’s Orbital Debris Program Office conducted a series of tests to evaluate the accuracy of material demise models for reentering orbital debris used in NASA’s Object Reentry Survival Analysis Tool (ORSAT) and Debris Assessment Software (DAS). Testing is planned in a multi-phase series to allow for quick quantification of results as well as refinement of methods resulting from lessons learned during early phases. The Phase 1 tests discussed here validated ORSAT models for homogeneous metals, provided an efficient quantification of composite material demisability properties like mass loss rate and overall time to demise, and identified potential failure modes, which are currently not well understood. Phase 2 tests will be used to further understand mass loss rates and modes of both thermal and mechanical failure in composite materials. The authors exposed 95 samples of aluminum, CFRP, Kevlar fiber-reinforced polymer, GFRP, and sheets of G10 fiberglass to conditions approximating the reentry environment using an inductively coupled plasma (ICP) torch facility. The cylindrical CFRP samples were exposed to the atmospheric pressure plasma, at both the end and the midpoint, to investigate the difference in demisability between parts with exposed edges, like panels, and parts with no edges, such as carbonoverwrapped pressure vessels (COPVs). In a non-oxidative environment, no composite materials demised within the 5-minute test time. In the oxidative, elevated heat flux environment, CFRP samples demised between 210 s and 270 s. For the first 100 s of insertion time, most of the mass loss was due to pyrolysis of resin, creating an approximately bi-linear mass-loss rate curve with time. In a non-oxidative environment, carbon filaments were observed to unravel from some of the CFRP end-burned samples; however, this effect did not seem to affect the overall time to demise for the samples significantly. These results indicate that both GFRP and CFRP components survive reentry with significantly more remaining mass than current models predict.

Greene, Benton R.↗

NASA NTRSDate not supplied

NASA’s Rotating Detonation Rocket Engine Development

The Rotating Detonation Rocket Engine has maintained steady development at NASA with many staggering performance advantages demonstrated to date over the state-of-the-art (SOA). The implementation of additive manufacturing and specialized NASA developed alloys have enabled rapid maturation of the technology. Several hot fire test projects have been successfully conducted at Marshall Space Flight Center under an early career initiative project funded by NASA Space Technology Mission Directorate. In addition, a new start Technology Demonstration Mission (TDM) project has been funded to investigate challenges relating to integration of turbomachinery with an RDRE thrust chamber assembly. This engine system demonstration will leverage a methane/oxygen single shaft turbopump with fuel rich gas generator and a 10,000 lbf thrust chamber assembly. The configuration was down selected based on feedback from both US industry collaborators and power balance trades in combination with technical feasibility. To date, industry has identified several use cases for RDRE ranging from thruster to primary launch vehicle propulsion. A wide range of fuel and oxidizers were also identified including but not limited to Methane, Kerosene and other liquid hydrocarbon (LH) fuels, and hydrogen. Recent work at NASA and in partnership with NASA has investigated these major fuels of interest with oxygen, air, and hydrogen peroxide (HTP) for various applications. NASA Marshall has already investigated the use of hydrogen/oxygen, methane/oxygen, kerosene/oxygen, and has plans in partnership with industry and academia to investigate LH/air and LH/HTP. In addition to propellants, hardware geometry has been investigated with some critical lessons learned toward greater theoretical performance over the SOA. To this end, several experimental and computational activities are ongoing to further advance the RDRE towards flight missions. Given the rate of advancement, it is highly likely the technology will be flown in space mission in the coming decade. This work documents and overviews many of these investigations and overviews NASA’s future plans for the technology maturation.

Thomas Teasley↗

DOE OSTI2022

Frhodo: A program for simulating chemical kinetic measurements and optimizing kinetic mechanisms

Chemical kinetic simulations are frequently used to extract kinetic and mechanistic information from experimental data by fitting simulations to the data. For simple systems of consecutive single channel reactions this is a relatively straightforward task. However, as the complexity of the system increases and particularly for systems involving competitive multi-channel reactions manually optimizing a mechanism to obtain the best fits to a range of experimental data quickly becomes a time-intensive and challenging process, especially when rate coefficients have pressure and temperature dependencies. There is considerable potential for exploiting automated optimization methods to rapidly screen reaction mechanisms and optimize the fit by adjusting rate coefficients within well-defined constraints. A new chemical kinetics simulation program, Frhodo, has been developed for this purpose. The program allows either manual simulation of individual experiments or fully automated optimization against a range of experimental data by adjusting user selected reactions within user defined constraints. Frhodo incorporates machine learning-based optimization routines that work by either minimizing standardized residuals or through Bayesian parameter estimation. Frhodo's optimization capabilities are demonstrated by reexamining two previously studied systems of relevance to combustion. Dissociation of diacetyl followed by recombination of methyl radicals is an example of a sequence of single channel, consecutive reactions. Pyrolysis of 2-methyl furan exemplifies multi-channel, unimolecular reactions that are often encountered and have temperature and pressure dependencies in the rate coefficients of the channels and branching ratios between them. For both systems the optimization routines resulted in solutions similar to the original studies. Finally, comments are made on the strengths and limitations of the approach.

0D simulation↗

DOE OSTI2021

On the feasibility of using physics-informed machine learning for underground reservoir pressure management

In this work, we evaluate the feasibility of using physics-informed machine learning (PIML) for underground energy-related pressure management. To this end, we develop a PIML framework to manage underground reservoir pressures by training neural networks to determine fluid extraction rates for dedicated extraction wells during fluid injection operations given a range of reservoir conditions (e.g., transmissivity and storativity). We implement an automatically-differentiable analytical physics model of fluid flow in porous media within the PIML framework as a proxy for more complicated models. This allows us to execute a sufficient number of training scenarios to fully evaluate the feasibility of using PIML to support pressure management activities. We quantify the number of physics-model parameters required for automatic differentiation to become more efficient than finite-difference gradient calculations. We use a simple scenario with a single injector, extractor, and critical location for our feasibility analysis. We evaluate the effect of the size of the training dataset (i.e., the number of reservoir condition samples) on the accuracy and efficiency of the PIML framework. For an equivalent number of model evaluations, the larger training dataset took less time to train and produced a neural network that was able to more accurately manage reservoir pressures. We also evaluate the effect of the training dataset batch size (i.e., number of reservoir condition samples used to update the neural network coefficients during training; i.e., how the training dataset is partitioned). While training ran faster with larger batch sizes, they produced neural networks that managed pressures less accurately. We demonstrate the approach on a more complex scenario involving 10 injectors, 10 extractors, and 4 critical locations (a relatively high well density of 20 wells/km2). We provide the number of forward and adjoint model evaluations required in each case as an indication of the feasibility of using PIML for pressure management when more complicated physics models with longer execution times are used.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Analysis of Waste Material Feedstocks Using Laser-Induced Breakdown Spectroscopy and Machine Learning

Predicting properties such as heating value, ash fusion temperature, and mineral ash composition from Laser-Induced Breakdown Spectroscopy (LIBS) data can make gasifiers more flexible to different feedstocks. Understanding these feedstock properties in-situ improves feedstock conversion modelling methods that allow for consistent operation, higher carbon conversion, and reduced fouling and erosion rates. The purpose of this study is to demonstrate methods for model creation that take LIBS data as predictor features and estimate higher order material properties as a function of feedstock material properties. Six samples were chosen to represent a mixture of abundant and carbon rich waste materials. LIBS measurements were performed on these samples for elemental wavelengths and intensity values. Laboratory analytical results were obtained for each sample’s heating value, proximate and ultimate analysis, mineral ash composition, ash fusion temperatures, and viscosity temperatures. Thermal conductivity was measured using a HotDisk TPS 2500S. LIBS measurements were processed and used as predictor features for machine learning (ML) models to predict the sample’s material properties. Predictor feature selection algorithms, particularly minimum redundancy maximum relevance (mRMR), reduced the dimensionality of ML models. Many modelling methods such as Gaussian process regression (GPR), regression tree, neural networks (NN), and support vector machines (SVM) were demonstrated to be effective at predicting higher order properties; however, mRMR with GPR stood out as a clear winning combination.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2024

Accelerating FEM-Based Corrosion Predictions Using Machine Learning

Atmospheric corrosion of metallic parts is a widespread materials degradation phenomena that is challenging to predict given its dependence on many factors (e.g. environmental, physiochemical, and part geometry). For materials with long expected service lives, accurately predicting the degree to which corrosion will degrade part performance is especially difficult due to the stochastic nature of corrosion damage spread across years or decades of service. The Finite Element Method (FEM) is a computational technique capable of providing accurate estimates of corrosion rate by numerically solving complex differential Eqs. characterizing this phenomena. Nevertheless, given the iterative nature of FEM and the computational expense required to solve these complex equations, FEM is ill-equipped for an efficient exploration of the design space to identify factors that accelerate or deter corrosion, despite its accuracy. In this work, a machine learning based surrogate model capable of providing accurate predictions of corrosion with significant computational savings is introduced. Specifically, this work leverages AdaBoosted Decision trees to provide an accurate estimate of corrosion current per width given different values of temperature, water layer thickness, molarity of the solution, and the length of the cathode for a galvanic couple of aluminum and stainless steel.

36 MATERIALS SCIENCE↗

DOE OSTI2025

LandScan mosaic enables high-resolution gridded population estimates with explicit uncertainty

Gridded population datasets represent high-resolution distributions of human occupancy, enabling informed decision-making across a broad range of fields. These data products are valuable for assessing environmental risk, urban development, disaster preparedness and resource allocation—areas where accurate population estimates directly enhance policy effectiveness and optimize resource distribution. Despite the importance of gridded population datasets, traditional population modeling approaches often overlook inherent uncertainties in the estimation process. This limitation can create a false sense of certainty in population estimates, potentially leading to flawed decisions by those who rely on the data. To address this methodological gap, we introduce a probabilistic machine learning modeling framework, LandScan Mosaic, that explicitly incorporates uncertainty into the population modeling process. Our approach systematically quantifies uncertainty in three key modeling parameters of the LandScan HD gridded population dataset: building use types, floor counts, and occupancy rates. By employing Monte Carlo simulations, we propagate these uncertainties through the modeling process, yielding probability distributions of population counts in place of deterministic point estimates. We demonstrate the practical application of this framework in Iloilo City, Philippines, using structured decision-making techniques and our probabilistic estimates to identify and prioritize areas most affected by projected flooding, supporting targeted interventions that address both economic and social risks. In doing so, we propose a population-specific approach for incorporating confidence into structured decision making processes. Through a comparative analysis with conventional deterministic approaches and point estimate approaches, including LandScan HD and WorldPop, we evaluate how the incorporation of machine learning and uncertainty influences decision rankings. This research advances population distribution modeling by offering a robust, quantitative approach that explicitly accounts for uncertainty in the underlying data, along with guidance for how users can apply uncertainty in their decision-making.

Environmental sciences↗

DOE OSTI2021

Predicting measures of soil health using the microbiome and supervised machine learning

Soil health encompasses a range of biological, chemical, and physical soil properties that sustain the commercial and ecological value of agroecosystems. Monitoring soil health requires a comprehensive set of diagnostics that can be cost-prohibitive for routine analyses. The soil microbiome provides a rich source of information about soil properties, which can be assayed in a high-throughput, cost-effective way. We evaluated the accuracy of random forest (RF) and support vector machine (SVM) regression and classification models in predicting 12 measures of soil health, tillage status, and soil texture from 16S rRNA gene amplicon data with an operationally relevant sample set. We validated the efficacy of the best performing models against independent datasets and also tested best practices for processing microbiome data for use in machine learning. Soil health metrics could be predicted from microbiome data with the best models achieving a Kappa value of ~0.65, for categorical assessments, and a R2 value of ~0.8, for numerical scores. Biological health ratings were better predicted than chemical or physical ratings. Validation with independent datasets revealed that models had general predictive value for soil properties, including yield. The ecological profiles of several taxa important for model accuracy matched the observed relationships with soil health, including Pyrinomonadaceae, Nitrososphaeraceae, and Candidatus Udeaobacter. Models trained at the highest taxonomic resolution proved most accurate, with losses in accuracy resulting from rarefying, sparsity filtering, and aggregating at higher taxonomic ranks. Furthermore, our study provides the groundwork for developing scalable technology to use microbiome-based diagnostics for the assessment of soil health.

16S rRNA gene↗

DOE OSTI2026

Deep nonparametric estimation of operators between infinite dimensional spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Deep Deception: Exemplars of Adversarial Machine Learning and Countermeasures Applicable to International Safeguards

As a follow-up to our more comprehensive report on Adversarial Machine Learning (AML), here we provide demonstrations of AML attacks against the Limbo image database of UF6 cylinders in a variety of orientations and amongst a variety of distractor images. We demonstrate the Carlini & Wagner AML attack against a subset of Limbo images, with 100% attack success rate; meaning all attacked images were misclassified by a highly accurate trained model, yet the image changes were imperceptible to the human eye. We also demonstrate successful attacks against segmented images (images with more than one targeted object). Finally, we demonstrated the Fast Fourier Transform countermeasure that can be used to detect AML attacks on images. The intent of this and our previous report is to inform the IAEA and stakeholders of both the promise of machine learning, which could greatly improve the efficiency of surveillance monitoring, but also of the real threat of AML and potential defenses.

97 MATHEMATICS AND COMPUTING↗