Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Debris Disks in Aggregate: Using Hubble Space Telescope Coronagraphic Imagery to Understand the Scattered-Light Disk Detection Rate

Despite more than a decade of coronagraphic imaging of debris disk candidate stars, only 16 have been imaged in scattered light. Since imaged disks provide our best insight into processes which sculpt disks, and can provide signposts of the presence of giant planets at distances which would elude radial velocity and transit surveys, we need to understand under what conditions we detect the disks in scattered light, how these disks differ from the majority of debris disks, and how to increase the yield of disks which are imaged with 0.1" angular resolution. In this talk, I will review what we have learned from a shallow HSTINICMOS NIR survey of debris disks, and present first results from our on-going HST /STIS optical imaging of bright scattered-light disks.

Grady, Carol A.↗
DOE OSTI2026

Tandem bulk oxygen diffusion and surface reactions in reducible metal oxides control redox cycle dynamics

The interplay between bulk oxygen diffusion and surface reactions in reducible metal oxides is key in heterogeneous catalysts, but direct measurements of oxygen mobility, transient kinetics, and in situ spectroscopies have been lacking. Here, we reveal complex dynamic behavior of ceria-zirconia by H 2 using transient kinetics via mass spectrometry and in situ Raman and near-ambient pressure x-ray photoelectron spectroscopies. Molecular dynamics simulations with a machine learning potential delineate competitive oxygen diffusion mechanisms, with an optimal mobility at intermediate reductions. We expose a compensation between vacancy availability and lattice distortion at intermediate to high reductions and Frenkel defects at low reductions, underscoring a potential deficiency of 16 O/ 18 O exchange experiments in deducing oxygen mobility. Vacancies in proximity require electron localization on Ce atoms further away. The continuous replenishment of surface oxygen results in a varying reduction rate, with H 2 dissociation being the rate-limiting step. Multiscale transient simulations, consistent with experiments, indicate catalysts of potentially spatially varying oxidation states. The approach is broadly applicable to reducible oxide materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Widespread underestimation of rain-induced soil carbon emissions from global drylands

Dryland carbon fluxes, particularly those driven by ecosystem respiration, are highly sensitive to water availability and rain pulses. However, the magnitude of rain-induced carbon emissions remains unclear globally. Here we quantify the impact of rain-pulse events on the carbon balance of global drylands and characterize their spatiotemporal controls. Using eddy-covariance observations of carbon, water and energy fluxes from 34 dryland sites worldwide, we produce an inventory of over 1,800 manually identified rain-induced CO2 pulse events. Based on this inventory, a machine learning algorithm is developed to automatically detect rain-induced CO2 pulse events. Our findings show that existing partitioning methods underestimate ecosystem respiration and photosynthesis by up to 30% during rain-pulse events, which annually contribute 16.9 ± 2.8% of ecosystem respiration and 9.6 ± 2.2% of net ecosystem productivity. We show that the carbon loss intensity correlates most strongly with annual productivity, aridity and soil pH. Finally, we identify a universal decay rate of rain-induced CO2 pulses and use it to bias-correct respiration estimates. Our research highlights the importance of rain-induced carbon emissions for the carbon balance of global drylands and suggests that ecosystem models may largely underrepresent the influence of rain pulses on the carbon cycle of drylands.

Nguyen, Ngoc B↗
DOE OSTI2021

Strength in Rotary Friction Welding of Five Dissimilar Nickel-Based Superalloys

Advanced manufacturing processes improve the cost and quality of goods. Rotary friction welding is a fast, energy-efficient, and reliable joining process for metals, but new applications are hindered by large development costs for each new alloy. Each alloy set has different welding characteristics; therefore, lessons learned from a single alloy are not always broadly applicable. To establish knowledge that is applicable across multiple alloys, a family of different superalloys were welded to discover process trends that were applicable beyond a single alloy set. In this study, weld symmetry did not correlate to weld strength across alloy systems. Some alloys’ strongest welds occurred at maximum symmetry, whereas high asymmetry was associated with different alloys’ maximum strength. High feed rates, high welding forces, low energy, and low temperatures all resulted in high-strength welds across all alloy and geometry combinations. Tensile strengths greater than 95% of base-metal strength were recorded for most alloy systems.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Simple Statistical Models for Predicting Overpressure Due to CO2 and Low-Salinity Waste-Fluid Injection into Deep Saline Formations

Deep saline aquifers have been used for waste-fluid disposal for decades and are the proposed targets for large-scale CO2 storage to mitigate CO2 concentration in the atmosphere. Due to relatively limited experience with CO2 injection in deep saline formations and given that the injection targets for CO2 sometimes are the same as waste-fluid disposal formations, it could be beneficial to model and compare both practices and learn from the waste-fluid disposal industry. In this paper, we model CO2 injection in the Patterson Field, which has been proposed as a site for storage of 50 Mt of industrial CO2 over 25 years. We propose general models that quickly screen the reservoir properties and calculate pressure changes near and far from the injection wellbore, accounting for variable reservoir properties. The reservoir properties we investigated were rock compressibility, injection rate, vertical-to-horizontal permeability ratio, average reservoir permeability and porosity, reservoir temperature and pressure, and the injectant total dissolved solids (TDS) in cases of waste-fluid injection. We used experimental design to select and perform simulation runs, performed a sensitivity analysis to identify the important variables on pressure build-up, and then fit a regression model to the simulation runs to obtain simple proxy models for changes in average reservoir pressure and bottomhole pressure. The CO2 injection created more pressure compared to saline waste-fluids, when similar mass was injected. However, we found a more significant pressure buildup at the caprock-reservoir interface and lower pressure buildup at the bottom of the reservoir when injecting CO2 compared with waste-fluid injection.

Ansari, Esmail↗
NASA NTRS2002

The Microwave Anisotropy Probe (MAP) Guidance, Navigation, and Control Hardware Suite

The on-orbit success of the Microwave Anisotropy Probe (MAP) Guidance, Navigation, and Control System can partially be attributed to the performance of a hardware suite chosen to meet the complex attitude determination and control requirements of the mission. To meet these requirements, a diverse set of components was used. The set included two Lockheed Martin AST-201 star trackers, two Kearfott Two-Axis Rate Assemblies mounted to provide X, Y and redundant Z-axis rates, two Adcole Digital Sun Sensor heads sharing one set of electronics, twelve Adcole Coarse Sun Sensor eyes, three Ithaco E-sized Reaction Wheel Assemblies, a Propulsion Subsystem that employed eight Primex Rocket Engine Modules, and a pair of Goddard-designed Attitude Control Electronics which connect all of the components to the spacecraft processor. The performance of this hardware is documented, as are some of the spacecraft accommodations and lessons learned that came from working with this particular set of hardware.

Ward, David K.↗
NASA NTRS2004

Team Formation in Partially Observable Multi-Agent Systems

Sets of multi-agent teams often need to maximize a global utility rating the performance of the entire system where a team cannot fully observe other teams agents. Such limited observability hinders team-members trying to pursue their team utilities to take actions that also help maximize the global utility. In this article, we show how team utilities can be used in partially observable systems. Furthermore, we show how team sizes can be manipulated to provide the best compromise between having easy to learn team utilities and having them aligned with the global utility, The results show that optimally sized teams in a partially observable environments outperform one team in a fully observable environment, by up to 30%.

Agogino, Adrian K.↗
DOE OSTI2020

Probing for Artifacts: Detecting Imagenet Model Evasions

While deep learning models have made incredible progress across a variety of machine learning tasks, they remain vulnerable to adversarial examples crafted to fool otherwise trustworthy models. In this work we approach this problem through the lens of a detection framework. We propose a classification network that uses the hidden layer activations of a trained model as inputs to detect adversarial artifacts in an input. We train this classification network simultaneously against multiple adversarial algorithms to create a more robust detector and show higher detection rates than several alternatives. The novelty of our approach is in the scale and scope of probing Imagenet models for adversarial artifacts. In addition, we propose an improvement to feature squeezing, another common adversarial example detection method.

Rounds, Jeremiah↗
DOE OSTI2024

7 Innovations in high-rate composite manufacturing: integrating additive manufacturing with compression molding process

Advanced composites play a pivotal role in modern engineering, offering exceptional strength-to-weight ratios and tailored properties, essential for various industries. High-rate composite manufacturing techniques have rapid production capabilities, which are essential for meeting the demands of industries requiring cost-saving, efficiency, and quick turnaround times. This chapter explores the Additive Manufacturing- Compression Molding (AM-CM) system developed by Oak Ridge National Laboratory (ORNL) for advanced composites manufacturing. The AM-CM system integrates additive manufacturing with compression molding, facilitating the production of polymer composite parts with superior mechanical properties and meticulously controlled microstructures. This innovative system not only ensures precise material deposition but also operates as a fast composite manufacturing process, enhancing productivity and performance, which are needed attributes across industrial applications. Through comprehensive mechanical testing and microstructural analysis, AM-CM promotes remarkable fiber alignment and reduced porosity in composite parts compared to alternative thermoplastic high-rate composite manufacturing methods. Furthermore, AM-CM enables overmolding reinforcement using continuous carbon fiber and supports selective reinforcement through customizable toolpaths. It also facilitates the production of hybrid materials to achieve tailored mechanical properties. Future advancements in AM-CM technology aim to enhance process efficiency, broaden material versatility, and improve part performance. This involves exploring novel materials, advancing process monitoring, implementing automation technologies, and integrating artificial intelligence (AI) and machine learning (ML) for predictive modeling and real-time optimization in composite manufacturing. These developments will establish the AM-CM system as a transformative technology in composite manufacturing, driving innovation across industries.

Hassen, Ahmed [ORNL] (ORCID:0000000328521222)↗
DOE OSTI2022

Machine-learning from Pseudomonas putida KT2440 transcriptomes reveals its transcriptional regulatory network

Bacterial gene expression is orchestrated by numerous transcription factors (TFs). Elucidating how gene expression is regulated is fundamental to understanding bacterial physiology and engineering it for practical use. In this study, a machine-learning approach was applied to uncover the genome-scale transcriptional regulatory network (TRN) in Pseudomonas putida KT2440, an important organism for bioproduction. We performed independent component analysis of a compendium of 321 high-quality gene expression profiles, which were previously published or newly generated in this study. We identified 84 groups of independently modulated genes (iModulons) that explain 75.7% of the total variance in the compendium. With these iModulons, we (i) expand our understanding of the regulatory functions of 39 iModulon associated TFs (e.g., HexR, Zur) by systematic comparison with 1993 previously reported TF-gene interactions; (ii) outline transcriptional changes after the transition from the exponential growth to stationary phases; (iii) capture group of genes required for utilizing diverse carbon sources and increased stationary response with slower growth rates; (iv) unveil multiple evolutionary strategies of transcriptome reallocation to achieve fast growth rates; and (v) define an osmotic stimulon, which includes the Type VI secretion system, as coordination of multiple iModulon activity changes. Taken together, this study provides the first quantitative genome-scale TRN for P. putida KT2440 and a basis for a comprehensive understanding of its complex transcriptome changes in a variety of physiological states.

09 BIOMASS FUELS↗
DOE OSTI2025

Morphotype-resolved characterization of microalgal communities in a nutrient recovery process with ARTiMiS flow imaging microscopy

Microalgae-driven nutrient recovery represents a promising technology for phosphorus removal from wastewater while simultaneously generating biomass that can be valorized to offset treatment costs. As full-scale processes come online, system parameters including biomass composition must be carefully monitored to optimize performance and prevent culture crashes. In this study, flow imaging microscopy (FIM) was leveraged to characterize microalgal community composition in near real-time at a full-scale municipal wastewater treatment plant (WWTP) in Wisconsin, USA, and population and morphotype dynamics were examined to identify relationships between water chemistry, biomass composition, and system performance. Two FIM technologies, FlowCam and ARTiMiS, were evaluated as monitoring tools. ARTiMiS provided a more accurate estimate of total system biomass, and estimates derived from particle area as a proxy for biovolume yielded better approximations than particle counts. Deep learning classification models trained on annotated image libraries demonstrated equivalent performance between FlowCam and ARTiMiS, and convolutional neural network (CNN) classifiers proved significantly more accurate when compared to feature table-based dense neural network (DNN) models. Across a two-year study period, Scenedesmus spp. appeared most important for phosphorus removal, and were negatively impacted by elevated temperatures and increase in nitrite/nitrate concentrations. Chlorella and Monoraphidium also played an important role in phosphorus removal. For both Scenedesmus and Chlorella, smaller morphological types were more often associated with better system performance, whereas larger morphotypes likely associated with stress response(s) correlated with poor phosphorus recovery rates. Furthermore, these results demonstrate the potential of FIM as a critical technology for high-resolution characterization of industrial microalgal processes.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRSDate not supplied

Cislunar Trajectory Design and Maneuver Autonomy for NASA's Moon to Mars Architecture

NASA’s Moon to Mars architecture is an ambitious roadmap of manned cislunar and deep space exploration. The extensive amount of orbital assets required will place a significant burden on ground-based resources, such as communication networks and operations facilities. Spacecraft autonomy is essential for maintaining a vast number of complex missions beyond Earth orbit. To achieve full autonomy, spacecraft must be able to employ methods of robust maneuver design without an explicit dependence on commands sent from the ground. This level of autonomy is needed not only for stationkeeping, but also for outbound transfers. To address the need of spacecraft maneuver design autonomy, this work investigates the use of neural networks (NNs) in a supervised learning environment. A supervised learning approach for NNs allows for a curated training data set, consisting exclusively of perturbations applied to a desired mission concept of operations (ConOps). The proposed approach allows humans on the ground to design a specific mission ConOps before flight, then employ NNs to fly the mission robustly and autonomously. This investigation numerically tests maneuver autonomy in four highly sensitive regions of flight: orbit raising, translunar injection burns, powered lunar flybys, and invariant manifold insertion burns. These straining cases are contextualized by testing them in a demonstration mission, targeting an Earth-Moon L3 orbit. The study first establishes feasibility by automating impulsive burn maneuvers. However, some guidance algorithms will need more intensive commands, such as inertial pointing and angular rates. To validate this method, NN maneuver autonomy is applied to a finite burn model of the demonstration mission. The use of sequential, mission specific maneuvers provide an appropriate testbed to demonstrate the robustness of a NN trained on feasible perturbed states. Moreover, these scenarios provide preliminary proof-of-concept for fully autonomous missions that execute maneuvers without dependence upon explicit command uplinks. As a result, the technological advancement proposed in this work may significantly ease the strain on ground-based mission operations. This would enable complex and autonomous mission execution in cislunar and deep space regimes, filling a technology gap required to support future manned missions.

NASA↗
DOE OSTI2020

Probing Slow Earthquakes With Deep Learning

Abstract Slow earthquakes may trigger failure on neighboring locked faults that are stressed sufficiently to break, and slow slip patterns may evolve before a nearby great earthquake. However, even in the clearest cases such as Cascadia, slow earthquakes and associated tremor have only been observed in intermittent and discrete bursts. By training a convolutional neural network to detect known tremor on a single seismic station in Cascadia, we isolate and identify tremor and slip preceding and following known larger slow events. The deep neural network can be used for the detection of quasi‐continuous tremor, providing a proxy that quantifies the slow slip rate. Furthermore, the model trained in Cascadia recognizes tremor in other subduction zones and also along the San Andreas Fault at Parkfield, suggesting a universality of waveform characteristics and source processes, as posited from experiments and theory.

58 GEOSCIENCES↗
DOE OSTI2023

Comparison of machine learning systems trained to detect Alfvén eigenmodes using the CO 2 interferometer on DIII-D

Abstract A Machine-Learning (ML) based detection scheme that automatically detects Alfvén Eigenmodes (AE) in a labelled DIII-D database is presented here. Controlling AEs is important for the success of planned burning plasma devices such as ITER, since resonant fast ions can drive AEs unstable and degrade the performance of the plasma or damage the first walls of the machine vessel. Artificial Intelligence could be useful for real-time detection and control of AEs in steady-state plasma scenarios by implementing ML-based models into control algorithms that drive actuators for mitigation of AE impacts. Thus, the objective is to compare differences in performance between using two different recurrent neural network systems (Reservoir Computing Network and Long Short Term Memory Network) and two different representations of the C O 2 phase data (simple and crosspower spectrograms). All C O 2 interferometer chords are used to train both models, but only one is processed during each training step. The results from the model and data comparison show higher performance for the RCN model (True Positive Rate = 90% and False Positive Rate = 14%), and that using simple magnitude spectrograms is sufficient to detect AEs. Also, the vertical C O 2 interferometer chord passing near the center is better for ML-based detection of AEs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

A deterministic gradient-based approach to avoid saddle points

Abstract Loss functions with a large number of saddle points are one of the major obstacles for training modern machine learning (ML) models efficiently. First-order methods such as gradient descent (GD) are usually the methods of choice for training ML models. However, these methods converge to saddle points for certain choices of initial guesses. In this paper, we propose a modification of the recently proposed Laplacian smoothing gradient descent (LSGD) [Osher et al., arXiv:1806.06317 ], called modified LSGD (mLSGD), and demonstrate its potential to avoid saddle points without sacrificing the convergence rate. Our analysis is based on the attraction region, formed by all starting points for which the considered numerical scheme converges to a saddle point. We investigate the attraction region’s dimension both analytically and numerically. For a canonical class of quadratic functions, we show that the dimension of the attraction region for mLSGD is $\lfloor (n-1)/2\rfloor$ , and hence it is significantly smaller than that of GD whose dimension is $n-1$ .

Mathematics↗
DOE OSTI2020

Active Learning Accelerated Discovery of Stable Iridium Oxide Polymorphs for the Oxygen Evolution Reaction

The discovery of high-performing and stable materials for sustainable energy applications is a pressing goal in catalysis and materials science. Understanding the relationship between a material’s structure and functionality is an important step in the process, such that viable polymorphs for a given chemical composition need to be identified. Machine-learning-based surrogate models have the potential to accelerate the search for polymorphs that target specific applications. Herein, we report a readily generalizable active-learning (AL) accelerated algorithm for identification of electrochemically stable iridium oxide polymorphs of IrO 2 and IrO 3 . The search is coupled to a subsequent analysis of the electrochemical stability of the discovered structures for the acidic oxygen evolution reaction (OER). Structural candidates are generated by identifying all 956 structurally unique AB2 and AB3 prototypes in existing materials databases (more than 38000). Next, using an active learning approach, we find 196 IrO 2 polymorphs within the thermodynamic amorphous synthesizability limit and reaffirm the global stability of the rutile structure. We find 75 synthesizable IrO 3 polymorphs and report a previously unknown FeF 3 -type structure as the most stable, termed α-IrO 3 . To test the algorithms performance, we compare to a random search of the candidate space and report at least a 2-fold increase in the rate of discovery. Additionally, the AL approach can acquire the most stable polymorphs of IrO 2 and IrO 3 with fewer than 30 density functional theory optimizations. Analysis of the structural properties of the discovered polymorphs reveals that octahedral local coordination environments are preferred for nearly all low-energy structures. Subsequent Pourbaix Ir–H 2 O analysis shows that α-IrO3 is the globally stable solid phase under acidic OER conditions and supersedes the stability of rutile IrO 2 . Calculation of theoretical OER surface activities reveal ideal weaker binding of the OER intermediates on α-IrO 3 than on any other considered iridium oxide. We emphasize that the proposed AL algorithm can be easily generalized to search for any binary metal oxide structure with a defined stoichiometry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Data-Driven Optimal Control of Traffic Signals for Urban Road Networks

This paper studies the issue of data-driven optimal control design for traffic signals of oversaturated urban road networks. The signal control system based on the store and forward model is generally uncontrollable for which the controllable decomposition is needed. Instead of identifying the unknown parameters like saturation rates and turning ratios, a finite number of measured trajectories can be used to parametrize the system and help directly construct a transformation matrix for Kalman controllable decomposition through the fundamental lemma of J. C. Willems. On top of that, an infinite-horizon linear quadratic regulator (LQR) problem is formulated considering the constraints of green times for traffic signals. The problem can be solved through a two-phase data-driven learning process, where one solves an infinite-horizon unconstrained LQR problem and the other solves a finite-horizon constrained LQR problem. The simulation result shows the theoretical analysis is effective and the proposed data-driven controller can yield desired performance for reducing traffic congestion.

Liu, Tong↗
DOE OSTI2020

The Value of Information From Horizontal Distributed Acoustic Sensing Compared to Multicomponent Geophones Via Machine Learning

Abstract Faults play an important role in recharging many geothermal reservoirs, and seismic information can image the locations of these faults. The value of information (VOI) metric is used to objectively quantify and compare the value of two types of seismic receiver data via a machine learning approach. The demonstrated VOI methodology is novel by including spatial models from seismic data and obtaining the information statistics from machine learning. Our two-dimensional numerical experiments compare images created from sparsely spaced (80 m), two-component geophone sampling to high spatial resolution (1 m), single-component DAS. We used a three-fold cross validation of a U-Net convolutional neural networks to achieve average classification statistics. The results suggest that when horizontal sources are utilized, geophones and DAS identify reflectors and non-reflectors at roughly the same rate. The average F1 score for horizontal DAS is 0.939 and 0.931 for geophones. For images created from a vertical source, DAS performed marginally better (F1 = 0.919) than geophones (F1 = 0.877). Our transferrable methodology can provide guidance on which acquisition scenarios can improve images of important structures in the subsurface and present an efficient method for obtaining reliability statistics from high-dimensional, spatial data.

Energy & Fuels↗