Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

An Economics-by-Design Approach Applied to a Heat Pipe Microreactor Concept

Microreactors present a potential paradigm shift in the nuclear industry. Emphasis thus far has been on large-scale multi-billion-dollar projects that cater solely to grid electricity market. These projects can be challenging to finance and execute. On the other hand, microreactors are intended to target a wide variety of smaller niche markets and are expected to be factory-fabricated and more readily deployable. While diseconomies of scale for microreactors may tend to raise their costs per energy output (MWh) relative to large nuclear plants, offsetting gains can be expected from standardization, simplification, passive safety, lower radionuclide inventories, factory fabrication, fast installation, and low financing costs. To adequately assess these contributions, designers should have a different perspective on cost drivers than for large nuclear plants and can utilize novel approaches for systematic cost reduction. To account for these important aspects of microreactors, this report proposes an economics-by-design approach that places economic considerations at the center of the design process. The methodology builds on existing frameworks such as design-to-cost and value engineering, expanding them to new markets (beyond the grid), new attributes (beyond costs alone), and introducing the approach at earlier points in the design cycle. Design parameters and technical specifications are systematically evaluated until costs meet market entry points, while also providing the high-priority performance attributes of the particular use case. Determining first-order estimates for different components early in the process enables designers to focus R&D efforts on the biggest overall cost contributors and components with the most cost uncertainty. The analysis is always guided by market needs and threshold prices. In addition to microreactors, the approach is expected to be useful for other classes of nuclear reactors as well. The analysis was applied to a concept found in the open literature (the Design A heat-pipe reactor). A comprehensive bottom-up estimate was generated by leveraging a new microreactor-specific code of accounts and a range of cost equations. The initial estimate for levelized cost of electricity (LCOE) unsurprisingly exceeded market ranges since the use case had prioritized technological readiness over economic considerations in design choices. An alternate concept was then proposed, with various assumptions/targets made to reduce the largest cost contributors. Changes in the neutron spectrum, the power output, and building structures were found to make even the first-of-a-kind of this modified concept competitive with diesel generation in some remote communities. Learning rate (LR) assumptions indicated cost reductions achieved from sequential unit deployments could expand the range of competitiveness to include additional markets as deployments proceed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Diagnosing and overcoming recombination and resistive losses in non-silicon solar cells using a silicon-inspired characterization platform

This project aimed to generate the characterization tools needed for accurate and systematic loss analysis in non-silicon photovoltaic solar cell technologies and, through the use of these tools and analysis techniques, contribute to the development of a novel class of hetero-contacts to II-VI absorbers, with the final goal of demonstrating record-breaking CdSeTe devices. CdSeTe solar cells provide a prime example of the potential impact of the techniques we proposed to develop and implement: record poly-CdSeTe cells have bandgap-voltage deficits (W oc ) of approximately 550 mV, as compared with below 400 mV for all other mature PV technologies. Similarly, these record CdSeTe devices have FFs below 80%, when other mature cells are near or above 85%. Frustratingly, a systematic identification of the origin of these sub-par performances—for example recombination or resistive losses—has been lacking, thus slowing down the development of these technologies. Similarly, it is often asserted that CdSeTe cells need a better back (hole) contact. Although most believe this is true, no one knew—at the start of this project—how high the V oc and FF could be for a given cell if it had a perfect back contact. Such characterization techniques and loss analysis methods exist and are routinely performed on c-Si solar cells (e.g. injection-dependent lifetime, Suns-V oc , transfer length method, etc). Over the years, they have been instrumental in the development of silicon devices that operate at 91% of their theoretical (Auger) limit. Lifetime testing, and the associated reconstruction of the implied-J-V curve, can moreover be performed at every cell-processing step, thus allowing a direct peek into the impact of that step on cell performance. Therefore, adapting these techniques and tools to non-Si devices would greatly improve their learning rate. In this project, we developed a Suns-ERE technique—the equipment, methodology, and know-how—to measure the implied-J-V curve, the pseudo-J-V curve, and the actual J-V curve of a thin-film solar cell, allowing an accurate assessment of the quality of the bulk material and its surface passivation, the selectivity of the contact, and its resistivity. We used this technique to show that the absorber of present CdSeTe solar cells is capable of achieving 1 V Voc,, that passivation layers exist (e.g., Al2O3) that can support such high voltages, and that the barrier is identifying contact layers that are both passivating and carrier-selective. The characterization platform created in this project and the understanding generated using it will accelerate the progress of non-silicon PV technologies. In particular, the project will contribute to CdSeTe solar cells with Voc > 1 V and cell efficiency > 24%. Such cells provide a pathway to module-level efficiencies >23%. As CdSeTe presently competes with silicon on module cost (in $\$ $/W) and yet has significantly more room for efficiency gains, the potential for LCOE reduction is particularly large. For example, CdTe modules with an efficiency of 21% would allow an LCOE below $\$ $0.04kWh -1 in average US climates.

14 SOLAR ENERGY↗
DOE OSTI2025

Potential Fuel Cycle Cost Reductions of Once Through HALEU Reactors

This report looks to identify potential cost reduction opportunities for SFR and HTGR reactors using HALEU fuel. This analysis focuses on how learning rates and experience from other industries could translate to future HALEU fueled reactor fuel cycles. Various fuel loading and residence scenarios are evaluated to estimate areas of potential cost savings. Cost savings from location optimization is explored for both fresh and spent nuclear fuel. Additional analysis was completed to estimate cost savings through improved labor productivity.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Data for The utility of transfer learning to improve the performance of deep learning in axon segmentation

The utility of transfer learning to improve the performance of deep learning in axon segmentation Data Data: All the input and labeled volumes tf-logs: Tensorflow logs, view with command "tensorboard --logdir [name of folder]" Model Weights: model_weights: the argument list under variable combo indicate 1) no oversampling, 2) no rotation, 3) no learn scheduler, and 4) flipping on all three dimensions, and the additional values indicate 5) elastic deformation percentage, 6) rotate deformation percentage, 7) layer setting , 8) learning rate, and 9) training/validation/test data division suffix (leave '' if not using suffix). Results: Output from inference segment_total_results_validation_final: All validation results and calculations segment_total_results: All test results and calculations Authors The modified code was created for a paper by: Marjolein Oostrom, Michael A. Muniak, Rogene Eichler West, Sarah Akers, Paritosh Pande, Moses Obiri, Wei Wang, Kasey Bowyer, Zhuhao Wu, Lisa Bramer, Tianyi Mao, Bobbie Jo Webb-Robertson The work is adapted from Github TrailMap, which was created by Albert Pun and Drew Friedmann Acknowledgments MO, RMEW, SA, MO, LB, BJWR were supported by the Laboratory Directed Research and Development at Pacific Northwest National Laboratory (PNNL), a Department of Energy facility operated by Battelle under contract DE-AC05-76RLO01830. WW, KB, and ZW were supported in part by a NIH/BRAIN Initiative Grant RF1MH128969. MAM and TM were supported by two NIH/BRAIN Initiative Grants R01NS104944, RF1MH120119 and NIH R01NS081071. This research is affiliated with the Pacific northwest bioMedical Innovation Co-laboratory (PMedIC) collaboration between OHSU and PNNL.

Oostrom, Marjolein T↗
DOE OSTI2022

An Accuracy-Maximization Approach for Claims Classifiers in Document Content Analytics for Cybersecurity

This paper presents our research approach and findings towards maximizing the accuracy of our classifier of feature claims for cybersecurity literature analytics, and introduces the resulting model ClaimsBERT. Its architecture, after extensive evaluations of different approaches, introduces a feature map concatenated with a Bidirectional Encoder Representation from Transformers (BERT) model. We discuss deployment of this new concept and the research insights that resulted in the selection of Convolution Neural Networks for its feature mapping aspects. We also present our results showing ClaimsBERT to outperform all other evaluated approaches. This new claims classifier represents an essential processing stage within our vetting framework aiming to improve the cybersecurity of industrial control systems (ICS). Furthermore, in order to maximize the accuracy of our new ClaimsBERT classifier, we propose an approach for optimal architecture selection and determination of optimized hyperparameters, in particular the best learning rate, number of convolutions, filter sizes, activation function, the number of dense layers, as well as the number of neurons and the drop-out rate for each layer. Fine-tuning these hyperparameters within our model led to an increase in classification accuracy from 76% obtained with BertForSequenceClassification’s original model to a 97% accuracy obtained with ClaimsBERT.

Ameri, Kimia (ORCID:0000000328791871)↗
DOE OSTI2020

Energy Storage Analysis

This study presents a comprehensive techno-economic characterization of energy storage and exible low carbon power generation technologies that can shift energy across days, weeks, or months to balance daily, weekly, and seasonal disparities in supply and demand. Energy storage technologies evaluated here include pumped hydropower storage (PHS), adiabatic and diabatic compressed air energy storage (CAES), vanadium redox flow batteries (VRBs), pumped thermal energy storage (P-TES), and renewably produced hydrogen stored in either geologic formations or underground pipes with re-electrification via combustion turbines in combined cycles, stationary proton exchange membrane (PEM) fuel cells, or the novel use of PEM fuel cells designed for heavy-duty vehicles (HDVs) which are expected to have shorter lives but also lower capital costs. We also evaluate flexible low-carbon power generation systems, including ethanol combustion in gas turbines and natural gas combustion with carbon capture and sequestration (CCS). We estimate current costs with literature data, use learning rates to characterize future costs, and develop capacity factors calibrated to an 85% renewables grid to calculate the levelized cost of energy (LCOE) of each technology. Results illustrate that at the 12-hour storage duration, PHS and CAES have the lowest LCOE with current costs, and VRBs become competitive if future costs are achieved. At the 120-hour storage duration, hydrogen systems with geologic storage and natural gas with CCS achieve the lowest LCOE in both current and future capital cost scenarios. In particular, the new configuration of HDV-PEM fuel cells with hydrogen storage in geologic formations evaluated here could lower the LCOE by 22-27% compared to stationary fuel cell systems typically evaluated and might help enable very high (>80%) renewable energy electric power systems. P-TES and hydrogen stored in underground pipes are the least-cost options at the 120-hour storage duration rating that do not require some form of geologic storage. Sensitivity analysis and Monte Carlo analysis illustrate that the general trends seen in this study are valid for a wide range of capacity factors and future cost scenarios. The study also illustrates that coproducing and selling hydrogen to other markets could reduce the LCOE of hydrogen systems by up to 39%.

carbon capture and sequestration↗
DOE OSTI2020

A Nonlocal-Gradient Descent Method for Inverse Design in Nanophotonics

Local-gradient-based optimization approaches lack nonlocal exploration abilityrequired for escaping from local minima when searching non-convex landscapes.A directional Gaussian smoothing (DGS) approach was recently proposed in [29]and used to define a truly nonlocal gradient, referred to as the DGS gradient, inorder to enable nonlocal exploration in high-dimensional black-box optimization.Promising results show that replacing the traditional local gradient with the nonlocalDGS gradient can significantly improve the performance of gradient-based methodsin optimizing highly multi-modal loss functions. However, the current DGS methodis designed for unbounded and uncontrained optimization problems, making itinapplicable to real-world engineering optimization problems where the tuningparameters are often bounded and the loss function is usually constrained byphysical processes. In this work, we propose to extend to the DGS approachto the constrained inverse design framework in order to find better optima ofmulti-modal loss functions. A series of adaptive strategies for smoothing radiusand learning rate updating are developed to improve the computational efficiencyand robustness. Our methodology is demonstrated by an example of designing ananoscale wavelength demultiplexer, and shows superior performance compared tothe state-of-the-art approaches. By incorporating volume constraints, the optimizeddesign achieves an equivalently high performance but significantly reduces theamount of material usage.

Bi, Sirui↗
DOE OSTI2023

Adaptive Data-Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Adaptable Data Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Approximation rates of DeepONets for learning operators arising from advection–diffusion equations

Here we present the analysis of approximation rates of operator learning in Chen and Chen (1995) and Lu et al. (2021), where continuous operators are approximated by a sum of products of branch and trunk networks. In this work, we consider the rates of learning solution operators from both linear and nonlinear advection–diffusion equations with or without reaction. We find that the approximation rates depend on the architecture of branch networks as well as the smoothness of inputs and outputs of solution operators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Technological evolution of large-scale blue hydrogen production toward the U.S. Hydrogen Energy Earthshot

Hydrogen potentially has a crucial role in the U.S. transition to a net-zero emissions economy. Learning from large-scale hydrogen projects will boost technological evolution and innovation toward the U.S. Hydrogen Energy Earthshot. We apply experience curves to estimate the evolving costs of blue hydrogen production and to further examine the economic effect on technological evolution of the Inflation Reduction Act’s tax credits for carbon sequestration and clean hydrogen. Learning-by-doing alone can decrease the production cost of blue hydrogen. Without tax incentives, however, it is hard for blue hydrogen production to reach the cost target of $\$1$/kg H 2 . Here we show that the breakeven cumulative production capacity required for gas-based blue hydrogen to reach the $\$1$/kg H 2 target highly depends on tax credit, natural gas price, inflation rate, and learning rates. We make recommendations for hydrogen hub development and for accelerating technological progress toward the Hydrogen Energy Earthshot.

08 HYDROGEN↗
DOE OSTI2025

Best of both worlds: Enforcing detailed balance in machine learning models of transition rates

The slow microstructural evolution of materials often plays a key role in determining material properties. When the unit steps of the evolution process are slow, direct simulation approaches such as molecular dynamics become prohibitive and Kinetic Monte-Carlo (kMC) algorithms, where the state-to-state evolution of the system is represented in terms of a continuous-time Markov chain, are instead frequently relied upon to efficiently predict long-time evolution. The accuracy of kMC simulations however relies on the complete and accurate knowledge of reaction pathways and corresponding kinetics. This requirement becomes extremely stringent in complex systems such as concentrated alloys where the astronomical number of local atomic configurations makes the a priori tabulation of all possible transitions impractical. Machine learning models of transition kinetics have been used to mitigate this problem by enabling the efficient on-the-fly prediction of kinetic parameters. While conventional KMC methods based on transition state theory naturally yield reversible dynamics that exactly obey the detailed balance criterion, providing strong guarantees on the properties of the stationary distribution, many recently-proposed ML-based approaches to barrier predictions provide no such guarantees. In this study, we derive conditions under which physics-informed ML architectures exactly enforce the detailed balance condition by construction, even when relying on non-extensive descriptions of states in terms of local environments around mobile defects. In conclusion, using the diffusion of a vacancy in a concentrated alloy as an example, we show that such ML architectures also exhibit superior performance in terms of prediction accuracy, demonstrating that the imposition of physical constraints can facilitate the accurate learning of barriers at no increase in computational cost.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Machine-learning based prediction of injection rate and solenoid voltage characteristics in GDI injectors

We report that current state-of-the-art gasoline direct-injection (GDI) engines use multiple injections as one of the key technologies to improve exhaust emissions and fuel efficiency. For this technology to be successful, secured adequate control of fuel quantity for each injection is mandatory. However, nonlinearity and variations in the injection quantity can deteriorate the accuracy of fuel control, especially with small fuel injections. Therefore, it is necessary to understand the complex injection behavior and to develop a predictive model to be utilized in the development process. This study presents a methodology for rate of injection (ROI) and solenoid voltage modeling using artificial neural networks (ANNs) constructed from a set of Zeuch-style hydraulic experimental measurements conducted over a wide range of conditions. A quantitative comparison between the ANN model and the experimental data shows that the model is capable of predicting not only general features of the ROI trend, but also transient and non-linear behaviors at particular conditions. In addition, the end of injection (EOI) could be detected precisely with a virtually generated solenoid voltage signal and the signal processing method, which applies to an actual engine control unit. A correlation between the detected EOI timings calculated from the modeled signal and the measurement results showed a high coefficient of determination.

42 ENGINEERING↗
DOE OSTI2023

Fast and accurate machine learning prediction of phonon scattering rates and lattice thermal conductivity

Abstract Lattice thermal conductivity is important for many applications, but experimental measurements or first principles calculations including three-phonon and four-phonon scattering are expensive or even unaffordable. Machine learning approaches that can achieve similar accuracy have been a long-standing open question. Despite recent progress, machine learning models using structural information as descriptors fall short of experimental or first principles accuracy. This study presents a machine learning approach that predicts phonon scattering rates and thermal conductivity with experimental and first principles accuracy. The success of our approach is enabled by mitigating computational challenges associated with the high skewness of phonon scattering rates and their complex contributions to the total thermal resistance. Transfer learning between different orders of phonon scattering can further improve the model performance. Our surrogates offer up to two orders of magnitude acceleration compared to first principles calculations and would enable large-scale thermal transport informatics.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Iterative Learning Control for Video-rate Atomic Force Microscopy

We present a control scheme for video-rate atomic force microscopy with rosette pattern. The controller structure involves a feedback internal-model-based controller and a feedforward iterative learning controller. The iterative learning controller is designed to improve tracking performance of the feedback-controlled scanner by rejecting the repetitive disturbances arising from the system nonlinearities. We investigate the performance of two inversion techniques for constructing the learning filter. We conduct tracking experiments using a two-degree-of-freedom microelectromechanical system (MEMS) nanopositioner at frame rates ranging from 5 to 20 frames per second. Furthermore, the results reveal that the algorithm converges rapidly and the iterative learning controller significantly reduces both the transient and steady-state tracking errors. We acquire and report a series of high-resolution time-lapsed video-rate AFM images with the rosette pattern.

42 ENGINEERING↗
DOE OSTI2022

Method for Generating Expert Derived Confidence Scores

We executed a pilot demonstration of a methodology for developing a new confidence metric to help operators calibrate their trust in ML event classifiers. This confidence metric was derived from domain expert judgment and was accompanied with a qualitative description describing the reason for each confidence rating. After learning the boundaries of an ML’s performance by studying a subset of events an SME rated his confidence in the ML’s ability to classify similar events and provided an explanation for his ratings. To demonstrate this methodology, we developed our expert driven confidence scores for the ML event classifier within the ESAMS. Next, we assessed the accuracy of the human expert confidence scores relative to the ML’s uncertainty quantification scores. This report includes a description of our methodology, summary of our findings and future directions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Molecular-Level Exploration of the Structure-Function Relations Underlying Interfacial Charge Transfer in the Subphthalocyanine/C 60 Organic Photovoltaic System

The arrangement of organic molecules at the donor-acceptor interface in an organic photovoltaic (OPV) cell can have a strong effect on the generation of charge carriers and thereby cell performance. In this paper, we report the molecular-level exploration of the ensemble of interfacial donor-acceptor pair geometries and the charge-transfer (CT) rates to which they give rise. Our approach combines molecular-dynamics simulations, electronic structure calculations, machine learning, and rate theory. This approach is applied to the boron subphthalocyanine chloride (donor) and C 60 (acceptor) OPV system. In this work we find that the interface is dominated by a previously unreported donor-acceptor pair edge geometry, which contributes significantly to device performance in a manner that depends on the initial conditions. Quantitative relations between the morphology and CT rates are established, which can be used to advance the design of more efficient OPV devices.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗