Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Training Time”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Variational AutoEncoders Reveal Intensifying GPP Extremes in Continental United States based on CESM2 Simulations

Climate extremes significantly impact terrestrial carbon cycle dynamics, necessitating robust methods for detecting and analyzing anomalous behavior in plant productivity. This study presents a novel application of variational autoencoders (VAE) for identifying extreme events in gross primary productivity (GPP) from Community Earth System Model version 2 simulations across four AR6 regions in the Continental United States. We compare VAE-based anomaly detection with traditional singular spectral analysis (SSA) methods across three time periods: 1850-80, 1950-80, and 2050-80 under SSP5-8.5 scenario. The VAE architecture employs three dense layers and a latent space with input sequence length of 12 months, training on normalized GPP time series to reconstruct the GPP and identify anomalies based on reconstruction errors. Extreme events are defined using 5th percentile thresholds applied to both VAE and SSA anomalies. Results demonstrate strong regional agreement between VAE and SSA methods in spatial patterns of extreme event frequencies, despite VAE consistently producing higher threshold values (179-756 GgC for VAE vs. 100-784 GgC for SSA across regions and periods). Both methods reveal increasing magnitudes and frequencies of negative carbon cycle extremes toward 2050-80, particularly in Western and Central North America. The VAE approach shows comparable performance to established SSA techniques while offering computational advantages and enhanced capability for capturing non-linear temporal dependencies in carbon cycle variability. This research demonstrates the potential of deep learning approaches for extremes detection and provides a foundation for improved understanding of future carbon cycle risks under future conditions.

Sharma, Bharat [ORNL] (ORCID:0000000266982487)↗

Contrasting student and staff perceptions of preclinical‐to‐clinical transition at a Chilean dental school

Abstract Introduction Dental education is a challenging and demanding field of study as students are expected to acquire various competencies to fulfil their professional requirements after graduation. The objective of this study was to investigate and compare dental students' and clinical staff instructors' perceptions of the preclinical‐to‐clinical transition training at a Dental School in Santiago, Chile. Material and Methods Two questionnaires containing 11 quantitative and one qualitative item were developed to assess our year three, four and five ( n = 244) dental undergraduate students' challenges when they begin treating patients, and clinical staff ( n = 78) perceptions of the preparedness to treat patients of the same students. Both questionnaires were voluntarily and anonymously implemented eight weeks after the beginning of the 2019 academic year. Responses were analysed using a Chi‐squared test for each quantitative question, while qualitative comments were studied to form themes and dimensions. RESULTS A total of 234 (96%) students and 60 (77%) instructors completed their respective questionnaire. There were considerable variations between students in the different years of the programme, as well as between students and staff members. Students and instructors felt the former had enough knowledge to treat patients though it was difficult for them to apply it in clinical practice. Again, both believed they could communicate with patients, but third year students asked for more training on this. Regarding practical skills, fourth‐ and fifth‐year students felt prepared but not third year students, who preferred to work in pairs with senior students, a preference that was shared by the instructors. All student groups asked clinical staff to provide more frequent, constructive and consistent feedback and felt that the difference between simulation and clinical environments and the amount of clinical work to fulfil clinical requirements made them feel stressed. Another mentioned stressor was students' low self‐confidence when working with patients. Among the requested improvements, students requested better training on how the dental clinic works to save time. Conclusions Preclinical‐to‐clinical transition training presents several challenges. Some of the problems highlighted by both students and clinical staff members persisted with the transition after three, four and even five years of training, which needs to be addressed.

Tricio, Jorge↗

A Hybrid-Learning Algorithm for Online Dynamic State Estimation in Multimachine Power Systems

With the increasing penetration of distributed generators in the smart grids, having knowledge of rapid real-time electromechanical dynamic states has become crucial to system stability control. Conventional Supervisory Control and Data Acquisition (SCADA)-based dynamic state estimation (DSE) techniques are limited by the slow sampling rates, while the emerging phasor measurement units (PMUs) technology enables rapid real-time measurements at network nodes. Using generator bus terminal voltages, we propose a hybrid-learning DSE (HL-DSE) algorithm to estimate the synchronous machine rotor angle and speed in real time. The HL-DSE takes the power system model into account and trains neuroestimators with real-time data in an online manner. Compared with traditional DSE methods, the HL-DSE overcomes limitations by using a data-driven approach in conjunction with the physical power system model. The time efficiency, accuracy, convergence, and robustness of the proposed algorithm are tested under noises and fault conditions in both small- and large-scale test systems. Simulation results show that the proposed HL-DSE is much more computationally efficient than widely used Kalman filter (KF)-based methods while maintaining comparable accuracy and robustness. In particular, HL-DSE is over 100 times faster than square-root unscented KF (SR-UKF) and 80 times faster than extended KF (EKF). The advantages and challenges of the HL-DSE are also discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Generation of ultrafast electron bunch trains via trapping into multiple periods of plasma wakefields

We demonstrate a novel approach to the generation of femtosecond electron bunch trains via laser-driven wakefield acceleration. We use two independent high-intensity laser pulses, a drive, and an injector, each creating their own plasma wakes. The interaction of the laser pulses and their wakes results in a periodic injection of free electrons in the drive plasma wake via several mechanisms, including ponderomotive drift, wake-wake interference, and pre-acceleration of electrons directly by strong laser fields. Electron trains were generated with up to four quasi-monoenergetic bunches, each separated in time by a plasma period. In conclusion, the time profile of the generated trains is deduced from an analysis of beam loading and confirmed using 2D particle-in-cell simulations

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A High-Voltage High-Reliability Scalable Architecture for Electric Vehicle Power Electronics (Final Report)

This project developed and demonstrated new composite converter technologies that lead to high power density (> 20 kW/L) at power levels of 10s of kW, 100s of kW, or possibly higher, with fundamental advances in converter efficiency and Q that lead to substantial increases in mean time to failure (MTTF). These advantages were realized through development of new composite converter topologies that perform buck, boost, or other conversion functions and that are scalable to higher voltage and power levels through sharing of voltage and current stresses among multiple dissimilar partial-power converter modules. The project led to experimental demonstration of a125 kW multifunction electric vehicle power conversion system having in-creased dc bus voltage (950 V nominal, 1200 V peak) that interfaces a 200 V to 400 V battery pack, and that includes integrated level 2 wired charging and wireless charging functions. The project incorporated SiC MOSFET modules having switching frequencies in excess of 100 kHz, planar magnetics, a hierarchical control architecture that enables scaling to higher voltages and powers with additional converter modules, and a high-power density in excess of 20 kW/L. The research demonstrated how a more complex converter approach can increase mean-time-to-failure, even though the number of elements is increased. This is achieved through significant reduction of temperature rise through fundamentally superior converter circuit topologies. The research also demonstrated new high power planar magnetics that increase power density. The technology is appropriate to a variety of applications including EV power trains, EV charging, PV inverters, battery storage, and similar areas. These systems potentially can be manufactured in the U.S.

33 ADVANCED PROPULSION SYSTEMS↗

Shared automated vehicle fleet operations for first-mile last-mile transit connections with dynamic pooling

Shared automated vehicles (SAVs) have the potential to promote transit ridership by providing efficient first-mile last-mile (FMLM) connections through reduced operational costs to fleet providers and lower out-of-pocket costs to riders. To help plan for a future of integrated mobility, this paper investigates the impacts of SAVs serving FMLM connections, as a mode that provides flexibility in access/egress decisions and is well coordinated with train station schedules. To achieve this objective, a novel dynamic pooling algorithm was introduced to match SAVs with riders while coordinating the riders' arrival times at the light-rail station to a known train schedule. Microsimulations of SAVs and travelers throughout two central Austin neighborhoods show how larger service areas, higher levels of SAV demand, and longer arrival times between successive trains require larger SAV fleet sizes and higher SAV utilization rates to deliver close traveler wait times. Four-person SAVs appear to perform similar to 6-seat SAVs but will cost less to provide. Using a dynamic pooling algorithm tightly coordinated with train arrivals (every 15 min) delivers 87% of travelers to their stations in time to catch the next train, whereas uncoordinated assignments deliver just 58% of travelers in time.

33 ADVANCED PROPULSION SYSTEMS↗

Iterative sampling of expensive simulations for faster deep surrogate training

Deep neural network (DNN) surrogates of expensive physics simulations are enabling a rapid change in the way that common experimental design and analysis tasks are approached. Surrogate models allow simulations to be performed in parallel and separately from downstream tasks, thereby enabling analyses that would be impossible with the simulation in-the-loop; surrogates based on DNNs can effectively emulate diverse non-scalar data of the types collected in fusion and laboratory-astrophysics experiments. The challenge is in training the surrogate model, for which large ensembles of physics simulations must be run, preferably without wasting computational effort on uninteresting simulations. Here, in this paper, we present an iterative sampling scheme that can preferentially propose simulations in interesting regions of parameter space without neglecting unexplored regions, allowing high-quality and wide-ranging surrogate models to be trained using 2–3 times fewer simulations compare to space-filling designs. Our approach uses an explicit importance function defined on the simulation output space, balanced against a measure of simulation density which serves as a proxy for surrogate accuracy. It is easy to implement and can be tuned to find interesting simulations early in the study, allowing surrogates to be trained quickly and refined as new simulations become available; this represents an important step towards the routine generation of deep surrogate models quickly enough to be truly relevant to experimental work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

FORCE Update 2024

The Framework for Optimization of Resources and Economics (FORCE) tool suite is the U.S. Department of Energy’s Nuclear Integrated Energy Systems (IES) Program flagship tool suite for technoeconomic IES analysis of IES. This tool suite is useful for analysis designed to evaluate and improve the technoeconomics of energy production systems, particularly for systems including nuclear technology. In this report, we document the development activity for the FORCE tool suite to extend its capabilities as performed during fiscal year 2024. In addition to reliability and accessibility, capability is one of the three standards guiding the development of the FORCE tool suite and the software codes that are its constituent parts. Extending the capabilities of the FORCE tool suite allows analysis both within the IES program as well as industry, university, and laboratory partners to perform analysis with more accuracy, insight, and impactful narrative. Four areas of capability development were the focus of activity this year: economic parameter uncertainty quantification, multiresolution analysis, components-to-optimization workflow automation, and statespace construction workflows for real-time optimal control. In economic parameter uncertainty quantification, the ability of HERON to capture risk due to scenarios (weather and energy demand uncertainty) was expanded to also include uncertainties in financial parameters such as capital cost or operation and maintenance costs. By including these sources of uncertainty, which are sometimes very large compared with scenario uncertainty, HERON is better able to capture the risk posed by investment in various IES technology. Because of this, analysts can also consider the reduction in risks that can be realized by choice of some technologies. In multiresolution analysis, development activity extended on work completed previously. In fiscal year 2023, methods for decomposing time series signals, such as demand, solar and wind availability, and price profiles, were analyzed and down-selected to those most effective at splitting signals into different resolutions. These resolutions allow considering the influence of different energy demand and supply behaviors across different time scales. For example, energy demand might be divided into seasonal, weekly, and hourly profiles. In fiscal year 2024, this preliminary work was extended and implemented within the Risk Analysis Virtual Environment (RAVEN) risk and uncertainty analysis platform, which is used throughout the FORCE framework. This development of the “multi-resolution time series analysis” (MR-TSA) module in RAVEN allows training synthetic history generators on complex time series. These synthetic history generators can then be used in HERON for generating scenarios that represent possible market and weather scenarios that can be analyzed on different time scales. We envision completing this work in the future, implementing multiresolution dispatch optimization strategies that can make the most beneficial use of these stratified time histories. In components-to-optimization workflow development, workflows for translating user inputs of components into algorithms for algebraic optimization were selected and implemented. Similar algorithms within the Holistic Energy Resource Optimization Network (HERON) were separated from the main code base of HERON and gathered with the components-to-optimization workflows in the new Dispatch Optimization Variable Engine (DOVE) software library. This modularization allows FORCE users to analyze dispatch optimization and energy system duty cycles independently of HERON, which previously was a burdensome task. Additionally, these dispatch optimization algorithms, set up in an independent library, can now be used across all software applications within FORCE, especially including the real-time optimal control software Optimization of Real-time Capacity Allocation (ORCA). Allowing FORCE software to share dispatch optimization algorithms within a single library allows for improved software maintenance and reliability. In statespace characterization workflow development, alternative workflows for optimizing dispatch with additional technical accuracy was the focus, particularly to improve the real-time optimization decision making in ORCA. Using algorithms and workflows initially developed for the Feasible Actuator Range Modifier (FARM), workflows for determining the statespace representation of IES were identified and demonstrated. The resulting dispatch optimization required a more robust optimization algorithm than that originally used in HERON (and moved to DOVE), which required adding an alternate workflow to DOVE that can more accurately match the behavior of physical systems using a partial differential equation representation. In conclusion, capability developments in the FORCE tool suite in fiscal year 2024 have improved the ability of the FORCE tool suite to perform

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Generation of multiple attosecond sub-bursts in femtosecond pulse trains by long-wavelength driving lasers

High-order harmonics generated by a long intense femtosecond laser are known experimentally to create attosecond pulse trains (APTs). In the time domain, an APT consists of a sequence of sharp attosecond bursts that are equally separated by each half optical cycle. Here, in this work, we show that such well-known features can be modified when a longer wavelength driving laser is used. From our simulations, we show that multiple shorter attosecond sub-bursts exist in the femtosecond pulse train within each half optical cycle and the duration of each sub-burst scales approximately as $λ^{–2}_0$ with the driving laser wavelength λ 0 . We show that such sub-bursts can be found using quantitative rescattering model for harmonics generated from a single atom, and their origin is due to the interference of the quantum orbits from first two returns of the recombining electron. We further show that such sub-bursts can be phase matched under proper laser focusing condition and the position of the gas cell, thus, such new features should be observable experimentally.

47 OTHER INSTRUMENTATION↗

High-Throughput Field Plant Phenotyping: A Self-Supervised Sequential CNN Method to Segment Overlapping Plants

High-throughput plant phenotyping—the use of imaging and remote sensing to record plant growth dynamics—is becoming more widely used. The first step in this process is typically plant segmentation, which requires a well-labeled training dataset to enable accurate segmentation of overlapping plants. However, preparing such training data is both time and labor intensive. To solve this problem, we propose a plant image processing pipeline using a self-supervised sequential convolutional neural network method for in-field phenotyping systems. This first step uses plant pixels from greenhouse images to segment nonoverlapping in-field plants in an early growth stage and then applies the segmentation results from those early-stage images as training data for the separation of plants at later growth stages. The proposed pipeline is efficient and self-supervising in the sense that no human-labeled data are needed. We then combine this approach with functional principal components analysis to reveal the relationship between the growth dynamics of plants and genotypes. We show that the proposed pipeline can accurately separate the pixels of foreground plants and estimate their heights when foreground and background plants overlap and can thus be used to efficiently assess the impact of treatments and genotypes on plant growth in a field environment by computer vision techniques. This approach should be useful for answering important scientific questions in the area of high-throughput phenotyping.

59 BASIC BIOLOGICAL SCIENCES↗

Path sampling of recurrent neural networks by incorporating known physics

Recurrent neural networks have seen widespread use in modeling dynamical systems in varied domains such as weather prediction, text prediction and several others. Often one wishes to supplement the experimentally observed dynamics with prior knowledge or intuition about the system. While the recurrent nature of these networks allows them to model arbitrarily long memories in the time series used in training, it makes it harder to impose prior knowledge or intuition through generic constraints. In this work, we present a path sampling approach based on principle of Maximum Caliber that allows us to include generic thermodynamic or kinetic constraints into recurrent neural networks. We show the method here for a widely used type of recurrent neural network known as long short-term memory network in the context of supplementing time series collected from different application domains. These include classical Molecular Dynamics of a protein and Monte Carlo simulations of an open quantum system continuously losing photons to the environment and displaying Rabi oscillations. Our method can be easily generalized to other generative artificial intelligence models and to generic time series in different areas of physical and social sciences, where one wishes to supplement limited data with intuition or theory based corrections.

59 BASIC BIOLOGICAL SCIENCES↗

Active learning strategy for high fidelity short-term data-driven building energy forecasting

The quality of a data-driven model is heavily dependent on the quality of data. Data from building operation often have data bias problems, which means that the data sample is collected in a way that some members of the intended data population are less likely to be included than others. Data-driven energy forecasting models built on such data hence are biased and could lead to large forecasting errors. Active learning—an effective method to defying data bias—is rarely studied or applied in the area of data-driven building energy forecasting modeling. This paper attempts to fill this gap and explores the application of active learning in data-driven building energy forecasting. The developed strategy in this paper efficiently generate informative training data within a time budget and uses block design to passively consider weather disturbances. The developed active learning strategy is applied and evaluated in both virtual and real-building testbeds against traditional data-driven methods. Via these virtual and real-building evaluation cases, we have demonstrated that the data bias problem typically exists in building operation data is resolved by applying the developed active learning strategy. Furthermore, building energy forecasting models trained from data generated from the active learning strategy have shown improved performances in both model accuracy and model extendibility perspectives. The effectiveness of the block design module is also validated to effectively consider the impact of weather conditions on active learning design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Self-supervised Representation Learning for Astronomical Images

Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning recovers representations of sky survey images that are semantically useful for a variety of scientific tasks. These representations can be directly used as features, or fine-tuned, to outperform supervised methods trained only on labeled data. We apply a contrastive learning framework on multiband galaxy photometry from the Sloan Digital Sky Survey (SDSS), to learn image representations. We then use them for galaxy morphology classification and fine-tune them for photometric redshift estimation, using labels from the Galaxy Zoo 2 data set and SDSS spectroscopy. In both downstream tasks, using the same learned representations, we outperform the supervised state-of-the-art results, and we show that our approach can achieve the accuracy of supervised models while using 2-4 times fewer labels for training. The codes, trained models, and data can be found at https://portal.nersc.gov/project/dasrepo/self-supervised-learning-sdss.

79 ASTRONOMY AND ASTROPHYSICS↗

Prediction of vacancy defect diffusion paths in high entropy alloys via machine learning on molecular dynamics data

Identifying the diffusion path of point defects is a critical step in understanding their evolution and the mechanisms of related phenomena. Defect diffusion occurs at small length and time scales, with impacts on material properties that may continue to evolve over ns to μs, ms, and the continuum scale (s, min, etc., and cm, m, etc.). The time scale accessible to molecular dynamics (MD) simulations is limited by small step sizes, typically in the fs range. Thus, surrogate models of MD simulations through machine learning (ML)-based algorithms are of great interest, especially for complex systems such as high entropy alloys (HEAs). In this work, dynamics governing vacancy migration in HEA were approximated with graph convolutional network (GCN) models as ansatzes for kinetic Monte Carlo (KMC) rate catalogs. Network design considered that diffusion in crystalline solids generally depends on interactions between defects and their immediate neighbor atoms. Graphs represented the vacancy surroundings, MD-generated trajectories provided training and comparison datasets, and unsupervised GCN models approximated interatomic dynamics governing vacancy migration in HEAs as ansatzes for KMC. A proof-of-concept model trained on MD data for the Fe, Ni, Cr, Co, and Cu HEA environment was used with two different neighbor interactions to assess the feasibility of training a GCN to predict vacancy defect transition rates in the HEA environment. The resulting setup rapidly generated MD-formatted synthetic trajectories based on dynamics learned from the MD training set, with a time acceleration of roughly two orders of magnitude and a similar diffusion coefficient to MD observations. Additionally, Nudged Elastic Band (NEB) calculations were performed on randomly generated FeNiCrCoCu HEA structures to determine vacancy migration barriers across nearest-neighbor sites. Transition probabilities for each jump, categorized by atomic type, were extracted from these calculations. NEB-based and GCN-based approaches led to similar outcomes.

Reimer, C↗

A mathematical approach to using the forgetting curve to evaluate experience and training factors in human reliability analysis

Traditional human reliability analysis (HRA) methods have difficulty dealing with the dynamic nature of factors such as time and rely on static and expert-judgment-based assessments of performance-shaping factors (PSFs) across limited levels. In this study, we introduce a mathematical approach for dynamically evaluating the experience and training PSF. Our proposed method integrates the psychological concept of the “forgetting curve” to evaluate how PSFs are impacted by the number of trainings and the time elapsed since training. To confirm the validity of the model, we provide experimental data fitted by identifying the quantitative relationship between training and human performance. This research enables dynamic and objective assessments, thus reducing reliance on subjective expert judgment and improving the accuracy of HRA.

99 - GENERAL AND MISCELLANEOUS↗

Efficient Reinforcement Learning for Real-Time Hardware-Based Energy System Experiments: Preprint

In the context of urgent climate challenges and the pressing need for rapid technology development, Reinforcement Learning (RL) stands as a compelling data-driven method for controlling real-world physical systems. However, RL implementation often entails time-consuming and computationally intensive data collection and training processes, rendering them inefficient for real-time applications that lack non-real-time models. To address these limitations, real-time emulation techniques have emerged as valuable tools for the lab-scale rapid prototyping of intricate energy systems. While emulated systems offer a bridge between simulation and reality, they too face constraints, hindering comprehensive characterization, testing, and development. In this research, we construct a surrogate model using limited data from simulated systems, enabling an efficient and effective training process for a Double Deep Q-Network (DDQN) agent for future deployment. Our approach is illustrated through a hydropower application, demonstrating the practical impact of our approach on climate-related technology development.

deep Q-learning↗

Leveraging Observations of Untrained Panelists to Screen for Quality of Fresh-Cut Romaine Lettuce

Fresh-cut romaine lettuce’s high perishability challenges ready-to-eat (RTE) salad production. Selecting cultivars less prone to browning and decay is crucial for extending shelf life. Traditional quality evaluation methods using instrumentation and trained panelists are time-consuming and logistically complex. This study investigated the effectiveness of untrained volunteers in assessing fresh-cut romaine lettuce quality. Given that the average consumer in the USA is familiar with the flavor characteristics of romaine lettuce, this study proposed to investigate the value of having untrained volunteers discern the quality of fresh-cut romaine lettuce. Therefore, six romaine lettuce accessions (Green Forest, King Henry, Parris Island Cos, PI 491224, SM13-R2, and Sun Valley) were assessed for sensory quality attributes (browning, green color, decay, and overall quality) and compared with instrumentation analyses (gas composition including O2 and CO2, electrolyte leakage, and color). The results showed significant quality differences (p < 0.05) among the accessions, with some seasonal variability. Very importantly, the consumers’ (n = 159) assessments revealed similar results to those produced by either instrumentation or a trained panel. The consumers provided sensory scores that allowed for the grouping of accessions based on their postharvest quality, which efficiently matched their pedigree relationship. In conclusion, ad hoc consumer panels can be an effective way to characterize the quality of romaine lettuce for RTE salads.

Agriculture↗