Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “epoch”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

AADL: Anderson Accelerated Deep Learning

We propose a stable, distributed approach to perform AA that accelerates the convergence rate of stochastic first-order optimizers to train neural networks. Differently from previous works, we do not alter neither the scheme to perform AA nor the loss function minimized during the training. To improve robustness against stagnation, we customize general guidelines that suggest to relax the frequency of AA corrections by performing AA only at the end of an entire training epoch. To improve robustness of AA against the stochastic oscillations of first-order optimizers, we average the gradients computed on consecutive stochastic optimization updates. The improved regularity of the converging sequence and the reduced amplitude of stochastic oscillations across consecutive optimization steps allows AA to efficiently extrapolate an improved converging sequence, thereby overcoming limitations of existing approaches to perform AA on stochastic optimization.

Lupo Pasini, Massimiliano [Oak Ridge National Lab.↗
DOE OSTI2021

PRIME

SAND2021-0565 O PRIME is a modeling framework designed for the real-time characterization and forecasting of partially observed epidemics. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. Examples are provided using publicly available COVID-19 data. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗
DOE OSTI2024

Data-Driven Protection Software to classify fault locations by protective zone in distribution systems with high PV penetration

The software contains (a) the source codes to generate Point-on-Wave (PoW) transient data for any feeder model in Alternative Transient Program (ATP) format. Codes provide options to change different steady state settings, including the loading condition and PV capacity and transient state setting like faults type, location and initiation time (b) data post-processing source code to converted data from native format to COMTRADE, csv, HDF5 (c) Docker container to train CNN to classify fault locations by protective zone. The container takes dataset and other training parameters (sampling rate, training epochs, batch size etc) as input to train CNN. The container writes back the trained CNN model, training and testing metrics and plots to the local workstation

Ramesh, Meghana↗
DOE OSTI2025

Vasomotion in Human Fingers

Introduction: We describe methods by which vasomotion can be recorded in awake and anesthetized human subjects without significant interference from other spontaneous vascular oscillations. Methods: In three separate studies, we used photoplethysmography (PPG) to record vasomotion in fingertips. In Study 1, we induced chemical sympathectomy in the studied hand of 11 awake subjects who received intravenous dexmedetomidine infusions. In Study 2, we administered four progressively increasing intravenous dexmedetomidine infusions to 16 awake volunteers. In Study 3, we recorded vasomotion simultaneously from 6 fingers of 7 patients who were under dexmedetomidine-based anesthesia. Five-minute epochs of PPG recordings that displayed slow vascular oscillations were analyzed for frequency and amplitude. Results: In Study 1, vasomotion frequencies were 0.025 ± 0.008 Hz. In Study 2, vasomotion frequencies were 0.033 ± 0.006 Hz, and 0.032 ± 0.008 Hz during the two highest dexmedetomidine infusion steps. In Study 3, vasomotion frequencies ranged from 0.020 to 0.037 Hz and were observed in all 6 fingers, with no synchrony between the six fingers. Conclusion: The vascular oscillations we observed without significant interference from other spontaneous oscillations are independent of neural activity (Study 1), local in nature (Study 3), and associated with alpha-2-adrenoceptor activation, consistent with known properties of vasomotion.

Cardiovascular System & Cardiology↗
DOE OSTI2023

The Future of Supercells in the United States

A supercell is a distinct type of intense, long-lived thunderstorm that is defined by its quasi-steady, rotating updraft. Supercells are responsible for most damaging hail and deadly tornadoes, causing billions of dollars in losses and hundreds of casualties annually. This research uses high-resolution, convection-permitting climate simulations across 15-yr epochs that span the twenty-first century to assess how supercells may change across the United States. Specifically, the study explores how late-twentieth-century supercell populations compare with their late-twenty-first-century counterparts for two—intermediate and pessimistic—anthropogenic climate change trajectories. An algorithm identifies, segments, and tracks supercells in the simulation output using updraft helicity, which measures the magnitude of corkscrew flow through a storm’s updraft and is a common proxy for supercells. Results reveal that supercells will be more frequent and intense in future climates, with robust spatiotemporal shifts in their populations. Supercells are projected to become more numerous in regions of the eastern United States, while decreasing in frequency in portions of the Great Plains. Supercell risk is expected to escalate outside of the traditional severe storm season, with supercells and their perils likely to increase in late winter and early spring months under both emissions scenarios. Conversely, the latter part of the severe storm season may be curtailed, with supercells expected to decrease midsummer through early fall. These results suggest the potential for more significant tornadoes, hail, and extreme rainfall that, when combined with an increasingly vulnerable society, may produce disastrous consequences.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Coastal Sea Level Observations Record the Twentieth-Century Enhancement of Decadal Climate Variability

Changes in the amplitude of decadal climate variability over the twentieth century have been noted, with most evidence derived from tropical Pacific sea surface temperature records. However, the length, spatial coverage, and stability of most instrumental records are insufficient to robustly identify such nonstationarity, or resolve its global spatial structure. Here, it is found that the long-term, stable, observing platform provided by tide gauges reveals a dramatic increase in the amplitude and spatial coherence of decadal (11–14-yr period) coastal sea level (ζ) variability between 1960 and 2000. During this epoch, western North American ζ was approximately out of phase with ζ in Sydney, Australia, and led northeastern U.S. ζ by approximately 1–2 years. The amplitude and timing of changes in decadal ζ variability in these regions are consistent with changes in atmospheric variability. Specifically, central equatorial Pacific wind stress and Labrador Sea heat flux are highly coherent and exhibit contemporaneous, order-of-magnitude increases in decadal power. These statistical relationships have a mechanistic underpinning: Along the western North American coastline, equatorial winds are known to drive rapidly propagating ζ signals along equatorial and coastal waveguides, while a 1–2-yr lag between Labrador Sea heat fluxes and northeastern United States ζ is consistent with a remotely forced, buoyancy-driven, mechanism. Tide gauges thus provide strong independent support for an increase in interbasin coherence on decadal time scales over the second half of the twentieth century, with implications for both the interpretation and prediction of climate and sea level variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Volcanic Imprints in Last-Millennium Land Summer Temperatures in the Circum-North Atlantic Area

Summer cooling is one of the most direct consequences of explosive volcanic eruptions that can affect ecosystems and human societies. Recent studies revealed a multiyear cooling impact on hemispheric and global summer temperatures after tropical eruptions, yet the volcanic responses appear to vary on regional scales. Here, in this work, we revisit volcano-induced summer cooling in eastern Canada and northern and central Europe by applying superposed epoch analysis on CMIP6-PMIP4 simulations and millennial temperature reconstructions based on tree-ring density. We then examine potential causes modulating region-specific volcanic impact. While confirming that, on average, tropical eruptions over the last millennium have induced a longer cooling (>4 yr) than eruptions from extratropical Northern Hemisphere in all three North Atlantic regions, we show that the peak magnitude of cooling is stronger in eastern Canada. We also find that the detected volcanic temperature anomalies can be strongly affected by the selection and number of volcanic events and nonvolcanic signals embedded in the climate time series. This study highlights the risks of using highly noisy proxy records to investigate volcanic impacts, especially in regions with strong unforced climate variability. The CMIP6-PMIP4 simulations generally agree with the three reconstructions on the average response to tropical eruptions, but their performance is poorer regarding the production of significant cooling after extratropical eruptions. Our results further suggest that the particular sensitivity to tropical eruptions in eastern Canada is likely related to increased sea ice surrounding Quebec–Labrador associated with the positive Arctic Oscillation and North Atlantic Oscillation formed during the first posteruption winter.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗
DOE OSTI2024

Development of message passing-based graph convolutional networks for classifying cancer pathology reports

Abstract Background Applying graph convolutional networks (GCN) to the classification of free-form natural language texts leveraged by graph-of-words features (TextGCN) was studied and confirmed to be an effective means of describing complex natural language texts. However, the text classification models based on the TextGCN possess weaknesses in terms of memory consumption and model dissemination and distribution. In this paper, we present a fast message passing network (FastMPN), implementing a GCN with message passing architecture that provides versatility and flexibility by allowing trainable node embedding and edge weights, helping the GCN model find the better solution. We applied the FastMPN model to the task of clinical information extraction from cancer pathology reports, extracting the following six properties: main site, subsite, laterality, histology, behavior, and grade. Results We evaluated the clinical task performance of the FastMPN models in terms of micro- and macro-averaged F1 scores. A comparison was performed with the multi-task convolutional neural network (MT-CNN) model. Results show that the FastMPN model is equivalent to or better than the MT-CNN. Conclusions Our implementation revealed that our FastMPN model, which is based on the PyTorch platform, can train a large corpus (667,290 training samples) with 202,373 unique words in less than 3 minutes per epoch using one NVIDIA V100 hardware accelerator. Our experiments demonstrated that using this implementation, the clinical task performance scores of information extraction related to tumors from cancer pathology reports were highly competitive.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

AbacusSummit Halo Light Cone Catalogs

This is a set of halo light cone catalogs from the AbacusSummit suite of cosmological N-body simulations (abacussummit.readthedocs.io/). They are a value-added data product provided by post-processing the simulation output. The main application of the halo light cone catalogs is the construction of realistic mock galaxy catalogues and weak lensing maps on the sky. The algorithm (described in Hadzhiyska et al. 2021) associates CompaSO halos from 29 redshift epochs spanning z = 0.1-2.5 with their particles at the time of light-cone crossing. It then records the halo and particle information into an easily accessible product, which can be read with the CompaSO reader. The 25 base resolution boxes at fiducial cosmology have a halo light cone catalog covering an octant of the sky to z approx 0.8 and about 2000 deg2 extending to z approx 2.4. The huge boxes provide light cone information of the full sky until z approx 2.18 and extend further towards the corners of the box (available until z = 2.25). Galaxy mock catalogs on the sky can be generated easily though the AbacusHOD script providing an extended HOD framework (see Yuan et al. 2021, for details), which has been modified to work with the halo light cone catalogs. The available tracers are luminous red galaxies (LRGs), emission-line galaxies (ELGs), and quasi-stellar objects (QSOs).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Data from: "Towards CONUS-Wide ML-Augmented Conceptually-Interpretable Modeling of Catchment-Scale Precipitation-Storage-Runoff Dynamics"

This data package was generated to support the manuscript “Towards CONUS-Wide Machine Learning-Augmented Conceptually Interpretable Modeling of Catchment-Scale Precipitation-Storage-Runoff Dynamics.” It provides input files, model outputs, plotting data, scripts, notebooks, and documentation used to develop, evaluate, and reproduce Mass-Conserving Perceptron (MCP)-based hydrologic modeling experiments across 513 selected Catchment Attributes and Meteorology for Large-sample Studies in the United States (CAMELS-US) basins. The files are organized by modeling component and analysis purpose, including rainfall–runoff experiments, snow module experiments, coupled hydrologic-snow experiments, Long Short-Term Memory (LSTM) benchmark results, model skill metrics, initialization and epoch records, cell-state normalization files, Akaike Information Criterion (AIC)-based model comparison files, and data used to generate manuscript figures. Tabular files can be opened using standard spreadsheet software or Python/R data-analysis tools. Python scripts, Jupyter notebooks, and selected MATLAB scripts are included for model execution, postprocessing, plotting, and statistical analysis. Quality assurance and quality control were conducted through the source-data selection and modeling workflow. Meteorological forcing, streamflow, and static catchment attributes were derived from the CAMELS-US dataset, and snow water equivalent data were derived from the University of Arizona (UA) Snow Water Equivalent dataset. Selected basins and time periods were screened during the associated research workflow to avoid missing observations or poor-quality cases. Static geospatial features were processed primarily using Quantum Geographic Information System (QGIS) and Geospatial Data Abstraction Library (GDAL) workflows. Additional details are provided in the associated manuscript and documentation.

ESS-DIVE CSV File Formatting Guidelines Reporting ↗
DOE OSTI2020

The First Three Seconds: a Review of Possible Expansion Histories of the Early Universe

It is commonly assumed that the energy density of the Universe was dominated by radiation between reheating after inflation and the onset of matter domination 54,000 years later. While the abundance of light elements indicates that the Universe was radiation dominated during Big Bang Nucleosynthesis (BBN), there is scant evidence that the Universe was radiation dominated prior to BBN. It is therefore possible that the cosmological history was more complicated, with deviations from the standard radiation domination during the earliest epochs. Indeed, several interesting proposals regarding various topics such as the generation of dark matter, matter-antimatter asymmetry, gravitational waves, primordial black holes, or microhalos during a nonstandard expansion phase have been recently made. In this paper, we review various possible causes and consequences of deviations from radiation domination in the early Universe - taking place either before or after BBN - and the constraints on them, as they have been discussed in the literature during the recent years.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Inventory of Public Key Cryptography in US Electric Vehicle Charging

Electric vehicles (EVs) and charging infrastructure are networked systems, which employ high-level communications in support of charging and grid service decisions. Public key cryptography (PKC) underlies much of the security and privacy protections of the information exchange. We are entering a new epoch where quantum computing threats must be seriously considered. A sufficiently large quantum computer, so named Cryptographically Relevant Quantum Computer (QRQC), will be able to perform the mathematical operations to efficiently attack the underpinnings of traditional PKC, thus jeopardizing the digital foundations for trust, communications security, and data security. Estimates suggest a QRQC can break public key encryption and digital signatures in the manner of tens to hundreds of hours, compared to traditional computing that would demand more than 10 18 years in a brute force-style attack. A consensus belief of quantum theorists, quantum experimenters, and cryptographers suggest that the quantum threat will be likely realized in the next twenty years. To address the threat, post-quantum cryptography, which is cryptosystems that are designed to be secure against both traditional and quantum computing threats, must be adopted. Migration from traditional PKC to quantum-resilient cryptography is a global undertaking and likely represents the largest transition in computing history. The nascent state of EV public key infrastructure, combined with limited adoption of the vehicle secure charging features, presents an opportunity to establish a preference for quantum-resistant cryptography as a step on the migration path. Delays will stunt the efforts as rapidly accelerating EVs sales and huge infrastructure investments will create large growing bases of long-lived vehicles and infrastructure. Migration preparations can commence while NIST continues the process to standardize post-quantum cryptography (PQC), which are quantum-resilient algorithms designed to be secure against traditional and quantum computing threats. The first step in preparing EV charging is to identify the presence of traditional public key cryptography algorithms and applications. With this objective in mind, this report is intended to advise the vehicle manufacturers, charging station manufacturers, charging station operators, charge network providers and other EV charging stakeholders with information on traditional PKC application and the potential risks when PKC becomes insecure. This report, the first in a series of reports discussing the topics existing at the confluence of post-quantum cryptography adoption and EV charging, identifies traditional public key applications employed and identifies potential consequences of leaving EV charging infrastructure vulnerable to quantum computing. The focus remains squarely on the of EV charging and infrastructure with respect to PKC and is believed by the authors to complement the NIST SP 1800-38 Migration to Post-Quantum Cryptography. While the report is centered on infrastructure, there are implications to vehicles.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

PRIME - A Software Toolkit for the Characterization of Partially Observed Epidemics in a Bayesian Framework

PRIME is a modeling framework designed for the “real-time’” characterization and forecasting of partially observed epidemics. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. We include examples using publicly available COVID-19 data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

AI-Assisted Conceptual Development of a Pre-Geometric Cosmological Model - An Exercise in AI-Assisted Conceptual Framework Generation, Paper III: Cosmological Structure and Predictions

This paper develops the cosmological consequences of the replication-driven cosmogenesis framework introduced in Paper I and the emergent geometric structure established in Paper II. After the replication epoch freezes out, the coherent sector occupies a finite spectral band and contains a population of excited states. The relaxation of these excited coherent configurations does not produce coherent radiation; instead, all released energy flows into the incoherent substrate, where the randomizer acts as a rapid phase-scrambling mechanism. This process generates an effectively thermal radiation bath, providing a natural reheating mechanism that requires neither inflaton oscillations nor scalar-field potentials, and can be contrasted with standard scenarios of nonperturbative reheating dynamics. Subsequent symmetry-breaking transitions in the coherent vacuum inject additional radiation, yielding a multi-stage thermal history with well-defined energy transfers. We derive the effective equations of state for each component—the cosmological vacuum, the coherent vacuum, and the radiation bath—and show how their interplay produces an FRW-like expansion. The discrete sequence of coherent-state relaxations imprints a distinctive multi-peaked stochastic gravitational-wave background, whose spectral structure reflects the underlying hierarchy of coherent frequencies. Potential observational signatures in the LISA and mid-band frequency ranges are highlighted, providing concrete avenues to test this replication-based cosmological framework in the context of standard cosmological gravitational-wave backgrounds and LISA-oriented forecasts.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

In situ Parallel Training of Analog Neural Network Using Electrochemical Random-Access Memory

In-memory computing based on non-volatile resistive memory can significantly improve the energy efficiency of artificial neural networks. However, accurate in situ training has been challenging due to the nonlinear and stochastic switching of the resistive memory elements. One promising analog memory is the electrochemical random-access memory (ECRAM), also known as the redox transistor. Its low write currents and linear switching properties across hundreds of analog states enable accurate and massively parallel updates of a full crossbar array, which yield rapid and energy-efficient training. While simulations predict that ECRAM based neural networks achieve high training accuracy at significantly higher energy efficiency than digital implementations, these predictions have not been experimentally achieved. In this work, we train a 3 × 3 array of ECRAM devices that learns to discriminate several elementary logic gates (AND, OR, NAND). We record the evolution of the network’s synaptic weights during parallel in situ (on-line) training, with outer product updates. Due to linear and reproducible device switching characteristics, our crossbar simulations not only accurately simulate the epochs to convergence, but also quantitatively capture the evolution of weights in individual devices. The implementation of the first in situ parallel training together with strong agreement with simulation results provides a significant advance toward developing ECRAM into larger crossbar arrays for artificial neural network accelerators, which could enable orders of magnitude improvements in energy efficiency of deep neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Enabling real-time adaptation of machine learning models at x-ray Free Electron Laser facilities with high-speed training optimized computational hardware

The emergence of novel computational hardware is enabling a new paradigm for rapid machine learning model training. For the Department of Energy’s major research facilities, this developing technology will enable a highly adaptive approach to experimental sciences. In this manuscript we present the per-epoch and end-to-end training times for an example of a streaming diagnostic that is planned for the upcoming high-repetition rate x-ray Free Electron Laser, the Linac Coherent Light Source-II. We explore the parameter space of batch size and data parallel training across multiple Graphics Processing Units and Reconfigurable Dataflow Units. We show the landscape of training times with a goal of full model retraining in under 15 min. Although a full from scratch retraining of a model may not be required in all cases, we nevertheless present an example of the application of emerging computational hardware for adapting machine learning models to changing environments in real-time, during streaming data acquisition, at the rates expected for the data fire hoses of accelerator-based user facilities.

97 MATHEMATICS AND COMPUTING↗