Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

A Path Towards Quantum Advantage in Training Deep Generative Models with Quantum Annealing

A class of quantum-classical hybrid machine-learning algorithms can be obtained by integrating classical deep generative models with quantum probability distributions as 'priors' over their latent variables. We introduce a hybrid implementation of variational autoencoders (QVAE) and also present a technique to hybridize flow-based invertible generative models. We demonstrate the use of D-Wave quantum annealers as physical simulators of quantum Boltzmann machines (QBM) to perform quantum-assisted training of QVAE. Latent-space QBM develop slowly mixing modes, opening a path to obtain quantum advantage in generative modeling with available quantum devices.

Vinci, Walter↗
NASA NTRS2016

Promoting A-Priori Interoperability of HLA-Based Simulations in the Space Domain: The SISO Space Reference FOM Initiative

Distributed and Real-Time Simulation plays a key-role in the Space domain being exploited for missions and systems analysis and engineering as well as for crew training and operational support. One of the most popular standards is the 1516-2010 IEEE Standard for Modeling and Simulation (M&S) High Level Architecture (HLA). HLA supports the implementation of distributed simulations (called Federations) in which a set of simulation entities (called Federates) can interact using a Run-Time Infrastructure (RTI). In a given Federation, a Federate can publish and/or subscribes objects and interactions on the RTI only in accordance with their structures as defined in a FOM (Federation Object Model). Currently, the Space domain is characterized by a set of incompatible FOMs that, although meet the specific needs of different organizations and projects, increases the long-term cost for interoperability. In this context, the availability of a reference FOM for the Space domain will enable the development of interoperable HLA-based simulators for related joint projects and collaborations among worldwide organizations involved in the Space domain (e.g. NASA, ESA, Roscosmos, and JAXA). The paper presents a first set of results achieved by a SISO standardization effort that aims at providing a Space Reference FOM for international collaboration on Space systems simulations.

Moller, Bjorn↗
DOE OSTI2024

Neural network denoising of x-ray images from high-energy-density experiments

Noise is a consistent problem for x-ray transmission images of High-Energy-Density (HED) experiments because it can significantly affect the accuracy of inferring quantitative physical properties from these images. We consider experiments that use x-ray area backlighting to image a thin layer of opaque material within a physics package to observe its hydrodynamic evolution. The spatial variance of the x-ray transmission across the system due to changing opacity serves as an analog for measuring density in this evolving layer. The noise in these images adds nonphysical variations in measured intensity, which can significantly reduce the accuracy of our inferred densities, particularly at small spatial scales. Denoising these images is thus necessary to improve our quantitative analysis, but any denoising method also affects the underlying information in the image. In this paper, we present a method for denoising HED x-ray images via a deep convolutional neural network model with a modified DenseNet architecture. In our denoising framework, we estimate the noise present in the real (data) images of interest and apply the inferred noise distribution to a set of natural images. These synthetic noisy images are then used to train a neural network model to recognize and remove noise of that character. We show that our trained denoiser network significantly reduces the noise in our experimental images while retaining important physical features.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

The Pixel Anomaly Detection Tool : a user-friendly GUI for classifying detector frames using machine-learning approaches

Data collection at X-ray free electron lasers has particular experimental challenges, such as continuous sample delivery or the use of novel ultrafast high-dynamic-range gain-switching X-ray detectors. This can result in a multitude of data artefacts, which can be detrimental to accurately determining structure-factor amplitudes for serial crystallography or single-particle imaging experiments. Here, a new data-classification tool is reported that offers a variety of machine-learning algorithms to sort data trained either on manual data sorting by the user or by profile fitting the intensity distribution on the detector based on the experiment. This is integrated into an easy-to-use graphical user interface, specifically designed to support the detectors, file formats and software available at most X-ray free electron laser facilities. The highly modular design makes the tool easily expandable to comply with other X-ray sources and detectors, and the supervised learning approach enables even the novice user to sort data containing unwanted artefacts or perform routine data-analysis tasks such as hit finding during an experiment, without needing to write code.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

PickerXL, A Large Deep Learning Model to Measure Arrival Times from Noisy Seismic Signals

Precisely measuring seismic arrival times is a labor-intensive task but is critical for both earthquake monitoring and subsurface imaging. Recently published deep learning models have demonstrated superior performance compared to traditional automatic approaches for picking arrival times. Although existing deep learning models have shown promising results, further advancements are necessary as their performance is not yet satisfactory especially when applied to new regions and station networks. Increasing model size has led to improved performance in other machine learning applications. Here, we aimed to investigate whether enlarging deep learning models can increase performance on accepted benchmarks. We trained three models of varying sizes, small (1X), medium (4X), and large (16X), using globally distributed local and regional earthquake signals and background noise waveforms from a benchmark dataset, Stanford Earthquake Dataset. Our results indicate that the largest model (PickerXL) outperforms both the smaller models and Seisbench implementation of the PhaseNet model, which has the same number of parameters as our small model. The PickerXL model’s enhanced capacity to extract complex patterns from seismograms contributes to its superior arrival picking abilities compared to the smaller model.

Chai, Chengping [Oak Ridge National Laboratory (OR↗
DOE OSTI2021

Project 57 Air Monitoring Report: January 1 through December 31, 2019

On April 24, 1957, the Atomic Energy Commission (AEC) (now the Department of Energy [DOE]) conducted the Project 57 safety experiment in western Emigrant Valley northeast of the Nevada National Security Site (NNSS) (formerly the Nevada Test Site) on lands withdrawn by the Department of Defense (DOD) for the Nevada Test and Training Range (NTTR). The test was performed to (1) assess a technique for estimating plutonium distribution resulting from a nonnuclear detonation, (2) develop biomedical evaluation techniques for use in plutonium-laden environments, (3) evaluate methods of surface decontamination, and (4) evaluate instruments and field procedures for the prompt estimation of alpha contamination (Shreve, 1958). Although the test did not result in the fission of nuclear materials, it did disseminate plutonium across the land surface. Following the experiment, the AEC fenced the contaminated area and returned control of the surrounding land to the DOD. Various radiological surveys were performed in the area and the DOE expanded the demarked Contamination Area (CA) in 2007 by posting signs 200 ft to 400 ft (60 m to 120 m) outside of the original fence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Grid-Integrated Production of Fischer-Tropsch Synfuels from Nuclear Power

Idaho National Laboratory (INL) investigates the relative economic profitability of an integrated energy system (IES) coupling an NPP with a synfuel production process at selected case study locations across the United States. In the synfuel IES, a high-temperature steam electrolysis (HTSE) plant is thermally and electrically coupled with an NPP to produce zero-carbon hydrogen. The synthetic fuel is produced from this H 2 combined with a CO 2 supply using the reverse water gas shift process followed by the Fischer-Tropsch (FT) reaction. This analysis considers a system in which the CO 2 is sourced from regional CO 2 emitters via the construction and operation of pipeline-based CO 2 supply networks. Locating the FT plant at the same site as the NPP and HTSE plants enables the NPP to provide zero-carbon heat and power to the HTSE plant and zero-carbon power to the FT plant as well as avoid the requirement for long-distance H 2 product transport from the HTSE plant to the FT plant. Hydrogen storage is used to enable the NPP to dispatch power to the electrical grid (instead of the HTSE plant) when grid demand increases, thus enabling the FT plant to continue to operate in a steady-state production mode. The ability to cease hydrogen production for several hours within each day enables the NPP to provide power to the grid to balance the electricity market during peak periods and maximize revenues for the nuclear synfuel IES. The FT process design considered has a 99% carbon conversion efficiency. The use of nuclear energy and nuclear energy-derived hydrogen enables synfuel production to achieve this high level of carbon utilization. Additionally, the life-cycle carbon emissions of the nuclear-based synfuel production process are very low, with WTW emissions of approximately 25 gCO 2 e/MJ, including steam credits (generated from FT process excess heat), and approximately 7 gCO 2 e/MJ, if steam credits are excluded. This compares favorably with the WTW emissions of 90.5 gCO 2 e/MJ for a compression-ignition, direct injection (CIDI) vehicle with a fuel economy of 31.6 miles per gallon gasoline equivalent (MPGGE), using low-sulfur diesel produced using conventional petroleum production and refining processes. Several NPPs in various regions of the U.S. are considered as case study analyses. Supply locations and transportation via pipeline of the CO 2 feedstock to the NPP site are analyzed through the National Energy Technology Laboratory (NETL) CO 2 Transport Cost model. The team finds that the amount of CO 2 generated by different sectors is sufficient for the synfuel production process at all locations considered. The CO 2 transportation costs are functions of the distance of the source to the NPP location, the CO 2 capture cost at the source, and the quantity of CO 2 transported. Historical electricity prices for the NPP case study locations are collected and analyzed. Monthly average prices, price range, and duration of negative-price periods vary among these locations. For each location, an auto-regressive moving average (ARMA) model is trained on historical electricity price data. ARMA validation is done to ensure the synthetic price distributions represent one of historical prices with high fidelity. Synthetic time series from these ARMA models are used in a coupled dispatch and system optimization in the Holistic Energy Resource Optimization Network (HERON) to compute the differential net present value (NPV) of the IES. The team finds that this econometric is positive, ranging from $14M–1.3bn (2020) depending on the location. The optimal synfuel IES configuration to obtain this increase in NPV often maximizes the size of the synfuel production process with regards to the size of the NPP. However, the team shows that the NPP still plays a stabilizing role for the grid: In periods of high prices and high loads, more electricity from the NPP is sent to the grid. A high variability of electricity prices and extreme maximum prices tend to drive up electricity production. While it requires significant investment, the synfuel IES could increase the economic profitability for the existing fleet of LWRs across the country while still maintaining the grid stabilizer role of NPPs. During its lifetime, the main costs for the nuclear synfuel IES are the carbon feedstock transportation costs, followed by the capital expenses (CAPEX) and operation and maintenance (O&M) costs while the revenue comes first from the IRA H 2 production tax credit (PTC) and then from the sales of synfuel products. The profitability of the synfuel IES is most sensitive to the value of the hydrogen PTC and the synfuel products as well as the cost of the carbon feedstock, highlighting the importance of governmental incentives regarding hydrogen, carbon emissions, and synfuel in driving the deployment of future nuclear synfuel IESs.

08 HYDROGEN↗
NASA NTRS1975

Information/user services, summary

Various aspects of the technology which are available to users now are described. Specific topics discussed include: data distribution: availability of and access to data; technology transfer: system use illustrations and availability of training; hardware systems descriptions: processing hardware constructed and available; data processing techniques: individual processing techniques; and future developments: a sampling of future technology.

Landgrebe, D. A.↗
NASA NTRS1976

Evaluation of algorithms for estimating wheat acreage from multispectral scanner data

The author has identified the following significant results. Fourteen different classification algorithms were tested for their ability to estimate the proportion of wheat in an area. For some algorithms, accuracy of classification in field centers was observed. The data base consisted of ground truth and LANDSAT data from 55 sections (1 x 1 mile) from five LACIE intensive test sites in Kansas and Texas. Signatures obtained from training fields selected at random from the ground truth were generally representative of the data distribution patterns. LIMMIX, an algorithm that chooses a pure signature when the data point is close enough to a signature mean and otherwise chooses the best mixture of a pair of signatures, reduced the average absolute error to 6.1% and the bias to 1.0%. QRULE run with a null test achieved a similar reduction.

Nalepka, R. F.↗
NASA NTRS2005

Elastic-Tether Suits for Artificial Gravity and Exercise

Body suits harnessed to systems of elastic tethers have been proposed as means of approximating the effects of normal Earth gravitation on crewmembers of spacecraft in flight to help preserve the crewmembers physical fitness. The suits could also be used on Earth to increase effective gravitational loads for purposes of athletic training. The suit according to the proposal would include numerous small tether-attachment fixtures distributed over its outer surface so as to distribute the artificial gravitational force as nearly evenly as possible over the wearer s body. Elastic tethers would be connected between these fixtures and a single attachment fixture on a main elastic tether that would be anchored to a fixture on or under a floor. This fixture might include multiple pulleys to make the effective length of the main tether great enough that normal motions of the wearer cause no more than acceptably small variations in the total artificial gravitational force. Among the problems in designing the suit would be equalizing the load in the shoulder area and keeping tethers out of the way below the knees to prevent tripping. The solution would likely include running tethers through rings on the sides. Body suits with a weight or water ballast system are also proposed for very slight spinning space-station scenarios, in which cases the proposed body suits will easily be able to provide the equivalency of a 1-G or even greater load.

Torrance, Paul↗
DOE OSTI2023

A Search for Heavy Neutral Leptons Decaying to Electron-Positron Pairs and Neutral Pions in the MicroBooNE Detector

This thesis presents a search for heavy neutral leptons (HNLs) decaying inside the MicroBooNE detector. The MicroBooNE detector is a liquid-argon time projection chamber located at Fermilab that receives flux from two neutrino beams; the booster neutrino beam (BNB) and the neutrinos at the main injector (NuMI) beam. The search uses data taken when the NuMI beam was on, with a total exposure of $7.01\times10^{20}$ protons on target. HNLs would be produced in kaon decays, and the source of HNLs targeted in this search is kaons decaying at rest in the NuMI hadron absorber. The kinematics of the HNLs produced in this way allow their decays to be distinguished from the majority of beam-neutrino interactions and cosmic-ray activity that constitute the background. Two HNL decay channels are studied, $\nu$\ee and \vpi. Boosted decision trees (BDTs) are trained to separate the simulated HNL decays from the expected background events. The BDT score distributions are used to calculate upper limits on the mixing angle \umusq in the mass range $10\le m_{\rm HNL}\le 245$~MeV. This is the first direct search for HNL decays to the \vpi channel, and the limits provide the most stringent constraints on \umusq in the mass range $35<\mhnl<175$~MeV.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Radiation Simulation using Wi-Fi Signal Strength and Frequency

For routine radiological operations, lost radioactive sources, decommissioning and cleanup of nuclear facilities, and radiological terrorist events such as Radioactive Dispersive Devices (RDDs) or Radiological Exposure Devices (REDs), individuals are tasked with accurately locating both point and distributed sources of radiation. Radiation workers must often practice these tasks, whether part of initial training or periodically as part of formal or informal exercises or drills. In such circumstances, it is desirable to have an accurate recreation of a radioactive source, including a method of detecting it, which does not include dangerous amounts of radiation. The goal of this research was to develop a radiation simulation technology that uses IEEE 802.11x W-LAN protocol, i.e. Wi-Fi sources and detectors for these, as an inexpensive, precise and accurate method of replicating sources of gamma radiation. For this work, existing 802.11x sources were used. Software was developed for use with an Android smartphone to detect the presence of these sources. The measurements followed the expected behavior as a function of distance from the sources, mimicking that of gamma radiation, thus demonstrating the fundamental principle of operation. The ultimate system will be used in an outreach program to interest students in the radiation protection field.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2025

FedOSAA: Improving Federated Learning with One-Step Anderson Acceleration

Federated learning (FL) is a distributed machine learning approach that enables multiple local clients and a central server to collaboratively train a model while keeping the data on their own devices. First-order methods, particularly those incorporating variance reduction techniques, are the most widely used FL algorithms due to their simple implementation and stable performance. However, these methods tend to be slow and require a large number of communication rounds to reach the global minimizer. We propose FedOSAA, a novel approach that preserves the simplicity of first-order methods while achieving the rapid convergence typically associated with second-order methods. Our approach applies one Anderson acceleration (AA) step following classical local updates based on first-order methods with variance reduction, such as FedSVRG and SCAFFOLD, during local training. This AA step is able to leverage curvature information from the history points and gives a new update that approximates the Newton-GMRES direction, thereby significantly improving the convergence. We establish a local linear convergence rate to the global minimizer of FedOSAA for smooth and strongly convex loss functions. Numerical comparisons show that FedOSAA substantially improves the communication and computation efficiency of the original first-order methods, achieving performance comparable to second-order methods like GIANT.

Feng, Xue [University of California, Davis]↗
DOE OSTI2021

Fast and accurate learned multiresolution dynamical downscaling for precipitation

Abstract. This study develops a neural-network-based approach for emulating high-resolution modeled precipitation data with comparable statistical properties but at greatly reduced computational cost. The key idea is to use combination of low- and high-resolution simulations (that differ not only in spatial resolution but also in geospatial patterns) to train a neural network to map from the former to the latter. Specifically, we define two types of CNNs, one that stacks variables directly and one that encodes each variable before stacking, and we train each CNN type both with a conventional loss function, such as mean square error (MSE), and with a conditional generative adversarial network (CGAN), for a total of four CNN variants. We compare the four new CNN-derived high-resolution precipitation results with precipitation generated from original high-resolution simulations, a bilinear interpolater and the state-of-the-art CNN-based super-resolution (SR) technique. Results show that the SR technique produces results similar to those of the bilinear interpolator with smoother spatial and temporal distributions and smaller data variabilities and extremes than the original high-resolution simulations. While the new CNNs trained by MSE generate better results over some regions than the interpolator and SR technique do, their predictions are still biased from the original high-resolution simulations. The CNNs trained by CGAN generate more realistic and physically reasonable results, better capturing not only data variability in time and space but also extremes such as intense and long-lasting storms. The new proposed CNN-based downscaling approach can downscale precipitation from 50 to 12 km in 14 min for 30 years once the network is trained (training takes 4 h using 1 GPU), while the conventional dynamical downscaling would take 1 month using 600 CPU cores to generate simulations at the resolution of 12 km over the contiguous United States.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

ML-Based Pebble Power Reconstruction for Pebble Bed Reactor Analysis

Pebble power reconstruction has been explored to complement the conventional homogenized modeling approach in pebble bed reactor (PBR) analysis, as detailed heterogeneous geometry calculations are computationally expensive. The random distribution of pebble fuels within the core challenges the application of conventional pin power reconstruction methods. To address this, we introduce a machine learning approach based on the transformer model, composed of encoder and decoder layers, to estimate the flux and power form functions for reconstructing individual pebble neutron fluxes and powers. The homogeneous neutron flux distribution within each spectral zone (SZ) is obtained from finite element solutions of global diffusion or transport calculations. Verification tests demonstrate that the trained transformer model accurately predicts power form functions over a range of conditions, including variations in pebble enrichment, location, type, SZ size, and burnup. In particular, verification using a three-dimensional PBR benchmark with burned pebbles shows good agreement in heterogeneous pebble power distributions between Griffin and Serpent. These results highlight the potential of applying conventional pin power reconstruction approaches to PBR cores with randomly distributed pebbles.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

QuantumNAT: quantum noise-aware training with noise injection, quantization and normalization

Parameterized Quantum Circuits (PQC) are promising towards quantum advantage on near-term quantum hardware. However, due to the large quantum noises (errors), the performance of PQC models has a severe degradation on real quantum devices. Take Quantum Neural Network (QNN) as an example, the accuracy gap between noise-free simulation and noisy results on IBMQ-Yorktown for MNIST-4 classification is over 60%. Existing noise mitigation methods are general ones without leveraging unique characteristics of PQC; on the other hand, existing PQC work does not consider noise effect. To this end, we present QuantumNAT, a PQC-specific framework to perform noise-aware optimizations in both training and inference stages to improve robustness. We experimentally observe that the effect of quantum noise to PQC measurement outcome is a linear map from noise-free outcome with a scaling and a shift factor. Motivated by that, we propose post-measurement normalization to mitigate the feature distribution differences between noise-free and noisy scenarios. Furthermore, to improve the robustness against noise, we propose noise injection to the training process by inserting quantum error gates to PQC according to realistic noise models of quantum hardware. Lastly, post-measurement quantization is introduced to quantize the measurement outcomes to discrete values, achieving the denoising effect. Extensive experiments on 8 classification tasks using 6 quantum devices demonstrate that QuantumNAT improves accuracy by up to 43%, and achieves over 94% 2-class, 80% 4-class, and 34% 10-class classification accuracy measured on real quantum computers. The code for construction and noise-aware training of PQC is available in the TorchQuantum library.

Wang, Hanrui↗
DOE OSTI2022

Extending the SAGA Survey (xSAGA). I. Satellite Radial Profiles as a Function of Host-galaxy Properties

We present "Extending the Satellites Around Galactic Analogs Survey" (xSAGA), a method for identifying low-z galaxies on the basis of optical imaging and results on the spatial distributions of xSAGA satellites around host galaxies. Using spectroscopic redshift catalogs from the SAGA Survey as a training data set, we have optimized a convolutional neural network (CNN) to identify z < 0.03 galaxies from more-distant objects using image cutouts from the DESI Legacy Imaging Surveys. From the sample of >100,000 CNN-selected low-z galaxies, we identify >20,000 probable satellites located between 36–300 projected kpc from NASA-Sloan Atlas central galaxies in the stellar-mass range $9.5\lt \mathrm{log}({M}_{\star }/{M}_{\odot })\lt 11$. We characterize the incompleteness and contamination for CNN-selected samples and apply corrections in order to estimate the true number of satellites as a function of projected radial distance from their hosts. Satellite richness depends strongly on host stellar mass, such that more-massive host galaxies have more satellites, and on host morphology, such that elliptical hosts have more satellites than disky hosts with comparable stellar masses. We also find a strong inverse correlation between satellite richness and the magnitude gap between a host and its brightest satellite. The normalized satellite radial distribution between 36–300 kpc does not depend on host stellar mass, morphology, or magnitude gap. The satellite abundances and radial distributions we measure are in reasonable agreement with predictions from hydrodynamic simulations. Our results deliver unprecedented statistical power for studying satellite galaxy populations and highlight the promise of using machine-learning for extending galaxy samples of wide-area surveys.

79 ASTRONOMY AND ASTROPHYSICS↗