Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Trains”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Efficient I/O for Neural Network Training with Compressed Data

FanStore is a shared object store that enables efficient and scalable neural network training on supercomputers. By providing a global cache layer on node-local burst buffers using a compressed representation, it significantly enhances the processing capability of deep learning (DL) applications on existing hardware. In addition, FanStore allows POSIX-compliant file access to the compressed data in user space. We investigate the tradeoff between runtime overhead and data compression ratio using real-world datasets and applications, and propose a compressor selection algorithm to maximize storage capacity given performance constraints. We consider both asynchronous (i.e., with prefetching) and synchronous I/O strategies, and propose mechanisms for selecting compressors for both approaches. Using FanStore, the same storage hardware can host 2-13x more data for example applications without significant runtime overhead. Empirically, our experiments show that FanStore scales to 512 compute nodes with near linear performance scalability.

Zhang, Zhao↗
DOE OSTI2024

Adaptive Quantum Generative Training using an Unbounded Loss Function

We propose a generative quantum learning algorithm using the Adaptive Derivative-Assembled Problem Tailored ansatz (ADAPT) framework in which the loss function to be minimized is the maximal quantum Rényi divergence of order two, an unbounded function that mitigates barren plateaus which inhibit training variational circuits. We benchmark this method against other state-of-the-art adaptive algorithms by learning random two-local thermal states. We perform numerical experiments of up to 12 qubits comparing our method learning algorithms that use linear objective functions and show that Rényi-ADAPT is capable of constructing shallow quantum circuits competitive with existing methods, while the gradients remain favorable resulting from the maximal Rényi divergence loss function.

quantum algorithms, quantum machine learning, quan↗
DOE OSTI2024

An Efficient Checkpointing System for Large Machine Learning Model Training

As machine learning models increase in size and complexity rapidly, the cost of checkpointing in ML training became a bottleneck in storage and performance (time). For example, the latest GPT-4 model has massive parameters at the scale of 1.76 trillion. It is highly time and storage consuming to frequently writes the model to checkpoints with more than 1 trillion floating point values to storage. This work aims to understand and attempt to mitigate this problem. First, we characterize the checkpointing interface in a collection of representative large machine learning/language models with respect to storage consumption and performance overhead. Second, we propose the two optimizations: i) A periodic cleaning strategy that periodically cleans up outdated checkpoints to reduce the storage burden; ii) A data staging optimization that coordinates checkpoints between local and shared file systems for performance improvement.

machine learning, artificial intelligence↗
DOE OSTI2024

Assessment of Training Performance, Degradation and Robustness of Paraffin-Wax Impregnated Nb 3 Sn Demonstrator Under High Magnetic Field

In the context of high-energy physics, the use of Nb 3 Sn superconducting magnets as a cost-effective and reliable technology depends on improvements in the following areas: long development and manufacturing cycles, conductor degradation after thermal cycling, long training, as well as a demonstration in accelerator magnets with a beam aperture of the full potential of modern Nb 3 Sn conductors. In short, performance, robustness, and cost are the three issues to be addressed. The Magnet Development project (MagDev) of the Swiss Accelerator Research and Technology initiative (CHART) at the Paul Scherrer Institute (PSI) aims to contribute to the solutions to each of these issues, re-thinking the manufacturing and design process. Here in our program, every innovation is to be validated by means of a panoply of fast-turnaround tools: from non-powered and powered samples and coils, tested under background field, to low-field subscale magnets and high field short prototypes. This work presents one element in this panoply of R&D vehicles: a stress-managed Nb 3 Sn coil called BigBOX, impregnated with paraffin wax, and tested, through a collaboration with the Magnet Development Program of the United States (US-MDP), in the background field of Brookhaven National Laboratory (BNL)’s common coils dipole DCC17.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Quantitative cross-species translators of cardiac myocyte electrophysiology: Model training, experimental validation, and applications

Animal experimentation is key in the evaluation of cardiac efficacy and safety of novel therapeutic compounds. However, interspecies differences in the mechanisms regulating excitation-contraction coupling can limit the translation of experimental findings from animal models to human physiology and undermine the assessment of drugs’ efficacy and safety. Here, we built a suite of translators for quantitatively mapping electrophysiological responses in ventricular myocytes across species. We trained these statistical operators using a broad dataset obtained by simulating populations of our biophysically detailed computational models of action potential and Ca 2+ transient in mouse, rabbit, and human. We then tested our translators against experimental data describing the response to stimuli, such as ion channel block, change in beating rate, and β-adrenergic challenge. We demonstrate that this approach is well suited to predicting the effects of perturbations across different species or experimental conditions and suggest its integration into mechanistic studies and drug development pipelines.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Mixture density network estimation of continuous variable maximum likelihood using discrete training samples

Abstract Mixture density networks (MDNs) can be used to generate posterior density functions of model parameters $$\varvec{\theta }$$ θ given a set of observables $${\mathbf {x}}$$ x . In some applications, training data are available only for discrete values of a continuous parameter $$\varvec{\theta }$$ θ . In such situations, a number of performance-limiting issues arise which can result in biased estimates. We demonstrate the usage of MDNs for parameter estimation, discuss the origins of the biases, and propose a corrective method for each issue.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Distributed Training and Optimization of Neural Networks

Deep learning models are yielding increasingly better performances thanks to multiple factors. To be successful, model may have large number of parameters or complex architectures and be trained on large dataset. This leads to large requirements on computing resource and turn around time, even more so when hyperparameter optimization is done (e.g. search over model architectures). While this is a challenge that goes beyond particle physics, we review the various ways to do the necessary computations in parallel, and put it in the context of high-energy physics.

Vlimant, Jean-Roch↗
DOE OSTI2021

Confronting Domain Shift in Trained Neural Networks

SAND2021-15138 O This code accompanies a paper published in the Proceedings of Machine Learning Research (PMLR), “Confronting Domain Shift in Trained Neural Networks.” Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Martinez, Carianne↗
DOE OSTI2024

Efficient training of physics-informed neural networks

Open-source software package designed for the efficient training of Physics-Informed Neural Networks (PINNs) and their variants, integrating advanced methodologies such as adaptive weighting and adaptive sampling

Chen, Wenqian [Pacific Northwest National Laborato↗
DOE OSTI2025

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) v1

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) is a comprehensive data visualization and analysis application focused on working with COLTRIMS (COLd Target Recoil Ion Momentum Spectroscopy) data, which is used in atomic and molecular physics experiments. The application offers several powerful features: - Data uploading and processing capabilities for COLTRIMS files - Multiple visualization methods using UMAP (Uniform Manifold Approximation and Projection) for dimensionality reduction - Interactive selection of data points across multiple views - Feature engineering through various methods: - Manual feature selection from calculated physics parameters - Deep autoencoder for dimension reduction - Genetic programming for discovering meaningful features - Mutual information-based feature selection - Multiple clustering approaches (DBSCAN, KMeans, Agglomerative) - Quality metrics for evaluating clustering results - Export capabilities for selections and generated features

Daoud, Hazem [Lawrence Berkeley National Laborator↗
DOE OSTI2023

Deep Learning Parameterization of Vertical Wind Velocity Variability via Constrained Adversarial Training

Atmospheric models with typical resolution in the tenths of kilometers cannot resolve the dynamics of air parcel ascent, which varies on scales ranging from tens to hundreds of meters. Small-scale wind fluctuations are thus characterized by a subgrid distribution of vertical wind velocity W with standard deviation σ W . The parameterization of σ W is fundamental to the representation of aerosol–cloud interactions, yet it is poorly constrained. Using a novel deep learning technique, this work develops a new parameterization for σ W merging data from global storm-resolving model simulations, high-frequency retrievals of W , and climate reanalysis products. The parameterization reproduces the observed statistics of σ W and leverages learned physical relations from the model simulations to guide extrapolation beyond the observed domain. Incorporating observational data during the training phase was found to be critical for its performance. The parameterization can be applied online within large-scale atmospheric models, or offline using output from weather forecasting and reanalysis products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Dataset: Breaking the barrier of human-annotated training data for machine-learning-aided plant research using aerial imagery

This dataset supports the implementation described in the manuscript "Breaking the Barrier of Human-Annotated Training Data for Machine-Learning-Aided Biological Research Using Aerial Imagery." It comprises UAV aerial imagery used to execute the code available at https://github.com/pixelvar79/GAN-Flowering-Detection-paper. For detailed information on dataset usage and instructions for implementing the code to reproduce the study, please refer to the GitHub repository.

generative and adversarial learning↗
DOE OSTI2026

EMT Workshop Pre-session

The dataset contains installation instructions for the EMT Workshop 2026 with a python script and PSCAD file for verification of installation for the participants.

Sahu, Vibhuti [ORNL] (ORCID:000000034808527X)↗