SEARCH · Engineering Papers

Results for “Training Time”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Scalable algorithms for physics-informed neural and graph networks

Physics-informed machine learning (PIML) has emerged as a promising new approach for simulating complex physical and biological systems that are governed by complex multiscale processes for which some data are also available. In some instances, the objective is to discover part of the hidden physics from the available data, and PIML has been shown to be particularly effective for such problems for which conventional methods may fail. Unlike commercial machine learning where training of deep neural networks requires big data, in PIML big data are not available. Instead, we can train such networks from additional information obtained by employing the physical laws and evaluating them at random points in the space–time domain. Such PIML integrates multimodality and multifidelity data with mathematical models, and implements them using neural networks or graph networks. Here, we review some of the prevailing trends in embedding physics into machine learning, using physics-informed neural networks (PINNs) based primarily on feed-forward neural networks and automatic differentiation. For more complex systems or systems of systems and unstructured data, graph neural networks (GNNs) present some distinct advantages, and here we review how physics-informed learning can be accomplished with GNNs based on graph exterior calculus to construct differential operators; we refer to these architectures as physics-informed graph networks (PIGNs). We present representative examples for both forward and inverse problems and discuss what advances are needed to scale up PINNs, PIGNs and more broadly GNNs for large-scale engineering problems.

42 ENGINEERING↗

DOE OSTI2020

Attosecond pulse shaping using a seeded free-electron laser

Attosecond pulses are central to the investigation of valence- and core-electron dynamics on their natural timescales. The reproducible generation and characterization of attosecond waveforms has been demonstrated so far only through the process of high-order harmonic generation. Several methods for shaping attosecond waveforms have been proposed, including the use of metallic filters, multilayer mirrors and manipulation of the driving field. However, none of these approaches allows the flexible manipulation of the temporal characteristics of the attosecond waveforms, and they suffer from the low conversion efficiency of the high-order harmonic generation process. Free-electron lasers, by contrast, deliver femtosecond, extreme-ultraviolet and X-ray pulses with energies ranging from tens of microjoules to a few millijoules. Recent experiments have shown that they can generate subfemtosecond spikes, but with temporal characteristics that change shot-to-shot. In this paper we report reproducible generation of high-energy (microjoule level) attosecond waveforms using a seeded free-electron laser. We demonstrate amplitude and phase manipulation of the harmonic components of an attosecond pulse train in combination with an approach for its temporal reconstruction. The results presented here open the way to performing attosecond time-resolved experiments with free-electron lasers.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Source localization for neutron imaging systems using convolutional neural networks

The nuclear imaging system at the National Ignition Facility (NIF) is a crucial diagnostic for determining the geometry of inertial confinement fusion implosions. The geometry is reconstructed from a neutron aperture image via a set of reconstruction algorithms using an iterative Bayesian inference approach. An important step in these reconstruction algorithms is finding the fusion source location within the camera field-of-view. Currently, source localization is achieved via an iterative optimization algorithm. In this paper, we introduce a machine learning approach for source localization. Specifically, we train a convolutional neural network to predict source locations given a neutron aperture image. We show that this approach decreases computation time by several orders of magnitude compared to the current optimization-based source localization while achieving similar accuracy on both synthetic data and a collection of recent NIF deuterium–tritium shots.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

AGNet: weighing black holes with deep learning

Supermassive black holes (SMBHs) are commonly found at the centres of most massive galaxies. Measuring SMBH mass is crucial for understanding the origin and evolution of SMBHs. Traditional approaches, on the other hand, necessitate the collection of spectroscopic data, which is costly. We present an algorithm that weighs SMBHs using quasar light time series information, including colours, multiband magnitudes, and the variability of the light curves, circumventing the need for expensive spectra. We train, validate, and test neural networks that directly learn from the Sloan Digital Sky Survey (SDSS) Stripe 82 light curves for a sample of 38 939 spectroscopically confirmed quasars to map out the non-linear encoding between SMBH mass and multiband optical light curves. We find a 1σ scatter of 0.37 dex between the predicted SMBH mass and the fiducial virial mass estimate based on SDSS single-epoch spectra, which is comparable to the systematic uncertainty in the virial mass estimate. Our results have direct implications for more efficient applications with future observations from the Vera C. Rubin Observatory. Our code, AGNet, is publicly available at https://github.com/snehjp2/AGNet.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Observation of attosecond electron dynamics in the photoelectron momentum distribution of atoms using few-cycle laser pulses

The method of time-resolved measurement with ultrashort laser pulses is vital to the development of attosecond science. Pump-probe measurements using a train of attosecond pulses in combination with a near-infrared (NIR) multicycle driving laser have been successful in capturing the intercycle electron dynamics which repeats every optical cycle and leads to above-threshold ionization (ATI) spectra in the frequency domain. Here in this work, we study the effect of a carrier-envelope phase (CEP) in a few-cycle (< 6 fs) NIR laser pulse on the photoelectron momentum distribution (PMD) of a hydrogen atom and show that interference patterns in a PMD change dramatically with CEPs in the few-cycle regime. When the few-cycle driving laser pulse has a sine shape, the double-slit interference with characteristic modulation of ATI peaks dominates the PMD. On the other hand, when the driving pulse has a cosine shape, the holographical interference featured by a spider-like pattern is isolated. Our results suggest that the CEP-stable few-cycle laser pulses can be used to identify different types of intracycle interference structures in a PMD which reveal the underlying subcycle electron dynamics on an attosecond timescale.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2021

Experimentally Driven Automated Machine-Learned Interatomic Potential for a Refractory Oxide

Understanding the structure and properties of refractory oxides is critical for high temperature applications. In this work, a combined experimental and simulation approach uses an automated closed loop via an active learner, which is initialized by x-ray and neutron diffraction measurements, and sequentially improves a machine-learning model until the experimentally predetermined phase space is covered. Furthermore, a multiphase potential is generated for a canonical example of the archetypal refractory oxide, HfO 2 , by drawing a minimum number of training configurations from room temperature to the liquid state at similar to 2900 degrees C. The method significantly reduces model development time and human effort.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2026

Generalized parton distributions from symbolic regression

AI/ML informed Symbolic Regression is the next stage of scientific modeling. We utilize a highly customizable symbolic regression package “PySR” to model the x and t dependence of the flavor isovector combination Hu-d(x, t, ) at = 0. These PySR models were trained on GPD results provided by both Lattice QCD and phenomenological sources GGL, GK, and VGG. We demonstrate, for the first time, the consistency and systematic convergence of Symbolic Regression by quantifying the disparate models through their Taylor expansion coefficients. In addition to PySR penalizing models with higher complexity and mean-squared error, we implement schemes that test specific physics hypotheses, including force-factorized x and t dependence and Regge behavior in PySR GPDs. We show that PySR can identify factorizing GPD sources based on their response to the Force-Factorized model. Here, knowing the precise behavior of the GPDs, and their uncertainties in a wide range in x and t, crucially impacts our ability to concretely and quantitatively predict hadronic spatial distributions and their derived quantities.

Dotson, Andrew [New Mexico State University, Las C↗

DOE OSTI2023

Malicious Cyber Activity Detection using Zigzag Persistence

In this study we synthesize zigzag persistence from topological data analysis with autoencoder-based approaches to detect malicious cyber activity, and derive analytic insights. Cybersecurity aims to safeguard computers, networks, and servers from various forms of malicious attacks, including network damage, data theft, and activity monitoring. We focus on the cybersecurity domain and investigate the detection of malicious activity using log data. We consider the dynamics of the log data and explore the changing topology of a hypergraph representation of this data to gain insights into the underlying activity. These hypergraphs capture complex interactions between processes, together with their temporal information. To study the changing topology we use zigzag persistence, which captures how topological features persist at multiple dimensions over time. We observe that this detects malicious activity in a cyber data set. To automate this detection we implement an autoencoder trained on a vectorization of the resulting zigzag persistence barcodes. Our experimental results demonstrate the effectiveness of the autoencoder in detecting malicious activity. Overall, this study highlights the potential of zigzag persistence and its combination with temporal hypergraphs for analyzing cybersecurity log data and detecting malicious behavior.

hypergraphs, temporal hypergraph, topological data↗

DOE OSTI2026

Boron Coordination in Multicomponent Glasses: Analytical Models and Machine Learning With Uncertainty

Borosilicate glasses are extensively used in a variety of applications from kitchenware to nuclear waste immobilization due to the strong network formed by the Si-O-B bond that makes it resistant to chemical corrosion and gives it a low thermal expansion. Boron, however, exists in both trigonal BO3 and tetrahedral BO4 bonds in glass systems, which impacts the chemical durability and thermal resistance of the glass, amongst other properties. Boron coordination (N4), or the ratio of the amount of BO4 to BO3 within a glass, may aid in predicting these properties but is difficult to derive without experimental data due to the complexity of impacts from varied glass compositions and processing factors. For this reason, compositional models have been developed to predict boron coordination, but the models typically include a limited number of glass components. To help fill this gap in the models, in this work, a diverse multicomponent glass dataset of 809 glasses is compiled from a literature search, and then a number of analytical and machine learning (ML) models are trained on the dataset. Previously developed modified Bernstein and modified Du Stebbins analytical models were fitted to update parameters with the new dataset. Then, partially Bayesian neural networks, Gaussian process regressor, and heteroskedastic deterministic neural networks were evaluated. The ML models examined all have different strategies to overcome the potential for overfitting as a result of a limited training dataset, and return results that account for model uncertainty, which can be valuable for understanding model reliability. For the first time, cooling rate is introduced as an input parameter for ML models, showing consistent improvements in performance and solidifying the importance of including parameters outside of composition alone for N4 prediction. The machine learning models examined here show promise in accurate predictions of boron coordination in borosilicate glasses, all achieving R2 values of 0.91.

boron coordination↗

DOE OSTI2022

Simultaneous contrast improvement and temporal compression using divided-pulse nonlinear compression

We experimentally demonstrate how divided-pulse nonlinear compression can be used to improve the temporal contrast of a laser pulse train while simultaneously temporally compressing the pulses. We measure a contrast improvement of almost four orders of magnitude on a nanosecond time scale and temporally compress the pulses from 1.2 ps to 187 fs. The efficiency of our method is also competitive with other contrast improvement methods, with 72% efficiency measured for the main pulse. We expect the method will be useful in the continuing development of high-power, Yb regenerative amplifiers, which suffer from both significant prepulses and relatively long pulse durations.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Dietary vitamin E reaches the mitochondria in the flight muscle of zebra finches but only if they exercise

Whether dietary antioxidants are effective for alleviating oxidative costs associated with energy-demanding life events first requires they are successfully absorbed in the digestive tract and transported to sites associated with reactive species production (e.g. the mitochondria). Flying birds are under high energy and oxidative demands, and although birds commonly ingest dietary antioxidants in the wild, the bioavailability of these consumed antioxidants is poorly understood. We show for the first time that an ingested lipophilic antioxidant, α-tocopherol, reached the mitochondria in the flight muscles of a songbird but only if they regularly exercise (60 min of perch-to-perch flights two times in a day or 8.5 km day -1 ). Deuterated α-tocopherol was found in the blood of exercise-trained zebra finches within 6.5 hrs and in isolated mitochondria from pectoral muscle within 22.5 hrs, but never reached the mitochondria in caged sedentary control birds. This rapid pace (within a day) and extent of metabolic routing of a dietary antioxidant to muscle mitochondria means that daily consumption of such dietary sources can help to pay the inevitable oxidative costs of flight muscle metabolism, but only when combined with regular exercise.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Foundations of an Electric Mobility Strategy for the City of Mexicali

The Foundations of an Electric Mobility Strategy for the city of Mexicali aligns with numerous energy, environmental, and transport plans and will help Mexicali meet multiple related goals. Mexicali’s energy mix, with 28% renewables, already enables plugin electric vehicles (PEVs) to reduce the mass of greenhouse gases (GHGs) per km driven 2/3 below that of their conventional counterparts. This GHG benefit will increase should Mexicali take steps to further increase their share of renewables in their electricity supply. Beyond increasing renewables, Mexicali could possibly deploy PEVs so that electric load is added in the right location (depending on further analysis of substations and feeders) and at the right time (between 21:00 and 11:00) in order to minimize grid upgrade costs. There are a handful of charge timing control mechanisms –at various stages of development– that Mexicali could implement. Transport electrification can facilitate mass transit by powering buses, trains, and small vehicles that get people from their homes or work to the transit stations and vice versa. Mexicali could utilize fleets as early PEV adopters in order to gain acceptance and add electric vehicle supply equipment (EVSE). Recommended prioritization of different types of fleets are suggested in this report: transit buses, school buses, airport ground support equipment (GSE), refuse trucks, taxis, shuttle buses, campus vehicles, delivery trucks, utility trucks, and finally semitrailers. There are a handful of policy options that Mexicali could use to incentivize fleets to purchase PEVs, including mandates, economic incentives, energy performance contracts, waivers to access restrictions, electricity discounts, and EVSE requirements in building codes. Mexicali’s taxi fleet was an early adopter of PEVs and had experienced some challenges—mostly related to the insufficient range of the taxis due to hot weather. In this report, we strategize ways to extend the range of the current electric taxis, including ways to make charging more convenient to the drivers, and more suggestions for appropriate vehicles to purchase in the future. This report also includes the groundwork of geotracking Mexicali’s taxi fleet so that more detailed recommendations can be made in the future. Once fleets have increased PEV acceptance and EVSE installations, the market will be ready to expand to private vehicle owners. In order to do this, more EVSE needs to be installed in the right locations. This mobility strategy lays out general local areas where EVSE could be well utilized, based on traffic patterns, land use, and demographic data. Mexicali could approach businesses within these areas that would likely make suitable hosts, based on how well they can profit from the additional business that EVSE would bring. Mexicali could then adopt a series of purchase incentives (including sales tax waivers or access to high-occupancy vehicles [HOV] lanes) that would encourage private vehicle owners to purchase PEVs. Purchase incentives run the risk of creating equity issues, which can be countered by promoting electrification in mass transit, creating more HOV lanes that have PEV exemptions, and installing EVSEs in underserved communities. Private PEV ownership will require a set of experts that Mexicali can help train, including PEV repair technicians, EVSE installation electricians, and first responders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Source localization for neutron imaging systems using convolutional neural networks

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

On the minimum number of radiation field parameters to specify gas cooling and heating functions

Fast and accurate approximations of gas cooling and heating functions are needed for hydrodynamic galaxy simulations. We use machine learning to analyze atomic gas cooling and heating functions in the presence of a generalized incident local radiation field computed by Cloudy. We characterize the radiation field through binned radiation field intensities instead of the photoionization rates used in our previous work. We find a set of 6 energy bins whose intensities exhibit relatively low correlation. We use these bins as features to train machine learning models to predict Cloudy cooling and heating functions at fixed metallicity. We compare the relative SHapley Additive exPlanation (SHAP) value importance of the features. From the SHAP analysis, we identify a feature subset of 3 energy bins (0.5-1, 1-4, and 13-16Ry) with the largest importance and train additional models on this subset. We compare the mean squared errors and distribution of errors on both the entire training data table and a randomly selected 20% test set withheld from model training. The machine learning models trained with 3 and 6 bins, as well as 3 and 4 photoionization rates, have comparable accuracy everywhere, with errors ≳10 times smaller than for the interpolation table of Gnedin and Hollon (2012). We conclude that 3 energy bins (or 3 analogous photoionization rates: molecular hydrogen photodissociation, neutral hydrogen HI, and fully ionized carbon CVI) are sufficient to characterize the dependence of the gas cooling and heating functions on our assumed incident radiation field model.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗

DOE OSTI2024

Privacy-Preserving Real-Time Action Detection in Intelligent Vehicles Using Federated Learning-Based Temporal Recurrent Network

This study introduces a privacy-preserving approach for the real-time action detection in intelligent vehicles using a federated learning (FL)-based temporal recurrent network (TRN). This approach enables edge devices to independently train models, enhancing data privacy and scalability by eliminating central data consolidation. Our FL-based TRN effectively captures temporal dependencies, anticipating future actions with high precision. Extensive testing on the Honda HDD and TVSeries datasets demonstrated robust performance in centralized and decentralized settings, with competitive mean average precision (mAP) scores. The experimental results highlighted that our FL-based TRN achieved an mAP of 40.0% in decentralized settings, closely matching the 40.1% in centralized configurations. Notably, the model excelled in detecting complex driving maneuvers, with mAPs of 80.7% for intersection passing and 78.1% for right turns. These outcomes affirm the model’s accuracy in action localization and identification. The system showed significant scalability and adaptability, maintaining robust performance across increased client device counts. The integration of a temporal decoder enabled predictions of future actions up to 2 s ahead, enhancing the responsiveness. Our research advances intelligent vehicle technology, promoting safety and efficiency while maintaining strict privacy standards.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Accurate numerical simulations of open quantum systems using spectral tensor trains

Decoherence between qubits is a major bottleneck in quantum computations. Decoherence results from intrinsic quantum and thermal fluctuations as well as noise in the external fields that perform the measurement and preparation processes. With prescribed colored noise spectra for intrinsic and extrinsic noise, we present a numerical method, Quantum Accelerated Stochastic Propagator Evaluation (Q-ASPEN), to solve the time-dependent noise-averaged reduced density matrix in the presence of intrinsic and extrinsic noise. Q-ASPEN is arbitrarily accurate and can be applied to provide estimates for the resources needed to error-correct quantum computations. We employ spectral tensor trains, which combine the advantages of tensor networks and pseudospectral methods, as a variational ansatz to the quantum relaxation problem and optimize the ansatz using methods typically used to train neural networks. Here, the spectral tensor trains in Q-ASPEN make accurate calculations with tens of quantum levels feasible. We present benchmarks for Q-ASPEN on the spin-boson model in the presence of intrinsic noise and on a quantum chain of up to 32 sites in the presence of extrinsic noise. In our benchmark, the memory cost of Q-ASPEN scales as a low-order polynomial in the size of the system once the number of system states surpasses the number of basis functions used in the spectral expansion.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Confronting Domain Shift in Trained Neural Networks

Neural networks (NNs) are known as universal function approximators and can interpolate nonlinear functions between observed data points. However, when the target domain for deployment shifts from the training domain and NNs must extrapolate, the results are notoriously poor. Prior work Martinez et al. (2019) has shown that NN uncertainty estimates can be used to correct binary predictions in shifted domains without retraining the model. We hypothesize that this approach can be extended to correct real-valued time series predictions. As an exemplar, we consider two mechanical systems with nonlinear dynamics. The first system consists of a spring-mass system where the stiffness changes abruptly, and the second is a real experimental system with a frictional joint that is an open challenge for structural dynamicists to model efficiently. Our experiments will test whether 1) NN uncertainty estimates can identify when the input domain has shifted from the training domain and 2) whether the information used to calculate uncertainty estimates can be used to correct the NN’s time series predictions. While the method as proposed did not significantly improve predictions, our results did show potential for modifications that could improve models’ predictions and play a role in structural health monitoring systems that directly impact public safety.

97 MATHEMATICS AND COMPUTING↗