Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Training Time”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Transition, Training, and Assessment of Multispectral Composite Imagery in Support of the NWS Aviation Forecast Mission

The NASA/Short‐term Prediction, Research, and Transition (SPoRT) Program works closely with NOAA/NWS weather forecasters to transition unique satellite data and capabilities into operations in order to assist with nowcasting and short‐term forecasting issues. Several multispectral composite imagery (i.e. RGB) products were introduced to users in the early 2000s to support hydrometeorology and aviation challenges as well as incident support. These activities lead to SPoRT collaboration with the GOES‐R Proving Ground efforts where instruments such as MODIS (Aqua, Terra) and S‐NPP/VIIRS imagers began to be used as near‐realtime proxies to future capabilities of the Advanced Baseline Imager (ABI). One of the composite imagery products introduced to users was the Night‐time Microphysics RGB, originally developed by EUMETSAT. SPoRT worked to transition this imagery to NWS users, provide region‐specific training, and assess the impact of the imagery to aviation forecast needs. This presentation discusses the method used to interact with users to address specific aviation forecast challenges, including training activities undertaken to prepare for a product assessment. Users who assessed the multispectral imagery ranged from southern U.S. inland and coastal NWS weather forecast offices (WFOs), to those in the Rocky Mountain Front Range region and West Coast, as well as highlatitude forecasters of Alaska. These user‐based assessments were documented and shared with the satellite community to support product developers and the broad users of new generation satellite data.

Fuell, Kevin↗
DOE OSTI2021

Training Spiking Neural Networks with Synaptic Plasticity under Integer Representation

Neuromorphic computing is emerging as a promising Beyond Moore computing paradigm that employs event-triggered computation and non-von Neumann hardware. Spike Timing Dependent Plasticity (STDP) is a well-known bio-inspired learning rule that relies on activities of locally connected neurons to adjust the weights of their respective synapses. In this work, we analyze a basic STDP rule and its sensitivity on the different hyperparameters for training spiking neural networks (SNNs) with supervision, customized for a neuromorphic hardware implementation with integer weights. We compare the classification performance on four UCI datasets (iris, wine, breast cancer and digits) that depict varying levels of complexity. We perform a search for optimal set of hyperparameters using both grid search and Bayesian optimization. Through the use of Bayesian optimization, we show the general trends in hyperparameter sensitivity in SNN classification problem. With the best sets of hyperparameters, we achieve accuracies comparable to some of the best performing SNNs on these four datasets. With a highly optimized supervised STDP rule we show that these accuracies can be achieved with just 20 epochs of training.

Kulkarni, Shruti↗
DOE OSTI2025

GenAI-Based Digital Twins Aided Data Augmentation Increases Accuracy in Real-Time Cokurtosis-Based Anomaly Detection of Wearable Data

Early detection of potential infectious disease outbreaks is crucial for developing effective interventions. In this study, we introduce advanced anomaly detection methods tailored for health datasets collected from wearables, offering insights at both individual and population levels. Leveraging real-world physiological data from wearables, including heart rate and activity, we developed a framework for the early detection of infection in individuals. Despite the availability of data from recent pandemics, substantial gaps remain in data collection, hindering method development. To bridge this gap, we utilized Wasserstein Generative Adversarial Networks (WGANs) to generate realistic synthetic wearable data, augmenting our dataset for training. Subsequently, we use these augmented datasets to implement a cokurtosis-based technique for anomaly detection in multivariate time-series data. Our approach includes a comprehensive assessment of uncertainties in synthetic data compared to the actual data upon which it was modeled, as well as the uncertainty associated with fine-tuning anomaly detection thresholds in physiological measurements. Through our work, we present an enhanced method for early anomaly detection in multivariate datasets, with promising applications in healthcare and beyond. This framework could revolutionize early detection strategies and significantly impact public health response efforts in future pandemics.

Data-Driven Digital Twins↗
DOE OSTI2023

Non-parametric Lagrangian biasing from the insights of neural nets

We present a Lagrangian model of galaxy clustering bias in which we train a neural net using the local properties of the smoothed initial density field to predict the late-time mass-weighted halo field.By fitting the mass-weighted halo field in the AbacusSummit simulations at z = 0.5, we find that including three coarsely spaced smoothing scales gives the best recovery of the halo power spectrum. Adding more smoothing scales may lead to 2–5% underestimation of the large-scale power and can cause the neural net to overfit.We find that the fitted halo-to-mass ratio can be well described by two directions in the original high-dimension feature space.Projecting the original features into these two principal components and re-training the neural net either reproduces the original training result, or outperforms it with a better match of the halo power spectrum. The elements of the principal components are unlikely to be assigned physical meanings, partly owing to the features being highly correlated between different smoothing scales.Our work illustrates a potential need to include multiple smoothing scales when studying galaxy bias, and this can be done easily with machine-learning methods that can take in high dimensional input feature space.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Early Battery Performance Prediction for Mixed Use Charging Profiles Using Hierarchal Machine Learning

A key step limiting how fast batteries can be deployed is the time necessary to provide evaluation and validation of performance. Using data analysis approaches, such as machine learning, the validation process can be accelerated. However, questions on the validity of projecting models trained on limited data or simple cycling profiles, such as constant current cycling, to real-world scenarios with complex loads remains. Here, we present the ability to predict performance with less than 1.2% mean absolute percent error when trained on cells aged using complex electric vehicle discharge profiles, and either AC Level 2 charge or DC Fast charge profiles, using only the first 45 cycles, namely 5% of the total testing time. While error is low across the projections, this study also highlights that battery lifetime analysis using only cycling data may not extrapolate safely to certain real-world conditions due to the impact of calendar degradation.

25 ENERGY STORAGE↗
NASA NTRS1991

Alfven shock trains

The Cohen-Kulsrud-Burgers equation (CKB) is used to consider the nonlinear evolution of resistive, quasi-parallel Alfven waves subject to a long-wavelength, plane-polarized, monochromatic instability. The instability saturates by nonlinear steepening, which proceeds until the periodic waveform develops an interior scale length comparable to the dissipation length; a fast or an intermediate shock then forms. The result is a periodic train of Alfven shocks of one or the other type. For propagation strictly parallel to the magnetic field, there will be two shocks per instability wavelength. Numerical integration of the time-dependent CKB equation shows that an initial, small-amplitude growing wave asymptotes to a stable, periodic stationary wave whose analytic solution specifies how the type of shock embedded in the shock train, and the amplitude and speed of the shock train, depend on the strength and phase of the instability. Waveforms observed upstream of the earth's bowshock and cometary shocks resemble those calculated here.

Malkov, M. A.↗
NASA NTRS2009

Low Cost Rapid Response Spacecraft, (LCRRS): A Research Project in Low Cost Spacecraft Design and Fabrication in a Rapid Prototyping Environment

The Low Cost Rapid Response Spacecraft (LCRRS) is an ongoing research development project at NASA Ames Research Center (ARC), Moffett Field, California. The prototype spacecraft, called Cost Optimized Test for Spacecraft Avionics and Technologies (COTSAT) is the first of what could potentially be a series of rapidly produced low-cost satellites. COTSAT has a target launch date of March 2009 on a SpaceX Falcon 9 launch vehicle. The LCRRS research system design incorporates use of COTS (Commercial Off The Shelf), MOTS (Modified Off The Shelf), and GOTS (Government Off The Shelf) hardware for a remote sensing satellite. The design concept was baselined to support a 0.5 meter Ritchey-Chretien telescope payload. This telescope and camera system is expected to achieve 1.5 meter/pixel resolution. The COTSAT team is investigating the possibility of building a fully functional spacecraft for $500,000 parts and $2,000,000 labor. Cost is dramatically reduced by using a sealed container, housing the bus and payload subsystems. Some electrical and RF designs were improved/upgraded from GeneSat-1 heritage systems. The project began in January 2007 and has yielded two functional test platforms. It is expected that a flight-qualified unit will be finished in December 2008. Flight quality controls are in place on the parts and materials used in this development with the aim of using them to finish a proto-flight satellite. For LEO missions the team is targeting a mission class requiring a minimum of six months lifetime or more. The system architecture incorporates several design features required by high reliability missions. This allows for a true skunk works environment to rapidly progress toward a flight design. Engineering and fabrication is primarily done in-house at NASA Ames with flight certifications on materials. The team currently employs seven Full Time Equivalent employees. The success of COTSATs small team in this effort can be attributed to highly cross trained engineering team. The engineers on the team are capable of functioning in two to three engineering disciplines which allows highly efficient interdisciplinary engineering collaboration. NASA Ames is actively proposing mission concepts to use the COTSAT platform to accomplish science. If the COTSAT team validates this approach, it will allow the possibility for remote sensing missions to produce a high science yield for minimal cost and reduced schedule. Another aim of this approach is to yield an accelerated pathway from a Phase A study to mission launch. Leaders in the aerospace industry have shown interest in this methodology. Several visits and tours have been given in the lab. Although the concept of low-cost development is initially met with skepticism from some within the prohibitive aerospace industry, the project's efforts have been highly praised for the accomplishments met within a limited time and budget. Overall the development has progressed tremendously well and the team is answering critical questions for current and future low-cost small satellite developments. COTSAT subsystems are not limited to a specific weight class and could be adapted to produce smaller platforms and to fit various launch vehicles.

Spremo, Stevan↗
DOE OSTI2025

Cluster-Graph Fingerprinting: A Framework for Quantitative Analysis of Machine-Learned Interatomic Model Training and Simulation Data

Machine-learned interatomic models represent a significant advancement in simulation methods, extending the predictive ability of first-principles methods to previously inaccessible length and time scales. However, the data-driven nature of these models can lead to difficult-to-detect errors that can compromise prediction accuracy. To address this challenge, we introduce a novel fingerprinting approach based on the Chebyshev Interaction Model for Efficient Simulation (ChIMES) ML-IAM graph-based descriptor. Our strategy enables efficient and statistically rigorous analysis of system configurations used in ML-IAM training and those generated by their application, e.g., in molecular dynamics simulations. We demonstrate that these fingerprints can effectively assess novelty of a configuration relative to an existing data set and determine dissimilarity among individual configurations, which are two key tasks in workflows for active learning-based ML-IAM training, data set curation, and on-the-fly uncertainty quantification.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Toward real-time optimization through model reduction and model discrepancy sensitivities

Optimization problems arise in a range of scenarios, from optimal control to model parameter estimation. In many applications, such as the development of digital twins, it is essential to solve these optimization problems within wall-clock-time limitations. However, this is often unattainable for complex systems, such as those modeled by nonlinear partial differential equations. One strategy for mitigating this issue is to construct a reduced-order model (ROM) that enables more rapid optimization. In particular, the use of nonintrusive ROMs—those that do not require access to the full-order model at evaluation time—is popular because they facilitate the computation of optimization solutions within the wall-clock time requirements. However, the optimization solution will be unreliable if the iterates move outside the ROM training data. This article proposes the use of hyper-differential sensitivity analysis with respect to model discrepancy (HDSA-MD) as a computationally efficient tool to augment ROM-constrained optimization and improve its reliability. The proposed approach consists of two phases: (i) an offline phase where several full-order model evaluations are computed to train the ROM, and (ii) an online phase where a ROM-constrained optimization problem is solved, a limited number of full-order model evaluations are computed, and HDSA-MD is used to enhance the optimization solution. Numerical results are demonstrated for two examples, atmospheric contaminant control and wildfire ignition location estimation, in which a ROM is trained offline using inaccurate atmospheric data. In conclusion, the HDSA-MD update yields a significant improvement in the ROM-constrained optimization solution using only one full-order model evaluation online with corrected atmospheric data.

PDE-constrained optimization↗
DOE OSTI2020

Overcoming small minirhizotron datasets using transfer learning

Minirhizotron technology is widely used to study root growth and development. Yet, standard approaches for tracing roots in minirhiztron imagery is extremely tedious and time consuming. Machine learning approaches can help to automate this task. However, lack of enough annotated training data is a major limitation for the application of machine learning methods. Transfer learning is a useful technique to help with training when available datasets are limited. In this paper, we investigated the effect of pre-trained features from the massives-cale, irrelevant ImageNet dataset and a relatively moderate-scale, but relevant peanut root dataset on switchgrass root imagery segmentation applications. We compiled two minirhizotron image datasets to accomplish this study: one with 17,550 peanut root images and another with 28 switchgrass root images. Both datasets were paired with manually labeled ground truth masks. Deep neural networks based on the U-net architecture were used with different pre-trained features as initialization for automated, precise pixel-wise root segmentation in minirhizotron imagery. We observed that features pre-trained on a closely related but relatively moderate size dataset like our peanut dataset were more effective than features pre-trained on the large but unrelated ImageNet dataset. Here, we achieved high quality segmentation on peanut root dataset with 99.04% accuracy at the pixel-level and overcame errors in human-labeled ground truth masks. By applying transfer learning technique on limited switchgrass dataset with features pre-trained on peanut dataset, we obtained 99% segmentation accuracy in switchgrass imagery using only 21 images for training (fine tuning). Furthermore, the peanut pre-trained features can help the model converge faster and have much more stable performance.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Electron emissions and hot spots in dual-phase LXe TPCs

Persistent photon and single-electron emissions - in the form of “electron trains” and localized “hot spots” - have been observed in multiple dual-phase liquid xenon (LXe) time projection chambers (TPCs), often persisting long after ionizing events. Here, we show that these phenomena are naturally explained by photon-triggered single-electron emission from resistive mixed-oxide films on stainless-steel (SS304 or s.s.) wires, which behave as leaky capacitors with long RC time constants at LXe temperature. Positive ions landing on these oxides can further enhance local fields and drive Malter-like electron emission. We outline the materials physics (Cr 2 O 3 /Cr 2 O 3-x /Cr(OH) 3 mosaics), quantify expected time scales (∼1 s under illumination), and demonstrate how small damaged regions with enhanced QE can produce persistent hot spots.

Va'vra, J. [SLAC National Accelerator Laboratory (↗
DOE OSTI2021

Deep spectral CNN for laser induced breakdown spectroscopy

This work proposes a spectral convolutional neural network (CNN) operating on laser induced breakdown spectroscopy (LIBS) signals to learn to (1) disentangle spectral signals from the sources of sensor uncertainty (i.e., pre-process) and (2) get qualitative and quantitative measures of chemical content of a sample given a spectral signal (i.e., calibrate). Once the spectral CNN is trained, it can accomplish either task through a single feed-forward pass, with real-time benefits and without any additional side information requirements including dark current, system response, temperature and detector-to-target range. Our experiments demonstrate that the proposed method outperforms the existing approaches used by the Mars Science Lab for pre-processing and calibration for remote sensing observations from the Mars rover, ‘Curiosity’.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Spatiotemporal Route to Understanding Metal Halide Perovskitoid Crystallization

Here, a spatiotemporal experimental route is reported for the antisolvent vapor diffusion crystal growth of metal halide perovskitoids. A computational analysis combining automated image capture and diffusion modeling enables the determination of the critical concentrations required for nucleation and crystal growth from a single experiment. Five different solvent systems and ten distinct organic ammonium iodide salts were investigated with lead iodide, from which nine previously unreported compounds were discovered. Automated image capture of the mother liquor and antisolvent vials was used to determine changes in solution meniscus positions and detect the nucleation event location. Matching the observations to a numerical solution of Fick's second law diffusion model enables the calculation of reactant, solvent, and antisolvent concentrations at both the time and position of the first stable nucleation and crystal growth. A machine learning model was trained on the resulting data, and it reveals solvent- and amine-specific crystallization tendencies. Solvent systems that interact more weakly with dissolved lead species promote crystallization, while those with stronger interactions can prevent crystallization through increased solubilities. Organic amines that interact more strongly with inorganic components and exhibit greater rigidity are more likely to be incorporated into crystalline products.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Rapid Identification of X-ray Diffraction Patterns Based on Very Limited Data by Interpretable Convolutional Neural Networks

Large volumes of data from material characterizations call for rapid and automatic data analysis to accelerate materials discovery. Herein, we report a convolutional neural network (CNN) that was trained based on theoretical data and very limited experimental data for fast identification of experimental X-ray diffraction (XRD) patterns of metal–organic frameworks (MOFs). To augment the data for training the model, noise was extracted from experimental data and shuffled; then it was merged with the main peaks that were extracted from theoretical spectra to synthesize new spectra. For the first time, one-to-one material identification was achieved. Theoretical MOFs patterns (1012) were augmented to a whole data set of 72 864 samples. It was then randomly shuffled and split into training (58 292 samples) and validation (14 572 samples) data sets at a ratio of 4:1. For the task of discriminating, the optimized model showed the highest identification accuracy of 96.7% for the top 5 ranking on a test data set of 30 hold-out samples. Neighborhood component analysis (NCA) on the experimental XRD samples shows that the samples from the same material are clustered in groups in the NCA map. Analysis on the class activation maps of the last CNN layer further discloses the mechanism by which the CNN model successfully identifies individual MOFs from the XRD patterns. Furthermore, this CNN model trained by the data augmentation technique would not only open numerous potential applications for identifying XRD patterns for different materials, but also pave avenues to autonomously analyze data by other characterization tools such as FTIR, Raman, and NMR spectroscopies.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Seismic Features Predict Ground Motions During Repeating Caldera Collapse Sequence

Abstract Applying machine learning to continuous acoustic emissions, signals previously deemed noise, from laboratory faults and slowly slipping subduction‐zone faults, demonstrates hidden signatures are emitted that describe physical details, including fault displacement and friction. However, no evidence currently exists to demonstrate that similar hidden signals occur during seismogenic stick‐slip on earthquake faults—the damaging earthquakes of most societal interest. We show that continuous seismic emissions emitted during the 2018 multi‐month caldera collapse sequence at the Kı̄lauea volcano in Hawai'i contain hidden signatures characterizing the earthquake cycle. Multi‐spectral data features extracted from 30 s intervals of the continuous seismic emission are used to train a gradient boosted tree regression model to predict the GNSS‐derived contemporaneous surface displacement and time‐to‐failure of the upcoming collapse event. This striking result suggests that at least some faults emit such signals and provide a potential path to characterizing the instantaneous and future behavior of earthquake faults.

58 GEOSCIENCES↗
DOE OSTI2026

Learning turbulent flows with generative models for super resolution and sparse flow reconstruction

Neural operators are promising surrogates for dynamical systems but when trained with standard L 2 losses they tend to oversmooth fine-scale turbulent structures. Here, we show that combining operator learning with generative modeling overcomes this limitation. We consider three practical turbulent-flow challenges where conventional neural operators fail: spatio-temporal super-resolution, forecasting, and sparse flow reconstruction. For Schlieren jet super-resolution, an adversarially trained neural operator (adv-NO) reduces the energy-spectrum error by 15 × while preserving sharp gradients at neural operator-like inference cost. For 3D homogeneous isotropic turbulence, adv-NO trained on only 160 timesteps from a single trajectory forecasts accurately for five eddy-turnover times and offers 114 × wall-clock speed-up at inference than the baseline diffusion-based forecasters, enabling near-real-time rollouts. For reconstructing cylinder wake flows from highly sparse Particle Tracking Velocimetry-like inputs, a conditional generative model infers full 3D velocity and pressure fields with correct phase alignment and statistics. These advances enable accurate reconstruction and forecasting at low compute cost, bringing near-real-time analysis and control within reach in experimental and computational fluid mechanics.

Fluid dynamics↗
DOE OSTI2025

Temporally-consistent koopman autoencoders for forecasting dynamical systems

Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Enhancing Knowledge Capture and Management within a Knowledge-Driven Workforce [Capstone Project]

This project aimed to understand how the collective knowledge of a group of engineers or ‘knowledge-based workers’ can be baselined through use of qualitative questionnaires based on input from subject matter experts. The results of the questionnaires were then used to inform management and the group where to focus efforts on terms of training and mentoring. With use of re-administering the qualitative questionnaire to gauge progress over time. Additionally, the development a knowledge-based wiki was explored to help shape group culture from one where ideas and knowledge tend to be siloed, into one where information is traded freely across the group and with external customers and collaborators.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗