Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “task tuning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Compiler and Runtime Approaches to Enable Large-Scale Irregular Programs. Final report, July 2013 - July 2019

While regular algorithms, characterized by operations on dense matrices and arrays, have long been the mainstay of scientific, high-performance computing, irregular algorithms, which feature unpredictable accesses to pointer-based data structures, are becoming increasingly common in high performance computing, arising in graph analysis, data mining and visualization, among other domains. Unfortunately, the defining characteristics of irregular applications, their dynamic, unpredictable, data-dependent access patterns and data layouts, make achieving high performance on large scale systems difficult. Scaling applications to peta- and exa-scale requires carefully controlling communication and data movement and placement, an inherently difficult task when access patterns and data layouts are unpredictable! Most irregular applications that attain high performance must be painstakingly hand-written and hand-tuned, with few common principles or paradigms uniting various implementations and easing future development. Despite the increasing importance of irregular applications, there is little programmer knowledge, and even less compiler ability, devoted to optimizing them. This project aims to solve these problems. By allowing programmers to write irregular applications in high level forms, with at most a few annotations highlighting key structural properties, programmers can focus on developing their algorithms and methods. The compiler and run-time system can take on the tedious task of optimizing the application for execution at large scales, and can automatically provide efficient implementations. This will provide portability and ease maintenance for existing irregular applications, but, more importantly, open up whole new domains of computational science to large-scale, high-performance simulation codes.

97 MATHEMATICS AND COMPUTING↗

Enhancing Molecular Isotope Detection with a Chirp Tuned Optical Centrifuge

This paper gives a brief experimental overview on creating a chirp-tunable optical centrifuge with the goal of amplifying the isotope shift of a given molecule. Results for this experiment were recorded with a CO 2 plume as the probed material. Beyond amplification of the isotope shift, this technology could be modified to alter magnetic field characteristics of common molecules as well as simulating high temperature gases found in combustion environments. Our specific design uses double mirror and grating stretcher and will include a unique tuning feature for customization of the beam’s red and blue components' temporal chirp, allowing for quick reactivity to varying task requirements. The design and parameters will be discussed, as well as the methods used to model the optical centrifuge. Although this experiment is ongoing, results have been gathered previously that display the efficacy of the optical centrifuge. For the probed CO 2 sample, Raman Shifts centered around a wavenumber of 60 and 275 were recorded with durations of 1000 and 800 picoseconds, respectively.

47 OTHER INSTRUMENTATION↗

Estimation of Aerodynamic Stability Derivatives for Space Launch System and Impact on Stability Margins

This paper describes the techniques involved in determining the aerodynamic stability derivatives for the frequency domain analysis of the Space Launch System (SLS) vehicle. Generally for launch vehicles, determination of the derivatives is fairly straightforward since the aerodynamic data is usually linear through a moderate range of angle of attack. However, if the wind tunnel data lacks proper corrections then nonlinearities and asymmetric behavior may appear in the aerodynamic database coefficients. In this case, computing the derivatives becomes a non-trivial task. Errors in computing the nominal derivatives could lead to improper interpretation regarding the natural stability of the system and tuning of the controller parameters, which would impact both stability and performance. The aerodynamic derivatives are also provided at off nominal operating conditions used for dispersed frequency domain Monte Carlo analysis. Finally, results are shown to illustrate that the effects of aerodynamic cross axis coupling can be neglected for the SLS configuration studied

Pei, Jing↗

Inflight Treadmill Exercise Can Serve as Multi-Disciplinary Countermeasure System

The goals of the Functional Task Test (FTT) study were to determine the effects of space flight on functional tests that are representative of high priority exploration mission tasks and to identify the key underlying physiological factors that contribute to decrements in performance. Ultimately this information will be used to assess performance risks and inform the design of countermeasures for exploration class missions. We have previously shown that for Shuttle, ISS and bed rest subjects, functional tasks requiring a greater demand for dynamic control of postural equilibrium (i.e. fall recovery, seat egress/obstacle avoidance during walking, object translation, jump down) showed the greatest decrement in performance. Functional tests with reduced requirements for postural stability (i.e. hatch opening, ladder climb, manual manipulation of objects and tool use) showed little reduction in performance. These changes in functional performance were paralleled by similar decrements in sensorimotor tests designed to specifically assess postural equilibrium and dynamic gait control. The bed rest analog allows us to investigate the impact of axial body unloading in isolation on both functional tasks and on the underlying physiological factors that lead to decrements in performance and then compare them with the results obtained in our space flight study. These results indicate that body support unloading experienced during space flight plays a central role in postflight alteration of functional task performance. These data also support the concept that space flight may cause central adaptation of converging body-load somatosensory and vestibular input during gravitational transitions [1]. Therefore, we conclude that providing significant body-support loading during inflight treadmill along with balance training is necessary to mitigate decrements in critical mission tasks that require dynamic postural stability and mobility. Data obtained from space flight and bed rest support the notion that in-flight treadmill exercise, in addition to providing aerobic exercise and mechanical stimuli to the bone, also has a number of sensorimotor benefits by providing: 1) A balance challenge during locomotion requiring segmental coordination in response to a downward force. 2) Body-support loading during performance of a full-body active motor task. 3) Oscillatory stimulation of the otoliths and synchronized periodic foot impacts that facilitate the coordination of gait motions and tune the full-body gaze control system. 4) Appropriate sensory input (foot tactile input, muscle and tendon stretch input) to spinal locomotor central pattern generators required for the control of locomotion. Forward work will focus on a follow-up bed rest study that incorporates aerobic and resistance exercise with a treadmill balance and gait training system that can serve as an integrated interdisciplinary countermeasure system for future exploration class missions.

Bloomberg, J. J.↗

Transferring a Molecular Foundation Model for Polymer Property Predictions

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and material discovery. Self-supervised pretraining of transformer models requires large-scale data sets, which are often sparsely populated in topical areas such as polymer science. Further, state-of-the-art approaches for polymers conduct data augmentation to generate additional samples but unavoidably incur extra computational costs. In contrast, large-scale open-source data sets are available for small molecules and provide a potential solution to data scarcity through transfer learning. In this work, we show that using transformers pretrained on small molecules and fine-tuned on polymer properties achieves comparable accuracy to those trained on augmented polymer data sets for a series of benchmark prediction tasks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Recreation Embedded State Tuning for Optimal Readiness and Effectiveness (RESTORE)

Physiological self-regulation training is a behavioral medicine intervention that has demonstrated capability to improve psychophysiological coping responses to stressful experiences and to foster optimal behavioral and cognitive performance. Once developed, these psychophysiological skills require regular practice for maintenance. A concomitant benefit of these physiologically monitored practice sessions is the opportunity to track crew psychophysiological responses to the challenges of the practice task in order to detect shifts in adaptability that may foretell performance degradation. Long-duration missions will include crew recreation periods that will afford physiological self-regulation training opportunities. However, to promote adherence to the regimen, the practice experience that occupies their recreation time must be perceived by the crew as engaging and entertaining throughout repeated reinforcement sessions on long-duration missions. NASA biocybernetic technologies and publications have developed a closed-loop concept that involves adjusting or modulating (cybernetic, for governing) a person's task environment based upon a comparison of that person's physiological responses (bio-) with a training or performance criterion. This approach affords the opportunity to deliver physiological self-regulation training in an entertaining and motivating fashion and can also be employed to create a conditioned association between effective performance state and task execution behaviors, while enabling tracking of individuals psychophysiological status over time in the context of an interactive task challenge. This paper describes the aerospace spin-off technologies in this training application area as well as the current spin-back application of the technologies to long-duration missions - the Recreation Embedded State Tuning for Optimal Readiness and Effectiveness (RESTORE) concept. The RESTORE technology is designed to provide a physiological self-regulation training countermeasure for maintaining and reinforcing cognitive readiness, resilience under psychological stress, and effective mood states in long-duration crews. The technology consists of a system for delivering physiological self-regulation training and for tracking crew central and autonomic nervous system function; the system interface is designed to be experienced as engaging and entertaining throughout repeated training sessions on long-duration missions. Consequently, this self-management technology has threefold capability for recreation, behavioral health problem prophylaxis and remediation, and psychophysiological assay. The RESTORE concept aims to reduce the risk of future manned exploration missions by enhancing the capability of individual crewmembers to self-regulate cognitive states through recreation-embedded training protocols to effectively deal with the psychological toll of long-duration space flight.

Pope, Alan T.↗

Fermilab Booster loss modelling and rebalancing using Bayesian methods

Fermilab Booster is being upgraded for the PIP-II project to support 20Hz ramp rate at higher intensities. Loss trip limits determine the achievable peak power. To meet PIP-II requirements, losses need to be halved as compared to current levels. Losses primarily occur at injection and transition crossing, with both gradually increasing and threshold-like intensity-dependent behaviors. The existing simulation models are not yet good enough for quantitative loss predictions. In practice, it will be necessary to tune up the Booster using iterative methods and operator intuition. In this paper we present an effort to systematically model Booster losses using active learning (Bayesian exploration) techniques, and subsequently to rebalance them for higher trip limit margins. We first created several sets of spatially and temporally isolated orbit and optics knobs, and trained Gaussian process models for each beam loss monitor as well as beam current. This is a complex task due to safety and timing requirements – we discuss mitigations such as uncertainty constraints and approximate fitting. Once models are stable, we perform large-scale single and multi-objective tuning using scalarized objectives made up of critical beam loss locations. Our results demonstrate significant rebalancing of losses, increasing trip margins, as well as an overall improvement in beam transmission efficiency. We are exploring how to combine existing simulations with experimental data and automate the collection procedure so that more advanced surrogate models can be created over time.

Kuklev, Nikita [Fermilab]↗

Survey of Image Denoising Methods for Medical Image Classification

Medical imaging devices, such as X-ray machines, inherently produce images that suffer from visual noise. Our objectives were to (i.) determine the effect of image denoising on a medical image classification task, and (ii.) determine if there exists a correlation between image denoising performance and medical image classification performance. We performed the medical image classification task on chest X-rays using the DenseNet-121 convolutional neural network (CNN) and used the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) metrics as the image denoising performance measures. We first found that different denoising methods can make a statistically significant difference in classification performance for select labels. We also found that denoising methods affect fine-tuned models more than randomly-initialized models and that fine-tuned models have significantly higher and more uniform performance than randomly-initialized models. Lastly, we found that there is no significant correlation between PSNR and SSIM values and classification performance for our task.

Michael, Peter↗

Foundation models for atomistic simulation of chemistry and materials

Conventional computational methods for modeling chemical and materials systems are limited by system size and timescale, forcing a trade-off between quantum-mechanical accuracy and the sampling needed for realistic observables. Large language and vision foundation models — pre-trained on massive datasets using transformer architectures — have revolutionized many fields. It is thus interesting to ask whether a foundation model — subject to suitable data, parameter scaling and training — could enable learned simulations of chemistry and materials. Here, in this study, we review the field of machine-learned interatomic potentials (MLIPs) and posit that scaling up large and diverse chemical and materials datasets and highly expressive architectures using advanced training strategies should result in models that are: more efficient, transferable, robust to out-of-distribution scenarios, and easier to fine-tune to a variety of downstream physical observables than models trained from scratch on small datasets corresponding to specific, targeted atomistic simulation tasks. We provide specific criteria for creating such large-scale MLIP foundation models, coordinated strategies for their development, evaluation and deployment, and highlight potential emergent capabilities that could transform predictive simulations in chemistry and materials science and accelerate discovery across multiple technological domains.

Yuan, Eric C.-Y. [University of California, Berkel↗

Fully Convolutional Spatio-Temporal Models for Representation Learning in Plasma Science

We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important fusion energy science issue that must be resolved for advanced tokamak plasmas such as the $25B burning plasma international thermonuclear experimental reactor (ITER) experiment. While a variety of statistical methods have been used to address the problem of tokamak disruption prediction and control, recent approaches based on deep learning have proven particularly compelling. In the present paper, we introduce further improvements to the fusion recurrent neural network (FRNN) software suite, which delivered cross-machine disruption predictions with unprecedented accuracy using a large database of experimental signals from two major tokamaks. Up to now, FRNN was based on the long short-term memory (LSTM) variant of recurrent neural networks to leverage the temporal information in the data. Here, we implement and apply the "temporal convolutional neural network (TCN)" architecture to the time-dependent input signals. Furthermore, this allows highly optimized convolution operations to carry the majority of the computational load of training, thus enabling a reduction in training time, and the effective use of high-performance computing resources for hyperparameter tuning. At the same time, the TCN-based architecture achieves better predictive performance when compared with the LSTM architecture for various tasks for a representative fusion database.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Nonlinear Optics Measurements in IOTA

Nonlinear integrable optics is a recently proposed accelerator lattice design approach which allows to generate an amplitude dependent tune shift which is needed in high brightness accelerators to mitigate fast coherent instabilities. Whereas usually octupoles are used to achieve this task, this concept allows doing so without exciting any resonances, in turn preventing any particle loss. The concept is based around a special magnet design, together with specific constraints on the optics of the accelerator. To study such a system, the Integrable Optics Test Accelerator (IOTA) was recently constructed and commissioned at Fermilab. For the assessment of the performance of this concept, good knowledge of the optics and the (non-)linear dynamics without the special magnet is of key importance. As such, measurements were conducted in the IOTA ring, using the captured turn-by-turn data by the beam position monitors after excitation to infer quantities such as amplitude detuning and resonance driving terms. In this note, first results of these measurements are presented.

43 PARTICLE ACCELERATORS↗

Decoding Golden Eagle Movement Behavior from High-Resolution, Variable-Rate Telemetry Data Through Bayesian Filtering

The recent advances in animal tracking technology have enabled the collection of a vast amount of in situ data regarding the movement of wildlife at high spatiotemporal resolution. These data are usually available at variable time resolutions and contains noise (error) originating from GPS fixes. Decoding movement characteristics, particularly of flying animals, from telemetry data while handling these factors is a challenging yet important task for conservation purposes. Typically, this task is broken into two subtasks: resampling, and model calibration. The resampling subtask converts the variable rate positional data into a constant time interval data, while the model calibration subtask uses the resampled data to tune time-invariant parameters of the proposed models. For telemetry data at high temporal resolutions (order of 1 second), it is very challenging to decouple noise from actual movements using interpolation-based resampling techniques. Any errors introduced during resampling can significantly alter the the calibration and prediction attributes of the movement model. We address this problem through a unified Bayesian state-space framework that can handle both the resampling and calibration tasks in a single step. In addition, we use the speed and heading of the bird from telemetry data to regularize the position information of the bird. We use a Kalman filtering approach to include these nonlinearly related motion parameters within the state space framework. We cross-validated to quantify how this inclusion affects the model performance in estimating true bird movements. The relationship between the true state of the bird and environmental and topographical covariates is then represented parametrically. These parameters are then tuned using stochastic sampling strategies like Markov Chain Monte Carlo (MCMC). We use the telemetry data collected from golden eagles in the western USA to demonstrate the applicability of this approach to build a predictive, probabilistic movement model. Our preliminary results show that this approach provides improved predictive performance in terms of capturing higher-order motion parameters such as angular and horizontal accelerations, which may have simpler and more direct relationships with environmental covariates than corresponding speeds. In this talk, we will demonstrate how this state-space approach benefits the prediction capabilities of a movement model in simulating golden eagle paths through a wind power plant in Wyoming given certain atmospheric conditions. The model outcomes are aimed at informing mitigation strategies that can minimize the potential for collisions of golden eagles with wind turbines.

Bayesian methods↗

Benchmarking materials property prediction methods: the Matbench test set and Automatminer reference algorithm

Abstract We present a benchmark test suite and an automated machine learning procedure for evaluating supervised machine learning (ML) models for predicting properties of inorganic bulk materials. The test suite, Matbench, is a set of 13 ML tasks that range in size from 312 to 132k samples and contain data from 10 density functional theory-derived and experimental sources. Tasks include predicting optical, thermal, electronic, thermodynamic, tensile, and elastic properties given a material’s composition and/or crystal structure. The reference algorithm, Automatminer, is a highly-extensible, fully automated ML pipeline for predicting materials properties from materials primitives (such as composition and crystal structure) without user intervention or hyperparameter tuning. We test Automatminer on the Matbench test suite and compare its predictive power with state-of-the-art crystal graph neural networks and a traditional descriptor-based Random Forest model. We find Automatminer achieves the best performance on 8 of 13 tasks in the benchmark. We also show our test suite is capable of exposing predictive advantages of each algorithm—namely, that crystal graph methods appear to outperform traditional machine learning methods given ~10 4 or greater data points. We encourage evaluating materials ML algorithms on the Matbench benchmark and comparing them against the latest version of Automatminer.

36 MATERIALS SCIENCE↗

HydraGNN_OPF_GFM_2026 - Ensemble of predictive graph foundation models for power grid applications

This dataset supports research on graph foundation models for optimal power flow (OPF) on electric grids using HydraGNN. It contains heterogeneous graph representations of PGLib-OPF cases spanning systems from 14 to 13,659 buses, together with packed HDF5 datasets for pretraining, feasibility classification, and N-1 contingency analysis. The release includes OPF solution data, downstream fine-tuning datasets, pretrained HeteroSAGE and HeteroHEAT model checkpoints, hyperparameter-optimization summaries across multiple heterogeneous GNN architectures, and aggregated fine-tuning results for sample-efficiency studies. The dataset is designed to enable scalable training, evaluation, and transfer-learning studies for OPF surrogate modeling, including node-level AC-OPF solution prediction, graph-level prediction, feasibility classification, operating-condition generalization, and contingency-response tasks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Generative large language models for predictive maintenance planning

Maintenance planning and the generation of necessary components for tasks can prove time-consuming and complex. Automating the creation of recurring or similar tasks by leveraging previous planning packages and data, while uncovering insights to automate planning package generation, presents an opportunity to conserve valuable time and resources. This work aims to harness the textual and probabilistic capabilities of large language models (LLMs) to automate the generation of planning packages. Utilizing diverse data sources ranging from raw data to handwritten text, both singular and collaborative LLMs are trained and tested. Results demonstrate their capability to generate essential planning package components, effectively replicating the statistical patterns in the data. This demonstrates the use of these tools inside a digital asset for automated planning. This work outlines a methodology for constructing datasets, a training suite, and evaluation methods for LLM-based textual and conversational planning tools utilized in an asset digital twin. Results indicate that the fine-tuned models generate estimated planning information within the statistical ranges observed in real maintenance data. The models achieve high accuracy (>90%) in document question-answering and instruction generation tasks. Furthermore, the conversational retrieval-augmented generation (RAG) assistant system achieves 100% document retrieval accuracy, while conversational information capture exceeds 98% across the majority of work-package assistant modules.

97 MATHEMATICS AND COMPUTING↗

Capsule network-based semantic segmentation model for thermal anomaly identification on building envelopes

Thermography technology is widely used to inspect thermal anomalies in building façade systems. Computer vision-based techniques provide opportunities to autonomously detect such heat anomalies to significantly improve the efficiency of decision-making for building envelope retrofitting and maintenance. Here, in this work, we propose a novel Capsule Network-based deep learning model – CapsLab – that detects and identifies thermal anomalies by semantic segmentation. CapsLab is built based on our proposed prediction-tuning capsule (PT-Capsule) layer. Different from a traditional capsule layer, which consists of part-whole transformation and capsule-routing process, the proposed layer is composed of a prediction and tuning process, which helps decreasing the number of model parameters significantly. While the applicability of traditional Capsule Networks (CapsNets) has been limited to simpler tasks and smaller datasets due to their scalability issue, we can leverage the lightweight of the proposed PT-Capsule layer, and apply it to the semantic segmentation task. In this work, we also employ our previously presented performance metric, referred to as the Anomaly Identification Metric (AIM) (Kakillioglua et al. 2021), to evaluate the segmentation outputs. Traditional performance metrics do not accurately reflect the true performance of the segmentation models in thermal anomaly identification due to the high subjectivity in the annotation process and higher overlap ratio sensitivity of the standard metrics. AIM, on the other hand, is robust to these drawbacks. Experimental results show, both qualitatively and quantitatively, that our proposed segmentation method can effectively segment the thermal anomalies. Specifically, our model provides 9.38% and 13.53% improvements over the baseline model – DeepLabV3+ – based on traditional mIoU score and the AIM score, respectively, while requiring less model parameters and less computation at the same time. In addition, the scores that the AIM metric generates better align with the scores provided by building performance experts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Machine learning-based surrogate models and transfer learning for derivative free optimization of HT-PEM fuel cells

Widespread adoption of high-temperature polymer electrolyte membrane electrochemical systems, such as fuel cells (HT-PEMFCs), requires models and computational tools for accurate optimization and guiding new materials for enhancing performance and durability. In this contribution, knowledge-based modelling and data-driven modelling are combined using Few-Shot Learning and implementing an Automated Machine Learning framework for the generation of Machine Learning-based surrogate models. Applicability of the resulting model for derivative-free optimization is demonstrated. Additionally, a way of considering extrapolation in the optimization task is presented. Results show that although extrapolation is needed to achieve better solutions during optimization, it can be monitored and managed. As a result, tuning the electrode ionomer binder's properties, such as ionic conductivity, in the fuel cell represents a promising pathway for improving HT-PEMFC performance.

08 HYDROGEN↗

Battery State of Health Estimator: Cooperative Research and Development Final Report

NREL has developed a software tool to enable Renewance to estimate the degradation of batteries from basic information such as the type of battery and the application of that battery during its first life, so that used batteries may be evaluated for potential repurposing at low cost. This software tool utilizes NREL's BLAST-Lite battery degradation modeling code, which was updated with additional models for commercially produced lithium-ion batteries as a part of this CRADA. The software tool enables users to input details such as battery type and application so that lifetime estimates can be made without any programming or expert battery knowledge. The application input loads in saved values for parameters such as cycles per year, depth-of-discharge, and other battery operating parameters from a file defined by Renewance. These parameters may be modified to refine simulations for specific batteries. The software tool also incorporates a degradation model optimization tool, whereby existing battery degradation models may be tuned according to measured battery health. This ensures that new models still predict degradation behaviors expected from a certain battery chemistry, but with the overall degradation rate tuned to a specific battery make and model. The new model can then be saved for estimating the degradation of other similar batteries. An additional task was planned to utilize machine-learning to enable battery health diagnosis from rapid EIS measurements to accelerate the screening of used batteries. This task was not completed due to lack of available data for training a machine-learning model. CRADA benefit to DOE, Participant, and US Taxpayer: Further development of open-source software tool BLAST-Lite for predicting the lifetime of commercially produced Lithium-ion batteries (NREL SWR-22-69).

25 ENERGY STORAGE↗