Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “adaptive learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

Next Day Building Load Predictions based on Limited Input Features Using an On-Line Laterally Primed Adaptive Resonance Theory Artificial Neural Network.

Optimal integration of thermal energy storage within commercial building applications requires accurate load predictions. Several methods exist that provide an estimate of a buildings future needs. Methods include component-based models and data-driven algorithms. This work implemented a previously untested algorithm for this application that is called a Laterally Primed Adaptive Resonance Theory (LAPART) artificial neural network (ANN). The LAPART algorithm provided accurate results over a two month period where minimal historical data and a small amount of input types were available. These results are significant, because common practice has often overlooked the implementation of an ANN. ANN have often been perceived to be too complex and require large amounts of data to provide accurate results. The LAPART neural network was implemented in an on-line learning manner. On-line learning refers to the continuous updating of training data as time occurs. For this experiment, training began with a singe day and grew to two months of data. This approach provides a platform for immediate implementation that requires minimal time and effort. The results from the LAPART algorithm were compared with statistical regression and a component-based model. The comparison was based on the predictions linear relationship with the measured data, mean squared error, mean bias error, and cost savings achieved by the respective prediction techniques. The results show that the LAPART algorithm provided a reliable and cost effective means to predict the building load for the next day.

25 ENERGY STORAGE↗

Turn-key constrained parameter space exploration for particle accelerators using Bayesian active learning

Abstract Particle accelerators are invaluable discovery engines in the chemical, biological and physical sciences. Characterization of the accelerated beam response to accelerator input parameters is often the first step when conducting accelerator-based experiments. Currently used techniques for characterization, such as grid-like parameter sampling scans, become impractical when extended to higher dimensional input spaces, when complicated measurement constraints are present, or prior information known about the beam response is scarce. Here in this work, we describe an adaptation of the popular Bayesian optimization algorithm, which enables a turn-key exploration of input parameter spaces. Our algorithm replaces the need for parameter scans while minimizing prior information needed about the measurement’s behavior and associated measurement constraints. We experimentally demonstrate that our algorithm autonomously conducts an adaptive, multi-parameter exploration of input parameter space, potentially orders of magnitude faster than conventional grid-like parameter scans, while making highly constrained, single-shot beam phase-space measurements and accounts for costs associated with changing input parameters. In addition to applications in accelerator-based scientific experiments, this algorithm addresses challenges shared by many scientific disciplines, and is thus applicable to autonomously conducting experiments over a broad range of research topics.

43 PARTICLE ACCELERATORS↗

Practical galaxy morphology tools from deep supervised representation learning

Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several recent approaches at practical tasks crucial for investigating large galaxy samples. The first task is identifying galaxies of similar morphology to a query galaxy. Given a single galaxy assigned a free text tag by humans (e.g. ‘#diffuse’), we can find galaxies matching that tag for most tags. The second task is identifying the most interesting anomalies to a particular researcher. Our approach is 100 per cent accurate at identifying the most interesting 100 anomalies (as judged by Galaxy Zoo 2 volunteers). The third task is adapting a model to solve a new task using only a small number of newly labelled galaxies. Models fine-tuned from our representation are better able to identify ring galaxies than models fine-tuned from terrestrial images (ImageNet) or trained from scratch. We solve each task with very few new labels; either one (for the similarity search) or several hundred (for anomaly detection or fine-tuning). This challenges the longstanding view that deep supervised methods require new large labelled data sets for practical use in astronomy. To help the community benefit from our pretrained models, we release our fine-tuning code zoobot. Zoobot is accessible to researchers with no prior experience in deep learning.

79 ASTRONOMY AND ASTROPHYSICS↗

Elastic distributed training with fast convergence and efficient resource utilization

Distributed learning is now routinely conducted on cloud as well as dedicated clusters. Training with elastic resources brings new challenges and design choices. Prior studies focus on runtime performance and assume a static algorithmic behavior. In this work, by analyzing the impact of of resource scaling on convergence, we introduce schedules for synchronous stochastic gradient descent that proactively adapt the number of learners to reduce training time and improve convergence. Our approach no longer assumes a constant number of processors throughout training. In our experiment, distributed stochastic gradient descent with dynamic schedules and reduction momentum achieves better convergence and significant speedups over prior static ones. Numerous distributed training jobs running on cloud may benefit from our approach.

Cong, Guojing↗

Addressing APC Data Sparsity in Predicting Occupancy and Delay of Transit Buses: A Multitask Learning Approach

Public transit is a vital mode of transportation in urban areas, and its efficiency is crucial for the daily commute of millions of people. To improve the reliability and predictability of transit systems, researchers have developed separate single-task learning models to predict the occupancy and delay of buses at the stop or route level. However, these models provide a narrow view of delay and occupancy at each stop and do not account for the correlation between the two. We propose a novel approach that leverages broader generalizable patterns governing delay and occupancy for improved prediction. We introduce a multitask learning toolchain that takes into account General Transit Feed Specification feeds, Automatic Passenger Counter data, and contextual temporal and spatial information. The toolchain predicts transit delay and occupancy at the stop level, improving the accuracy of the predictions of these two features of a trip given sparse and noisy data. We also show that our toolchain can adapt to fewer samples of new transit data once it has been trained on previous routes/trips as compared to state-of-the-art methods. Finally, we use actual data from Chattanooga, Tennessee, to validate our approach. We compare our approach against the state-of-the-art methods and we show that treating occupancy and delay as related problems improves the accuracy of the predictions. We show that our approach improves delay prediction significantly by as much as 4% in F1 scores while producing equivalent or better results for occupancy.

Zulqarnain, Ammar Bin↗

Advances in genetic tools for metabolic engineering of non-conventional yeasts

Non-conventional yeasts are emerging as powerful alternatives to Saccharomyces cerevisiae for metabolic engineering, owing to their innate stress tolerance, broad substrate utilization, and distinctive metabolic capabilities. These attributes position them as promising chassis for producing biofuels, pharmaceuticals, and specialty chemicals. This review synthesizes recent advances in genetic toolkits for four such species—Pichia kudriavzevii (Issatchenkia orientalis), Starmerella bombicola, Debaryomyces hansenii, and Pachysolen tannophilus—highlighting progress across plasmid architectures (episomal and integrative), identification of autonomously replicating sequences and centromeric elements, and the development of safe-harbor genomic loci. We summarize promoter and terminator libraries enabling tunable expression, the expansion of auxotrophic and antifungal selection markers with recycling strategies, and the rapid adaptation of CRISPR-based systems (Cas9 and Cas12a) with optimized guide RNA expression, multiplex editing, and approaches that enhance homologous recombination (e.g., KU70/80 disruption). We also review landing-pad platforms for modular, repeated integrations and transposon-based tools (e.g., piggyBac) that facilitate multigene pathway assembly. Collectively, these innovations are accelerating design-build-test-learn cycles and enabling precise, scalable engineering of non-conventional yeasts. Remaining challenges—including limited species-specific episomal systems, variable transformation efficiencies, genome-stability concerns, and alternative codon usage—define clear priorities for future toolkit development. Together, these advances and open needs chart a path toward robust, sustainable biomanufacturing using diverse non-conventional yeast chassis.

59 BASIC BIOLOGICAL SCIENCES↗

Bold endeavors: behavioral lessons from polar and space exploration

Anecdotal comparisons frequently are made between expeditions of the past and space missions of the future. Spacecraft are far more complex than sailing ships, but from a psychological perspective, the differences are few between confinement in a small wooden ship locked in the polar ice cap and confinement in a small high-technology ship hurtling through interplanetary space. This paper discusses some of the behavioral lessons that can be learned from previous expeditions and applied to facilitate human adjustment and performance during future space expeditions of long duration.

Non-NASA Center↗

Study of the Genes and Mechanism Involved in the Radioadaptive Response

The radioadaptive response is a phenomenon where exposure to a prior low dose of radiation reduces the level of damage induced by a subsequent high radiation dose. The molecular mechanism behind this is still not well understood. Learning more about the radioadaptive response is critical for long duration spaceflight since astronauts are exposed to low levels of cosmic radiation. The micronucleus assay was used to measure the level of damage caused by radiation. Although cells which were not washed with phosphate buffered saline (PBS) after a low priming dose of 5cGy did not show adaptation to the challenge dose, washing the cells with PBS and giving the cells fresh media after the low dose did allow radioadaptation to occur. This is consistent with the results of a previous publication by another research group. In the present study, genes involved in DNA damage signaling and the oxidative stress response were studied using RT PCR techniques in order to look at changes in expression level after the low dose with or without washing. Our preliminary results indicate that upregulation of oxidative stress response genes ANGPTL7, NCF2, TTN, and SRXN1 may be involved in the radioadaptive response. The low dose of radiation alone was found to activate the oxidative stress response genes GPR156 and MTL5, whereas, washing the cells alone caused relatively robust upregulation of the oxidative stress response genes DUSP1 and PTGS2. Washing after the priming dose showed some changes in the expression level of several DNA damage signaling genes. In addition, we studied whether washing the cells after the priming dose has an effect on the level of nitric oxide in both the media and cells, since nitric oxide levels are known to increase in the media of the cells after a high dose of radiation only if the cells were already exposed to a low priming dose. Based on this preliminary study, we propose that washing the cells after priming exposure actually eliminates some factor secreted by the cells that inhibits radioadaptation leading to the upregulation of some genes which initiates the response.

Dasgupta, Pushan R.↗

AI Benchmark Democratization and Carpentry

Benchmarks are a cornerstone of modern machine learning, enabling reproducibility, comparison, and scientific progress. However, AI benchmarks are increasingly complex, requiring dynamic, AI-focused workflows. Rapid evolution in model architectures, scale, datasets, and deployment contexts makes evaluation a moving target. Large language models often memorize static benchmarks, causing a gap between benchmark results and real-world performance. Beyond traditional static benchmarks, continuous adaptive benchmarking frameworks are needed to align scientific assessment with deployment risks. This calls for skills and education in AI Benchmark Carpentry. From our experience with MLCommons, educational initiatives, and programs like the DOE's Trillion Parameter Consortium, key barriers include high resource demands, limited access to specialized hardware, lack of benchmark design expertise, and uncertainty in relating results to application domains. Current benchmarks often emphasize peak performance on top-tier hardware, offering limited guidance for diverse, real-world scenarios. Benchmarking must become dynamic, incorporating evolving models, updated data, and heterogeneous platforms while maintaining transparency, reproducibility, and interpretability. Democratization requires both technical innovation and systematic education across levels, building sustained expertise in benchmark design and use. Benchmarks should support application-relevant comparisons, enabling informed, context-sensitive decisions. Dynamic, inclusive benchmarking will ensure evaluation keeps pace with AI evolution and supports responsible, reproducible, and accessible AI deployment. Community efforts can provide a foundation for AI Benchmark Carpentry.

von Laszewski, Gregor [Virginia U.]↗

Integrated deep learning framework for unstable event identification and disruption prediction of tokamak plasmas

Abstract The ability to identify underlying disruption precursors is key to disruption avoidance. In this paper, we present an integrated deep learning (DL) based model that combines disruption prediction with the identification of several disruption precursors like rotating modes, locked modes, H-to-L back transitions and radiative collapses. The first part of our study demonstrates that the DL-based unstable event identifier trained on 160 manually labeled DIII-D shots can achieve, on average, 84% event identification rate of various frequent unstable events (like H-L back transition, locked mode, radiative collapse, rotating MHD mode, large sawtooth crash), and the trained identifier can be adapted to label unseen discharges, thus expanding the original manually labeled database. Based on these results, the integrated DL-based framework is developed using a combined database of manually labeled and automatically labeled DIII-D data, and it shows state-of-the-art (AUC = 0.940) disruption prediction and event identification abilities on DIII-D. Through cross-machine numerical disruption prediction studies using this new integrated model and leveraging the C-Mod, DIII-D, and EAST disruption warning databases, we demonstrate the improved cross-machine disruption prediction ability and extended warning time of the new model compared with a baseline predictor. In addition, the trained integrated model shows qualitatively good cross-machine event identification ability. Given a labeled dataset, the strategy presented in this paper, i.e. one that combines a disruption predictor with an event identifier module, can be applied to upgrade any neural network based disruption predictor. The results presented here inform possible development strategies of machine learning based disruption avoidance algorithms for future tokamaks and highlight the importance of building comprehensive databases with unstable event information on current machines.

plasma instabilities↗

Assembling a Cyber Range to Evaluate Artificial Intelligence / Machine Learning (AI/ML) Security Tools

In this case study, we will describe the design and assembly of a cyber security test range we have built at Oak Ridge National Laboratory in Oak Ridge, TN, USA. The range is designed to provide a flexible environment to evaluate cyber security tools—particularly those involving AI/ML—in a way that provides realistic environments and where we can control the experiments to determine the strengths and weaknesses of the tools. We have designed in the ability to repeat the evaluations, so additional tools can be evaluated and compared at a later time. The system is one that can be scaled up or down for experiment sizes. At the time of the conference we will have completed two full-scale, national, government challenges on this range. These challenges are evaluating the performance and operating costs for AI/ML-based cyber security tools for application into large, government-sized environments. These evaluations will be described, in order to provide motivation and context for various design decisions and adaptations we have made. The first challenge measured end-point security tools against 100K malware samples chosen across a range of types. The second is network detection of attempted penetration and exploitations with varying levels of covertness in a high-volume, business network. The scale of each of these challenges is requiring us to create automation systems to repeat the experiments identically for each tool. Preventing there being easy signs of malicious activity for the AI/ML tools to focus on has been a particularly interesting and challenging aspect of designing and executing these challenge events. After the events, the range continues to be used for other research such as adversarial machine learning where the repeatability, scale, and automation required for the national challenge events become essential elements for research.

Nichols, Jeff↗

Full Scale Advanced Systems Testbed (FAST): Capabilities and Recent Flight Research

At the NASA Armstrong Flight Research Center research is being conducted into flight control technologies that will enable the next generation of air and space vehicles. The Full Scale Advanced Systems Testbed (FAST) aircraft provides a laboratory for flight exploration of these technologies. In recent years novel but simple adaptive architectures for aircraft and rockets have been researched along with control technologies for improving aircraft fuel efficiency and control structural interaction. This presentation outlines the FAST capabilities and provides a snapshot of the research accomplishments to date. Flight experimentation allows a researcher to substantiate or invalidate their assumptions and intuition about a new technology or innovative approach Data early in a development cycle is invaluable for determining which technology barriers are real and which ones are imagined Data for a technology at a low TRL can be used to steer and focus the exploration and fuel rapid advances based on real world lessons learned It is important to identify technologies that are mature enough to benefit from flight research data and not be tempted to wait until we have solved all the potential issues prior to getting some data Sometimes a stagnated technology just needs a little real world data to get it going One trick to getting data for low TRL technologies is finding an environment where it is okay to take risks, where occasional failure is an expected outcome Learning how things fail is often as valuable as showing that they work FAST has been architected to facilitate this type of testing for control system technologies, specifically novel algorithms and sensors Rapid prototyping with a quick turnaround in a fly-fix-fly paradigm Sometimes it's easier and cheaper to just go fly it than to analyze the problem to death The goal is to find and test control technologies that would benefit from flight data and find solutions to the real barriers to innovation. The FAST vehicle is a flexible laboratory for nascent technologies that would benefit from early life cycle flight research data It provides a robust and safe environment where innovative techniques can be explored in a fly-fix-fly rapid prototyping paradigm IRAC Simple adaptive control technologies can provide real benefits without undo complexity Adverse pilot/adaptive system interactions can be mitigated and tools have been developed to evaluate those interactions ICP Substantial fuel savings can be achieved over a broad range of vehicles and configurations with intelligent control solutions LVAC The AAC design is robust and effective for the SLS mission, and promises to provide benefits to other platforms as well OCLA Hopefully will show that structural feedback can be seamlessly integrated with performance and stability objectives All of these control technologies have been implemented into the same baseline control law and could be combined into one control solution that answers many pressing questions for modern vehicle configurations

flight controls↗

Comprehensive Chemical Fingerprinting by Multidimensional GC and Supervised Machine Learning

This project leveraged advances in machine learning based data analysis techniques and untargeted analytical methods for organic analysis to progress nuclear nonproliferation technologies beyond current capabilities. The developed approaches can be used to detect and identify complex chemical fingerprints of facilities of interest. These techniques have been developed for fields such as metabolomics and genomics but have not been applied to nuclear nonproliferation applications. Adaptation of these techniques for volatile organic compound analysis has far reaching application within the scientific community including environmental chemistry, atmospheric physics, and climate sciences.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Recent Enhancements of the Phased Array Mirror Extendible Large Aperture (PAMELA) Telescope Testbed at MSFC

Recent incremental upgrades to the Phased Array Mirror Extendible Large Aperture (PAMELA) telescope testbed have enabled the demonstration of phasing (with a monochromatic source) of clusters of primary mirror segments down to the diffraction limit. PAMELA upgrades include an improved Shack-Hartmann wavefront sensor, passive viscoelastic damping treatments for the voice-coil actuators, mechanical improvement of mirror surface figures, and optical bench baffling. This report summarizes the recent PAMELA upgrades, discusses the lessons learned, and presents a status of this unique testbed for wavefront sensing and control. The Marshall Space Flight Center acquired the Phased Array Mirror Extendible Large Aperture (PAMELA) telescope in 1993 after Kaman Aerospace was unable to complete integration and testing under the limited SDIO and DARPA funding. The PAMELA is a 36-segment, half-meter aperture, adaptive telescope which utilizes a Shack-Hartmann wavefront sensor, inductive coil edge sensors, voice coil actuators, imaging CCD cameras and interferometry for figure alignment, wavefront sensing and control. MSFC originally obtained the PAMELA to supplement its research in the interactions of control systems with flexible structures. In August 1994, complete tip, tilt and piston control was successfully demonstrated using the Shack-Hartmann wavefront sensor and the inductive edge sensors.

Rakoczy, John↗

Recent Enhancements of the Phased Array Mirror Extendible Large Aperture (PAMELA) Telescope Testbed at MSFC

Recent incremental upgrades to the Phased Array Mirror Extendible Large Aperture (PAMELA) telescope testbed have enabled the demonstration of phasing (with a monochromatic source) of clusters of primary mirror segments down to the diffraction limit. PAMELA upgrades include in improved Shack-Hartmann wavefront sensor, passive viscoelastic damping treatments for the voice-coil actuators, mechanical improvement of mirror surface figures, and optical bench baffling. This report summarizes the recent PAMELA upgrades, discusses the lessons learned, and presents a status of this unique testbed for wavefront sensing and control. The Marshall Space Flight Center acquired the Phased Array Mirror Extendible Large Aperture (PAMELA) telescope in 1993 after Kaman Aerospace was unable to complete integration and testing under the limited SDIO and DARPA funding. The PAMELA is a 36-segment, half-meter aperture, adaptive telescope which utilizes a Shack-Hartmann wavefront sensor, inductive coil edge sensors, voice coil actuators, imaging CCD cameras and interferometry for figure alignment, wavefront sensing and control. MSFC originally obtained the PAMELA to supplement its research in the interactions of control systems with flexible structures. In August 1994, complete tip, tilt and piston control was successfully demonstrated using the Shack-Hartmann wavefront sensor and the inductive edge sensors.

Rakoczy, John↗

SIMPLIFIED PREDICTIVE MODELS FOR CO₂ SEQUESTRATION PERFORMANCE ASSESSMENT RESEARCH TOPICAL REPORT ON TASK #3 STATISTICAL LEARNING BASED MODELS

We compare two approaches for building a statistical proxy model (metamodel) for CO₂ geologic sequestration from the results of full-physics compositional simulations. The first approach involves a classical Box-Behnken or Augmented Pairs experimental design with a quadratic polynomial response surface. The second approach used a space-filling maxmin Latin Hypercube sampling or maximum entropy design with the choice of five different meta-modeling techniques: quadratic polynomial, kriging with constant and quadratic trend terms, multivariate adaptive regression spline (MARS) and additivity and variance stabilization (AVAS). Simulations results for CO₂ injection into a reservoir-caprock system with 9 design variables (and 97 samples) were used to generate the data for developing the proxy models. The fitted models were validated with using an independent data set and a cross-validation approach for three different performance metrics: total storage efficiency, CO₂ plume radius and average reservoir pressure. The Box-Behnken–quadratic polynomial metamodel performed the best, followed closely by the maximin LHS–kriging metamodel.

Mishra, Srikanta↗

Developing a Descriptor-Based Approach for CO and NO Adsorption Strength to Transition Metal Sites in Zeolites

The discovery of new materials tailored for a given application typically requires the screening of a large number of compounds, and this process can be significantly accelerated by computational analysis. In such an approach the performance of a compound is correlated to a materials property, a so-called descriptor. Here we develop a descriptor-based approach for the adsorption of CO and NO to Cu, Ni, Co, and Fe sites in zeolites. Here we start out by discussing a possible design strategy for zeolite catalysts, define the studied test set of sites in the zeolites SSZ-13 and mordenite, and define a set of appropriate descriptors. In a subsequent step we use these descriptors in single-parameter, two-parameter, and multiparameter regression analysis and finally use a machine-learning genetic algorithm to reduce the number of variables. We find that one or two descriptors are not sufficient to accurately capture the interactions between molecules and metal centers in zeolites, and indeed a multiparameter approach is necessary. Even though many of the descriptors are directly correlated, we identify the position of the s orbital and the number of valence electrons of the active site as well as the HOMO–LUMO gap of the adsorbate as most important descriptors. Furthermore, the reconstruction of the active sites upon adsorption plays a crucial role, and when it is explicitly included in the analysis, correlations improve significantly. In the future we expect that the fundamental methodology developed here will be adapted and transferred to selected problems in adsorption and catalysis and will assist the rational design of materials for the given application.

36 MATERIALS SCIENCE↗

From sequence to protein structure and conformational dynamics with artificial intelligence/machine learning

The 2024 Nobel Prize in Chemistry was awarded in part for de novo protein structure prediction using AlphaFold2, an artificial intelligence/machine learning (AI/ML) model trained on vast amounts of sequence and three-dimensional structure data. AlphaFold2 and related models, including RoseTTAFold and ESMFold, employ specialized neural network architectures driven by attention mechanisms to infer relationships between sequence and structure. At a fundamental level, these AI/ML models operate on the long-standing hypothesis that the structure of a protein is determined by its amino acid sequence. More recently, AlphaFold2 has been adapted for the prediction of multiple protein conformations by subsampling multiple sequence alignments. Herein, we provide an overview of the deterministic relationship between sequence and structure, which was hypothesized over half a century ago with profound implications for the biological sciences ever since. We postulate that protein conformational dynamics are also determined, at least in part, by amino acid sequence and that this relationship may be leveraged for construction of AI/ML models dedicated to predicting protein conformational ensembles. Accordingly, we describe a conceptual model architecture, which may be trained on sequence data in combination with conformationally sensitive structural information, coming primarily from nuclear magnetic resonance (NMR) spectroscopy. Notwithstanding certain limitations in this context, NMR offers abundant structural heterogeneity conducive to conformational ensemble prediction. As NMR and other data continue to accumulate, sequence-informed prediction of protein structural dynamics with AI/ML has the potential to emerge as a transformative capability across the biological sciences.

Artificial intelligence↗