SEARCH · Engineering Papers

Results for “task tuning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

324 records · Page 18

All sources NASA NTRS DOE OSTI

NASA NTRS2010

Ares I First Stage Propulsion System Status

With the retirement of the Space Shuttle inevitable, the US is faced with the need to loft a reliable cost-effective, technologically viable solution to bring the nation s fleet of spacecraft back up to industry standard. It must not only support the International Space Station (ISS), it must also be capable of supporting human exploration beyond low Earth orbit (LEO). NASA created the Constellation Program to develop a new fleet including the launch vehicles, the spacecraft, and the mission architecture to meet those objectives. The Ares First Stage Team is tasked with developing a propulsion system capable of safely, dependably and repeatedly lofting that new fleet. To minimize technical risks and development costs, the Solid Rocket Boosters (SRBs) of Shuttle were used as a starting point in the design and production of a new first stage element. While the first stage will provide the foundation, the structural backbone, power, and control for launch, the new propulsive element will also provide a greater total impulse to loft a safer, more powerful, fleet of space flight vehicles. Substantial design and system upgrades were required to meet the mass and trajectory requisites of the new fleet. Noteworthy innovations and design features include new forward structures, new propellant grain geometry, a new internal insulation system, and a state-of-the art avionics system. Additional advances were in materials and composite structures development, case bond liners, and thermal protection systems. Significant progress has been made in the design, development and testing of the propulsion and avionics systems for the new first stage element. Challenges, such as those anticipated with thrust oscillation, have been better characterized, and are being effectively mitigated. The test firing of the first development motor (DM-1) was a success that validated much of the engineering development to date. Substantive data has been collected and analyzed, allowing the Ares First Stage team to move forward, fine-tune the design, and advance to production of the second development motor (DM-2), which is now in fabrication. This paper will provide an overview of the design, development, challenges, and progress on the production of the new Ares First Stage propulsion system

Priskos, Alex S.↗

DOE OSTI2020

Overcoming small minirhizotron datasets using transfer learning

Minirhizotron technology is widely used to study root growth and development. Yet, standard approaches for tracing roots in minirhiztron imagery is extremely tedious and time consuming. Machine learning approaches can help to automate this task. However, lack of enough annotated training data is a major limitation for the application of machine learning methods. Transfer learning is a useful technique to help with training when available datasets are limited. In this paper, we investigated the effect of pre-trained features from the massives-cale, irrelevant ImageNet dataset and a relatively moderate-scale, but relevant peanut root dataset on switchgrass root imagery segmentation applications. We compiled two minirhizotron image datasets to accomplish this study: one with 17,550 peanut root images and another with 28 switchgrass root images. Both datasets were paired with manually labeled ground truth masks. Deep neural networks based on the U-net architecture were used with different pre-trained features as initialization for automated, precise pixel-wise root segmentation in minirhizotron imagery. We observed that features pre-trained on a closely related but relatively moderate size dataset like our peanut dataset were more effective than features pre-trained on the large but unrelated ImageNet dataset. Here, we achieved high quality segmentation on peanut root dataset with 99.04% accuracy at the pixel-level and overcame errors in human-labeled ground truth masks. By applying transfer learning technique on limited switchgrass dataset with features pre-trained on peanut dataset, we obtained 99% segmentation accuracy in switchgrass imagery using only 21 images for training (fine tuning). Furthermore, the peanut pre-trained features can help the model converge faster and have much more stable performance.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

On the characteristics of the wake of a wind turbine undergoing large motions caused by a floating structure: an insight based on experiments and multi-fidelity simulations from the OC6 project Phase III

This study reports the results of the second round of analyses of the Offshore Code Comparison, Collaboration, Continued, with Correlation and unCertainty (OC6) project Phase III. While the first round investigated rotor aerodynamic loading, here, focus is given to the wake behavior of a floating wind turbine under large motion. Wind tunnel experimental data from the UNsteady Aerodynamics for FLOating Wind (UNAFLOW) project are compared with the results of simulations provided by participants with methods and codes of different levels of fidelity. The effect of platform motion on both the near and the far wake is investigated. More specifically, the behavior of tip vortices in the near wake is evaluated through multiple metrics, such as streamwise position, core radius, convection velocity, and circulation. Additionally, the onset of velocity oscillations in the far wake is analyzed because this can have a negative effect on stability and loading of downstream rotors. Results in the near wake for unsteady cases confirm that simulations and experiments tend to diverge from the expected linearized quasi-steady behavior when the rotor reduced frequency increases over 0.5. Additionally, differences across the simulations become significant, suggesting that further efforts are required to tune the currently available methodologies in order to correctly evaluate the aerodynamic response of a floating wind turbine in unsteady conditions. Regarding the far wake, it is seen that, in some conditions, numerical methods overpredict the impact of platform motion on the velocity fluctuations. Moreover, results suggest that the effect of platform motion on the far wake, differently from original expectations about a faster wake recovery in a floating wind turbine, seems to be limited or even oriented to the generation of a wake less prone to dissipation.

17 WIND ENERGY↗

NASA NTRS1997

Improving Search Properties in Genetic Programming

With the advancing computer processing capabilities, practical computer applications are mostly limited by the amount of human programming required to accomplish a specific task. This necessary human participation creates many problems, such as dramatically increased cost. To alleviate the problem, computers must become more autonomous. In other words, computers must be capable to program/reprogram themselves to adapt to changing environments/tasks/demands/domains. Evolutionary computation offers potential means, but it must be advanced beyond its current practical limitations. Evolutionary algorithms model nature. They maintain a population of structures representing potential solutions to the problem at hand. These structures undergo a simulated evolution by means of mutation, crossover, and a Darwinian selective pressure. Genetic programming (GP) is the most promising example of an evolutionary algorithm. In GP, the structures that evolve are trees, which is a dramatic departure from previously used representations such as strings in genetic algorithms. The space of potential trees is defined by means of their elements: functions, which label internal nodes, and terminals, which label leaves. By attaching semantic interpretation to those elements, trees can be interpreted as computer programs (given an interpreter), evolved architectures, etc. JSC has begun exploring GP as a potential tool for its long-term project on evolving dextrous robotic capabilities. Last year we identified representation redundancies as the primary source of inefficiency in GP. Subsequently, we proposed a method to use problem constraints to reduce those redundancies, effectively reducing GP complexity. This method was implemented afterwards at the University of Missouri. This summer, we have evaluated the payoff from using problem constraints to reduce search complexity on two classes of problems: learning boolean functions and solving the forward kinematics problem. We have also developed and implemented methods to use additional problem heuristics to fine-tune the searchable space, and to use typing information to further reduce the search space. Additional improvements have been proposed, but they are yet to be explored and implemented.

Janikow, Cezary Z.↗

DOE OSTI2023

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

NASA NTRSDate not supplied

Predicting Airport Runway Configurations for Decision-Support Using Supervised Learning

One of the most challenging tasks for air traffic controllers is runway configuration management (RCM). It deals with the optimal selection of runways to operate on (for arrivals and departures) based on traffic, surface wind speed, wind direction, other environmental variables, noise constraints, and several other airport-specific factors. It affects the efficiency of the National Airspace System (NAS) and both surface and airspace operations can benefit from better understanding future runway configurations. In this paper, we present a comprehensive implementation of predictive models for runway configuration estimation from large volumes of historical data. Specifically, operational data from two full years (2018 and 2019) is collected, analyzed, and fused together to build the data product used in this work. The data set differs from prior work in the field in terms of its scope, resolution, and variety of factors collected and considered. Meteorological data is collected from two different sources – current weather conditions from METAR (Meteorological Terminal Aviation Routine Weather Report) and forecast weather conditions from Localized Aviation MOS Program (LAMP). Operational data from the Federal Aviation Administration (FAA) Aviation System Performance Metrics (ASPM) related to scheduled and actual number of arrivals and departures, average taxi times, etc. are collected. NASA’s Sherlock Data Warehouse is used to identify critical information such as go-arounds, and other events that might impact RCM decision-making. All data is collected and aggregated over 15-minute intervals throughout the two years. This provides a resolution like the timescales that might be necessary for runway configuration management decision-making. A variety of supervised learning algorithms are tested including Support Vector Machine, Random Forest, Gradient Boosting, etc. including tuning of the model hyperparameters. The modeling process is applied and presented on two representative U.S. airports – Charlotte Douglas International Airport (KCLT) and Denver International Airport (KDEN). The two airports present different levels of complexity in terms of the total number of configurations used and provide a balanced perspective on the generalizability of the developed approach to other airports in the NAS. Initial results are promising (F1 score of 0.91 at KCLT and 0.83 at KDEN) for data in the test set. The final paper will contain a comprehensive comparison between different models and model building strategies as well as further refined results. Most important predictors for each airport will be identified along with a discussion and recommendations on adapting the framework to other scenarios.

Tejas G Puranik↗

DOE OSTI2025

Knowledge Oriented Graph Unified Transformer (KOGUT) v0.1

KOGUT — Knowledge Oriented Graph Unified Transformer KOGUT implements the Relational Graph Transformer (RelGT) architecture for knowledge graph link prediction in biological domains, with a primary focus on microbial growth media prediction. While the original RelGT (arXiv:2505.10960) targets relational tables, time series, and multi-table databases, KOGUT adapts this architecture for heterogeneous biological knowledge graphs, providing first-in-class AI predictive models for microbial cultivation. Key Adaptations Beyond Original RelGT: - Knowledge Graph Focus: Applied to biological KGs with semantic node types (taxa, chemicals, media, phenotypes, environments) versus generic relational database tables, trained on the KG-Microbe knowledge graph (1.3M entities, 2.9M edges, 24 relation types). - Multimodal Node Encoding: Integrates node labels, categories, descriptions, and synonyms from KG metadata through learned embedding layers—adapting relational column features to graph node attributes with textual semantics. - Extended K-Hop Subgraph Strategy: Optimized neighborhood sampling (3-hop default, configurable up to 200 nodes) tuned for sparse biological networks, building on the original local-global attention framework with biological relation preservation. - Biolink Predicate Preservation: Type-specific transformations for 24 biological edge semantics (occurs_in, consumes, produces, has_phenotype, subclass_of) beyond standard relational foreign keys, enabling multi-relation link prediction. - Inductive Learning Support: Enables zero-shot predictions for novel taxa through feature-based embeddings (temperature, oxygen requirements, gram stain, cell shape), extending the original transductive relational benchmark scope to uncultured microorganisms. CheapSOTA Performance Optimizations (This Distribution): - VQ-EMA Centroid Attention: Vector quantization with exponential moving average for improved global context modeling (+5-10% MRR improvement). - HDF5 Precomputed Data Loading: One-time preprocessing of k-hop subgraphs to eliminate redundant graph traversals (2-5× training speedup). - Distributed Data Parallel Training: Multi-GPU support for scaling to larger knowledge graphs (tested on 4× NVIDIA A100 GPUs at NERSC Perlmutter). - Mixed Precision Training: Automatic mixed precision (AMP) for memory efficiency and faster training. Advantages Over Standard Knowledge Graph Embedding Models: Combines RelGT's proven multi-element tokenization (features, type, hop, structure) with graph-native biological representations, enabling interpretable link prediction across heterogeneous entities that standard embedding models (TransE, RotatE, ComplEx) and table-based transformers cannot directly model. Achieves near-perfect performance on microbial growth media prediction (MRR: 0.9966, Precision@1: 0.9932, Hit@10: 1.0000) while maintaining explainability through attention-based reasoning over biological pathways. Training Data: - KG-Microbe merged knowledge graph: 1,379,337 nodes, 2,960,472 edges - 24 biological relation types including taxonomic hierarchies, metabolic interactions, phenotype associations, and environmental relationships - Primary prediction task: Growth media suitability for microbial taxa (biolink:occurs_in, 50K edges) - Multi-relation capability: Predicts links for any of the 24 relation types, including chemical consumption/production, phenotype associations, and taxonomic classification Citation: Original RelGT Architecture: Dwivedi et al., "Relational Graph Transformer", arXiv:2505.10960, 2025 KOGUT Implementation: Knowledge Oriented Graph Unified Transformer for Microbial Growth Media Prediction Developed at Lawrence Berkeley National Laboratory (LBNL) Trained on NERSC Perlmutter supercomputer

Joachimiak, Marcin [Lawrence Berkeley National Lab↗

DOE OSTI2025

Harnessing distributed GPU computing for generalizable graph convolutional networks in power grid reliability assessments

Although machine learning (ML) has emerged as a powerful tool for rapidly assessing grid contingencies, prior studies have largely considered a static grid topology in their analyses. This limits their application, since they need to be re-trained for every new topology. Here, this paper explores the development of generalizable graph convolutional network (GCN) models by pre-training them across a range of grid topologies and contingency types. We found that a GCN model with auto-regressive moving average (ARMA) layers with a line graph representation of the grid offered the best predictive performance in predicting voltage magnitudes (VM) and voltage angles (VA). We introduced the concept of phantom nodes to consider disparate grid topologies with a varying number of nodes and lines. For pre-training the GCN ARMA model across a variety of topologies, distributed graphics processing unit (GPU) computing afforded us significant training scalability. The predictive performance of this model on grid topologies that were part of the training data is substantially better than the direct current (DC) approximation. Although direct application of the pre-trained model to topologies that are not part of the grid is not particularly satisfactory, fine-tuning with small amounts of data from a specific topology of interest significantly improves predictive performance. In general, this paper highlights the feasibility of training large-scale GNN models to assess the reliability of power grids by considering a wide variety of grid topologies and contingency types. With the advent of foundational models in ML and the exponential increase in GPU computing clusters, generalizable ML models will significantly enhance how utilities manage power systems and make decisions in real-time or near-real-time.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Short-wavelength-sensitive 2 (Sws2) visual photopigment models combined with atomistic molecular simulations to predict spectral peaks of absorbance

For many species, vision is one of the most important sensory modalities for mediating essential tasks that include navigation, predation and foraging, predator avoidance, and numerous social behaviors. The vertebrate visual process begins when photons of the light interact with rod and cone photoreceptors that are present in the neural retina. Vertebrate visual photopigments are housed within these photoreceptor cells and are sensitive to a wide range of wavelengths that peak within the light spectrum, the latter of which is a function of the type of chromophore used and how it interacts with specific amino acid residues found within the opsin protein sequence. Minor differences in the amino acid sequences of the opsins are known to lead to large differences in the spectral peak of absorbance (i.e. the λ max value). In our prior studies, we developed a new approach that combined homology modeling and molecular dynamics simulations to gather structural information associated with chromophore conformation, then used it to generate statistical models for the accurate prediction of λ max values for photopigments derived from Rh1 and Rh2 amino acid sequences. In the present study, we test our novel approach to predict the λ max of phylogenetically distant Sws2 cone opsins. To build a model that can predict the λ max using our approach presented in our prior studies, we selected a spectrally-diverse set of 11 teleost Sws2 photopigments for which both amino acid sequence information and experimentally measured λ max values are known. The final first-order regression model, consisting of three terms associated with chromophore conformation, was sufficient to predict the λ max of Sws2 photopigments with high accuracy. This study further highlights the breadth of our approach in reliably predicting λ max values of Sws2 cone photopigments, evolutionary-more distant from template bovine RH1, and provided mechanistic insights into the role of known spectral tuning sites.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2010

Multi-Stage System for Automatic Target Recognition

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feedforward back-propagation neural network (NN) is then trained to classify each feature vector and to remove false positives. The system parameter optimizations process has been developed to adapt to various targets and datasets. The objective was to design an efficient computer vision system that can learn to detect multiple targets in large images with unknown backgrounds. Because the target size is small relative to the image size in this problem, there are many regions of the image that could potentially contain the target. A cursory analysis of every region can be computationally efficient, but may yield too many false positives. On the other hand, a detailed analysis of every region can yield better results, but may be computationally inefficient. The multi-stage ATR system was designed to achieve an optimal balance between accuracy and computational efficiency by incorporating both models. The detection stage first identifies potential ROIs where the target may be present by performing a fast Fourier domain OT-MACH filter-based correlation. Because threshold for this stage is chosen with the goal of detecting all true positives, a number of false positives are also detected as ROIs. The verification stage then transforms the regions of interest into feature space, and eliminates false positives using an artificial neural network classifier. The multi-stage system allows tuning the detection sensitivity and the identification specificity individually in each stage. It is easier to achieve optimized ATR operation based on its specific goal. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar and video image datasets.

Chao, Tien-Hsin↗

NASA NTRSDate not supplied

VEG-04 PICK-AND-EAT CROP PRODUCTION AND HUMAN RESEARCH ON THE INTERNATIONAL SPACE STATION

Growing fresh, nutritious, palatable produce for crew consumption during spaceflight may provide health-promoting, bioavailable nutrients and enhance the astronaut dietary experience as we move toward longer-duration missions. Tending plants may also serve as a countermeasure for crew psychological stresses associated with spaceflight. However, requirements to support consistent growth of a variety of nutritious crops under spaceflight environmental conditions remain unclear. This study explores the potential to grow crops for consumption on the International Space Station (ISS) using the Veggie vegetable-production system. VEG-04A and B were two flight tests conducted in 2019 with the leafy green crop Mizuna mustard. Mizuna was grown in two Veggie chambers simultaneously, with the chambers set to different red-to-blue light formulations; one Veggie was programmed as “red-rich” and the second as “blue-rich.” Light quality is known to impact plant growth, nutrition, microbiology, and organoleptic characteristics on Earth, and the Veggie flight tests examined how these impacts might differ in microgravity. VEG-04A was a 35-day growth test with a single harvest. VEG-04B, a 58-day test with harvests at four, six, and eight weeks from the same plants, assessed sustained productivity. Challenges with the watering program occurred early during VEG-04A, and several plants failed to survive in both the flight and ground control operations. Thus, prior to VEG-04B, an extra test was conducted to tailor water timing and volumes. This test allowed a fine tuning of methods for VEG-04B, and generally plant survival was better in that experiment. At each harvest, the astronauts froze half of the edible plant tissue to return to Earth and weighed the remaining half using the ISS Mass Measurement Device (MMD). Weighed samples were then cleaned with produce-sanitizing wipes, and consenting crew members participated in organoleptic evaluation of the fresh produce. Organoleptic evaluations were conducted on the Mizuna crops grown in both light treatments, and data from these tests are compared to ground data collected at JSC. The remaining sanitized produce was available for crew consumption as desired. Frozen flight samples were returned for microbial and chemical analyses to assess food safety and nutritional quality. Microbial assessments included culturing and identifying aerobic bacteria, yeasts, and molds, and screening for specific human pathogens. Chemical nutrient analyses included assessing elements, antioxidants, and phenolics in plant tissues. Crew members involved in plant operations completed behavioral health surveys pre-flight, in-flight associated with plant growth and harvest activities, and post-flight. Surveys captured the amount of time spent on different plant-related operations, enjoyment of the different activities, engagement with Veggie, experience interacting with Veggie, and sensory stimulation associated with growing plants in Veggie. Within each study, plant growth did not differ across light treatment or location (flight versus ground). In general, more biomass was produced in most treatments during the longer study, but growth of this crop declined over time with the repeated harvests. On average, bacterial and fungal counts were significantly lower on ground control samples than flight samples, and microbial counts increased with repeated harvests. Light treatment did not influence any elements in tissues tested; however, the growth duration did impact levels of several elements. Organoleptic scores were generally higher in flight, and ground tasters considered samples more bitter. Amount of interaction and responses to Veggie varied widely by individual. Enjoyable tasks had higher impact than non-enjoyable tasks and interacting with Veggie was generally viewed as positive. These tests on ISS are helping to mitigate the risk of an inadequate food supply for long-duration missions by adding fresh vegetables and key nutrients to the crew diet, and indicating which plant care activities are providing behavioral health benefits for the crew. This research was co-funded by the Human Research Program and Space Biology (MTL#1075) in the ILSRA 2015 NRA call. Videos due Jan. 25th.

Veggie↗

DOE OSTI2021

ClimateNet: an expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weather

Abstract. Identifying, detecting, and localizing extreme weather events is a crucial first step in understanding how they may vary under different climate change scenarios. Pattern recognition tasks such as classification, object detection, and segmentation (i.e., pixel-level classification) have remained challenging problems in the weather and climate sciences. While there exist many empirical heuristics for detecting extreme events, the disparities between the output of these different methods even for a single event are large and often difficult to reconcile. Given the success of deep learning (DL) in tackling similar problems in computer vision, we advocate a DL-based approach. DL, however, works best in the context of supervised learning – when labeled datasets are readily available. Reliable labeled training data for extreme weather and climate events is scarce. We create “ClimateNet” – an open, community-sourced human-expert-labeled curated dataset that captures tropical cyclones (TCs) and atmospheric rivers (ARs) in high-resolution climate model output from a simulation of a recent historical period. We use the curated ClimateNet dataset to train a state-of-the-art DL model for pixel-level identification – i.e., segmentation – of TCs and ARs. We then apply the trained DL model to historical and climate change scenarios simulated by the Community Atmospheric Model (CAM5.1) and show that the DL model accurately segments the data into TCs, ARs, or “the background” at a pixel level. Further, we show how the segmentation results can be used to conduct spatially and temporally precise analytics by quantifying distributions of extreme precipitation conditioned on event types (TC or AR) at regional scales. The key contribution of this work is that it paves the way for DL-based automated, high-fidelity, and highly precise analytics of climate data using a curated expert-labeled dataset – ClimateNet. ClimateNet and the DL-based segmentation method provide several unique capabilities: (i) they can be used to calculate a variety of TC and AR statistics at a fine-grained level; (ii) they can be applied to different climate scenarios and different datasets without tuning as they do not rely on threshold conditions; and (iii) the proposed DL method is suitable for rapidly analyzing large amounts of climate model output. While our study has been conducted for two important extreme weather patterns (TCs and ARs) in simulation datasets, we believe that this methodology can be applied to a much broader class of patterns and applied to observational and reanalysis data products via transfer learning.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Progress on Optimizing Wind Farms and Rotor Designs Using Adjoints

Modern wind plants are increasingly tasked with multiple performance objectives. In addition to designing plants that maximize power output and minimize the levelized cost of energy (LCOE), the design and operation of wind plants is increasingly influenced by challenges regarding grid integration of variable generation renewables. This places a growing emphasis on making wind plants more controllable and predictable. WindSE is a Reynolds-averaged Navier-Stokes (RANS) model designed around analytical gradient and adjoint methods, with the ability to capture terrain-induced effects, as shown in Figure 1. The recent addition of an unsteady solver with an actuator line method (ALM) and ongoing work to enable massively parallel optimizations gives it a unique niche to explore coupled plant-level controls and design problems. This code is an open source python package built on the FEniCS framework that utilizes fast, parallel PETSc solvers to model fluid flow throughout wind-farm scale domains. Two recent studies performed using WindSE demonstrate the capability to optimize under a wide variety of flow conditions and objective functions. In the first, we present an optimization focused on modifying the layout of a wind farm with a fixed number of turbines for maximum total power output [1]. This study highlights the ability to quickly perform simulations using the steady Navier-Stokes solver combined with rotors represented as actuator disks while also stressing the importance of capturing terrain-induced effects. Gradient-based optimization using the RANS equations is viable due to the inclusion of efficiently computed adjoint derivatives. We interpret the physical results of the optimal layout and also discuss the computational cost of scaling to larger problems. In the second study, we present the capabilities of the unsteady Navier-Stokes solver, where rotor-blade profiles represented by actuator lines are optimized to enhance wake steering effects and overall power production [2]. We quantify the wind plant performance gains obtained from this type of simultaneous control co-design optimization as compared to optimizing the blade design and yaw independently. Figure 2 shows the differences between a baseline two-turbine system and an optimized system where we fine-tune the blade chord profile. Results and challenges from each study are quickly summarized and used to motivate the current development efforts within WindSE. Current and future work is focused on enabling higher-resolution studies with more degrees of freedom through parallelization of both the simulation and optimization algorithms. We present benchmarking results to show that WindSE performs well in both weak- and strong-scaling tests and further demonstrate that the optimizer obtains the same convergence rates in both shared- and distributed-memory environments. Using larger wind farms, we can study deep-array effects within an optimization context, allowing the use of objective functions that have been previously unstudied. As an example, we present ongoing work on a blockage metric which characterizes the loss of available kinetic energy due to wake effects from multiple upstream turbines.

adjoint optimization↗

DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

DOE OSTI2020

Changes in SSL Device Efficiency and Optical Performance Under Accelerated Aging Conditions

Lighting application efficiency (LAE) describes the efficient delivery of light from the light source to the lighted task and is viewed as a new frontier—increasing energy savings with solid-state lighting (SSL) technologies. The framework for LAE that is proposed by the U.S. Department of Energy (DOE) consists of four major elements: light source efficiency, optical delivery efficiency, spectral efficiency, and intensity effectiveness. This report focuses on a sampling of the available SSL products that can be broadly defined as having modified spectral output because the method of spectra modification has a significant impact on light source efficiency and long-term optical delivery and spectral efficiencies. This report focused on the changes in light source, optical delivery, and spectral efficiencies that occur during aging of SSL devices. An accelerated stress test (AST) regiment was developed for the devices under test (DUTs) examined in this report to provide insights into how the performance of SSL devices change with aging. The AST protocols demonstrate that the SSL products discussed in this report often reduce light source efficiency to achieve different spectral characteristics. In addition, aging of the optical components (e.g., lenses, solder masks) in SSL devices can produce increased light absorption, which negatively impacts optical delivery efficiency and light source efficiency. The modified spectral outputs of the selected SSL products discussed in this report come in a variety of form factors and achieve enhanced optical performance by using a variety of methods. All of the products examined in this study use mid-power light-emitting diodes (MP-LEDs), although the number, configuration, phosphor content, and light-emitting diode (LED) pump of the MP-LEDs differ. Product MS-1 is a 60-watt (W) replacement A19 lamp with a hermetically sealed glass globe, which contains an embedded optical filter to absorb green and yellow emissions, thereby creating a “sunlike” modified spectrum. Product MS-2 is a 60-W replacement A19 lamp with 30 MP-LEDs, and it uses a violet LED pump, along with green and red phosphor emissions, to produce a “healthy” spectrum. This spectrum omits blue emissions in an effort to reduce melanopic lux. Product MS-3 is an LED module consisting of 21 MP-LEDs that use a violet LED pump, along with blue, green, and red phosphors, to produce a “sunlike” spectrum. Products MS-4 and MS-5 are both 6-inch (in) downlights that use a manual switching mechanism so that users can select application-specific correlated color temperatures before installation. Products MS-4 and MS-5 both contain two LED primaries (2,700 Kelvin [K] and 5,000 K) for spectral tuning. Product MS-4 contains 12 MP-LEDs for each LED primary, and Product MS-5 contains 10 MP-LEDs for each LED primary. This report summarizes the overall findings from up to 8,000 hours (hrs) of AST on the lamp DUTs (Products MS-1 and MS-2); up to 5,000 hrs of AST on the LED light engine DUTs (Product MS-3); and up to 7,000 hrs of AST on the downlight DUTs (Products MS-4 and MS-5). The AST procedures used in this study included a room temperature operational life (RTOL) test, an operational life test conducted at 45 degrees Celsius (°C; 45OL) test, an operational life test conducted at 75°C (75OL), a wet high-temperature operational life test performed at 65°C and 90% relative humidity (6590), and a wet high-temperature operational life test performed at 75°C and 75% relative humidity (7575). The AST procedures used for Products MS-1 and MS-2 were RTOL, 45OL, and 6590. The AST procedures used for Products MS-3, MS-4, and MS-5 were RTOL, 75OL, and 7575. During the ASTs described herein, separate populations of each product (three DUTs in each population for Products MS-1, MS-2, MS-4, and MS-5; four DUTs in each population for Product MS-3) were subjected to power cycling of 1 hr on and 1 hr off. The key findings from this study include the following. Enhanced optical performance came at the cost of reduced light source efficiency for the lamps and light engines examined in this study. The optical filter used to produce a “sunlike” spectrum for Product MS-1 reduced light source efficiency by 26%, from 113 lumens per watt (lm/W) to 85 lm/W. Products MS-2 and MS-3 that used a violet-pumped LED to achieve “healthy” and “sunlike” enhanced optical performance, respectively, suffered the largest reduction in initial light source efficiency (49 lm/W for Product MS-2 and 68 lm/W for Products MS-3) perhaps because of the use of violet LED as the optical pump. Product MS-2 also had the poorest color fidelity because of undersaturation of blues and oversaturation of greens and yellows. Chromaticity maintenance of the products in this study was generally good, with parametric failure only occurring for one product at one AST condition (i.e., Product MS-3 at 7575). The chromaticity shift for Product MS-3 in 7575 test conditions resulted from reduced emissions of the broad green and red phosphors used to mimic sunlight in the 500–750 nanometer (nm) range. As a result of these phosphor emission losses, chromaticity shifted toward the more stable violet-pumped LED and blue phosphor. Although chromaticity maintenance was acceptable for most products tested, different chromaticity shift mechanisms were observed for temperature and humidity tests compared with temperature alone for Products MS-1, MS-2, and MS-3. For Product MS-1, a relative increase in green emissions was observed with humidity, which may indicate humidity-accelerated degradation of the optical filter at green wavelengths (optical delivery efficiency reduction) or degradation of the emitters in the red region (spectral efficiency reduction). The violet-pumped products (i.e., MS-2 and MS-3) exhibited different chromaticity shift behavior in the temperature-humidity environments, with Product MS-2 shifting generally yellow because of photo-induced oxidation of the plastic globe (i.e., a reduction of optical delivery efficiency) and Product MS-3 shifting toward violet and blue emitters because of faster loss of emission from green and red phosphors (i.e., a reduction in spectral efficiency). Because of an initial drop in power consumption, the light source efficiency of downlights (Products MS-4 and MS-5) increased at RTOL throughout the test duration. The light source efficiency initially increased during 75OL until a decay in luminous flux maintenance (LFM) dominated light source efficiency, whereas the light source efficiency decreased for the entire 7575 test duration. It was found that increasing the ambient environment of an SSL device from 25°C to 75°C decreases the LFM by 2.7 to 5.5, depending on design of the SSL device. Adding humidity to the system (75OL to 7575) was found to decrease LFM by another factor of approximately 3.0. A common location of failure was identified for the downlights (Products MS-4 and MS-5) operated in the 7575 environment. This failure abruptly occurred between 3,000 to 5,000 hrs of testing on the film capacitor of the electromagnetic interference (EMI) filter near the diode bridge for 11 of the 12 downlights. It is likely that this failure was caused by a combination of the high electrical voltage across the capacitor, the location of the capacitor near the heat sources (e.g., transformers, diode bridges, power resistors), and the high stress environment of 7575. Longer test times are needed to fully understand the LFM, luminous efficacy changes, and chromaticity shifts for some of the products. Because of the high reliability, light source efficiency, and spectral tuning capabilities of LEDs, the expectations of LAE for SSL products are greatly increased over traditional lighting products. The data gathered in this report begin to provide an understanding of the tradeoffs that current SSL products undergo when optimizing the different efficiency elements of LAE. As discussed in this report, the findings from the tests conducted show that the optimization of spectral efficiency can come at the cost of initial light source efficiency. Furthermore, the introduction of violet LEDs can promote long-term optical delivery efficiency degradation, and the introduction of optical filters or new phosphors can lead to unwanted spectral efficiency changes because the ratio of phosphor emitters changes with aging. The data presented in this report also identified a common failure location in 6-in downlights. The results regarding long-term behavior of the modified spectra devices studied provide valuable information about changes to the light source, spectral, and optical delivery efficiencies as the devices age. This information can be used to improve future SSL designs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS2007

The Ares I-1 Flight Test--Paving the Road for the Ares I Crew Launch Vehicle

In accordance with the U.S. Vision for Space Exploration and the nation's desire to again send humans to explore beyond Earth orbit, NASA has been tasked to send human beings to the moon, Mars, and beyond. It has been 30 years since the United States last designed and built a human-rated launch vehicle. NASA is now building the Ares I crew launch vehicle, which will loft the Orion crew exploration vehicle into orbit, and the Ares V cargo launch vehicle, which will launch the Lunar Surface Access Module and Earth departure stage to rendezvous Orion for missions to the moon. NASA has marshaled unique resources from the government and private sectors to perform the technically and programmatically complex work of delivering astronauts to orbit early next decade, followed by heavy cargo late next decade. Our experiences with Saturn and the Shuttle have taught us the value of adhering to sound systems engineering, such as the "test as you fly" principle, while applying aerospace best practices and lessons learned. If we are to fly humans safely aboard a launch vehicle, we must employ a variety of methodologies to reduce the technical, schedule, and cost risks inherent in the complex business of space transportation. During the Saturn development effort, NASA conducted multiple demonstration and verification flight tests to prove technology in its operating environment before relying upon it for human spaceflight. Less testing on the integrated Shuttle system did not reduce cost or schedule. NASA plans a progressive series of demonstration (ascent), verification (orbital), and mission flight tests to supplement ground research and high-altitude subsystem testing with real-world data, factoring the results of each test into the next one. In this way, sophisticated analytical models and tools, many of which were not available during Saturn and Shuttle, will be calibrated and we will gain confidence in their predictions, as we gain hands-on experience in operating the first of two new launch vehicle systems. The Ares I-1 flight test vehicle (FTV) will incorporate a mix of flight and mockup hardware, reflecting a configuration similar in mass, weight, and shape (outer mold line or OML) to the operational vehicle. It will be powered by a four-segment reusable solid rocket booster (RSRB), which is currently in Shuttle inventory, and will be modified to include a fifth, inert segment that makes it approximately the same size and weight as the five segment RSRB, which will be available for the second flight test in 2012. The Ares I-1 vehicle configuration is shown. Each test flight has specific objectives appropriate to the design analysis cycle in progress. The Ares I-1 demonstration test, slated for April 2009, gives NASA its first opportunity to gather critical data about the flight dynamics of the integrated launch vehicle stack, understand how to control its roll during flight, and other characterize the severe stage separation environment that the upper stage will experience during future operational flights. NASA also will begin the process of modifying the launch infrastructure and fine-tuning ground and mission operational scenarios, as NASA transitions from the Shuttle to the Ares/Orion system.

Davis, Stephan R.↗

DOE OSTI2022

Robust Carbon Dioxide Plume Imaging Using Joint Tomographic Inversion of Seismic Onset Time and Distributed Pressure and Temperature Measurements (Final Report)

We develop and demonstrate rapid and cost-effective methodologies for spatiotemporal tracking of CO2 plumes during geologic sequestration using joint inversion of seismic data and distributed pressure and temperature measurements. Key elements of our methodology are: (a) a computationally efficient approach to pressure and temperature propagation, (b) analysis of time lapse seismic data using a novel ‘seismic onset time’ approach to detect fluid front propagation, and (c) data assimilation and uncertainty assessment via joint inversion of pressure, temperature and time lapse seismic data, and (d) validating the numerical tomographic inversion using a CO2 injection demonstration projects, specifically data collected from the from the Petra Nova Parish Holdings CCUS project in the West Ranch Field, Texas and the Chester-16 reef CO2 injection site in Northern Michigan which is part of the DOE Midwestern Carbon Sequestration Project. The research team is led by Texas A&M University and includes Battelle as a subcontractor with support from Shell, Anadarko, Chevron and JX Nippon. A carbon dioxide (CO2) water-alternating-gas (WAG) pilot was conducted to gain insights into tertiary oil recovery potential via CO2 flood in the West Ranch Field as part of the Petra Nova project, the world’s largest post-combustion CO2 capture and utilization initiative. With a fluvial formation geology and large contrasts in permeability, this is a challenging and novel application of CO2 enhanced oil recovery (EOR). We build a predictive dynamic model of the subsurface that incorporates the multiphase and compositional data acquired during the pilot operation. The calibrated model is used for the carbon dioxide plume imaging. The study began with an initialization of the pilot sector model extracted from a calibrated full-field model. The pilot model calibration follows a two-step hierarchical workflow. First, we performed a large-scale update of the permeability distribution by integrating available bottomhole pressure and multiphase production data. In the second step, local permeability field is fine-tuned using a streamline-based method to match CO2 breakthrough times at the producers. The predictive capability of the calibrated model was verified through two blind validation tests: (1) the model showed good agreement with saturation logs acquired at two observation wells; and (2) the model reproduced the CO2 recovery as a fraction of the injected CO2. The use of seismic onset times has shown great promise for integrating near-continuous seismic surveys for updating geologic models. In this study, we analyze the impact of seismic survey frequency on the onset time approach aiming to extend the application of onset time to infrequent seismic surveys. In addition, we quantitatively examine the nonlinearity of the onset time method and compare it to the commonly used amplitude inversion method. We carry out a sensitivity analysis of seismic survey frequency based on the complete seismic survey data (over 175 surveys) of steam injection in a heavy oil reservoir (Peace River Unit) in Canada. Our results show that an adequate onset time map can be obtained from the infrequent seismic surveys by interpolation between seismic surveys as long as there is no change in the dominant underlying physics between the successive surveys. The study also shows that nonlinearity of the onset time method can be -smaller than that of the amplitude inversion method by several orders of magnitude. Application to the Brugge benchmark case shows that the onset time method obtains comparable permeability update as the traditional seismic amplitude inversion method with faster computation and improved convergence characteristics. We extend the streamline-based data integration approach to incorporate distributed temperature sensor (DTS) data using the concept of thermal tracer travel time. Then, a hierarchical workflow composed of evolutionary and streamline methods is employed to jointly history match the DTS and pressure data. Finally, CO2 saturation and streamline maps are used to visualize the CO2 plume movement during the sequestration process. The hierarchical workflow is applied to a carbon sequestration project in a carbonate reef reservoir within the Northern Niagaran Pinnacle Reef Trend in Michigan, USA. The monitoring data set consists of distributed temperature sensing (DTS) data acquired at the injection well and a monitoring well, flowing bottom-hole pressure data at the injection well, and time-lapse pressure measurements at several locations along the monitoring well. The history matching results indicate that the CO2 movement is mostly restricted to the intended zones of injection which is consistent with an independent warm-back analysis of the temperature data. In addition to employing simulation models and inverse methods for CO2 plume imaging, we also initialized a data-driven technology for detecting inter-well connectivity based on production and pressure data. Our machine-learning framework is built on the statistical recurrent unit (SRU) model and interprets well-based injection/production data into inter-well connectivity without relying on a geologic model. We test it on synthetic and field-scale CO2 EOR projects utilizing the water-alternating-gas (WAG) process. The validation of the proposed data-driven inter-well connectivity assessment is performed using synthetic data from simulation models where inter-well connectivity can be easily measured using the streamline-based flux allocation. The SRU model is shown to offer excellent prediction performance on the synthetic case. Despite significant measurement noise and frequent well shut-ins imposed in the field-scale case, the SRU model offers good prediction accuracy, the overall relative error of the phase production rates at most producers ranges from 10% to 30%. It is shown that the dominant connections identified by the data-driven method and streamline method are in close agreement. Texas A&M University, the lead organization in the project, was primarily responsible for the development of tomographic approaches for CO2 plume mapping in conjunction with distributed pressure, temperature and seismic onset time data. Battelle, as a subcontractor, was primarily responsible for the development of analytical and empirical methods for analyzing transient injection rate and pressure data from point/line sources such as injection and monitoring wells. An additional area of emphasis for Battelle was the use of machine learning for such tasks as inferring reservoir connectivity information from injection-production data, and identifying variable importance for machine learning-based proxy models developed from full-physics simulations. The two organizations also collaborated on the application of the tomographic inversion methodology for a field data set.

02 PETROLEUM↗