Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “test approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Graph-based machine learning improves just-in-time defect prediction

The increasing complexity of today’s software requires the contribution of thousands of developers. This complex collaboration structure makes developers more likely to introduce defect-prone changes that lead to software faults. Determining when these defect-prone changes are introduced has proven challenging, and using traditional machine learning (ML) methods to make these determinations seems to have reached a plateau. In this work, we build contribution graphs consisting of developers and source files to capture the nuanced complexity of changes required to build software. By leveraging these contribution graphs, our research shows the potential of using graph-based ML to improve Just-In-Time (JIT) defect prediction. We hypothesize that features extracted from the contribution graphs may be better predictors of defect-prone changes than intrinsic features derived from software characteristics. We corroborate our hypothesis using graph-based ML for classifying edges that represent defect-prone changes. This new framing of the JIT defect prediction problem leads to remarkably better results. We test our approach on 14 open-source projects and show that our best model can predict whether or not a code change will lead to a defect with an F1 score as high as 77.55% and a Matthews correlation coefficient (MCC) as high as 53.16%. This represents a 152% higher F1 score and a 3% higher MCC over the state-of-the-art JIT defect prediction. We describe limitations, open challenges, and how this method can be used for operational JIT defect prediction.

59 BASIC BIOLOGICAL SCIENCES↗

The Escherichia coli MFS-type transporter genes yhjE, ydiM, and yfcJ are required to produce an active bo3 quinol oxidase

Heme-copper oxygen reductases are membrane-bound oligomeric complexes that are integral to prokaryotic and eukaryotic aerobic respiratory chains. Biogenesis of these enzymes is complex and requires coordinated assembly of the subunits and their cofactors. Some of the components are involved in the acquisition and integration of different heme and copper (Cu) cofactors into these terminal oxygen reductases. As such, MFS-type transporters of the CalT family ( e . g ., CcoA) are required for Cu import and heme-Cu B center biogenesis of the cbb 3 -type cytochrome c oxidases ( cbb 3 -Cox). However, functionally homologous Cu transporters for similar heme-Cu containing bo 3 -type quinol oxidases ( bo 3 -Qox) are unknown. Despite the occurrence of multiple MFS-type transporters, orthologs of CcoA are absent in bacteria like Escherichia coli that contain bo 3 -Qox. In this work, we identified a subset of uncharacterized MFS transporters, based on the presence of putative metal-binding residues, as likely candidates for the missing Cu transporter. Using a genetic approach, we tested whether these transporters are involved in the biogenesis of E . coli bo 3 -Qox. When respiratory growth is dependent on bo 3 -Qox, because of deletion of the bd -type Qox enzymes, three candidate genes, yhjE , ydiM , and yfcJ , were found to be critical for E . coli growth. Radioactive metal uptake assays showed that Δ ydiM has a slower 64 Cu uptake, whereas Δ yhjE accumulates reduced 55 Fe in the cell, while no similar uptake defect is associated with Δ ycfJ . Phylogenomic analyses suggest plausible roles for the YhjE, YdiM, and YfcJ transporters, and overall findings illustrate the diverse roles that the MFS-type transporters play in cellular metal homeostasis and production of active heme-Cu oxygen reductases.

59 BASIC BIOLOGICAL SCIENCES↗

Narrow-Band Least-Squares Infrasound Array Processing

Infrasound data from arrays can be used to detect, locate, and quantify a variety of natural and anthropogenic sources from local to remote distances. However, many array processing methods use a single broad frequency range to process the data, which can lead to signals of interest being missed due to the choice of frequency limits or simultaneous clutter sources. In this work, we introduce a new open-source Python code that processes infrasound array data in multiple sequential narrow frequency bands using the least-squares approach. We test our algorithm on a few examples of natural sources (volcanic eruptions, mass movements, and bolides) for a variety of array configurations. Our method reduces the need to choose frequency limits for processing, which may result in missed signals, and it is parallelized to decrease the computational burden. Improvements of our narrow-band least-squares algorithm over broad-band least-squares processing include the ability to distinguish between multiple simultaneous sources if distinct in their frequency content (e.g., microbarom or surf vs. volcanic eruption), the ability to track changes in frequency content of a signal through time, and a decreased need to fine-tune frequency limits for processing. We incorporate a measure of planarity of the wavefield across the array (sigma tau, στ) as well as the ability to utilize the robust least trimmed squares algorithm to improve signal processing and insight into array performance. Our implementation allows for more detailed characterization of infrasound signals recorded at arrays that can improve monitoring and enhance research capabilities.

58 GEOSCIENCES↗

Probabilistic Programming for Transportable Source Characterization and Uncertainty Quantification of the North Korean Nuclear Tests 2006–2017

Here, we introduce a transportable technique to determine the yield and depth of burial (DOB) from seismic source spectra of underground nuclear explosions. We demonstrate this technique on the six declared North Korean nuclear tests. This approach derives source spectra in absolute units from regional phase (Pg) amplitudes by correcting the observations for geometric spreading, attenuation, and site amplification. We couple the source spectra and explosion source models with a probabilistic programming framework that integrates deep learning techniques and Bayesian modeling. This approach permits the exchange of information across various data categories to quantify both the data and model uncertainty. This technique stands out as an innovative use of broad‐area propagation models, making it transportable across various geologic settings. This method proves to be effective in scenarios with diverse and/or limited observational data, even when the source depth is unknown. We present new independent estimates of absolute yield and DOB that are consistent with the prior assessments, underscoring the potential of this method in enhancing transportable nuclear explosion monitoring capabilities.

58 GEOSCIENCES↗

How to GAN Higher Jet Resolution

QCD-jets at the LHC are described by simple physics principles. We show how super-resolution generative networks can learn the underlying structures and use them to improve the resolution of jet images. We test this approach on massless QCD-jets and on fat top-jets and find that the network reproduces their main features even without training on pure samples. In addition, we show how a slim network architecture can be constructed once we have control of the full network performance.

Baldi, Pierre↗

Improving Ni-Based SOFC Anode Resilience and Durability through Secondary Phase Formation

The project used a multi-disciplinary approach to test test if 2° materials, added to traditional cermet components, enhanced SOFC mechanical strength, anode resilience and durability when subjected to electrochemical and environmental redox cycling. Findings from fracture testing, electrochemical studies and operando Raman spectroscopy measurements demonstrated that aluminum titanate (Al 2 TiO 5 or ALT) mechanically mixed with NiO-YSZ cermets confers superior mechanical strength and slower degradation rates under polarization. No deleterious effects from ALT in conversion efficiency were observed. Specific accomplishments included the following: (1) Refined methods used to fabricate ALT enhanced anodes into bi-layer anode supports to achieve high power densities; (2) Compared the effects of adding ALT mechanically to Ni-YSZ powders prior to anode fabrication with adding ALT through infiltration and co-infiltration of YSZ scaffolds; (3) Tested the resilience of these novel materials to electrochemical and environmental redox cycling and thermal stresses commonly encountered in functioning SOFCs; and (4) Characterized the ability of ALT to improve the carbon tolerance of Ni-YSZ anodes operating with dry methane.

01 COAL, LIGNITE, AND PEAT↗

Microcalorimeters for IAEA NML (Annual Report FY2020)

Based on input from Andrey Bosko (IAEA NML) during a visit to LLNL October 17-18, 2019, the project focused on adapting magnetic microcalorimeters (MMCs) for high-resolution decay energy (Q) spectroscopy of actinides. This included fabricating an MMC detector suitable for MeV signals, testing different approaches on how to embed an alpha source inside an absorber, and demonstrating Q-spectroscopy with MMCs.

42 ENGINEERING↗

Space-Time Reduced-Order Modeling for Uncertainty Quantification

This work focuses on the space-time reduced-order modeling (ROM) method for solving large-scale uncertainty quantification (UQ) problems with multiple random coefficients. In contrast with the traditional space ROM approach, which performs dimension reduction in the spatial dimension, the space-time ROM approach performs dimension reduction on both the spatial and temporal domains, and thus enables accurate approximate solutions at a low cost. We incorporate the space-time ROM strategy with various classical stochastic UQ propagation methods such as stochastic Galerkin and Monte Carlo. Numerical results demonstrate that our methodology has significant computational advantages compared to state-of-the-art ROM approaches. By testing the approximation errors, we show that there is no obvious loss of simulation accuracy for space-time ROM given its high computational efficiency.

97 MATHEMATICS AND COMPUTING↗

Intelligent Monitoring System for Real-time Geologic Storage, Optimization, and Reservoir Management

The objective of the subtask was to develop a near-real-time monitoring system for seismic data at the Decatur, IL, geologic carbon sequestration (GCS) site and specifically include fiber-optic cable derived distributed acoustic signal (DAS) data in the process. Owing to the large volumes of data, we opted to utilize existing deep borehole conventional seismic sensors for detection and pull DAS and shallow borehole seismic data once a detection has been made. Unfortunately, the horizontal fiber-optic cables did not yield microseismic signals for use in locating events near the GCS site. Various stacking and filtering approaches were tested without any coherent detection becoming apparent. We attribute the insensitivity to local microseismic events to a lack of coupling in downhole, vertical cable and the non-ideal alignment of the horizontal fiber-optic cable to the vertically polarized seismic energy. Despite the inability to detect and utilize the DAS data from the fiber-optic cables, we developed a general processing framework that enables easy adaptation for future deployment of fiber-optic cables with better suited alignment at Decatur or elsewhere.

Kaven, J. Ole↗

Thermal Ratcheting Analysis of TEDS Packed-bed Thermocline Energy Storage Tank - Modeling Methodology and Data Validation

This report investigates numerical modeling methods for thermal ratcheting analysis of packed-bed thermal energy storage (TES) tank and discusses the validation results via comparison with experimental data. The experimental data obtained from various design characteristics of packed-bed thermocline tanks, including the Thermal Energy Distribution System (TEDS) TES tank at Idaho National Laboratory (INL), were used to validate thermal and mechanical models developed in this study to evaluate the thermal ratcheting potential. The thermal model was shown to predict the transient thermal propagation through the packed-bed thermocline tanks generally well. However, a larger discrepancy was observed during the comparison with the data from TEDS, presumably due to the uncertainty of boundary conditions given from the experiment. Based on the comparative study between the thermal model predictions and experimental data of various packed-bed thermocline tanks, potential improvements were suggested for the future TEDS experiments for more precise validation study. For mechanical (thermally induced stress) analysis, two different modeling approaches were tested to evaluate hoop stress applied to the packed-bed TES tank wall, which is a major cause of thermal ratcheting process: (i) infinite rigidity model and (ii) Drucker-Prager (DP) model. The ‘model (i)’ is a conservative method with infinite rigidity assumption of granular filler inside a TES tank, whereas the ‘model (ii)’ is a method that takes into account more realistic processes such as thermal expansion of filler and tank wall as well as inter-particle interactions during the cyclic operation of a packed-bed TES tank. The validity of each modeling method was examined by comparing the numerical simulation with the experimental data obtained from the packed-bed TES tank for Solar One pilot plant. Then, the effects of various model parameters were discussed to evaluate the thermal ratcheting potential of the TEDS TES tank. The preliminary thermal ratcheting analysis implies that the TEDS TES tank will hold its structural integrity during the normal operation cycles.

25 ENERGY STORAGE↗

Inverse Reinforcement Learning based Bayesian Goal Inference Method for Early Nuclear Proliferation Detection

Traditional methods for detection of nuclear proliferation indicators are usually applied after nuclear proliferation has already occurred. There is a need to advance these methods to perform early detection of nuclear proliferation indicators. In this project, we formulated an early detection problem as a sequential, decision-making, goal inference problem based on research publications of authors, to determine whether it is possible to infer whether an author will publish on a research activity before it has occurred. To develop and test our approach, we selected a civil nuclear activity for our case study. We constructed a state-action-state transition graph from publications of authors associated with the activity and the co-authors of their publications, using titles, abstracts, and author publication sequences. We then used inverse reinforcement learning to model the goal-directed behavior of authors in trajectories that terminate at selected goal states. Using a Bayesian formulation, we computed the probability that authors would reach each selected state from partially observed trajectories of their state transitions in their research topic space. The state with the highest probability was selected as the most probable goal state. Based on our results, we found that 60% of the times we can infer the correct goal state early; sometimes the inference is either delayed, or multiple states could be inferred as goal states. Overall, our results show that it is possible to perform early detection of research activities of authors in a nuclear technology area. Further research is necessary to establish a more accurate understanding of how topic modeling, topic space grid discretization, and the extent of overlap among trajectories of different goal states, affect the goal inference results. The methods developed in this work may be used to enhance data-driven methods for early detection of nuclear proliferation indicators.

97 MATHEMATICS AND COMPUTING↗

Interregional Renewable Energy Zones

A growing number of studies suggest that fundamental changes in the nation’s power sector have major implications for transmission planning (FERC 2022). The changing landscape suggests, among other things, the need for a concerted reexamination of long-distance interregional transmission solutions. Large, long-distance interregional transmission projects have faced institutional obstacles in the past, however (Homer et al. forthcoming). The purpose of this study is to design and test an approach to interregional transmission that can respond both to the evolving needs of the U.S. power system and to the regulatory questions that states and other authorities must consider when approving new investments in transmission.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Technical Report for SMART task 3.3.4

To implement the Fourier Neural Operator (FNO) (Li et al., 2021) as well as the U-Shaped Fourier Neural Operator (U-NO) (Rahman et al., 2022) to forecast the pressure distribution in the subsurface. Furthermore, to test out approaches to work on larger-scale as well as adding physics-based constraints.

58 GEOSCIENCES↗

Off-line Tests of the DM1200 Thermal Catalytic Oxidation (TCO) Unit (Final Report)

The River Protection Project-Waste Treatment Plant (RPP-WTP) Low-Activity Waste (LAW) and High-Level Waste (HLW) feed streams are listed for a variety of hazardous organic compounds. The permitting basis for the WTP systems may necessitate the demonstration of minimum Destruction/Removal Efficiencies (DREs) of such species from any released emissions of up to 99.99%. Results from a previous study on the fate of hazardous organics in the melter itself indicated, not only that DREs for selected test compounds approached 99.99% only at extreme melter conditions, but also that organic compounds not originally present in the feed were actually produced in the melter, In order to ensure that the required DREs for hazardous organics are met, Thermal Catalytic Oxidation (TCO) units were therefore added to both the HLW and LAW off-gas treatment systems, The extent to which these species can be destroyed or removed in the TCO units is therefore an important issue in the design and permitting of the LAW and HLW off-gas treatment systems. A further consideration is that it would be desirable, if possible, to be able to achieve all of the required DRE across the TCO alone. If that is not the case, the DRE would be distributed across several unit operations, which may then become subject to additional operational constraints that may reduce process flexibility. Compliance with the DRE requirements on the basis of the TCO unit alone is also an approach that lends itself to periodic confirmation during operations, since the TCO is located at the back-end of the off-gas treatment system where radioactivity levels are lowest.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Automating the Analysis of Large Language Models Responses through Zero-Shot Question Answering

Recent advancements in Large Language Models (LLMs) have shown significant potential in various applications, yet their evaluation, particularly in zero-shot question answering scenarios, remains a challenging task. In this study, our objective was to explore precision metrics for Large Language Models (LLM) and design and implement a software pipeline to automatically evaluate LLMs' outputs under zero-shot question answering. Zero-shot question answering involves a model providing answers to questions about topics it hasn't seen during training. It leverages the principles of zero-shot learning by relying on semantic understanding and generalization from related knowledge. The data used was metadata from medical databases on congenital heart disease. We explored eleven LLM metrics and selected three for our evaluation: BLEU, BERTScore, and MoverScore. BLEU calculates a score based on the overlap of n-grams (contiguous sequences of n items, typically words) between the machine-generated translation and the reference translations. Higher BLEU scores indicate better correspondence between the machine-generated and human-generated translations. BERTScore is a metric used to evaluate the quality of machine-generated text by measuring the similarity of token embeddings produced by BERT (Bidirectional Encoder Representations from Transformers) between the generated text and reference text. MoverScore is a metric that quantifies the dissimilarity between the distributions of word embeddings from machine-generated text and reference text, emphasizing semantic similarity over exact token overlap. We also introduced HBKI, a composite metric summarizing these approaches. We tested five models —GPT-3, Llama-2, Gemini 1.5 Pro, Solar 10.7B, and Mixtral-8x7b. Our software pipeline, designed and implemented using Object-Oriented Programming principles, allows users to customize the selection and extraction of features for topics of interest in their own research. Our results show that MoverScore delivered the most precise evaluation of the LLM's outputs, while Mixtral-8x7b achieved the best overall performance in extracting metadata from the databases.

97 MATHEMATICS AND COMPUTING↗

Artificial Intelligence for Enhancing Multiscale Analysis: Buildings Focus

This project aims to develop multi-scale building energy data, potentially improving the representation of the U.S. buildings sector in GCAM-USA, an U.S.-focused human-energy-Earth systems model. Existing building energy datasets are typically limited to national or regional levels, which constrains the ability of models to capture fine-scale human-energy-Earth systems interactions and reduces their relevance for decision-making on issues such as energy security, resilience, and energy planning. By leveraging AI and advanced data integration methods, this work fuses multiple existing datasets to enhance the physical and geographic representation of both residential and commercial building energy use. So far, progress includes processing residential building data, designing the data structure for commercial buildings, and testing AI approaches for integrating datasets and addressing spatial-temporal gaps. This effort can not only advances GCAM-USA’s capability in modeling the buildings sector but also supports broader DOE missions, such as developing digital testbeds, enhancing grid resilience analysis, and improving building–energy system modeling at decision-relevant scales.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

To investigate the reciprocal interactions between dielectric barrier discharges and different biological targets in cell culture medium

The objective of this project was to investigate the dynamic interactions between non-thermal plasma (NTP) and biological targets suspended in a physiological liquid medium. The experiments under this collaborative study were designed to combine theoretical and experimental approaches to test the hypothesis that when living cells (and the growth medium surrounding them) encounter plasma, they reciprocally and dynamically modify each other.

59 BASIC BIOLOGICAL SCIENCES↗

Use of Graph Theory and Neural Networks for Microstructural Classification

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Modifications in segmentation also show potential in improving the accuracy of our current pyCHIP classifier. Replacing previous encoders trained on ImageNet with those trained on microscopy images like MicroNet has initially shown better performance at classifying images of irradiated samples. Additionally, different normalization approaches were tested to show no discernable effect on classification. The Louvain method for community detection is analyzed on a set of irradiated samples with different parameters to determine which proved beneficial under what circumstances. We suggest that microscopy experiments be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗