Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Automation of Vulnerability and Patch Management: Information Extraction, Association, and Optimization

Vulnerability and patch management is an integral part of a robust cybersecurity program, yet it grows increasingly complex due to the sheer amount of data that must be analyzed. Particularly in Operational Technology (OT) environments, analysis must be done manually because of the lack of automated solutions. Additionally, there are many steps in this process, from the initial discovery of the vulnerability to the implementation of its remediation, and each step in the process requires different data in order to be performed effectively. In this work, we provide approaches and strategies to assist operators in industrial or OT environments throughout the vulnerability management cycle. Security advisories provide key information about mitigation strategies, or actions that can be taken when a patch is unavailable or cannot be installed. Details of these strategies are not shared in public vulnerability databases and must be found manually. We approach this problem by designing a solution to automatically identify that information within vendor security advisories and retrieve it for operator use. We start with an approach that requires domain-specific knowledge of certain frequently-seen reference websites. Next, an approach that can work on an arbitrary website but relies on certain keywords. Finally, an approach that uses Natural Language Processing (NLP) methods and does not require specific knowledge or keywords. Each of these approaches is more general than its predecessor; we demonstrate high accuracy for all approaches Advisories also often contain details of affected products in non-standard or natural language formats. While this information can be easily understood when read by an operator, the non-standard format acts as a barrier to effective automation. We provide an approach for the first step in this process: identifying vendors in security advisories and mapping them to a standard framework for representing digital assets and software products. We evaluate five established string similarity algorithms, plus one of our own design that combines string similarity and information theory, on the task of mapping vendors to their corresponding entries in the Common Platform Enumeration (CPE) repository. Our results show that our proposed metric outperforms all others. Due to the constraints on time, finances, and personnel for organizations, Large Language Models (LLMs) may seem like attractive opportunities for security operators to speed up information gathering; however, it is still not clear whether LLMs can handle vulnerability management tasks well. To answer this question, we perform an empirical study of LLMs’ ability to provide consistent, accurate information about vulnerabilities in order to guide organizations in their adoption of LLMs. We observe poor performance for all models tested, suggesting that these models are not well-suited to the consistent retrieval of accurate vulnerability information. Finally, once vulnerabilities have been identified and any additional information has been obtained, operators must decide which remediation actions to implement based on their available resources. This already-complex problem becomes even more so when we consider that a vulnerability may have multiple avenues for remediation. We formulate this scenario as two knapsack problems and provide solutions, which we then compare against several existing strategies for vulnerability prioritization seen in real operational environments.

McClanahan, Kylie↗
DOE OSTI2023

Python codes for the paper - "Trade-offs in the latent representation of microstructure evolution"

SAND2024-00946O Python codes used in "Trade-offs in the latent representation of microstructure evolution," a manuscript accepted for publication in Acta Materialia, are part of a repository. The code was developed to perform analysis of microstructure evolution. The repository consists of two main directories: models, which train and test models such as autoencoders and diffusion maps, and analysis, which analyzes microstructures. Source code is used to perform dimensionality reduction of microstructure data for analysis of its evolution in time. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Dingreville, Remi↗
DOE OSTI2021

Numerical Codes for the DESC-LSST Analysis Pipeline: Core Cosmology Library Standard Modules and Beyond wCDM Modules (Final Technical Report)

The overall objective of the project is to investigate and develop specific software modules and analysis components for the software pipeline of LSST Dark Energy Science Collaboration (DESC). Following the key projects of DESC Science Roadmap (SRM), we will write and test computer codes for the Core Cosmology Library (CCL) in order to complete its modules, functionalities, and interface to work with the analysis pipelines from the five science probes of DESC (parts of SRM deliverables CX4.2TJP, CX6.2CS). We will also code modules for CCL to test models beyond w-Cold-Dark-Matter (wCDM) and modification to gravity (MG). Interfaces for MG models will also be developed for the TJPCOSMO software which is the main pipeline of the Theory and Joint Probe (TJP) working group (deliverable TJP2.3). In order to use the full power of LSST data to constrain MG models, we will also work on constraints from nonlinear regime by running and analyzing MG N-Body simulations using a Parameterized-Post-Friedmann framework into the Gadget-2 simulation package (deliverable TJP2.2). Preliminary results for the simulations were obtained in the past. In collaboration with other DESC groups, we plan to make these simulations feedable to cosmic emulators that are practical for likelihood analyzes (deliverable TJP2.2, parts of CX6.2CS). We will also modify and integrate our current codes for consistency tests between data sets and probes into the pipeline (parts of deliverables CX8.2TJP, TJP2.3). We understand that other groups will contribute to some of these objectives but our team will focus and collaborate with others on the particular part of testing MG and models beyond wCDM and refine the DESC pipeline for this purpose. PI has been coordinating his work with the TJP and CS working groups and the DESC management team. PI is a full member of DESC since June 2013. He and his students have been contributing to LSST-DESC activities and work including TJP telecons, collaboration meetings, hack-weeks, and workshops. PI chaired or co-chaired sessions at collaboration meetings and hack-weeks about testing gravity and models beyond wCDM using LSST. He is coordinating the TJP2 projects for testing models beyond wCDM including the writing of DESC-research-note, development of code for pipeline, and N-Body simulations for MG and beyond wCDM models testable with LSST analyses. As stressed in the DESC white paper, SRM, and P5 report, one of the important questions in understanding cosmic acceleration and dark energy is to be able to distinguish whether the acceleration is due to a dark energy component in the universe or a modification to gravity. Answering these questions will have a significant impact on the question of cosmic acceleration and dark energy. The methods that we will use include analytical work, numerical code, and N-Body simulations. A first approach that that we will use consists of using growth rate parameters that enter the perturbed dynamics equations. These parameters take distinctive values for distinct gravity theories and have potential to distinguish between Dark Energy and Modified Gravity. The second method is to look for inconsistencies in Dark Energy parameter spaces using specific combinations of cosmological data sets. Our investigation addresses the Dark Energy problem that is relevant to the mission of the HEP program to understand how our universe works at its most fundamental level. It will allow us to make progress on the HEP mission to explore the nature of Dark Energy and the basic nature of space and time using future surveys such as LSST. The investigation supports the DOE HEP program Cosmic Frontier as it will contribute to the study and understanding of dark energy and fundamental properties of the universe. The investigation contributes directly to LSST-DESC key projects and their deliverables as described in the Science Road-map document to build analysis pipeline and to test dark energy and beyond wCDM models using LSST.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Vadose and Saturated Zone Flow and Transport Model Package Report for the Active Trenches of the Low-Level Burial Grounds, Hanford Site, Washington

This model package report (MPR) documents the development of the integrated vadose and saturated zone flow and transport model developed for the performance assessment of Trenches 31 and 34 in the low-level burial grounds (LLBGs). This modeling capability is intended for use in addressing the analysis requirements outlined in DOE O 435.1, Chg 1, Radioactive Waste Management1. The overall objective of the modeling effort is to provide a basis for making informed disposal decisions pertinent to Trenches 31 and 34. The purpose of the MPR is to document the development of the three-dimensional numerical vadose zone and saturated flow and transport model test case and evaluate its adequacy to support the LLBG performance assessment. The purpose is not to present results for DOE 435.1 decision making. The use of the model to perform base case and sensitivity analysis for the LLBG performance assessment, including inputs and results, is documented separately in subsequent environmental calculation files. This report discusses the development and translation of the conceptual model for flow and contaminant transport into the LLBG performance assessment three-dimensional numerical flow and transport model evaluated using the Subsurface Transport Over Multiple Phases (STOMP©) simulator. The development of representative geologic framework is described along with the implementation of waste release models used to represent contaminant release from waste disposed in the trenches. The report also provides the technical basis for specific model parameters and boundary conditions, along with description of modeling assumptions. This MPR includes certain calculations that are necessary to demonstrate the soundness of the model. Results provided by the model include vadose zone and saturated zone flow fields, and estimates of the possible future concentration in groundwater of technetium-99 and iodine-129 as example test cases. As an evaluation of the test cases, the model estimates of current vadose conditions are compared to available and analogous field and laboratory data, and compared to the results from the original performance assessment model (WHC-EP-0645, Performance Assessment for the Disposal of Low-Level Waste in the 200 West Area Burial Grounds 2 ). The features, events, and processes applicable to vadose zone and saturated zone flow and transport model are identified, and representative initial estimates for various parameters are documented. Note that the parameter estimates presented in this MPR are for illustration purposes, and may or may not reflect values selected for eventual performance assessment. Several key topical discussions (i.e., basis for recharge estimates, basis for vadose zone modeling, basis for saturated zone model development, and calibration) are included, which serve as the groundwork for confidence building for the groundwater pathway modeling and results. Numerical simulation results based on an example test case are included to illustrate the use of the combined saturated-unsaturated model in performance assessment calculations. Sensitivity and uncertainty results are not included in this MPR. Those results will be included in future environmental calculation files. The inclusion of the trapezoidal trench geometry and construction details in the finite difference grid introduces some gross simplifications regarding the trench and liner systems. The model test case presented in this MPR includes the assumption that the trench liner system does not affect flow through or around the trenches after the liner system is assumed to fail. This MPR also includes results of other test cases that involve alternate assumptions about how to incorporate the hydraulic effects of the trenches into the vadose zone of the model. These alternate cases do not attempt to account for the presence of the liner system after its assumed failure either. None of these cases is considered to be the base case at this time. Analysis and alternate cases that attempt to account for the presence of the liner system in greater detail, and its effect on flow through and around it, are to be documented in subsequent environmental calculation files. Depending on the results of those analyses and alternate cases, the eventual base case may involve more detailed inclusion of the effects of the liner system hydraulics.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

A High-Quality Genome-Scale Model for Rhodococcus opacus Metabolism

Rhodococcus opacus is a bacterium that has a high tolerance to aromatic compounds and can produce significant amounts of triacylglycerol (TAG). Here, we present iGR1773, the first genome-scale model (GSM) of R. opacus PD630 metabolism based on its genomic sequence and associated data. The model includes 1773 genes, 3025 reactions, and 1956 metabolites, was developed in a reproducible manner using CarveMe, and was evaluated through Metabolic Model tests (MEMOTE). We combine the model with two Constraint-Based Reconstruction and Analysis (COBRA) methods that use transcriptomics data to predict growth rates and fluxes: E-Flux2 and SPOT (Simplified Pearson Correlation with Transcriptomic data). Growth rates are best predicted by E-Flux2. Flux profiles are more accurately predicted by E-Flux2 than flux balance analysis (FBA) and parsimonious FBA (pFBA), when compared to 44 central carbon fluxes measured by 13C-Metabolic Flux Analysis (13C-MFA). Under glucose-fed conditions, E-Flux2 presents an R2 value of 0.54, while predictions based on pFBA had an inferior R2 of 0.28. We attribute this improved performance to the extra activity information provided by the transcriptomics data. For phenol-fed metabolism, in which the substrate first enters the TCA cycle, E-Flux2’s flux predictions display a high R2 of 0.96 while pFBA showed an R2 of 0.93. We also show that glucose metabolism and phenol metabolism function with similar relative ATP maintenance costs. These findings demonstrate that iGR1773 can help the metabolic engineering community predict aromatic substrate utilization patterns and perform computational strain design.

Roell, Garrett W.↗
DOE OSTI2022

Cross-correlation of Dark Energy Survey Year 3 lensing data with ACT and Planck thermal Sunyaev-Zel’dovich effect observations. I. Measurements, systematics tests, and feedback model constraints

Here we present a tomographic measurement of the cross-correlation between thermal Sunyaev-Zel’dovich (TSZ) maps from Planck and the Atacama Cosmology Telescope and weak galaxy lensing shears measured during the first three years of observations of the Dark Energy Survey. This correlation is sensitive to the thermal energy in baryons over a wide redshift range and is therefore a powerful probe of astrophysical feedback. We detect the correlation at a statistical significance of 21σ, the highest significance to date. We examine the TSZ maps for potential contaminants, including cosmic infrared background and radio sources, finding that cosmic infrared background has a substantial impact on our measurements and must be taken into account in our analysis. We use the cross-correlation measurements to test different feedback models. In particular, we model the TSZ using several different pressure profile models calibrated against hydrodynamical simulations. Our analysis marginalizes over redshift uncertainties, shear calibration biases, and intrinsic alignment effects. We also marginalize over Ω m and σ 8 using Planck or DES priors. We find that the data prefer the model with a low amplitude of the pressure profile at small scales, compatible with a scenario with strong active galactic nuclei feedback and ejection of gas from the inner part of the halos. When using a more flexible model for the shear profile, constraints are weaker, and the data cannot discriminate between different baryonic prescriptions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Single-Bar SMT Creep-Fatigue Testing on Alloy 617 with Software Controls on elastic Follow-Up Feedback in Support of New Creep-Fatigue Design Methodology

The Simplified Model Test (SMT) is one of the alternative ways to calculate the creep-fatigue damage of elevated temperature components. The SMT approach unifies the creep and fatigue damage, simplifying the damage calculation process with improved accuracy. Traditionally, SMT tests has have been conducted through the two bars: first is the driver bar and second is the test bar. The driver bar stays elastic and imposes the confinement to the second bar. This experimental procedure requires two test frames and a large test specimen, which limits the test parameter range and accessibility of this testing procedures. Hence, a single-bar SMT (SB-SMT) tests has been developed to simplify complexity in SMT experiment setup. The software-controlled SB-SMT test process has been introduced which completely replaces the driver bar. This paper discusses the single-bar SMT (SB-SMT) test procedure with software controls. The challenges and critical parameters in the software-controlled SB-SMT procedure are addresses addressed and recommendations are provided. A scoping test with a set of wider strain range, elastic follow-ups and dwell time validated the proposed test procedure.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Benchmark Analysis

Tremendous progress has been achieved in the development of land models and their inclusion in Earth system models (ESMs). However, we still have very limited knowledge on the performance skills of these land models. This chapter introduces benchmark analysis, which is a procedure to measure performance of models against a set of defined standards. The benchmark analysis includes: (1) defining targeted aspects of model performance to be evaluated; (2) testing model performance in comparison with a set of benchmarks; (3) measuring model performance skill through quantitative metrics; and (4) evaluating model performance and offering suggestions for future model improvement.

Luo, Yiqi↗
DOE OSTI2020

The impact of the fiducial cosmology assumption on BAO distance scale measurements

ABSTRACT Standard analysis pipelines for measurements of Baryon Acoustic Oscillations (BAO) in galaxy surveys make use of a fiducial cosmological model to guide the data compression required to transform from observed redshifts and angles to the measured angular and radial BAO peak positions. In order to remove any dependence on the fiducial cosmology from the results, all models compared to the data should mimic the compression and its dependence on the fiducial model. In practice, approximations are made when testing models: (1) There is assumed to be no residual dependence on the fiducial cosmology after reconstruction, (2) differences in the distance–redshift relationship are assumed to match a linear scaling, and (3) differences in clustering between true and fiducial models are assumed to be removed by the free parameters used to null the non-BAO signal. We test these approximations using the current standard measurement procedure with a set of halo catalogues from the aemulus suite of N-body simulations, which span a range of wCDM cosmological models. We focus on reconstruction of the primordial BAO and locating the BAO. For the range of wCDM cosmologies covered by the aemulus suite, we find no evidence for systematic errors in the measured BAO shift parameters α∥ and α⊥ to $\lt 0.1\%$. However, the measured errors $\sigma _{\alpha _{\parallel }}$ and $\sigma _{\alpha _{\bot }}$ show a notable absolute increase by up to +0.001 and +0.002, respectively, in the case that the fiducial cosmology does not match the truth. These effects on the inferred BAO scale will be important, given the precision of measurements expected from future surveys including DESI, Euclid, and WFIRST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Release of a High Temperature Engineering Test Reactor (HTTR) Steady-State Multiphysics Model to the Virtual Test Bed

The National Reactor Innovation Center (NRIC) accelerates the demonstration and deployment of advanced nuclear energy through inspiring stakeholders and the public, empowering innovators, and delivering successful outcomes. The Virtual Test Bed (VTB) supports this mission by providing an open-source repository of advanced test reactor models for industry, academia, and the public to utilize. During my time at Idaho National Laboratory (INL), I: • Verified the input files of the High Temperature Engineering Test Reactor • Generated computational results • Created user documentation for the HTTR • Uploaded a steady-state HTTR model to the Virtual Test Bed • Authored a conference publication on the model

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

The Solar Neighborhood. XLVII. Comparing M-dwarf Models with Hubble Space Telescope Dynamical Masses and Spectroscopy

We use HST/STIS optical spectroscopy of 10 M dwarfs in five closely separated binary systems to test models of M-dwarf structure and evolution. Individual dynamical masses ranging from 0.083 to 0.405 M {sub ⊙} for all stars are known from previous work. We first derive temperature, radius, luminosity, surface gravity, and metallicity by fitting the BT-Settl atmospheric models. We verify that our methodology agrees with empirical results from long-baseline optical interferometry for stars of similar spectral types. We then test whether or not evolutionary models can predict those quantities given the stars’ known dynamical masses and the conditions of coevality and equal metallicity within each binary system. We apply this test to five different evolutionary model sets: the Dartmouth models, the MESA/MIST models, the models of Baraffe et al., the PARSEC models, and the YaPSI models. We find marginal agreement between evolutionary model predictions and observations, with few cases where the models respect the condition of coevality in a self-consistent manner. We discuss the pros and cons of each family of models and compare their predictive power.

47 OTHER INSTRUMENTATION↗