Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The Impact of Ethylenediaminetetraacetic Acid (EDTA) on the Sorption of Nd(III), Th{sup (IV)}, and U(VI) onto Dolomite in WIPP-Relevant Brines, GWB and ERDA-6 - 20356

Storage of legacy, transuranic waste at the Waste Isolation Pilot Plant (WIPP) requires accurate risk models for performance assessments. These models must predict the long-term fate and transport of contaminants in the WIPP and surrounding environment. Laboratory support is necessary for the development of an accurate model through better understanding of contaminant behavior in the WIPP. The WIPP is a deep geologic repository that is characterized by high ionic strength due to evaporite deposits in the Salado formation (porewaters up to 7.4 M). High concentrations of sodium chloride (NaCl), calcium chloride (CaCl{sub 2}), and magnesium chloride (MgCl{sub 2}) are particularly of concern due to their potential impact on solubility and ultimately transport of contaminants of concern. Additionally, ligands capable of forming strong complexes with metals are found in significant concentrations in the WIPP environment due to their disposal from waste processing and formation during degradation of repository components (e.g. cellulose degradation by calcium hydroxide in cement). Consequently, there is a need to investigate the fate and transport of contaminants in the WIPP environment with a focus on the effects of high ionic strength and strongly coordinating ligands. Contaminants of high concern include the actinides (U(VI), Pu(IV), and Am(III)). Laboratory support of the WIPP modeling efforts was provided by this research. A series of batch experiments were utilized to study the impact of ionic strength, contaminant concentration, and the presence of ethylenediaminetetraacetic acid (EDTA) on the sorption of Nd(III), Th(IV), and U(VI) onto dolomite, a carbonate mineral found within the Culebra formation. The Culebra formation is the most transmissive layer above the WIPP, making transport of contaminants the most likely route in previous risk assessments. Two brines specifically designed to imitate conditions within the WIPP environment were used in these experiments. The U.S. Energy Research and Development Administration Well 6 (ERDA-6, 95%) brine simulates a low Mg environment, while the generic weep brine (GWB, 95%) simulates the WIPP environment with a high Mg concentration. Mg is added to the repository in the form of MgO as an engineered barrier and is naturally present in some formations. It is expected to scavenge carbonate from solutions decreasing formation of the highly soluble and competitive uranium-carbonate complexes. EDTA is used during manipulations of nuclear materials due to its ability to form strong, stable complexes with the actinides and may be found in high concentrations (up to 0.08 mM) within the WIPP as waste canisters degrade. Further, it may provide additional avenues for unwanted transport of contaminants. Nd(III) and Th(IV) were used as stable analogues of Am(III) and Pu(IV), respectively, to represent the most common oxidation states of actinides in the WIPP environment in addition to U(VI). The potential for colloid formation was also investigated with low and high concentrations of contaminants (10 and 1000 μg/L) using three size-dependent particle separation steps. The results of this research provide a better understanding of potential behavior of actinides in the presence of EDTA and within WIPP-relevant brines. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Enhancement of HLW glass property-composition models

Since the WTP compositional space of HLW glasses is extremely large, development of HLW property-composition models is a multi-year task consisting of multiple phases. The primary focus of this work was to enhance the WTP HLW models of interest including PCT releases, spinel crystallization (T1%), viscosity, electrical conductivity, and TCLP-Cd response. Model development to predict nepheline formation upon CCC is the subject of a separate task. In particular, the earlier work has produced property-composition models for glass melt viscosity and glass melt electrical conductivity that showed good performance, while models for PCT releases and spinel crystallization (T1%) required improvement. Therefore, more efforts were directed in the present work to collect data and improve model performance for HLW glass PCT releases and spinel crystallization than for other properties. The present work is a continuation of earlier development phases and is responsive to the applicable Test Plan.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Simulating Long–Term Dynamics of Radiation Belt Electrons Using DREAM3D Model

Here, we compared the performance of DREAM3D simulations in reproducing the long-term radiation belt dynamics observed by Van Allen Probes over the entire year of 2017 with various boundary conditions (BCs) and model inputs. Specifically, we investigated the effects of three different outer boundary conditions, two different low-energy boundary conditions for seed electrons, four different radial diffusion (RD) coefficients (DLL), four hiss wave models, and two chorus wave models from the literature. Using the outer boundary condition driven by GOES data, our benchmark simulation generally well reproduces the observed radiation belt dynamics inside L* = 6, with a better model performance at lower μ than higher μ, where μ is the first adiabatic invariant. By varying the boundary conditions and inputs, we find that: (a) The data-driven outer boundary condition is critical to the model performance, while adding in the data-driven seed population doesn't further improve the performance. (b) The model shows comparable performance with DLL from Brautigam and Albert (2000, https://doi.org/10.1029/1999ja900344), Ozeke et al. (2014, https://doi.org/10.1002/2013ja019204), and Liu et al. (2016, https://doi.org/10.1002/2015gl067398), while with DLL from Ali et al. (2016, https://doi.org/10.1002/2016ja023002) the model shows less RD compared to data. (c) The model performance is similar with data-based hiss models, but the results show faster loss is still needed inside the plasmasphere. (d) The model performs similarly with the two different chorus models, but better capturing the electron enhancement at higher μ using the Wang et al. (2019, https://doi.org/10.1029/2018ja026183) model due to its stronger wave power, since local heating for higher energy electrons is under-reproduced in the current model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Inverse Modeling of Hydrologic Parameters in CLM4 via Generalized Polynomial Chaos in the Bayesian Framework

In this work, generalized polynomial chaos (gPC) expansion for land surface model parameter estimation is evaluated. We perform inverse modeling and compute the posterior distribution of the critical hydrological parameters that are subject to great uncertainty in the Community Land Model (CLM) for a given value of the output LH. The unknown parameters include those that have been identified as the most influential factors on the simulations of surface and subsurface runoff, latent and sensible heat fluxes, and soil moisture in CLM4.0. We set up the inversion problem in the Bayesian framework in two steps: (i) building a surrogate model expressing the input–output mapping, and (ii) performing inverse modeling and computing the posterior distributions of the input parameters using observation data for a given value of the output LH. The development of the surrogate model is carried out with a Bayesian procedure based on the variable selection methods that use gPC expansions. Our approach accounts for bases selection uncertainty and quantifies the importance of the gPC terms, and, hence, all of the input parameters, via the associated posterior probabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Indirect Tool Condition Monitoring Using Ensemble Machine Learning Techniques

Abstract Tool condition monitoring (TCM) has become a research area of interest due to its potential to significantly reduce manufacturing costs while increasing process visibility and efficiency. Machine learning (ML) is one analysis technique which has demonstrated advantages for TCM applications. However, the commonly studied individual ML models lack generalizability to new machining and environmental conditions, as well as robustness to the unbalanced datasets which are common in TCM. Ensemble ML models have demonstrated superior performance in other fields, but have only begun to be evaluated for TCM. As a result, it is not well understood how their TCM performance compares to that of individual models, or how homogeneous and heterogeneous ensemble models’ performances compare to one another. To fill in these research gaps, milling experiments were conducted using various cutting conditions, and the model groups were compared across several performance metrics. Statistical t-tests were also used to evaluate the significance of model performance differences. Through the analysis of four individual ML models and five ensemble models, all based on the processes’ sound, spindle power, and axial load signals, it was found that on average, the ensemble models performed better than the individual models, and that the homogeneous ensembles outperformed the heterogeneous ensembles.

Engineering↗
DOE OSTI2025

ERF: Energy Research and Forecasting Model

High performance computing (HPC) architectures have undergone rapid development in recent years. As a result, established software suites face an ever increasing challenge to remain performant on and portable across modern systems. Many of the widely adopted atmospheric modeling codes cannot fully (or in some cases, at all) leverage the acceleration provided by General-Purpose Graphics Processing Units, leaving users of those codes constrained to increasingly limited HPC resources. Energy Research and Forecasting (ERF) is a regional atmospheric modeling code that leverages the latest HPC architectures, whether composed of only Central Processing Units (CPUs) or incorporating GPUs. ERF contains many of the standard discretizations and basic features needed to model general atmospheric dynamics. The modular design of ERF provides a flexible platform for exploring different physics parameterizations and numerical strategies. ERF is built on a state-of-the-art, well-supported, software framework (AMReX) that provides a performance portable interface and ensures ERF's long-term sustainability on next generation computing systems. This paper details the numerical methodology of ERF, presents results for a series of verification/validation cases, and documents ERF's performance on current HPC systems. The roughly 5× speed up of ERF (using GPUs) over Weather Research and Forecasting (CPUs only) for a 3D squall line test case highlights the significance of leveraging GPU acceleration.

17 WIND ENERGY↗
DOE OSTI2023

Degradation of Insulating Glass Units: Thermal Performance, Measurements and Energy Impacts

Insulating glass unit (IGU) degradation has been studied extensively. However, there is limited understanding of how present durability evaluation standards relate to product lifetime. Furthermore, there is debate on how to quantify performance of installed windows over time to better understand degradation processes. More knowledge on these topics is required to link durability evaluation to product lifetime projections based on energy performance. Energy models provide helpful estimations of total annual building energy consumption. However, most models are based on “as installed” performance of envelope components and fail to account for performance degradation. This can lead to an underestimation of building lifetime energy consumption. A better understanding of the relationship between durability and energy performance can inform integration of degradation dynamics into energy modeling software. This will improve lifetime building energy consumption estimations as well as inform appropriate retrofit strategies and timing. This paper reviews current durability literature, various standards for window performance ratings and weathering methods, existing in situ IGU energy performance measurement techniques, and whole-building energy effects. The challenges and disparities among various studies are analyzed and discussed. The authors hope that further work in this area will lead to the development of improved in situ test methods to assess IGU degradation in the field and link this knowledge to improved energy performance modeling approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Large language model evaluation for high–performance computing software development

We apply AI-assisted large language model (LLM) capabilities of GPT-3 targeting high-performance computing (HPC) kernels for (i) code generation, and (ii) auto-parallelization of serial code in C ++, Fortran, Python and Julia. Our scope includes the following fundamental numerical kernels: AXPY, GEMV, GEMM, SpMV, Jacobi Stencil, and CG, and language/programming models: (1) C++ (e.g., OpenMP [including offload], OpenACC, Kokkos, SyCL, CUDA, and HIP), (2) Fortran (e.g., OpenMP [including offload] and OpenACC), (3) Python (e.g., numpy, Numba, cuPy, and pyCUDA), and (4) Julia (e.g., Threads, CUDA.jl, AMDGPU.jl, and KernelAbstractions.jl). Kernel implementations are generated using GitHub Copilot capabilities powered by the GPT-based OpenAI Codex available in Visual Studio Code given simple + + prompt variants. To quantify and compare the generated results, we propose a proficiency metric around the initial 10 suggestions given for each prompt. For auto-parallelization, we use ChatGPT interactively giving simple prompts as in a dialogue with another human including simple “prompt engineering” follow ups. Results suggest that correct outputs for C++ correlate with the adoption and maturity of programming models. For example, OpenMP and CUDA score really high, whereas HIP is still lacking. We found that prompts from either a targeted language such as Fortran or the more general-purpose Python can benefit from adding language keywords, while Julia prompts perform acceptably well for its Threads and CUDA.jl programming models. Finally, we expect to provide an initial quantifiable point of reference for code generation in each programming model using a state-of-the-art LLM. Overall, understanding the convergence of LLMs, AI, and HPC is crucial due to its rapidly evolving nature and how it is redefining human-computer interactions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Formal Definitions and Performance Comparison of Consistency Models for Parallel File Systems

The semantics of HPC storage systems are defined by the consistency models to which they abide. Storage consistency models have been less studied than their counterparts in memory systems, with the exception of the POSIX standard and its strict consistency model. The use of POSIX consistency imposes a performance penalty that becomes more significant as the scale of parallel file systems increases and the access time to storage devices, such as node-local solid storage devices, decreases. While some efforts have been made to adopt relaxed storage consistency models, these models are often defined informally and ambiguously as by-products of a particular implementation. Here in this work, we establish a connection between memory consistency models and storage consistency models and revisit the key design choices of storage consistency models from a high-level perspective. Further, we propose a formal and unified framework for defining storage consistency models and a layered implementation that can be used to easily evaluate their relative performance for different I/O workloads. Finally, we conduct a comprehensive performance comparison of two relaxed consistency models on a range of commonly seen parallel I/O workloads, such as checkpoint/restart of scientific applications and random reads of deep learning applications. We demonstrate that for certain I/O scenarios, a weaker consistency model can significantly improve the I/O performance. For instance, in small random reads that are typically found in deep learning applications, session consistency achieved a 5x improvement in I/O bandwidth compared to commit consistency, even at small scales.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

An Analysis of the Spatial Variations in the Relationship Between Built Environment and Severe Crashes

Traffic crashes significantly contribute to global fatalities, particularly in urban areas, highlighting the need to evaluate the relationship between urban environments and traffic safety. This study extends former spatial modeling frameworks by drawing paths between global models, including spatial lag (SLM), and spatial error (SEM), and local models, including geographically weighted regression (GWR), multi-scale geographically weighted regression (MGWR), and multi-scale geographically weighted regression with spatially lagged dependent variable (MGWRL). Utilizing the proposed framework, this study analyzes severe traffic crashes in relation to urban built environments using various spatial regression models within Leon County, Florida. According to the results, SLM outperforms OLS, SEM, and GWR models. Local models with lagged dependent variables outperform both the global and generic versions of the local models in all performance measures, whereas MGWR and MGWRL outperform GWR and GWRL. Local models performed better than global models, showing spatial non-stationarity; so, the relationship between the dependent and independent variables varies over space. The better performance of models with lagged dependent variables signifies that the spatial distribution of severe crashes is correlated. Finally, the better performance of multi-scale local models than classical local models indicates varying influences of independent variables with different bandwidths. According to the MGWRL model, census block groups close to the urban area with higher population, higher education level, and lower car ownership rates have lower crash rates. On the contrary, motor vehicle percentage for commuting is found to have a negative association with severe crash rate, which suggests the locality of the mentioned associations.

Alisan, Onur (ORCID:0000000193113984)↗
DOE OSTI2023

Validating Connected, Automated, and Electric Vehicle Models and Simulation - Research Performance Progress Report

The objective of this project is to test connected and automated vehicles with both electrified and internal combustion engine powertrains to support updates and validation of modeling and simulation tools. This includes the development of the components and network architecture to execute and collect empirical data for multiple scenarios and traffic interactions. Specific program objectives include: • Translate Lab algorithms into vehicle and infrastructure controls • Conduct physical testing at realistic scale • Evaluate system performance • Improve models using empirical data • Improve control algorithms from lessons learned • Identify system and algorithm assumptions which need refinement It is important to note that the objective of this project was not to demonstrate the efficacy of the selected algorithms to improve energy efficiency but rather to validate and improve modeling and simulation tools using empirical data. While it is a desirable outcome to concurrently demonstrate improved energy efficiency through use of these algorithms, and in most cases that was the outcome, the success of this project was not predicated on the performance of the algorithm towards improving energy efficiency across all scenarios and test matrices.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗