Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “trustworthiness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Sustainable Aviation Operations and the Role of Information Technology and Data Science: Background, Current Status and Future Directions

This paper reviews the achievements of the international community towards environmentally friendly aviation operations, also referred to as Sustainable Aviation Operations in the last 25 years and the aspirations and goals to limit the impact of aviation and climate in the future. The framework for achieving global progress is provided by the International Civil Aviation Organization. NASA and FAA supported research and development to advance ATM concepts, and implemented the technology, concepts, and procedures that were responsible for creating fuel efficient flights. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. Future developments in aviation operations require new concepts, procedure, modeling, and analysis techniques. There is an increasing interest in applying methods based on Machine Learning Techniques to problems in Air Traffic Management. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and the availability of a rich historical database provide opportunities to exploit the richness of data-driven methods. The promises and challenges in applying Machine Learning Techniques to Air Traffic Management are discussed in the paper along with the testing and trustworthiness required for adoption of the techniques in operations.

Sustainable Aviation, Data Science, Machine Learni↗

Measuring the Exciton Binding Energy: Learning from a Decade of Measurements on Halide Perovskites and Transition Metal Dichalcogenides

The exciton binding energy ( E b ) is a key parameter that governs the physics of many optoelectronic devices. At their best, trustworthy and precise measurements of E b challenge theoreticians to refine models, are a driving force in advancing the understanding of a material system, and lead to efficient device design. At their worst, inaccurate E b measurements lead theoreticians astray, sow confusion within the research community, and hinder device improvements by leading to poor designs. Here, this review article seeks to highlight the pros and cons of different measurement techniques used to determine E b , namely, temperature‐dependent photoluminescence, resolving Rydberg states, electroabsorption, magnetoabsorption, scanning tunneling spectroscopy, and fitting the optical absorption. Due to numerous conflicting E b values reported for halide perovskites (HP) and transition metal dichalcogenides (TMDC) monolayers, an emphasis is placed on highlighting these measurements in an attempt to reconcile the variance between different measurement techniques. It is argued that the experiments with the clearest indicators are in agreement on the following values: ≈350–450 meV for TMDC monolayers between SiO 2 and vacuum, ≈150–200 meV for hBN‐encapsulated TMDC monolayers, ≈200–300 meV for common lead‐iodide 2D HPs, and ≈10 meV for methylammonium lead iodide.

36 MATERIALS SCIENCE↗

Trusted Simulation: Considering Model Quality in the Context of User Trust

A high‐quality simulation model should help its users to easily and appropriately calibrate their trust in the model. Traditional evaluation metrics such as validation and robustness are necessary but insufficient for this task. Trust calibration depends on factors like the model's transparency, applicability to intended use, usability, reputation, and consideration of potential bias. This article proposes a framework for designing and evaluating system dynamics models by considering factors that contribute to the proper calibration of user trust. This framework takes inspiration from trusted artificial intelligence, broadening our traditional concept of model quality and explicitly focusing on what users need to consider a model trustworthy and to understand the model's relevance to its intended purpose. The trusted simulation framework can improve our integration of model quality activities throughout the modeling process, leading to more impactful and better‐targeted model design, development, and evaluation.

Naugle, Asmeret Bier [Sandia National Laboratories↗

Uncertainty quantification's role in modeling and simulation planning, and credibility assessment through the predictive capability maturity model

The importance of credible, trustworthy numerical simulations is obvious especially when using the results for making high-consequence decisions. Determining the credibility of such numerical predictions is much more difficult and requires a systematic approach to assessing predictive capability, associated uncertainties and overall confidence in the computational simulation process for the intended use of the model. This process begins with an evaluation of the computational modeling of the identified, important physics of the simulation for its intended use. This is commonly done through a Phenomena Identification Ranking Table (PIRT). Then an assessment of the evidence basis supporting the ability to computationally simulate these physics can be performed using various frameworks such as the Predictive Capability Maturity Model (PCMM). There were several critical activities that follow in the areas of code and solution verification, validation and uncertainty quantification, which will be described in detail in the following sections. Here, we introduce the subject matter for general applications but specifics are given for the failure prediction project. In addition, the first task that must be completed in the verification & validation procedure is to perform a credibility assessment to fully understand the requirements and limitations of the current computational simulation capability for the specific application intended use. The PIRT and PCMM are tools used at Sandia National Laboratories (SNL) to provide a consistent manner to perform such an assessment. Ideally, all stakeholders should be represented and contribute to perform an accurate credibility assessment. PIRTs and PCMMs are both described in brief detail below and the resulting assessments for an example project are given.

97 MATHEMATICS AND COMPUTING↗

Improving Automation Transparency: Addressing Some of Machine Learning’s Unique Challenges

Abstract. A variety of factors can affect one’s reliance on an automated aid. Some of these factors include one’s per-ception of the system’s trustworthiness, such as perceived reliability of the system or one’s ability to understand the system’s underlying reasoning. A mismatch between the operator’s perception and the true capabilities and charac-teristics of the system can lead to inappropriate reliance on the tool. This improper use of the system can manifest as either underutilization of the technology or complacency resulting from over-trusting the system. Increasing an au-tomated tool’s transparency is one approach that enables the operator to more appropriately rely on the technology. Transparent automated systems provide additional infor-mation that allows the user to see the system’s intent and understand its underlying processes and capabilities. Sev-eral researchers have developed frameworks to support the design of more transparent automation. However, these frameworks may not fully consider the particular challeng-es to transparency design introduced by automation that leverages machine learning. Like all automation, these systems can benefit from transparency. However, artificial intelligence poses new challenges that must be considered when designing for transparency. Unique considerations must be made in terms of the type, and amount or level of transparency information conveyed to the user.

Transparency, Machine Learning, Automation↗

Leveraging The Open Provenance Model as a Multi-Tier Model for Global Climate Research

Global climate researchers rely upon many forms of sensor data and analytical methods to help profile subtle changes in climate conditions. The U.S. Department of Energy's Atmospheric Radiation Measurement (ARM) program provides researchers with curated Value Added Products (VAPs) resulting from continuous sensor data streams, data fusion, and modeling. The ARM operations staff and software development teams (data producers) rely upon a number of techniques to ensure strict quality control (QC) and quality assurance (QA) standards are maintained. Climate researchers (data consumers) are highly interested in obtaining as much provenance (data quality, data pedigree) as possible to establish data trustworthiness. Currently all the provenance is not easily attainable or identifiable without significant efforts to extract and piece together information from configuration files, log files, codes, and status information from ARM databases. The need for a formalized approach to managing provenance became paramount with the planned addition of 120 new instruments, new data products, and data collection scaling to half a terabyte daily. Last year our research identified the need for a multi-tier provenance model to enable the data consumer easy access to the provenance for their data. This year we are leveraging the Open Provenance Model as a foundational construct that serves the needs of both the VAP producers and consumers, we are organizing the provenance in different tiers of granularity to model VAP lineage, causality at the component level within a VAP, and the causality for each time step as samples are being assembled within the VAP. This paper shares our implementation strategy and how the ARM operations staff and the climate research community can greatly benefit from this approach to more effectively assess and quantify VAP provenance.

54 ENVIRONMENTAL SCIENCES↗

Gravity duals for defect quivers in the Veneziano limit

We construct gravity duals to supersymmetric gauge theories in the presence of unquenched flavor hypermultiplets in the fundamental representation of the gauge group living on the (1+1)-dimensional defect. This configuration is given by the intersection of two sets of D3-branes. Working in the Veneziano limit with large number of colors and flavors we are able to find a closed set of equations describing the dual geometry. We briefly discuss the corresponding solutions for massless flavors as well as in the small flavor limit of massive hypermultiplets. Interestingly, the $\frac{1}{16}$-BPS supergravity solutions, preserving two Poincaré supercharges, are generically only asymptotically anti de-Sitter and the dilaton does not vary with the holographic radial coordinate. This implies that the classical Type IIB supergravity solutions remain trustworthy descriptions for the gauge theories from the deep IR to the far UV.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Finite element solution of MHD power-law fluid with slip velocity effect and non-uniform heat source/sink

The laminar steady boundary layer flow of an incompressible MHD Power-law fluid past a continuously moving surface is investigated numerically. The study involves the influence of surface slip and non-uniform heat source/sink on the flow and heat transfer. The governing boundary layer flow equations are transformed into non-dimensional, non-linear coupled ordinary differential equations with the help of suitable similarity transformations. The Galerkin finite element method is implemented to crack the resulting system. The impact of different involved physical parameters is exhibited on the dimensionless velocity profile, temperature distributions and rate of heat transfer in graphical and tabular forms for pseudoplastic and dilatant fluids. The local Nusselt number is found to be the decreasing function of slip parameter, temperature and space-dependent heat sink parameter whereas it increases with increasing values of temperature and space dependent heat source parameter. The problem has important application in attaining the sustainable heat transfer rate for the cooling of fluids, especially in heat exchangers used frequently in chemical industry, in order to increase the trustworthiness of a system, as it removes high heat loads from these systems.

97 MATHEMATICS AND COMPUTING↗

Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings

Trustworthy savings calculations are critical to convincing investors in energy efficiency projects of the benefit and cost-effectiveness of such investments and their ability to replace or defer supply-side capital investments. However, today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of efficiency projects. They also require time-consuming manual data acquisition and often do not deliver results until years after the program period has ended. The rising availability of “smart” meters, combined with new analytical approaches to quantifying savings, has opened the door to conducting M&V more quickly and at lower cost, with comparable or improved accuracy. These meter- and software-based approaches, increasingly referred to as “M&V 2.0”, are the subject of surging industry interest, particularly in the context of utility energy efficiency programs. Program administrators, evaluators, and regulators are asking how M&V 2.0 compares with more traditional methods, how proprietary software can be transparently performance tested, how these techniques can be integrated into the next generation of whole-building focused efficiency programs. This paper expands recent analyses of public-domain whole-building M&V methods, focusing on more novel M&V2.0 modeling approaches that are used in commercial technologies, as well as approaches that are documented in the literature, and/or developed by the academic building research community. We present a testing procedure and metrics to assess the performance of whole-building M&V methods. We then illustrate the test procedure by evaluating the accuracy of ten baseline energy use models, against measured data from a large dataset of 537 buildings. The results of this study show that the already available advanced interval data baseline models hold great promise for scaling the adoption of building measured savings calculations using Advanced Metering Infrastructure (AMI) data. Median coefficient of variation of the root mean squared error (CV(RMSE)) was less than 25% for every model tested when twelve months of training data were used. With even six months of training data, median CV(RMSE) for daily energy total was under 25% for all models tested. Finally, these findings can be used to build confidence in model robustness, and the readiness of these approaches for industry uptake and adoption

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Transcriptional information revealed differentially expressed circular RNAs in facet joint osteoarthritis

Highlights: • A full recognition of circrna changes in FJOA by RNA-seq analysis. • We initial listed Top 20 enriched signaling pathways associated with FJOA. • Seven circRNAs were arbitrarily selected to confirm their differential expression levels by qRT-PCR. • A group of potential miRNAs that might bind to circular RNAs were identified. Circular RNAs are newly identified RNAs that regulate gene expression and execute various biological activities. Facet joint osteoarthritis (FJOA) is a severe facet joint cartilage degeneration disease that induces chronic low back pain to a larger population. The molecular mechanisms of FJOA, especially the presence and changes of circular RNAs in FJOA have not been investigated. In the current study, we analyzed RNA deep sequencing outcomes from healthy control group and FJOA group, identified and annotated circular RNAs, and determined the expressions of circular RNAs. Differentially expressed circular RNAs in the FJOA group were then screened and the host genes of these differentially expressed circular RNAs were functional analyzed by Gene Ontology (GO), Kyoto Enrichment of Genes and Genomes (KEGG), and protein-protein interaction network analysis. Seven circRNAs were arbitrarily selected to confirm the trustworthiness of these profiles by quantitative qRT-PCR. The potential binding sites of microRNAs (miRNAs) and identified circular RNAs were also predicted. Our current study provided valuable bioinformation regarding circular RNAs in FJOA and expanded our knowledge of FJOA.

60 APPLIED LIFE SCIENCES↗

CALPHAD modeling of uranium nitride (UN) fabrication routes enabled by first-principles calculations

The thermochemical details of fabricating uranium nitride (UN) by ammonolysis of uranium tetraflouride (UF 4 ) were determined using density functional theory (DFT) and CALculation of PHAse Diagrams (CALPHAD) computational methods. The thermochemical data of all binary, ternary, and quaternary U-H-N-F phases were computed using DFT, and the data for the phases that have not been measured experimentally, including UN 2 and NH 4 F(g), were combined with existing experimentally-determined data for CALPHAD modeling. The DFT data were benchmarked using experimental Gibbs energy of reaction and experimental thermochemical data for individual species. Phase diagrams relevant to the ammonolysis reaction are depicted, showing regions of stability for solid U-N, U-F and U-N-F phases. An unidentified phase produced in a previous experiment was identified as UN 0.95 F 1.2 (UNF) by comparing its X-ray diffraction spectrum to the experimental spectrum, and its formation during the fabrication of UN from UF 4 is supported by the simulated phase diagram. Here, it is calculated that UN 2 can be produced by the ammonolysis of UF 4 , but requires elevated temperatures, high NH 3 (g) partial pressure, and large amounts of flowing NH 3 (g) to avoid solid flu oride impurities in the uranium nitride. Likewise, U 2 N 3 can be produced instead at temperatures greater than 980 K. The use of silane (SiH 4 ) gas was investigated as a potential additive in the ammonolysis fabrication route to speed removal of fluorine. The addition of SiH 4 (g) offers little advantage to the removal of fluorine, and adds the complication of Si 3 N 4 formation. The use of DFT to fill in missing data to perform CALPHAD calculations demonstrated here allows for the determination of more comprehensive and trustworthy phase diagrams than the use of existing experimental data alone.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Enabling end-to-end secure federated learning in biomedical research on heterogeneous computing environments with APPFLx

Facilitating large-scale, cross-institutional collaboration in biomedical machine learning (ML) projects requires a trustworthy and resilient federated learning (FL) environment to ensure that sensitive information such as protected health information is kept confidential. Specifically designed for this purpose, this work introduces APPFLx - a low-code, easy-to-use FL framework that enables easy setup, configuration, and running of FL experiments. APPFLx removes administrative boundaries of research organizations and healthcare systems while providing secure end-to-end communication, privacy-preserving functionality, and identity management. Furthermore, it is completely agnostic to the underlying computational infrastructure of participating clients, allowing an instantaneous deployment of this framework into existing computing infrastructures. Experimentally, the utility of APPFLx is demonstrated in two case studies: (1) predicting participant age from electrocardiogram (ECG) waveforms, and (2) detecting COVID-19 disease from chest radiographs. Here, ML models were securely trained across heterogeneous computing resources, including a combination of on-premise high-performance computing and cloud computing facilities. By securely unlocking data from multiple sources for training without directly sharing it, these FL models enhance generalizability and performance compared to centralized training models while ensuring data remains protected. In conclusion, APPFLx demonstrated itself as an easy-to-use framework for accelerating biomedical studies across organizations and healthcare systems on large datasets while maintaining the protection of private medical data.

Biomedical Research↗

Application of automated measurement and verification to utility energy efficiency program data

Trustworthy savings calculations are critical to convincing regulators of both the cost-effectiveness of energy efficiency program investments and their ability to defer supply-side capital investments. Today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of energy efficiency programs. They also require time-consuming data acquisition. A spectrum of savings calculation approaches is used, with some relying more heavily on measured data and others relying more heavily on estimated, modeled, or stipulated data. The increasing availability of “smart” meters and devices that report near-real time data, combined with new analytical approaches to quantify savings, offers the potential to conduct M&V more quickly and at lower cost, with comparable or improved accuracy. Commercial energy management and information systems (EMIS) technologies are beginning to offer these ‘M&V 2.0’ capabilities, and program administrators want to understand how they might assist programs in quickly and accurately measuring energy savings. This paper presents the results of recent testing of the ability to use automation to streamline the M&V process. In this paper, we apply an automated whole-building M&V tool to historic data sets from energy efficiency programs to begin to explore the accuracy, cost, and time trade-offs between more traditional M&V, and these emerging streamlined methods that use high-resolution energy data and automated computational intelligence. For the data sets studied we evaluate the fraction of buildings that are well suited to automated baseline characterization, the uncertainty in gross savings that is due to M&V 2.0 tools’ model error, and indications of labor time savings, and how the automated savings results compare to prior, traditionally determined savings results. The results show that 70% of the buildings were well suited to the automated approach. In a majority of the cases (80%) savings and uncertainties for each individual building were quantified to levels above the criteria in ASHRAE Guideline 14. In addition the findings suggest that M&V 2.0 methods may also offer time-savings relative to traditional approaches. Lastly, we discuss the implications of these findings relative to the potential evolution of M&V, and pilots currently being launched to test how M&V automation can be integrated into ratepayer-funded programs and professional implementation and evaluation practice.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Explainable machine learning model for multi-step forecasting of reservoir inflow with uncertainty quantification

We propose an explainable machine learning (ML) model with uncertainty quantification (UQ) to improve multi-step reservoir inflow forecasting. Traditional ML methods have challenges in forecasting inflows multiple days ahead, and lack explainability and UQ. To address these limitations, we introduce an encoder–decoder long short-term memory (ED-LSTM) network for multi-step forecasting, employ the SHapley Additive exPlanation (SHAP) technique for understanding the influence of hydrometeorological factors on inflow prediction, and develop a novel UQ method for prediction trustworthiness. We apply these methods to forecast 7-day inflow in snow-dominant and rain-driven reservoirs. The results demonstrate the effectiveness of the ED-LSTM model, with high forecasting accuracy for short lead times. Our UQ method provides reliable uncertainty estimates, covering 90% of data with a 90% confidence level. The SHAP analysis reveals the importance of historical inflow and precipitation as influential factors. These findings and methods may support reservoir operators in optimizing water resources management decisions.

54 ENVIRONMENTAL SCIENCES↗

Resilient information and inference networks under mixed-trust sensing

With ubiquitous digitization, sensing, and computational intelligence deployed in increasingly more and broader domains, including critical infrastructure, potentially misleading and destabilizing effects of multimodal anomalies and adversarial behavior are growing in importance. Here, we develop randomized and reinforcement learning-based strategies for strategically recruiting and utilizing deployed (and, thus, vulnerable and potentially faulty and/or compromised) nodes from information and inference networks, while defending against adversaries that attempt to misguide assessments of inferred variables. Recognizing that, besides communication and other costs, sampling from any observable node can either provide true data or dangerously expose our inference to misinformation (without being easily distinguishable what actually happens), the proposed strategies proceed by progressively recruiting nodes and cautiously scaling their information contribution based on assumed, or, in our reinforcement learning approach, intelligently weighed trustworthiness, with the learning approach also considering network-wide, threat-inclusive risk/value tradeoffs. While avoiding the hardware, communication, analytical and computational burden of explicit redundancy, the proposed defensive schemes enable on-the-fly assessments of underlying processes, and system-wide situational awareness with demonstrable resilience against adversarial activities.

97 - MATHEMATICS AND COMPUTING↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Correlation approach for quality assurance of additive manufactured parts based on optical metrology

Surface topography and surface finish are two significant factors for evaluating the quality of products in additive manufacturing (AM). AM parts are fabricated layer by layer, which is quite different from traditional formative or subtractive methods. Despite rapid progress in additive manufacturing and associated optical metrology for quality control and in-situ monitoring, limited research has been conducted to investigate the reliability of 3D surface measurement data. The surface topologies scanned by multiple optical systems demonstrated significant differences due to varying sampling mechanisms, resolutions, system noises, etc. The 3D datasets should be trustworthy in order to extract parameters for quality assurance or feedback control from 3D surface measurements. In this paper, we set up new standards to evaluate the reliability of 3D surface measurement data and analyze the variation in the topographical profile. In this study, two non-contact optical methods based on Focus Variation Microscopy (FVM) and Structured Light System (SLS) were adopted to measure the surface topography of the target components. The two optical metrology systems generated two entirely different point cloud datasets. Statistical methods were applied to test the difference between the data obtained from the two systems. By using a data analytics approach for comparison, it was found that the surface roughness estimated from the point cloud data sets of FVM and SLS has no significant difference, though the point cloud data sets were completely different. This paper provides standard validation approach to evaluate the plausibility of metrology data from in-situ real-time surface analysis for process planning of AM.

36 MATERIALS SCIENCE↗