Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

PSA 2025 DPRA for Cyber Optimization

Cyberattacks can have many different attack paths, durations, and goals. There are also many different mitigation options involving hardware, software, and/or humans. Evaluating defense options should include quantitative evaluation of overall effectiveness to make cost and risk-informed decisions. Typical cyberattack modeling methods only provide a qualitative evaluation and have difficulty with time dependent scenarios. The main areas of cybersecurity are confidentiality, integrity, and availability. For companies with cyber-physical systems such as advanced nuclear reactors, cyber-related integrity is a requirement set by the U.S. Nuclear Regulatory Commission. But companies are also concerned about availability or reliability as a business case. As cyber threats are evolving to a business-for-hire structure, more attacks focus on disrupting business success and reliability, causing financial and economic stability risk. Companies want reliability analysis while optimizing cost, which requires more than safety modeling methods. Dynamic-state-based and Markov-based modeling provides a method for better cyber scenario modeling with timing and conditional features not found in other numerical evaluation methods. EMRALD (Event Modeling Risk Assessment using Lined Diagrams) is a dynamic risk analysis modeling and simulation tool and has features that reduce modeling issues such as state-base explosion found in Markov-based tools. It has been used to model different time-dependent events including plant behavior and operator procedures. As a general modeling tool, EMRALD can also be used to model cyberattack scenarios with varying mitigation options and quantify effectiveness, producing numerical data for risk-informed decisions. This paper uses EMRALD to demonstrate that dynamic risk analysis can be used for cyber threat modeling to provide insights for design decision-making and optimize defense strategies.

97 - MATHEMATICS AND COMPUTING↗
NASA NTRS2007

Evaluation of a Potential for Enhancing the Decision Support System of the Interagency Modeling and Atmospheric Assessment Center with NASA Earth Science Research Results

NASA's objective for the Applied Sciences Program of the Science Mission Directorate is to expand and accelerate the realization of economic and societal benefits from Earth science, information, and technology. This objective is accomplished by using a systems approach to facilitate the incorporation of Earth observations and predictions into the decision-support tools used by partner organizations to provide essential services to society. The services include management of forest fires, coastal zones, agriculture, weather prediction, hazard mitigation, aviation safety, and homeland security. In this way, NASA's long-term research programs yield near-term, practical benefits to society. The Applied Sciences Program relies heavily on forging partnerships with other Federal agencies to accomplish its objectives. NASA chooses to partner with agencies that have existing connections with end-users, information infrastructure already in place, and decision support systems that can be enhanced by the Earth science information that NASA is uniquely poised to provide (NASA, 2004).

Blonski, Slawomir↗
NASA NTRS2013

Integrating Wind Profiling Radars and Radiosonde Observations with Model Point Data to Develop a Decision Support Tool to Assess Upper-Level Winds for Space Launch

On the day of launch, the 45th Weather Squadron (45 WS) Launch Weather Officers (LWOs) monitor the upper-level winds for their launch customers. During launch operations, the payload/launch team sometimes asks the LWOs if they expect the upper-level winds to change during the countdown. The LWOs used numerical weather prediction model point forecasts to provide the information, but did not have the capability to quickly retrieve or adequately display the upper-level observations and compare them directly in the same display to the model point forecasts to help them determine which model performed the best. The LWOs requested the Applied Meteorology Unit (AMU) develop a graphical user interface (GUI) that will plot upper-level wind speed and direction observations from the Cape Canaveral Air Force Station (CCAFS) Automated Meteorological Profiling System (AMPS) rawinsondes with point forecast wind profiles from the National Centers for Environmental Prediction (NCEP) North American Mesoscale (NAM), Rapid Refresh (RAP) and Global Forecast System (GFS) models to assess the performance of these models. The AMU suggested adding observations from the NASA 50 MHz wind profiler and one of the US Air Force 915 MHz wind profilers, both located near the Kennedy Space Center (KSC) Shuttle Landing Facility, to supplement the AMPS observations with more frequent upper-level profiles. Figure 1 shows a map of KSC/CCAFS with the locations of the observation sites and the model point forecasts.

Bauman, William H., III↗
DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17–18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17-18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

A proposed framework for the development and qualitative evaluation of West Nile virus models and their application to local public health decision-making

West Nile virus (WNV) is a globally distributed mosquito-borne virus of great public health concern. The number of WNV human cases and mosquito infection patterns vary in space and time. Many statistical models have been developed to understand and predict WNV geographic and temporal dynamics. However, these modeling efforts have been disjointed with little model comparison and inconsistent validation. In this paper, we describe a framework to unify and standardize WNV modeling efforts nationwide. WNV risk, detection, or warning models for this review were solicited from active research groups working in different regions of the United States. A total of 13 models were selected and described. The spatial and temporal scales of each model were compared to guide the timing and the locations for mosquito and virus surveillance, to support mosquito vector control decisions, and to assist in conducting public health outreach campaigns at multiple scales of decision-making. Our overarching goal is to bridge the existing gap between model development, which is usually conducted as an academic exercise, and practical model applications, which occur at state, tribal, local, or territorial public health and mosquito control agency levels. The proposed model assessment and comparison framework helps clarify the value of individual models for decision-making and identifies the appropriate temporal and spatial scope of each model. This qualitative evaluation clearly identifies gaps in linking models to applied decisions and sets the stage for a quantitative comparison of models. Specifically, whereas many coarse-grained models (county resolution or greater) have been developed, the greatest need is for fine-grained, short-term planning models (m–km, days–weeks) that remain scarce. We further recommend quantifying the value of information for each decision to identify decisions that would benefit most from model input.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1992

Cognition and procedure representational requirements for predictive human performance models

Models and modeling environments for human performance are becoming significant contributors to early system design and analysis procedures. Issues of levels of automation, physical environment, informational environment, and manning requirements are being addressed by such man/machine analysis systems. The research reported here investigates the close interaction between models of human cognition and models that described procedural performance. We describe a methodology for the decomposition of aircrew procedures that supports interaction with models of cognition on the basis of procedures observed; that serves to identify cockpit/avionics information sources and crew information requirements; and that provides the structure to support methods for function allocation among crew and aiding systems. Our approach is to develop an object-oriented, modular, executable software representation of the aircrew, the aircraft, and the procedures necessary to satisfy flight-phase goals. We then encode in a time-based language, taxonomies of the conceptual, relational, and procedural constraints among the cockpit avionics and control system and the aircrew. We have designed and implemented a goals/procedures hierarchic representation sufficient to describe procedural flow in the cockpit. We then execute the procedural representation in simulation software and calculate the values of the flight instruments, aircraft state variables and crew resources using the constraints available from the relationship taxonomies. The system provides a flexible, extensible, manipulative and executable representation of aircrew and procedures that is generally applicable to crew/procedure task-analysis. The representation supports developed methods of intent inference, and is extensible to include issues of information requirements and functional allocation. We are attempting to link the procedural representation to models of cognitive functions to establish several intent inference methods including procedural backtracking with concurrent search, temporal reasoning, and constraint checking for partial ordering of procedures. Finally, the representation is being linked to models of human decision making processes that include heuristic, propositional and prescriptive judgement models that are sensitive to the procedural content in which the valuative functions are being performed.

Corker, K.↗
NASA NTRS1984

Multi-crew Model Analytic Assessment of Landing Performance and Decision-making Demands

Some of the relative merits of the PROCRU approach to modelling multi-crew flight deck activity during approach to landing are discussed. On the basis of two realistic flight scenarios, the ability of the model to simulate different vectored approaches is demonstrated. A secondary exemplary analysis of a nominal and an accelerated final approach is performed, illustrating the potential of the expected net gain (ENGP) functions as a measure of decision-making load.

Milgram, P.↗
NASA NTRS1993

Criteria for assessing problem solving and decision making in complex environments

Training crews to cope with unanticipated problems in high-risk, high-stress environments requires models of effective problem solving and decision making. Existing decision theories use the criteria of logical consistency and mathematical optimality to evaluate decision quality. While these approaches are useful under some circumstances, the assumptions underlying these models frequently are not met in dynamic time-pressured operational environments. Also, applying formal decision models is both labor and time intensive, a luxury often lacking in operational environments. Alternate approaches and criteria are needed. Given that operational problem solving and decision making are embedded in ongoing tasks, evaluation criteria must address the relation between those activities and satisfaction of broader task goals. Effectiveness and efficiency become relevant for judging reasoning performance in operational environments. New questions must be addressed: What is the relation between the quality of decisions and overall performance by crews engaged in critical high risk tasks? Are different strategies most effective for different types of decisions? How can various decision types be characterized? A preliminary model of decision types found in air transport environments will be described along with a preliminary performance model based on an analysis of 30 flight crews. The performance analysis examined behaviors that distinguish more and less effective crews (based on performance errors). Implications for training and system design will be discussed.

Orasanu, Judith↗
DOE OSTI2021

Influence of Business Models on PV-Battery Dispatch Decisions and Market Value

PV-battery hybrid projects dominate interconnection queues in some regions in the United States, but few projects have been operational long enough to assess how the hybrid capabilities may be used in practice. We interview plant operators and analyze empirical dispatch data for eleven large-scale PV-battery hybrids in three organized wholesale markets in the United States. We use the dispatch data and wholesale market prices to estimate the market value of our sample hybrids in 2020. The empirical increase in market value of a PV-battery hybrid relative to a standalone PV plant varies by project and ranges from $\$$1 to $\$$48/MWhsolar. The premium is driven by market, location, technical characteristics of the PV and battery asset, and battery dispatch strategies. In contrast to the widespread assumptions in the PV-battery hybrid modeling literature, only three of the eleven project operators optimize battery usage for wholesale market revenue as merchant plants. Instead, the majority of operators in the sample have alternate objectives. For example, load-serving entities target peak load reductions, incentive program participants focus on compliance with program requirements, and large energy consumers prioritize resiliency and utility bill minimization. Understanding prevalent dispatch signals and the degree of alignment with system-wide grid needs can increase the market value of PV-battery hybrids.

14 SOLAR ENERGY↗
DOE OSTI2025

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Towards Improved Decision Making for the Smarter Grid: Geomagnetic Disturbance Implicit Modeling Uncertainty Quantification

Geomagnetic disturbances can greatly disrupt the power grid operation. This is caused by low-frequency changes in the earth’s magnetic field, which upon interaction with the deep earth conductivity induces a changing electric field at the earth’s surface. This in turn induces quasi-direct currents which have the potential to cause protective devices to operate, widespread damage to high-voltage transformers, or voltage collapse due to induced reactive power losses. While these impacts have been known since the 1940s, only recently have standards for GMD response been implemented. Because these standards are heavily based on models, it is important to understand when it is appropriate to make certain modeling assumptions. In this work, implicit modeling uncertainty is quantified for the purpose of enhanced decision making for disturbance impact mitigation. Considering electromagnetic models, modeling assumptions of non-uniform grounding, imbalanced operation, transformer saturation, and geomagnetically induced currents, voltage estimation values are analyzed. Statistical characteristics of modeling uncertainty are obtained by analysis of synthetically generated data. Results statistically characterize geomagnetic disturbances modeling uncertainty, providing an important tool for impact mitigation.

grid analysis↗
DOE OSTI2023

Modeling and simulation to investigate the electrification potential of medium- and heavy-duty vehicle fleets

This project involves developing and integrating new modeling tools to simulate the dynamics of electric medium- and heavy-duty fleet vehicle adoption. A technical and economic modeling tool, combining a data-driven hardware cost model with a cost-optimal charging strategy microsimulation, enables tailored analysis of the costs and benefits of electrifying individual fleets. Next, a novel text synthesis process, applied to a curated corpus of literature, quantifies trade-offs between technical, economic, and other factors in the fleet vehicle procurement decision. The outcomes of these tasks combine with knowledge from recent literature on fleet decision processes to specify the vehicle procurement model used by fleets in an agent-based model of the medium- and heavy-duty electric vehicle market. This model embodies an especially disaggregated approach to adoption modeling, internalizing factors and dynamics that conventional adoption models externalize. In particular, explicitly modeling the formation and diffusion of opinions among agents enables experiments that conventional models cannot support. Demonstrations show, for example, that increasing the extent of interactions between populations with different proclivities to electric vehicles has an asymmetrical outcome. High-proclivity electric vehicle adoption is generally unaffected as interactions increase, but low-proclivity adoption is accelerated. By representing individual fleets' requirements and costs at a high level of detail, incorporating an adoption decision model informed by a wide body of empirical research, and broadening the array of variables and dynamics available for experimentation, this integrated model offers a new way to understand the urgent challenge of eliminating emissions from the most emissions-intensive transportation sectors.

Trinko, David A.↗
DOE OSTI2024

Uncertainty-Aware, Structure-Preserving Machine Learning Approach for Domain Shift Detection From Nonlinear Dynamic Responses of Structural Systems

Complex structural systems deployed for aerospace, civil, or mechanical applications must operate reliably under varying operational conditions. Structural health monitoring (SHM) systems help ensure the reliability of these systems by providing continuous monitoring of the state of the structure. SHM relies on synthesizing measured data with a predictive model to make informed decisions about structural states. However, these models—which may be thought of as a form of a digital twin—need to be updated continuously as structural changes (e.g., due to damage) arise. We propose an uncertainty-aware machine learning model that enforces distance preservation of the original input state space and then encodes a distance-aware mechanism via a Gaussian process (GP) kernel. The proposed approach leverages the spectral-normalized neural GP algorithm to combine the flexibility of neural networks with the advantages of GP, subjected to structure-preserving constraints, to produce an uncertainty-aware model. This model is used to detect domain shift due to structural changes that cannot be observed directly because they may be spatially isolated (e.g., inside a joint or localized damage). This work leverages detection theory to detect domain shift systematically given statistical features of the prediction variance produced by the model. The proposed approach is demonstrated on a nonlinear structure being subjected to damage conditions. In conclusion, it is shown that the proposed approach is able to rely on distances of the transformed input state space to predict increased variance in shifted domains while being robust to normative changes.

Algorithms↗