Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “decision analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A Scenario-Based Approach to Assess Continuity Gaps in Earth Observations

Decision analysis processes outlined in systems engineering references, such as the Systems Engineering Body of Knowledge [1] or the NASA Systems Engineering Handbook [2], recommend following a series of steps to support decision-making for engineering applications. These steps are consistent across the literature and typically involve defining objectives, defining relevant criteria against which candidate alternatives can be assessed, selecting an evaluation method, assessing alternatives, and making a recommendation based on this assessment. These approaches are well-suited to assess systems for which sets of common objectives and constraints can be identified. A vast body of literature describes their application to numerous engineering problems, and many methods have been developed since the middle of the 20th century to support the assessment of candidate alternatives for such systems [3, 4, 5, 6]. These approaches, however, show some limitations when decisions pertain to systems of systems. These collections of individual systems typically do not share a common set of objectives and constraints, tend to be highly complex, and the definition of assessable, high-value candidate alternatives poses a challenge due to interdependencies. The formulation, development, operation, and funding of Earth observing missions are such that gaps may occur between missions, therefore impacting the continuity of measurements. These Earth observing mission architectures constitute systems of systems for which a common set of objectives and constraints can be challenging to define. When tasked with assessing gaps that may occur for a series of spaceborne missions that address similar science parameters, the authors therefore proposed to depart from the traditional objective- and criteria-based approach and instead adopted a scenario-based approach. This approach does not require a prioritized set of common objectives; rather, it assesses the impact of possible decisions on the system-of-systems and characterizes its possible future states. It also offers the flexibility to adjust assumptions, update inputs, and refine supporting models over time, while enabling the rapid, early identification of challenges and key decision points. By simulating the impact of potential decisions on the entirety of the system-of-systems, the approach enables the synchronization of multiple decisions that typically occur at the level of the individual system. This paper provides an overview of the approach that was developed to assess continuity gaps for a series of operational and planned spaceborne Earth observing missions, a description of its application to the problem at hand, and a discussion of currently known limitations.

scenario earth observations continuity gaps↗

A review on recent machine learning applications for imaging mass spectrometry studies

Imaging mass spectrometry (IMS) is a powerful analytical technique widely used in biology, chemistry, and materials science fields that continue to expand. IMS provides a qualitative compositional analysis and spatial mapping with high chemical specificity. The spatial mapping information can be 2D or 3D depending on the analysis technique employed. Due to the combination of complex mass spectra coupled with spatial information, large high-dimensional datasets (hyperspectral) are often produced. Therefore, the use of automated computational methods for an exploratory analysis is highly beneficial. The fast-paced development of artificial intelligence (AI) and machine learning (ML) tools has received significant attention in recent years. These tools, in principle, can enable the unification of data collection and analysis into a single pipeline to make sampling and analysis decisions on the go. There are various ML approaches that have been applied to IMS data over the last decade. Here, in this review, we discuss recent examples of the common unsupervised (principal component analysis, non-negative matrix factorization, k-means clustering, uniform manifold approximation and projection), supervised (random forest, logistic regression, XGboost, support vector machine), and other methods applied to various IMS datasets in the past five years. The information from this review will be useful for specialists from both IMS and ML fields since it summarizes current and representative studies of computational ML-based exploratory methods for IMS.

47 OTHER INSTRUMENTATION↗

Distributed Resource Energy Analysis and Management System (DREAMS) Development for Real-time Grid Operations

This project supports development of the next generation, integrated energy management infrastructure (EMS) able to incorporate advance visualization of behind-the-meter distributed resource information and probabilistic renewable energy generation forecasts to inform real-time operational decisions. The project involves end-users and active feedback from an Utility Advisory Team (UAT) to help inform how information can be used to enhance operational functions (e.g. unit commitment, load forecasting, Automatic Generation Control (AGC) reserve monitoring, ramp alerts) within two major EMS platforms. Objectives include: Engaging utility operations personnel to develop user input on displays, set expectations, test and review; Developing ease of use and timeliness metrics for measuring enhancements; Developing prototype integrated capabilities within two operational EMS environments; Demonstrating an integrated decision analysis platform with real-time wind and solar forecasting information and timely distributed resource information; Seamlessly integrating new 4-dimensional information into operations without increasing workload and complexities; Developing sufficient analytics to inform and confidently transform and adopt new operating practices and procedures; Disseminating project lessons learned through industry sponsored workshops and conferences;Building on collaborative utility-vendor partnership and industry capabilities

14 SOLAR ENERGY↗

NASA'S concept for a human mission to a near-earth asteroid : preference tradeoffs for the surveyor decision problem

NASA's recent attention and interest in sending a human mission to land on a Near-Earth asteroid raised the question of whether to first send a robotic surveyor. This paper describes a Bayesian approach for comparing the value and cost-risk tradeoffs of sending (versus not sending) surveyor missions prior to a human mission. A multiattribute decision analysis approach was used to account for both mission value and cost in each of 27 hypothetical risk-attitude cases corresponding to an emphasis on mission value; equal priority between mission value and cost; and an emphasis on cost. The decisions implied by the different strategic viewpoints are described.

Smith, Jeffrey H.↗

Methods and system for siting advanced nuclear reactors and evaluating energy policy concerns

There is a growing sociopolitical desire to develop cleaner energy sources in the United States and maintain energy security. Regardless of politics, many coal-fired electric plants have already been shut down and many utilities are vowing to retire their current coal-fired assets within the next two decades. Replacement power assets require consideration of appropriate siting. A geographic information system (GIS)-based multicriteria decision analysis approach is useful to assist utility and energy companies, as well as policymakers, to evaluate potential areas for siting new plants in the contiguous United States. A GIS-based framework is simply a database of location information that allows for mapping, querying, modeling, and analyzing data based on location. The spatial output can be structured to be visual, allowing for easier analysis of location data. The need to site additional power assets, including renewable resources and clean power sources, such as nuclear, led to the development of the Oak Ridge Siting Analysis for power Generation Expansion (OR-SAGE) tool discussed in this paper. The tool takes inputs such as population growth, water availability, environmental indicators, and tectonic and geological hazards to provide an in-depth visual analysis for siting options. Energy companies and other stakeholders can use OR-SAGE to procure feedback quickly and effectively on land suitability based on technology specific inputs. Policymakers can use OR-SAGE to analyze the impacts of future energy technology decisions, while balancing competing resource use. Overall, this paper discusses the recent use of OR-SAGE for these purposes and plans for future development.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Process-Based Cost Estimation for Ramjet/Scramjet Engines

Process-based cost estimation plays a key role in effecting cultural change that integrates distributed science, technology and engineering teams to rapidly create innovative and affordable products. Working together, NASA Glenn Research Center and Boeing Canoga Park have developed a methodology of process-based cost estimation bridging the methodologies of high-level parametric models and detailed bottoms-up estimation. The NASA GRC/Boeing CP process-based cost model provides a probabilistic structure of layered cost drivers. High-level inputs characterize mission requirements, system performance, and relevant economic factors. Design alternatives are extracted from a standard, product-specific work breakdown structure to pre-load lower-level cost driver inputs and generate the cost-risk analysis. As product design progresses and matures the lower level more detailed cost drivers can be re-accessed and the projected variation of input values narrowed, thereby generating a progressively more accurate estimate of cost-risk. Incorporated into the process-based cost model are techniques for decision analysis, specifically, the analytic hierarchy process (AHP) and functional utility analysis. Design alternatives may then be evaluated not just on cost-risk, but also user defined performance and schedule criteria. This implementation of full-trade study support contributes significantly to the realization of the integrated development environment. The process-based cost estimation model generates development and manufacturing cost estimates. The development team plans to expand the manufacturing process base from approximately 80 manufacturing processes to over 250 processes. Operation and support cost modeling is also envisioned. Process-based estimation considers the materials, resources, and processes in establishing cost-risk and rather depending on weight as an input, actually estimates weight along with cost and schedule.

Singh, Brijendra↗

Effects of Automation Types on Air Traffic Controller Situation Awareness and Performance

The Joint Planning and Development Office has proposed the introduction of automated systems to help air traffic controllers handle the increasing volume of air traffic in the next two decades (JPDO, 2007). Because fully automated systems leave operators out of the decision-making loop (e.g., Billings, 1991), it is important to determine the right level and type of automation that will keep air traffic controllers in the loop. This study examined the differences in the situation awareness (SA) and collision detection performance of individuals when they worked with information acquisition, information analysis, decision and action selection and action implementation automation to control air traffic (Parasuraman, Sheridan, & Wickens, 2000). When the automation was unreliable, the time taken to detect an upcoming collision was significantly longer for all the automation types compared with the information acquisition automation. This poor performance following automation failure was mediated by SA, with lower SA yielding poor performance. Thus, the costs associated with automation failure are greater when automation is applied to higher order stages of information processing. Results have practical implications for automation design and development of SA training programs.

Sethumadhavan, A.↗

Cost-Effectiveness Analysis of Preoperative Versus Postoperative Radiation Therapy in Extremity Soft Tissue Sarcoma

Purpose: Surgery combined with radiation therapy (RT) is the cornerstone of multidisciplinary management of extremity soft tissue sarcoma (STS). Although RT can be given in either the preoperative or the postoperative setting with similar local recurrence and survival outcomes, the side effect profiles, costs, and long-term functional outcomes are different. The aim of this study was to use decision analysis to determine optimal sequencing of RT with surgery in patients with extremity STS. Methods and Materials: A cost-effectiveness analysis was conducted using a state transition Markov model, with quality-adjusted life years (QALYs) as the primary outcome. A time horizon of 5 years, a cycle length of 3 months, and a willingness-to-pay threshold of $50,000/QALY was used. One-way deterministic sensitivity analyses were performed to determine the thresholds at which each strategy would be preferred. The robustness of the model was assessed by probabilistic sensitivity analysis. Results: Preoperative RT is a more cost-effective strategy ($26,633/3.00 QALYs) than postoperative RT ($28,028/2.86 QALYs) in our base case scenario. Preoperative RT is the superior strategy with either 3-dimensional conformal RT or intensity-modulated RT. One-way sensitivity analyses identified the relative risk of chronic adverse events as having the greatest influence on the preferred timing of RT. The likelihood of preoperative RT being the preferred strategy was 82% on probabilistic sensitivity analysis. Conclusions: Preoperative RT is more cost effective than postoperative RT in the management of resectable extremity STS, primarily because of the higher incidence of chronic adverse events with RT in the postoperative setting.

61 RADIATION PROTECTION AND DOSIMETRY↗

Introduction to SIMRAND: Simulation of research and development project

SIMRAND: SIMulation of Research ANd Development Projects is a methodology developed to aid the engineering and management decision process in the selection of the optimal set of systems or tasks to be funded on a research and development project. A project may have a set of systems or tasks under consideration for which the total cost exceeds the allocated budget. Other factors such as personnel and facilities may also enter as constraints. Thus the project's management must select, from among the complete set of systems or tasks under consideration, a partial set that satisfies all project constraints. The SIMRAND methodology uses analytical techniques and probability theory, decision analysis of management science, and computer simulation, in the selection of this optimal partial set. The SIMRAND methodology is truly a management tool. It initially specifies the information that must be generated by the engineers, thus providing information for the management direction of the engineers, and it ranks the alternatives according to the preferences of the decision makers.

Miles, R. F., Jr.↗

Space Shuttle RTOS Bayesian Network

With shrinking budgets and the requirements to increase reliability and operational life of the existing orbiter fleet, NASA has proposed various upgrades for the Space Shuttle that are consistent with national space policy. The cockpit avionics upgrade (CAU), a high priority item, has been selected as the next major upgrade. The primary functions of cockpit avionics include flight control, guidance and navigation, communication, and orbiter landing support. Secondary functions include the provision of operational services for non-avionics systems such as data handling for the payloads and caution and warning alerts to the crew. Recently, a process to selection the optimal commercial-off-the-shelf (COTS) real-time operating system (RTOS) for the CAU was conducted by United Space Alliance (USA) Corporation, which is a joint venture between Boeing and Lockheed Martin, the prime contractor for space shuttle operations. In order to independently assess the RTOS selection, NASA has used the Bayesian network-based scoring methodology described in this paper. Our two-stage methodology addresses the issue of RTOS acceptability by incorporating functional, performance and non-functional software measures related to reliability, interoperability, certifiability, efficiency, correctness, business, legal, product history, cost and life cycle. The first stage of the methodology involves obtaining scores for the various measures using a Bayesian network. The Bayesian network incorporates the causal relationships between the various and often competing measures of interest while also assisting the inherently complex decision analysis process with its ability to reason under uncertainty. The structure and selection of prior probabilities for the network is extracted from experts in the field of real-time operating systems. Scores for the various measures are computed using Bayesian probability. In the second stage, multi-criteria trade-off analyses are performed between the scores. Using a prioritization of measures from the decision-maker, trade-offs between the scores are used to rank order the available set of RTOS candidates.

Morris, A. Terry↗

Design Analysis for Lunar Safe Haven Concepts

NASA’s plan to return humans to the lunar surface faces many challenges, especially in the sustained phases of the Artemis program. In combination with a habitat, a Lunar Safe Haven (LSH) would provide additional protection to crew, electronics, and equipment from the hazards of the space environment such as radiation, thermal extremes, micrometeoroids, and lunar dust. Influenced by the NASA Artemis program goals, the Lunar Safe Haven Study defined the high-level requirements, outlined the trade space for a LSH concept, and evaluated a set of concepts using a decision analysis structure. This paper will provide additional detail for two concepts that were designed and evaluated during the LSH study, the logic behind the choices, and some of the main driving design parameters.

lunar↗

Applying Technology Ranking and Systems Engineering in Advanced Life Support

According to the Advanced Life Support (ALS) Program Plan, the Systems Modeling and Analysis Project (SMAP) has two important tasks: 1) prioritizing investments in ALS Research and Technology Development (R&TD), and 2) guiding the evolution of ALS systems. Investments could be prioritized simply by independently ranking different technologies, but we should also consider a technology's impact on system design. Guiding future ALS systems will require SMAP to consider many aspects of systems engineering. R&TD investments can be prioritized using familiar methods for ranking technology. The first step is gathering data on technology performance, safety, readiness level, and cost. Then the technologies are ranked using metrics or by decision analysis using net present economic value. The R&TD portfolio can be optimized to provide the maximum expected payoff in the face of uncertain future events. But more is needed. The optimum ALS system can not be designed simply by selecting the best technology for each predefined subsystem. Incorporating a new technology, such as food plants, can change the specifications of other subsystems, such as air regeneration. Systems must be designed top-down starting from system objectives, not bottom-up from selected technologies. The familiar top-down systems engineering process includes defining mission objectives, mission design, system specification, technology analysis, preliminary design, and detail design. Technology selection is only one part of systems analysis and engineering, and it is strongly related to the subsystem definitions. ALS systems should be designed using top-down systems engineering. R&TD technology selection should consider how the technology affects ALS system design. Technology ranking is useful but it is only a small part of systems engineering.

Jones, Harry↗

NASA Langley Research Center Systems Analysis & Concepts Directorate Participation in the Exploration Systems Architecture Study

The NASA Langley Research Center (LaRC) Systems Analysis & Concepts Directorate (SACD) began studying human exploration missions beyond low Earth orbit (LEO) in the year 1999. This included participation in NASA s Decadal Planning Team (DPT), the NASA Exploration Team (NExT), Space Architect studies and Revolutionary Aerospace Systems Concepts (RASC) architecture studies that were used in formulating the new Vision for Space Exploration. In May of 2005, NASA initiated the Exploration Systems Architecture Study (ESAS). The primary outputs of the ESAS activity were concepts and functional requirements for the Crewed Exploration Vehicle (CEV), its supporting launch vehicle infrastructure and identification of supporting technology requirements and investments. An exploration systems analysis capability has evolved to support these functions in the past and continues to evolve to support anticipated future needs. SACD had significant roles in supporting the ESAS study team. SACD personnel performed the liaison function between the ESAS team and the Shuttle/Station Configuration Options Team (S/SCOT), an agency-wide team charged with using the Space Shuttle to complete the International Space Station (ISS) by the end of Fiscal Year (FY) 2010. The most significant of the identified issues involved the ability of the Space Shuttle system to achieve the desired number of flights in the proposed time frame. SACD with support from the Kennedy Space Center performed analysis showing that, without significant investments in improving the shuttle processing flow, that there was almost no possibility of completing the 28-flight sequence by the end of 2010. SACD performed numerous Lunar Surface Access Module (LSAM) trades to define top level element requirements and establish architecture propellant needs. Configuration trades were conducted to determine the impact of varying degrees of segmentation of the living capabilities of the combined descent stage, ascent stage, and other elements. The technology assessment process was developed and implemented by SACD as the ESAS architecture was refined. SACD implemented a rigorous and objective process which included (a) establishing architectural functional needs, (b) collection, synthesis and mapping of technology data, and (c) performing an objective decision analysis resulting in technology development investment recommendations. The investment recommendation provided budget, schedule, and center/program allocations to develop required technologies for the exploration architecture, as well as the identification of other investment opportunities to maximize performance and flexibility while minimizing cost and risk. A summary of the trades performed and methods utilized by SACD for the Exploration Systems Mission Directorate (ESAS) activity is presented along with how SACD is currently supporting the implementation of the Vision for Space Exploration.

Keyes, Jennifer↗

GIS Supported Optimal Site Selection for Coastal Structure Integrated Wave Energy Converters: Preprint

There is an urgent need for adaptative engineering towards more resilient coastal communities, and Coastal Structure Integrated Wave Energy Converters (CSI-WECs) are a promising solution. CSI-WECs are wave energy converters (WECs) that are built into coastal protection structures, such as breakwaters. These devices provide the dual benefits of coastal protection and local energy production, and unlike other WECs, maximizing energy production is not always the main objective. CSI-WECs are located near the shore, where the wave resource is lower, thus site selection for these devices differs from the typical offshore WECs. Other attributes of a site that may be more important than wave power include existing coastal structures, port proximity, electric transmission line proximity, and location of disadvantaged communities. Geospatial information systems (GIS) interfaces can be used to easily visualize geospatial data that represents these difference kinds of criteria important for the determination of optimal marine energy sites. Multi-Criteria Decision Analysis (MCDA) is a geospatial analysis method that allows for the evaluation of multiple, usually overlapping, criteria. This project applies GIS-based MCDA methods to two distinct case studies in Puerto Rico and California for CSI-WEC site selection. The two study sites contrast in terms of wave resource, coastal hazards, and local energy needs. This research demonstrates the utility of applying an MCDA framework within GIS to facilitate efficient site selection for devices with unique characteristics in different use cases.

coastal protection↗

Panel Session 6: Interagency Community of Practice in Risk and Performance Assessments

This panel focused on the status of the Inter-agency Performance and Risk Assessment Community of Practice (P and RA COP). Representatives from the P and RA COP and subject matter experts discussed lessons learned and provide feedback on building the P and RA COP to support risk-informed environmental decision making. Each panelist provided a brief presentation followed by open discussion. Presentations proposed include: 1 - Applying Lessons Learned on Engineered Barrier Service Life to Performance Assessment (Craig Benson, University of Virginia - CRESP (USA)); 2 - Decision Analysis in Integrated Risk and Performance Assessment: Challenges (Paul Black, Neptune and Company, Inc. (USA)); 3 - Managing Uncertainty (Roger Seitz, IEI (USA)); 4 - U.S. EPA Superfund Program's Need for Model Comparison for Radioactive Contamination (Stuart Walker, Office of Remediation and Technology Innovation (OSRTI), US EPA (USA)); 5 - CRESP Activities Supporting Performance and Risk Assessments (Kevin Brown, Vanderbilt University - CRESP (USA))

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Pleural homocysteine for malignant pleural effusion: A prospective and double‐blind diagnostic test accuracy study

Abstract Objective To assess the accuracy of pleural fluid homocysteine for discriminating malignant pleural effusion (MPE) and benign pleural effusion (BPE). Methods A total of 194 patients from two cohorts (Hohhot and Changshu) with undiagnosed pleural effusion were prospectively enrolled. Their pleural homocysteine was measured, and its diagnostic accuracy and net benefit for MPE were analyzed by receiver operating characteristic (ROC) curve analysis and decision curve analysis, respectively. Results In the Hohhot cohort ( n = 136) and the Changshu cohort ( n = 58), MPE patients had significantly higher homocysteine levels than BPE patients. The areas under the ROC curves of homocysteine for the diagnosis of MPE were 0.61 ( p = 0.027) and 0.59 ( p = 0.247), respectively. The decision curves of homocysteine were close to the reference line in both the Hohhot cohort and the Changshu cohort. Conclusion The diagnostic accuracy of pleural fluid homocysteine for MPE was low.

Cao, Xi‐Shan↗

Multi-criteria group decision-making based sustainability measurement of wastewater treatment processes

There are various processes which can be used for wastewater treatment (WT), and the selection of the most sustainable one among different processes is a hard task. This study aims at helping the decision-makers (DM) to address this by developing an intuitionistic fuzzy set (IFS) theory based group multi-attribute decision analysis (MADA) method. Ten criteria in environment, economy, society-politic, and technology dimensions were employed to achieve sustainability measurement (SM) of WT processes. The multi-criteria sustainability assessment method developed in this study allow different experts to attend the SM, and enable the participants to employ the natural language/words to depict their intuitionistic opinions. Accordingly, the proposed method can achieve group SM under uncertainties. An illustrative case including four processes for wastewater treatment, namely Anaerobic-Anoxic-Oxic (AAO) process, Triple Oxidation Ditch (TOD) process, Anaerobic single-ditch oxidation (ASD) process, and Sequencing batch reactor activated sludge process (SBR), has been studied, and the results reveal that this method can determine sustainability sequence of different WT processes.

54 ENVIRONMENTAL SCIENCES↗

Radionuclide Risk Coefficient Uncertainty Distributions for Use in Performance Assessments - 19156

Traditionally, radiation dose has been used as the regulatory criterion for decision making in performance assessments (PAs), despite the concept of cancer risk arguably being a more easily understood endpoint than dose for the public, and a preferable metric for decision analysis. However, the United States Environmental Protection Agency (EPA) has developed risk parameters for use in risk assessments and PAs in the form of radionuclide-specific risk coefficients, or RCs, which are published in various Federal Guidance Reports (FGRs). RCs are employed as scalars to convert environmental radionuclide exposure (via ingestion, inhalation, and external exposure) estimates to incremental lifetime cancer risk (ILCR). ILCR is the additional cancer risk averaged over a lifetime, over-and-above all-cause cancer risk, associated with carcinogen exposure. Uncertainties associated with RCs are discussed in FGR 13 and in a joint report published by EPA and Oak Ridge National Laboratory, but statistical distributions for the RCs were not directly developed. The uncertainty assessments in the EPA/ONRL report were based on dosimetric modeling and elicitation of nine experts. From these sources, five uncertainty categories were defined based on ratios of the 5. and 95. quantiles of uncertainty. Thus, the representations of uncertainty defined by EPA/ORNL are not distributions in a traditional sense. Furthermore, the authors only addressed uncertainty in RCs for inhalation and ingestion pathways. We develop a methodology for assigning statistical distributions to EPA's published mortality RC values (i.e. to estimate the probability of dying from radiation-induced cancers) for the inhalation (slow, medium, and fast absorption types), ingestion (water, food, and soil), and external exposure pathways associated with all cancer types. We employed the same dosimetric concepts and assumptions as EPA/ORNL, including cancer risk (dose-response) distributional information from a previous expert elicitation, which was also employed by EPA/ORNL in their work. We assumed that uncertainty in RCs can be described by lognormal distributions based on the modeling conducted previously by EPA/ORNL, and that point estimates tabulated in FGR 13 represent median values of the distributions. We also extended EPA/ORNL's uncertainty ratios to statistical distributions for external exposure RCs. The results are a set of radionuclide-specific distributions that are applicable in PAs that focus on cancer mortality. These distributions are currently and will subsequently be employed in PAs at various sites, in addition to the required regulatory dose limits. Quantification of ILCRs and associated uncertainty in PAs will provide regulators and the public with additional information for good decision making. Future directions include further refinement of the distributions and development of statistical distributions for morbidity RCs, which are used to estimate the probability of developing, but not necessarily dying as a result of, radiation-induced cancer. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗