Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Judgment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Why Models Don%3CU%2B2019%3Et Forecast.

The title of this paper, Why Models Don't Forecast, has a deceptively simple answer: models don't forecast because people forecast. Yet this statement has significant implications for computational social modeling and simulation in national security decision making. Specifically, it points to the need for robust approaches to the problem of how people and organizations develop, deploy, and use computational modeling and simulation technologies. In the next twenty or so pages, I argue that the challenge of evaluating computational social modeling and simulation technologies extends far beyond verification and validation, and should include the relationship between a simulation technology and the people and organizations using it. This challenge of evaluation is not just one of usability and usefulness for technologies, but extends to the assessment of how new modeling and simulation technologies shape human and organizational judgment. The robust and systematic evaluation of organizational decision making processes, and the role of computational modeling and simulation technologies therein, is a critical problem for the organizations who promote, fund, develop, and seek to use computational social science tools, methods, and techniques in high-consequence decision making.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Chemical hazard evaluation of material disposal area (MDA) B closure project

TA-21, MDA-B (NES) is the 'contaminated dump,' landfill with radionuclides and chemicals from process waste disposed in 1940s. This paper focuses on chemical hazard categorization and hazard evaluation of chemicals of concern (e.g., peroxide, beryllium). About 170 chemicals were disposed in the landfill. Chemicals included products, unused and residual chemicals, spent, waste chemicals, non-flammable oils, mineral oil, etc. MDA-B was considered a High hazard site. However, based on historical records and best engineering judgment, the chemical contents are probably at best 5% of the chemical inventory. Many chemicals probably have oxidized, degraded or evaporated for volatile elements due to some fire and limited shelf-life over 60 yrs, which made it possible to downgrade from High to Low chemical hazard site. Knowing the site history and physical and chemical properties are very important in characterizing a NES site. Public site boundary is only 20 m, which is a major concern. Chemicals of concern during remediation are peroxide that can cause potential explosion and beryllium exposure due to chronic beryllium disease (CBD). These can be prevented or mitigated using engineering control (EC) and safety management program (SMP) to protect the involved workers and public.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Quantification Techniques of SCALE/TSUNAMI

The Standardized Computer Analysis for Licensing Evaluation (SCALE) code system developed at Oak Ridge National Laboratory (ORNL) includes Tools for Sensitivity and Uncertainty Analysis Methodology Implementation (TSUNAMI). The TSUNAMI code suite can quantify the predicted change in system responses, such as k eff , reactivity differences, or ratios of fluxes or reaction rates, due to changes in the energy-dependent, nuclide-reaction-specific cross-section data. Where uncertainties in the neutron cross-section data are available, the sensitivity of the system to the cross-section data can be applied to propagate the uncertainties in the cross-section data to an uncertainty in the system response. Uncertainty quantification is useful for identifying potential sources of computational biases and highlighting parameters important to code validation. Traditional validation techniques often examine one or more average physical parameters to characterize a system and identify applicable benchmark experiments. However, with TSUNAMI correlation coefficients are developed by propagating the uncertainties in neutron cross-section data to uncertainties in the computed responses for experiments and safety applications through sensitivity coefficients. The bias in the experiments, as a function of their correlation coefficient with the intended application, is extrapolated to predict the bias and bias uncertainty in the application through trending analysis or generalized linear least squares techniques, often referred to as 'data adjustment.' Even with advanced tools to identify benchmark experiments, analysts occasionally find that the application models include some feature or material for which adequately similar benchmark experiments do not exist to support validation. For example, a criticality safety analyst may want to take credit for the presence of fission products in spent nuclear fuel. In such cases, analysts sometimes rely on 'expert judgment' to select an additional administrative margin to account for gap in the validation data or to conclude that the impact on the calculated bias and bias uncertainty is negligible. As a result of advances in computer programs and the evolution of cross-section covariance data, analysts can use the sensitivity and uncertainty analysis tools in the TSUNAMI codes to estimate the potential impact on the application-specific bias and bias uncertainty resulting from nuclides not represented in available benchmark experiments. This paper presents the application of methods described in a companion paper.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Science-Based Simulation Model of Human Performance for Human Reliability Analysis

Human reliability analysis (HRA), a component of an integrated probabilistic risk assessment (PRA), is the means by which the human contribution to risk is assessed, both qualitatively and quantitatively. However, among the literally dozens of HRA methods that have been developed, most cannot fully model and quantify the types of errors that occurred at Three Mile Island. Furthermore, all of the methods lack a solid empirical basis, relying heavily on expert judgment or empirical results derived in non-reactor domains. Finally, all of the methods are essentially static, and are thus unable to capture the dynamics of an accident in progress. The objective of this work is to begin exploring a dynamic simulation approach to HRA, one whose models have a basis in psychological theories of human performance, and whose quantitative estimates have an empirical basis. This paper highlights a plan to formalize collaboration among the Idaho National Laboratory (INL), the University of Maryland, and The Ohio State University (OSU) to continue development of a simulation model initially formulated at the University of Maryland. Initial work will focus on enhancing the underlying human performance models with the most recent psychological research, and on planning follow-on studies to establish an empirical basis for the model, based on simulator experiments to be carried out at the INL and at the OSU.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A total risk assessment methodology for security assessment.

Sandia National Laboratories performed a two-year Laboratory Directed Research and Development project to develop a new collaborative risk assessment method to enable decision makers to fully consider the interrelationships between threat, vulnerability, and consequence. A five-step Total Risk Assessment Methodology was developed to enable interdisciplinary collaborative risk assessment by experts from these disciplines. The objective of this process is promote effective risk management by enabling analysts to identify scenarios that are simultaneously achievable by an adversary, desirable to the adversary, and of concern to the system owner or to society. The basic steps are risk identification, collaborative scenario refinement and evaluation, scenario cohort identification and risk ranking, threat chain mitigation analysis, and residual risk assessment. The method is highly iterative, especially with regard to scenario refinement and evaluation. The Total Risk Assessment Methodology includes objective consideration of relative attack likelihood instead of subjective expert judgment. The 'probability of attack' is not computed, but the relative likelihood for each scenario is assessed through identifying and analyzing scenario cohort groups, which are groups of scenarios with comparable qualities to the scenario being analyzed at both this and other targets. Scenarios for the target under consideration and other targets are placed into cohort groups under an established ranking process that reflects the following three factors: known targeting, achievable consequences, and the resources required for an adversary to have a high likelihood of success. The development of these target cohort groups implements, mathematically, the idea that adversaries are actively choosing among possible attack scenarios and avoiding scenarios that would be significantly suboptimal to their objectives. An adversary who can choose among only a few comparable targets and scenarios (a small comparable target cohort group) is more likely to choose to attack the specific target under analysis because he perceives it to be a relatively unique attack opportunity. The opposite is also true. Thus, total risk is related to the number of targets that exist in each scenario cohort group. This paper describes the Total Risk Assessment Methodology and illustrates it through an example.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Semantic Relatedness Approach for Traceability Link Recovery

Human analysts working with automated tracing tools need to directly vet candidate traceability links in order to determine the true traceability information. Currently, human intervention happens at the end of the traceability process, after candidate traceability links have already been generated. This often leads to a decline in the results accuracy. In this paper, we propose an approach, based on semantic relatedness (SR), which brings human judgment to an earlier stage of the tracing process by integrating it into the underlying retrieval mechanism. SR tries to mimic human mental model of relevance by considering a broad range of semantic relations, hence producing more semantically meaningful results. We evaluated our approach using three datasets from different application domains, and assessed the tracing results via six different performance measures concerning both result quality and browsability. The empirical evaluation results show that our SR approach achieves a significantly better performance in recovering true links than a standard Vector Space Model (VSM) in all datasets. Our approach also achieves a significantly better precision than Latent Semantic Indexing (LSI) in two of our datasets.

99 GENERAL AND MISCELLANEOUS↗

Prioritizing Acquisition Pathways in the State Level Concept

The International Atomic Energy Agency's (IAEA) Department of Safeguards has launched a project to further develop the State-level concept for the planning, implementation, and evaluation of safeguards activities. In order to further evolve the safeguards system an emphasis is placed on integrating inspection-related activities and the State evaluation process to draw safeguards conclusions in the most efficient way. The credible implementation of acquisition pathway analysis is central to the success of the IAEA's State-level concept. NNSA's Office of Nuclear Safeguards and Security (NA-241) The Next Generation Safeguards Initiative (NGSI) is sponsoring Los Alamos National Laboratory (LANL) to produce a study that will examine the use of acquisition pathway analysis in: (1) Developing a State-specific, State-level approach (SLA) and Annual Implementation Plan (AIP); (2) Maximizing the utility of the physical model; and (3) Supporting resource allocation decisions through a pathway prioritization. To deal with the challenge of developing an effective and efficient SLA, this study looks at: (1) Prioritizing proliferation pathways based on an assessment of a State's capabilities and assumed proliferation strategies; and (2) Relevant State behavior (e.g., transparency, cooperation, etc.) while avoiding subjective judgments about States themselves. The study makes use of case studies and concrete examples in order to illustrate how new concepts and approaches will be implemented, and how they may differ from more traditional safeguards approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Adaptive Sampling using Support Vector Machines

Reliability/safety analysis of stochastic dynamic systems (e.g., nuclear power plants, airplanes, chemical plants) is currently performed through a combination of Event-Tress and Fault-Trees. However, these conventional methods suffer from certain drawbacks: • Timing of events is not explicitly modeled • Ordering of events is preset by the analyst • The modeling of complex accident scenarios is driven by expert-judgment For these reasons, there is currently an increasing interest into the development of dynamic PRA methodologies since they can be used to address the deficiencies of conventional methods listed above.

99 GENERAL AND MISCELLANEOUS↗

Deep Sludge Gas Release Event Analytical Evaluation

Long Abstract. Full Text. The purpose of the Deep Sludge Gas Release Event Analytical Evaluation (DSGRE-AE) is to evaluate the postulated hypothesis that a hydrogen GRE may occur in Hanford tanks containing waste sludges at levels greater than previously experienced. There is a need to understand gas retention and release hazards in sludge beds which are 200 -300 inches deep. These sludge beds are deeper than historical Hanford sludge waste beds, and are created when waste is retrieved from older single-shell tanks (SST) and transferred to newer double-shell tanks (DST).Retrieval of waste from SSTs reduces the risk to the environment from leakage or potential leakage of waste into the ground from these tanks. However, the possibility of an energetic event (flammable gas accident) in the retrieval receiver DST is worse than slow leakage. Lines of inquiry, therefore, are (1) can sludge waste be stored safely in deep beds; (2) can gas release events (GRE) be prevented by periodically degassing the sludge (e.g., mixer pump); or (3) does the retrieval strategy need to be altered to limit sludge bed height by retrieving into additional DSTs? The scope of this effort is to provide expert advice on whether or not to move forward with the generation of deep beds of sludge through retrieval of C-Farm tanks. Evaluation of possible mitigation methods (e.g., using mixer pumps to release gas, retrieving into an additional DST) are being evaluated by a second team and are not discussed in this report. While available data and engineering judgment indicate that increased gas retention (retained gas fraction) in DST sludge at depths resulting from the completion of SST 241-C Tank Farm retrievals is not expected and, even if gas releases were to occur, they would be small and local, a positive USQ was declared (Occurrence Report EM-RP--WRPS-TANKFARM-2012-0014, "Potential Exists for a Large Spontaneous Gas Release Event in Deep Settled Waste Sludge"). The purpose of this technical report is to (1) present and discuss current understandings of gas retention and release mechanisms for deep sludge in U.S. Department of Energy (DOE) complex waste storage tanks; and (2) to identify viable methods/criteria for demonstrating safety relative to deep sludge gas release events (DSGRE) in the near term to support the Hanford C-Farm retrieval mission. A secondary purpose is to identify viable methods/criteria for demonstrating safety relative to DSGREs in the longer term to support the mission to retrieve waste from the Hanford Tank Farms and deliver it to the Waste Treatment and Immobilization Plant (WTP). The potential DSGRE issue resulted in the declaration of a positive Unreviewed Safety Question (USQ). C-Farm retrievals are currently proceeding under a Justification for Continued Operation (JCO) that only allows tanks 241-AN-101 and 241-AN-106 sludge levels of 192 inches and 195 inches, respectively. C-Farm retrievals need deeper sludge levels (approximately 310 inches in 241-AN-101 and approximately 250 inches in 241-AN-106). This effort is to provide analytical data and justification to continue retrievals in a safe and efficient manner.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Climate Change and Infrastructure, Urban Systems, and Vulnerabilities

This Technical Report on Climate Change and Infrastructure, Urban Systems, and Vulnerabilities has been prepared for the U.S. Department of Energy by the Oak Ridge National Laboratory in support of the U.S. National Climate Assessment (NCA). It is a summary of the currently existing knowledge base on its topic, nested within a broader framing of issues and questions that need further attention in the longer run. The report arrives at a number of assessment findings, each associated with an evaluation of the level of consensus on that issue within the expert community, the volume of evidence available to support that judgment, and the section of the report that provides an explanation for the finding. Cross-sectoral issues related to infrastructures and urban systems have not received a great deal of attention to date in research literatures in general and climate change assessments in particular. As a result, this technical report is breaking new ground as a component of climate change vulnerability and impact assessments in the U.S., which means that some of its assessment findings are rather speculative, more in the nature of propositions for further study than specific conclusions that are offered with a high level of confidence and research support. But it is a start in addressing questions that are of interest to many policymakers and stakeholders. A central theme of the report is that vulnerabilities and impacts are issues beyond physical infrastructures themselves. The concern is with the value of services provided by infrastructures, where the true consequences of impacts and disruptions involve not only the costs associated with the clean-up, repair, and/or replacement of affected infrastructures but also economic, social, and environmental effects as supply chains are disrupted, economic activities are suspended, and/or social well-being is threatened. Current knowledge indicates that vulnerability concerns tend to be focused on extreme weather events associated with climate change that can disrupt infrastructure services, often cascading across infrastructures because of extensive interdependencies threatening health and local economies, especially in areas where human populations and economic activities are concentrated in urban areas. Vulnerabilities are especially large where infrastructures are subject to multiple stresses, beyond climate change alone; when they are located in areas vulnerable to extreme weather events; and if climate change is severe rather than moderate. But the report also notes that there are promising approaches for risk management, based on emerging lessons from a number of innovative initiatives in U.S. cities and other countries, involving both structural and non-structural (e.g., operational) options.

Climate Impacts on Infrastructure Systems↗

Site transition framework for long-term surveillance and maintenance

This document provides a framework for all U.S. Department of Energy (DOE) facilities and sites where DOE may have anticipated long-term surveillance and maintenance (LTSM) responsibilities. It is a tool to help facilitate a smooth transition from remediation to LTSM, providing a systematic process for affected parties to utilize in analyzing the baseline to understand and manage the actions from EM mission completion through a site’s transition into LTSM. The framework is not meant to provide an exhaustive list of the specific requirement and information that are needed. Sites will have unique considerations that may not be adequately addressed by this tool, and it is anticipated that a team comprised of the transferring and receiving organization will use judgment in utilizing this augmenting with other DOE guidance. However the framework should be followed to the extent possible at each site; and adapted to accommodate unique site-specific requirements, needs, and documents. Since the objective of the tool is facilitate better understanding of the conditions of the site and the actions required for transfer, the transition team utilizing the checklist is expected to consult with management of both the receiving and transferring organization to verify that major concerns are addressed. Ideally, this framework should be used as early in the remediation process as possible. Subsequent applications of the Site Transition Framework (STF) to the site should be conducted periodically and used to verify that all appropriate steps have been or will be taken to close-out the site and that actions by both organization are identified to transfer the site to LTSM. The requirements are provided herein.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Machine Learning for Power System Disturbance and Cyber-attack Discrimination

Power system disturbances are inherently complex and can be attributed to a wide range of sources, including both natural and man-made events. Currently, the power system operators are heavily relied on to make decisions regarding the causes of experienced disturbances and the appropriate course of action as a response. In the case of cyber-attacks against a power system, human judgment is less certain since there is an overt attempt to disguise the attack and deceive the operators as to the true state of the system. To enable the human decision maker, we explore the viability of machine learning as a means for discriminating types of power system disturbances, and focus specifically on detecting cyber-attacks where deception is a core tenet of the event. We evaluate various machine learning methods as disturbance discriminators and discuss the practical implications for deploying machine learning systems as an enhancement to existing power system architectures.

cyber-attack↗

The Initial Development of a Computerized Operator Support System

A computerized operator support system (COSS) is a collection of resilient software technologies to assist operators in monitoring overall nuclear power plant performance and making timely, informed decisions on appropriate control actions for the projected plant condition. The COSS provides rapid assessments, computations, and recommendations to reduce workload and augment operator judgment and decision-making during fast- moving, complex events. A prototype COSS for a chemical volume control system at a nuclear power plant has been developed in order to demonstrate the concept and provide a test bed for further research. The development process identified four underlying elements necessary for the prototype, which consist of a digital alarm system, computer-based procedures, piping and instrumentation diagram system representations, and a recommender module for mitigation actions. An operational prototype resides at the Idaho National Laboratory (INL) using the U.S. Department of Energy’s (DOE) Light Water Reactor Sustainability (LWRS) Human Systems Simulation Laboratory (HSSL). Several human-machine interface (HMI) considerations are identified and incorporated in the prototype during this initial round of development.

99 GENERAL AND MISCELLANEOUS↗

Combined Sustainability Assessment and Techno-Economic Analysis for the Production of Biomass-Derived High-Octane Gasoline Blendstock

Conversion technologies for biomass to liquid hydrocarbon fuels are being actively developed. Converting biomass into advanced hydrocarbon fuels requires detailed assessments to help prioritize research; techno-economic analysis (TEA) is a long established tool used to assess feasibility and progress. TEA provides information needed to make informed judgments about the viability of any given conceptual conversion process; it is particularly useful to identify technical barriers and measure progress toward overcoming those barriers. Expansion of the cellulosic biofuels industry at the scale needed to meet the Renewable Fuel Standard goals is also expected to have environmental impacts. Hence, the success of the biofuels industry depends not only on economic viability, but also on environmental sustainability. A biorefinery process that is economically feasible but suffers from key sustainability drawbacks is not likely to represent a long-term solution to replace fossil-derived fuels. Overarching concerns like environmental sustainability need to be addressed for biofuels production. Combined TEA and environmental sustainability assessment of emerging pathways helps facilitate biorefinery designs that are both economically feasible and minimally impactful to the environment. This study focuses on environmental sustainability assessment and techno-economic analysis for the production of high-octane gasoline blendstock via gasification and methanol/dimethyl ether intermediates. Results from the conceptual process design with economic analysis, along with the quantification and assessment of the environmental sustainability, are presented and discussed. Sustainability metrics associated with the production of high-octane gasoline include carbon conversion efficiency, consumptive water use, life-cycle greenhouse gas emissions, fossil energy consumption, energy return on investment and net energy value.

09 BIOMASS FUELS↗

Spreadsheet Assessment Tool v. 2.4

The Spreadsheet Assessment Tool (SAT) is an easy to use, blast assessment tool that is intended to estimate the potential risk due to an explosive attack on a blood irradiator. The estimation of risk is based on the methodology, assumptions, and results of a detailed blast effects assessment study that is summarized in Sandia National Laboratories Technical Report SAND2015-6166. Risk as defined in the report and as used in the SAT is: "The potential risk of creating an air blast-induced vent opening at a buildings envelope surface". Vent openings can be created at a buildings envelope through the failure of an exterior building component—like a wall, window, or door—due to an explosive sabotage of an irradiator within the building. To estimate risk, the tool requires that users obtain and input information pertaining to the building's characteristics and the irradiator location. The tool also suggests several prescriptive mitigation strategies that can be considered to reduce risk. Given the variability in civilian building construction practices, the input parameters used by this tool may not apply to all buildings being assessed. The tool should not be used as a substitute for engineering judgment. The tool is intended for assessment purposes only.

Allen, David J.↗

Exploring Effective Decision Making through Human-Centered and Computational Intelligence Methods

Decision-making has long been studied to understand a psychological, cognitive, and social process of selecting an effective choice from alternative options. Its studies have been extended from a personal level to a group and collaborative level, and many computer-aided decision-making systems have been developed to help people make right decisions. There has been significant research growth in computational aspects of decision-making systems, yet comparatively little effort has existed in identifying and articulating user needs and requirements in assessing system outputs and the extent to which human judgments could be utilized for making accurate and reliable decisions. Our research focus is decision-making through human-centered and computational intelligence methods in a collaborative environment, and the objectives of this position paper are to bring our research ideas to the workshop, and share and discuss ideas.

collaboration↗

Document Set Differentiability Analyzer v. 0.1

Software is a JMP Scripting Language (JSL) script designed to evaluate the differentiability of a set of documents that exhibit some conceptual commonalities but are expected to describe substantially different – thus differentiable – categories. The script imports the document set, a subset of which may be partitioned into an additions pool. The bulk of the documents form a basis pool. Text analysis is applied to the basis pool to extract a mathematical representation of its conceptual content, referred to as the document concept space. A bootstrapping approach is applied to that mathematical representation in order to generate a representation of a large population of randomly designed documents that could be written within the concept space, notably without actually writing the text of those documents.The Kolmogorov-Smirnov test is applied to determine whether the basis pool document set exhibits superior differentiation relative to the randomly designed virtual documents produced by bootstrapping. If an additions pool exists, the documents are incrementally added to the basis pool, choosing the best differentiated remaining document at each step. In this manner the impact of additional categories to overall document set differentiability may be assessed.The software was developed to assess the differentiability of job description document sets. Differentiability is key to meaningful categorization. Poor job differentiation may have economic, ethical, and/or legal implications for an organization. Job categories are used in the assignment of market-based salaries; consequently, poor differentiation of job duties may set the stage for legal challenges if very similar jobs pay differently depending on title, a circumstance that also invites economic waste.The software can be applied to ensure job description set differentiability, reducing legal, economic, and ethical risks to an organization and its people. The extraction of the conceptual space to a mathematical representation enables identification of exceedingly similar documents. In the event of redundancy, two jobs may be collapsed into one. If in the judgment of the subject matter experts the jobs are truly different, the conceptual similarities are highlighted, inviting inclusion of appropriate descriptive content to explicitly characterize those differences. When additional job categories may be needed as the organization changes, the software enables evaluation of proposed additions to ensure that the resulting document set remains adequately differentiated.

Osborn, Thor D.↗

Experts’ Familiarity Versus Optimality of Visualization Design: How Familiarity Affects Perceived and Objective Task Performance

Experts, cutting across domains like biology, climate science, cyber, energy, etc., frequently use visualizations as the principal medium for making analytical judgments or for presenting the results of their analysis. However, scientists are often skeptical about adopting new visualization methods over familiar ones, although the latter might be perceptually sub-optimal. This is due to the use of the familiarity heuristic, where the perceived cognitive ease in processing familiar representations of information leads scientists to undermine the effect of visualization best practices. Recent studies have shown that this often results in a discrepancy between scientists’ perceived and actual performance quality. It has also been shown that in some cases, participatory design sessions and qualitative and quantitative user studies are able to mitigate the effects of such bias. In this paper, we discuss the potential causes and effects of familiarity related biases with examples from recent studies and reflect on the related research questions.

visualization, climate science, cognitive bias, fa↗