Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Bayesian Model Averaging for Ensemble-Based Estimates of Solvation Free Energies

This paper applies the Bayesian Model Averaging (BMA) statistical ensemble technique to estimate small molecule solvation free energies. There is a wide range methods for predicting solvation free energies, ranging from empirical statistical models to {\it ab initio} quantum mechanical approaches. Each of these methods are based on a set of conceptual assumptions that can affect a method's predictive accuracy and transferability. Using an iterative statistical process, we have selected and combined solvation energy estimates using an ensemble of 17 diverse methods from the SAMPL4 blind prediction study to form a single, aggregated solvation energy estimate. The ensemble design process evaluates the statistical information in each individual method as well as the performance of the aggregate estimate obtained from the ensemble as a whole. Methods that possess minimal or redundant information are pruned from the ensemble and the evaluation process repeats until aggregate predictive performance can no longer be improved. We show that this process results in a final aggregate estimate that outperforms all individual methods by reducing estimate errors by as much as 91% to 1.2 kcal/mol accuracy. We also compare our iterative refinement approach to other statistical ensemble approaches and demonstrate that this iterative process reduces estimate errors by as much as 61%. This work provides a new approach for accurate solvation free energy prediction and lays the foundation for future work on aggregate models that can balance computational cost with predictive accuracy.

solvation, Bayesian model averaging, Electrostatic↗

The Integration of COTS/GOTS within NASA's HST Command and Control System

NASA's mission critical Hubble Space Telescope (HST) command and control system has been re-engineered with COTS/GOTS and minimal custom code. This paper focuses on the design of this new HST Control Center System (CCS) and the lessons learned throughout its development. CCS currently utilizes 31 COTS/GOTS products with an additional 12 million lines of custom glueware code; the new CCS exceeds the capabilities of the original system while significantly reducing the lines of custom code by more than 50%. The lifecycle of COTS/GOTS products will be examined including the pack-age selection process, evaluation process, and integration process. The advantages, disadvantages, issues, concerns, and lessons teamed for integrating COTS/GOTS into the NASA's mission critical HST CCS will be examined in detail. Command and control systems designed with traditional custom code development efforts will be compared with command and control systems designed with new development techniques relying heavily on COTS/COTS integration. This paper will reveal the many hidden costs of COTS/GOTS solutions when compared to traditional custom code development efforts; this paper will show the high cost of COTS/GOTS solutions including training expenses, consulting fees, and long-term maintenance expenses.

Pfarr, Thomas↗

The Integration of COTS/GOTS within NASA's HST Command and Control System

NASA's mission critical Hubble Space Telescope (HST) command and control system has been re-engineered with commercial-off-the-shelf (COTS/GOTS) and minimal custom code. This paper focuses on the design of this new HST Control Center System (CCS) and the lessons learned throughout its development. CCS currently utilizes more than 30 COTS/GOTS products with an additional 1/2 million lines of custom glueware code; the new CCS exceeds the capabilities of the original system while significantly reducing the lines of custom code by more than 50%. The lifecycle of COTS/GOTS products will be examined including the package selection process, evaluation process, and integration process. The advantages, disadvantages, issues, concerns, and lessons learned for integrating COTS/GOTS into the NASA's mission critical HST CCS will be examined in detail. This paper will reveal the many hidden costs of COTS/GOTS solutions when compared to traditional custom code development efforts; this paper will show the high cost of COTS/GOTS solutions including training expenses, consulting fees, and long-term maintenance expenses.

Pfarr, Thomas↗

Test and inspection for process control of monolithic circuits

Report details the test and inspection procedures for the mass production of high reliability integrated circuits. It covers configuration control, basic fundamentals of quality control, control charts, wafer process evaluation, general process evaluation, evaluation score system, and diffusion evaluation.

Spangenberg, E.↗

Water Governance Process Assessment: Evaluating the Link between Decision Making Processes and Outcomes in the Columbia River Basin

Academics and practitioners agree that in water governance, the quality of a decision making process should influence the quality of the outcome and the degree to which it is accepted by interested parties. However, finding a feasible way to evaluate and then improve the quality of a decision making process has proven elusive. Systematically collecting evidence of a link between process and outcome is also challenging. In my dissertation, I developed a synthesis framework for evaluating and improving water governance decision making to address these two challenges. The synthesis framework, which I call the Water Governance Process Assessment (Water GPA), draws upon 22 existing frameworks rooted in resilience, adaptive governance, and good governance. From these frameworks, I identified and provided a way to evaluate four characteristics critical to good water governance decision making processes: 1) accountability, 2) inclusivity, and 3) information, and 4) context. I applied the Water GPA framework to the recent reviews of the Columbia River Treaty by the United States and Canada. I collected data for the case studies through semi-structured interviews and surveys of process participants from the federal agencies, Tribal and First Nations, state/provincial governments, local governments, stakeholder interests, and citizens. I coded and analyzed the interviews using the qualitative analysis software QSR NVivo and the characteristics identified in the Water GPA framework. I used the two case study applications to demonstrate how to use the framework. I identified what aspects of the four process categories served as barriers and building blocks for good water governance in each water governance process. I also gleaned lessons learned and recommendations including some for determining process leadership, ensuring meaningful engagement and inclusivity, addressing sovereignty issues, setting decision criteria, sharing decision authority, allocating resources in future processes in the US and BC portions of the Columbia River Basin and similar basins. In my case studies, I also investigated which characteristics of the water governance decision making process influenced the direct outcomes of those processes (the decisions) as well as other non-target outcomes (such as trust, co-produced science, new coalitions, etc.). All four characteristics outlined in the Water Governance Process Assessment (Water GPA), played some role in the development of the content and/or support of the two case study decision documents (US Regional Recommendation and BC Provincial Decision). Generally, when the characteristic of the process was done well, it improved the legitimacy and acceptance of the decision. At the same time performing poorly in one area did not necessarily torpedo the process or decision. In both case studies, it appears that the interplay between the process characteristics (that is where two or more characteristics converge) had a greater influence over the decision. Further work is needed to clearly identify what characteristics of a process are most influential in different situations. The Water GPA is one useful tool for this effort.

13 HYDRO ENERGY↗

The Aerosol Modeling Testbed: A community tool to objectively evaluate aerosol process modules

This study describes a new modeling paradigm that significantly advances how the third activity is conducted while also fully exploiting data and findings from the first two activities. The Aerosol Modeling Testbed (AMT) is a computational framework for the atmospheric sciences community that streamlines the process of testing and evaluating aerosol process modules over a wide range of spatial and temporal scales. The AMT consists of a fully-coupled meteorology-chemistry-aerosol model, and a suite of tools to evaluate the performance of aerosol process modules via comparison with a wide range of field measurements. The philosophy of the AMT is to systematically and objectively evaluate aerosol process modules over local to regional spatial scales that are compatible with most field campaigns measurement strategies. The performance of new treatments can then be quantified and compared to existing treatments before they are incorporated into regional and global climate models. Since the AMT is a community tool, it also provides a means of enhancing collaboration and coordination among aerosol modelers.

54 ENVIRONMENTAL SCIENCES↗

ISOLOK VALVE ACCEPTANCE TESTING FOR DWPF SME SAMPLING PROCESS

Evaluation of the Defense Waste Processing Facility (DWPF) Chemical Process Cell (CPC) cycle time identified several opportunities to improve the CPC processing time. Of the opportunities, a focus area related to optimizing the equipment and efficiency of the sample turnaround time for DWPF Analytical Laboratory was identified. The Mechanical Systems & Custom Equipment Development (MS&CED) Section of the Savannah River National Laboratory (SRNL) evaluated the possibility of using an Isolok{reg_sign} sampling valve as an alternative to the Hydragard{reg_sign} valve for taking process samples. Previous viability testing was conducted with favorable results using the Isolok sampler and reported in SRNL-STI-2010-00749 (1). This task has the potential to improve operability, reduce maintenance time and decrease CPC cycle time. This report summarizes the results from acceptance testing which was requested in Task Technical Request (TTR) HLW-DWPF-TTR-2010-0036 (2) and which was conducted as outlined in Task Technical and Quality Assurance Plan (TTQAP) SRNL-RP-2011-00145 (3). The Isolok to be tested is the same model which was tested, qualified, and installed in the Sludge Receipt Adjustment Tank (SRAT) sample system. RW-0333P QA requirements apply to this task. This task was to qualify the Isolok sampler for use in the DWPF Slurry Mix Evaporator (SME) sampling process. The Hydragard, which is the current baseline sampling method, was used for comparison to the Isolok sampling data. The Isolok sampler is an air powered grab sampler used to 'pull' a sample volume from a process line. The operation of the sampler is shown in Figure 1. The image on the left shows the Isolok's spool extended into the process line and the image on the right shows the sampler retracted and then dispensing the liquid into the sampling container. To determine tank homogeneity, a Coliwasa sampler was used to grab samples at a high and low location within the mixing tank. Data from the two locations were compared to determine if the contents of the tank were well mixed. The Coliwasa sampler is a tube with a stopper at the bottom and is designed to obtain grab samples from specific locations within the drum contents. A position paper (4) was issued to address the prototypic flow loop issues and simulant selections. A statistically designed plan (5) was issued to address the total number of samples each sampler needed to pull, to provide the random order in which samples were pulled and to group samples for elemental analysis. The TTR required that the Isolok sampler perform as well as the Hydragard sampler during these tests to ensure the acceptability of the Isolok sampler for use in the DWPF sampling cells. Procedure No.L9.4-5015 was used to document the sample parameters and process steps. Completed procedures are located in R&D Engineering job folder 23269.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Mesoscale to microscale wind farm flow modeling and evaluation

The increasing size of wind turbines, with rotors already spanning more than 150 m diameter and hub heights above 100 m, requires proper modeling of the atmospheric boundary layer (ABL) from the surface to the free atmosphere. Furthermore, large wind farm arrays create their own boundary layer structure with unique physics. This poses significant challenges to traditional wind engineering models that rely on surface-layer theories and engineering wind farm models to simulate the flow in and around wind farms. However, adopting an ABL approach offers the opportunity to better integrate wind farm design tools and meteorological models. The challenge is how to build the bridge between atmospheric and wind engineering model communities and how to establish a comprehensive evaluation process that identifies relevant physical phenomena for wind energy applications with modeling and experimental requirements. A framework for model verification, validation, and uncertainty quantification is established to guide this process by a systematic evaluation of the modeling system at increasing levels of complexity. In terms of atmospheric physics, ‘building the bridge’ means developing models for the so-called ‘terra incognita,’ a term used to designate the turbulent scales that transition from mesoscale to microscale. This range of scales within atmospheric research deals with the transition from parameterized to resolved turbulence and the improvement of surface boundary-layer parameterizations. The coupling of meteorological and wind engineering flow models and the definition of a formal model evaluation methodology, is a strong area of research for the next generation of wind conditions assessment and wind farm and wind turbine design tools. Some fundamental challenges are identified in order to direct future research in this area.

17 WIND ENERGY↗

C-400 and C-409 Criticality Incredible Road Map

Many guides and standards describe a process for evaluating process operations with known quantities of fissile material. The accepted industry guides and standards for performing criticality evaluations for fissile material operations are not well suited for operating systems that may contain residual fissile material. The Paducah Site deactivation activities includes large process components that have unfavorable geometries for the {sup 235}U enrichment levels present. The fissile material holdup in these components can range from negligible residual quantities to significant deposits weighing several hundred pounds. The purpose of this white paper is to outline a methodology that can be used to declare a facility as criticality incredible (CI). For the purpose of this paper, criticality incredible means that the inventory and its form and distribution within the facility does not need Nuclear Criticality Safety Evaluation (NCSE) type (e.g., administrative or engineered) controls. This assumes of course that certain project assumptions are maintained. For example in the facilities that will be discussed within this paper, wet decontamination is not part of the planned demolition and disposal operations. The proposed methodology for deactivation of a facility to the point that criticality incredible can be declared will be applied to the C-400 Chemical Cleaning Building and to the C-409 Decontamination Facility at the Paducah Gaseous Diffusion Plant (PGDP). The purpose and intent of the CI declaration is to release a facility from Nuclear Criticality Safety (NCS) requirements and simplify the demolition of the facility. In practical terms, this means the facility can be re-categorized as < a Hazard Category 3 facility per DOE-STD-1027-92 Hazard Categorization and Accident Analysis Techniques for compliance with DOE Order 5480.23, Nuclear Safety Analysis Reports, NCS controls are not needed, and the Criticality Accident Alarm Systems (CAAS) can be removed from service. The only involvement from the site NCS program following the declaration would be to ensure that the underlying assumptions are not violated through discovered conditions or project changes. This includes the institutional control of preventing new fissile material from being introduced into the facility. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Molten Salt Reactor Initiating Event and Licensing Basis Event Workshop Summary

Oak Ridge National Laboratory (ORNL) hosted a workshop on identifying potential initiating events for radioactive releases as precursors to licensing basis events for a generic liquid-fuel molten salt reactor (MSR). The workshop was held on May 21 and 22, 2019. Participants included representatives from seven prospective reactor vendors, industry bodies, US and Canadian regulators, US and Canadian national laboratories, and the academic community. Accident sequence evaluation is central to deterministic and risk-informed performance-based reactor safety evaluation processes, and initiating events begin the accident sequence evaluation process. The workshop focused on how MSR initiating events feed into the risk-informed, performance-based reactor safety evaluation process described in DG-1353. This report describes the workshop activities and results, provides a generic list of initiating events involving selected systems, and presents the estimation of the relative frequency and consequences of accident sequences for a few important, high-level initiating events.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluation of NASA space grant consortia programs

The meaningful evaluation of the NASA Space Grant Consortium and Fellowship Programs must overcome unusual difficulties: (1) the program, in its infancy, is undergoing dynamic change; (2) the several state consortia and universities have widely divergent parochial goals that defy a uniform evaluative process; and (3) the pilot-sized consortium programs require that the evaluative process be economical in human costs less the process of evaluation comprise the effectiveness of the programs they are meant to assess. This paper represents an attempt to assess the context in which evaluation is to be conducted, the goals and limitations inherent to the evaluation, and to recommend appropriate guidelines for evaluation.

Eisenberg, Martin A.↗

The Strengths and Limitations of Satellite Data for Evaluating Tropospheric Processes in Chemistry-Climate Models

There is now a wealth of satellite data products available with which to evaluate a model fs simulation of tropospheric composition and other model processes. All of these data products have their strengths and limitations that need to be considered for this purpose. For example, uncertainties are introduced into a data product when 1) converting a slant column to a vertical column and 2) estimating the amount of a total column of a trace gas (e.g., ozone, nitrogen dioxide) that resides in the troposphere. Oftentimes, these uncertainties are not well quantified and the satellite data products are not well evaluated against in situ observations. However, these limitations do not preclude us from using these data products to evaluate our model processes if we understand these strengths and limitations when developing diagnostics. I will show several examples of how satellite data products are being used to evaluate particular model processes with a focus on the strengths and limitations of these data products. In addition, I will introduce the goals of a newly formed team to address issues on the topic of "satellite data for improved model evaluation and process studies" that is established in support of the IGAC/SPARC Global Chemistry ]Climate Modeling and Evaluation Workshop.

Duncan, Bryan↗