Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

TH-C-204-03: Writing Good Scientific Papers and Responding to Critiques

In this presentation, the Editors will outline our vision for the future of Medical Physics and review recent work-in-progress initiatives to implement this vision. Finally, we will close with guidance to authors on how to write a good Medical Physics paper. A major focus will be the transition to a new publisher in 2017 following a more than 40-year association with American Institute of Physics Publishing (AIPP). Vision for Medical Physics and status of current initiatives: Jeff Williamson, Editor-in-Chief The broad vision of Medical Physics is “to continue the Journal’s tradition of publishing the very best science that propels our discipline forward and improves our contribution to patient care.” More concretely, the Journal should be the preeminent forum for exchange of cutting edge medical physics science. We seek to identify the best contributions in (a) high impact clinical physics innovations; (b) clinical translation and validation of basic science innovations; and (c) cutting edge basic science developments with potential for patient care improvements. Among the challenges and opportunities, we face are: electronic-only and open access publishing; competition from new radiological science journals; trends towards more interactive, social-media based scientific communities; and diversification of the medical physics research, authorship, and readership domains, including clinical applications quite foreign to core ABR clinical competencies. Recently implemented and ongoing initiatives include: Revised Table of Contents (TOC) and more contemporary topical submission categories Structured review template in HTML format Comprehensive hierarchical taxonomy for identifying reviewer expertise Formal process for soliciting high quality and impact Review and Vision 20/20 Articles We have recruited four Review Article Co-editors: John Rowlands and Ingrid Reiser (imaging physics) and Joao Seco and Tim Zhu (therapy physics). The Co-Editors will identify timely topics and solicit high profile authors to submit review manuscripts. To submit an article, authors will need to work with an assigned Co-Editor to develop a mutually acceptable outline and abstract. 5) A new and exciting class of articles: Medical Physics Dataset Articles (MPDAs) MPDAs describe scientifically or clinically valuable open-access datasets with high potential for contributing to the research of medical physicists working on related problems. In contrast to Research Articles, MPDAs should not include hypothesis testing; or data analyses supporting generalizable conclusions. The publically accessible dataset must be permanently archived before the MPDA can be published. This initiative is being led by Joe Deasy. Update on new publisher transition: The transition of AAPM scientific publishing operations to a major publishing house is a major opportunity to expand Medical Physics readership and its scholarly impact. The advantages include: (a) common manuscript management and web hosting platforms for Medical Physics and its sister journal, JACMP; (b) greater than 4-fold expansion of subscribing institutions; and (c) resources to mount data-driven, highly targeted marketing campaigns to enhance citation and download rates. A transition update of this epochal development, which has only begun as of this writing (3/31/16), will be given. Improving manuscript quality via structured reviews, enhanced scientific category taxonomy, and outreach: Shiva Das, Therapy Physics Editor Medical Physics is committed to continuous improvement with the ultimate goal of improving the potential impact of accepted manuscripts. In order to do so, Medical Physics must be able to tap into important/emerging areas and be able to select high quality contributions consistently via discerning reviews. Improving the quality of reviews is crucial to selecting high quality manuscripts and also to improving manuscript impact via feedback in the review process. With this in mind, Medical Physics is in the process of: (a) fostering outreach to important areas that are currently underrepresented in Medical Physics; (b) implementing a structured template review form; and (c) implementing a comprehensive scientific category taxonomy to identify reviewers who are best suited to an article. Outreach efforts have begun to various scientific areas. Strategies to increase submissions from these areas will be discussed. As a consequence of this effort, a special issue on particle therapy is under development. A review template was implemented in late 2014 on a limited test basis. Based on reviewer feedback, the template was restructured and shortened to capture essential review elements. The restructured template is due to be released shortly. The new scientific category taxonomy is in the process of being deployed to reviewers and associate editors. Salient aspects of the structured review template and scientific category taxonomy will be discussed in this talk. Writing good scientific papers and responding to critiques: Mitch Goodsitt, Imaging Physics Editor The essential components of the abstract, introduction, methods, discussion and conclusion sections of manuscripts, as well as the desired writing style and style of the figures and tables will be reviewed. Publishable Medical Physics manuscripts must include clear and concise statements of the novelty and clinical and/or scientific importance of the authors’ work. Examples of novelty include: new technical solution to an important clinical problem; new generalizable knowledge; and first demonstration that an existing engineering solution solves a clinical problem. Please note that we encourage authors of recently published conference proceedings (e.g., SPIE, IEEE) papers on novel medical physics related work to submit more substantial versions of that work to our journal. All submissions must include: sufficient background information and rationale; enough detail for others to reproduce the authors’ work; sufficient statistical analysis to refute or validate the authors’ hypotheses; a description of how the present work compares to, is distinct from, and improves upon others’ work; and sections devoted to the limitations of the study and future directions. Writing should be polished. Poor wording, grammar and composition frustrate the review process. Our journal does not have copyeditors for revising manuscripts. When authors receive critiques from the referees and associate editor, the authors should provide a detailed point-by-point response to each comment. The authors’ rebuttal should include the text of the original criticism, the authors’ response, and a pasted copy of the modified text along with the line numbers in the revised article. The new text should be highlighted in a different font color in the revised submission. Following these recommendations will improve submissions and facilitate the review process.

60 APPLIED LIFE SCIENCES↗

Source scaling comparison and validation in Central Italy: data intensive direct S waves versus the sparse data coda envelope methodology

SUMMARY Robustness of source parameter estimates is a fundamental issue in understanding the relationships between small and large events; however, it is difficult to assess how much of the variability of the source parameters can be attributed to the physical source characteristics or to the uncertainties of the methods and data used to estimate the values. In this study, we apply the coda method by Mayeda et al. using the coda calibration tool (CCT), a freely available Java-based code (https://github.com/LLNL/coda-calibration-tool) to obtain a regional calibration for Central Italy for estimating stable source parameters. We demonstrate the power of the coda technique in this region and show that it provides the same robustness in source parameter estimation as a data-driven methodology [generalized inversion technique (GIT)], but with much fewer calibration events and stations. The Central Italy region is ideal for both GIT and coda approaches as it is characterized by high-quality data, including recent well-recorded seismic sequences such as L'Aquila (2009) and Amatrice–Norcia–Visso (2016–2017). This allows us to apply data-driven methods such as GIT and coda-based methods that require few, but high-quality data. The data set for GIT analysis includes ∼5000 earthquakes and more than 600 stations, while for coda analysis we used a small subset of 39 events spanning 3.5 < Mw < 6.33 and 14 well-distributed broad-band stations. For the common calibration events, as well as an additional 247 events (∼1.7 < Mw < ∼5.0) not used in either calibration, we find excellent agreement between GIT-derived and CCT-derived source spectra. This confirms the ability of the coda approach to obtain stable source parameters even with few calibration events and stations. Even reducing the coda calibration data set by 75 per cent, we found no appreciable degradation in performance. This validation of the coda calibration approach over a broad range of event size demonstrates that this procedure, once extended to other regions, represents a powerful tool for future routine applications to homogeneously evaluate robust source parameters on a national scale. Furthermore, the coda calibration procedure can homogenize the Mw estimates for small and large events without the necessity of introducing any conversion scale between narrow-band measures such as local magnitude (ML) and Mw, which has been shown to introduce significant bias.

Morasca, Paola (ORCID:0000000265254867)↗

Rapid Exploitation and Analysis of Documents

Analysts are overwhelmed with information. They have large archives of historical data, both structured and unstructured, and continuous streams of relevant messages and documents that they need to match to current tasks, digest, and incorporate into their analysis. The purpose of the READ project is to develop technologies to make it easier to catalog, classify, and locate relevant information. We approached this task from multiple angles. First, we tackle the issue of processing large quantities of information in reasonable time. Second, we provide mechanisms that allow users to customize their queries based on latent topics exposed from corpus statistics. Third, we assist users in organizing query results, adding localized expert structure over results. Forth, we use word sense disambiguation techniques to increase the precision of matching user generated keyword lists with terms and concepts in the corpus. Fifth, we enhance co-occurrence statistics with latent topic attribution, to aid entity relationship discovery. Finally we quantitatively analyze the quality of three popular latent modeling techniques to examine under which circumstances each is useful.

97 MATHEMATICS AND COMPUTING↗

Dynamics retrieval from stochastically weighted incomplete data by low-pass spectral analysis

Time-resolved serial femtosecond crystallography (TR-SFX) provides access to protein dynamics on sub-picosecond timescales, and with atomic resolution. Due to the nature of the experiment, these datasets are often highly incomplete and the measured diffracted intensities are affected by partiality. To tackle these issues, one established procedure is that of splitting the data into time bins, and averaging the multiple measurements of equivalent reflections within each bin. This binning and averaging often involve a loss of information. Here, we propose an alternative approach, which we call low-pass spectral analysis (LPSA). In this method, the data are projected onto the subspace defined by a set of trigonometric functions, with frequencies up to a certain cutoff. This approach attenuates undesirable high-frequency features and facilitates retrieving the underlying dynamics. A time-lagged embedding step can be included prior to subspace projection to improve the stability of the results with respect to the parameters involved. Subsequent modal decomposition allows to produce a low-rank description of the system's evolution. Using a synthetic time-evolving model with incomplete and partial observations, we analyze the LPSA results in terms of quality of the retrieved signal, as a function of the parameters involved. We compare the performance of LPSA to that of a range of other sophisticated data analysis techniques. We show that LPSA allows to achieve excellent dynamics reconstruction at modest computational cost. Finally, we demonstrate the superiority of dynamics retrieval by LPSA compared to time binning and merging, which is, to date, the most commonly used method to extract dynamical information from TR-SFX data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Color Transformations of Photometric Measurements of Galaxies in Optical and Near-infrared Wide-field Imaging Surveys*

Abstract Over the past 2 decades, wide-field photometric surveys in optical and infrared domains reached a nearly all-sky coverage thanks to numerous observational facilities operating in both hemispheres. However, subtle differences among exact realizations of Johnson and SDSS photometric systems require one to convert photometric measurements into the same system prior to analysis of composite data sets originating from multiple surveys. It turns out that the published photometric transformations lead to substantial biases when applied to integrated photometry of galaxies from the corresponding catalogs. Here we present photometric transformations based on piece-wise linear approximations of integrated photometry of galaxies in the optical surveys SDSS, DECaLS, BASS, MzLS, DES, DELVE, KiDS, VST ATLAS, and the near-infrared surveys UKIDSS, UHS, VHS, and VIKING. We validate our transformations by constructing k -corrected color–magnitude diagrams of non-active galaxies and measuring the position and tightness of the “red sequence.” We also provide transformations for aperture magnitudes and show how they are affected by the image quality difference among the surveys. We present the implementation of the derived transformations in python and idl and also a web-based color transformation calculator for galaxies. By comparing DECaLS and DES, we identified systematic issues in DECaLS photometry for extended galaxies, which we attribute to the photometric software package used by DECaLS. As an application of our method, we compiled two multi-wavelength photometric catalogs for over 200,000 low- and intermediate-redshift galaxies originating from CfA FAST and Hectospec spectral archives.

Astronomy & Astrophysics↗

TU-C-17A-07: FusionARC Treatment with Adaptive Beam Selection Method

Purpose: Recently, a new treatment scheme, FusionARC, has been introduced to compensate for the pitfalls in single-arc VMAT planning. It basically allows for the static field treatment in selected locations, while the remaining is treated by single-rotational arc delivery. The important issue is how to choose the directions for static field treatment. This study presents an adaptive beam selection method to formulate fusionARC treatment scheme. Methods: The optimal plan for single-rotational arc treatment is obtained from two-step approach based on the reweighted total-variation (TV) minimization. To choose the directions for static field treatment with extra segments, a value of our proposed cost function at each field is computed on the new fluence-map, which adds an extra segment to the designated field location only. The cost function is defined as a summation of equivalent uniform dose (EUD) of all structures with the fluence-map, while assuming that the lower cost function value implies the enhancement of plan quality. Finally, the extra segments for static field treatment would be added to the selected directions with low cost function values. A prostate patient data was applied and evaluated with three different plans: conventional VMAT, fusionARC, and static IMRT. Results: The 7 field locations, corresponding to the lowest cost function values, are chosen to insert extra segment for step-and-shoot dose delivery. Our proposed fusionARC plan with the selected angles improves the dose sparing to the critical organs, relative to static IMRT and conventional VMAT plans. The dose conformity to the target is significantly enhanced at the small expense of treatment time, compared with VMAT plan. Its estimated treatment time, however, is still much faster than IMRT. Conclusion: The fusionARC treatment with adaptive beam selection method could improve the plan quality with insignificant damage in the treatment time, relative to the conventional VMAT.

60 APPLIED LIFE SCIENCES↗

A knowledge based approach to matching human neurodegenerative disease and animal models

Neurodegenerative diseases present a wide and complex range of biological and clinical features. Animal models are key to translational research, yet typically only exhibit a subset of disease features rather than being precise replicas of the disease. Consequently, connecting animal to human conditions using direct data-mining strategies has proven challenging, particularly for diseases of the nervous system, with its complicated anatomy and physiology. To address this challenge we have explored the use of ontologies to create formal descriptions of structural phenotypes across scales that are machine processable and amenable to logical inference. As proof of concept, we built a Neurodegenerative Disease Phenotype Ontology (NDPO) and an associated Phenotype Knowledge Base (PKB) using an entity-quality model that incorporates descriptions for both human disease phenotypes and those of animal models. Entities are drawn from community ontologies made available through the Neuroscience Information Framework (NIF) and qualities are drawn from the Phenotype and Trait Ontology (PATO). We generated ~1200 structured phenotype statements describing structural alterations at the subcellular, cellular and gross anatomical levels observed in 11 human neurodegenerative conditions and associated animal models. PhenoSim, an open source tool for comparing phenotypes, was used to issue a series of competency questions to compare individual phenotypes among organisms and to determine which animal models recapitulate phenotypic aspects of the human disease in aggregate. Overall, the system was able to use relationships within the ontology to bridge phenotypes across scales, returning non-trivial matches based on common subsumers that were meaningful to a neuroscientist with an advanced knowledge of neuroanatomy. The system can be used both to compare individual phenotypes and also phenotypes in aggregate. This proof of concept suggests that expressing complex phenotypes using formal ontologies provides considerable benefit for comparing phenotypes across scales and species.

59 BASIC BIOLOGICAL SCIENCES↗

Non-Invertible Transforms for Image-Based Verification

Imaging may play a unique role in verifying the presence and distribution of warhead components in warhead counting and dismantlement settings where image information content can distinguish among shapes, forms, and material composition of items. However, a major issue with imaging is the high level of intrusiveness, and in particular, the possible need to store sensitive comparison images in the inspection system that would violate information barrier (IB) principles. Reducing images via transformations or feature extraction can produce image features (e.g. attributes) for verification, but with enough prior information about structure the reduced information itself may be sufficient to deduce sensitive details of the original image. Further reducing resolution of the transformed image information is an option, but too much reduction destroys the quality of the attribute. We study the possibility of a one-way transform that allows storage of non-sensitive reference information and analysis to enable comparison of transformed images within IB constraints. In particular, we consider the degree to which images can be reconstructed from image intensity histograms depending on the number of pixel intensity bins and the degree of frequency data quantization, as well as assumed knowledge of configuration of objects in the images. We also explore the concept of a 'perceptual hash' as a class of transforms that may enable verification with provable non-invertibility, leading to an effective one-way transform that preserves the nature of the image feature data without revealing sufficient information to reconstruct the original image.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Low Level and Transuranic Waste Segregation and Low Level Waste Characterization at the 200 Area of the Hanford Site - 12424

This paper describes the waste measurement and waste characterization activities carried out by ANTECH Corporation (ANTECH) and CH2M Hill Plateau Remediation Company (CHPRC) at the 200 Area of the Hanford Site under Contracts No. 22394 and No. 40245 for the US Department of Energy (DOE). These include Low Level Waste (LLW) and Transuranic (TRU) Waste segregation and LLW characterization for both 55-gallon (200-litre) drums with gross weight up to 454 kg and 85-gallon over-pack drums. In order to achieve efficient and effective waste drum segregation and assay, ANTECH deployed an automated Gamma Mobile Assay Laboratory (G-MAL) at the trench face in both 200 Area West and East. The unit consists of a modified 40 foot ISO shipping container with an automatic flow through roller conveyor system with internal drum weigh scale, four measurement and drum rotation positions, and four high efficiency high purity Germanium (HPGe) detectors with both detector and shadow shields. The unit performs multiple far-field measurements and is able to segregate drums at levels well below 100 nCi/g. The system is sufficiently sensitive that drums, which are classified as LLW, are characterized at measurement levels that meet the Environmental Restoration Disposal Facility (ERDF) Waste Acceptance Criteria (WAC). With measurement times of between 20 and 30 minutes the unit can classify and characterize over 40 drums in an 8-hour shift. The system is well characterized with documented calibrations, lower limits of detection (LLD) and total measurement uncertainty. The calibrations are confirmed and verified using nationally traceable standards in keeping with the CHPRC measurement requirements. The performance of the system has been confirmed and validated throughout the measurement process by independent CHPRC personnel using traceable standards. All of the measurement and maintenance work has been conducted during the period under a Quality Assurance Plan (QAP) compliant with the applicable criteria of NQA-1 (2000). This includes not only the calibrations and measurements but also the data analysis activities of the ANTECH Subject Matter Experts (SME) and ANTECH support and maintenance activities as well as the activities of CHPRC staff who recover, transport and load waste drums and disposition measured and characterized drums. The overall processes of drum recovery and analysis are described in the paper. Specific spectral data is presented which illustrates the segregation, sentencing and assay process for different types of drums with different radionuclide profiles. The process of identifying and quantifying a wide range of non-TRU radionuclide isotopes is explained and illustrated with spectral examples. The difficulties associated with the measurement of drums with a high gamma ray background, usually arising from high levels of Cs-137 are considered. These drums, which would normally be declared indeterminate and treated as TRU, are addressed under contract No. 40245 by the deployment of the ANTECH Neutron Mobile Assay Laboratory. This is an Active-Passive neutron assay system housed in a modified ISO shipping container. The unit is designed for the measurement and assay of both drums and crates (including B-25 boxes and SWB containers) and will quantify the content of both plutonium and uranium. The neutron system has been employed to perform further evaluation on indeterminate drums to classify them to either LLW or TRU. The experiences of both gamma ray and neutron system operation in different conditions are described; as are the issues of throughput, drum handling and system maintenance. All of these are considered in the overriding context of safe drum handling and safe assay system operation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Tropospheric Ozone Assessment Report: Database and Metrics Data of Global Surface Ozone Observations

In support of the first Tropospheric Ozone Assessment Report (TOAR) a relational database of global surface ozone observations has been developed and populated with hourly measurement data and enhanced metadata. A comprehensive suite of ozone data products including standard statistics, health and vegetation impact metrics, and trend information, are made available through a common data portal and a web interface. These data form the basis of the TOAR analyses focusing on human health, vegetation, and climate relevant ozone issues, which are part of this special feature. Cooperation among many data centers and individual researchers worldwide made it possible to build the world's largest collection of in-situ hourly surface ozone data covering the period from 1970 to 2015. By combining the data from almost 10,000 measurement sites around the world with global metadata information, new analyses of surface ozone have become possible, such as the first globally consistent characterisations of measurement sites as either urban or rural/remote. Exploitation of these global metadata allows for new insights into the global distribution, and seasonal and long-term changes of tropospheric ozone and they enable TOAR to perform the first, globally consistent analysis of present-day ozone concentrations and recent ozone changes with relevance to health, agriculture, and climate. Considerable effort was made to harmonize and synthesize data formats and metadata information from various networks and individual data submissions. Extensive quality control was applied to identify questionable and erroneous data, including changes in apparent instrument offsets or calibrations. Such data were excluded from TOAR data products. Limitations of a posteriori data quality assurance are discussed. As a result of the work presented here, global coverage of surface ozone data for scientific analysis has been significantly extended. Yet, large gaps remain in the surface observation network both in terms of regions without monitoring, and in terms of regions that have monitoring programs but no public access to the data archive. Therefore future improvements to the database will require not only improved data harmonization, but also expanded data sharing and increased monitoring in data-sparse regions.

54 ENVIRONMENTAL SCIENCES↗

Design, Development, and Operation of an Integrated Fluidized Carbon Capture Unit Using Polyethylenimine Sorbents

In this paper, we present the design, development, and operation of a reactor system for CO 2 capture. Modifications were implemented to address differences in sorbent from 180 μm Geldart group B to 115 μm Geldart group A material; operational issues were discovered during experimental trials. The major obstacle in system operation was the ability to maintain a constant circulation of a solid sorbent stemming from this change in sorbent material. The system consisted of four fluid beds, through which a polyamine impregnated sorbent was circulated and adsorption, preheat, regeneration, and cooling processes occurred. Pressure transducers, thermocouples, gas flow meters, and gas composition instrumentation were used to characterize thermal, hydrodynamic, and gas adsorption performance in this integrated unit. A series of shakedown tests were performed and the configuration altered to meet the needs of the sorbent performance and achieve desired target capture efficiencies. Methods were identified, tested, and applied to continuously monitor critical operating parameters including solids circulation rate, adsorbed and desorbed CO 2 , solids inventories, and pressures. The working capacity and CO 2 capture efficiency were used to assess sorbent performance while CO 2 closure was used to define data quality and approach to steady-state. Testing demonstrated >90% capture efficiencies and identified the regenerator to be the process step limiting throughput. Sorbent performance was found to be related to the reactant stoichiometry. Finally, a stochastic model with an exponential dependence on the relative CO 2 /amine concentration was used to describe 90% of the variance in the data.

01 COAL, LIGNITE, AND PEAT↗

Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report

Extreme-science drives the need for distributed exascale processing and communications that are carefully, yet flexibly, managed. Exponential growth of data for scientific simulations, experimental data, collaborative data analyses, remote visualization and GRID computing requirements of scientists in fields as diverse as high energy physics, climate change, genomics, fusion, synchrotron radiation, material science, medicine, and other scientific disciplines cannot be accommodated by simply applying existing transport protocols to faster pipes. Further, scientific challenges today demand diverse research teams, heightening the need for and increasing the complexity of collaboration. To address these issues within the network layer and physical layer, we have performed a number of research activities surrounding effective allocation and management of elastic optical network (EON) resources, particularly focusing on FlexGrid transponders. FlexGrid transponders support the opportunity to build Layer-1 connections at a wide range of bandwidths and to reconfigure them rapidly. The new flexibility supports complex new ways of using the physical layer that must be carefully managed and hidden from the scientist end-users. FlexGrid networks utilize flexible (or elastic) spectral bandwidths for each data link without using fixed wavelength grids. The flexibility in spectrum allocation brings many appealing features to network operations. Current networks are designed for the worst case impairments in transmission performance and the assigned spectrum is over-provisioned. In contrast, the FlexGrid networks can operate with the highest spectral efficiency and minimum bandwidth for the given traffic demand while meeting the minimum quality of transmission (QoT) requirement. Two primary focuses of our research are: (1) resource and spectrum allocation (RSA) for IP traffic over EONs, and (2) RSA for cross-domain optical networks. Previous work concentrates primarily on large file transfers within a single domain. Adding support for IP traffic changes the nature of the RSA problem: instead of choosing to accept or deny each request for network support, IP traffic is inherently elastic and thus lends itself to a bandwidth maximization formulation. We developed a number of algorithms that could be easily deployed within existing and new FlexGrid networks, leading to networks that better support scientific collaboration. Cross-domain RSA research is essential to support large-scale FlexGrid networks, since configuration information is generally not shared or coordinated across domains. The results presented here are in their early stages. They are technically feasible and practical, but still require coordination among organizations and equipment owners and a higher-layer framework for managing network requests.

42 ENGINEERING↗

LLNL Response to the DOE ASCR RFI, "Stewardship of Software for Scientific and High-Performance Computing"

For decades, Lawrence Livermore National Laboratory (LLNL) has been engaged in significant research, development, and support for software to enable scientific computing and, particularly, the use of high performance computing (HPC) in the NNSA mission space. In particular, the move in the mid-1990’s to simulation as a leading component of stockpile stewardship through the ASCI and the successor ASC programs, as well as the need for reliable data acquisition and control software for the National Ignition Facility, have been important drivers in building expertise in production-quality software development at LLNL. LLNL has also been a leader in the DOE SciDAC FASTMath Institute and the DOE Exascale Computing Project (ECP), both of which have striven to make scientific computing software – in particular, the enabling technologies underpinning simulation capabilities – more widely adopted and sustainable. As such, we believe that our experience can inform the broader goal of software stewardship for scientific and high-performance computing. LLNL strongly supports the formation of a new DOE ASCR program element in software stewardship and sustainment. Historically, DOE ASCR has funded applied mathematics and computer science research that has led to the development of important new capabilities and algorithms that are expressed as artifacts in research software. Such frameworks, libraries, and tools have seldom been directly funded to address the important issues of code maintenance, documentation, robustness, and community building. Software engineering and support have typically been done on the side in support of the ASCR-driven research products. DOE funding priorities have been slow to recognize that good software engineering, the kind that ensures research investments have more adoption and longevity, requires significant resources. Based upon our experiences, we have prepared this response to highlight the concerns and issues we believe to be important as DOE ASCR considers its role in scientific software stewardship. We believe that role is important and will require a significant investment of new funding to legitimately support the technologies past and future DOE ASCR investments have and will produce to facilitate their uptake and adoption in the broader scientific computing community. Following a summary of our involvement in scientific software development, the remainder our response is organized around the nine topics specifically identified in the RFI.

97 MATHEMATICS AND COMPUTING↗

Validation of CTF Droplet Entrainment and Annular/Mist Closure Models using Riso Steam/Water Experiments

This report summarizes the work done to validate the droplet entrainment and de-entrainment models as well as two-phase closure models in the CTF code by comparison with experimental data obtained at Riso National Laboratory. The Riso data included a series of over 250 steam/water experiments that were performed in both tube and annulus geometries over a range of various pressures and outlet qualities. Experimental conditions were set so that the majority of cases were in the annular/mist ow regime. Measurements included liquid lm ow rate, droplet ow rate, lm thickness, and two-phase pressure drop. CTF was used to model 180 of the tubular geometry cases, matching experimental geometry, outlet pressure, and outlet ow quality to experimental values. CTF results were compared to the experimental data at the outlet of the test section in terms of vapor and entrained liquid ow fractions, pressure drop per unit length, and liquid lm thickness. The entire process of generating CTF input decks, running cases, extracting data, and generating comparison plots was scripted using Python and Matplotlib for a completely automated validation process. All test cases and scripting tools have been committed to the COBRA-TF master repository and selected cases have been added to the continuous testing system to serve as regression tests. The dierences between the CTF- and experimentally-calculated ow fraction values were con- sistent with previous calculations by Wurtz, who applied the same entrainment correlation to the same data. It has been found that CTF's entrainment/de-entrainment predictive capability in the annular/mist ow regime for this particular facility is comparable to the licensed industry code, COBRAG. While lm and droplet predictions are generally good, it has been found that accuracy is diminished at lower ow qualities. This nding is consistent with the noted deciencies in the Wurtz entrainment model employed by CTF. The CTF predicted two-phase pressure drop in the annular/mist ow regime has been found to be highly inaccurate, exhibiting a clear bias with respect to the experimental data. This inaccuracy led to an investigation that revealed deciencies in the implementation of the annular/mist interfacial friction model, which should be investigated further in the future. Looking to published COBRAG results for this same facility reveal it exhibits no bias with regard to experimental pressure drop results. In addition to the problems with pressure drop prediction, the lm thickness was also signicantly under-predicted by CTF compared to both experimental data and Wurtz's analytical calculations. Film thickness is calculated using a simple geometric relationship and lm void fraction in CTF, which is dependent on slip ratio and interfacial friction. It is possible that the issues aecting the pressure drop and lm void prediction are related.

97 MATHEMATICS AND COMPUTING↗

ENHANCED DOE HIGH LEVEL WASTE MELTER THROUGHPUT STUDIES: SRNL GLASS SELECTION STRATEGY

The Department of Energy has authorized a team of glass formulation and processing experts at the Savannah River National Laboratory (SRNL), the Pacific Northwest National Laboratory (PNNL), and the Vitreous State Laboratory (VSL) at Catholic University of America to develop a systematic approach to increase high level waste melter throughput (by increasing waste loading with minimal or positive impacts on melt rate). This task is aimed at proof-of-principle testing and the development of tools to improve waste loading and melt rate, which will lead to higher waste throughput. Four specific tasks have been proposed to meet these objectives (for details, see WSRC-STI-2007-00483): (1) Integration and Oversight, (2) Crystal Accumulation Modeling (led by PNNL)/Higher Waste Loading Glasses (led by SRNL), (3) Melt Rate Evaluation and Modeling, and (4) Melter Scale Demonstrations. Task 2, Crystal Accumulation Modeling/Higher Waste Loading Glasses is the focus of this report. The objective of this study is to provide supplemental data to support the possible use of alternative melter technologies and/or implementation of alternative process control models or strategies to target higher waste loadings (WLs) for the Defense Waste Processing Facility (DWPF)--ultimately leading to higher waste throughputs and a reduced mission life. The glass selection strategy discussed in this report was developed to gain insight into specific technical issues that could limit or compromise the ability of glass formulation efforts to target higher WLs for future sludge batches at the Savannah River Site (SRS). These technical issues include Al-dissolution, higher TiO{sub 2} limits and homogeneity issues for coupled-operations, Al{sub 2}O{sub 3} solubility, and nepheline formation. To address these technical issues, a test matrix of 28 glass compositions has been developed based on 5 different sludge projections for future processing. The glasses will be fabricated and characterized based on the protocols outlined in the SRNL Task and Quality Assurance (QA) plan.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Simulations of the edge plasma: the role of atomic, molecular and surface physics

Atomic, molecular and surface physics plays an important role in simulations of the edge plasma in present day tokamaks, and in the predictive simulations of new devices. The edge plasma - in this context, the Scrape-Off Layer (SOL), the Private Flux Region (PFR) and core region close to the separatrix (or Last Closed Flux Surface, LCFS) - provides the boundary conditions for the main plasma, and is the region where much of the power and all of the particle exhaust occurs. It is also the region where the plasma interacts with solid surfaces, puffed gases and gas arising from recycling. The results of plasma edge simulations can depend strongly on the availability and quality of the atomic, molecular and surface data (the peak plasma temperature at the divertor was found to vary by a factor of five dependent on the choice of atomic physics data in a recent sensitivity analysis). The current material choice for ITER with Plasma Facing Components (PFCs) consisting of C, Be and W also presents challenges, both in the availability of the necessary data for W, and in the plethora of charge states for W. Another challenge presented by the material choice is the likely presence of mixed materials formed by the migration of material from one surface to another. These introduce effects like alloying and preferential sputtering as well as new (much longer) time-scales in the problem.Efforts to incorporate a bundled charge state model within one of the present edge simulation codes, SOLPS, will be described, as well as efforts to address some of the questions raised by mixed materials. Some issues related to data consistency and traceability within the context of the European effort on Integrated Tokamak Modelling will also be addressed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Initial Efforts Organizing WPNCS SG-8: Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks

The Working Party on Nuclear Criticality Safety (WPNCS) under the guidance of the Organization for Economic Co-operation and Development (OECD) Nuclear Energy Agency (NEA) has over 20 years of experience addressing concerns related to static and transient configurations encountered within the nuclear fuel cycle: fuel fabrication, transportation, reprocessing, storage, and geological disposal. One of the cornerstone activities of the WPNCS is the International Criticality Safety Benchmark Evaluation Project (ICSBEP), which was established to identify a comprehensive set of criticality benchmark data, evaluate the data, including quantification of overall uncertainties; compile the data into a standardized format, perform sample calculations utilizing modern nuclear data sets and codes utilized in nuclear criticality safety, and formally document the work into a single source of verified benchmark data. Annually, members of the ICSBEP Technical Review Group (TRG) contribute evaluated benchmark data that undergoes comprehensive technical review prior to publication in the ICSBEP Handbook. In the years since the ICSBEP was established, there has been much work to prepare benchmark data to support validation activities in nuclear criticality safety. The 2020 edition of the ICSBEP Handbook contains acceptable benchmark specifications for 5,053 critical, subcritical, or near-critical configurations in 582 benchmark evaluations. Modern benchmark development benefits from decades of experienced international participants, a well-established handbook format, supplementary guides to deal with uncertainty quantification, and a comprehensive review process based upon independent reviews from international experts. The ICSBEP Handbook also contains 838 configurations deemed unacceptable to support criticality safety efforts. They are recorded, with the reasoning for their rejection, to preserve the experimental data, prevent reevaluation of data that are incomplete or contain known errors, and/or to potentially allow future reevaluation of the experiment pending the identification of sufficient data to resolve identified inconsistencies and errors. Users of the ICSBEP Handbook today might notice that the rigor and quality of modern criticality safety benchmarks is much greater than those prepared within the initial decade of the project. Benchmarks with 1s uncertainties in k eff greater than 1% were traditionally rejected unless they were identified as unique experiment types that encompassed materials, fuels, or designs not available from other benchmark experiments. However, benchmarks developed using modern experimental techniques and practices typically have uncertainties on the order of a few tenths of a percent. There have been ongoing efforts to improve the overall quality of previously published benchmark evaluations. Seventy-eight evaluations, containing approximately 600 configurations, have been revised just within the past decade. An additional eleven benchmarks are under revision for updated release in the 2020 edition of the ICSBEP Handbook. If some of the historic benchmarks were resubmitted in their current form to the TRG today, they would be rejected due to lack of data, missing components in the uncertainty analysis, or incomplete benchmark model development. The use of historic criticality safety benchmarks that underestimate the total uncertainty, lack properly quantified biases, or provide inadequate benchmark specifications do not sufficiently support modern criticality safety and nuclear data efforts. Although the ICSBEP Handbook is recognized by regulating bodies to support criticality safety, users are required to justify their reasons to ignore historic benchmark data and include additional safety margins within their designs. Discussions were held at the WPNCS 23rd Annual Meeting in September 2019 regarding the aforementioned issues. The resultant decision was to establish Subgroup 8 (SG-8): Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks. The current activities of SG-8 are discussed herein.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

American Recovery & Reinvestment Act: Fuel Cell Hybrid Power Packs and Hydrogen Refueling for Lift Trucks

HEB Grocery Company, Inc. (H-E-B) is a privately-held supermarket chain with 310 stores throughout Texas and northern Mexico. H-E-B converted 14 of its lift reach trucks to fuel cell power using Nuvera Fuel Cells’ PowerEdge™ units to verify the value proposition and environmental benefits associated with the technology. Issues associated with the increasing power requirements of the distribution center operation, along with high ambient temperature in the summer and other operating conditions (such as air quality and floor surface condition), surfaced opportunities for improving Nuvera’s PowerEdge fuel cell system design in high-throughput forklift environments. The project included on-site generation of hydrogen from a steam methane reformer, called PowerTap™ manufactured by Nuvera. The hydrogen was generated, compressed and stored in equipment located outside H-E-B’s facility, and provided to the forklifts by hydrogen dispensers located in high forklift traffic areas. The PowerEdge fuel cell units logged over 25,300 operating hours over the course of the two-year project period. The PowerTap hydrogen generator produced more than 11,100 kg of hydrogen over the same period. Hydrogen availability at the pump was 99.9%. H-E-B management has determined that fuel cell forklifts help alleviate several issues in its distribution centers, including truck operator downtime associated with battery changing, truck and battery maintenance costs, and reduction of grid electricity usage. Data collected from this initial installation demonstrated a 10% productivity improvement, which enabled H-E-B to make economic decisions on expanding the fleet of PowerEdge and PowerTap units in the fleet, which it plans to undertake upon successful demonstration of the new PowerEdge reach truck product. H-E-B has also expressed interest in other uses of hydrogen produced on site in the future, such as for APUs used in tractor trailers and refrigerated transport trucks in its fleet.

08 HYDROGEN↗