Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “tasks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Multimodal Data Representation with Deep Learning for Extracting Cancer Characteristics from Clinical Text

This paper presents a multimodal data representation to improve the performance of deep learning models for extracting cancer key characteristics from unstructured text in pathology reports. Specifically, in addition to using the text as the input to deep learning models, we use concept unique identifiers (CUIs) as another source of information to the models. We analyze the performance of different text and CUI data representations, including word embeddings and bag of embeddings (BOE), with a convolutional neural network (CNN) and a fully connected multilayer perceptron neural network (MLP-NN). The high level document embeddings from text and CUI inputs are combined by concatenating them and then applying a classifier. The model is used for extracting cancer subsite and histology from pathology reports. These two classification tasks have a large number of labels, i.e. 317 for subsite and 556 for histology, with extreme class imbalance. We compare the performance of the developed DL models across the two tasks based on micro- and macro-F1 scores. The evaluation shows that a multi-channel DL model that utilizes text represented by word embeddings and CUIs represented by BOE outperforms other DL models. Also, this approach significantly improves the model performance on low prevalence classes.

Alawad, Mohammed↗

BETO 2021 Peer Review - Strategic Analysis Support WBS 4.1.1.30

Strategic Analysis Support. The objective of the NREL strategic support project is to provide sound, unbiased, and consistent analyses to inform the strategic direction of the DOE BETO office. This project addresses key technological questions, provides critical data needed to inform strategy, and highlights barriers, gaps and data needs in support of the DOE BETO's mission to improve the affordability of bio-based fuels and products. This task employs various quantitative (techno-economic analysis, TEA) and qualitative (gap analysis) approaches to allow for direct comparisons of biomass conversion technologies across a wide slate of processing platforms and products. Furthermore, this project develops and utilizes novel analyses beyond traditional biorefinery focused TEA/LCAs to identify both technical (e.g., in sustainable design) and non-technical (e.g., in value proposition) barriers, as well as to outline mitigation strategies and R&D needs for emerging technologies. Additionally, the project is tasked with evaluating drivers that support the growing bio-economy, which is achieved by the development and public release of tools to advance the understanding and facilitate comparisons of socio-economic impacts along the supply chain. Critical to the success of this project is the development of defensible methodologies, analyses, and tools that are publicly available to support stakeholders and bioeconomy growth. To develop such high-quality analyses, the biggest challenge to this project, as with most analysis focused projects, is the availability and reliability of the underlying data. Therefore, the project team works extensively with key stakeholders (e.g., policy makers, bioenergy technology developers, and investors) in developing and reviewing the results of these analyses to overcome this challenge. Any remaining uncertainties associated with the analysis efforts are clearly defined and quantified.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Production of Medium-Scale Metal Additive Geometry With Hybrid Manufacturing Technology

Oak Ridge National Lab’s (ORNL) Metal Big Area Additive Manufacturing (mBAAM) and Hybrid Manufacturing teams in the Manufacturing Demonstration Facility (MDF) was tasked with developing a part that exceeded 24 inches in length and 100lbs in weight on a laser hotwire welding system. The Mazak VC-500A/5X AM HWD hybrid 5-axis CNC laser hotwire system was leveraged to complete the task. The proposed geometry was manufactured with 410 stainless steel on AISI1018 steel substrate in just over 36 hours of build time. The proposed geometry was sliced and additively manufactured in three segments; the base, and two extrusions measuring 10 inches in length and 14 inches in length. Production of this component demonstrated hybrid capabilities requiring fixed 5-axis rotations to complete geometry that exceeded the defined build volume of the machine. Multiple repairs of the part were conducted in-situ leveraging the additive and subtractive capabilities of the Mazak hybrid system. Significant overbuilding challenges were encountered and manually addressed by leveraging subtractive capabilities of the hybrid system. Future processes are presented for development to reduce overheating of top layers. Final part measurements exceeded 107 lbs. in weight and 24.5 inches in length along the principal axis; the largest and heaviest part created by a hybrid system at the MDF.

Saleeby, Kyle↗

Application-driven Privacy-preserving Data Publishing with Correlated Attributes

Recent advances in computing have allowed for the possibility to collect large amounts of data on personal activities and private living spaces. To address the privacy concerns of users in this environment, we propose a novel framework called PR-GAN that offers privacy-preserving mechanism using generative adversarial networks. Given a target application, PR-GAN automatically modifies the data to hide sensitive attributes - which may be hidden and can be inferred by machine learning algorithms - while preserving the data utility in the target application. Unlike prior works, the public's possible knowledge of the correlation between the target application and sensitive attributes is built into our modeling. We formulate our problem as an optimization problem, show that an optimal solution exists and use generative adversarial networks (GAN) to create perturbations. We further show that our method provides privacy guarantees under the Pufferfish framework, an elegant generalization of the differential privacy that allows for the modeling of prior knowledge on data and correlations. Through experiments, we show that our method outperforms conventional methods in effectively hiding the sensitive attributes while guaranteeing high performance in the target application, for both property inference and training purposes. Finally, we demonstrate through further experiments that once our model learns a privacy-preserving task, such as hiding subjects' identity, on a group of individuals, it can perform the same task on a separate group with minimal performance drops.

97 MATHEMATICS AND COMPUTING↗

Reducing Airborne Infectious Aerosol Exposure

Since beginning its work in late March 2020, the ASHRAE Epidemic Task Force (ETF) has produced a large set of guidance documents totaling hundreds of pages, all of which can be found at the ASHRAE COVID-19 resources web pages (www.ashrae.org/COVID19). This guidance has evolved as scientific understanding has increased and circumstances have changed, necessitating several updates. The initial, one-page “Core Recommendations” document, approved in January 2021, was written to provide a concise summary of the most current task force recommendations for the benefit of the public and to promote consistency between guidance documents developed by different ETF teams. This column includes the Core Recommendations (in bold) with added commentary to provide the rationale for each.

60 APPLIED LIFE SCIENCES↗

Productive Programming of Distributed Systems with the SHAD C++ Library

High-performance computing (HPC) is often perceived as a matter of making large-scale systems (e.g., clusters) run as fast as possible, regardless the required programming effort. However, the idea of "bringing HPC to the masses" has recently emerged. Inspired by this vision, we have designed SHAD, the Scalable High-performance Algorithms and Data-structures library. SHAD is open source software, written in C++, for C++ developers. Unlike other HPC libraries for distributed systems, which rely on SPMD models, SHAD adopts a shared-memory programming abstraction, to make C++ programmers feel at home. Underneath, SHAD manages tasking and data-movements, moving the computation where data resides and taking advantage of asynchrony to tolerate network latency. At the bottom of his stack, SHAD can interface with multiple runtime systems: this not only improves developer’s productivity, by hiding the complexity of such software and of the underlying hardware, but also greatly enhance code portability. Thanks to its abstraction layers, SHAD can indeed target different systems, ranging from laptops to HPC clusters, without any need for modifying the user-level code. We have prototyped and open-sourced the implementation of (a subset of) the C++ standard library (STL) targeting multi-node HPC clusters. Our work allows plain STL-based C++ code to scale on HPC systems, with no need for rewriting the code to exploit the complex hardware. SHAD is available under Apache v2 License at https://github.com/pnnl/SHAD. In this paper we overview the design of the SHAD library, depicting its main components: runtime systems abstractions for tasking; parallel and distributed data-structures; STL-compliant interfaces and algorithms.

Castellana, Vito G.↗

Overview of the Second Workshop on Scholarly Document Processing

With the ever-increasing pace of research and high volume of scholarly communication, scholars face a daunting task. Not only must they keep up with the growing literature in their own and related fields, scholars increasingly also need to rebut pseudo-science and disinformation. These needs have motivated an increasing focus on computational methods for enhancing search, summarization, and analysis of scholarly documents. However, the various strands of research on scholarly document processing remain fragmented. To reach out to the broader NLP and AI/ML community, pool distributed efforts in this area, and enable shared access to published research, we held the 2nd Workshop on Scholarly Document Processing (SDP) at NAACL 2021 as a virtual event (https://sdproc.org/2021/). The SDP workshop consisted of a research track, three invited talks, and three Shared Tasks (LongSumm 2021, SCIVER, and 3C). The program was geared towards the application of NLP, information retrieval, and data mining for scholarly documents, with an emphasis on identifying and providing solutions to open challenges.

Beltagy, Iz↗

NRIC Asset Suite Engineering and Operations Data Integration Plan

The National Reactor Innovation Center (NRIC), established by the U.S. Department of Energy (DOE) in August 2019, accelerates the demonstration and deployment of advanced nuclear energy through its mission to inspire stakeholders and the public, empower innovators, and deliver successful outcomes through efficient coordination of partners and resources. NRIC is a national program led by Idaho National Laboratory (INL), enabling collaborators to harness the world-class capabilities of the U.S. National Laboratory System. Committed to demonstrating advanced reactors by the end of 2025, NRIC is designed to bridge the gap between research, development, and the marketplace to help convert some of the Nation’s most promising advanced nuclear reactors into commercial applications by 2030. To meet these needs, NRIC is developing two reactor demonstration test beds at Idaho National Laboratory (INL), the Laboratory for Operation and Testing in the United States (LOTUS) and the Demonstration and Operation of Microreactor Experiments (DOME) test bed. Each test bed involves the modification of existing facilities at INL’s Materials and Fuels Complex (MFC). Retrofitting these facilities to accommodate novel reactors, as well as subsequent but similar NRIC projects, is a non-trivial engineering task and is expected to generate a significant amount of new and revised documentation. Leveraging digital engineering practices, this documentation will be managed in a purpose-built data management tool to facilitate origination, review, and approval while coordinating with the design contractor. The subsequent upload and review of documentation to INL’s existing document control system comprises a long and unnecessarily manual task. An opportunity exists to automate this upload process and save job-hours while continuing to adhere to INL/MFC document management procedures.

99 GENERAL AND MISCELLANEOUS↗

The Accelerator Neutrino Neutron InteractionExperiment: Design, Construction and Preparationfor First Physics

This thesis covers work performed for the Accelerator Neutrino Neutron Interaction Experiment (ANNIE) between 2015 and 2020. ANNIE is a beamline neutrino experiment located at the Fermi National Accelerator Laboratory in Chicago. Its primary physics goals are the measurement of neutrino interaction cross-sections on oxygen, and a measurement of the multiplicity of final state neutrons from these interactions, both as functions of final state kinematics. In order to achieve these goals ANNIE will be pioneering the use of Large Area Picosecond Photodetectors and the use of gadolinium doping to enhance neutron visibility in a water Cherenkov detector. Over the time period of this thesis the ANNIE detector was constructed, an initial 'Phase I' background run was completed, the detector was decommissioned and then substantially upgraded in preparation for the main 'Phase II' physics run. At the time of writing ANNIE is being re-commissioned, with Phase II data taking anticipated to begin in 2021. During this time I spent 21/2 years on-site contributing to almost all aspects of hardware work, while performing software development for the simulation and analysis frameworks. As my first software task I developed Monte Carlo simulations of the detector response, based on the WCSim framework. While thismore » framework provided a starting point for the tank simulation significant modifications were required to implement the complete ANNIE detector system. This included a rewrite of the geometry, along with modifications to the photosensor definitions, hit collections, digitization, triggering, input and output interfaces, etc. To take advantage of improved modelling of neutrons in Geant4.10 the physics lists were also reimplemented in the new version format. As part of this work I determined performance metrics based on the output files, calculating kinematic acceptance, detector efficiency and expected event rates. My contributions on reconstruction focused primarily on the MRD, for which I implemented two track reconstruction algorithms, specialised for high and low energy muons. The high energy algorithm achieves >90% efficiency for tracks with at least 8 hits, and is robust against dead paddles and unrelated hits. The low energy algorithm performs a search in combination with tank information to provide sensitivity down to a single MRD hit. Early data handling work for the Phase I background run included writing the code for handling TDC hits and performing studies on neutron detection without the requirement of multi-hit coincidence. As the collaboration moved to a new framework for the Phase II analysis I performed a substantial amount of work to develop the codebase, implementing tools to perform tasks such as file IO, data parsing, waveform processing, event building, timestamp alignment, time clustering, hit residual calculation, event visualisation etc. I helped develop the python API for integrating multi-language tools, and ported the framework into a Singularity container to provide a self-contained environment that…« less

43 PARTICLE ACCELERATORS↗

Degradation in Photovoltaic Encapsulant Transmittance: Results of the Second PVQAT TG5 Artificial Weathering Study

The optical degradation of encapsulants from ultraviolet (UV) radiation has historically resulted in a significant loss in performance throughout the life of a photovoltaic (PV) module. IEC test methods have recently been developed to screen for PV encapsulants prone to loss in optical performance. The present study was performed to benchmark polymeric packaging materials relative to IEC 62788-1-4 (covering the measurement of optical transmittance) and IEC 62788-1-7 (on the durability of transmittance), provide feedback toward improvement of the methods, and develop insight regarding optical degradation. Contemporary materials were examined, including: poly(ethylene-co-vinyl acetate) (EVA), thermoplastic polyolefin (TPO), polyolefin elastomer (POE), and polyvinyl butyral (PVB) encapsulants; a poly(ethene-co-tetrafluoroethene)/poly(ethylene terephthalate) (ETFE/PET) transparent backsheet; and a polystyrene (PS) working reference material. The use of silica-, specialty-, and rolled-glass was also compared in laminated coupons. Specimen size was separately examined from 2.5 cm to 12.5 cm. Weathering was performed with a xenon source, using IEC TS 62788-7-2 methods A2, A3, A4, and A5 (chamber temperature of 55 Degrees C, 65 Degrees C, 75 Degrees C, or 85 Degrees C), respectively. Characterizations were made using a UV-VIS-NIR spectrophotometer (transmittance and reflectance, with and without an integrating sphere), a UV-VIS fluorescence spectrophotometer, a camera, and an optical microscope. Performance was analyzed, including solar weighted transmittance, yellowness index, UV cut-off wavelength, and haze (scattering). Separate Arrhenius analyses were performed to assess retention of transmittance and changes in yellowness index. The activation energy for both characteristics was found to range from 15 kJ?mol-1-80 kJ/mol-1, with an average of 48 kJ/mol-1, similar to the average of 45 kJ/mol-1 identified in the previous international PV Quality Assurance Task Force (PVQAT) Task Group 5 (TG5) study of more traditional encapsulants. The separate degradation modes of discoloration and scattering were distinguished in the encapsulants using a comprehensive spectral characterization. Based on these results, the IEC 62788-1-7 pass/fail criteria of 5% change in transmittance was confirmed to identify a known bad encapsulant.

durability↗

Investigation of INL Site Implementation of ARG-US

The Packaging Certification and Life Cycle Management department at Argonne National Laboratory (ANL) developed a suite of monitoring systems collectively referred to here as ARG-US. ARG-US is used to provide necessary data for nuclear facility and system operation and maintenance. ARG-US has been previously demonstrated in hot cells, radioactive material (RAM) storage areas, and RAM shipment trucks. It has also been installed directly on RAM storage and shipment containers. ARG-US offers some unique advantages over other commercially available systems by using wireless data connections, battery power supplies, and customizable monitoring methods. Idaho National Laboratory (INL) has been tasked with investigating applications for ARG-US at INL site facilities, which are operated by several different contractors. The initial investigation scope centered on CPP-603 Wet & Dry Fuel Storage Facility in relation to the upcoming DOE Spent (SNF) Packaging Demonstration. The investigation has been led by the Used Fuel Management Department in the Nuclear Science and Technology Directorate. This investigation is expected to recommend processes or facilities at the INL site at which to implement ARG-US systems. INL has engaged local site technical and oversite representatives, security, nuclear safeguards, and program management to identify good candidates for ARG-US test implementations. INL has identified high-level goals for any INL site implementation of ARG-US: provide unique testing environments, prompt development of new monitoring methods/techniques for the ARG-US suite, and acquire useful monitoring for the user facility. To these ends, INL suggests 3 program areas for further investigation: CPP-603 Fuel Handling Cave (FHC), legacy mixed waste storage systems at Idaho Nuclear Technology & Engineering Center (INTEC) known as the “tank farm”, and periodic and emergency environmental monitoring. This progress report relates activities undertaken in this investigation, describes the preliminary areas of interest for limited scope ARG-US testing or implementation, and relays expected actions needed to complete the task scope. This report offers an opportunity to the program sponsor, technical leads at ANL, and INL site representatives to give feedback on the initial assessment and make recommendations on the forthcoming activities.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sensitivity/Uncertainty Comparison Study Involving IRSN, LANL, and ORNL Tools to Support Validation [Abstract]

Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Unified Testing Platform to Mature Blockchain Applications for Grid Emulation Environments: Preprint

Blockchain technology is a relatively novel technology that can be used to develop more decentralized, autonomous and tamper-evident solutions. A feature that can aid Transactive Energy Systems to reach their goals by enabling individual actors to communicate and reach consensus with other participants in a more decentralized fashion. However, technical barriers to evaluate and adopt this type of technology within the electrical domain still exist. To facilitate this task, BLOSEM Unified Testing Platform (UTP), a DOE-sponsored, multi-lab effort intends to accelerate the development of solutions by offering a common set of reusable services that can be used to interconnect existent grid tools with blockchain services. UTP is intended to serve as development platform that can provide application engineers with the technical means to evaluate potential blockchain solutions, by enabling them to concentrate on the actual application functionalities while at the same time abstracting the connectivity and performance measurement tasks. The use of BLOSEM UTP is further demonstrated by implementing two potential use cases that are intended to validate both the feasibility of implementing these applications as blockchain-based solutions while also demonstrating the features provided by UTP.

blockchain↗

Sensitivity/Uncertainty Comparison Study Involving IRSN, LANL, and ORNL Tools to Support Validation

Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation. This study examines five cases from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) selected as application models: IEU-MET- FAST-002-001, LEU-COMP-THERM-001-001, LEU-SOL-THERM-004-001, MIX-COMP- THERM-001-001, and U233-SOL-THERM-001-001. This is a continuation of a previous study to examine Pu and HEU cases: HEU-MET-FAST-013-001, HEU-SOL-THERM-001-008, PU-MET- FAST-022-001, and PU-SOL-THERM-001-001. Ultimately, comparison is made between Upper Subcritical Limits (USLs) obtained using each code package for each application case. Since differences exist in whether packages take into account margin of subcriticality (MOS), the USL is computed using only bias and bias uncertainty, also known as the calculational margin (CM) in ANSI/ANS-8.24. Results comparison appears to show that benchmark selection has a greater influence on the USL than the method used for calculation of bias and bias uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Contextual Active Online Model Selection with Expert Advice

How can we collect the most useful labels to learn a model selection policy, when presented with arbitrary heterogeneous data streams? In this paper, we formulate this task as a contextual active model selection problem, where at each round the learner receives an unlabeled data point along with a context. The goal is to output the best model for any given context without obtaining an excessive amount of labels. In particular, we focus on the task of selecting pre-trained classifiers, and propose a contextual active model selection algorithm (CAMS), which relies on a novel uncertainty sampling query criterion defined on a given policy class for adaptive model selection. In comparison to prior art, our algorithm does not assume a globally optimal model. We provide rigorous theoretical analysis for the regret and query complexity under both adversarial and stochastic settings. Our experiments on several benchmark classification datasets demonstrate the algorithm’s effectiveness in terms of both regret and query complexity. Notably, to achieve the same accuracy, CAMS incurs less than 10% of the label cost when compared to the best online model selection baselines on CIFAR10.

Liu, Xuefeng↗

Integration of the Kromek D3S Detector and Spot Robot For Secondary Inspections

Inspecting vehicles and containers for the presence of nuclear material is a challenging task for border control and security. When performed manually by inspectors, this task also has an associated risk of exposing the inspectors to unknown radiation. With the advent of agile, easy-to-program, quadruped robots like the Boston Dynamics Spot, automation of secondary inspection can improve the efficiency of the inspection process and alleviates the radiation risks to inspectors. In this project, Brookhaven National Laboratory and the University of Massachussetts at Lowell explored how to automate a simple secondary inspection mission. The Spot robot comes with its own software development kit (SDK) that allows clients/users to write custom code in the Python programming language to control the robot. Spot also has a payload computer called Spot-CORE, which runs the Ubuntu Linux operating system and allows users to integrate external sensors, such as a radiation detector, with Spot. In this study, the Kromek D3S detector has been integrated with Spot via the Spot-CORE, allowing Spot to capture gamma spectra and neutron counts for a specified acquisition period. Two custom routines, search and confirmation, have been developed and executed in this specified order. The search routine directs Spot to go around the nearest obstacle, e.g., vehicle and container, in a preset distance and step to collect gamma and neutron gross counts with the D3S detector. The radiation data and the robot location corresponding to each step are stored and fed to the confirmation routine at the end of the search. The confirmation routine then navigates Spot to the locations of the highest gamma or neutron counts to perform a long, e.g., one minute, measurement, and gives the operators the signature gamma spectra and neutron counts at the hotspots. This paper presents a detailed description of this automated system along with results of the preliminary tests in identifying the location and signature of a 137Cs radiation source in a vehicle.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Do graph neural networks learn traditional jet substructure?

At the CERN LHC, the task of jet tagging, whose goal is to infer the origin of a jet given a set of final-state particles, is dominated by machine learning methods. Graph neural networks have been used to address this task by treating jets as point clouds with underlying, learnable, edge connections between the particles inside. We explore the decision-making process for one such state-of-the-art network, ParticleNet, by looking for relevant edge connections identified using the layerwise-relevance propagation technique. As the model is trained, we observe changes in the distribution of relevant edges connecting different intermediate clusters of particles, known as subjets. The resulting distribution of subjet connections is different for signal jets originating from top quarks, whose subjets typically correspond to its three decay products, and background jets originating from lighter quarks and gluons. This behavior indicates that the model is using traditional jet substructure observables, such as the number of prongs -- energetic particle clusters -- within a jet, when identifying jets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗