Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Analysis of the performance of different culvert boundary conditions in 2D shallow flow models

Culverts allow roads to safely traverse small streams or drainage ditches, and their proper design is critical to ensure a safe and reliable transportation network. A correct modelization of these hydraulic structures becomes crucial in the assessment of flood footprints or discharge peak estimation in a risk evaluation plan. The question of how to include culverts comes up frequently when assembling a hydraulic model that requires the presence of as many singular elements as possible. In this work, three different culvert integrations with the surface domain are studied and compared in the context of a 2D shallow water (SW) model. All of them are based on the Federal Highway Administration (FHWA) formulation for the culvert discharge estimation but differ in complexity and in the interaction with the numerical model for surface flow, some of them as internal boundary conditions. Several steady and unsteady validation test cases are presented and the numerical results are compared with the predictions from HEC-RAS 1D and HY-8 software. Furthermore, the culvert area, shape and their sensitivity to the 2D computational mesh is also analyzed.

54 ENVIRONMENTAL SCIENCES↗

BISON TRISO Modeling Advancements and Validation to AGR-1 Data

BISON is a finite element-based nuclear fuel performance code. Among its unique characteristics are its ability to model 1D, 2D, and 3D geometries and its applicability to a wide variety of nuclear fuels. For the last eight years, BISON has included a beginning capability to model tri-structural isotropic (TRISO) fuel. Recently, interest in TRISO fuel has grown, and a significant effort has been made to improve BISON’s capabilities in this area. Capability development has occurred for each material present in TRISO fuel particles: the buffer, inner pyrolytic carbon, silicon carbide, and outer pyrolytic carbon layers, as well as the fuel kernel. New elastic, creep, swelling, thermal expansion, thermal conductivity, and fission gas release (FGR) models are available. New models for the graphite matrix are also now available. Another important addition is the ability to perform statistical failure analysis of large samples of fuel particles. This new capability, which continues to grow, enables evaluation of failure due to pressure or crack formation by analyzing many thousands of particles. This enables realistic calculations of fission product release from the many particles in a TRISO-fueled reactor. These capabilities were checked via regression and verification tests. A large number of code benchmarking problems were also run, showing that BISON’s results closely match those of other software tools. Finally, a significant validation effort was completed in which fission product release, measured as part of the AGR-1 capsule experiments, was compared to BISON outputs. BISON outputs compared very well to the experimental data and to PARFUME results. Interest in BISON’s TRISO capabilities is growing, with the U.S. Nuclear Regulatory Commission (NRC) and Westinghouse Electric Company receiving training during the past year. Multiple other entities have expressed interest in or are actively using BISON. Kairos Power, LLC, has a strong partnership with Idaho National Laboratory (INL) regarding the use of BISON for TRISO analysis. While its capabilities still continue to grow, BISON has already become a powerful tool for TRISO analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A VXS [VITA41] Trigger Processor for the 12GEV Experimental Programs at Jefferson Lab

The VXS_Trigger_Processor [VTP] was developed and commissioned for CLAS12 in the fall of 2016. This board is a VITA41 switch card and it collects data from a variety of front-end TDC and Flash ADC modules. The VTP has since been used in several experiments at Jefferson Lab serving as the L1 trigger module for a variety of detector types, such as stacked calorimeters, strip calorimeters, time-of-flight, Cerenkov, hodoscopes, drift chambers, and silicon strips. Trigger algorithms implemented include cluster finding (1D, 2D), drift chamber segment and road finding, geometry matching between various detectors, particle counting, and general global trigger bit processing. The VTP is also capable of reading out each front-end crate with up to 40Gbps Ethernet which is an enormous increase compared to the currently used 200MB/s VME bus. Recent progress has been made to show that a firmware and software upgrade can enable existing Jefferson Lab front-end crates to operate in a streaming DAQ mode. In February 2020, tests will be performed on a full calorimeter and matched hodoscope which are components of the CLAS12 Forward Tagger detector system with beam in Hall B. This paper details the hardware performance, triggered, and streaming applications that have been implemented using the VTP for several experiments at Jefferson Lab.

ABBOTT, David↗

Integrate Latimer Controls' Solution into RTAC (CRADA Final Report, CRD-23-24672)

Latimer Controls, Inc. was awarded two vouchers under the Department of Energy's American-Made Solar Prize Round 6 to conduct collaborative research at a national laboratory. The National Renewable Energy Laboratory (NREL) was selected as a partner to assist Latimer Controls in the performance evaluation of its photovoltaic (PV) control software. This collaboration focuses on developing a hardware-in-the-loop (HIL) testbed at NREL, which will be used to test and validate the Latimer PV control technology in a realistic yet de-risked environment. Both Latimer and NREL teams will work together to analyze the collected test data, derive insights, and disseminate the scientific findings. Recent studies underscore the potential of solar energy as a zero-marginal-cost and zero-emission flexibility resource within the bulk power system, particularly when integrated with advanced control systems. To enhance the performance of such systems, Latimer Controls has developed leading-edge technologies, including machine learning (ML) algorithms and hierarchical inverter set-point allocation methods. These innovations are designed to estimate the operational headroom of large PV plants for grid integration and control. However, comprehensive validation under real-world conditions remains necessary. To address this gap, the concurrent CRADA project proposes the real-world application and validation of the Latimer Control solution within a HIL environment. Initially, the Latimer algorithm was developed and tested within MATLAB Simulink, a platform suitable for research-level simulations and iterative development. However, transitioning this technology to a real solar site as an industry-ready solution necessitates implementation in a format compatible with widely used solar power plant controllers. In this additional CRADA work, the MATLAB Simulink-based logic will be translated into Structured Text, a programming language compliant with IEC 61131 standards, which is commonly used for custom logic implementations in industry-leading programmable logic controllers (PLCs), such as the Schweitzer SEL real-time automation controller (RTAC). This transition will facilitate the deployment of the Latimer Control solution in real-world solar power plants, thereby advancing the technology towards commercialization.

14 SOLAR ENERGY↗

Intelligent Experiments Through Real-time AI: Fast Data Processing and Autonomous Detector Control for sPHENIX and Future EIC Detectors (Final Report)

The overall vision of this project was to integrate real-time artificial intelligence (AI) directly into the data acquisition and detector-control systems of nuclear physics experiments, including both fast online event selection and an autonomous detector-control feedback loop. The work carried out under the award focused on the fast online event-selection half of that vision: the efficient recording of low-momentum heavy-flavor (HF) hadron decays in proton-proton collisions at the sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC)—an observable that requires fast tracking and topological trigger selection not previously demonstrated at RHIC, and that is essential for QCD studies at future facilities such as the Electron-Ion Collider (EIC). The autonomous detector-control (GPU-based feedback) component named in the project title remained a design concept and was not implemented under this award. The Massachusetts Institute of Technology (MIT) group led the offline simulation and data processing needed to train the machine-learning (ML) models, the translation of trained models to Field-Programmable Gate Array (FPGA) firmware using the hls4ml framework, and the physics validation of heavy-flavor reconstruction. Over the award period, the team developed and hardware-tested the principal components of an AI-based heavy-flavor trigger on simulated and recorded sPHENIX tracker data: a software Bipartite Graph Attention Network (BiGAT) trigger model reaching > 95% signal efficiency at 99% background rejection; an FPGA-native hit clusterizer matching the offline clustering; smaller networks synthesized to FPGA within the required sub-10 µs latency; and an assembled decoder–clusterizer–inference firmware chain exercised on the FELIX readout board. A complete, fully integrated hardware demonstrator was not finished within the award period. This report documents the project goals, the MIT group’s contributions, the technical accomplishments, and the outlook toward applications at the future EIC ePIC detector.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗

SMART-COM – Scalable Multi-Agent Adaptive Resolution Tools for Collaborative Outage Management

The purpose of this grant was to conduct scientific research and prototype applications to support NPP outage staff in their adaptive decision-making in efficient scheduling and resource allocation while preventing violation of safety technical specifications. The project contributed to scientific knowledge and engineering methods in (1) user interface design, (2) scheduling optimization and risk estimation, and (2) natural language processing that would benefit the nuclear power plants in minimizing schedule overruns and even unexpected shutdowns. The research team conducted site visits at a test reactor facility and an operating nuclear power plant to gather necessary information and inputs for research and development of a software application to support NPP staff in executing their outages. The final software application consisted of three modules. First, the natural language processing module supports interactive processing of technical documentation to build a database for outage staff to query non-permissible actions on system components. This module can alleviate outage staff from reviewing extensive documentation and minimize violation of technical specifications, especially in time-sensitive situations. Second, the schedule optimization module schedules outage activities and compute risk indices that outperform existing software and current practice. This module can reduce completion time of an outage that typically have too many activities for human to optimize based on current practice that does not apply the latest operations research. Finally, the visualization module presents progress and risk information of the overall outage and individual activities, as well as enabling access to the natural language processing and schedule optimization modules. This module can provide outage staff with situation awareness that are necessary to make risk-informed decisions in response to unexpected events during the execution of an outage.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

[Presentation Slides] Code-to-Code Benchmark Study for Thermal Stress Modeling and Preliminary Analysis of the High-temperature Single Heat-Pipe Experiment

In the heat-pipe-cooled microreactor, heat pipes remove heat from the reactor core as a passive heat-transfer device, so the fluid circulation is not required for cooling, which can substantially simplify the overall reactor design. However, given the extremely high temperatures in the core region and potentially large temperature gradients across the structure materials, thermal stresses need to be well-analyzed to ensure structural integrity during normal operations and accident scenarios. This presentation slides discuss finite element method-based thermal-stress analysis for the high-temperature single heat-pipe test article in the Single Primary Heat Extraction and Removal Emulator (SPHERE) facility at Idaho National Laboratory (INL), using two commercial software packages, Abaqus and Star-CCM+. A code-to-code benchmark study was performed to crosscheck the model setup and capability of each code and to gain preliminary insights into the potential thermal stress concerns from the current experimental setup. It is observed the significant thermal stresses happen at the inner surface of the heat pipe hole surrounded by electric heaters where the largest temperature gradients appear. The temperature fields have good agreements between Abaqus and Star-CCM+, while the induced thermal stresses show modest deviations probably due to differences of meshing engines used in these two codes. It is found that the local maximum thermal stresses may reach close to the ultimate tensile strength and yield strength of structural material depending on the heater power. Ultimately, the coupled thermal-structural analysis will help guide the current experimental plan and ensure the facility safety for future experimental study.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

2.2.2.405 - Verdant/NREL Research Measurement Campaign

The marine renewable energy industry primarily uses thermoset composite materials for blades and other hydrodynamic components, which can have up to 50% reduction in strength when exposed to seawater and are not recyclable. Thermoplastic composite materials have been shown at a coupon-scale to have improved seawater saturated properties but have not been validated at full scale. The primary goal of the project is to demonstrate the structural properties of thermoplastic-fiberglass composite blades compared to epoxy-fiberglass composite blades in seawater at a tidal energy site on an operational turbine. Through this work, NREL manufactured, tested and deployed thermoplastic blades and a data acquisition system on Verdant Power's turbine TriFrame in the East River, NYC. The thermoplastic blades and DAQ were retrieved after a 6-month deployment with no signs of degradation and all cable connections, structural supports and strain gages had a 100% survival rate. The blades are currently undergoing post-deployment structural validation to compare their performance to traditional epoxy blades that were deployed for the same amount of time. This will increase confidence in thermoplastic materials and move it closer to commercial adoption, as well as increase confidence in the design of a DAQ and instrumentation method for a tidal turbine. However, due to an error in the DAQ software that was introduced after the DAQ and software were validated, there was no loads data collected during the deployment.

blade testing↗

Results of FY 2023 Alloy 617 and Alloy 709 High-Temperature Crack-Growth Testing

This report summarizes the work performed at Idaho National Laboratory under the “Creep, fatigue and creep-fatigue crack growth tests” task of the “Long-Term VHTR Material Qualification – INL” work package. Work was performed this year to validate the crack growth monitoring setup used with the test frames against both continuous crack length monitoring using an optical camera, as well as post-mortem analysis of marker bands on the fracture surface. Delays prevented the use of a gauge to measure load-line displacement for early tests, and so the creep-fatigue crack growth setup was evaluated using the actuator displacement for a load-line displacement setup. While not ideal, this allowed examination of the shortcomings with the current software setup that was originally designed for performing stress corrosion crack growth rate studies. The method for data collection was modified to link the crack growth monitoring software with Instron’s Wave Matrix software. Once the load-line displacement gauge arrived, the crack growth equipment was successfully modified to permit continuous monitoring of both load-line displacement and crack length. This is critical for creep-fatigue and creep crack growth rate studies for ductile material, as it permits the C* and Ct analyses. Test results are shown for Alloy 617 fatigue and creep-fatigue (without the gauge for load-line displacement measurements), as well as creep-fatigue of Alloy 709, which was performed with the completed test setup, allowing for crack length and load-line displacement monitoring.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Open-source electrochemical cell for in situ X-ray absorption spectroscopy in transmission and fluorescence modes

X-ray spectroscopy is a valuable technique for the study of many materials systems. Characterizing reactions in situ and operando can reveal complex reaction kinetics, which is crucial to understanding active site composition and reaction mechanisms. In this project, the design, fabrication and testing of an open-source and easy-to-fabricate electrochemical cell for in situ electrochemistry compatible with X-ray absorption spectroscopy in both transmission and fluorescence modes are accomplished via windows with large opening angles on both the upstream and downstream sides of the cell. Using a hobbyist computer numerical control machine and free 3D CAD software, anyone can make a reliable electrochemical cell using this design. Onion-like carbon nanoparticles, with a 1:3 iron-to-cobalt ratio, were drop-coated onto carbon paper for testing in situ X-ray absorption spectroscopy. Cyclic voltammetry of the carbon paper showed the expected behavior, with no increased ohmic drop, even in sandwiched cells. Chronoamperometry was used to apply 0.4 V versus reversible hydrogen electrode, with and without 15 min of oxygen purging to ensure that the electrochemical cell does not provide any artefacts due to gas purging. The XANES and EXAFS spectra showed no differences with and without oxygen, as expected at 0.4 V, without any artefacts due to gas purging. The development of this open-source electrochemical cell design allows for improved collection of in situ X-ray absorption spectroscopy data and enables researchers to perform both transmission and fluorescence simultaneously. It additionally addresses key practical considerations including gas purging, reduced ionic resistance and leak prevention.

08 HYDROGEN↗

Development of NDE/NDT Tools for High-Volume & High-Speed Inspection of CFRP Structures in Automotive Manufacturing

Main advantages of the air-coupled ultrasound testing (ACUT) and electromagnetic testing (EMT) techniques for NDE of CFRP composites were non-contact sensing, scalability for high-speed inspection, cost-effectiveness, and non-hazardous operation. Despite these advantages, no systems that would satisfy the project requirements were commercially available. Hence, one of the major efforts of the Michigan State University (MSU) team at the initial stage of the project was to close this technological gap by developing, optimizing, and validating array sensors that would provide sufficient sensitivity, spatial coverage, and resolution for robust defect detection. Optimization of the ACUT and EMT sensor designs was performed using experimentally validated finite element models. Initial experiments using array probes were conducted on relatively flat CFRP samples. In parallel, the MSU team designed and assembled a portable platform with two robotic arms. The robots were equipped with newly designed sensors that enabled high-speed NDE of curved CFRP parts. Presently, the developed robotic platform can be used as a demo/template NDE system, which is easily adaptable to manufacturing environments and in-line NDE. The ACUT NDE system developed by the MSU team used a high-power 4-channel pulser receiver for parallel data acquisition. The array probes were designed by stacking commercially available ACUT transducers, which operated in the frequency range between 100 kHz and 500 kHz. MSU optimized the excitation procedure and developed wave focusing cones so as to reduce the crosstalk between the transducers and to provide higher pulse repletion frequency (PRF). The through-transmission (TT) and single-side access (SSA) inspection modes were successfully implemented. In the TT-ACUT, structural defects in CFRP were detected by passing ultrasonic waves through the test part. Hence, the ACUT transmitters and receivers needed to be placed on the opposite sides of the test part. In the SSA-ACUT, guided waves (GW) were excited in the test part using the transmitters and were sensed by the receivers from the same side. Multi-channel TT-ACUT and SSA-ACUT provided high-speed NDE, and were successfully validated on CFRP test samples with interlaminar delaminations and other embedded defects The EM techniques developed by the MSU team included: 1) eddy current testing (ECT), 2) capacitive imaging (CI) and hybrid dual-mode imaging. In ECT, structural damage was detected in CFRP using coils sensor arrays. In ECT, the excitation magnetic field is generated by passing an alternating current through a coil, which is placed above the test sample. The excitation field penetrates the conductive sample and induces the eddy currents in its transect. In turn, the eddy currents generate the reaction field, which affects the total field sensed by a coil. Hence, the presence of structural flaws will alter the eddy current flow and the picked-up signal. ECT is mostly sensitive to local changes of the electric conductivity of the test sample, and CFRPs are mostly conductive in the direction of carbon fibers. Hence, ECT was well suited for the detection of fiber damage/fiber irregularities. The MSU team developed printed circuit boards (PCB) with coil sensor arrays optimized for NDE of CFRP. Unlike most commercial probes designed for ECT of metallic structures, the MSU array probes were designed for operation in [1-10] MHz frequency range, which was optimal for low-conductive CFRP. Multiple sensing topologies (coil groups excitation/sensing arrangements) were implemented and successfully validated. Capacitive Imaging (CI) technique developed by MSU was complementary to ECT. In contrast to ECT, which was sensitive to local changes of the electrical conductivity, the CI was sensitive to local changes of the dielectric constant. Therefore, CI could provide information about matrix damage/matrix irregularities in CFRP. The MSU CI sensor arrays were made of multiple circular or rectangular open-plate capacitors printed on PCB. Sensors of this type are not commercially available. In addition to ECT and CI, the MSU team developed a hybrid (dual-mode) inductive/capacitive measurement technique that synergistically combined the benefits of inductive and capacitive sensing for rapid NDE of fiber reinforced polymer (FRP) composite structures. Fiber damage and fiber irregularities in FRPs were detected by configuring hybrid sensors as coil sensors. Similarly, matrix damage, matrix irregularities and interlaminar delaminations were detected by configuring hybrid sensors as capacitive sensors. ECT and CI were performed sequentially by means of electronic switching. Hence, eliminating the need for mounting two separate sensor arrays on the probe. Portable robotic platform was developed by MSU for multi-technique high-speed NDE of CFRP test parts. The platform had two 6-axis robots, which enabled inspection of curved parts in approximately a 6×6×6 ft 3 active scan area. On the software side, the MSU team integrated scripts for NDE hardware control with scripts for robot motion control. MSU also implemented automated path planning for the robots, reconstruction of part’s surfaces via stereovision, 3D rendering of inspection data, and image processing algorithms for enhanced defect detection. Automotive composite parts manufactured by Plasan Composites from Phase I were used to validate the ACUT and EMT techniques on representative testbeds. Among those parts were three X-braces for a Dodge Viper, one composite calibration plaque with known defects at known locations, and four other test sections, including sections from a front splitter, a corner section from a composite hood, and a high-pressure RTM panel made using non crimp fabric. Other test samples included CFRP and GFRP calibration plates with fiber/matrix defects fabricated at MSU/CVRC.

36 MATERIALS SCIENCE↗

Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators

Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.

47 OTHER INSTRUMENTATION↗

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗

Machine Learning Based Resilience Testing of an Address Randomization Cyber Defense

Moving target defenses (MTDs) are widely used as an active defense strategy for thwarting cyberattacks on cyber-physical systems by increasing diversity of software and network paths. Recently, machine Learning (ML) and deep Learning (DL) models have been demonstrated to defeat some of the cyber defenses by learning attack detection patterns and defense strategies. It raises concerns about the susceptibility of MTD to ML and DL methods. Here, in this article, we analyze the effectiveness of ML and DL models when it comes to deciphering MTD methods and ultimately evade MTD-based protections in real-time systems. Specifically, we consider a MTD algorithm that periodically randomizes address assignments within the MIL-STD-1553 protocol—a military standard serial data bus. Two ML and DL-based tasks are performed on MIL-STD-1553 protocol to measure the effectiveness of the learning models in deciphering the MTD algorithm: 1) determining whether there is an address assignments change i.e., whether the given system employs a MTD protocol and if it does 2) predicting the future address assignments. The supervised learning models (random forest and k-nearest neighbors) effectively detected the address assignment changes and classified whether the given system is equipped with a specified MTD protocol. On the other hand, the unsupervised learning model (K-means) was significantly less effective. The DL model (long short-term memory) was able to predict the future addresses with varied effectiveness based on MTD algorithm's settings.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

AENET–LAMMPS and AENET–TINKER : Interfaces for accurate and efficient molecular dynamics simulations with machine learning potentials

Machine-learning potentials (MLPs) trained on data from quantum-mechanics based first-principles methods can approach the accuracy of the reference method at a fraction of the computational cost. To facilitate efficient MLP-based molecular dynamics and Monte Carlo simulations, an integration of the MLPs with sampling software is needed. Here, we develop two interfaces that link the atomic energy network (ænet) MLP package with the popular sampling packages TINKER and LAMMPS. The three packages, ænet, TINKER, and LAMMPS, are free and open-source software that enable, in combination, accurate simulations of large and complex systems with low computational cost that scales linearly with the number of atoms. Scaling tests show that the parallel efficiency of the ænet–TINKER interface is nearly optimal but is limited to shared-memory systems. The ænet–LAMMPS interface achieves excellent parallel efficiency on highly parallel distributed memory systems and benefits from the highly optimized neighbor list implemented in LAMMPS. We demonstrate the utility of the two MLP interfaces for two relevant example applications: the investigation of diffusion phenomena in liquid water and the equilibration of nanostructured amorphous battery materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Population balance modeling of polyurethane foam formation with pressure‐dependent growth kernel

Abstract Polyurethane foams are widely used materials often chosen for their useful characteristics such as low thermal conductivity, ease of application, and high strength‐to‐weight ratios. Computational models are needed to predict the dynamics of the flow and expansion, and the resulting material properties, to improve manufacturing processes. In this paper, a model for PMDI, a water‐blown polyurethane foam, is presented. By extending a kinetics‐based approach by adding bubble‐scale information via a population balance equation (PBE) using the quadrature method of moments, we can track bubble size distributions during foaming. We present results from a three‐dimensional computational fluid dynamics model using arbitrary Lagrangian–Eulerian interface tracking implemented in finite element software. The model compares favorably with experimental data, including dynamics, bubble distributions measured by both camera and diffusion wave spectroscopy, and post‐test bubble size from scanning electron microscopy and density measurements from x‐ray computed tomography.

Ortiz, Weston↗

Intrinsic quality factor extraction of multi-port cavity with arbitrary coupling

In this work, we derived S-parameter based expressions for the intrinsic quality factor of an arbitrary coupled multiport microwave cavity and a non-ideal test fixture. Practical accuracy limitations of the obtained expressions specifically for superconducting accelerator cavities were evaluated both analytically and with the simulation software. The resulting formulas can be used to extract the intrinsic quality factor of normal-conducting and superconducting cavities directly from the calibrated S-parameter measurements.

43 PARTICLE ACCELERATORS↗