Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Extending the Nuclide Inventory Validation Basis for High-Burnup Fuel with New Radiochemical Assay Data

Efforts are underway at Oak Ridge National Laboratory to improve the nuclide inventory validation basis for spent nuclear fuel at high burnups. Recently conducted radiochemical assay experiments provided new measurement data for nine samples of fuel irradiated in a pressurized water reactor, with estimated sample burnups in the 30 to 70 GWd/t range. This type of destructive assay data is essential for validating computational methods, tools, and nuclear data applied in nuclear safety analyses and for improving our understanding of the bias and uncertainty in code predictions. The measurement data include key actinides and fission products that span a gamut of needs and interests for nuclear science and engineering applications in criticality safety, reactor physics, nuclide inventory, decay heat, and radiation shielding. The SCALE 6.3 code system with ENDF/B-VII.1 cross-section libraries was used to simulate the irradiation histories of the measured fuel samples. The calculated nuclide concentrations are compared to corresponding measurement data. The significance of the comparisons is discussed, emphasizing how the addition of the new measurement data fills gaps in the validation basis at high burnups and contributes to the decrease in bias and uncertainty for predicted nuclide concentrations. The discussion addresses the effect of the sample burnup used in the simulation—which is based on reactor operator records or on calibration to measured data for burnup indicator fission products—on the validation results.

Nuclide inventory↗

Validation of theory-based models for the control of plasma currents in W7-X divertor plasmas

A theory-based model for the control of plasma currents for steady-state operation in W7-X is proposed and intended for model-based plasma control. The conceptual outline implies the strength of physics-based models: it offer approaches applicable to future conditions of fusion devices or next-step machines. The application at extrapolated settings is related to the validity range of the theory model. Therefore, the predictive power of theory-based control models could be larger than for data-driven approaches and limitations can be predicted from the validity range for the prediction of bootstrap currents in W7-X. The model predicts the L/R response when density or heating power is changed. The model is based on neoclassical bootstrap current calculations and validated for different discharge conditions. While the model was found to be broadly applicable for conducted electron-cyclotron-heated discharges in W7-X, limits were found for cases when the polarization of the electron cyclotron heating was changed from X2 to O2-heating. The validity assessment attempts to quantify the potential of the derived model for model-based control in the operational space (density, heating power) of W7-X.

neoclassical modelling↗

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Validation and Verification for INL Modelica-based TEDS models Via Experimental Results

This report provides an overview on the verification and validation (V&V) of the Thermal Energy Distribution System (TEDS) model developed in the Modelica process modeling ecosystem using experimental data. Model development has led to the creation of a dynamic process model of the experimental TEDS facility housed within the Energy Systems Laboratory (ESL) at Idaho National Laboratory (INL). The model was then used during the preconstruction phase of the experimental effort to inform experimental design (e.g., insulation requirements, bypass line placement, expected performance of components) and to test innovative control schemes prior to the initial operation. The TEDS model developed in Modelica includes the primary components of the TEDS experimental unit: a 200kW Chromalox heater; a single-tank packed-bed thermal energy storage system filled with 0.125-inch alumina (Al2O3) beads; an ethylene-glycol-to-Therminol-66 heat exchanger; system piping; five control valves; and all associated temperature, pressure, and volumetric flow sensors. Using the Institute of Electrical and Electronics Engineers (IEEE) V&V methodologies, considered the gold standard in the engineering field, the model was verified using a combination of static analysis, spatial convergence, and regression tests. Then using dynamic time warping (DTW) initial runs to validate and tune the TEDS model versus the experiment were conducted. This tuning method was accomplished using the INL Risk Analysis Virtual ENvironment (RAVEN) software package. Tuning is required to account for physical phenomena that are less understood within the empirical heat transfer correlations. Through the commencement of this work, a systems-level model of TEDS with associated control systems, sensors, piping diameters, and component capabilities has been created. This model was utilized in the pre-experimental phase to inform system design, insulation thicknesses, and potential control schemes to operate the system effectively and safely. Then, initial experimental startup and operational data were used to demonstrate the validation and tuning methodology. This process demonstrates the classical two-step approach of a model informing experimental design followed by the experiment validation and tuning the model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

VALID Past, Present, and Future [Slides]

This presentation discusses the Verified, Archived Library of Inputs and Data (VALID) procedure which is managed per computational procedure under the overall SCALE quality assurance plan. The principle behind VALID is that two independent, qualified people prepare and review the model, while a dual, independent check acts as a primary barrier to prevent errors in the library. A final check by VALID QAC of procedural compliance is then performed. The future for VALID includes plans to add more experiments, a review for all ICSBEP cases containing Deuterium, ZEUS intermediate and fast spectrum evaluations, intermediate enrichment experiments, other cases of interest to sponsors, and mixed/intermediate spectrum experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Subcomponent Validation of Composite Joints for the Marine Energy Advanced Materials Project

The Marine Energy Advanced Materials project is an ongoing multi-year, multi-lab project with the main goals of addressing barriers and uncertainties facing marine energy developers in adopting advanced materials for structural applications. NREL's goals of the project were to address subcomponents testing needs for marine energy materials, to improve understanding of design allowables at the full-scale and provide near net-scale static and fatigue data of composite subcomponents using materials applicable to the marine energy industry. In the long term, the test method development and data generated would be used to inform standards development. This report outlines perhaps one of the largest-scale studies conducted with regards to saltwater conditioning of various composite material subcomponents and their subsequent structural validation, specifically directed at the marine renewable energy industry. A variety of fiberglass composite panels with epoxy and vinyl ester epoxy resin systems were manufactured at Montana State University, which were then used to manufacture an array of different types of subcomponent test specimens at the National Renewable Energy Laboratory's Flatirons Campus. These subcomponents were in the form of T-bolt and double-ended-insert specimens, which were intended to represent bonded and mechanical bolted connections for thick composite laminates, metal-metal and composite lap shear specimens to evaluate adhesion of constituent materials, and adhesive beam-shear specimens as part of an effort to better evaluate the characteristics of thick adhesive bondlines. Overall, the materials used were fiberglass reinforced epoxy and vinyl ester matrix composites, epoxy and methacrylate adhesives, and 316 and 2507 stainless steels. Specimens were then conditioned in salt water at various temperatures and for various periods of time at Florida Atlantic University and Pacific Northwest National Laboratory. All specimens were then mechanically characterized and validated using various test methods under static and fatigue loading conditions at NREL's Structural Technology Laboratory. Throughout the conditioning and mechanical validation process, valuable experience was gained, which will help guide future test method development for marine energy materials. In many instances, the results indicated similar observations as to what had been observed during previous coupon scale characterization efforts that provided a vital understanding of the scale up process. However in some instances, unexpected phenomena were observed, such as interactions between the adhesives and 316 steel. Furthermore, some materials exhibited significant degradation due to the saltwater conditioning. Ultimately, this report provides a detailed summary of the specimens that were designed, the subcomponent test methods that were developed, and the results that were generated, which will serve as important guidance for marine renewable energy developers and researchers for future structural designs and validation.

16 TIDAL AND WAVE POWER↗

A Guide to Engaging Underserved Communities in Commercial Energy Efficiency Field Validations

Underserved communities in the United States often experience the negative impacts of climate change and environmental degradation but enjoy few of the benefits of technological and environmental advances. The White House has addressed this inequity through the Justice40 initiative, which requires 40% of the benefits of select federal investments to be directed to underserved communities (The White House, 2022). Clean energy and energy efficiency are two highlighted investment categories, so the U.S. Department of Energy will guide implementation of the Justice40 initiative by, among other things, decreasing energy burdens, increasing parity in clean energy technology access and adoption, and increasing energy resiliency. A strategy for reaching these goals is to evaluate and validate new energy efficiency technologies in commercial buildings in underserved communities, where buildings may be older, smaller, and have deferred maintenance due to historical underinvestment. This paper develops guidance for researchers pursuing field validations with underserved communities. Historical redlining and past negative experiences with government and large institutions may make residents wary of participating in these field validations. Researchers, therefore, may need to spend more time building relationships and matching technologies to buildings. In this paper, we analyzed technical reports to identify common field validation building characteristics and conducted semi-structured expert conversations to identify key stages and major themes of engaging underserved communities. Results indicate there may be flexibility in site selection and there are steps researchers can take to support collaboration with communities. Results also suggest benefits to both the community and energy efficiency research.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Validation of the NLR Pumped Storage Hydropower Cost Model

The National Laboratory of the Rockies (NLR) first released its pumped storage hydropower (PSH) cost model in 2023 as the most detailed bottom-up PSH cost model available to the public. It is available both as a spreadsheet and an interactive web tool, enabling users with a variety of PSH interests to transparently characterize costs of alternative PSH sites and designs. The PSH cost model cannot replace detailed site-level studies and design, but it is important to validate it against other industry PSH cost estimates. The initial model methodology report validated the cost model for a single proposed site, the Eagle Mountain Project in California. This slide deck documents an expanded validation exercise using cost data from six other sites: Goldendale (Washington), Seminoe (Wyoming), Gordon Butte (Montana), Swan Lake (Oregon), White Pine (Oregon), and Lewis Ridge (Kentucky). It compares itemized costs from Federal Energy Regulatory Commission (FERC) applications and other reported costs with NLR PSH cost model outputs after customizing inputs for each site. The validation exercise finds that the NLR model's conservative indirect cost assumptions often drive overall cost overestimation, with direct cost comparisons typically agreeing more closely. All cost model estimates are well within an Association for the Advancement of Cost Engineering (AACE) Class 5 estimation range (-50% to +100%), with five within the AACE Class 4 range (-30% to +50%) and four being within 15%. This result is considered reasonable performance for a parametric model applied at a preliminary design stage.

13 HYDRO ENERGY↗

H2@Scale - Validating an Electrolysis System with High Output Pressure: Cooperative Research and Development Final Report, CRADA Number CRD-18-00741

Electrolysis has been a commercially available product for a while and electrolyzers have been a proven capability to provide additional benefits (e.g. controllable load for grid services) in addition to production of hydrogen. The hydrogen output is typically compressed for storage and dispensing. Compression adds cost and decreases system reliability. Honda’s electrolyzer systems have been developed to include electrochemical compression to leverage the production system itself for at least partial compression. In this project, the team will evaluate Honda’s PEM based electrochemical compression system. The system is capable of compressing hydrogen up to 70 MPa electrochemically. Validation testing is the next step to accelerate this technology into the marketplace, as the validation will provide needed data under a variety of operation conditions and controls. These operating conditions and controls are based on over a decade of NLR research and development with low-temperature electrolysis. The validation testing will include preparing NLR’s site for third party evaluation, benchmark testing of Honda’s stack and system, and simulating operation connected to renewables or in a grid service profile. NLR’s Energy System Integration Lab will be the location for the electrolyzer validation research and integrated into the Hydrogen Infrastructure Test & Research Facility (HITRF). This will build into the existing retail style hydrogen fueling station for a fully integrated experimental setup.

08 HYDROGEN↗

Subcomponent Validation of Composite Joints for Marine Energy Structures

The Marine Energy Advanced Materials project addresses the barriers and uncertainties facing marine renewable energy developers in using composite materials for load-bearing structures. Sponsored by the U.S. Department of Energy's Water Power Technologies Office, the multiyear project comprises of collaborators from the National Renewable Energy Laboratory (NREL), Sandia National Laboratories, Pacific Northwest National Laboratory (PNNL), Montana State University (MSU), Florida Atlantic University (FAU), and industry stakeholders. As part of the Marine Energy Advanced Materials project, marine renewable energy industry surveys and assessments were conducted to identify key materials and knowledge gaps that hinder the adoption of composite materials in marine renewable energy structures. Specific knowledge gaps highlighted for composite materials were environmental effects, fatigue strengths, and bonded and bolted interconnects (composite/composite and composite/metal). It was concluded that many of these gaps could be addressed through subcomponent validation; consequently, a program was developed at NREL with the goals of developing subcomponent validation methods for appropriate marine energy materials, which would improve the understanding of design allowables for full-scale structural components and joints. Ultimately, the aim is to reduce timelines and costs associated with full-scale structural validation efforts while also providing near-net-scale static and fatigue data of composite/metal subcomponents for marine renewable energy systems. To approach these goals, a testing program was developed at NREL to investigate a variety of materials and structural design details at the subcomponent scale to understand (a) the effects of harsh and corrosive marine energy environments and (b) the static and fatigue strengths of the complex geometries. The recent study from this testing program is perhaps the largest that has ever been conducted with respect to specimen scale and geographic diversity of underwater environmental conditions that the specimens were subjected to. A variety of specimen geometries were designed by NREL to highlight key features of multimaterial (composite/composite or metal/composite) interconnects that may be used in marine renewable energy structural designs. The designs used several different composite matrices, adhesives, and marine-grade steels, which were highlighted in the surveys as being the most appropriate for harsh marine environments. Composite panels were then manufactured at MSU, and were subsequently manufactured into test specimens by NREL. The specimens were shipped to FAU and PNNL for conditioning in ocean water tanks at various temperatures for an extended period. The specimens were then returned to NREL for structural validation. This presentation will provide an overview of recent advances within the testing program in terms of specimen design and test methods, and will discuss results and key findings of the subcomponent testing program to date at NREL.

adhesives↗

Bison Verification and Validation Activities for TRISO

Numerical modeling and simulation (M&S) tools play a key role in the research, development, and overall safety assessments of next-generation nuclear energy systems. One such tool, Bison, is a nuclear fuel performance code that is applicable to many fuel forms (e.g., light-water reactor fuel, oxide and metallic fuel for fast reactors, tri-structural isotropic (TRISO) fuel, and plate fuel), and it uses the finite element method to model the thermo- mechanical response of nuclear fuels. One fuel form widely utilized in Generation-IV high-temperature gas-cooled and fluoride- salt-cooled nuclear reactor concepts is TRISO fuel. Recently, Bison’s capabilities were significantly expanded to enable it to model the performance of TRISO particles and compacts. It is important that Bison’s computational results be reliable and predictive, since this code is used to inform high-consequence decisions. The various processes developed to address this issue generally entail two fundamental steps: verification and validation (V&V). Verification ensures that the code functions correctly and is reliable. Code/solution verification, code benchmark, and software quality assurance exercises are examples of verification activities. On the other hand, validation is the process of assessing a code’s capability to accurately model physical problems. Comparisons between code results and experiments quantify the validation level. Application of V&V procedures is crucial to the development of computational tools that are free of coding mistakes and can accurately represent reality. The current study presents an overview of Bison V&V activities relevant to the TRISO fuel concept, which include code/solution verification exercises, CRP-6 Benchmark—a Coordinated Research Program through the International Atomic Energy Agency (IAEA)—exercises, and validation exercises with the Advanced Gas Reactor (AGR)- 1/2/3/4 experiment series.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V&V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. Pronghorn is a coarse-mesh, intermediate-fidelity, and multidimensional thermal-hydraulics (TH) code developed by the Idaho National Laboratory (INL). New pebble bed experiments are used to observe the details of the fluid motion and pressure drop in the porous bed under the reactor normal operation. This paper focuses on the validation of the Pronghorn compressible and incompressible Navier-Stokes equations using the pressure drop measurements performed at the engineering-scale pebble bed facility at the Texas A&M university (TAMU). Various pressure drop correlations and porosity functions are implemented in both Pronghorn and STAR-CCM+ to compare the pressure drop due to the combined viscous and inertial resistances in the porous bed. The correlations accounting for the near-wall effect are also utilized to observe if the pressure drop estimates can be improved. Pronghorn porous media models predict the pressure drop well relative to the STAR-CCM+ simulation results and 1D correlations, and both the finite element method (FEM) and finite volume method (FVM) perform accurately. Pronghorn models are also validated with the experimental measurements given the different Reynolds number ranges and specific aspect ratios. The likelihood of the statistical significance between the pressure drop measurements and specific correlations or simulations is low provided that the overlap of their confidence intervals is more than the half of a single arm. Several validation metrics are reasonable in regard to the similar studies from other literature. The precise average pebble bed porosity estimation has much impact on the pressure drop, and the Foumeny and Montillet (dense packing) models carry out the accurate pressure drop prediction by considering the near-wall effect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

RELAP5-3D HTGR Validation Work at Idaho National Laboratory

Prismatic block-type high-temperature gas-cooled reactors (HTGRs) were built in the United States decades ago, and now advanced reactor vendors are seeking to deploy them again for a variety of applications. Deploying these reactors requires modelling and simulation tools that have been validated against conditions representative of the HTGR application. Idaho National Laboratory (INL) is leading the execution an of HTGR thermal hydraulics benchmark to accelerate the validation of thermal hydraulics modelling and simulation tools for these applications. That benchmark is based on a facility called the High Temperature Test Facility (HTTF). This work provides an overview of work conducted at INL over the last 2 years to validate RELAP5-3D against data from HTTF. This presentation shows results from multiple RELAP5-3D models and an HTTF experiment to assess the impact of certain modelling assumptions on results. The contents of this talk sit on the cutting edge of RELAP5-3D validation for HTGR analysis.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of Scale-Derived Ages in Wild Juvenile and Adult Steelhead Using Parental-Based Tagging

Abstract Accurate age information is a critical component in fisheries monitoring, management, and research. The ability to assign accurate ages to fish by using nonlethal structures is vital in calculating cohort productivity for fish species with low abundances and variable life histories. A common nonlethal method to assign ages is by interpretation of patterns in scales. Validation of ages is not easily obtained for free-ranging fishes; however, the development of genetic “tags” has expanded age validation opportunities. In this study, we used parental-based genetic tagging to validate ages determined from scales collected from juvenile and adult steelhead Oncorhynchus mykiss in two streams within the Snake River basin. Juvenile scale ages were in agreement with 93% of the known ages. Adult scale ages were in agreement with 89% of the known ages. Although overall bias in juvenile ages was very low, we saw a slight positive bias in younger fish (young of the year and age 1) and a small negative bias in older juveniles (ages 2–4). A small negative bias in ages of adults was a consequence of errors in freshwater age. The errors observed did not significantly bias age compositions because the 90% confidence intervals about the age proportions based on scales contained the known proportions; therefore, scale analysis is an acceptable method for assigning ages to Snake River steelhead. We discuss the value of validated known-age scales as a reference collection, and as an illustrative use, we constructed a circulus count guide to aid technicians in identifying missing annuli and distinguishing true from false annuli. To demonstrate the use of the circulus guidelines, we reanalyzed samples with age discrepancies, applying the circulus count data and the known age to identify mistakes.

Reinhardt, Leslie↗

Development and cross‐validation of a circumference‐based predictive equation to estimate body fat in an active population

Abstract Objective The U.S. Army uses sex‐specific circumference‐based prediction equations to estimate percent body fat (%BF) to evaluate adherence to body composition standards. The equations are periodically evaluated to ensure that they continue to accurately assess %BF in a diverse population. The objective of this study was to develop and validate alternative field expedient equations that may improve upon the current Army Regulation (AR) body fat (%BF) equations. Methods Body size and composition were evaluated in a representatively sampled cohort of 1904 active‐duty Soldiers (1261 Males, 643 Females), using dual‐energy X‐ray absorptiometry (%BF DXA ), and circumferences obtained with 3D imaging and manual measurements. Sex stratified linear prediction equations for %BF were constructed using internal cross validation with %BF DXA as the criterion measure. Prediction equations were evaluated for accuracy and precision using root mean squared error, bias, and intraclass correlations. Equations were externally validated in a convenient sample of 1073 Soldiers. Results Three new equations were developed using one to three circumference sites. The predictive values of waist, abdomen, hip circumference, weight and height were evaluated. Changing from a 3‐site model to a 1‐site model had minimal impact on measurements of model accuracy and performance. Male‐specific equations demonstrated larger gains in accuracy, whereas female‐specific equations resulted in minor improvements in accuracy compared to existing AR equations. Equations performed similarly in the second external validation cohort. Conclusions The equations developed improved upon the current AR equation while demonstrating robust and consistent results within an external population. The 1‐site waist circumference‐based equation utilized the abdominal measurement, which aligns with associated obesity related health outcomes. This could be used to identify individuals at risk for negative health outcomes for earlier intervention.

Taylor, Kathryn M.↗

Comparison and validation of the QuEChERSER mega-method for determination of per- and polyfluoroalkyl substances in foods by liquid chromatography with high-resolution and triple quadrupole mass spectrometry

Instances of food contamination with per- and polyfluoroalkyl substances (PFAS) continue to occur globally, but sample preparation and analytical methods are quite limited and often monitor for a small percentage of known PFAS. This study aimed to evaluate, validate, and compare performance of two instruments with the recently developed “quick, easy, cheap, effective, rugged, safe, efficient, and robust” (QuEChERSER) sample preparation mega-method – a method developed to monitor chemicals over a broad range of physicochemical properties. Initial evaluation of the QuEChERSER mega-method for determination of PFAS in food demonstrated recoveries, matrix interferences, and co-extractive removal comparable to (or better than) US Food and Drug Administration (FDA) and USDA Food Safety and Inspection Service (FSIS) methods. Subsequent validation of QuEChERSER in beef, catfish, chicken, pork, liquid eggs, and powdered eggs on a high-resolution mass spectrometer achieved acceptable recoveries (70–120%) and precision (RSDs ≤20%) for all 33 target analytes at the 1 and 5 ng g –1 levels and 67–88% of analytes at the 0.1 ng g –1 level, depending on the matrix. Additional validation was performed by tandem mass spectrometry on a triple quadrupole instrument. This approach provided no non-detects and better recoveries at the 0.1 ng g –1 level than the HRMS method but exhibited more variability at 1 and 5 ng g –1 spiking levels. Analysis of NIST SRMs 1946 and 1947 gave accuracies of 70–117%. Furthermore, these results demonstrate the capability of combining PFAS analysis with a mega-method previously validated for 350 analytes, while collecting non-target data for future retrospective analysis of emerging alternatives with a high-resolution mass spectrometry method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗