Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Software Quality Assurance Plan ANSYS LSDYNA Version 2023R1

ANSYS Inc. develops and markets engineering simulation software and services used in the aerospace, automotive, manufacturing, electronics, biomedical, energy, defense, and many other industries. ANSYS is dedicated to engineering simulation and is the world’s leading software provider. ANSYS was founded in 1970 and is headquartered in Canonsburg, Pennsylvania. ANSYS provides an engineering analysis tool combining structural, thermal, computational fluid dynamics, acoustic and electromagnetic simulation capabilities. ANSYS LS-DYNA is the most used explicit simulation program capable of simulating the response of materials to short periods of severe loading. Its many elements, contact formulations, material models, and other controls can be used to simulate complex models with control over all the details of the problem. ANSYS LS-DYNA has a vast array of capabilities to simulate extreme deformation problems using its explicit solver. Engineers can tackle simulations involving material failure and look at how the failure progresses through a part or through a system. Models with large amounts of parts or surfaces interacting with each other are also easily handled, and the interactions and load passing between complex behaviors are modeled accurately. Using computers with higher numbers of CPU cores can drastically reduce solution times. In addition, many consulting firms and hundreds of universities use ANSYS for analysis, research, and educational purposes. ANSYS is recognized worldwide as one of the most widely used and capable programs of its type. ANSYS has successfully passed over 100 customer quality system audits against American Society of Mechanical Engineers (ASME) NQA-1 and 10 CFR Part 50, Appendix B, since the company was founded, over 60 of which have been since 1997. ANSYS has successfully passed over 100 International Organization for Standardization (ISO) 9001 assessments. ANSYS design analysis software is the first created within a quality system with ISO 9001 certification, which is the internationally accepted quality standard. Product development, testing, maintenance, and support processes also meet the US Nuclear Regulatory Commission’s (NRC’s) quality requirements, as they have for nearly four decades. ANSYS staff perform more than 60,000 software verification tests before releasing each new product. ASME NQA-1-2012 (Subpart 2.7 is specific to software) is the industry- and NRC-accepted approach (consensus standard) for meeting 10 CFR Part 50, Appendix B, requirements.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Machine Learning-Based Anomaly Detection for PMT Data Quality Monitoring in the SBN and DUNE

Maintaining high-quality detector data is essential for achieving the scientific objectives of the Short-Baseline Neutrino (SBN) Program at Fermilab. Current data quality monitoring (DQM) procedures rely primarily on threshold-based metrics and manual inspection of detector monitoring plots, making the detection of subtle or gradually developing anomalies both time-consuming and dependent on expert interpretation. This project developed and evaluated a machine-learning workflow for automatically identifying anomalous photomultiplier tube (PMT) channels in the Short-Baseline Near Detector (SBND) using optical-hit amplitude data. A Python-based analysis program was developed to process ROOT files, extract statistical features describing individual PMT amplitude distributions, and generate feature vectors for anomaly detection. These features were used to train an Isolation Forest model using data representing normal detector operation. The trained model was subsequently applied to independent detector runs to identify channels exhibiting statistically unusual behavior relative to the learned reference response. To support expert interpretation, the workflow generated complementary diagnostic products, including anomaly score distributions, normalized amplitude comparisons, decision-tree visualizations, and principal component analysis (PCA) projections. This project demonstrated the feasibility of integrating unsupervised machine learning into detector data-quality monitoring and developed a complete workflow for automated PMT performance assessment to aid expert-driven review. Beyond its technical contributions, the VFP appointment fostered a research collaboration between Aurora University and Fermilab and provided direct workforce development benefits by training the visiting faculty member in detector-scale machine-learning methods that are now being incorporated into undergraduate coursework and research. The methodology developed here provides a foundation for future applications to ProtoDUNE and other liquid argon time projection chamber (LArTPC) detectors, contributing to ongoing efforts to improve detector reliability, reduce manual monitoring requirements, and enable scalable data quality monitoring for future large-scale neutrino experiments, including the Deep Underground Neutrino Experiment (DUNE).

Colón Santana, Juan A. [Unlisted, US, IL]↗
DOE OSTI2025

The role of soil chemical properties and microbial communities on Dendrocalamus brandisii bamboo shoot quality, Yunnan Province, China

Objective To explore the effects of soil nutrients and microbial communities on the quality of Dendrocalamus brandisii shoots in different regions, providing a scientific basis for their development and utilization. Methods Using seven different geographic sources of D. brandisii from Yunnan Province as research subjects, this study employs chemical analysis and high-throughput sequencing to reveal the relationship between soil nutrients, microbial functional groups, and the nutritional quality of bamboo shoots. Results The results indicate that there are significant differences in soil nutrient content among the regions ( p < 0.05), with bamboo shoots from Baoshan Changning (CN) exhibiting the best overall nutritional quality. The key factors influencing bacterial community changes include pH, available phosphorus (AP), and available potassium (AK). In contrast, the main factors affecting fungal community changes are pH, soil organic matter (SOM), available potassium (AK), and total nitrogen (TN). This version maintains clarity and logical flow, making it easier for readers to understand the different factors influencing bacterial and fungal community changes. The diversity indices of soil microbial communities among different sources of Dendrocalamus brandisii show significant differences ( p < 0.05). The dominant groups in the seven regions include Proteobacteria, Acidobacteriota, Actinobacteriota, Chloroflexi, Ascomycota, and Basidiomycota. The soil microbial community in Baoshan Changning (CN) shows significant structural differences compared to the other six regions, with the highest relative abundances of Chloroflexi and Acidobacteriota. In contrast, the highest relative abundance of Proteobacteria is found in Honghe Shiping (SP), while Actinobacteriota has the highest relative abundance in Yuxi Xinping (XP). RDA analysis indicates that soil nutrients (SOM, pH, AP, TN) affect the water content, soluble sugar, and crude fat of bamboo shoots. Additionally, the bacterial communities including Actinobacteriota, Chloroflexi, Patescibacteria, GAL15, and Cyanobacteria influence the water content, soluble sugar, ash content, protein, and lignin of bamboo shoots. Discussion In the fungal community, Basidiomycota, Kickxellomycota, Mucoromycota, unclassified-k-Fungi, and Glomeromycota affect the water content and tannin levels in bamboo shoots. In summary, soil nutrients and soil microorganisms are interconnected and work together to influence the quality of bamboo shoots.

Chen, Qian↗
DOE OSTI2025

Cleaned 5-Minute Resolution Air Quality and Meteorological Data from Nine TCEQ CAMS Sites in Houston, Texas (Nov 2021 – Oct 2022)

These data encompass 5-minute air monitoring and meteorological observations collected in the greater Houston, Texas metropolitan region, at nine (9) Continuous Ambient Monitoring Stations (CAMS) operated by the Texas Commission on Environmental Quality (TCEQ) between November 1, 2021 and October 31, 2022. The CAMS sites (CAMS 1, 8, 35, 45, 148, 403, 405, 410, and 1052) were chosen because their instrumentation includes measurements of PM2.5. These sites also provide continuous multi-parameter air-quality and meteorological measurements. Particulate matter (PM2.5, PM10) was sampled along with several trace gases, including ozone (O3), nitrogen oxides (NO, NO2, NOx), sulfur dioxide (SO2), and carbon monoxide (CO). The data set also contains standard surface meteorological parameters (temperature, humidity, pressure, wind speed, and wind direction). Several sites also include AutoGC-based measurements of volatile organic compounds (VOCs). Air monitoring instruments deployed at the selected sites comprise the following systems: BAM-1020 or TEOM (PM2.5), Thermo Scientific TEI 49i (O3), TEI 42i (NOx), and AutoGCs (VOCs). This data set is similar to the data included within the houairq5mX1.00 datastream, except for a few additional quality control steps. A systematic data cleaning and verification process was performed on the data set to ensure its quality and preparation for analysis. Removal of non-numeric status flags (e.g., [LIM], [QAS], [SPZ], [CAL], [PMA], [AQI], [SPN], [MAL]) was accomplished by employing rule-based string parsing to extract valid numerical values. Missing entries were set to -9999; however, invalid or anomalous values (e.g., 99999) were retained as originally reported by the TCEQ to preserve data provenance. The time sequence was verified for completeness, removal of duplicates, and uniformity at 5-minute intervals. Column labeling was standardized, and corresponding values were assessed for physical plausibility. All timestamps in the data set were reported in Coordinated Universal Time (UTC) as provided by the TCEQ. Further, the latitude and longitude coordinates were added for each CAMS site. A subset of the data (June 1–September 30, 2022) has been used in the following publication: Subba et al. 2025. “Implications of sea breeze circulations on boundary layer aerosols in the southern coastal Texas region.” EGUsphere 2025: 1–49, https://doi.org/10.5194/egusphere-2025-2659.

latitude↗
DOE OSTI2025

The Effect of Slag Heat Treatment on Ingot Quality during Cold Start Electroslag Remelting

Heat treatments of a commercial 40CaF 2 –30CaO–30Al 2 O 3 slag are explored to study their effect on quality of ingots produced using cold start electroslag remelting (ESR). Reducing heat treatment (or roasting) time or temperature for slag degassing can lead to energy savings as well as longer lifetimes for various components. Heat treatments in vacuum with pressure monitoring and air are investigated along with several temperatures, heating rates, and/or holding times. A research scale ESR furnace is used with steel electrodes. Significant differences in ingot quality, such as the occurrence of pores and a rough sidewall near the bottom of the ingot produced using slag heat treated in air at 580 °C, are observed. Further, adjustments in the heat treatment temperature for heat treatment in air eventually lead to an ingot quality comparable to that obtained using slag degassing in a controlled atmosphere at higher temperatures. Using differential thermal analysis, it is found that moisture is primarily removed from the slag at ≈460 °C and 700 °C. A safe slag roasting temperature is concluded to be 750 °C. Improper slag heat treatment leads to hydrogen concentrations from 8 to 15 ppm in about one‐quarter of the ingot volume.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Modeling the Air Quality Impacts of Future Energy Scenarios

Many greenhouse gas (GHG) emission reduction measures achieve simultaneous reductions in air pollutants. Human-Earth system models can estimate such emission changes in the energy system but using them in chemistry-transport models (CTMs) to study their air quality impacts involves resource-intensive emissions processing. This is greatly simplified by an emissions scaling approach linking state-level emissions estimated by a human-Earth system model to a CTM. A scenario continuing pre-2022 energy policy in the U.S. to 2050 shows widespread air quality improvements over the 2015 baseline from SO 2 and NO x emission reductions of 50–80% from electricity generation and light-duty vehicles. Scenarios of GHG mitigation and vehicle electrification at the state and national level add further benefits. However, PM 2.5 increases from increased use of wood heating and bioenergy suggest that additional PM 2.5 management may be needed when using biofuels. In conclusion, this approach helps assess multiple future energy scenarios efficiently without sacrificing chemical detail in the air quality simulations.

air quality↗
DOE OSTI2024

PeakQC: A Software Tool for Omics-Agnostic Automated Quality Control of Mass Spectrometry Data

Mass spectrometry is broadly employed to study complex molecular mechanisms in various biological and environmental fields, enabling 'omics' research such as proteomics, metabolomics, and lipidomics. As study cohorts grow larger and more complex with dozens to hundreds of samples, the need for robust quality control (QC) measures through automated software tools becomes paramount to ensure the integrity, high quality, and validity of scientific conclusions from downstream analyses and minimize the waste of resources. Since existing QC tools are mostly dedicated to proteomics, automated solutions supporting metabolomics are needed. To address this need, we developed the software PeakQC, a tool for automated QC of MS data that is independent of omics molecular types (i.e., omics-agnostic). It allows automated extraction and inspection of peak metrics of precursor ions (e.g., errors in mass, retention time, arrival time) and supports various instrumentations and acquisition types, from infusion experiments or using liquid chromatography and/or ion mobility spectrometry front-end separations and with/without fragmentation spectra from data-dependent or independent acquisition analyses. Diagnostic plots for fragmentation spectra are also generated. Here, in this paper, we describe and illustrate PeakQC’s functionalities using different representative data sets, demonstrating its utility as a valuable tool for enhancing the quality and reliability of omics mass spectrometry analyses.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Collider-quality electron bunches from an all-optical plasma photoinjector

We present an approach for generating collider-quality electron bunches using a plasma photoinjector. The approach leverages recently developed techniques for the spatiotemporal control of laser pulses to produce a moving ionization front in a nonlinear plasma wave. The moving ionization front generates an electron bunch with a current profile that balances the longitudinal electric field of an electron beam-driven plasma wave, creating a uniform accelerating field across the bunch. Particle-in-cell (PIC) simulations of the ionization stage show the formation of an electron bunch with 220 pC charge and low emittance (ɛ 𝑥 = 171 nm rad, ɛ 𝑦 = 76 nm rad). Quasistatic PIC simulations of the acceleration stage show that the bunch is efficiently accelerated to 24 GeV over 2 m with a final energy spread of less than 1% and emittances of ɛ 𝑥 = 189 nm rad and ɛ 𝑦 = 80 nm rad. This high-quality electron bunch meets the requirements outlined by the Snowmass process for intermediate-energy colliders and compares favorably to the beam quality of proposed and existing accelerator facilities. The results establish the feasibility of plasma photoinjectors for future collider applications making a significant step toward the realization of high-luminosity, compact accelerators for particle physics research.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

“Godzilla,” the Extreme African Dust Event of June 2020: Origins, Transport, and Impact on Air Quality in the Greater Caribbean Basin

In June 2020, the tropical Atlantic and the Caribbean Basin were affected by a series of African dust outbreaks unprecedented in size and intensity. These events, informally named “Godzilla,” coincided with CALIMA, a large field campaign, offering a rare opportunity to assess the impact of African dust on air quality in the Greater Caribbean Basin. Network measurements of respirable particles (i.e., PM 10 and PM 2.5 ) showed that dust significantly degraded regional air quality and increased the risk to public health in the Caribbean, the southern United States, northern South America, and Central America. CALIMA examined the meteorological context of Godzilla dust events over North Africa and how these conditions might relate to the greatly increased dust emissions and enhanced transport to the Americas. Godzilla was linked to strong pressure anomalies over West Africa, resulting in a large-scale geostrophic wind anomaly at 700 hPa over North Africa. We used surface-based and columnar measurements to test the performance of two frequently used aerosol forecast models: the NASA Goddard Earth Observing System (GEOS) and Weather Research and Forecasting Model coupled with Chemistry (WRF-Chem) models. The models showed some skills but differed substantially between their forecasts, suggesting large uncertainties in these forecasts that are critical for issuing early warnings of health-threatening dust events. Our results demonstrate the value of an integrated approach in characterizing the spatial and temporal variability of African dust transport and assessing its impact on regional air quality. Future studies are needed to improve models and to track the long-term changes in dust transport from Africa under a changing climate.

Aerosols/particulates↗
DOE OSTI2025

Indoor Air Quality (IAQ) Monitoring for Space Farming Institute [Slides]

Through the U.S. Department of Energy's Energy to Communities (E2C) program, NREL, other national laboratory experts, and select organizations provide Expert Match - free, short-term technical assistance to address near-term energy challenges and questions. Expert Match is for community stakeholders who have decision-making power or influence in their community but need access to additional energy expertise to inform key upcoming decisions. This Expert Match request supported the Space Farming Institute, a nonprofit organization located in Anchorage, AK, with an indoor air quality analysis. The NREL team analyzed indoor air quality data provided by the Space Farming Institute, which experts at PNNL used to design an indoor bioreactor to grow Ulva algae for indoor air quality mitigation purposes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Biomass yield potential, feedstock quality, and nutrient removal of perennial buffer strips under continuous zero fertilizer application

Perennial-based buffer strips have been promoted as having the potential for improving ecosystem services from riparian areas while producing biomass as livestock feed or as a bioenergy feedstock. Both biomass production and nutrient removal of buffer strips are substantially influenced by the vegetation types for the multipurpose perennial buffers. In this 2016–2019 study in western Illinois, two perennial cropping systems, including forage crops composed of cool-season grass mixtures (forage system) and bioenergy crops made up of warm-season grass mixtures (bioenergy system), were used to establish buffer strips for assessing biomass production, feedstock quality, nutrient removal, and buffer longevity. Treatments for this study reflecting agronomic practices included (1) two harvests occurring in summer (at anthesis) and fall (after complete senescence) and (2) one harvest in fall for the forage system (two-cut vs. one-cut forage) and (3) one fall harvest for the bioenergy system (one-cut bioenergy). Successively harvesting without any fertilizer input resulted in a yield decline in forage biomass over 3 years by approximately 30 % (6.3 to 4.4 Mg DM ha –1 (dry matter) with a rate of 1.0 Mg ha –1 yr –1 ) in the two-cut forage and by 35 % (4.9 to 3.2 Mg DM ha –1 with a rate of 0.9 Mg ha –1 yr –1 ) in the one-cut forage systems. The feed quality also decreased over the years by showing declined rates of 12.9 (crucial protein), 0.9 (calcium), 0.7 (copper), and 1.3 g kg –1 DM yr –1 (zinc). Empirical models predicted enteric CH 4 emissions from cattle ranged from 225.7 to 242.6 g per cow per day based on the feed nutritive values. In contrast, bioenergy biomass yield increased by 27 % from 4.9 to 6.7 Mg DM ha –1 with a consistent quality (cellulose of ~ 397.9 g kg –1 ; hemicellulose of ~ 299.4 g kg –1 ), corresponding to the increased total theoretical ethanol yield from 1.8 × 10 3 to 2.4 × 10 3 L ha –1 (~ 33 % increase). Annual nutrient removals of N, P, K, Ca, and Mg were significantly higher in the forage systems (e.g., two-cut: 52.6–106.9 kg N ha –1 ; one-cut: 44.5–84.1 kg N ha –1 ) than those in the bioenergy system (e.g., 25.9–34.4 kg N ha –1 ); however, the removal rate declined rapidly over 3 years (e.g., ~ 49 % reduction) as the annual biomass yield declined in the forage systems. This on-farm field study demonstrated the potential of the perennial crop used as buffer strip options for biomass production and buffer sustainability at the edge of the field.

09 BIOMASS FUELS↗
DOE OSTI2026

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

CROCUS Air Quality Data at Argonne National Laboratory Prairie Site

The AQT (Vaisala AQT530) instrument provides observations on meteorological conditions, including particulate matter (PM2.5, PM10), gas species concentrations (NO, NO2, O3, CO), and environment temperature and moisture. These measurements are critical for understanding air quality. These measurements are useful for understanding changes in aerosol properties, air quality research, and comparing to model experiments especially in urban environments. These measurements are collected at the Argonne Testbed for Multiscale Observational Science (ATMOS), a prairie field site at Argonne National Laboratory in Lemont, Illinois. Data is available in the netCDF data format, we encourage data users review documentation through Project Pythia to understand how to work with netCDF data https://foundations.projectpythia.org/core/data-formats/netcdf-cf.html. Each file contains one day's worth of data (24 hours, starting at 0000 UTC). The data is aggregated into daily frequency to make it easier to process multiple days, and compress the higher-resolution fields. File naming convention includes the project (CROCUS), location (atmos), data level (raw, a1), date (year, month, day), and hour (0000).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

CROCUS Air Quality Data at University of Illinois - Chicago Tower

The AQT (Vaisala AQT530) instrument provides observations on meteorological conditions, including particulate matter (PM2.5, PM10), gas species concentrations (NO, NO2, O3, CO), and environment temperature and moisture. These measurements are critical for understanding air quality. These measurements are useful for understanding changes in aerosol properties, air quality research, and comparing to model experiments especially in urban environments. These measurements are collected at the University of Illinois in Chicago, Illinois, on the meteorological tower near the greenhouse on campus. Data is available in the netCDF data format, we encourage data users review documentation through Project Pythia to understand how to work with netCDF data https://foundations.projectpythia.org/core/data-formats/netcdf-cf.html. Each file contains one day's worth of data (24 hours, starting at 0000 UTC). File naming convention includes the project (CROCUS), location (UIC), data level (raw, a1), date (year, month, day), and hour (0000).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Wide‐Field Bond Quality Evaluation Using Frequency Domain Thermoreflectance with Deep Neural Network Feature Reconstruction

Heterogeneous integration of microelectronic components provides a pathway to improve circuit/component performance; however, this comes with assembly challenges, in particular due to complex interfaces via subsurface bump bonds. The ability of these bonds to transmit electrical signals and conduct heat to the carrier substrate limits component performance. In this work, hyperspectral frequency‐domain thermoreflectance (FDTR) imaging is demonstrated as a robust technique for evaluating the quality of subsurface indium bump bonds in a surrogate microelectronic sample. By performing microscale FDTR imaging with coarse motion image stitching, thermal phase maps that cover a 4 mm by 4 mm field‐of‐view with subsurface feature sensitivity at depths greater than 50 µm are obtained. The resulting FDTR hyperspectral data contains more than three million pixels and reveal the quality of subsurface microbump arrays. Wide‐field analysis of bonded versus gap regions is enabled by deep neural network feature reconstruction, that after training, rapidly provides an interpretable representation of bond quality. Utility of noisy higher frequency FDTR phase maps, i.e., near the computationally predicted sensing depth limit, results in an average prediction error of 11%. Taken together, FDTR with neural network‐based analysis demonstrates subsurface bond monitoring at length scales relevant for heterogeneously integrated microelectronics.

FDTR↗
DOE OSTI2024

Toward Ultra‐High‐Quality‐Factor Wireless Masing Magnetic Resonance Sensing

It has recently been shown that a bolus of hyperpolarized nuclear spins can yield stimulated emission signals similar in nature to maser signals, potentially enabling new ways of sensing hyperpolarized contrast media, including most notably [1- 13 C]pyruvate that is under evaluation in over 50 clinical trials for metabolic imaging of cancer. The stimulated NMR signal emissions lasting for minutes do not require radio-frequency excitation, offering unprecedented advantages compared to conventional MR sensing. However, creating nuclear spin maser emission is challenging in practice due to stringent fundamental requirements, making practical in vivo applications hardly possible using conventional passive MR detectors. Here, in this study, we demonstrate the utility of a wireless NMR maser detector, the quality factor of which was enhanced 22-fold (to 1,670) via parametric pumping. This active-feedback technique breaks the intrinsic fundamental limit of NMR detector circuit quality factor. We show the use of parametric pumping to reduce the threshold requirement for inducing nuclear spin masing at 300 MHz resonance frequency in a preclinical MRI scanner. Indeed, stimulated emission from hyperpolarized protons was obtained under highly unfavorable conditions of low magnetic field homogeneity (T 2 * of 3 ms). Greater gains of the quality factor of the MR detector (up to 1 million) were also demonstrated.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Trusted Simulation: Considering Model Quality in the Context of User Trust

A high‐quality simulation model should help its users to easily and appropriately calibrate their trust in the model. Traditional evaluation metrics such as validation and robustness are necessary but insufficient for this task. Trust calibration depends on factors like the model's transparency, applicability to intended use, usability, reputation, and consideration of potential bias. This article proposes a framework for designing and evaluating system dynamics models by considering factors that contribute to the proper calibration of user trust. This framework takes inspiration from trusted artificial intelligence, broadening our traditional concept of model quality and explicitly focusing on what users need to consider a model trustworthy and to understand the model's relevance to its intended purpose. The trusted simulation framework can improve our integration of model quality activities throughout the modeling process, leading to more impactful and better‐targeted model design, development, and evaluation.

Naugle, Asmeret Bier [Sandia National Laboratories↗
DOE OSTI2024

Autoencoder-Based Anomaly Detection System for Online Data Quality Monitoring of the CMS Electromagnetic Calorimeter

The CMS detector is a general-purpose apparatus that detects high-energy collisions produced at the LHC. Online data quality monitoring of the CMS electromagnetic calorimeter is a vital operational tool that allows detector experts to quickly identify, localize, and diagnose a broad range of detector issues that could affect the quality of physics data. A real-time autoencoder-based anomaly detection system using semi-supervised machine learning is presented enabling the detection of anomalies in the CMS electromagnetic calorimeter data. A novel method is introduced which maximizes the anomaly detection performance by exploiting the time-dependent evolution of anomalies as well as spatial variations in the detector response. The autoencoder-based system is able to efficiently detect anomalies, while maintaining a very low false discovery rate. The performance of the system is validated with anomalies found in 2018 and 2022 LHC collision data. In addition, the first results from deploying the autoencoder-based system in the CMS online data quality monitoring workflow during the beginning of Run 3 of the LHC are presented, showing its ability to detect issues missed by the existing system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗