Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Critical Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

High Fidelity BWR Fuel Simulations

This report describes the Consortium for Advanced Simulation of Light Water Reactors (CASL) work conducted for completion of the Thermal Hydraulics Methods (THM) Level 3 milestone THM.CFD.P13.03: High Fidelity BWR Fuel Simulation. High fidelity computational fluid dynamics (CFD) simulation for Boiling Water Reactor (BWR) was conducted to investigate the applicability and robustness performance of BWR closures. As a preliminary study, a CFD model with simplified Ferrule spacer grid geometry of NUPEC BWR Full-size Fine-mesh Bundle Test (BFBT) benchmark has been implemented. Performance of multiphase segregated solver with baseline boiling closures has been evaluated. Although the mean values of void fraction and exit quality of CFD result for BFBT case 4101-61 agreed with experimental data, the local void distribution was not predicted accurately. The mesh quality was one of the critical factors to obtain converged result. The stability and robustness of the simulation was mainly affected by the mesh quality, combination of BWR closure models. In addition, the CFD modeling of fully-detailed spacer grid geometry with mixing vane is necessary for improving the accuracy of CFD simulation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Single-Bunch Instabilities at the Fermilab Recycler Ring

Understanding and characterizing collective instabilities is critical for high-intensity operation at the Fermilab Recycler Ring. This work presents an application of the the Nested Head-Tail (NHT) formalism for modeling single-bunch transverse instabilities, incorporating analytical solutions to the resistive wall impedances in the absence of space charge. Predicted growth rates and mode structures are benchmarked against PyHEADTAIL simulations and ongoing experimental measurements. The experimental program includes studies of bare-machine instabilities at different machine parameters. These results support the understanding of naturally-occurring instabilities in the Recycler and contribute to the development of predictive tools for beam stability in future high-intensity configurations.

Gonzalez-Ortiz, Cristhian [Fermilab]↗

Extreme Risk Mitigation in Reinforcement Learning using Extreme Value Theory

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modelling highly rare risk events (rewards) that could potentially lead to catastrophic outcomes. These infrequent occurrences present a formidable challenge for data-driven methods aiming to capture such risky events accurately. While risk-aware RL techniques do exist, they suffer from high variance estimation due to the inherent data scarcity. Our work proposes to enhance the resilience of RL agents when faced with very rare and risky events by focusing on refining the predictions of the extreme values predicted by the state-action value distribution. To achieve this, we formulate the extreme values of the state-action value function distribution as parameterized distributions, drawing inspiration from the principles of extreme value theory (EVT). We propose an extreme value theory based actor-critic approach, namely, Extreme Valued Actor-Critic (EVAC) which effectively addresses the issue of infrequent occurrence by leveraging EVT-based parameterization. Importantly, we theoretically demonstrate the advantages of employing these parameterized distributions in contrast to other risk-averse algorithms. Our evaluations show that the proposed method outperforms other risk averse RL algorithms on a diverse range of benchmark tasks, each encompassing distinct risk scenarios.

Wang, Yu↗

Energy Intensity Baselining and Tracking Guidance

Each company joining the U.S. Department of Energy’s (DOE’s) Better Buildings, Better Plants Program (Better Plants) commits to establishing an energy consumption and energy intensity (EI) baseline and to tracking its energy performance over a 10-year period against that baseline. The baseline must reflect a company’s energy consumption over a 12-month period, covering all its U.S.-based operations. Energy consumption is calculated by fuel type in terms of primary energy (also known as source energy). EI is broadly defined as the amount of energy consumed per unit of output produced. For this guidance document and for the program, the term energy performance represents an evaluation of a facility’s capacity to use energy efficiently. Metrics used to assess a facility’s energy performance can include EI, energy consumption, improvements in EI, etc. Establishing an energy baseline and tracking system is a critical first step in effectively managing energy use. Developing a baseline can help a company understand energy use within the corporation and give it a point of comparison to evaluate future efforts to improve energy performance. It can also support efforts to validate a company’s energy management activities, improve comparative analyses when using benchmarks, and help in predicting future energy needs. In addition, a company that normalizes its performance data can determine highly defensible measures of energy savings generated through implemented energy efficiency projects. Establishing a baseline and tracking energy performance is also a requirement for ISO 50001 certification. Although basic energy data can be collected through utility bills, most manufacturers will have to perform additional analyses to develop accurate and robust energy baselines and tracking systems. Energy is consumed in many ways within the manufacturing sector and can come from multiple sources. Energy is sometimes generated and sold to other parties or captured and reused on-site. External events can exert a significant impact on a facility or company’s energy use independent of any purposeful efforts to improve energy efficiency. Operational changes, such as production shifts—which may be inevitable for some companies over the 10-year period covered by the program—can also make a big difference in energy use. Since Better Plants asks companies to account for all their U.S.-based operations, mergers, acquisitions, and divestitures can also have significant implications for a company’s energy metrics. This document aims to demystify the sometimes complex baselining process. It devotes special attention to the task of normalizing and adjusting energy consumption to account for external factors, such as weather and production changes. A key recommendation is that companies use regression analysis to normalize their energy consumption data whenever possible. Regression analysis is a statistical technique that estimates the dependence of a variable (i.e., energy use in the context of Better Plants) on one or more independent variables such as ambient temperature, while controlling for the influence of other variables at the same time. A properly developed regression analysis can provide a reliable estimate of energy savings resulting from energy improvement strategies and projects by accounting for the effects of variables such as annual production levels and weather. DOE has developed a companion Energy Performance Indicator software tool (EnPI) to simplify the baselining process. This tool can run regression models, calculate changes in EI at the facility level, and automatically compile facility-level data into a corporate-wide metric. Note that although the relevant equations used to calculate EI are provided in this document, the EnPI tool will automatically perform most calculations for the user. Additionally, Better Plants Partners (Partners) can call on their Technical Account Manager (TAM) to help them establish a baseline and assist with the necessary calculations to track progress.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Updates and Validation for the n+ 63,65 Cu Cross Sections [Slides]

The RRR and URR parameters for 63,65 Cu have been optimized to transmission and capture data. Several data sets have been newly incorporated in this evaluation. The angular distribution parameters have been adopted from differential measurements, as was done in ENDF/B-V. The performance of this evaluation in the integral benchmark calculations is favorable, and the validation is ongoing.

07 ISOTOPE AND RADIATION SOURCES↗

Godiva 4 CAAS Shielding Benchmark: Pre CED-3A Overview [Slides]

Thiis presentation shows the character of an integral experiment. It covers the question why Godiva 4? Additionally, this presentation touches on the IER 498 benchmark quantity, activities facilitated by IER 498, proposed CED-2 test matrix, and what happened during the IER 498’s gap year.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Best Practices for Nuclear Experiment Data Preservation at Idaho National Laboratory: A Guide for Researchers and Reactor Operators

Preserving experimental data is essential for supporting advancements in nuclear science and ensuring the longevity of Idaho National Laboratory's contributions to reactor technology and safety. This report provides a comprehensive guide to best practices for experimental data management and preservation, focusing on standardized data formats, redundancy in storage, metadata documentation, and alignment with international standards. By following these recommendations, experimentalists and reactor operators can enhance the accessibility, reproducibility, and utility of critical datasets for regulatory review, validation computational methods, and future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A reproducible study design for the MIMIC-IV in-hospital mortality task

Open, tabular electronic health record (EHR) datasets such as MIMIC-III and MIMIC-IV have become critical resources for developing machine learning (ML) models addressing clinical prediction tasks, including hospital readmission, length of stay, and in-hospital mortality (IHM). While MIMIC-III has benefited from well-established preprocessing pipelines and standardized feature sets, MIMIC-IV remains comparatively challenging to work with because there are no standardized benchmarks to support reproducibility and comparability across studies. To address this limitation, we present a rigorously curated MIMIC-IV custom feature set optimized for IHM prediction, constructed through a reproducible preprocessing pipeline and feature selection strategy.

97 MATHEMATICS AND COMPUTING↗

Summary of GFL Inverter Capability and Performance: Malawi [Slides]

This presentation provides a comprehensive comparison of inverter-based resource (IBR) technical requirements across multiple international grid codes - including IEEE 2800, ESO, EirGrid, and Malawi's evolving regulatory framework - to support capacity building for electricity-sector institutions in Malawi. It highlights key performance expectations for grid-following (GFL) inverters across critical domains such as primary and fast frequency response, ramping behavior, frequency and voltage ride-through capabilities, reactive power and voltage control, ROCOF withstand, phase jump tolerance, system strength considerations, protection schemes, and dynamic modeling requirements. Emphasizing a "Do no harm, do something, do more" philosophy, the document synthesizes best practices and operational benchmarks to guide the integration and stability of inverter-based resources within Malawi's power system. The presentation forms part of the SABESS Center of Excellence initiative supported by the Global Energy Alliance for People and the Planet.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Space Flown Rodent Liver RNA Sequencing Data for Machine Learning in Space Biology Research

High-throughput nucleic acid sequencing (DNA-seq, RNA-seq) has become widespread in biomedical research due to the growing availability and affordability of these assays. Data analysis has been accelerated in recent years by the adoption of artificial intelligence (AI) and machine learning (ML) techniques by biomedical researchers. In space biology research, RNAseq datasets from space-flown experimental samples are critical for characterizing the gene expression aberrations associated with exposure to spaceflight stressors. However, space biological experiments tend to be very low sample size, so identifying proper AI/ML algorithms for sequencing data analysis is an ongoing challenge since these algorithms typically require large sample size. The NASA Science Mission Directorate (SMD) has started the “Benchmark Initiative for AI/ML”, focused on creating datasets meant for three main applications: 1) scientific benchmarking, which finds the best algorithm for a specific problem; 2) application benchmarking, which measures algorithm performance against a set of parameters; and 3) system benchmarking, which evaluates performance of hardware and software architecture. These scientific benchmarks consist of an AI-ready dataset and a reference implementation on a specific scientific question. In this work, we focused on generating standardized datasets to allow the scientific community to benchmark AI/ML algorithms in the domain of space biology. We present here a standardized, AI-ready, publicly available benchmark dataset for space biology RNA-seq data as a collaboration between the NASA AI4LS (Artificial Intelligence for Life Sciences) working group. and NASA’s SMD. This dataset consists of space-flown and ground control mouse liver found in the NASA GeneLab omics database. However, to amplify the small sample number (n=112 samples) for ML purposes, we employ Gaussian noise and a generative adversarial network to extend this dataset to 6,000 synthetic samples, matching the original gene expression characteristics.

James Casaletto↗

Benchmarking of a treatment planning system for spot scanning proton therapy: Comparison and analysis of robustness to setup errors of photon IMRT and proton SFUD treatment plans of base of skull meningioma

Purpose: Base of skull meningioma can be treated with both intensity modulated radiation therapy (IMRT) and spot scanned proton therapy (PT). One of the main benefits of PT is better sparing of organs at risk, but due to the physical and dosimetric characteristics of protons, spot scanned PT can be more sensitive to the uncertainties encountered in the treatment process compared with photon treatment. Therefore, robustness analysis should be part of a comprehensive comparison between these two treatment methods in order to quantify and understand the sensitivity of the treatment techniques to uncertainties. The aim of this work was to benchmark a spot scanning treatment planning system for planning of base of skull meningioma and to compare the created plans and analyze their robustness to setup errors against the IMRT technique. Methods: Plans were produced for three base of skull meningioma cases: IMRT planned with a commercial TPS [Monaco (Elekta AB, Sweden)]; single field uniform dose (SFUD) spot scanning PT produced with an in-house TPS (PSI-plan); and SFUD spot scanning PT plan created with a commercial TPS [XiO (Elekta AB, Sweden)]. A tool for evaluating robustness to random setup errors was created and, for each plan, both a dosimetric evaluation and a robustness analysis to setup errors were performed. Results: It was possible to create clinically acceptable treatment plans for spot scanning proton therapy of meningioma with a commercially available TPS. However, since each treatment planning system uses different methods, this comparison showed different dosimetric results as well as different sensitivities to setup uncertainties. The results confirmed the necessity of an analysis tool for assessing plan robustness to provide a fair comparison of photon and proton plans. Conclusions: Robustness analysis is a critical part of plan evaluation when comparing IMRT plans with spot scanned proton therapy plans.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Rapid assessment of REBCO CC angular critical current density J c (B, T = 4.2 K, θ) using torque magnetometry up to at least 30 tesla

Abstract Detailed design of REBa 2 Cu 3 O 7 − x (REBCO)-based magnets ideally relies on knowledge of the full angular and wide temperature range characterization of the critical current I c of the REBCO coated conductors (CC) at high magnetic fields. In practice, however, obtaining I c ( B , T , θ ) data by the commonly used electrical transport technique is expensive, tedious, and difficult, due to high critical current values that exceed 2000 A for B | | a b -plane ( θ = 90 deg). The conductors are often damaged during angular transport measurements at angles approaching the ab -plane. Therefore, so far, REBCO magnets have been designed without full I c ( B , T , θ ) data sets. Here, we present J c ( B , T , θ ) results for more than twenty samples of CC all made to the same advanced pinning specification produced by SuperPower Inc. For this, we employed torque magnetometry, benchmarking the results to transport I c measurements mostly made away from ab -plane, finding good agreement with scaling factors ≈1–1.3. What is striking is the huge variety of properties exhibited by the samples, even for CC made recently. Given the huge attention now being paid to the effects of screening currents and to the torques generated by offsets between the tape plane and the local magnetic field vector, our data set suggests some caution in detailed design of such magnets without having data of the type presented here.

Physics↗

TRIPOLI-4{sup R} version 9 Shielding for the Shielding Community: Overview, Relevant Benchmarking for Shielding and Licensing Policy - Paper 49

This is a review paper of the Shielding only version of TRIPOLI-4. TRIPOLI-4 and TRIPOLI-4 S: TRIPOLI{sup R} represents a family of radiation transport codes using the Monte Carlo method (1,2). It has been continuously developed at CEA since the mid 60's. TRIPOLI-4{sup R}, being the fourth generation, has been developed starting from the mid 90's in C++. It tracks neutrons from 20 MeV down to 10{sup -5} eV, photons, electrons and positrons from 100 MeV to 1 keV, in 3D arbitrary geometries either in TRIPOLI{sup R} proprietary format or ROOT(4) format. It reads its continuous energy nuclear data from any evaluation in ENDF format, including but not limited to JEFF-3.1.1 and ENDF/BVII.0. It has various simulation modes, fixed-source (with or without fission), criticality, or both of them chained. A variety of tallies are available: averaged flux in a volume (track length and collision estimators), surface flux and current, point flux, reaction rates, deposited energy, dpa, pka, gamma spectroscopy, mesh tallies, tallies for criticality (k{sub eff}, beta eff, kinetic parameters). It provides the user with embedded response functions from IRDF and EAF as well. Several variance reduction techniques (3), including automated ones, make it particularly suitable to deep penetration problems (implicit capture, Russian roulette, exponential biasing with automatic estimation of the importance map). It may run in parallel, on single multi-core machines as well as heterogeneous networks of stations or massively parallel machines. It comes with productivity tools designed to speed-up the elaboration and verification of the input deck as well as the output analysis: 2D interactive display of geometry; 2D display of mesh tallies and collision sites; 3D input deck modeler; compatibility with ROOT tools to post-process TRIPOLI{sup R} outputs. Its V and V test base is made of more than 1000 internationally accepted benchmarks from ICSBEP and SINBAD (REPLICA, ASPIS, NESDIP) and covers all its application domains, including several shielding cases which will be detailed in the talk. TRIPOLI-4{sup R} is the reference Monte Carlo code for CEA, EDF, and also for AREVA for a number of applications. A 'Shielding-only' version has been designed to specifically answer the needs of the shielding community. It is distributed through the NEA Databank with a license for R and D, covering the fusion applications, whose terms are detailed in the paper.

61 RADIATION PROTECTION AND DOSIMETRY↗

Extending deterministic transport capabilities for very-high and ultra-high energy electron beams

Focused Very-High Energy Electron (VHEE, 50–300 MeV) and Ultra-High Energy Electron (UHEE, > 300 MeV) beams can accurately target both large and deeply seated human tumors with high sparing properties, while avoiding the spatial requirements and cost of proton and heavy ion facilities. Advanced testing phases are underway at the CLEAR facilities at CERN (Switzerland), NLCTA at Stanford (USA), and SPARC at INFN (Italy), aiming to accelerate the transition to clinical application. Currently, Monte Carlo (MC) transport is the sole paradigm supporting preclinical trials and imminent clinical deployment. In this paper, we propose an alternative: the first extension of the nuclear-reactor deterministic chain Njoy-Dragon for VHEE and UHEE applications. We have extended the Boltzmann-Fokker-Planck (BFP) multigroup formalism and validated it using standard radio-oncology benchmarks, complex assemblies with a wide range of atomic numbers, and comprehensive irradiation of the entire periodic table. We report that 99% of water voxels exhibit a BFP-MC deviation below 2% for electron energies under 1.5 GeV. Additionally, we demonstrate that at least 97% of voxels of bone, lung, adipose tissue, muscle, soft tissue, tumor, steel, and aluminum meet the same criterion between 50 MeV and 1.5 GeV. For water, the thorax, and the breast intra-operative benchmark, typical average BFP-MC deviations of 0.3% and 0.4% were observed at 300 MeV and 1 GeV, respectively. By irradiating the entire periodic table, we observed similar performance between lithium (Z = 3) and cerium (Z = 58). Deficiencies observed between praseodymium (Z = 59) and einsteinium (Z = 99) have been reported, analyzed, and quantified, offering critical insights for the ongoing development of the Evaluated Nuclear Data File mode in NJOY.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Employee Assistance Program Issues

Employee Assistance Program (EAP) officers, as well as personnel in other disciplines from eight NASA Centers, attended this breakout session. Ms. Brenda Blair, MA, CEAP, a guest speaker at the conference, also attended as a consultant. Representatives from the NASA Centers introduced themselves and spoke briefly about their programs. In a discussion related to the conference theme on benchmarking, quality control issues within the EAP community and adequate documentation of cases were addressed. Disposition and provision for quality assurance checks for EAP providers in single person offices were also discussed. Ms. Blair presented methods for consulting with other NASA personnel in single person EAP offices as a quality control measure. EAP intervention in critical incidents was discussed. The question of whether EAP assistance is an asset or a potential liability in those situations was addressed. Suggestions were made of topics for future EAP video-teleconference topics. A program on EAP ethics was planned for a September video teleconference. Each person was asked to provide intake forms they use to Mr. Gettleman or Ms. Blair. Ms. Blair said she would review the forms to ensure that adequate notification is provided to the client for confidentiality. She would also review them to ensure they have adequate limits of confidentiality--a topic for future video teleconferencing. Mr. Gettleman described the NASA initiative to reduce stresses in the workplace, and the activities of an ad-hoc EAP group that will make recommendations to NASA senior management. Alternative training methods were discussed for reaching target audiences such as employees at risk, supervisors, and others. Pfc. David A. Pendleton, Victim Assistance Coordinator, U.S. Capitol Police. U.S. House of Representatives made a special presentation. Pfc. Pendleton was on duty during the tragic shooting of two Federal guards at the U.S. Capitol. He related the events immediately after the incident. He described the nature and structure of the EAP's and the separate nature of the House and Senate programs. This episode was a particularly difficult situation as large numbers of tourists were involved. William S. Barry, MD, the new Manager of the NASA Occupational Health Program Office was introduced to those attending the breakout session.

Gettleman, Alan G.↗

Malware forensics on mobile devices for DOE-EM applications - 15708

Malware attacks are deployed in order to achieve one of the following goals: To disrupt system functionality; To gather sensitive information; To gain access to private data. The top areas that become primary targets for malware to attack are: Availability, Integrity, Confidentiality. Malware forensics is a particular field where the execution and methods of a malware are studied. Malware activity has increased on unprotected mobile devices. Establishing an accurate and ethical approach is critical when assessing security issues. Knowing the method of execution leads to fewer security risks and prevention of future attacks. Our intentions are not to create a new wave of malware attacks, but to study them and point to possible vulnerabilities that can occur. To create a work-flow for desktop computers, the following benchmarks are used: Using an isolated environment, tracing the host processes, using dynamic analysis to isolate the malware and destroy it. The isolated environment will prevent any malignant code from activating and risking the rest of the computers in the vicinity and/or network. Tracing the host processes, will allow us to read the host and user processes, giving us valuable information on the activities of the device. Using dynamic analysis will allow us to manipulate the malware in a number of ways, such as using a debugger to try and change it. We used a virus and a Trojan to infiltrate a desktop computer for the following reasons: A - The virus will inject itself to force data to connect using a port. B - The Trojan will unlock and grant access to an unauthorized port. With the desktop work-flow in place as a systematic approach for mobile applications, we will investigate how to apply the same methods to the mobile devices. We are currently looking into different ways to develop 'friendly' malware to launch on the Android. We will then try to use malignant Windows malware to infect an Android, and using the work-flow try to come to the same conclusion as with the Android and Desktop, separately.

97 MATHEMATICS AND COMPUTING↗

Monte Carlo N-Particle Transport Performance of Predicting Digital Radiographic IQI Inspection

The identification of porosity, geometric noncompliance, and other defect types are critical to the qualification of materials and components. X-ray radiographic nondestructive testing is a common industrial inspection method for process quality control and component qualification and certification. Digital radiography provides a quick and efficient alternative when compared to traditional film-based inspection. The quality of radiographic inspection is dependent on equipment specifications, such as the source spot size and detector pixel size, and the specific parameters selected for use for the radiographic technique. To evaluate if an x-ray system and technique is sufficient for a given requirement, a radiographic image quality indicator (IQI) can be used. Radiographic IQIs in hard to machine materials or hard to manufacture defects can be time consuming and expensive to manufacture. This study was conducted to evaluate current Savannah River National Laboratory (SRNL) x-ray imaging systems with a custom tantalum IQI and using Monte Carlo simulations to predict the performance of future systems. The tantalum IQI was tested using a Siefert Isovolt 420 keV x-ray tube with a Perkin Elmer XRD 1611 flat panel with 100-micron pixels. Using the Monte Carlo N-Particle transport software, the radiographic tally was used to simulate the photon flux through an identical tantalum IQI. These simulations provided a benchmark as to the best theoretical identification on a given system using our tantalum IQI. The simulations were refined to match SRNL’s current systems’ noise levels, leading to confidence in their ability to predict the performance of other systems that may be purchased and deployed in the future at the Savannah River Site. Future studies will be conducted to prove this research can be extended to artificially evaluate the ability for systems to identify critical defect sizes through x-ray radiographic inspection, drastically reducing the cost and time burdens of producing high-fidelity radiographic test articles.

digital X-ray radiography↗

Bayesian Monte Carlo Evaluation Framework for Imperfect Nuclear Data

Bayesian evaluation of resolved resonance region (RRR) nuclear data has historically been carried out using the generalized least squares (GLS) formalism, as implemented in, e.g., SAMMY. We have recently developed a prototype of Bayesian Monte Carlo (BMC) evaluation framework, implemented using a Markov Chain Monte Carlo (MCMC) method with a Metropolis-Hastings (MH) acceptance criterion. This was done in order to remove the approximations underlying the conventional GLS evaluations, namely, the linear approximation, and the approximation that all probability density functions (PDFs) are of the normal kind. Recent works by others have used similar stochastic approaches to quantify cross section uncertainties from ENDF evaluated co-variances, and/or, from integral benchmark data, but those have not been conceived as an evaluation framework like the one presented here.

97 MATHEMATICS AND COMPUTING↗