Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

ENDF/B-VIII.1

The ENDF/B-VIII.1 release is the newest evaluated nuclear data library produced, distributed, and recommended by CSEWG for use in nuclear science and technology applications. Among the many key advances, relative to the previous version ENDF/B-VIII.0, are: re-evaluation of 239Pu file by a joint international effort; updated 16,18O, 19F, 28-30Si, 50-54Cr, 55Mn, 54,56,57Fe, 63,65Cu, 139La, 233,235,238U, and 240,241Pu neutron nuclear data by the IAEA-coordinated INDEN collaboration; significant changes for 3He, 6Li, 9Be, 51V, 88Sr, 103Rh, 140,142Ce, Dy, 181Ta, Pt, 206-208Pb, and 234,236U neutron data; new nuclear data for the photo-nuclear, being 196 adopted from the IAEA2019 Photonuclear Data Library and one new file from JENDL-5; and new evaluations for the charged-particle and atomic sublibraries. Numerous thermal neutron scattering kernels were re-evaluated or provided for the very first time. Additionally, new covariance testing was implemented. ENDF/B-VIII.1 reduced bias in the simulations of many integral experiments with particular progress noted for fluorine, copper and stainless steel containing benchmarks. Data issues which had hindered the deployment of ENDF/B-VIII.0 for commercial nuclear power applications in high burn-up situations, were addressed. ENDF/B-VIII.1 data are distributed in both ENDF-6 and GNDS formats.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Decomposable Formulation of Transmission Constraints for Decentralized Power Systems Optimization

One of the most complicating factors in decentralized solution methods for a broad range of power system optimization problems is the modeling of power flow equations. Existing formulations for direct current power flows either have limited scalability or are very dense and unstructured, making them unsuitable for large-scale decentralized studies. Here, in this work, we present a novel sparsified variant of the injection shift factors formulation, which has a decomposable block-diagonal structure and scales well for large systems. We also propose a decentralized solution method, based on the alternating direction multiplier method, that efficiently handles transmission line outages in N-1 security requirements. Benchmarks on multizonal security-constrained unit commitment problems show that the proposed formulation and algorithm can reliably and efficiently solve interconnection-level test systems with up to 6,515 buses with no convergence or numerical issues.

Alternating-method of multipliers (ADMM)↗

Milliradian precision ultrafast pulse control for spectral phase metrology

A pulse-shaper-based method for spectral phase measurement and compression with milliradian precision is proposed and tested experimentally. Measurements of chirp and third-order dispersion are performed and compared to theoretical predictions. The single-digit milliradian accuracy is benchmarked by a group velocity dispersion measurement of fused silica.

Stamm, Jacob↗

KOMPASS-II: Compaction of Crushed salt for Safe Containment – Phase 2

Long-term stable sealing elements are a basic component in the safety concept for a possible repository for heat-emitting radioactive waste in rock salt. The sealing elements will be part of the closure concept for drifts and shafts. They will be made from a welldefinied crushed salt in employ a specific manufacturing process. The use of crushed salt as geotechnical barrier as required by the German Site Selection Act from 2017 /STA 17/ represents a paradigm change in the safety function of crushed salt, since this material was formerly only considered as stabilizing backfill for the host rock. The demonstration of the long-term stability and impermeability of crushed salt is crucial for its use as a geotechnical barrier. The KOMPASS-II project, is a follow-up of the KOMPASS-I project and continues the work with focus on improving the understanding of the thermal-hydraulic-mechanical (THM) coupled processes in crushed salt compaction with the objective to enhance the scientific competence for using crushed salt for the long-term isolation of high-level nuclear waste within rock salt repositories. The project strives for an adequate characterization of the compaction process and the essential influencing parameters, as well as a robust and reliable long-term prognosis using validated constitutive models. For this purpose, experimental studies on long-term compaction tests are combined with microstructural investigations and numerical modeling. The long-term compaction tests in this project focused on the effect of mean stress, deviatoric stress and temperature on the compaction behavior of crushed salt. A laboratory benchmark was performed identifying a variability in compaction behavior. Microstructural investigations were executed with the objective to characterize the influence of pre-compaction procedure, humidity content and grain size/grain size distribution on the overall compaction process of crushed salt with respect to the deformation mechanisms. The created database was used for benchmark calculations aiming for improvement and optimization of a large number of constitutive models available for crushed salt. The models were calibrated, and the improvement process was made visible applying the virtual demonstrator.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NAS Parallel Benchmarks, Multi-Zone Versions

We describe an extension of the NAS Parallel Benchmarks (NPB) suite that involves solving the application benchmarks LU, BT and SP on collections of loosely coupled discretization meshes. The solutions on the meshes are updated independently, but after each time step they exchange boundary value information. This strategy, which is common among structured-mesh production flow solver codes in use at NASA Ames and elsewhere, provides relatively easily exploitable coarse-grain parallelism between meshes. Since the individual application benchmarks also allow fine-grain parallelism themselves, this NPB extension, named NPB Multi-Zone (NPB-MZ), is a good candidate for testing hybrid and multi-level parallelization tools and strategies.

vanderWijngaart, Rob F.↗

Asymmetric Base-Bleed Effect on Aerospike Plume-Induced Base-Heating Environment During Power-Pack Out

A computational heat transfer design methodology was developed to study tbe dual-engine linear aerospike plume-induced base-heating environment during one power-pack out, in ascent flight. It includes a three-dimensional, finite volume, viscous, chemically reacting, and pressure-based computational fluid dynamics formulation, a special base-bleed boundary condition, and a three-dimensional, finite volume, and spectral-line-based weighted-sum-of-gray-gases absorption computational radiation heat transfer formulation. A separate radiation model was used for diagnostic purposes. The computational methodology was systematically benchmarked. in this study, near-base radiative heat fluxes were computed, and they compared well with those measured during static linear aerospike engine tests. The base-heating environment of 18 trajectory points secected from three power-pack out scenarios was computed. The computed asymmetric base-heating physics were analyzed. The power-pack out condition has the most impact on convective base heating when it happens early in flight. The soume of its impact comes from the asymmetric and reduced base bleed.

Wang, Ten-See↗

Asymmetric Base-Bleed Effect on Aerospike Plume-Induced Base-Heating Environment

A computational heat transfer design methodology was developed to study the dual-engine linear aerospike plume-induced base-heating environment during one power-pack out, in ascent flight. It includes a three-dimensional, finite volume, viscous, chemically reacting, and pressure-based computational fluid dynamics formulation, a special base-bleed boundary condition, and a three-dimensional, finite volume, and spectral-line-based weighted-sum-of-gray-gases absorption computational radiation heat transfer formulation. A separate radiation model was used for diagnostic purposes. The computational methodology was systematically benchmarked. In this study, near-base radiative heat fluxes were computed, and they compared well with those measured during static linear aerospike engine tests. The base-heating environment of 18 trajectory points selected from three power-pack out scenarios was computed. The computed asymmetric base-heating physics were analyzed. The power-pack out condition has the most impact on convective base heating when it happens early in flight. The source of its impact comes from the asymmetric and reduced base bleed.

Wang, Ten-See↗

Fundamental Test of a Hovering Rotor: Comprehensive Measurements for CFD Validation

A model-scale hover test of a 4-bladed, 11.08-ft diameter rotor was recently completed inside the National Full-Scale Aerodynamics Complex 80- by 120-Foot Wind Tunnel test section. The primary objective of the test was to acquire key experimental data for a hovering rotor of sufficient quality and quantity to allow validation of state-of-the-art analysis codes. A comprehensive measurement set has been acquired, including rotor performance, blade airloads, flow transition locations, blade deflections, and wake geometry for a range of tip Mach numbers and collective settings. The present paper provides an overview of the test, including detailed descriptions of the hardware, instrumentation, and measurement systems. In addition, the specific test objectives, approach, and sample results are presented. The full test database, as well as detailed rotor geometry information, will ultimately be shared openly on a NASA-sponsored website to serve as a benchmark validation dataset.

Hover↗

NASA Software Engineering Benchmarking Study

To identify best practices for the improvement of software engineering on projects, NASA's Offices of Chief Engineer (OCE) and Safety and Mission Assurance (OSMA) formed a team led by Heather Rarick and Sally Godfrey to conduct this benchmarking study. The primary goals of the study are to identify best practices that: Improve the management and technical development of software intensive systems; Have a track record of successful deployment by aerospace industries, universities [including research and development (R&D) laboratories], and defense services, as well as NASA's own component Centers; and Identify candidate solutions for NASA's software issues. Beginning in the late fall of 2010, focus topics were chosen and interview questions were developed, based on the NASA top software challenges. Between February 2011 and November 2011, the Benchmark Team interviewed a total of 18 organizations, consisting of five NASA Centers, five industry organizations, four defense services organizations, and four university or university R and D laboratory organizations. A software assurance representative also participated in each of the interviews to focus on assurance and software safety best practices. Interviewees provided a wealth of information on each topic area that included: software policy, software acquisition, software assurance, testing, training, maintaining rigor in small projects, metrics, and use of the Capability Maturity Model Integration (CMMI) framework, as well as a number of special topics that came up in the discussions. NASA's software engineering practices compared favorably with the external organizations in most benchmark areas, but in every topic, there were ways in which NASA could improve its practices. Compared to defense services organizations and some of the industry organizations, one of NASA's notable weaknesses involved communication with contractors regarding its policies and requirements for acquired software. One of NASA's strengths was its software assurance practices, which seemed to rate well in comparison to the other organizational groups and also seemed to include a larger scope of activities. An unexpected benefit of the software benchmarking study was the identification of many opportunities for collaboration in areas including metrics, training, sharing of CMMI experiences and resources such as instructors and CMMI Lead Appraisers, and even sharing of assets such as documented processes. A further unexpected benefit of the study was the feedback on NASA practices that was received from some of the organizations interviewed. From that feedback, other potential areas where NASA could improve were highlighted, such as accuracy of software cost estimation and budgetary practices. The detailed report contains discussion of the practices noted in each of the topic areas, as well as a summary of observations and recommendations from each of the topic areas. The resulting 24 recommendations from the topic areas were then consolidated to eliminate duplication and culled into a set of 14 suggested actionable recommendations. This final set of actionable recommendations, listed below, are items that can be implemented to improve NASA's software engineering practices and to help address many of the items that were listed in the NASA top software engineering issues. 1. Develop and implement standard contract language for software procurements. 2. Advance accurate and trusted software cost estimates for both procured and in-house software and improve the capture of actual cost data to facilitate further improvements. 3. Establish a consistent set of objectives and expectations, specifically types of metrics at the Agency level, so key trends and models can be identified and used to continuously improve software processes and each software development effort. 4. Maintain the CMMI Maturity Level requirement for critical NASA projects and use CMMI to measure organizations developing software for NASA. 5.onsolidate, collect and, if needed, develop common processes principles and other assets across the Agency in order to provide more consistency in software development and acquisition practices and to reduce the overall cost of maintaining or increasing current NASA CMMI maturity levels. 6. Provide additional support for small projects that includes: (a) guidance for appropriate tailoring of requirements for small projects, (b) availability of suitable tools, including support tool set-up and training, and (c) training for small project personnel, assurance personnel and technical authorities on the acceptable options for tailoring requirements and performing assurance on small projects. 7. Develop software training classes for the more experienced software engineers using on-line training, videos, or small separate modules of training that can be accommodated as needed throughout a project. 8. Create guidelines to structure non-classroom training opportunities such as mentoring, peer reviews, lessons learned sessions, and on-the-job training. 9. Develop a set of predictive software defect data and a process for assessing software testing metric data against it. 10. Assess Agency-wide licenses for commonly used software tools. 11. Fill the knowledge gap in common software engineering practices for new hires and co-ops.12. Work through the Science, Technology, Engineering and Mathematics (STEM) program with universities in strengthening education in the use of common software engineering practices and standards. 13. Follow up this benchmark study with a deeper look into what both internal and external organizations perceive as the scope of software assurance, the value they expect to obtain from it, and the shortcomings they experience in the current practice. 14. Continue interactions with external software engineering environment through collaborations, knowledge sharing, and benchmarking.

Rarick, Heather L.↗

Progress Update on the MUSIC Critical Benchmark

The Measurement of Uranium Subcritical and Critical (MUSiC) experiment was carried out from December 2020 through April 2021 at the National Criticality Experiments Research Center (NCERC). This measurement campaign featured bare configurations of the Rocky Flats highly-enriched uranium (HEU) shells, with each configuration having different numbers of these shells. The goal of the experiment was to test multiple neutron multiplicity detectors and measurement methods for a large range of neutron multiplication values. The large range of multiplications allows researchers to see when the combination of detectors and methods break down as the configurations reach the delayed supercritical window. The critical configurations were the extreme end of the multiplication range in MUSIC configurations. A critical benchmark in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook is planned to help further validate nuclear data. Even though there are many benchmarks focusing on the fast spectrum for highly-enriched uranium, an additional benchmark that is well documented and up to the modern standard of the handbook would be a welcome addition. Given that there are no other materials such as moderators or significant reflectors, and its similarity to Lady Godiva, it is possible that this could be very useful for validation of 235 U nuclear data in the future.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Benchmarking state-of-the-art theory and empirical models of pionless neutrino-argon scattering in GENIE

Upcoming experiments need improved simulations of neutrino scattering. This work uses the popular GENIE event generator to test a variety of neutrino interaction models against recent MicroBooNE measurements of pionless charged-current interactions. The GENIE code can easily interchange model components, including nucleon form factor parameterizations, quasielastic cross-section calculations, treatments of the nuclear ground state and hadronic final-state interactions. Leveraging this software capability in comparisons with MicroBooNE data, the performance of some of GENIE’s most theoretically sophisticated model components is evaluated and contrasted with more empirically-driven alternatives.

Neutrino cross section↗

Group structure selection with random forests

Choosing an appropriate group structure for multigroup transport is far from an exact science. For some applications, one blindly uses a group structure developed years ago by forgotten methods. Furthermore, one sometimes uses the same group structure for a variety of problems, even if the group structure was originally developed with a certain application in mind. In this work, we create optimized group structures with simulated annealing for critical assembly test problems and apply a random forest regressor with bagging to choose the best group structure based on parameters of the different test problems. The optimized group structures were generated using a simulated annealing optimizer for several simple, spherical, and unreflected problems. The optimization was performed to minimize a cost function that included fission rate, absorption rate, leakage, and k{sub eff}. A random forest regressor was then trained on a set of International Criticality Safety Benchmark Evaluation Project inputs and used to select one of these six group structures. The trained machine learning model chose the best group structure 65% of the time, and one of the three best 89% of the time. Furthermore, it decreased the L2 error over all test problems by a factor of 25 when compared to the standard Los Alamos 70-group structure. In other words, the model chose group structure that were far more appropriate for the test problems than the traditional LANL group structure. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Muonic force behind flavor anomalies

We develop an economical theoretical framework for combined explanations of the flavor physics anomalies involving muons: (g - 2) μ , R K(*), and b → sμ + μ - angular distributions and branching ratios, that was first initiated by some of us in ref. [1]. The Standard Model (SM) is supplemented with a lepton-flavored U(1) X gauge group. The U(1) X gauge boson with the mass of O(0.1) GeV resolves the (g - 2) μ tension. A TeV-scale leptoquark, charged under the U(1) X , carries a muon number and mediates B-decays without prompting charged lepton flavor violation or inducing proton decay. We explore the theory space of the chiral, anomaly-free U(1) X gauge extensions featuring the above scenario, and identify many suitable charge assignments for the SM+3ν R fermion content with the integer charges in the range X F i $\in$ [-10, 10]. We then carry out a comprehensive phenomenological study of the muonic force in representative benchmark models. Interestingly, we found models which can resolve the tension without conflicting the complementary constraints, and all of the viable parameter space will be tested in future muonic resonance searches. Finally, the catalog of the anomaly-free lepton-non-universal charge assignments motivated us to explore different directions in model building. We present a model in which the muon mass and the (g - 2) μ are generated radiatively from a common short-distance dynamics after the U(1) X breaking. We also show how to charge a vector leptoquark under U(1) μ-τ in a complete gauge model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Benchmarking graph neural networks for materials chemistry

Graph neural networks (GNNs) have received intense interest as a rapidly expanding class of machine learning models remarkably well-suited for materials applications. To date, a number of successful GNNs have been proposed and demonstrated for systems ranging from crystal stability to electronic property prediction and to surface chemistry and heterogeneous catalysis. However, a consistent benchmark of these models remains lacking, hindering the development and consistent evaluation of new models in the materials field. Here, we present a workflow and testing platform, MatDeepLearn, for quickly and reproducibly assessing and comparing GNNs and other machine learning models. We use this platform to optimize and evaluate a selection of top performing GNNs on several representative datasets in computational materials chemistry. From our investigations we note the importance of hyperparameter selection and find roughly similar performances for the top models once optimized. We identify several strengths in GNNs over conventional models in cases with compositionally diverse datasets and in its overall flexibility with respect to inputs, due to learned rather than defined representations. Meanwhile several weaknesses of GNNs are also observed including high data requirements, and suggestions for further improvement for applications in materials chemistry are discussed.

36 MATERIALS SCIENCE↗

Platform for probing radiation transport properties of hydrogen at conditions found in the deep interiors of red dwarfs

We describe an experimental concept at the National Ignition Facility for specifically tailored spherical implosions to compress hydrogen to extreme densities (up to ∼800× solid density, electron number density ne∼4×1025 cm−3) at moderate temperatures (T∼200 eV), i.e., to conditions, which are relevant to the interiors of red dwarf stars. The dense plasma will be probed by laser-generated x-ray radiation of different photon energy to determine the plasma opacity due to collisional (free–free) absorption and Thomson scattering. The obtained results will benchmark radiation transport models, which in the case for free–free absorption show strong deviations at conditions relevant to red dwarfs. This very first experimental test of free–free opacity models at these extreme states will help to constrain where inside those celestial objects energy transport is dominated by radiation or convection. Moreover, our study will inform models for other important processes in dense plasmas, which are based on electron–ion collisions, e.g., stopping of swift ions or electron–ion temperature relaxation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Development and Evaluation of a Cost-Effective Behind-the-Meter Synchronized Measurement Unit for Enhanced Grid Integration

This paper presents the development of the Inverter Based Resource Monitor (IBRM), an innovative behind-the-meter synchronized measurement unit (SMU) tailored for integration with inverter-based resources (IBRs). The IBRM distinguishes itself as a highly accurate and cost-effective SMU, offering facile deployment and connectivity to IBRs. It is equipped to conduct real-time voltage and current waveform analyses, serving as a phasor measurement unit (PMU) with exceptionally rapid synchrophasor transmission capabilities. The device incorporates a cutting-edge dual-core architecture designed to minimize sampling delays inherent to its microprocessor, thereby enhancing the precision of synchronized waveform measurements. Moreover, the IBRM is adept at recording high-fidelity waveform data, capturing nuances such as waveform distortions, high-order harmonics, and wide-band oscillations prevalent in power grids with substantial IBR presence. A prototype of the IBRM has been constructed and subjected to rigorous testing to assess its functional capabilities and measurement precision, utilizing both idealized signal generators and a real-world off-grid inverter setup as benchmarks.

Wu, Ori [ORNL] (ORCID:0000000326723410)↗

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗

Optimal gas cooling with minimal aero-opticaldistortion for next generation high-average-power lasers (Progress report, Year 2)

Next-generation lasers that combine high-peak-power ultrashort pulses with high repetition rates have the potential to efficiently deliver the high-average-power outputs required for inertial fusion energy generation, laser-based particle acceleration, and to generate compact secondary x- and 𝛾-ray radiation sources, among others. The combination of long gain length with high surface-to-volume ratio to remove residual heat makes gas-cooled multi-slab amplifier heads an inherently aperture- and average power scalable technology that enables this new class of solid-state lasers, and their thermal management becomes the most pressing technical challenge. As the index-of refraction depends on the gas density, heat removal from the slab surfaces unavoidably entails scattering of propagated light from regions of high temperature fluctuations. The requirement to maximize convective heat extraction from the gain medium under the constraint of minimum optical aberration of the beam renders amplifier slab cooling a technological challenge at the intersection of aero-optics, fluid-mechanics and heat transfer. The goal of this research is to leverage computational fluid dynamics and aero optics simulations of different levels of fidelity to devise a numerical modeling and optimization framework for gas-cooled multi-slab amplifiers. The project will be conducted in close collaboration with the Advanced Photon Technologies Group at Lawrence Livermore National Laboratory, where a gas-cooled test stand for laser materials and thermal management structures will be developed and installed. The final goal of the collaborative effort is to manufacture and benchmark a physical prototype of an numerically optimized amplifier head design. Measurement data on solid-state and thermo-optical distortions will be used for the validation of the numerical models. The key technical challenge in this multi-objective design problem is that of balancing optimal heat removal with minimal optical distortion. To facilitate computationally efficient design optimization and, at the same time, deepen our basic understanding of the interaction of light with turbulence, a complementary study that combines high and low-fidelity flow simulations and aero-optical models is proposed. Along the lines of these two objectives and solution strategies, the project is organized into two thrusts.

42 ENGINEERING↗