Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Classifying multispectral data by neural networks

Several energy functions for synthesizing neural networks are tested on 2-D synthetic data and on Landsat-4 Thematic Mapper data. These new energy functions, designed specifically for minimizing misclassification error, in some cases yield significant improvements in classification accuracy over the standard least mean squares energy function. In addition to operating on networks with one output unit per class, a new energy function is tested for binary encoded outputs, which result in smaller network sizes. The Thematic Mapper data (four bands were used) is classified on a single pixel basis, to provide a starting benchmark against which further improvements will be measured. Improvements are underway to make use of both subpixel and superpixel (i.e. contextual or neighborhood) information in tile processing. For single pixel classification, the best neural network result is 78.7 percent, compared with 71.7 percent for a classical nearest neighbor classifier. The 78.7 percent result also improves on several earlier neural network results on this data.

Telfer, Brian A.↗
NASA NTRS2001

A Step Response Based Mixed-Signal BIST Approach

A new Mixed-Signal Built-in Self-test approach that is based upon the step response of a reconfigurable (or multifunction) analog block is presented in this paper. The technique requires the overlapping step response of the Circuit Under Test (CUT) for two circuit configurations. Each configuration can be realized by changing the topology of the CUT or by sampling two CUT nodes with differing step responses. The technique can effectively detect both soft and hard faults and does not require an analog-to-digital converter (ADC) and/or digital-to-analog converter( DAC). It also does not require any precision voltage sources or comparators. The approach does not require any additional analog circuits to realize the test signal generator and a two input analog multiplexer for CUT test node sampling. The paper is concluded with the application of the proposed approach to a circuit found in the work of Epstein et a1 and two ITC 97 analog benchmark circuits.

Walker, Alvernon↗
NASA NTRS2005

Experimental Results from the Active Aeroelastic Wing Wind Tunnel Test Program

The Active Aeroelastic Wing (AAW) program is a cooperative effort among NASA, the Air Force Research Laboratory and the Boeing Company, encompassing flight testing, wind tunnel testing and analyses. The objective of the AAW program is to investigate the improvements that can be realized by exploiting aeroelastic characteristics, rather than viewing them as a detriment to vehicle performance and stability. To meet this objective, a wind tunnel model was crafted to duplicate the static aeroelastic behavior of the AAW flight vehicle. The model was tested in the NASA Langley Transonic Dynamics Tunnel in July and August 2004. The wind tunnel investigation served the program goal in three ways. First, the wind tunnel provided a benchmark for comparison with the flight vehicle and various levels of theoretical analyses. Second, it provided detailed insight highlighting the effects of individual parameters upon the aeroelastic response of the AAW vehicle. This parameter identification can then be used for future aeroelastic vehicle design guidance. Third, it provided data to validate scaling laws and their applicability with respect to statically scaled aeroelastic models.

Heeg, Jennifer↗
NASA NTRS2009

A Combination of Traditional and Novel Methods Used to Evaluate the Impact of an EVA Glove on Hand Performance

The gloved hand is an astronaut s primary means of interacting with the environment, so performance on an EVA is strongly impacted by any restrictions imposed by the glove. As a result, these restrictions have been the subject of study for decades. However, previous studies have generally been unsuccessful in quantifying glove mobility and tactility. Instead, studies have tended to focus on the dexterity, strength and functional performance of the gloved hand. Therefore, it has been difficult to judge the impact of each type of restriction on the glove s overall capability. The lack of basic information on glove mobility in particular, is related to the difficulty in instrumenting a gloved hand to allow an accurate evaluation. However, the current study aims at developing novel technological capabilities to provide metrics for mobility and tactility that can be used to assess the performance of a glove in a way that could enable designers and engineers to improve upon their current designs. A series of evaluations were performed in ungloved, unpressurized and pressurized (4.3 psi) conditions, to allow a comparison across pressures and to the baseline barehanded condition. In addition, a subset of the testing was also performed with the Thermal Micrometeoroid Garment (TMG) removed. This test case in particular provided some interesting insight into how much of an impact the TMG has on gloved mobility -- in some cases, as much as pressurization of the glove. Previous rule-of-thumb estimates had assumed that the TMG would have a much lower impact on mobility, while these results suggest that an improvement in the TMG could actually have a significant impact on glove performance. Similarly, tactility testing illustrated the impact of glove pressurization on tactility and provided insight on the design of interfaces to the glove. The metrics described in this paper have been used to benchmark the Phase VI EVA glove and to develop requirements for the next generation glove for the Constellation program.

Rajulu, Sudhakar↗
DOE OSTI2024

Investigating sol–gel matrix loading capacity toward producing surrogate nuclear explosive debris with realistic composition

Post detonation nuclear forensic materials which resemble the size, color, elemental composition, and radionuclide content of real nuclear debris would be valuable for developing and validating new nuclear forensic techniques. As nuclear fallout types vary significantly, the ability to tailor each of these parameters accurately is desired to produce materials capable of testing analytical methods under a wide array of forensic scenarios. Sol–gel synthesis techniques can provide tunability of size, shape and composition for producing a wide variety of solid nuclear forensics benchmarking materials. Further, the sol–gel process consists of forming a metal oxide material, often silica, through polymerization of a metal-alkoxy precursor. In this work, we characterize the ability to load sol–gel particles with secondary elemental components such as iron, aluminum, and calcium toward producing benchmarking materials approximating the elemental composition of historic nuclear debris from the Nevada National Security Site. We also demonstrate quantitative radionuclide encapsulation toward producing benchmarking materials with controllable radionuclide content. Finally, we employ these techniques to produce nuclear debris benchmarking materials with controllable elemental matrix composition and radionuclide content and compare these samples with the composition of a historic fallout sample previously reported from the Nevada National Security Site.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Hydrogen Production System Scaling Using a High-Fidelity Simulation-Optimization Framework

Proton exchange membrane (PEM) electrolyzers are widely used for hydrogen production, yet few validated, high-fidelity tools can reliably guide scale-up. Using measured performance from a 50-hour hardware-in-the-loop pilot test, a physics-based, plant-level model of a 1.25 MW PEM electrolyzer and its balance-of-plant (BoP) subsystems is developed and validated. The model couples electrochemistry and thermal/flow submodels and is calibrated against pilot test data via a genetic algorithm (GA) workflow. Validation yields a mean absolute percentage error (APE) of 0.43% for cell voltage and stack power. Two scale-out strategies are then benchmarked under a common 7-day wind-and-photovoltaic (PV) profile: (i) linear duplication of 1.25 MW blocks and (ii) shared-BoP architectures. Sharing BoP between stacks reduces BoP energy by 27% at 10 MW and 34% at 100 MW (vs. linear duplication) and improves system specific energy consumption (SEC) to 52.9 and 52.6 kWh/kg, respectively (from 54.0 kWh/kg with linear duplication). Partial-load studies (25-100% set-point) show that cumulative hydrogen production remains nearly constant down to 50% load because all cases use the same weekly renewable-energy input. Below 50%, the power cap limits how much energy can be used within 168 h, which reduces hydrogen output. The model further indicates that the practical operating optimum lies between 50% and 85% load, where efficiency gains begin to appear without significant loss in hydrogen output. Moreover, the efficiency gains at lower loads are offset by reduced production. The validated framework supports scenario-based engineering trade-off studies for large configurations (10-100 MW) and for operating policies under variable renewables.

08 HYDROGEN↗
DOE OSTI2021

Benchmarking blockchain-based gene-drug interaction data sharing methods: A case study from the iDASH 2019 secure genome analysis competition blockchain track

Blockchain distributed ledger technology is just starting to be adopted in genomics and healthcare applications. Despite its increased prevalence in biomedical research applications, skepticism regarding the practicality of blockchain technology for real-world problems is still strong and there are few implementations beyond proof-of-concept. We focus on benchmarking blockchain strategies applied to distributed methods for sharing records of gene-drug interactions. We expect this type of sharing will expedite personalized medicine. We generated gene-drug interaction test datasets using the Clinical Pharmacogenetics Implementation Consortium (CPIC) resource. We developed three blockchain-based methods to share patient records on gene-drug interactions: Query Index, Index Everything, and Dual-Scenario Indexing. We achieved a runtime of about 60 s for importing 4,000 gene-drug interaction records from four sites, and about 0.5 s for a data retrieval query. Our results demonstrated that it is feasible to leverage blockchain as a new platform to share data among institutions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Accelerated cryo-EM-guided determination of three-dimensional RNA-only structures

The discovery and design of biologically important RNA molecules is outpacing three-dimensional structural characterization. In this work, we demonstrate that cryo-electron microscopy can routinely resolve maps of RNA-only systems and that these maps enable subnanometer-resolution coordinate estimation when complemented with multidimensional chemical mapping and Rosetta DRRAFTER computational modeling. Furthermore ,this hybrid ‘Ribosolve’ pipeline detects and falsifies homologies and conformational rearrangements in 11 previously unknown 119- to 338-nucleotide protein-free RNA structures: full-length Tetrahymena ribozyme, hc16 ligase with and without substrate, full-length Vibrio cholerae and Fusobacterium nucleatum glycine riboswitch aptamers with and without glycine, Mycobacterium SAM-IV riboswitch with and without S-adenosylmethionine, and the computer-designed ATP-TTR-3 aptamer with and without AMP. Simulation benchmarks, blind challenges, compensatory mutagenesis, cross-RNA homologies and internal controls demonstrate that Ribosolve can accurately resolve the global architectures of RNA molecules but does not resolve atomic details. These tests offer guidelines for making inferences in future RNA structural studies with similarly accelerated throughput.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Fast correlation function calculator: A high-performance pair-counting toolkit

A novel high-performance exact pair-counting toolkit called fast correlation function calculator (FCFC) is presented. With the rapid growth of modern cosmological datasets, the evaluation of correlation functions with observational and simulation catalogues has become a challenge. High-efficiency pair-counting codes are thus in great demand. We introduce different data structures and algorithms that can be used for pair-counting problems, and perform comprehensive benchmarks to identify the most efficient algorithms for real-world cosmological applications. We then describe the three levels of parallelisms used by FCFC, SIMD, OpenMP, and MPI, and run extensive tests to investigate the scalabilities. Finally, we compare the efficiency of FCFC with alternative pair-counting codes. The data structures and histogram update algorithms implemented in FCFC are shown to outperform alternative methods. FCFC does not benefit greatly from SIMD because the bottleneck of our histogram update algorithm is mainly cache latency. Nevertheless, the efficiency of FCFC scales well with the numbers of OpenMP threads and MPI processes, even though speedups may be degraded with over a few thousand threads in total. FCFC is found to be faster than most (if not all) other public pair-counting codes for modern cosmological pair-counting applications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

I/O performance studies of analysis workloads on production and dedicated resources at CERN

The recent evolutions of the analysis frameworks and physics data formats of the LHC experiments provide the opportunity of using central analysis facilities with a strong focus on interactivity and short turnaround times, to complement the more common distributed analysis on the Grid. In order to plan for such facilities, it is essential to know in detail the performance of the combination of a given analysis framework, of a specific analysis and of the installed computing and storage resources. This contribution describes performance studies performed at CERN, using the EOS disk-based storage, either directly or through an XCache instance, from both batch resources and highperformance compute nodes which could be used to build an analysis facility. A variety of benchmarks, both synthetic and based on real-world physics analyses and their corresponding input datasets, are utilized. In particular, the RNTuple format from the ROOT project is put to the test and compared to the latest version of the TTree format, and the impact of caches is assessed. In addition, we assessed the difference in performance between the use of storage system specific protocols, like XRootd, and FUSE. The results of this study are intended to be a valuable input in the design of analysis facilities, at CERN and elsewhere.

Sciabà, Andrea↗
DOE OSTI2020

Ground-state properties of the Hubbard model in one and two dimensions from the Gutzwiller conjugate gradient minimization theory

We introduce Gutzwiller conjugate gradient minimization (GCGM) theory, an ab initio quantum many-body theory for computing the ground-state properties of infinite systems. GCGM uses the Gutzwiller wave function but does not use the commonly adopted Gutzwiller approximation (GA), which is a major source of inaccuracy. Instead, the theory uses an approximation that is based on the occupation probability of the on-site configurations, rather than approximations that decouple the site-site correlations as used in the GA. We test the theory in the one-dimensional and two-dimensional Hubbard models at various electron densities and find that GCGM reproduces energies and double occupancies in reasonable agreement with benchmark data at a very small computational cost.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Coupling between collective modes in the deformed 98 Zr nucleus: Insights from consistent HFB + QRPA calculations with the Gogny interaction

The zirconium isotopes exhibit structural properties that present multiple challenges to nuclear theory. Investigations of the coupling present within isoscalar modes and within isovector modes are scarce but important for advancing our understanding of the microscopic picture of nuclei. To explore some of these underlying coupling features, and to test the predictive power of a state-of-the-art nuclear structure approach, we provide a detailed analysis of the properties of 90,96,98 Zr . This region includes a benchmarking case and offers insights into nuclear deformation phenomena. Here, to investigate the coupling between collective modes in deformed nuclei, we focused our analysis on the ground and excited-state properties of these isotopes, employing a consistent approach with the axially symmetric deformed Hartree-Fock-Bogoliubov (HFB) and the quasiparticle random phase approximation (QRPA) framework, both using the Gogny D1M force. This approach effectively describes both low-lying and giant-resonance states. We devoted special attention to the deformed 98 Zr nucleus, where we confirm the existence of coupling between monopole and quadrupole excitations through the 𝐾 𝜋 = 0 + QRPA components and demonstrate an analogous dipole-octupole coupling through the 𝐾 𝜋 = 0 − and 𝐾 𝜋 = 1 − components. Intrinsic transition densities and associated radial projections illustrate the coupling. Our work complements and extends earlier studies carried out using density-functional-based methods and notably, we included the complete Coulomb interaction also in the pairing fields, i.e., we treat terms exactly that are approximated in typical calculations that use the Gogny D1 and D2 interaction families.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Effects of error, chimera, bias, and GC content on the accuracy of amplicon sequencing

ABSTRACT Targeted amplicon sequencing is widely used in microbial ecology studies. However, sequencing artifacts and amplification biases are of great concern. To identify sources of these artifacts, a systematic analysis was performed using mock communities comprised of 16S rRNA genes from 33 bacterial strains. Our results indicated that while sequencing errors were generally isolated to low-abundance operational taxonomic units, chimeric sequences were a major source of artifacts. Singleton and doubleton sequences were primarily chimeras. Formation of chimeric sequences was significantly correlated with the GC content of the targeted sequences. Low-GC-content mock community members exhibited lower rates of chimeric sequence formation. GC content also had a large impact on sequence recovery. The quantitative capacity was notably limited, with substantial recovery variations and weak correlation between anticipated and observed strain abundances. The mock community strains with higher GC content had higher recovery rates than strains with lower GC content. Amplification bias was also observed due to the differences in primer affinity. A two-step PCR strategy reduced the number of chimeric sequences by half. In addition, comparative analyses based on the mock communities showed that several widely used sequence processing pipelines/methods, including DADA2, Deblur, UCLUST, UNOISE, and UPARSE, had different advantages and disadvantages in artifact removal and rare species detection. These results are important for improving sequencing quality and reliability and developing new algorithms to process targeted amplicon sequences. IMPORTANCE Amplicon sequencing of targeted genes is the predominant approach to estimate the membership and structure of microbial communities. However, accurate reconstruction of community composition is difficult due to sequencing errors, and other methodological biases and effective approaches to overcome these challenges are essential. Using a mock community of 33 phylogenetically diverse strains, this study evaluated the effect of GC content on sequencing results and tested different approaches to improve overall sequencing accuracy while characterizing the pros and cons of popular amplicon sequence data processing approaches. The sequencing results from this study can serve as a benchmarking data set for future algorithmic improvements. Furthermore, the new insights on sequencing error, chimera formation, and GC bias from this study will help enhance the quality of amplicon sequencing studies and support the development of new data analysis approaches.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Coupling between collective modes in the deformed 98 Zr nucleus: Insights from consistent HFB+QRPA calculations with the Gogny interaction

The Zirconium isotopes exhibit structural properties that present multiple challenges to nuclear theory. Investigations of the coupling present within isoscalar modes and within isovector modes are scarce but important for advancing our understanding of the microscopic picture of nuclei. To explore some of these underlying coupling features, and to test the predictive power of a state-of the-art nuclear structure approach, we provide a detailed analysis of the properties of 90,96,98Zr. This region includes a benchmarking case and offers insights into nuclear deformation phenomena. To investigate the coupling between collective modes in deformed nuclei, we focused our analysis on the ground and excited-state properties of these isotopes, employing a consistent approach with the axially-symmetric deformed Hartree-Fock-Bogoliubov (HFB) and the Quasiparticle Random Phase Approximation (QRPA) framework, both using the Gogny D1M force. This approach effectively describes both low-lying and giant-resonance states. We devoted special attention to the deformed 98Zr nucleus, where we confirm the existence of coupling between monopole and quadrupole excitations through the K π = 0 + QRPA components and demonstrate an analogous dipole-octupole coupling through the K π = 0 − and K π = 1 − components. Intrinsic transition densities and associ ated radial projections illustrate the coupling. Our work complements and extends earlier studies carried out using density-functional-based methods and notably, we included the complete Coulomb interaction also in the pairing fields, i.e. we treat terms exactly that are approximated in typical calculations that use the Gogny D1 and D2 interaction families.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Additively manufacturing high-temperature aluminum alloy for automotive engine pistons

The purpose of the project was to evaluate DuAlumin-3D, an ORNL designed Al alloy, for additive manufacturing of high-performance automotive components. The project consisted of additively manufacturing a cylindrical block of representative material which was then heat treated before machining into test coupons. Testing included tensile tests as a function of temperature, high-cycle fatigue testing as a function of temperature, density and elastic modulus measurements, and thermophysical property measurements. Fractography was also performed on failed high-cycle fatigue specimens. The results were compared against benchmark AM Al alloys and current high-performance conventionally manufactured alloys. Overall, the DuAlumin-3D material outperformed the incumbent materials in mechanical properties, especially at elevated temperatures, while maintaining broadly similar thermophysical properties. The results of this study support further maturation of the material for additive manufacturing of high-performance automotive components.

36 MATERIALS SCIENCE↗
DOE OSTI2026

GenASiS: General Astrophysical Simulation System. II. Self-gravitating Baryonic Matter*

GenASiS (General Astrophysical Simulation System) is a code being developed initially and primarily, though not exclusively, for the simulation of core-collapse supernovae on the world's leading capability supercomputers. This paper---the second in a series---documents capabilities for Newtonian self-gravitating fluid dynamics, including tabulated microphysical equations of state treating nuclei and nuclear matter (`baryonic matter'). Computation of the gravitational potential of a spheroid, and simulation of the gravitational collapse of dust and of an ideal fluid, provide tests of self-gravitation against known solutions. In multidimensional computations of the adiabatic collapse, bounce, and explosion of spherically symmetric pre-supernova progenitors---which we propose become a standard benchmark for code comparisons---we find that the explosions are prompt and remain spherically symmetric (as expected), with an average shock expansion speed and total kinetic energy that are inversely correlated with the progenitor mass at the onset of collapse and the compactness parameter.

Cardall, Christian [ORNL] (ORCID:000000020086105X)↗
NASA NTRS1993

Computational Fluid Dynamics (CFD) applications in rocket propulsion analysis and design

Computational Fluid Dynamics (CFD) has been used in recent applications to affect subcomponent designs in liquid propulsion rocket engines. This paper elucidates three such applications for turbine stage, pump stage, and combustor chamber geometries. Details of these applications include the development of a high turning airfoil for a gas generator (GG) powered, liquid oxygen (LOX) turbopump, single-stage turbine using CFD as an integral part of the design process. CFD application to pump stage design has emphasized analysis of inducers, impellers, and diffuser/volute sections. Improvements in pump stage impeller discharge flow uniformity have been seen through CFD optimization on coarse grid models. In the area of combustor design, recent CFD analysis of a film cooled ablating combustion chamber has been used to quantify the interaction between film cooling rate, chamber wall contraction angle, and geometry and their effects of these quantities on local wall temperature. The results are currently guiding combustion chamber design and coolant flow rate for an upcoming subcomponent test. Critical aspects of successful integration of CFD into the design cycle includes a close-coupling of CFD and design organizations, quick turnaround of parametric analyses once a baseline CFD benchmark has been established, and the use of CFD methodology and approaches that address pertinent design issues. In this latter area, some problem details can be simplified while retaining key physical aspects to maintain analytical integrity.

Mcconnaughey, P. K.↗