SEARCH · Engineering Papers

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Experimental Benchmarking for High-Reproducibility, Cross-Institutional Evaluation of Iron Redox Electrochemistry

We present a practical case study standardizing experimental protocols between collaborators with the goal of understanding ferrous iron (Fe 2+ ) chemistry and improving the iron deposition reaction for energy-efficient, electrochemical iron production. The study of iron reactions can be difficult, as aqueous iron electrolytes exhibit complex behaviors that can lead to differing interpretation of ostensibly similar experiments. The question we want to answer: are we studying the same chemistry? Our protocols address inherent challenges such as the tendency for Fe 2+ to spontaneously oxidize to ferric iron (Fe 3+ ) and the production of hydrogen at the potentials of interest. Our standardized protocol, executed by four collaborators in different labs and institutions, yields high-reproducibility results, and identified glassy carbon electrode surface quality and Fe 3+ impurities in the salt as key factors with outsized effects on cyclic voltammetry measurements. The process of developing the protocols helped to troubleshoot underlying issues that created poorer reversibility and reproducibility. This study highlights the fact that even nominally straightforward electrochemical systems can yield vastly different outcomes due to small differences in experimental preparation and serves as a useful example for creating transparent and achievable standards for the generation of reliable datasets that can be widely used and shared.

Ketter, Benjamin [Argonne National Laboratory (ANL↗

DOE OSTI2016

Evaluation of NASA’s MERRA Precipitation Product in Reproducing the Observed Trend and Distribution of Extreme Precipitation Events in the United States

This study evaluates the performance of NASA's Modern-Era Retrospective Analysis for Research and Applications (MERRA) precipitation product in reproducing the trend and distribution of extreme precipitation events. Utilizing the extreme value theory, time-invariant and time-variant extreme value distributions are developed to model the trends and changes in the patterns of extreme precipitation events over the contiguous United States during 1979-2010. The Climate Prediction Center (CPC)U.S.Unified gridded observation data are used as the observational dataset. The CPC analysis shows that the eastern and western parts of the United States are experiencing positive and negative trends in annual maxima, respectively. The continental-scale patterns of change found in MERRA seem to reasonably mirror the observed patterns of change found in CPC. This is not previously expected, given the difficulty in constraining precipitation in reanalysis products. MERRA tends to overestimate the frequency at which the 99th percentile of precipitation is exceeded because this threshold tends to be lower in MERRA, making it easier to be exceeded. This feature is dominant during the summer months. MERRAtends to reproduce spatial patterns of the scale and location parameters of the generalized extreme value and generalized Pareto distributions. However, MERRA underestimates these parameters, particularly over the Gulf Coast states, leading to lower magnitudes in extreme precipitation events. Two issues in MERRA are identified: 1)MERRAshows a spurious negative trend in Nebraska andKansas, which ismost likely related to the changes in the satellite observing system over time that has apparently affected the water cycle in the central United States, and 2) the patterns of positive trend over theGulf Coast states and along the East Coast seem to be correlated with the tropical cyclones in these regions. The analysis of the trends in the seasonal precipitation extremes indicates that the hurricane and winter seasons are contributing the most to these trend patterns in the southeastern United States. The increasing annual trend simulated by MERRA in the Gulf Coast region is due to an incorrect trend in winter precipitation extremes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2016

SNaPP: Simplified Nanoproteomics Platform for Reproducible Global Proteomic Analysis of Nanogram Protein Quantities

Global proteomic analyses are now widely applied across biological research to study changes in an organism(s) proteome correlated with a perturbation, phenotype and/or time series of interest.[1-3] Further, it has been broadly established that efficient and reproducible sample preparation workflows are crucial to successful quantitative proteome comparisons, especially when applying label free methods.[4-8] However, clinical samples are often severely limited in quantity and can preclude the application of more robust bulk sample processing workflows due to e.g. contamination, carry-over, or sample losses.[9] This has limited the effective application of global proteomics for many sample types of great interest, e.g. LCM dissected tissues, FACS sorted cells, circulating tumor cells (CTC), and early embryos. In a typical proteomics experiment, bulk homogenization is applied to generate sufficient protein for processing (> 10 µg protein), and can blend the proteomes of many different cell types and disparate tissue regions. The resulting “average” proteome, can effectively render unobservable proteome changes of interest, and preclude important applications. Global proteomic analyses of complex protein samples in nanogram quantities require a fastidious approach to achieve in-depth protein coverage and quantitative reproducibility.

automation↗

DOE OSTI2025

Videos, photos, and AI-derived grain size data associated with “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization” under review. This data package includes five data types: 1) raw photos and videos from drone survey and walking smartphone surveys; 2) images derived from raw videos; 3) manual labeling of reference scales; 4) metadata for all images and photo resolution derived from artificial intelligence (AI) models or manual labels, 5) grain size data obtained from AI models for all photos, 6) metadata and grain size data after quality control, 7) summaries of sample efficiency for all data, and 8) computational fluid dynamics (CFD) data used to support hydro-biogeochemical (HBGC) parameter estimation. Such data is used to 1) demonstrate significant improvements in accuracy, efficiency, and quality control for grain size data collection with the help of AI models, 2) study the spatial heterogeneity of grain size and observation reproducibility based on tens of thousands of data points generated by the AI models, and 3) evaluate the impacts of grain size heterogeneity on key HBGC parameters across sediment-to-reach and hourly-to-yearly scales. In particular, the data package contains 116 folders and 179696 files. The files include 41 videos in .mov format, 64047 photos in .jpg format, 13541 video-derived photos in .png format, 12747 segmentation mask data in .tif format, 12747 segmentation data in .json format, 24771 .csv files that with metadata and grain size for each individual photo as well as water depth and velocity data from CFD and observation, 51791 .txt files of raw AI predicted labels, and 11 flight record data in .srt format. The summary for all metadata and grain size statistics information is included in “Scales_V3_NG.csv” and “Statistics_V3_NG.csv”. The summary for data that pass data quality control (QC) level 0-2 is included in “QCStatistics_V3_NG.csv”. The QC level 0 represents photos whose photo resolution is positive, excluding photos that miss reference scale. The QC level 1 means reference scale circularity uncertainty is less than 5% for smartphone images while representing photo resolution is larger than 0.44 mm/pixel for drone images. The QC level 2 means excluding photos whose grain number is less than 100, a minimum number of grains recommended by classic literature. The summary for each video’s name, length, frame rates, survey area, grain number, survey efficiency, etc. can be found in “QCSummary_V3_NG.csv”. The summary for site name, GPS coordinates, and number of images at each site can be found in “SitesSummary_V3_*.csv” files. Overall computational efficiency summary is reported in Table 4 of accompanying manuscript. Additionally, the nitrate concentration data used in this work was downloaded from an existing dataset published on ESS-DIVE (Boat-Dragged Sensor Hanford Reach.csv; Conner A. et al., 2020). We thank the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, Cowiche Canyon Conservatory, Port of Benton, and the Confederated Tribes and Bands of the Yakama Nation for access to field locations where the data were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate data collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2015

Verification and Large Deformation Analysis Using the Reproducing Kernel Particle Method

The reproducing kernel particle method (RKPM) is a meshless method used to solve general boundary value problems using the principle of virtual work. RKPM corrects the kernel approximation by introducing reproducing conditions which force the method to be complete to arbritrary order polynomials selected by the user. Effort in recent years has led to the implementation of RKPM within the Sierra/SM physics software framework. The purpose of this report is to investigate convergence of RKPM for verification and validation purposes as well as to demonstrate the large deformation capability of RKPM in problems where the finite element method is known to experience difficulty. Results from analyses using RKPM are compared against finite element analysis. A host of issues associated with RKPM are identified and a number of potential improvements are discussed for future work.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2015

Tackling the Reproducibility Problem in Systems Research with Declarative Experiment Specifications

Validating experimental results in the field of computer systems is a challenging task, mainly due to the many changes in software and hardware that computational environments go through. Determining if an experiment is reproducible entails two separate tasks: re-executing the experiment and validating the results. Existing reproducibility efforts have focused on the former, envisioning techniques and infrastructures that make it easier to re-execute an experiment. In this work we focus on the latter by analyzing the validation workflow that an experiment re-executioner goes through. We notice that validating results is done on the basis of experiment design and high-level goals, rather than exact quantitative metrics. Based on this insight, we introduce a declarative format for specifying the high-level components of an experiment as well as describing generic, testable conditions that serve as the basis for validation. We present a use case in the area of storage systems to illustrate the usefulness of this approach. We also discuss limitations and potential benefits of using this approach in other areas of experimental systems research.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2018

Girder Profile Reproducing Residuals Report

Girder profile is represented by 6 or 8 girder fiducials, depending on the length of the girder. The profile is recorded precisely in environmentally controlled room (ER) where vibrating wire measurement is taken place. The girder profile is expected to be reproduced in tunnel by following a strictly-designed procedure. Girder profile is adjusted by referring to the dynamic reading of laser tracker and is recorded by multiple shots to common targets and girder fiducials. A final 6 tracker setup is performed to confirm the girder profile reported by 2 trackers and report the magnet relative height location by including magnet top fiducial observation. In order to further isolate the impact of instrument and monument geometry, the girder fiducials that are symmetrical relative to beam centerline will be averaged to compute girder profile error. The girder profile reproducing residuals will be summarized for the girders have been profiled so far.

36 MATERIALS SCIENCE↗

DOE OSTI2013

Girder Profile Reproducing Residuals Report

36 MATERIALS SCIENCE↗

DOE OSTI2026

A reproducible study design for the MIMIC-IV in-hospital mortality task

Open, tabular electronic health record (EHR) datasets such as MIMIC-III and MIMIC-IV have become critical resources for developing machine learning (ML) models addressing clinical prediction tasks, including hospital readmission, length of stay, and in-hospital mortality (IHM). While MIMIC-III has benefited from well-established preprocessing pipelines and standardized feature sets, MIMIC-IV remains comparatively challenging to work with because there are no standardized benchmarks to support reproducibility and comparability across studies. To address this limitation, we present a rigorously curated MIMIC-IV custom feature set optimized for IHM prediction, constructed through a reproducible preprocessing pipeline and feature selection strategy.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Plasmonic Core–Shell–Satellites with Abundant Electromagnetic Hotspots for Highly Sensitive and Reproducible SERS Detection

In this work, we develop a Ag@Al2O3@Ag plasmonic core–shell–satellite (PCSS) to achieve highly sensitive and reproducible surface-enhanced Raman spectroscopy (SERS) detection of probe molecules. To fabricate PCSS nanostructures, we employ a simple hierarchical dewetting process of Ag films coupled with an atomic layer deposition (ALD) method for the Al2O3 shell. Compared to bare Ag nanoparticles, several advantages of fabricating PCSS nanostructures are discovered, including high surface roughness, high density of nanogaps between Ag core and Ag satellites, and nanogaps between adjacent Ag satellites. Finite-difference time-domain (FDTD) simulations of the PCSS nanostructure confirm an enhancement in the electromagnetic field intensity (hotspots) in the nanogap between the Ag core and the satellite generated by the Al2O3 shell, due to the strong core–satellite plasmonic coupling. The as-prepared PCSS-based SERS substrate demonstrates an enhancement factor (EF) of 1.7 × 107 and relative standard deviation (RSD) of ~7%, endowing our SERS platform with highly sensitive and reproducible detection of R6G molecules. We think that this method provides a simple approach for the fabrication of PCSS by a solid-state technique and a basis for developing a highly SERS-active substrate for practical applications.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

The Gut Microbiome and Alcoholic Liver Disease: Ethanol Consumption Drives Consistent and Reproducible Alteration in Gut Microbiota in Mice

Phenotypic health effects, both positive and negative, have been well studied in association with the consumption of alcohol in humans as well as several other mammals including mice. Many studies have also associated these same health effects and phenotypes to specific members of gut microbiome communities. Here we utilized a chronic plus binge ethanol feed model (Gao-binge model) to explore microbiome community changes across three independent experiments performed in mice. We found significant and reproducible differences in microbiome community assemblies between ethanol-treated mice and control mice on the same diet absent of ethanol. We also identified significant differences in gut microbiota occurring temporally with ethanol treatment. Peak shift in communities was observed 4 days after the start of daily alcohol consumption. We quantitatively identified many of the bacterial genera indicative of these ethanol-induced shifts including 20 significant genera when comparing ethanol treatments with controls and 14 significant genera based on temporal investigation. Including overlap of treatment with temporal shifts, we identified 25 specific genera of interest in ethanol treatment microbiome shifts. Shifts coincide with observed presentation of fatty deposits in the liver tissue, i.e., Alcoholic Liver Disease-associated phenotype. The evidence presented herein, derived from three independent experiments, points to the existence of a common, reproducible, and characterizable “mouse ethanol gut microbiome”.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2017

REPRODUCING THE CORRELATIONS OF TYPE C LOW-FREQUENCY QUASI-PERIODIC OSCILLATION PARAMETERS IN XTE J1550–564 WITH A SPIRAL STRUCTURE

While it has been observed that the parameters intrinsic to the type C low-frequency quasi-periodic oscillations are related in a nonlinear manner among themselves, there has been, up to now, no model to explain or reproduce how the frequency, the FWHM, and the rms amplitude of the type C low-frequency quasi-periodic oscillations behave with respect to one another. Here we are using a simple toy model representing the emission from a standard disk and a spiral such as that caused by the accretion–ejection instability to reproduce the overall observed behavior and shed some light on its origin. This allows us to prove the ability of such a spiral structure to be at the origin of flux modulation over more than an order of magnitude in frequency.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Enhanced climate reproducibility testing with false discovery rate correction

Simulating the Earth's climate is an important and complex problem, thus climate models are similarly complex, comprised of millions of lines of code. In order to appropriately utilize the latest computational and software infrastructure advancements in Earth system models running on modern hybrid computing architectures to improve their performance, precision, accuracy, or all three; it is important to ensure that model simulations are repeatable and robust. This introduces the need for establishing statistical or non-bit-for-bit reproducibility, since bit-for-bit reproducibility may not always be achievable. Here, we propose a short-simulation ensemble-based test for an atmosphere model to evaluate the null hypothesis that modified model results are statistically equivalent to that of the original model. We implement this test in version 2 of the US Department of Energy's Energy Exascale Earth System Model (E3SM). The test evaluates a standard set of output variables across the two simulation ensembles and uses a false discovery rate correction to account for multiple testing. The false positive rates of the test are examined using re-sampling techniques on large simulation ensembles and are found to be lower than the currently implemented bootstrapping-based testing approach in E3SM. We also evaluate the statistical power of the test using perturbed simulation ensemble suites, each with a progressively larger magnitude of change to a tuning parameter. The new test is generally found to exhibit more statistical power than the current approach, being able to detect smaller changes in parameter values with higher confidence.

Kelleher, Michael E. [Oak Ridge National Laborator↗

DOE OSTI2019

Vectorization of Random Number Generation and Reproducibility of Concurrent Particle Transport Simulation

Efficient random number generation with high quality statistical properties and exact reproducibility of Monte Carlo simulations are important requirements in many areas of computational science. VecRNG is a package providing pseudo-random number generation (pRNG) in the context of a new library VecMath. This library bundles up several general-purpose mathematical utilities, data structures, and algorithms having both SIMD and SIMT (GPUs) support based on VecCore.~Several state-of-the-art RNG algorithms are implemented as kernels supporting parallel generation of random numbers in scalar, vector, and Cuda workflows. In this report, we will present design considerations, implementation details, and computing performance of parallel pRNG engines on both CPU and GPU. Reproducibility of propagating multiple particles in parallel for HEP event simulation is demonstrated, using GeantV-based examples, for both sequential and fine-grain track-level concurrent simulation wor kflows. Strategies for efficient uses of vectorized pRNG and non-overlapping streams of random number sequences in concurrent computing environments is discussed as well.

Jun, S. Y.↗

DOE OSTI2015

The Acoustic Emission signal acquired by the microphones placed in the CABRI test device along the fourteen last R.I.A. experiments: an example of reproducible research in nuclear science

The CABRI facility is an experimental nuclear reactor of the French Atomic Energy Commission. It is located at the Cadarache Research Centre in southern France and it is designed to act as a support to the French nuclear infrastructure. The purpose of the new testing programme termed, 'CABRI International Programme' (CIP) is to study the behaviour of PWR-type fuel rods at high burnup, equipped with an 'advanced' cladding, under Reactivity Initiated Accident (RIA) conditions (such as the scenario of a control rod ejection). Within the framework of this programme, piloted and funded by the French Institute of Nuclear Radioprotection and Safety (IRSN), ten tests are to be conducted with a frequency of two tests per year. The LPRE laboratory of the CEA which is in charge of the Preparation, realisation and breakdown of the test results studies the possibility to set up a new test analysis based on the processing of signals coming from sensors placed within the test equipment. During the experimental phase, the behaviour of the fuel element generates acoustic waves which can be detected by two microphones placed upstream and downstream of the test device. Studies showed the interest to realize temporal and spectral analyses on these signals by showing the existence of signatures which can be correlated with physical phenomena as the rod failure or the test shutdown (i.e. scram). The work presented in this article results from the will to consolidate these studies. Since the main phenomenon to be tracked is the fuel rod failure, the aim would be to highlight specific events which would have been precursors of the rod failure in order to use in the future these signals for further interpretation. Such an antecedent works resumption leads to a better understanding of the experimental needs and constitutes a good initial state to prepare the new very fast digital data acquisition systems. Although all the raw data are accessible in the form of text files, analyses and graphics representations were not straightforward to reproduce from the ancient studies since that, on one hand, people who were in charge of the original work left the laboratory and on the other hand because it is not easy when the time passes, even with our own work, to be able to remember the steps of data manipulations and the exact setup: - During the ancient experiments the use of analog data acquisition systems required to digitize tapes to be able to realize computer treatments. That had had for consequence to lose the initial dating. This one must be correctly edited to do temporal comparisons. - Analyses require functions for calculations whose parameters has to be well-known to reach the same results. We thus wished to manage our workflow in the idea that it can be easily reproducible on all the experiments. The object of the work presented in this article was to put in practice this strong bind between the data, treatments and generation of the document in order not to hesitate to do the iteration principle in action. We do not have to be afraid by the data driven analyses. According to the philosophy of the literate programming, the text of the technical document is woven with the computer code that produces all the printed output as tables, graphs for the study eliminating hence the unrealistic cut and paste. This difficulty is not specific to the nuclear domain. For many years, researchers have been worked out solutions to this mundane issue. And, presently, new technologies and high-level programming languages offer us actual answers. We will firstly present the tools applied in our laboratory to implement this workflow, then we will describe the global perception carried out to continue the study of the Acoustic Emission signals recorded by the two microphones during the fourteen last CABRI R.I.A. test.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2023

Benzo[d]thiazole Based Wide Bandgap Donor Polymers Enable 19.54% Efficiency Organic Solar Cells Along with Desirable Batch-to-Batch Reproducibility and General Applicability

The limited selection pool of high-performance wide bandgap (WBG) polymer donors is a bottleneck problem of the nonfullerene acceptor (NFA) based organic solar cells (OSCs) that impedes the further improvement of their photovoltaic performances. In this work, a series of new WBG polymers, namely PH-BTz, PS-BTz, PF-BTz, and PCl-BTz, are developed by using the bicyclic difluoro-benzo[d]thiazole (BTz) as the acceptor block and benzo[1,2-b:4,5-b']dithiophene (BDT) derivatives as the donor units. By introducing S, F, and Cl atoms to the alkylthienyl sidechains on BDT, the resulting polymers exhibit lowered energy levels and enhanced aggregation properties. The fluorinated PBTz-F not only exhibits a low-lying HOMO level, but also has stronger face-on packing order and results in more uniform fibril-like interpenetrating networks in the related PF-BTz:L8-BO blend. A high-power conversion efficiency (PCE) of 18.57% is achieved. Moreover, PBTz-F also exhibits a good batch-to-batch reproducibility and general applicability. In addition, ternary blend OSCs based on the host PBTz-F:L8-BO blend and PM6 guest donor exhibits a further enhanced PCE of 19.54%, which is among the highest values of OSCs.

36 MATERIALS SCIENCE↗

DOE OSTI2018

A reproducing kernel enhanced approach for peridynamic solutions

The most common discretization method for peridynamic models used in engineering problems is the node-based meshfree approach. This method discretizes peridynamic domains by a set of nodes, each associated with a nodal cell with a characteristic volume, leading to a particle-based description of continuum systems. The behavior of each particle is then considered representative of its cell. This limits the convergence rate to the first order. In this paper, we introduce a reproducing kernel (RK) approximation to the field variables in the peridynamic equations to increase the order of convergence of peridynamic numerical solutions. Furthermore, the numerical results demonstrate improved convergence rates in static peridynamic problems using the proposed method.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Asymptotically compatible reproducing kernel collocation and meshfree integration for the peridynamic Navier equation

Here, we study reproducing kernel (RK) collocation method for peridynamic Navier equation. In the first part, we apply a linear RK approximation to both displacement and dilatation, and then back-substitute dilatation and solve the peridynamic Navier equation in a pure displacement form. The RK collocation scheme converges to the nonlocal limit for a fixed nonlocal interaction length and also to the local limit as nonlocal interactions vanish. The stability is shown by comparing the collocation scheme with the standard Galerkin scheme using Fourier analysis. In the second part, we apply the RK collocation to the quasi-discrete peridynamic Navier equation and show its convergence to the correct local limit when the ratio between the nonlocal length scale and the discretization parameter is fixed. The analysis is carried out on a special family of rectilinear Cartesian grids for the RK collocation method with a designated kernel with finite support. We assume the Lamé parameters satisfy λ ≥ μ to avoid extra assumptions on the nonlocal kernel. Finally, numerical experiments are conducted to validate the theoretical results.

42 ENGINEERING↗