Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Comparative Evaluation of the Ability of the MYNN‐EDMF PBL Scheme in WRF Model to Reproduce Near Surface Wind Speed Over Different Topographical Types

Abstract This study systematically evaluates the performance of the Mellor‐Yamada‐Nakanishi‐Niino‐Eddy‐Diffusion‐Mass‐Flux planetary boundary layer (PBL) scheme within the Weather Research and Forecasting (WRF) model in simulating near‐surface wind speeds across various topographies in New York State (NYS). Simulated wind speeds are compared with in‐situ measurements from 22 surface sites, grouped into six topographic categories: continental plain (CT), lakeside (LS), river valley (RV), Long Island (LI), Block Island (BI), and offshore ocean (OO). A quantitative evaluation based on Relative Euclidean Distance shows that wind speeds at the OO site are the most accurately reproduced, followed by those at LI sites, while the model performs less accurately for the remaining topographic groups. Wind speeds over CT sites tend to be overestimated by approximately 1 m/s, although their diurnal variability (DV) is well captured. In contrast, the model underestimates wind DV at LS, RV, LI, and BI sites, with the largest biases occurring at LI and BI, resulting in underestimated daytime wind speed and/or overestimated nighttime wind speed. The OO winds exhibit minimal diurnal variation, accurately captured by our WRF model. The surface wind diurnal variation is closely linked to PBL development. Among the indicators of PBL development, surface potential temperature biases most strongly correlate with wind speed biases. Our WRF model faces challenges in capturing the distinctions between winds influenced by local circulations and those over continental plains, and the significantly stronger winds at OO compared to BI. Potential causes for these biases are discussed, offering pathways for improving surface wind simulations in future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Design-driven optimization of low-cost reagent formulations for reproducible and high-yielding cell-free gene expression

Access to recombinant proteins is vital in basic science and biotechnology research. Cell-free gene expression systems provide one approach to address this need, but widespread utilization remains limited by the cost, complexity, and inconsistency of current platforms. To address these limitations, we carry out a multi-dimensional definitive screening design to reduce the number of reagent components and remove costly secondary energy substrates. From 1,231 different reagent formulations, we discover a simple and reproducible system based on 12 components. The optimized reagent formulation can produce 2.4 ± 0.3 g/L of protein product at the 15-µL scale (~$\$60$/gprotein) and 3.7 ± 0.2 g/L (~$\$39$/gprotein) at the 4-mL scale with oxygen supplementation. This provides an average 95% reduction in cost over previous cell-free reagent formulations. We further show that the optimized reagent formulation can produce nucleoside triphosphates from nitrogenous bases and ribose and that it is robust to failure across batches of cell lysates, users/locations, and in the synthesis of more than 20 different proteins. For example, we demonstrate the production of fifteen therapeutically relevant products, including full-length aglycosylated monoclonal antibodies. We anticipate that our optimized reagent formulation will democratize the use of cell-free systems for protein manufacturing and synthetic biology applications.

Biologics↗
DOE OSTI2021

Accelerated, scalable and reproducible AI-driven gravitational wave detection

The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware-Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery. By combining a repository for artificial intelligence models and a supercomputing cluster, an entire month's worth of advanced LIGO data is analysed in just 7 min, finding all binary black hole mergers previously identified in this dataset and reporting no misclassifications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Qresp, a tool for curating, discovering and exploring reproducible scientific papers

We propose a strategy and present a simple tool to facilitate scientific data reproducibility by making available, in a distributed manner, all data and procedures presented in scientific papers, together with metadata to render them searchable and discoverable. In particular, we describe a graphical user interface (GUI), Qresp, to curate papers (i.e. generate metadata) and to explore curated papers and automatically access the data presented in scientific publications.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

An AI-accelerated pathway for reproducible and stable halide perovskites

Halide perovskites (HPs) have remarkable optoelectronic properties, and in the last decade their photovoltaic power conversion efficiency and light-emitting diode efficiency have skyrocketed. Despite the surge in research on these burgeoning materials, two key challenges in the field remain: material irreproducibility and instability. Their behavior is especially dynamic in response to environmental stressors, due to complex interactions with the perovskite crystal lattice. Here, in this review, we survey the latest achievements in HP materials research accomplished with the assistance of artificial intelligence (AI), through the implementation of automated experimentation and machine learning (ML) data analysis. Automated synthesis and characterization tackle problems with material irreproducibility by systematically controlling parameters with very high precision, creating massive datasets, and allowing methodical comparisons from which unbiased conclusions can be drawn. AI can reveal otherwise unnoticed trends, inform future experiments with the highest potential information gain, and forecast future performance. The review concludes with a forward viewpoint of how human-assisted closed-loop laboratories and shared databases allow halide perovskite materials’ processing, properties, and performance to be potentially optimized with AI, accelerating the development of highly reproducible and stable optoelectronic devices.

Hering, Abigail R. [Univ. of California, Davis, CA↗
DOE OSTI2022

Discovering causal structure with reproducing-kernel Hilbert space ε -machines

We merge computational mechanics’ definition of causal states (predictively equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely applicable method that infers causal structure directly from observations of a system’s behaviors whether they are over discrete or continuous events or time. A structural representation—a finite- or infinite-state kernel ϵ-machine—is extracted by a reduced-dimension transform that gives an efficient representation of causal states and their topology. In this way, the system dynamics are represented by a stochastic (ordinary or partial) differential equation that acts on causal states. We introduce an algorithm to estimate the associated evolution operator. Paralleling the Fokker–Planck equation, it efficiently evolves causal-state distributions and makes predictions in the original data space via an RKHS functional mapping. We demonstrate these techniques, together with their predictive abilities, on discrete-time, discrete-value infinite Markov-order processes generated by finite-state hidden Markov models with (i) finite or (ii) uncountably infinite causal states and (iii) continuous-time, continuous-value processes generated by thermally driven chaotic flows. The method robustly estimates causal structure in the presence of varying external and measurement noise levels and for very high-dimensional data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Controlling morphology and improving reproducibility of magnetized liner inertial fusion experiments

X-ray imaging indicates magnetized liner inertial fusion (MagLIF) stagnation columns have a complicated quasi-helical structure with significant variations in x-ray brightness along the column. In this work, we describe MagLIF experiments aimed at controlling these stagnation structures by varying the initial liner geometry and composition. First, by varying the initial aspect ratio of the liner, we demonstrate a change in the stagnation structures that is consistent with helical magneto Rayleigh–Taylor (MRT) instabilities feedthrough from the outer-to-inner surfaces of the liner. Second, to minimize the seed for such instabilities, we incorporate a dielectric coating on the outer surface of the beryllium liner, which has previously been shown to reduce the growth of the electrothermal instability, a likely seed for MRT growth. Using this coating, we achieve a stagnation column with significantly reduced helical structure and axial variation in x-ray brightness. We discuss how this coating changes the evolution of structures through stagnation along with the spatial uniformity of neutron production. Finally, we show that these more uniform stagnations also result in improved reproducibility in stagnation temperatures and primary DD neutron yield.

Ampleford, D. J. (ORCID:0000000237422421)↗
DOE OSTI2020

Where Is the Provenance? Ethical Replicability and Reproducibility in GIScience and Its Critical Applications

As replicability and reproducibility (R&R) crises develop within emerging convergent inquiry, ethical use of provenance information is central to the establishment and preservation of trust in critical applications of GIScience and geospatial technologies. Today large volumes of geospatial data are generated at high velocity from satellite sensors and unmanned aircraft systems, citizen sensors, geolocation-based data services, global navigation satellite systems, and so on. The extensive use of these data for applications such as disaster and humanitarian response raises the issue of R&R from competing perspectives of location privacy and geospatial data quality. Although geospatial data can be integrated and linked with contextual information to identify individuals’ movements, steps taken to ensure privacy can complicate the multiuser development of high-quality geospatial workflows. Provenance information as digital records of historical (retrospective) and potential future (prospective) geospatial processes is often overlooked, misunderstood, or inadequately addressed. We explore the relationship between provenance information, location privacy, and geospatial data quality in the context of R&R with a focus on disaster analytics. Here, we argue that in the era of big data and deep learning, GIScientists and associated institutions bear greater responsibility both for geospatial workflow quality and for location privacy. Given vastly heterogenous computational landscapes, we provide practical recommendations for ethically driven provenance and R&R research and development within the GIScience community and beyond.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

The Galaxy platform for accessible, reproducible, and collaborative data analyses: 2024 update

Galaxy (https://galaxyproject.org) is deployed globally, predominantly through free-to-use services, supporting user-driven research that broadens in scope each year. Users are attracted to public Galaxy services by platform stability, tool and reference dataset diversity, training, support and integration, which enables complex, reproducible, shareable data analysis. Applying the principles of user experience design (UXD), has driven improvements in accessibility, tool discoverability through Galaxy Labs/subdomains, and a redesigned Galaxy ToolShed. Galaxy tool capabilities are progressing in two strategic directions: integrating general purpose graphical processing units (GPGPU) access for cutting-edge methods, and licensed tool support. Engagement with global research consortia is being increased by developing more workflows in Galaxy and by resourcing the public Galaxy services to run them. The Galaxy Training Network (GTN) portfolio has grown in both size, and accessibility, through learning paths and direct integration with Galaxy tools that feature in training courses. Code development continues in line with the Galaxy Project roadmap, with improvements to job scheduling and the user interface. Environmental impact assessment is also helping engage users and developers, reminding them of their role in sustainability, by displaying estimated CO 2 emissions generated by each Galaxy job.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A round-robin approach provides a detailed assessment of biomolecular small-angle scattering data reproducibility and yields consensus curves for benchmarking

Through an expansive international effort that involved data collection on 12 small-angle X-ray scattering (SAXS) and four small-angle neutron scattering (SANS) instruments, 171 SAXS and 76 SANS measurements for five proteins (ribonuclease A, lysozyme, xylanase, urate oxidase and xylose isomerase) were acquired. From these data, the solvent-subtracted protein scattering profiles were shown to be reproducible, with the caveat that an additive constant adjustment was required to account for small errors in solvent subtraction. Further, the major features of the obtained consensus SAXS data over the q measurement range 0–1 Å −1 are consistent with theoretical prediction. The inherently lower statistical precision for SANS limited the reliably measured q -range to <0.5 Å −1 , but within the limits of experimental uncertainties the major features of the consensus SANS data were also consistent with prediction for all five proteins measured in H 2 O and in D 2 O. Thus, a foundation set of consensus SAS profiles has been obtained for benchmarking scattering-profile prediction from atomic coordinates. Additionally, two sets of SAXS data measured at different facilities to q > 2.2 Å −1 showed good mutual agreement, affirming that this region has interpretable features for structural modelling. SAS measurements with inline size-exclusion chromatography (SEC) proved to be generally superior for eliminating sample heterogeneity, but with unavoidable sample dilution during column elution, while batch SAS data collected at higher concentrations and for longer times provided superior statistical precision. Careful merging of data measured using inline SEC and batch modes, or low- and high-concentration data from batch measurements, was successful in eliminating small amounts of aggregate or interparticle interference from the scattering while providing improved statistical precision overall for the benchmarking data set.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

DataFed: Towards Reproducible Research via Federated Data Management

The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a logical and holistic view of data that greatly simplifies and empowers data organization, curation, searching, sharing, dissemination, etc. We present DataFed - a lightweight, distributed SDMS that spans a federation of storage systems within a loosely-coupled network of scientific facilities. Unlike existing SDMS offerings, DataFed uses high-performance and scalable user management and data transfer technologies that simplify deployment, maintenance, and expansion of DataFed. DataFed provides web-based and command-line interfaces to manage data and integrate with complex scientific workflows. DataFed represents a step towards reproducible scientific research by enabling reliable staging of the correct data at the desired environment.

Stansberry, Dale↗
DOE OSTI2022

Simple steps to enable reproducibility: culture conditions affecting Chlamydomonas growth and elemental composition

Even subtle modifications in growth conditions elicit acclimation responses affecting the molecular and elemental makeup of organisms, both in the laboratory and in natural habitats. Here, we systematically explored the effect of temperature, pH, nutrient availability, culture density, and access to CO 2 and O 2 in laboratory-grown algal cultures on growth rate, the ionome, and the ability to accumulate Fe. We found algal cells accumulate Fe in alkaline conditions, even more so when excess Fe is present, coinciding with a reduced growth rate. Using a combination of Fe-specific dyes, X-ray fluorescence microscopy, and NanoSIMS, we show that the alkaline-accumulated Fe was intracellularly sequestered into acidocalcisomes, which are localized towards the periphery of the cells. At high photon flux densities, Zn and Ca specifically over-accumulate, while Zn alone accumulates at low temperatures. The impact of aeration was probed by reducing shaking speeds and changing vessel fill levels; the former increased the Cu quota of cultures, the latter resulted in a reduction in P, Ca, and Mn at low fill levels. Trace element quotas were also affected in the stationary phase, where specifically Fe, Cu, and Zn accumulate. Cu accumulation here depends inversely on the Fe concentration of the medium. Individual laboratory strains accumulate Ca, P, and Cu to different levels. All together, we identified a set of specific changes to growth rate, elemental composition, and the capacity to store Fe in response to subtle differences in culturing conditions of Chlamydomonas, affecting experimental reproducibility. Accordingly, we recommend that these variables be recorded and reported as associated metadata.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Reproducible growth of Brachypodium in EcoFAB 2.0 reveals that nitrogen form and starvation modulate root exudation

Understanding plant-microbe interactions requires examination of root exudation under nutrient stress using standardized and reproducible experimental systems. We grew Brachypodium distachyon hydroponically in fabricated ecosystem devices (EcoFAB 2.0) under three inorganic nitrogen forms (nitrate, ammonium, and ammonium nitrate), followed by nitrogen starvation. Analyses of exudates with liquid chromatography–tandem mass spectrometry, biomass, medium pH, and nitrogen uptake showed EcoFAB 2.0’s low intratreatment data variability. Furthermore, the three inorganic nitrogen forms caused differential exudation, generalized by abundant amino acids–peptides and alkaloids. Comparatively, nitrogen deficiency decreased nitrogen-containing compounds but increased shikimates-phenylpropanoids. Subsequent bioassays with two shikimates-phenylpropanoids (shikimic and p-coumaric acids) on soil bacteria or Brachypodium seedlings revealed their distinct capacity to regulate both bacterial and plant growth. Our results suggest that (i) Brachypodium alters exudation in response to nitrogen status, which can affect rhizobacterial growth, and (ii) EcoFAB 2.0 is a valuable standardized plant research tool.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Asymptotically Compatible Reproducing Kernel Collocation and Meshfree Integration for Nonlocal Diffusion

Reproducing kernel (RK) approximations are meshfree methods that construct shape functions from sets of scattered data. We present an asymptotically compatible (AC) RK collocation method for nonlocal diffusion models with Dirichlet boundary condition. The numerical scheme is shown to be convergent to both nonlocal diffusion and its corresponding local limit as nonlocal interaction vanishes. The analysis is carried out on a special family of rectilinear Cartesian grids for a linear RK method with designed kernel support. The key idea for the stability of the RK collocation scheme is to compare the collocation scheme with the standard Galerkin scheme, which is stable. In addition, assembling the stiffness matrix of the nonlocal problem requires costly computational resources because high-order Gaussian quadrature is necessary to evaluate the integral. We thus provide a remedy to the problem by introducing a quasi-discrete nonlocal diffusion operator for which no numerical quadrature is further needed after applying the RK collocation scheme. The quasi-discrete nonlocal diffusion operator combined with RK collocation is shown to be convergent to the correct local diffusion problem by taking the limits of nonlocal interaction and spatial resolution simultaneously. The theoretical results are then validated with numerical experiments. We additionally illustrate a connection between the proposed technique and an existing optimization based approach based on generalized moving least squares.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗
DOE OSTI2022

Limitations of Bin and Bulk Microphysics in Reproducing the Observed Spatial Structure of Light Precipitation

Abstract Coarse-gridded atmospheric models often account for subgrid-scale variability by specifying probability distribution functions (PDFs) of process rate inputs such as cloud and rainwater mixing ratios ( q c and q r , respectively). PDF parameters can be obtained from numerous sources: in situ observations, ground- or space-based remote sensing, or fine-scale modeling such as large-eddy simulation (LES). LES is appealing to constrain PDFs because it generates large sample sizes, can simulate a variety of cloud regimes/case studies, and is not subject to the ambiguities of observations. However, despite the appeal of using model output for parameterization development, it has not been demonstrated that LES satisfactorily reproduces the observed spatial structure of microphysical fields. In this study, the structure of observed and modeled microphysical fields are compared by applying bifractal analysis, an approach that quantifies variability across spatial scales, to simulations of a drizzling stratocumulus field that span a range of domain sizes, drop concentrations (a proxy for mesoscale organization), and microphysics schemes (bulk and bin). Simulated q c closely matches observed estimates of bifractal parameters that measure smoothness and intermittency. There are major discrepancies between observed and simulated q r properties, though, with bulk simulated q r consistently displaying the bifractal properties of observed clouds (smooth, minimally intermittent) rather than rain while bin simulations produce q r that is appropriately intermittent but too smooth. These results suggest fundamental limitations of bulk and bin schemes to realistically represent higher-order statistics of the observed rain structure.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Improved quality metrics for association and reproducibility in chromatin accessibility data using mutual information

Correlation metrics are widely utilized in genomics analysis and often implemented with little regard to assumptions of normality, homoscedasticity, and independence of values. This is especially true when comparing values between replicated sequencing experiments that probe chromatin accessibility, such as assays for transposase-accessible chromatin via sequencing (ATAC-seq). Such data can possess several regions across the human genome with little to no sequencing depth and are thus non-normal with a large portion of zero values. Despite distributed use in the epigenomics field, few studies have evaluated and benchmarked how correlation and association statistics behave across ATAC-seq experiments with known differences or the effects of removing specific outliers from the data. Here, we developed a computational simulation of ATAC-seq data to elucidate the behavior of correlation statistics and to compare their accuracy under set conditions of reproducibility. Using these simulations, we monitored the behavior of several correlation statistics, including the Pearson’s R and Spearman’s ρ coefficients as well as Kendall’s τ and Top–Down correlation. We also test the behavior of association measures, including the coefficient of determination R 2 , Kendall’s W, and normalized mutual information. Our experiments reveal an insensitivity of most statistics, including Spear man’s ρ, Kendall’s τ, and Kendall’s W, to increasing differences between simulated ATAC-seq replicates. The removal of co-zeros (regions lacking mapped sequenced reads) between simulated experiments greatly improves the estimates of correlation and association. After removing co-zeros, the R 2 coefficient and normalized mutual information display the best performance, having a closer one-to-one relationship with the known portion of shared, enhanced loci between simulated replicates. When comparing values between experimental ATAC-seq data using a random forest model, mutual information best predicts ATAC-seq replicate relationships. Collectively, this study demonstrates how measures of correlation and association can behave in epigenomics experiments. We provide improved strategies for quantifying relationships in these increasingly prevalent and important chromatin accessibility assays.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

BioHackathon 2015: Semantics of data for life sciences and reproducible research

We report on the activities of the 2015 edition of the BioHackathon, an annual event that brings together researchers and developers from around the world to develop tools and technologies that promote the reusability of biological data. We discuss issues surrounding the representation, publication, integration, mining and reuse of biological data and metadata across a wide range of biomedical data types of relevance for the life sciences, including chemistry, genotypes and phenotypes, orthology and phylogeny, proteomics, genomics, glycomics, and metabolomics. We describe our progress to address ongoing challenges to the reusability and reproducibility of research results, and identify outstanding issues that continue to impede the progress of bioinformatics research. We share our perspective on the state of the art, continued challenges, and goals for future research and development for the life sciences Semantic Web.

97 MATHEMATICS AND COMPUTING↗