Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reproducible research”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Workshop on Addressing Rigor and Reproducibility in Thermal, Heterogeneous Catalysis

Heterogeneous catalysis has long served as the bedrock of the manufacturing of energy carriers, fuels and chemicals, and various technologies for pollution abatement. The significant complexity and variability spanning the entire breadth of catalyst material properties, synthesis methods, characterization techniques, and evaluation procedures, has focused attention on the need to establish community-accepted best practices for ensuring high-quality, benchmarked, and reproducible data. In addition, increased societal urgency to transition to clean energy and reduce greenhouse gas concentrations has incentivized interdisciplinary, convergent, and translational approaches to catalysis research in recent years. Research engineers and scientists with expertise cutting broadly across materials science, chemical synthesis, interfacial science, spectroscopy, and methods of data science and computational simulation, all bring diverse and important perspectives to catalysis research, but often with little awareness of the complexity of catalytic systems, especially in their working environment. As has already occurred in other scientific fields, there has been growing recognition and consensus in the heterogeneous catalysis research community that mechanisms are needed to improve the rigor and reproducibility (R&R) of experimental measurements, to ensure alignment of the broader research community with a common core of best practices specific to the realization of high-quality catalysis research. Similarly, the field is moving rapidly toward computationally informed and data science-driven catalyst design, but the success of implementing such predictive tools hinges on model training and validation rooted in rigorously obtained and reproducible experimental data that are benchmarked to common specifications. As such, this workshop was convened to prepare a report summarizing best practices for reporting data and performing experiments that researchers can use to benchmark, validate, and reproduce data in specific sub-fields of thermal, heterogeneous catalysis. Additionally, we discussed recommendations for future actions that may improve R&R in this field. The workshop organizers and participants include a diverse range of catalysis researchers from various employment sectors (e.g., academia, industry, national laboratory), institutional mission and resources (e.g., PhD-granting research universities, non-PhD-granting teaching universities), career stage (e.g., early, mid and late-career), technical expertise, and demographic background. This diverse group was involved in the discussion of workshop agenda items, writing this report, and discussing possible future action items for the community to consider, which helped ensure that a broad range of perspectives were captured in the description of the problems at hand and the creation of actionable solutions that may be effectively adopted by the diverse practitioners in catalysis research. Importantly, this group of workshop participants also included very early career researchers (e.g., senior PhD students, postdoctoral scholars) who will become the next generation of scientific leaders in various sectors, thus capturing emerging perspectives of newcomers to the field to shape its future while positively impacting the development of its future workforce. We envision that this effort will help advance the field of catalysis science by improving the rigor and reproducibility of experimental data collected by current researchers and future newcomers to the field, which is of broad importance to health and vitality of any scientific discipline. Therefore, best practices identified in this endeavor for thermal heterogeneous catalysis can be translated to such efforts in other areas of catalysis and other scientific fields involving the study of materials, and vice versa. We also envision this to be an ongoing effort, with future workshops that are convened to discuss issues of rigor and reproducibility on technical topics that were unable to be covered in this workshop due to its scope limitations, and as emerging methods and materials become more prevalent in the research community.

36 MATERIALS SCIENCE↗

Final Technical Report for DE-SC0022206

This project developed foundational genetic, genomic, and epigenetic tools for anaerobic fungi (Neocallimastigomycota), a group of microorganisms with exceptional natural abilities to deconstruct lignocellulosic biomass. Efficient biomass deconstruction remains a major barrier to economical production of renewable fuels, chemicals, and materials from agricultural and forestry residues. The project sought to enable mechanistic studies and future engineering of anaerobic fungi by improving genomic resources, establishing methods for gene expression, and investigating epigenetic regulation of biomass-degrading pathways. Major accomplishments included generation of the first chromosome-scale genome assemblies for multiple anaerobic fungal species, providing publicly available genomic resources that support both engineering and fundamental biological research. The project established the first reproducible system for heterologous gene expression in anaerobic fungi and identified genomic features and mobile genetic elements that may support future development of stable transformation technologies. In parallel, the project demonstrated direct conversion of untreated lignocellulosic biomass into fuels and specialty chemicals through a fungal-yeast bioprocess and identified anaerobic fungal enzymes with utility for metabolic engineering. The research also revealed that epigenetic regulation plays an important role in controlling fungal gene expression and enzyme production, identifying potential strategies for enhancing biomass degradation. Collectively, this work established anaerobic fungi as a tractable emerging platform for bioenergy and biomanufacturing research, generated valuable public resources, trained the next generation of researchers, and advanced DOE-BER goals related to predictive biology, sustainable bioprocessing, and the circular bioeconomy.

Solomon, Kevin [University of Delaware] (ORCID:000↗

Reproducibility Practice in High-Performance Computing: Community Survey Results

The integrity of science and engineering research is grounded in assumptions of rigor and transparency on the part of those engaging in such research. HPC community effort to strengthen rigor and transparency take the form of reproducibility efforts. In a recent survey of the SC conference community, we collected information about the SC Reproducibility Initiative activities. Here, we present the survey results in this paper. Results show that the reproducibility initiative activities have contributed to higher levels of awareness on the part of SC conference technical program participants, and hint at contributing to greater scientific impact for the published papers of the SC conference series. Stringent point-of-manuscript-submission verification is problematic for reasons we point out, as are inherent difficulties of computational reproducibility in HPC. Future efforts should better decouple the community educational goals from goals that specifically strengthen a research work's potential for long-term impact through reuse 5-10 years down the road.

97 MATHEMATICS AND COMPUTING↗

Computer architectures for computational physics work done by Computational Research and Technology Branch and Advanced Computational Concepts Group

Slides are reproduced that describe the importance of having high performance number crunching and graphics capability. They also indicate the types of research and development underway at Ames Research Center to ensure that, in the near term, Ames is a smart buyer and user, and in the long-term that Ames knows the best possible solutions for number crunching and graphics needs. The drivers for this research are real computational physics applications of interest to Ames and NASA. They are concerned with how to map the applications, and how to maximize the physics learned from the results of the calculations. The computer graphics activities are aimed at getting maximum information from the three-dimensional calculations by using the real time manipulation of three-dimensional data on the Silicon Graphics workstation. Work is underway on new algorithms that will permit the display of experimental results that are sparse and random, the same way that the dense and regular computed results are displayed.

Source record↗

Survey of Use Cases and Scenarios on the Open Energy Data Initiative Solar Systems Integration (OEDI SI) Platform

The Open Energy Data Initiative Solar Systems Integration (OEDI SI) Data and Modeling Platform offers a comprehensive set of use cases tailored for power systems analysis. Each use case is centered around a specific power system analysis problem, supported by composite input data and reference algorithms. These composite input datasets are meticulously assembled using OEDI SI's data preprocessing tools, which integrate raw data from various sources. The primary objectives of the OEDI SI Platform include facilitating access to composite input data through widely accepted input/output formats and verified results. This accessibility enables power system network researchers and developers to validate their algorithms and showcase their applications' capabilities to the broader community. Moreover, the platform strives to promote reproducible, robust, replicable, and generalizable solar systems integration research.

14 SOLAR ENERGY↗

Warm-phase microphysical evolution in large-eddy simulations of tropical cumulus congestus: evaluating drop size distribution evolution using polarimetry retrievals, in situ measurements, and a thermal-based framework

Owing to uncertainties in convective microphysics processes, improving parameterizations in Earth system models (ESMs) can benefit from observationally constrained cases suitable for scaling between cloud-resolving models and ESMs. We propose a benchmark large-eddy simulation (LES) cumulus congestus case study from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP 2 Ex) for evaluating and improving ESMs in single-column model (SCM) mode. We seek observational constraints using novel polarimetric retrievals and in situ cloud microphysics measurements. Simulations using bulk and bin microphysics initialized with observed aerosol profiles are compared to cloud-top retrievals of cloud droplet effective radius (R eff ), effective variance (ν eff ), and number concentration (N d ) from the airborne Research Scanning Polarimeter (RSP). Both schemes reproduce characteristics of cloud-top N d and R eff that increase and decrease with altitude, respectively. Cloud-top N d is low-biased relative to RSP retrievals in both schemes, potentially due to limitations in both simulations and retrieval assumptions. Cloud-top R eff is low-biased in the bulk scheme but reasonably reproduced by the bin scheme. Profiles of N d and R eff are sensitive to the collision–coalescence process and the vertical variation in aerosol size distribution. Comparison of simulated and in situ droplet size distributions (DSDs) shows that, to first order, integrated moments are always sensitive to sizes < ~ 30 µm and can also be sensitive to larger sizes if the DSDs are sufficiently broad, with implications for the assumed maximum observed size retrieved by the RSP. The bin scheme captures the observed extended tail of the DSD, while the bulk scheme is unable to due to parametric constraints. Differences in expected relationships between in situ measurements of cloud cores and cloud-top retrievals by RSP demonstrate difficulty in constraining well the case presented herein. Finally, a thermal-tracking framework demonstrates that the dilution of N d throughout a thermal's lifetime is heavily determined by collision–coalescence and the height-varying aerosol distribution and that, in the absence of these, the impact of entrainment on diluting N d is largely offset by secondary activation. Implications for evaluating warm-phase convective microphysics schemes in ESMs and translating results for use on global, space-based polarimetry platforms are discussed.

Stanford, McKenna Wallace [Columbia Univ., New Yor↗

SBML Level 3: an extensible format for the exchange and reuse of biological models

Systems biology has experienced dramatic growth in the number, size, and complexity of computational models. To reproduce simulation results and reuse models, researchers must exchange unambiguous model descriptions. We review the latest edition of the Systems Biology Markup Language (SBML), a format designed for this purpose. A community of modelers and software authors developed SBML Level 3 over the past decade. Its modular form consists of a core suited to representing reaction-based models and packages that extend the core with features suited to other model types including constraint-based models, reaction-diffusion models, logical network models, and rule-based models. The format leverages two decades of SBML and a rich software ecosystem that transformed how systems biologists build and interact with models. More recently, the rise of multiscale models of whole cells and organs, and new data sources such as single-cell measurements and live imaging, has precipitated new ways of integrating data with models. We provide our perspectives on the challenges presented by these developments and how SBML Level 3 provides the foundation needed to support this evolution.

59 BASIC BIOLOGICAL SCIENCES↗

On the Topotactic Phase Transition Achieving Superconducting Infinite‐Layer Nickelates

Abstract Topotactic reduction is critical to a wealth of phase transitions of current interest, including synthesis of the superconducting nickelate Nd 0.8 Sr 0.2 NiO 2 , reduced from the initial Nd 0.8 Sr 0.2 NiO 3 /SrTiO 3 heterostructure. Due to the highly sensitive and often damaging nature of the topotactic reduction, however, only a handful of research groups have been able to reproduce the superconductivity results. A series of in situ synchrotron‐based investigations reveal that this is due to the necessary formation of an initial, ultrathin layer at the Nd 0.8 Sr 0.2 NiO 3 surface that helps to mediate the introduction of hydrogen into the film such that apical oxygens are first removed from the Nd 0.8 Sr 0.2 NiO 3 / SrTiO 3 (001) interface and delivered into the reducing environment. This allows the square‐planar / perovskite interface to stabilize and propagate from the bottom to the top of the film without the formation of interphase defects. Importantly, neither geometric rotations in the square planar structure nor significant incorporation of hydrogen within the films is detected, obviating its need for superconductivity. These findings unveil the structural basis underlying the transformation pathway and provide important guidance on achieving the superconducting phase in reduced nickelate systems.

36 MATERIALS SCIENCE↗

Challenging and Improving the Simulation of Mid-Level Mixed-Phase Clouds Over the High-Latitude Southern Ocean

Climate models exhibit major radiative biases over the Southern Ocean owing to a poor representation of mixed-phase clouds. In this study, we used the remote-sensing dataset from the Measurements of Aerosols, Radiation and Clouds over the Southern Ocean (MARCUS) campaign to assess the ability of the Weather Research and Forecasting (WRF) model to reproduce frontal clouds off Antarctica. It focuses on the modeling of thin mid-level supercooled liquid water layers which precipitate ice. The standard version of WRF produces almost fully glaciated clouds and cannot reproduce cloud top turbulence. Our work demonstrates the importance of adapting the ice nucleation parameterization to the pristine austral atmosphere to reproduce the supercooled liquid layers. Once simulated, droplets significantly impact the cloud radiative effect by increasing downwelling longwave fluxes and decreasing downwelling shortwave fluxes at the surface. The net radiative effect is a warming of snow and ice covered surfaces and a cooling of the ocean. Despite improvements in our simulations, the local turbulent circulation related to cloud-top radiative cooling is not properly reproduced, advocating for the need to develop a parameterization for top-down convection to capture the turbulence-microphysics interplay at cloud top.

54 ENVIRONMENTAL SCIENCES↗

Improved reproducibility of metal halide perovskite solar cells via automated gas quenching

Achieving reproducible perovskite solar cell fabrication is crucial for making it a scalable technology. We demonstrate an automated gas quenching system to improve perovskite solar cell reproducibility at the lab-scale. We use in situ photoluminescence to monitor the perovskite film formation as a function of the atmosphere in the glove box and find that antisolvent quenching is more sensitive to lingering precursor solvents than the gas quenching method. We observe a better reproducibility with gas quenching than with antisolvent quenching because it maintains a more consistent atmosphere in the glove box. The automated gas quenching process leads to high performing devices that are reproducible both batch to batch and researcher to researcher. The insights into gas quenching film formation as a function of solvent atmosphere and quench velocity will help inform future studies on large scale fabrication systems.

14 SOLAR ENERGY↗

32 examples of LLM applications in materials science and chemistry: towards automation, assistants, agents, and accelerated scientific discovery

Abstract Large language models (LLMs) are reshaping many aspects of materials science and chemistry research, enabling advances in molecular property prediction, materials design, scientific automation, knowledge extraction, and more. Recent developments demonstrate that the latest class of models are able to integrate structured and unstructured data, assist in hypothesis generation, and streamline research workflows. To explore the frontier of LLM capabilities across the research lifecycle, we review applications of LLMs through 32 total projects developed during the second annual LLM hackathon for applications in materials science and chemistry, a global hybrid event. These projects spanned seven key research areas: (1) molecular and material property prediction, (2) molecular and material design, (3) automation and novel interfaces, (4) scientific communication and education, (5) research data management and automation, (6) hypothesis generation and evaluation, and (7) knowledge extraction and reasoning from the scientific literature. Collectively, these applications illustrate how LLMs serve as versatile predictive models, platforms for rapid prototyping of domain-specific tools, and much more. In particular, improvements in both open source and proprietary LLM performance through the addition of reasoning, additional training data, and new techniques have expanded effectiveness, particularly in low-data environments and interdisciplinary research. As LLMs continue to improve, their integration into scientific workflows presents both new opportunities and new challenges, requiring ongoing exploration, continued refinement, and further research to address reliability, interpretability, and reproducibility.

Computer Science↗

Reliability, stability during long-term storage, and intra-individual variation of circulating levels of osteopontin, osteoprotegerin, vascular endothelial growth factor-A, and interleukin-17A

Background: Studies in many populations have reported associations between circulating cytokine levels and various physiological or pathological conditions. However, the reliability of cytokine measurements in population studies, which measure cytokines in multiple assays over a prolonged period, has not been adequately examined; nor has stability during sample storage or intra-individual variation been assessed. Methods: We assessed (1) analytical reliability in short- and long-term repeated measurements; (2) stability and analytical reliability during long-term sample storage, and (3) variability within individuals over seasons, of four cytokines—osteopontin (OPN), osteoprotegerin (OPG), vascular endothelial growth factor-A (VEGF-A), and interleukin-17A (IL-17A). Measurements in plasma or serum samples were made with commercial kits according to standard procedures. Estimation was performed by fitting a random or mixed effects linear model on the log scale. Results: In repeated assays over a short period, OPN, OPG, and VEGF-A had acceptable reliability, with intra- and inter-assay coefficients of variation (CV) less than 0.11. Reliability of IL-17A was poor, with inter- and intra-assay CV 0.85 and 0.43, respectively. During long-term storage, OPG significantly decayed (-33% per year; 95% confidence interval [-54, -3.7]), but not OPN or VEGF-A (-0.3% or -6.3% per year, respectively). Intra- and inter-assay CV over a long period were comparable to that in a short period except for a slight increase in inter-assay CV of VEGF-A. Within-individual variation was small for OPN and VEGF-A, with intra-class correlations (ICC) 0.68 and 0.83, respectively, but large for OPG (ICC 0.11). Conclusions: We conclude that OPN and VEGF-A can be reliably measured in a large population, that IL-17A is suitable only for small experiments, and that OPG should be assessed with caution due to degradation during storage and intra-individual variation. The overall results of our study illustrate the need for validation under relevant conditions when measuring circulating cytokines in population studies.

60 APPLIED LIFE SCIENCES↗

Dynamic Rupture Modeling of the M7.1, 2019 Ridgecrest, California, Earthquake

An important part of the simulation technique implemented in the strong motion prediction recipe developed in Japan, originally proposed by Irikura and Miyake (2011) is the earthquake rupture characterization that is based on established empirical scaling relationships between source parameters and seismic moment. These scaling relationships and rupture characterization are derived from recorded data and are tested by simulations. Recent analysis of results obtained with the Recipe for the 2016 M7.1 Kumamoto earthquake performed by several researchers, indicate that in order to reproduce near-fault long-period ground motions with permanent displacements, typical for earthquakes with surface rupturing, the recipe needs modifications. In particular, improvements are required in characterizing the rupture kinematics at shallow depths, above the seismogenic zone (Irikura et al., 2019). Modeling of rupture dynamics for recorded earthquakes, and numerical simulations for different rupture scenarios, provides physical constrains on slip evolution in time and space, which can be used in adjustments of empirical source scaling relationships for large crustal earthquakes. In this study we mainly focused on rupture dynamics modeling of the 2019 M7 Ridgecrest, California earthquake. The characterization of the kinematic rupture model derived from the dynamic rupture models of this earthquake can inform further refinements of rupture modeling proposed by the Recipe. Through different rupture scenarios we investigated potential relationships between characteristics of Long Period Ground Motion Generation Area (LMGA), used in the Recipe, and asperity depth and rupture initiation.

58 GEOSCIENCES↗

The Parallel System for Integrating Impact Models and Sectors (pSIMS)

We present a framework for massively parallel climate impact simulations: the parallel System for Integrating Impact Models and Sectors (pSIMS). This framework comprises a) tools for ingesting and converting large amounts of data to a versatile datatype based on a common geospatial grid; b) tools for translating this datatype into custom formats for site-based models; c) a scalable parallel framework for performing large ensemble simulations, using any one of a number of different impacts models, on clusters, supercomputers, distributed grids, or clouds; d) tools and data standards for reformatting outputs to common datatypes for analysis and visualization; and e) methodologies for aggregating these datatypes to arbitrary spatial scales such as administrative and environmental demarcations. By automating many time-consuming and error-prone aspects of large-scale climate impacts studies, pSIMS accelerates computational research, encourages model intercomparison, and enhances reproducibility of simulation results. We present the pSIMS design and use example assessments to demonstrate its multi-model, multi-scale, and multi-sector versatility.

crop modeling↗

Tracking and Establishing Provenance of Earth Science Datasets: A NASA-based Example

Information quality is of paramount importance to science. Accurate, scientifically vetted and statistically meaningful and, ideally, reproducible information engenders scientific trust and research opportunities. Therefore, so-called Highly Influential Scientific Assessments (HISA) such as the U.S. Third National Climate Assessment undergo a very rigorous process to ensure transparency and credibility. As an activity to support the transparency of such reports, the U.S. Global Change Research Program has developed the Global Change Information System (GCIS). Specifically related to the transparency of NCA3, a recent activity was carried out to trace the provenance as completely as possible for all figures in the NCA3 report that predominantly used NASA data. This paper discusses lessons learned from this activity that trace the provenance of NASA figures in a major HISA-class pdf report.

Ramapriyan, Hampapuram K.↗

Tracking and Establishing Provenance of Earth Science Datasets: A NASA-Based Example

Information quality is of paramount importance to science. Accurate, scientifically vetted and statistically meaningful and, ideally, reproducible information engenders scientific trust and research opportunities. Not surprisingly, federal bodies (e.g., NASA, NOAA, USGS) have very strictly affirmed the importance of information quality in their product requirements. So-called Highly Influential Scientific Assessments (HISA) such as The Third US National Climate Assessment (NCA3) published in 2014 undergo a very rigorous review process to ensure transparency and credibility. To support the transparency of such reports, the U.S. Global Change Research Program (USGCRP) has developed the Global Change Information System (GCIS). A recent activity was performed to trace the provenance as completely as possible for all NCA3 figures that were predominantly based on NASA data. This poster presents the mechanics of that project and the lessons learned from that activity.

Ramapriyan, Hampapuram K.↗

Meshfree Methods for Modeling Chemo-Mechanical Cathode Cracking in Li-Ion Batteries

Through repeated charging and discharging, the electrodes of a Li-ion battery experience cyclic loading causing swelling and contraction due to the movement of lithium, also known as intercalation. This research focuses specifically on the chemo-mechanical cracking in the cathode. Because cathode particles are comprised of many randomly-oriented grains, which have highly anisotropic material properties, the expansion and contraction is very non-uniform. As a result, stress concentrations tend to form between grains, which necessitates the modeling of crack propagation largely along grain boundaries. Chemo-mechanical models are simulated mainly by two methods: the cohesive zone model (CZM) and the continuous damage model (CDM). The CZM is more accurate at capturing the sharp discontinuities of a crack but is very computationally expensive and intractable for large-scale models as a result. Conversely, the CDM is easily computed but not well-suited to easily allow for discontinuous field variables, which are inherent across a crack. This study aims to improve the CDM's ability to capture discontinuous cracks. Current versions of the CDM use the finite element method (FEM), which is one of the most widely used approaches for spatial discretization. This research investigates the use of the Reproducing Kernel Particle Method (RKPM), a meshfree method, for spatial discretization and aims to achieve a chemo-mechanical crack propagation model that achieves both intermediate accuracy and computational time between a CDM and CZM. To gain a better understanding of how the meshfree model compares to the current FEM model in capturing cathode crack propagation, further investigation is needed.

cathode cracking↗

Meshfree Multiphysics Damage Modeling of Li-ion Battery Materials

Through repeated charging and discharging cycles, the electrodes of a Li-ion battery experience significant swelling and contraction due to the movement of lithium, also known as intercalation. This research focuses specifically on the chemo-mechanical cracking in the cathode. Because cathode particles are comprised of many randomly-oriented grains, which have highly anisotropic material properties, the expansion and contraction is very non-uniform. As a result, stress concentrations tend to form between grains, which necessitates the modeling of crack propagation largely along grain boundaries and material interfaces. Chemo-mechanical damage models are generally simulated by one of two methods: the cohesive zone model (CZM) and the continuous damage model (CDM). The CZM is more accurate at capturing the sharp discontinuities of a crack but is very computationally expensive and intractable for large-scale models as a result. Conversely, the CDM is easily computed but not well-suited to easily allow for discontinuous field variables, which are inherent across a crack. This study aims to improve the CDM's ability to capture discontinuous cracks. Current versions of the CDM use the finite element method (FEM), which is one of the most widely used approaches for spatial discretization. This research investigates the use of the Reproducing Kernel Particle Method (RKPM), a meshfree method, for spatial discretization and aims to achieve a coupled chemo-mechanical crack propagation model that enhances accuracy while maintaining high computational efficiency. This model features a fully coupled, iterative electrochemistry solution, which informs the meshfree damage model of impending crack formation. To gain a better understanding of how the meshfree model compares to the current FEM model in capturing cathode crack propagation, further investigation is needed.

damage modeling↗