SEARCH · Engineering Papers

Results for “best practice”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Uncertainty Analysis in Multi‐Sector Systems: Considerations for Risk Analysis, Projection, and Planning for Complex Systems

Abstract Simulation models of multi‐sector systems are increasingly used to understand societal resilience to climate and economic shocks and change. However, multi‐sector systems are also subject to numerous uncertainties that prevent the direct application of simulation models for prediction and planning, particularly when extrapolating past behavior to a nonstationary future. Recent studies have developed a combination of methods to characterize, attribute, and quantify these uncertainties for both single‐ and multi‐sector systems. Here, we review challenges and complications to the idealized goal of fully quantifying all uncertainties in a multi‐sector model and their interactions with policy design as they emerge at different stages of analysis: (a) inference and model calibration; (b) projecting future outcomes; and (c) scenario discovery and identification of risk regimes. We also identify potential methods and research opportunities to help navigate the tradeoffs inherent in uncertainty analyses for complex systems. During this discussion, we provide a classification of uncertainty types and discuss model coupling frameworks to support interdisciplinary collaboration on multi‐sector dynamics (MSD) research. Finally, we conclude with recommendations for best practices to ensure that MSD research can be properly contextualized with respect to the underlying uncertainties.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Informing Robust Functional Relationship Benchmarks: An Evaluation of the Temperature Sensitivity of Ecosystem Respiration Across the Arctic-Boreal Region

During land model development, simulated carbon dynamics are often benchmarked against observational data sets to evaluate model performance. Functional relationship benchmarks are the relationship between a driving variable (e.g., temperature) and a response variable (e.g., ecosystem respiration) and are a promising tool for assessing model performance by evaluating modeled sensitivities to changing environmental conditions. However, observed functional relationships can be influenced by choices made during data collection and throughout the benchmarking process, impacting the inferred skill of land models. To avoid misrepresenting a model's true performance, it is necessary to systematically evaluate best practices when constructing functional relationship benchmarks. We developed a set of guidelines for constructing functional relationship benchmarks, considering the choice of data set, number of daily observations, temporal extent, and temporal resolution across Alaska and Canada over a 20-year period from 2001 to 2020. The temperature sensitivity of ecosystem respiration from observations, evaluated through an apparent Q 10 , is highly variable both spatially and as a result of the data processing approach applied in the benchmark formation. When benchmarking 13 models from the Warming Permafrost Model Intercomparison Project (WrPMIP), the range in inferred model skill is substantially impacted by the choices applied in constructing functional relationship benchmarks. The inferred performance of a given model is most sensitive to the number of daily observations and temporal extent, followed by choice of benchmark data set and temporal averaging. Results from this analysis can guide the development of consistent and robust functional relationships for future model evaluation studies.

Poe, Jeralyn [Northern Arizona University, Flagsta↗

DOE OSTI2026

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

DOE OSTI2021

Integration of theory and experiment in the modelling of heterogeneous electrocatalysis.

Theoretical modelling is essential to deepen our understanding of heterogeneous electrocatalytic energy conversion processes, such as water splitting. Here, Sharon Hammes-Schiffer and Giulia Galli offer their perspectives on the best strategies for successfully studying such systems. Heterogeneous electrocatalysis is critical to many energy conversion processes. Theoretical and computational approaches are essential to interpret experimental data and provide the mechanistic understanding necessary to design more effective catalysts. However, automated general procedures to build predictive theoretical and computational frameworks are not readily available; specific choices must be made in terms of the atomistic structural model and the level of theory, as well as the experimental data used to inform and validate these choices. Here we outline some best practices for modelling heterogeneous systems and present examples in the context of catalysis at metal electrodes and oxides. The level of theory should be chosen for the specific system and properties of interest, and experimental validation is essential from the beginning to the end of the study. Continuous feedback and ultimate integration between experiment and theory enhances the power of calculations to elucidate mechanisms, identify effective descriptors and clarify design principles.

Hammes-Schiffer, Sharon↗

DOE OSTI2023

Challenges and opportunities for the mechanical reliability of metal halide perovskites and photovoltaics

The unproven reliability of perovskite photovoltaics (PVs) is likely to pose an important technical hurdle in the path towards the widespread deployment of the technology. The overall reliability of perovskite PVs is directly afected by the mechanical reliability of the metal halide perovskite material, cells and modules, but this issue has been largely overlooked. Here we stress the importance of addressing the mechanical reliability issue comprehensively. We highlight the important challenges and opportunities, together with best practices, pertaining to the three key interrelated elements that determine the mechanical reliability of perovskite PVs: driving stresses, mechanical properties and mechanical failure. Here, we discuss how to measure the driving stresses and mechanical properties accurately, together with their evolution over time, and the need to understand the relevant failure mechanisms and coupled efects. This efort will inform scientifc approaches to making perovskite PVs more reliable and durable and help them reach their full potential.

14 SOLAR ENERGY↗

DOE OSTI2025

Identification of the glassy state in nanoparticles by transmission electron microscopy

Identification of amorphous phases in nanoparticles by atomic-resolution transmission electron microscopy (TEM) requires analyses such as tilt-angle-dependent TEM imaging and single-nanoparticle electron diffraction, rather than relying on a single TEM image. Here, the disordered structures of amorphous nanoparticles offer unique atomic configurations and properties that differ from the properties of their crystalline counterparts. These characteristics have motivated the exploration of such materials for mechanical, sensing and catalytic applications. In addition, the formation of amorphous metal nanoparticles is an important endeavour to understand the process of vitrification and the nature of the glassy state. Atomic-resolution transmission electron microscopy (TEM) is increasingly being used as a tool for characterizing structures of nanoparticles produced by vitrification. In this Comment, we discuss the pitfalls of using TEM for ascertaining whether nanoparticles are amorphous. We also make recommendations of best practices.

Alcorn, Francis M. [Sandia National Laboratories (↗

DOE OSTI2023

Cohort-based learning for microbiome research community standards

Microbiome data standards are key to enabling data reuse, yet awareness and community adoption continue to be significant barriers to their broad implementation. The National Microbiome Data Collaborative launched an Ambassador Program based around a community learning model to broaden foundational knowledge and technical skills regarding microbiome metadata standards and best practices in data stewardship.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

A call for caution in the biological interpretation of viral auxiliary metabolic genes

Virus-encoded auxiliary metabolic genes (AMGs) are non-essential genes that increase viral fitness by maintaining or manipulating host metabolism during infection. AMGs are intriguing from an evolutionary perspective, as most viral genomes are highly compact and have limited coding capacity for accessory genes. Advances in viral (meta)genomics have expanded the detection of putative AMGs from viruses in diverse environments. However, this has also led to many instances of misannotation due to the limitations of annotation tools, resulting in misinterpretations about the roles of some viral genes. Here, we highlight studies that support claims about AMGs with more than just function predictions for guidance on best practices. We then propose the adoption of an expanded, inclusive view of all genes auxiliary to core viral functions with the term ‘auxiliary viral genes’ (AVGs), alongside an associated eco-evolutionary framework for considering the types of analyses that can better support claims made about AVGs.

Environmental microbiology↗

DOE OSTI2025

WorkflowHub: a registry for computational workflows

The rising popularity of computational workflows is driven by the need for repetitive and scalable data processing, sharing of processing know-how, and transparent methods. As both combined records of analysis and descriptions of processing steps, workflows should be reproducible, reusable, adaptable, and available. Workflow sharing presents opportunities to reduce unnecessary reinvention, promote reuse, increase access to best practice analyses for non-experts, and increase productivity. In reality, workflows are scattered and difficult to find, in part due to the diversity of available workflow engines and ecosystems, and because workflow sharing is not yet part of research practice. WorkflowHub provides a unified registry for all computational workflows that links to community repositories, and supports both the workflow lifecycle and making workflows findable, accessible, interoperable, and reusable (FAIR). By interoperating with diverse platforms, services, and external registries, WorkflowHub adds value by supporting workflow sharing, explicitly assigning credit, enhancing FAIRness, and promoting workflows as scholarly artefacts. The registry has a global reach, with hundreds of research organisations involved, and more than 800 workflows registered.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Photocatalytic water splitting

With the goal of achieving large-scale H 2 production from renewable resources, water splitting into H 2 and O 2 using semiconductor photocatalysts (sometimes called artificial photosynthesis) has been studied for five decades. Unfortunately, the lack of rigour and reproducibility in the data collection and analysis of experimental results has hindered progress in the field. This Primer provides a comprehensive overview of proper characterization and evaluation of photocatalysts for overall water splitting. In particular, the Primer covers various pitfalls in photocatalysis research, best practices for reproducibility and reliable methods for conducting rigorous experiments. As a result, the recommendations are intended to reduce false positives in the literature and to promote progress towards a practical technology for producing H 2 from water by using sunlight.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Ptychography at all wavelengths

Ptychography is a computational imaging technique that operates across multiple wavelength regimes, from electron (picometres) to X-ray (~0.1 nm), extreme ultraviolet (~10 nm) and visible light (micrometres). By reconstructing both amplitude and phase from diffraction patterns, ptychography enables high-resolution, quantitative imaging without conventional limitations imposed by lens-based optics. Ptychography has enabled advances across a range of scales: achieving deep-sub-angstrom resolution with electron microscopy, becoming an indispensable tool at X-ray synchrotron facilities worldwide and overcoming the trade-offs between resolution and field-of-view in optical imaging. This Primer provides a unified treatment of ptychography across these wavelength regimes. First, we discuss theoretical foundations, reconstruction algorithms, experimental considerations and wavelength-specific challenges. We then give examples of raw and processed data from various configurations and wavelengths. Next, we highlight key applications of ptychography in life sciences, materials science and industry. We also discuss data standards, open-source software implementations and best practices for ensuring reproducibility across different wavelength regimes. Finally, we consider limitations and future opportunities for ptychography. Together with accompanying datasets and code implementations, this Primer aims to serve newcomers and experienced practitioners in the field, facilitating broader adoption of ptychography across different disciplines.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Thermodynamic and kinetic hydricity of transition metal hydrides

The prevalence of transition metal-mediated hydride transfer reactions in chemical synthesis, catalysis, and biology has inspired the development of methods for characterizing the reactivity of transition metal hydride complexes. Thermodynamic hydricity represents the free energy required for heterolytic cleavage of the metal–hydride bond to release a free hydride ion, H - , as determined through equilibrium measurements and thermochemical cycles. Kinetic hydricity represents the rate of hydride transfer from one species to another, as measured through kinetic analysis. This tutorial review describes the common methods for experimental and computational determination of thermodynamic and kinetic hydricity, including advice on best practices and precautions to help avoid pitfalls. The influence of solvation on hydricity is emphasized, including opportunities and challenges arising from comparisons across several different solvents. Connections between thermodynamic and kinetic hydricity are discussed, and opportunities for utilizing these connections to rationally improve catalytic processes involving hydride transfer are highlighted.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Guidelines for performing lignin-first biorefining

With these guidelines, we aim to unite the lignin-first biorefining research field around best practices for performing or reporting feedstock analysis, reactor design, catalyst performance, and product yields.

09 BIOMASS FUELS↗

DOE OSTI2022

Creating ground truth for nanocrystal morphology: a fully automated pipeline for unbiased transmission electron microscopy analysis

Control over colloidal nanocrystal morphology (size, size distribution, and shape) is important for tailoring the functionality of individual nanocrystals and their ensemble behavior. Despite this, traditional methods to quantify nanocrystal morphology are laborious. New developments in automated morphology classification will accelerate these analyses but the assessment of machine learning models is limited by human accuracy for ground truth, causing even unsupervised machine learning models to have inherent bias. Herein, we introduce synthetic image rendering to solve the ground truth problem of nanocrystal morphology classification. By simulating 2D images of nanocrystal shapes via a function of high-dimensional parameter space, we trained a convolutional neural network to link unique morphologies to their simulated parameters, defining nanocrystal morphology quantitatively rather than qualitatively. An automated pipeline then processes, quantitatively defines, and classifies nanocrystal morphology from experimental transmission electron microscopy (TEM) images. Using improved computer vision techniques, 42,650 nanocrystals were identified, assessed, and labeled with quantitative parameters, offering a 600-fold improvement in efficiency over best-practice manual measurements. Further, a classification algorithm was trained with a prediction accuracy of 99.5%, which can successfully analyze a range of concave, convex, and irregular nanocrystal shapes. The resulting pipeline was applied to differentiating two syntheses of nominally cuboidal CsPbBr 3 nanocrystals and uniquely classifying binary nickel sulfide nanocrystal phase based on morphology. This pipeline provides a simple, efficient, and unbiased method to quantify nanocrystal morphology and represents a practical route to construct large datasets with an absolute ground truth for training unbiased morphology-based machine learning algorithms.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2020

WLCG Authorisation from X.509 to Tokens

The WLCG Authorisation Working Group was formed in July 2017 with the objective to understand and meet the needs of a future-looking Authentication and Authorisation Infrastructure (AAI) for WLCG experiments. Much has changed since the early 2000s when X.509 certificates presented the most suitable choice for authorisation within the grid; progress in token based authorisation and identity federation has provided an interesting alternative with notable advantages in usability and compatibility with external (commercial) partners. The need for interoperability in this new model is paramount as infrastructures and research communities become increasingly interdependent. Over the past two years, the working group has made significant steps towards identifying a system to meet the technical needs highlighted by the community during staged requirements gathering activities. Enhancement work has been possible thanks to externally funded projects, allowing existing AAI solutions to be adapted to our needs. A cornerstone of the infrastructure is the reliance on a common token schema in line with evolving standards and best practices, allowing for maximum compatibility and easy cooperation with peer infrastructures and services. We present the work of the group and an analysis of the anticipated changes in authorisation model by moving from X.509 to token based authorisation. A concrete example of token integration in Rucio is presented.

Bockelman, Brian↗

DOE OSTI2025

Evolution of the ATLAS TDAQ online software framework towards Phase-II upgrade: Use of Kubernetes as an orchestrator of the ATLAS Event Filter computing farm

The ATLAS experiment at the LHC at CERN continuously evolves its TDAQ system to meet the challenges of new physics goals and technological advancements. As ATLAS prepares for the Phase-II Run 4 of the LHC, significant enhancements in the TDAQ Controls and Configuration (TDAQ-CC) tools have been designed to ensure efficient data collection, processing, and management. This abstract presents the evolution of ATLAS TDAQ-CC system leading up to Phase-II Run 4. As part of the evolution towards Phase-II, Kubernetes has been chosen to orchestrate the Event Filter (EF) farm. By leveraging Kubernetes, ATLAS can dynamically allocate computing resources, scale processing capacity in response to changing data taking conditions and ensure high availability of data processing services. The integration of the Kubernetes with the TDAQ Run Control framework enables perfect synchronisation between the experiment’s data acquisition components and the computing infrastructure. We will discuss the architectural considerations and implementation challenges involved in Kubernetes integration with the ATLAS TDAQ-CC system. We will highlight the benefits of using Kubernetes as an EF farm orchestrator, including improved resource utilization, enhanced fault tolerance, and simplified deployment and management of data processing workflows. In addition, we will report on the extensive testing of Kubernetes that was conducted using a farm of 2500 servers within the experiment data taking environment, demonstrating its scalability and robustness in handling the demands of the ATLAS TDAQ system for Phase-II. The adoption of Kubernetes represents a significant step forward in the evolution of ATLAS TDAQ-CC system, aligning with industry best practices in container orchestration.

Corso Radu, Alina [Univ. of California, Irvine, CA↗

DOE OSTI2025

Exploiting Kubernetes to Simplify the Deployment and Management of the Multi-purpose CMS Pilot Job Factory

GlideinWMS, a widely utilized workload management system in high-energy physics (HEP) research, serves as the backbone for efficient job provisioning across distributed computing resources. It is utilized by various experiments and organizations, including CMS, OSG, Dune, and FIFE, to create HTCondor pools as large as 600k cores. In particular, a shared factory service historically deployed at UCSD has been configured to interface with more than 500 routes to compute clusters. As part of our team’s initiative to modernize infrastructure and enhance scalability, we undertook the migration of the GlideinWMS factory service into the Kubernetes environment. Leveraging the flexibility and orchestration capabilities of Kubernetes, we successfully deployed the factory service within the OSG Tiger Kubernetes cluster. The major benefits Kubernetes gives us is it streamlines the management and monitoring of the factory infrastructure, and improves fault tolerance through its resilient deployment strategies. Through this case study, we aim to share insights, challenges, and best practices encountered during the migration process. Our experience underscores the benefits of embracing containerization and Kubernetes orchestration for HEP computing infrastructure, paving the way for scalability and resilience in distributed computing environments.

Dost, Jeffrey Michael [UC, San Diego (main)]↗

DOE OSTI2020

Dam-Break Flow Measurements of Liquid–Granular Mixtures in a Channelized Reservoir

Dam-break flows of granular materials exhibit a complex non-Newtonian rheology, which is strongly influenced by various factors, such as the characteristics of the granular material, the degree of initial compaction, and saturation level of the granular matrix. Specially adapted nonintrusive techniques are required to investigate these flows in the laboratory. This paper investigated the nonintrusive technique of image analysis. The methodologies used in the measurement of bulk flow parameters, such as flow depth, front velocity, and flow rate, and the extraction of detailed flow characteristics such as velocity profiles, were discussed in the context of a series of granular dam-break flow experiments. These experiments were performed under three types of initial conditions: dry, saturated (water filling the pore space), and submerged (a layer of saturated granular material submerged under water) using four types of granular materials—PET pellets, crushed walnut shells, urea, and sand—with grain sizes ranging from 200 μm to 2.9 mm. High-speed cameras were used to capture the evolution and local properties of the flow, such as velocity fields using particle image velocimetry (PIV). Bulk properties of the flow were obtained by tracking the surface profile of the granular matrix and the water table. The extracted profiles were used to measure the evolution of the volume of the granular matrix and the fluid phase separately upstream and downstream of the gate, which allowed measuring the dilatancy (increase in pore space). The study showed that the image analysis techniques are versatile and can be adapted to measure different flow parameters in a variety of granular flows to better understand and analyze their complex behavior. Finally, the advantages and drawbacks of each image analysis technique were discussed and best-practice recommendations were provided.

42 ENGINEERING↗