Sas-temper: Software for fitting small-angle scattering data that provides automated reproducibility characterization
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “Reproducibility characterization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Development of characterized and reproducible syntactic foam of phenolic nylon for heat shields Final report, 1 Feb. - 31 Dec. 1965
Characterization and reproducibility of nylon phenolic resin syntactic foam for use in ablative heat shields of Scout vehicle nosecaps
ABLATING MATERIAL↗
Characterizing the Reproducibility of Noisy Quantum Circuits
The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.
97 MATHEMATICS AND COMPUTING↗
Recommendations for improving rigor and reproducibility in site specific characterization
Heterogeneous catalysis is driven by the interaction of reactant molecules and the catalyst surface. The locus of this interaction as well as the surrounding ensemble of atoms is referred to as the catalyst active site. Active site characterization attempts to distinguish active catalytic sites from inactive surface sites, to elucidate the structural and chemical nature of active sites, and to quantify active site concentration. Numerous techniques have been demonstrated to provide compositional and structural information about the active sites within a catalyst. However, each technique has its own limitations and experimental pitfalls that can lead to data misinterpretation or irreproducible results. Further, this work aims to provide an overview of the types of data that can be collected, to outline common experimental challenges and how to avoid them, and to assemble relevant references for the most used active site characterization techniques. More broadly, we aim to outline best practices for researchers to collect, interpret, and report active site characterization data in a way that provides the most benefit to the broader catalysis community. Increasing the rigor and reproducibility of active site characterization offers a strategy to better link properties with catalytic performance and to enable the community to develop consensus concerning these relationships.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Perspective: Reproducible Coherence Characterization of Superconducting Quantum Devices
As the field of superconducting quantum computing approaches maturity, optimization of single-device performance is proving to be a promising avenue towards large-scale quantum computers. However, this optimization is possible only if performance metrics can be accurately compared among measurements, devices, and laboratories. Currently such comparisons are inaccurate or impossible due to understudied errors from a plethora of sources. In this Perspective, we outline the current state of error analysis for qubits and resonators in superconducting quantum circuits, and discuss what future investigations are required before superconducting quantum device optimization can be realized.
McRae, Corey H.↗
A Review of Existing Test Methods for Occupancy Sensors
One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict the performance of such sensors in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies (i.e., multimodal), have come on the market over the years, with claims of improved performance compared to their predecessors. However, in practice, their performance has neither differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them, nor has it led to high deployment or high user satisfaction in human-occupied spaces with persistent presence. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them typically have been loosely described and have incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a fully described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy-sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recently published fully described test methods for characterizing occupancy-sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates test conditions for characterizing sensor performance in indoor spaces and identifies apparent test method gaps that need to be filled in order to evaluate emerging technologies and products. The identified test-method conditions are intended to enable the development of a future technology-agnostic test method that facilitates occupancy-sensor performance characterization more-accurately representing performance in buildings.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
A Review of Existing Test Methods for Occupancy Sensors
One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict their performance in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies, have come on the market over the years, with claims of improved performance compared to their predecessors; yet in practice, their performance has led to neither high deployment nor high user satisfaction in any significant application, nor has it differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them have typically been loosely described and incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a well-described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, also additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recent published, well-described test methods for characterizing occupancy sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates the best techniques for characterizing sensor performance in indoor spaces and identifies test method gaps that need to be filled in order to evaluate emerging technologies and products.
47 OTHER INSTRUMENTATION↗
BiomeProbe [Abstract]
We propose the development and application of a microtiter plate-based chemical probe assay that can facilitate the rapid quantification of fecal microbiome-associated enzyme functional activities (“gut pharmacomicrobiomics”). Our initial proof-of-concept project with FedImpact is to show that one or more glucuronidase probes can be used for sensitive and reproducible characterization of fecal microbe glucuronidase activities. Glucuronidase enzymes are important for contributing to enterohepatic recycling of therapeutic drug compounds, resulting in impaired or prolonged drug activity. Importantly, the assay to be developed will permit facile ‘swapping’ of chemical probes to characterize different and multiple enzyme activities. Similarly, the assay is naïve to the biological sample to be analyzed.
59 BASIC BIOLOGICAL SCIENCES↗
Data From Experiments on Bubbling Fluidization of Zeolite in a Rectangular Bubbling Fluidized Bed
Fluidization experiments were conducted in a lab-scale rectangular bubbling fluidized bed with the objective of generating a high-quality dataset for model validation and artificial intelligence/machine learning (AI/ML) training. Zeolite was chosen as the bed material, and the fluidizing medium was air as supplied by a compressor. Three different flow rates at the inlet were chosen such that the particles were fluidized but not elutriated from the system. The test matrix involved randomization and replicates to provide uncertainty estimates as well as four different batches of zeolite as the bed material. The quantities of interest obtained from this study were statistics of differential pressures, interface heights, and particle velocities. Considering all the components of the elaborate test plan, the results obtained were consistent and reproducible. Characterization tests were performed to estimate particle properties including size, density, coefficient of friction, coefficient of restitution, and minimum fluidization velocity. In addition, the angle of repose from granular discharge experiments has been reported to account for rolling friction, though its effect on the overall process is expected to be negligible.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Crystal Size Distributions from Porphyritic Olivine Chondrules: Insights into Formation Conditions
Most chondrules preserve, in their texture, a record of their precursor material and the nature and intensity of the nebular events in which they were formed. We have used crystal size distributions (CSDs) together with crystallization experiments to explore the textures of natural chondrules and their relationships to natural formation conditions. Many careful experimental studies have demonstrated fundamental relationships between the texture of a chondrule and its precursor material, melting intensity, and cooling rate. However, until recently most studies have focused on distinctions between textural types (e.g., barred, radial, porphyritic). Previous work has shown that CSDs provide precise, reproducible characterizations of chondrule-scale textures, and can be used together with crystallization experiments to estimate chondrule formation conditions. Here, we expand this study to investigate the link between texture and formation conditions for a range of natural porphyritic olivine (PO) chondrules.
Zieg, M. J.↗
Materials characterization: Can artificial intelligence be used to address reproducibility challenges?
Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.
Materials Science↗
Automated ICRF heating surrogate modeling via machine learning
This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.
Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗
Characterizing the Superconducting-to-Normal Transition in Mo/Au Transition-Edge Sensor Bilayers
We are developing arrays of Mo/Au bilayer transition-edge sensors (TES's) for applications in future X-ray astronomy missions such as NASA's Constellation-X. The physical properties of the superconducting-to-normal transition in our TES bilayers, while often reproducible and characterized, are not well understood. The addition of normal metal features on top of the bilayer are found to change the shape and temperature of the transition, and they typically reduce the unexplained 'excess' noise. In order to understand and potentially optimize the properties of the transition, we have been studying the temperature, widths and current dependence of these transitions. We report on the characterization of devices both deposited on silicon substrates and suspended on thin silicon nitride membranes. This includes key device parameters such as the logarithmic resistance sensitivity with temperature alpha, and the logarithmic resistance sensitivity with current beta, of the phase-transition. We investigate alpha and beta as a function of current, both at fixed and varying bias points in the transition. Using Ginzburg-Landau theory for the current dependence of the superconducting transition temperature, we investigate the relationship between alpha and beta and compare our measured and theoretical estimates.
Smith, Stephen J.↗
Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms
Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.
Dask↗
Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case
In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.
59 BASIC BIOLOGICAL SCIENCES↗
Rapid Open-Air Fabrication of Perovskite Solar Modules
We report on the open-air fabrication of perovskite solar modules with key advances including scalable large-area spray deposition, new monolithic integration scribing techniques, advanced photoluminescence characterization, and reproducible high-throughput manufacturability. Perovskite deposition with linear speeds of 12 m/min without a post-anneal are demonstrated with improved device performance, luminescent yield and >10X carrier lifetimes. Manufacturability using monolithic integration of series-connected modules is accomplished with a new indirect fiber laser ablation scribing method. A stable cell and module power output of 18.0% and 15.5%, respectively, was achieved with a subcell V oc > 1.06V. A comprehensive supporting technoeconomic analysis details the entire in-line manufacturing process from the glass substrate to the junction box of the encapsulated module. Here, the module manufacturing cost, balance of system costs and levelized cost of energy for a range of module efficiencies and lifetimes provides insights for the necessary tool speeds, efficiencies, and lifetimes for utility-scale energy generation.
14 SOLAR ENERGY↗
Rapid Open-Air Processing of Low-Cost Perovskite Solar Modules
We report an industrially relevant approach to both scalable and fast open-air perovskite photovoltaic (PV) module production. This work resolves some of the most formidable barriers to module-level scaling that the perovskite community has been facing. Key advances include scalable large-area spray deposition, new monolithic integration scribing techniques, advanced photoluminescence characterization, and reproducible high-throughput manufacturability. Our rapid spray processing techniques enabled the highest perovskite PV efficiency produced in open-air. Innovations in scribing techniques enabled the first single-source laser process to achieve perovskite module monolithic integration and technoeconomic analysis led to a comprehensive cost model for perovskite module manufacturing. We report significant progress in reducing perovskite manufacturing costs necessary to potentially compete with incumbent Si-based PV for utility-scale power generation.
cost modeling↗
Status of the MQXFB Nb 3 Sn Quadrupoles for the HL-LHC
Here, the cold powering test of the first two prototypes of the MQXFB quadrupoles (MQXFBP1, now disassembled, and MQXFBP2), the Nb 3 Sn inner triplet magnets to be installed in the HL-LHC, has validated many features of the design, such as field quality and quench protection, but has found performance limitations. In fact, both magnets showed a similar phenomenology, characterized by reproducible quenches in the straight part inner layer pole turn, with absence of training and limiting the performance at 93% (MQXFBP1) and 98% (MQXFBP2) of the nominal current at 1.9 K, required for HL-LHC operation at 7 TeV. Microstructural inspections of the quenching section of the limiting coil in MQXFBP1 have identified fractured Nb 3 Sn sub-elements in strands located at one specific position of the inner layer pole turn, allowing to determine the precise origin of the performance limitation. In this paper we outline the strategy that has been defined to address the possible sources of performance limitation, namely coil manufacturing, magnet assembly and integration in the cold mass.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗