Sas-temper: Software for fitting small-angle scattering data that provides automated reproducibility characterization
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “Reproducibility characterization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Characterizing the Reproducibility of Noisy Quantum Circuits
The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.
97 MATHEMATICS AND COMPUTING↗
Recommendations for improving rigor and reproducibility in site specific characterization
Heterogeneous catalysis is driven by the interaction of reactant molecules and the catalyst surface. The locus of this interaction as well as the surrounding ensemble of atoms is referred to as the catalyst active site. Active site characterization attempts to distinguish active catalytic sites from inactive surface sites, to elucidate the structural and chemical nature of active sites, and to quantify active site concentration. Numerous techniques have been demonstrated to provide compositional and structural information about the active sites within a catalyst. However, each technique has its own limitations and experimental pitfalls that can lead to data misinterpretation or irreproducible results. Further, this work aims to provide an overview of the types of data that can be collected, to outline common experimental challenges and how to avoid them, and to assemble relevant references for the most used active site characterization techniques. More broadly, we aim to outline best practices for researchers to collect, interpret, and report active site characterization data in a way that provides the most benefit to the broader catalysis community. Increasing the rigor and reproducibility of active site characterization offers a strategy to better link properties with catalytic performance and to enable the community to develop consensus concerning these relationships.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Perspective: Reproducible Coherence Characterization of Superconducting Quantum Devices
As the field of superconducting quantum computing approaches maturity, optimization of single-device performance is proving to be a promising avenue towards large-scale quantum computers. However, this optimization is possible only if performance metrics can be accurately compared among measurements, devices, and laboratories. Currently such comparisons are inaccurate or impossible due to understudied errors from a plethora of sources. In this Perspective, we outline the current state of error analysis for qubits and resonators in superconducting quantum circuits, and discuss what future investigations are required before superconducting quantum device optimization can be realized.
McRae, Corey H.↗
A Review of Existing Test Methods for Occupancy Sensors
One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict the performance of such sensors in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies (i.e., multimodal), have come on the market over the years, with claims of improved performance compared to their predecessors. However, in practice, their performance has neither differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them, nor has it led to high deployment or high user satisfaction in human-occupied spaces with persistent presence. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them typically have been loosely described and have incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a fully described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy-sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recently published fully described test methods for characterizing occupancy-sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates test conditions for characterizing sensor performance in indoor spaces and identifies apparent test method gaps that need to be filled in order to evaluate emerging technologies and products. The identified test-method conditions are intended to enable the development of a future technology-agnostic test method that facilitates occupancy-sensor performance characterization more-accurately representing performance in buildings.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
A Review of Existing Test Methods for Occupancy Sensors
One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict their performance in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies, have come on the market over the years, with claims of improved performance compared to their predecessors; yet in practice, their performance has led to neither high deployment nor high user satisfaction in any significant application, nor has it differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them have typically been loosely described and incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a well-described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, also additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recent published, well-described test methods for characterizing occupancy sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates the best techniques for characterizing sensor performance in indoor spaces and identifies test method gaps that need to be filled in order to evaluate emerging technologies and products.
47 OTHER INSTRUMENTATION↗
BiomeProbe [Abstract]
We propose the development and application of a microtiter plate-based chemical probe assay that can facilitate the rapid quantification of fecal microbiome-associated enzyme functional activities (“gut pharmacomicrobiomics”). Our initial proof-of-concept project with FedImpact is to show that one or more glucuronidase probes can be used for sensitive and reproducible characterization of fecal microbe glucuronidase activities. Glucuronidase enzymes are important for contributing to enterohepatic recycling of therapeutic drug compounds, resulting in impaired or prolonged drug activity. Importantly, the assay to be developed will permit facile ‘swapping’ of chemical probes to characterize different and multiple enzyme activities. Similarly, the assay is naïve to the biological sample to be analyzed.
59 BASIC BIOLOGICAL SCIENCES↗
Data From Experiments on Bubbling Fluidization of Zeolite in a Rectangular Bubbling Fluidized Bed
Fluidization experiments were conducted in a lab-scale rectangular bubbling fluidized bed with the objective of generating a high-quality dataset for model validation and artificial intelligence/machine learning (AI/ML) training. Zeolite was chosen as the bed material, and the fluidizing medium was air as supplied by a compressor. Three different flow rates at the inlet were chosen such that the particles were fluidized but not elutriated from the system. The test matrix involved randomization and replicates to provide uncertainty estimates as well as four different batches of zeolite as the bed material. The quantities of interest obtained from this study were statistics of differential pressures, interface heights, and particle velocities. Considering all the components of the elaborate test plan, the results obtained were consistent and reproducible. Characterization tests were performed to estimate particle properties including size, density, coefficient of friction, coefficient of restitution, and minimum fluidization velocity. In addition, the angle of repose from granular discharge experiments has been reported to account for rolling friction, though its effect on the overall process is expected to be negligible.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Materials characterization: Can artificial intelligence be used to address reproducibility challenges?
Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.
Materials Science↗
Automated ICRF heating surrogate modeling via machine learning
This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.
Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗
Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms
Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.
Dask↗
Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case
In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.
59 BASIC BIOLOGICAL SCIENCES↗
Rapid Open-Air Fabrication of Perovskite Solar Modules
We report on the open-air fabrication of perovskite solar modules with key advances including scalable large-area spray deposition, new monolithic integration scribing techniques, advanced photoluminescence characterization, and reproducible high-throughput manufacturability. Perovskite deposition with linear speeds of 12 m/min without a post-anneal are demonstrated with improved device performance, luminescent yield and >10X carrier lifetimes. Manufacturability using monolithic integration of series-connected modules is accomplished with a new indirect fiber laser ablation scribing method. A stable cell and module power output of 18.0% and 15.5%, respectively, was achieved with a subcell V oc > 1.06V. A comprehensive supporting technoeconomic analysis details the entire in-line manufacturing process from the glass substrate to the junction box of the encapsulated module. Here, the module manufacturing cost, balance of system costs and levelized cost of energy for a range of module efficiencies and lifetimes provides insights for the necessary tool speeds, efficiencies, and lifetimes for utility-scale energy generation.
14 SOLAR ENERGY↗
Rapid Open-Air Processing of Low-Cost Perovskite Solar Modules
We report an industrially relevant approach to both scalable and fast open-air perovskite photovoltaic (PV) module production. This work resolves some of the most formidable barriers to module-level scaling that the perovskite community has been facing. Key advances include scalable large-area spray deposition, new monolithic integration scribing techniques, advanced photoluminescence characterization, and reproducible high-throughput manufacturability. Our rapid spray processing techniques enabled the highest perovskite PV efficiency produced in open-air. Innovations in scribing techniques enabled the first single-source laser process to achieve perovskite module monolithic integration and technoeconomic analysis led to a comprehensive cost model for perovskite module manufacturing. We report significant progress in reducing perovskite manufacturing costs necessary to potentially compete with incumbent Si-based PV for utility-scale power generation.
cost modeling↗
Status of the MQXFB Nb 3 Sn Quadrupoles for the HL-LHC
Here, the cold powering test of the first two prototypes of the MQXFB quadrupoles (MQXFBP1, now disassembled, and MQXFBP2), the Nb 3 Sn inner triplet magnets to be installed in the HL-LHC, has validated many features of the design, such as field quality and quench protection, but has found performance limitations. In fact, both magnets showed a similar phenomenology, characterized by reproducible quenches in the straight part inner layer pole turn, with absence of training and limiting the performance at 93% (MQXFBP1) and 98% (MQXFBP2) of the nominal current at 1.9 K, required for HL-LHC operation at 7 TeV. Microstructural inspections of the quenching section of the limiting coil in MQXFBP1 have identified fractured Nb 3 Sn sub-elements in strands located at one specific position of the inner layer pole turn, allowing to determine the precise origin of the performance limitation. In this paper we outline the strategy that has been defined to address the possible sources of performance limitation, namely coil manufacturing, magnet assembly and integration in the cold mass.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Exploring the exact limits of the real-time equation-of-motion coupled cluster cumulant Green’s functions
In this paper, we analyze the properties of the recently proposed real-time equation-of-motion coupled-cluster (RT-EOM-CC) cumulant Green’s function approach [Rehr et al., J. Chem. Phys. 152, 174113 (2020)]. We specifically focus on identifying the limitations of the original time-dependent coupled cluster (TDCC) ansatz and propose an enhanced double TDCC ansatz, ensuring the exactness in the expansion limit. In addition, we introduce a practical cluster-analysis-based approach for characterizing the peaks in the computed spectral function from the RT-EOM-CC cumulant Green’s function approach, which is particularly useful for the assignments of satellite peaks when many-body effects dominate the spectra. Our preliminary numerical tests focus on reproducing, approximating, and characterizing the exact impurity Green’s function of the three-site and four-site single impurity Anderson models using the RT-EOM-CC cumulant Green’s function approach. The numerical tests allow us to have a direct comparison between the RT-EOM-CC cumulant Green’s function approach and other Green’s function approaches in the numerical exact limit.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
3-D Geological Modeling for Numerical Flow Simulation Studies of Gas Hydrate Reservoirs at the Kuparuk State 7-11-12 Pad in the Prudhoe Bay Unit on the Alaska North Slope
Accurate reservoir evaluation requires reliable three-dimensional (3-D) geological models. Here, this study conducted 3-D geological modeling for numerical flow simulation of the B1 sand gas hydrate reservoir at the Kuparuk State 7-11-12 pad, Prudhoe Bay Unit, Alaska North Slope. The model integrates well logs, core, and seismic data to address spatial heterogeneity in geological structures and reservoir properties. Two modeling types were performed: structural framework modeling and petrophysical property modeling. For structural framework modeling, seismic data and well log markers were used to reproduce subsurface structures characterized by a normal fault system. A volume-based modeling algorithm and stair-stepping grid were applied. The resulting 3-D model comprised 2,640,000 grid cells across 264 layers, including seven fault grids. For petrophysical property modeling, total porosity was initially modeled using sequential Gaussian simulation with collocated cokriging. To reproduce the upward coarsening of the B1 sand, upscaled log-derived total porosity and a three-dimensional (3-D) trend depicting total porosity variation were used as primary and secondary data, respectively. Gas hydrate saturation distribution was modeled similarly, with secondary data from estimated porosity distribution and seismic-derived acoustic impedance map enhancing accuracy. Results indicate higher gas hydrate saturation in the upper part of the B1 sand and areas with higher acoustic impedance. Intrinsic permeability was modeled from the total porosity and clay-bound water volume, and effective permeability was derived from the gas hydrate saturation and intrinsic permeability distributions based on the “Tokyo model”. Effective permeability distributions were influenced by the total porosity, gas hydrate saturation, and intrinsic permeability. Within the same layer, higher gas hydrate saturation leads to decreased effective permeability. In total, 100 sets of multiple scenarios were prepared, providing input data for dynamic flow simulations to evaluate the effects of lateral heterogeneity in reservoir properties and the hydraulic characteristics of faults on production behavior for preassessment before the long-term production test.
58 GEOSCIENCES↗
Frequency reproducibility of solid-state thorium-229 nuclear clocks
Solid-state thorium-229 ( 229 Th) nuclear clocks are set to provide new opportunities for precision metrology and fundamental physics. Taking advantage of inherent low sensitivity of a nuclear transition to its environment, orders of magnitude more emitters can be hosted in a solid-state crystal compared with current optical lattice atomic clocks. Furthermore, solid-state systems needing only simple thermal control are key to the development of field-deployable compact clocks. Here we explore and characterize the frequency reproducibility of the 229 Th:CaF 2 nuclear clock transition, a key performance metric for all clocks. We measure the transition linewidth and centre frequency as a function of the doping concentration, temperature and time. We report the concentration-dependent inhomogeneous linewidth of the nuclear transition, limited by the intrinsic host crystal properties. We determine an optimal working temperature for the 229 Th:CaF 2 nuclear clock at 196(5) K, at which the first-order thermal sensitivity vanishes. This would enable in situ temperature co-sensing using different quadrupole-split lines, reducing the temperature-induced systematic shift below the 10 −18 fractional frequency uncertainty level. At 195 K, the reproducibility of the nuclear transition frequency is 220 Hz (fractionally 1.1 × 10 −13 ) for two differently doped 229 Th:CaF 2 crystals over 7 months. Furthermore, these results form the foundation for understanding, controlling and harnessing the coherent nuclear excitation of 229 Th in solid-state hosts and for their applications in constraining temporal variations of fundamental constants.
Atomic and molecular physics↗