Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sampling methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Elucidating proximity magnetism through polarized neutron reflectometry and machine learning

Polarized neutron reflectometry is a powerful technique to interrogate the structures of multilayered magnetic materials with depth sensitivity and nanometer resolution. However, reflectometry profiles often inhabit a complicated objective function landscape using traditional fitting methods, posing a significant challenge for parameter retrieval. In this work, we develop a data-driven framework to recover the sample parameters from polarized neutron reflectometry data with minimal user intervention. We train a variational autoencoder to map reflectometry profiles with moderate experimental noise to an interpretable, low-dimensional space from which sample parameters can be extracted with high resolution. We apply our method to recover the scattering length density profiles of the topological insulator–ferromagnetic insulator heterostructure Bi2Se3/EuS exhibiting proximity magnetism in good agreement with the results of conventional fitting. We further analyze a more challenging reflectometry profile of the topological insulator–antiferromagnet heterostructure (Bi,Sb)2Te3/Cr2O3 and identify possible interfacial proximity magnetism in this material. We anticipate that the framework developed here can be applied to resolve hidden interfacial phenomena in a broad range of layered systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Two-Step Hyperparameter Optimization Method: Accelerating Hyperparameter Search by Using a Fraction of a Training Dataset

Abstract Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic—primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms introduces added complexity to the workflow, leading to longer computation times. This poses a notable challenge to ML applications, as suboptimal hyperparameter selections curtail the potential of ML model performance, ultimately obstructing the full exploitation of ML techniques. In this article, we present a two-step HPO method as a strategic solution to curbing computational demands and wait times, gleaned from practical experiences in applied ML parameterization work. The initial phase involves a preliminary evaluation of hyperparameters on a small subset of the training dataset, followed by a reevaluation of the top-performing candidate models postretraining with the entire training dataset. This two-step HPO method is universally applicable across HPO search algorithms, and we argue it has attractive efficiency gains. As a case study, we present our recent application of the two-step HPO method to the development of neural network emulators for aerosol activation. Although our primary use case is a data-rich limit with many millions of samples, we also find that using up to 0.0025% of the data—a few thousand samples—in the initial step is sufficient to find optimal hyperparameter configurations from much more extensive sampling, achieving up to 135× speedup. The benefits of this method materialize through an assessment of hyperparameters and model performance, revealing the minimal model complexity required to achieve the best performance. The assortment of top-performing models harvested from the HPO process allows us to choose a high-performing model with a low inference cost for efficient use in global climate models (GCMs).

97 MATHEMATICS AND COMPUTING↗

The eROSITA Final Equatorial-Depth Survey (eFEDS)

Aims. The eROSITA Final Equatorial-Depth Survey (eFEDS), executed during the performance verification phase of the Spectrum-Roentgen-Gamma (SRG)/eROSITA telescope, was completed in November 2019. One of the science goals of this survey is to demonstrate the ability of eROSITA to detect samples of clusters and groups at the final depth of the eROSITA all-sky survey. Methods. Because of the sizeable (≈26" HEW FOV average) point-spread function of eROSITA, high-redshift clusters of galaxies or compact nearby groups hosting bright active galactic nuclei (AGN) can be misclassified as point sources by the source detection algorithms. A total of 346 galaxy clusters and groups in the redshift range of 0.1 < z < 1.3 were identified based on their red sequenc in the eFEDS point source catalog. Results. We examine the multiwavelength properties of these clusters and groups to understand the potential biases in our selection process and the completeness of the extent-selected sample. We find that the majority of the clusters and groups in the point source sample are indeed underluminous and compact compared to the extent-selected sample. Their faint X-ray emission, well below the flux limit of the extent-selected eFEDS clusters, and their compact X-ray emission are likely to be the main reason for this misclassification. In the sample, we confirm that 10% of the sources host AGN in their brightest cluster galaxies (BCGs) through optical spectroscopy and visual inspection. By studying their X-ray, optical, infrared, and radio properties, we establish a method for identifying clusters and groups that host AGN in their BCGs. We successfully test this method on the current point source catalog through the Sloan Digital Sky Survey optical spectroscopy and find eight low-mass clusters and groups with active radio-loud AGN that are particularly bright in the infrared. They include eFEDS J091437.8+024558, eFEDS J083520.1+012516, and eFEDS J092227.1+043339 at redshifts 0.3-0.4. Conclusions. This study helps us to characterize and understand our selection process and assess the completeness of the eROSITA extent-selected samples. The method we developed will be used to identify high-redshift clusters, AGN-dominated groups, and low-mass clusters that are misclassified in the future eROSITA all-sky survey point source catalogs.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating Optical Techniques to Characterize Solid State Samples for the Pu-238 Supply Program

This report documents steps that have been taken to establish advanced characterization capabilities for solid-state samples to support the 238 Pu Supply Program. The program has already invested significantly in spectroscopy and online monitoring development for liquid processes. Many of the data, analytical methods, and equipment could also be leveraged for the analysis of Np/Pu oxides and Np pellets to help classify material properties and link them to operations. The techniques described in this work include diffuse reflectance spectroscopy (DRS), Raman spectroscopy, and laser-induced breakdown spectroscopy (LIBS). Each technique is sensitive to various chemical and/or elemental species and can provide complimentary information to more standard methods such as powder x-ray diffraction and scanning electron microscopy. These options are remotely deployable via fiber-optic cables. DRS and Raman spectroscopy are already approved for glove box and hot cell work, but LIBS requires US Department of Energy approval for incorporation. Raman spectroscopy does require laser shielding, which means that DRS is the easiest method to implement. However, each technique provides complimentary data, and the most robust sample characterization could be achieved when all three, among other methods, are harnessed together. This report documents some of the progress made testing these capabilities, some of the challenges, and next steps to optimize the technology and integration strategies.

07 ISOTOPE AND RADIATION SOURCES↗

Controlled removal of hydrogen atoms from H-terminated silicon surfaces

The controlled formation of dangling bond structures on a H-terminated silicon surface is the first step in an atomically precise method of fabrication of silicon quantum electronic devices. An ultrahigh vacuum scanning tunneling microscope (STM) tip is used to selectively desorb hydrogen atoms from a Si(100)-2x1:H surface by injecting electrons with the sample held at a positive bias voltage. The authors propose a lithography method that allows the STM to operate under negative bias imaging conditions and simultaneously desorb H atoms as required. A high frequency signal is added to the negative bias voltage to deliver the required energy for hydrogen removal. The resulting current at this frequency and its harmonics are filtered to minimize their effect on the operation of the STM’s feedback control loop. The authors show that the chance of tip-sample crash during the lithography process is reduced by employing this method. They also demonstrate that this approach offers a significant potential for controlled and precise removal of H atoms from a H-terminated silicon surface and thus may be used for the fabrication of practical silicon-based atomic-scale devices.

42 ENGINEERING↗

Machine learning with knowledge constraints for process optimization of open-air perovskite solar cell manufacturing

Perovskite photovoltaics (PV) have achieved rapid development in the past decade in terms of power conversion efficiency of small-area lab-scale devices; however, successful commercialization still requires further development of low-cost, scalable, and high-throughput manufacturing techniques. One of the critical challenges of developing a new fabrication technique is the high-dimensional parameter space for optimization, but machine learning (ML) can readily be used to accelerate perovskite PV scaling. Herein, we present an ML-guided framework of sequential learning for manufacturing process optimization. We apply our methodology to the Rapid Spray Plasma Processing (RSPP) technique for perovskite thin films in ambient conditions. With a limited experimental budget of screening 100 process conditions, we demonstrated an efficiency improvement to 18.5% as the best-in-our-lab device fabricated by RSPP, and we also experimentally found 10 unique process conditions to produce the top-performing devices of more than 17% efficiency, which is 5 times higher rate of success than the control experiments with pseudo-random Latin hypercube sampling. Our model is enabled by three innovations: (a) flexible knowledge transfer between experimental processes by incorporating data from prior experimental data as a probabilistic constraint; (b) incorporation of both subjective human observations and ML insights when selecting next experiments; (c) adaptive strategy of locating the region of interest using Bayesian optimization first, and then conducting local exploration for high-efficiency devices. Furthermore, in virtual benchmarking, our framework achieves faster improvements with limited experimental budgets than traditional design-of-experiments methods (e.g., one-variable-at-a-time sampling). This framework shows the capability of incorporating researchers’ domain knowledge into the ML-guided optimization loop; therefore, it has the potential to facilitate the wider adoption of ML in scaling to perovskite PV manufacturing.

14 SOLAR ENERGY↗

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗

Detecting optical transients using artificial neural networks and reference images from different surveys

ABSTRACT We present a technique to detect optical transients based on an artificial neural networks method. We describe the architecture of two networks capable of comparing images of the same part of the sky taken by different telescopes. One image corresponds to the epoch in which a potential transient could exist; the other is a reference image of an earlier epoch. We use data obtained by the Dr. Cristina V. Torres Memorial Astronomical Observatory and archival reference images from the Sloan Digital Sky Survey. We trained a convolutional neural network and a dense layer network on simulated source samples and then tested the trained networks on samples created from real image data. Autonomous detection methods replace the standard process of detecting transients, which is normally achieved by source extraction of a difference image followed by human inspection of the detected candidates. Replacing the human inspection component with an entirely autonomous method would allow for a rapid and automatic follow-up of interesting targets of opportunity. The toy-model pipeline that we present here is not yet able to replace human inspection, but it might provide useful hints to identify potential candidates. The method will be further expanded and tested on telescopes participating in the Transient Optical Robotic Observatory of the South Collaboration.

79 ASTRONOMY AND ASTROPHYSICS↗

Role of the likelihood for elastic scattering uncertainty quantification

In the last decade, uncertainty quantification (UQ) for optical model potentials (OMPs) has become a focal point for nuclear reaction theory, and several competing approaches for OMP UQ have recently been developed. Here, we clarify recent efforts to compare frequentist and Bayesian approaches in the context of OMP UQ [G. B. King et al., Phys. Rev. Lett. 122, 232502 (2019)]. We replicate a portion of that OMP UQ study but use independent statistical tools. Specifically, we compare two methods for OMP parameter inference from elastic scattering data: the Levenberg-Marquardt algorithm for χ 2 minimization on one hand and Markov chain Monte Carlo (MCMC) sampling on the other. Separately, we assess the common practice of using a renormalized likelihood (χ 2 /N), N being the number of data points, instead of the canonical weighted-least-squares likelihood (χ 2 ), as a way of accounting for unknown data correlations. Here, we show that for a generic linear model and for a five-parameter OMP analysis, frequentist and uniform-prior Bayesian approaches recover the same optimum and uncertainty estimates—not systematically larger uncertainties for the Bayesian approach, as was concluded in G. B. King et al., Phys. Rev. Lett. 122, 232502 (2019). Further, we show that if an additional, near-degenerate parameter is introduced into the same OMP analysis such that the parameter posterior becomes non-Gaussian, then covariance-based estimates of uncertainty become unreliable. Finally, we show that regardless of optimization approach, if χ 2 /N is used for the likelihood, the resulting parametric uncertainties increase by $\sqrt{N}$, and that this is responsible for the conclusions drawn in the revisited study. Based on our replication results, we find that a fortuitous cancellation of unreported errors and the renormalization factor can lead to improvement in empirical coverages, as was the case in the original comparative study. We emphasize that developing and applying a realistic likelihood function is an essential task in a UQ analysis, and that several recent UQ studies that employed a renormalized likelihood (i.e., including a 1/N factor) may have yielded unrealistically large uncertainties for elastic-scattering observables. If the parameter posterior deviates from multivariate-normal, a sampling-based approach like MCMC has a clear advantage over methods that assume the Laplace approximation holds. We note that empirical coverage can serve as an important internal check for the analyst whose model or data may have additional, unaccounted-for uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Abundance of Major Cell Wall Components in Natural Variants and Pedigrees of Populus trichocarpa

The rapid analysis of biopolymers including lignin and sugars in lignocellulosic biomass cell walls is essential for the analysis of the large sample populations needed for identifying heritable genetic variation in biomass feedstocks for biofuels and bioproducts. In this study, we reported the analysis of cell wall lignin content, syringyl/guaiacyl (S/G) ratio, as well as glucose and xylose content by high-throughput pyrolysis-molecular beam mass spectrometry (py-MBMS) for >3,600 samples derived from hundreds of accessions of Populus trichocarpa from natural populations, as well as pedigrees constructed from 14 parents (7 × 7). Partial Least Squares (PLS) regression models were built from the samples of known sugar composition previously determined by hydrolysis followed by nuclear magnetic resonance (NMR) analysis. Key spectral features positively correlated with glucose content consisted of m/z 126, 98, and 69, among others, deriving from pyrolyzates such as hydroxymethylfurfural, maltol, and other sugar-derived species. Xylose content positively correlated primarily with many lignin-derived ions and to a lesser degree with m/z 114, deriving from a lactone produced from xylose pyrolysis. Models were capable of predicting glucose and xylose contents with an average error of less than 4%, and accuracy was significantly improved over previously used methods. The differences in the models constructed from the two sample sets varied in training sample number, but the genetic and compositional uniformity of the pedigree set could be a potential driver in the slightly better performance of that model in comparison with the natural variants. Broad-sense heritability of glucose and xylose composition using these data was 0.32 and 0.34, respectively. In summary, we have demonstrated the use of a single high-throughput method to predict sugar and lignin composition in thousands of poplar samples to estimate the heritability and phenotypic plasticity of traits necessary to develop optimized feedstocks for bioenergy applications.

09 BIOMASS FUELS↗

A density-wave-like transition in the polycrystalline V 3 Sb 2 sample with bilayer kagome lattice

Recently, transition-metal-based kagome metals have aroused much research interest as a novel platform to explore exotic topological quantum phenomena. Here we report on the synthesis, structure, and physical properties of a bilayer kagome lattice compound V 3 Sb 2 . The polycrystalline V 3 Sb 2 samples were synthesized by conventional solid-state-reaction method in a sealed quartz tube at temperatures below 850 °C. Measurements of magnetic susceptibility and resistivity revealed consistently a density-wave-like transition at T dw ≈ 160 K with a large thermal hysteresis, even though some sample-dependent behaviors were observed presumably due to the different preparation conditions. Upon cooling through T dw , no strong anomaly in lattice parameters and no indication of symmetry lowering were detected in powder x-ray diffraction measurements. This transition can be suppressed completely by applying hydrostatic pressures of about 1.8 GPa, around which no sign of superconductivity was observed down to 1.5 K. Specific-heat measurements revealed a relatively large Sommerfeld coefficient γ = 18.5 mJ∙mol –1 ∙K –2 , confirming the metallic ground state with moderate electronic correlations. Density functional theory calculations indicate that V 3 Sb 2 shows a non-trivial topological crystalline property. Furthermore, our study makes V 3 Sb 2 a new candidate of metallic kagome compound to study the interplay between density-wave-order, nontrivial band topology, and possible superconductivity.

36 MATERIALS SCIENCE↗

Efficient many-jet event generation with flow matching

We apply for the first time, to the best of our knowledge, the flow matching method to the problem of phase-space sampling for event generation in high-energy collider physics. By training the model to remap the random numbers used to generate the momenta and helicities of the scattering matrix elements as implemented in the portable partonic event generator pepper, we find substantial efficiency improvements in the studied processes. We focus our study on the highest final-state multiplicities in Drell-Yan and top-antitop pair production used in simulated samples for the Large Hadron Collider, which computationally are the most relevant ones. We find that the unweighting efficiencies improve by factors of 184 and 25, respectively, when compared to the standard approach of using a vegas-based optimization. We also compare continuous normalizing flows trained with flow matching against the previously studied normalizing flows based on coupling layers and find that the former leads to better results, faster training and a better scaling behavior across the studied multiplicity range, while the latter evaluate faster. When combining the advantages of both methods using the regflow approach, we find parton-level unweighted event generation walltime gains of about a factor of 10 at the highest final-state multiplicities.

Bothmann, E. [CERN; Gottingen U.] (ORCID:000000016↗

Polarization-dependent electrocaloric and pyroelectric effects in ferroelectric BaTiO 3 thin films

In this paper we examine the influence of controllable polarization reversal and built-in electric fields on pyroelectric and electrocaloric effects in a BaTiO 3 thin film using a modified indirect method. We find that the magnitude of the sample's change in polarization with temperature is sensitive to the degree of polarization reversal. The pyroelectric response is small at low fractions of switched polarization and grows larger by several factors as larger fractions of polarization are reversed. This polarization reversal-sensitive pyroelectric behavior is the result of an internal built-in field, which has the effect of destabilizing low fractions of switched polarization and producing diminished pyroelectric effect. Greater fractions of switched polarization are more stable against backswitching and permit a larger pyroelectric response. Our findings highlight a characterization method for polarization-dependent pyroelectric effects in ferroelectric thin films, where built-in field effects are also present.

36 MATERIALS SCIENCE↗

A cosine-based correlation information entropy approach for building automatic fault detection baseline construction

Building automatic fault detection and diagnosis (AFDD) technologies have shown great potential for energy savings. To enable AFDD, a baseline depicting the normal operation mode is needed to detect whether the building operation deviates from normality. Existing research using physics-based knowledge and models for AFDD has mainly taken a trial-and-error approach to determine if a given baseline is sufficient via empirical experiments. A mechanism to support decisions such as how many samples and what samples should be included in the baseline is currently lacking. In this study, a data-driven method for AFDD baseline construction based on information entropy is developed. The entropy is derived based on cosine similarity among typical building automation system measurements in conjunction with outdoor weather information. The performance of the proposed method is evaluated using real building data. Evaluation results indicate that the fault detection strategy adopting the proposed method has similar or better accuracy in detecting faults compared to the same fault detection strategy using the baseline construction method from the literature. Additionally, the use of entropy enables the proposed method to automatically construct and assess the baseline consisting of information-rich samples.

42 ENGINEERING↗

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗

The Dark Energy Survey Year 3 high-redshift sample: selection, characterization, and analysis of galaxy clustering

ABSTRACT The fiducial cosmological analyses of imaging surveys like DES typically probe the Universe at redshifts z < 1. We present the selection and characterization of high-redshift galaxy samples using DES Year 3 data, and the analysis of their galaxy clustering measurements. In particular, we use galaxies that are fainter than those used in the previous DES Year 3 analyses and a Bayesian redshift scheme to define three tomographic bins with mean redshifts around z ∼ 0.9, 1.2, and 1.5, which extend the redshift coverage of the fiducial DES Year 3 analysis. These samples contain a total of about 9 million galaxies, and their galaxy density is more than 2 times higher than those in the DES Year 3 fiducial case. We characterize the redshift uncertainties of the samples, including the usage of various spectroscopic and high-quality redshift samples, and we develop a machine-learning method to correct for correlations between galaxy density and survey observing conditions. The analysis of galaxy clustering measurements, with a total signal to noise S/N ∼ 70 after scale cuts, yields robust cosmological constraints on a combination of the fraction of matter in the Universe Ωm and the Hubble parameter h, $\Omega _m h = 0.195^{+0.023}_{-0.018}$, and 2–3 per cent measurements of the amplitude of the galaxy clustering signals, probing galaxy bias and the amplitude of matter fluctuations, bσ8. A companion paper (in preparation) will present the cross-correlations of these high-z samples with cosmic microwave background lensing from Planck and South Pole Telescope, and the cosmological analysis of those measurements in combination with the galaxy clustering presented in this work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

In-Situ Approach to Sampling and Survey for Radiological Contaminants to Release Overburden Soil for Reuse - 20120

Various methods may be utilized to determine if overburden soil meets approved release criteria to allow for reuse of overburden soil as backfill material: soil scanning and sorting equipment, survey and sampling of excavated soil, in-situ sampling, and utilization of box or truck counters are common approaches. This paper focuses on a modified approach using elements of in-situ sampling and after excavation survey for a large volume of overburden soil that was expected to meet soil release criteria. This approach was utilized for the U.S. Army Corps of Engineers (USACE) St. Louis District at a North St. Louis County property. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An automated cluster surface scanning method for exploring reaction paths on metal-cluster surfaces

Metal-cluster surfaces present a wide variety of unique coordination environments. This complexity makes it difficult to manually probe the surface reactivity of such clusters. Here, we present a simple and automated method to systematically discover reaction pathways on cluster surfaces, based on the automated cluster surface scanning (ACSS) technique for mapping out potential energy surfaces. We showcase our method on 55-atom icosahedral Cu and Ag clusters, where we determine the activation energies of four elementary steps common in heterogeneous catalysis – hydrogen recombination (H* + H* → H 2 * + *), oxygen recombination (O* + O* → O 2 * + *), water formation (OH* + H* → H 2 O* + *), and CO oxidation (CO* + O* → CO 2 * + *) – with density functional theory calculations (DFT-PBE + D3). We show that the ACSS method requires significantly less human effort than the established manually performed climbing-image nudged elastic band (MP + CI-NEB) technique and locates transition states with comparable accuracy (root-mean-squared error of 0.10 eV) and similar computational cost. Rigorous sampling of the potential energy surface with the ACSS method allows one to locate all lowest-energy reaction pathways obtained via the MP+CI-NEB approach, as well as alternative pathways that one may have missed with the MP+CI-NEB approach due to the many possible pathways available on these clusters. The accuracy and efficiency afforded by the ACSS method could enable high-throughput exploration of the diverse reactivity of metal clusters.

36 MATERIALS SCIENCE↗