Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “maximum likelihood”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Source shape estimation for neutron imaging systems using convolutional neural networks

Neutron imaging systems are important diagnostic tools for characterizing the physics of inertial confinement fusion reactions at the National Ignition Facility (NIF). In particular, neutron images give diagnostic information on the size, symmetry, and shape of the fusion hot spot and surrounding cold fuel. Images are formed via collection of neutron flux from the source using a system of aperture arrays and scintillator-based detectors. Currently, reconstruction of fusion source geometry from the collected neutron images is accomplished by solving a computationally intensive maximum likelihood estimation problem via expectation maximization. In contrast, it is often useful to have simple representations of the overall source geometry that can be computed quickly. In this work, we develop convolutional neural networks (CNNs) to reconstruct the outer contours of simple source geometries. We compare the performance of the CNN for penumbral and pinhole data and provide experimental demonstrations of our methods on both non-noisy and noisy data.

Machine learning, neutron imaging, source reconstr↗

Adversarial autoencoder ensemble for fast and probabilistic reconstructions of few-shot photon correlation functions for solid-state quantum emitters

Second-order photon correlation measurements [g (2) (τ) functions] are widely used to classify single-photon emission purity in quantum emitters or to measure the multiexciton quantum yield of emitters that can simultaneously host multiple excitations – such as quantum dots – by evaluating the value of g (2) (τ = 0). Accumulating enough photons to accurately calculate this value is time consuming and could be accelerated by fitting of few-shot photon correlations. Here, we develop an uncertainty-aware, deep adversarial autoencoder ensemble (AAE) that reconstructs noise-free g (2) (τ) functions from noise-dominated, few-shot inputs. The model is trained with simulated g (2) (τ) functions that are facilely generated by Poisson sampling time bins. The AAE reconstructions are performed orders-of-magnitude faster, with reconstruction errors and estimates of g (2) (τ = 0) that are lower in variance and similar in accuracy compared to Maximum likelihood estimation and Levenberg-Marquardt least-squares fitting approaches, for simulated and experimentally measured few-shot g (2) (τ) functions (~100 two-photon events) of InP/ZnS/ZnSe and CdS/CdSe/CdS quantum dots. The deep-ensemble model comprises eight individual autoencoders, allowing for probabilistic reconstructions of noise-free g (2) (τ) functions, and we show that the predicted variance scales inversely with number of shots, with comparable uncertainties to computationally intensive Markov chain Monte Carlo sampling. Furthermore, this work demonstrates the advantage of machine learning models to perform uncertainty-aware, fast, and accurate reconstructions of simple Poisson-distributed photon correlation functions, allowing for on-the-fly reconstructions and accelerated materials characterization of solid-state quantum emitters.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Sub-10 second fly-scan nano-tomography using machine learning

Abstract X-ray computed tomography is a versatile technique for 3D structure characterization. However, conventional reconstruction algorithms require that the sample not change throughout the scan, and the timescale of sample dynamics must be longer than the data acquisition time to fulfill the stable sample requirement. Meanwhile, concerns about X-ray-induced parasite reaction and sample damage have driven research efforts to reduce beam dosage. Here, we report a machine-learning-based image processing method that can significantly reduce data acquisition time and X-ray dose, outperforming conventional approaches like Filtered-Back Projection, maximum-likelihood, and model-based maximum-a-posteriori probability. Applying machine learning, we achieve ultrafast nano-tomography with sub-10 second data acquisition time and sub-50 nm pixel resolution in a transmission X-ray microscope. We apply our algorithm to study dynamic morphology changes in a lithium-ion battery cathode under a heating rate of 50 o C min −1 , revealing crack self-healing during thermal annealing. The proposed method can be applied to various tomography modalities.

36 MATERIALS SCIENCE↗

Fitting Matérn smoothness parameters using automatic differentiation

The Mat$\acute{e}$rn covariance function is ubiquitous in the application of Gaussian processes to spatial statistics and beyond. Perhaps the most important reason for this is that the smoothness parameter $\nu$ gives complete control over the mean-square differentiability of the process, which has significant implications for the behavior of estimated quantities such as interpolants and forecasts. Unfortunately, derivatives of the Mat$\acute{e}$rn covariance function with respect to $\nu$ require derivatives of the modified second-kind Bessel function $K$ $\nu$ with respect to $\nu$. While closed form expressions of these derivatives do exist, they are prohibitively difficult and expensive to compute. For this reason, many software packages require fixing $\nu$ as opposed to estimating it, and all existing software packages that attempt to offer the functionality of estimating $\nu$ use finite difference estimates for $\partial$ $\nu$ $K$ $\nu$ . In this work, we introduce a new implementation of $K$$\nu$ that has been designed to provide derivatives via automatic differentiation (AD), and whose resulting derivatives are significantly faster and more accurate than those computed using finite differences. Here, we provide comprehensive testing for both speed and accuracy and show that our AD solution can be used to build accurate Hessian matrices for second-order maximum likelihood estimation in settings where Hessians built with finite difference approximations completely fail.

97 MATHEMATICS AND COMPUTING↗

Analysis of Polarimetry Data with Angular Uncertainties

For a track based polarimeter, such as the Imaging X-ray Polarimetry Explorer (IXPE), the sensitivity to polarization depends on the modulation factor, which is a strong function of energy. In previous work, a likelihood method was developed that would account for this variation in order to estimate the minimum detectable polarization (MDP). That method essentially required that the position angles of individual events should be known precisely. In a separate work, however, it was shown that using a machine-learning method for measuring event tracks can generate track angle uncertainties, which can be used in the analysis. Here, the maximum likelihood method is used as a basis for revising the estimate of the MDP in a general way that can include uncertainties in event track position angles. The resultant MDP depends solely upon the distribution of track angle uncertainties present in the input data. Due to the physics of the IXPE detectors, it is possible to derive a simple relationship between these angular uncertainties and the energy-dependent modulation function as a step in the process.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Structure-aware Initialization via Numerical Continuation and Informed Priors

Scientific machine learning (SciML) often operates in ill-conditioned, weakly identifiable regimes due to limited data or indirect observations. In such settings, optimization and inference are highly sensitive to the starting point, making initialization--often under-reported--a consequential degree of freedom. Random initialization is not a neutral default as it induces an implicit prior over candidate solutions and can systematically bias the result, producing large run-to-run variability. Here, we formalize this view by treating initialization as a hidden confounder in SciML and develop a unifying theory for structure-aware initialization via numerical continuation, constructing warm starts from related problem instances. Across representative tasks, including physics-informed neural networks, maximum likelihood estimation, and variational inference, warm starts have been shown to consistently reduce optimization effort and improve reliability.

Data integrity↗

A Primer on Dose-Response Data Modeling in Radiation Therapy

An overview of common approaches used to assess a dose response for radiation therapy–associated endpoints is presented, using lung toxicity data sets analyzed as a part of the High Dose per Fraction, Hypofractionated Treatment Effects in the Clinic effort as an example. Each component presented (eg, data-driven analysis, dose-response analysis, and calculating uncertainties on model prediction) is addressed using established approaches. Specifically, the maximum likelihood method was used to calculate best parameter values of the commonly used logistic model, the profile-likelihood to calculate confidence intervals on model parameters, and the likelihood ratio to determine whether the observed data fit is statistically significant. The bootstrap method was used to calculate confidence intervals for model predictions. Correlated behavior of model parameters and implication for interpreting dose response are discussed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Disaggregating Customer-Level Behind-the-Meter PV Generation Using Smart Meter Data and Solar Exemplars

Customer-level rooftop photovoltaic (PV) has been widely integrated into distribution systems. In most cases, PVs are installed behind-the-meter (BTM), and only the net demand is recorded. Therefore, the native demand and PV generation are unknown to utilities. Separating native demand and solar generation from net demand is critical for improving grid-edge observability. In this paper, a novel approach is proposed for disaggregating customer-level BTM PV generation using low-resolution but widely available hourly smart meter data. The proposed approach exploits the strong correlation between monthly nocturnal and diurnal native demands and the high similarity among PV generation profiles. First, a joint probability density function (PDF) of monthly nocturnal and diurnal native demands is constructed for customers without PVs, using Gaussian mixture modeling (GMM). Deviation from the constructed PDF is utilized to probabilistically assess the monthly solar generation of customers with PVs. Then, to identify hourly BTM solar generation for these customers, their estimated monthly solar generation is decomposed into an hourly timescale; to do this, we have proposed a maximum likelihood estimation (MLE)-based technique that utilizes hourly typical solar exemplars. Leveraging the strong monthly native demand correlation and high PV generation similarity enhances our approach's robustness against the volatility of customers’ hourly load and enables highly-accurate disaggregation. Furthermore, the proposed approach has been verified using real native demand and PV generation data.

14 SOLAR ENERGY↗

Revised and New Proper Motions for Confirmed and Candidate Milky Way Dwarf Galaxies

A new derivation of systemic proper motions of Milky Way satellites is presented and applied to 59 confirmed or candidate dwarf galaxy satellites using Gaia Data Release 2. This constitutes all known Milky Way dwarf galaxies (and likely candidates) as of 2020 May, except for the Magellanic Clouds, the Canis Major and Hydra 1 stellar overdensities, and the tidally disrupting Bootes III and Sagittarius dwarf galaxies. We derive systemic proper motions for the first time for Indus 1, DES J0225+0304, Cetus 2, Pictor 2, and Leo T, but note that the latter three rely on photometry that is of poorer quality than that of the rest of the sample. We cannot resolve a signal for Bootes 4, Cetus 3, Indus 2, Pegasus 3, or Virgo 1. Our method is inspired by the maximum likelihood approach of Pace & Li and examines simultaneously the spatial, color–magnitude, and proper motion distribution of sources. Systemic proper motions are derived without the need to identify confirmed radial velocity members, although the proper motions of these stars, where available, are incorporated into the analysis through a prior on the model. The associated uncertainties on the systemic proper motions are on average a factor of ∼1.4 smaller than existing literature values. Analysis of the implied membership distribution of the satellites suggests that we accurately identify member stars with a contamination rate lower than 1 in 20.

79 ASTRONOMY AND ASTROPHYSICS↗

Detection of translational noncrystallographic symmetry in Patterson functions

Detection of translational noncrystallographic symmetry (TNCS) can be critical for success in crystallographic phasing, particularly when molecular-replacement models are poor or anomalous phasing information is weak. If the correct TNCS is detected then expected intensity factors for each reflection can be refined, so that the maximum-likelihood functions underlying molecular replacement and single-wavelength anomalous dispersion use appropriate structure-factor normalization and variance terms. Here, an analysis of a curated database of protein structures from the Protein Data Bank to investigate how TNCS manifests in the Patterson function is described. These studies informed an algorithm for the detection of TNCS, which includes a method for detecting the number of vectors involved in any commensurate modulation (the TNCS order). The algorithm generates a ranked list of possible TNCS associations in the asymmetric unit for exploration during structure solution.

59 BASIC BIOLOGICAL SCIENCES↗

Ptychographic phase retrieval by proximal algorithms

We derive a set of ptychography phase-retrieval iterative engines based on proximal algorithms originally developed in convex optimization theory, and discuss their connections with existing ones. The use of proximal operator creates a simple frame work that allows us to incorporate the effect of noise from a maximum-likelihood (ML) principle. We focus on three particular algorithms, namely proximal minimization, alternating direction method of multiplier and accelerated proximal gradient (APG). We benchmark their performance with numerical simulations, and discuss their optimal conditions for convergence and accuracy. An experimental dataset is used to demonstrate their effectiveness as well, in which case an array of cubic Au nanoparticles with a size of 50 nm is imaged. We show that with the presence of Poisson noise, a dataset with photon counts up to 10 4 at one detector pixel already requires ML-based methods to achieve a stable convergence. Among the three algorithms derived in this work, APG method is reported first time for its application in ptychographic reconstruction and shows superior performance in terms of both accuracy and convergence rate with a noisy dataset.

36 MATERIALS SCIENCE↗

Stopping criteria for ending autonomous, single detector radiological source searches

While the localization of radiological sources has traditionally been handled with statistical algorithms, such a task can be augmented with advanced machine learning methodologies. The combination of deep and reinforcement learning has provided learning-based navigation to autonomous, single-detector, mobile systems. However, these approaches lacked the capacity to terminate a surveying/search task without outside influence of an operator or perfect knowledge of source location (defeating the purpose of such a system). Two stopping criteria are investigated in this work for a machine learning navigated system: one based upon Bayesian and maximum likelihood estimation (MLE) strategies commonly used in source localization, and a second providing the navigational machine learning network with a “stop search” action. A convolutional neural network was trained via reinforcement learning in a 10 m × 10 m simulated environment to navigate a randomly placed detector-agent to a randomly placed source of varied strength (stopping with perfect knowledge during training). The network agent could move in one of four directions (up, down, left, right) after taking a 1 s count measurement at the current location. During testing, the stopping criteria for this navigational algorithm was based upon a Bayesian likelihood estimation technique of source presence, updating this likelihood after each step, and terminating once the confidence of the source being in a single location exceeded 0.9. A second network was trained and tested with similar architecture as the previous but which contained a fifth action: for self-stopping. The accuracy and speed of localization with set detector and source initializations were compared over 50 trials of MLE-Bayesian approach and 1000 trials of the CNN with self-stopping. The statistical stopping condition yielded a median localization error of ~1.41 m and median localization speed of 12 steps. The machine learning stopping condition yielded a median localization error of 0 m and median localization speed of 17 steps. This work demonstrated two stopping criteria available to a machine learning guided, source localization system.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Remote Radiation Sensing Using Aerial and Ground Platforms

Remote sensing of ionizing radiation has a significant role in waste management, nuclear material management and nonproliferation, and radiation safety. Robotic platforms can surpass the number of tasks that are achieved by humans. With this technique, the operator's radiation exposure can be decreased. Remote sensing allows for the evaluation and monitoring of radiological contamination. Gamma-ray and neutron sensors were integrated onto the robotic platforms. This approach allows for the radiation sensor data to be dynamically tracked and mapped thus enabling further analysis of the radiation flux in temporal and spatial domains. The goal is to complete scheduled tasks while the robot is being irradiated. To achieve this, electronic components must be shielded and radiation hardened. CZT Detector: Cadmium Zinc Telluride (CZT) detector technology has been a promising solution for gamma-ray and x-ray measurements. Detector data is transferred to the Odroid minicomputer that controls and powers the module via the USB. Robot Operating System (ROS) was utilized for data acquisition and data fusion. The Mariscotti method was employed for the spectrum analysis. A function was programmed in ROS for the automatic identification of photopeaks. CLYC Detector: A Cs{sub 2}LiYCl{sub 6}:Ce{sup 3+} (CLYC) detector was used for simultaneous medium-resolution gamma-ray measurements and neutron counting. A 2.54 cm diameter photomultiplier tube (PMT) was equipped with a high voltage supply and a miniature digitizer. Gamma-ray excitation: fast core-to-valence luminescence (CVL) with 1 ns decay constant, and prompt Ce{sup 3+} emission with 50 ns decay constant. Neutron excitation: slow cerium self-trapped excitation (Ce{sup 3+} STE), 1000 ns decay constant. Radiation Source Localization: Maximum Likelihood Estimation (MLE) and gradient-based methods were used to locate the position of a radiation source based on measured radiation intensities. Multi-Particle Transport Code FLUKA: Estimation of radiation damage of the electronic components is important in order to optimize the robot's operational time while it is irradiated. Displacement per atom (DPA) represents the radiation damage in materials exposed to the ionizing radiation. Various shielding layers of different thickness t were analyzed (< 5% statistical error). The model of the controller of the UAS was designed in FLUKA. Conclusion: CZT and CLYC detectors were integrated onto the robotic platforms. Radiation source localization and contour mapping using robotic platforms were studied. Functions for data analysis and fusion were developed in ROS. FLUKA code was utilized to analyze DPA values. Layers of low-density and high-density materials were used to shield the UAS electronics.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Orbits and Masses of Binaries from Speckle Interferometry at SOAR

We present results from Speckle inteferometric observations of 15 visual binaries and one double-line spectroscopic binary, carried out with the HRCam Speckle camera of the SOAR 4.1 m telescope. These systems were observed as a part of an on-going survey to characterize the binary population in the solar vicinity, out to a distance of 250 pc. We obtained orbital elements and mass sums for our sample of visual binaries. The orbits were computed using a Markov Chain Monte Carlo algorithm that delivers maximum likelihood estimates of the parameters, as well as posterior probability density functions that allow us to evaluate their uncertainty. Their periods cover a range from 5 yr to more than 500 yr; and their spectral types go from early A to mid M, implying total system masses from slightly more than 4M{sub ⊙} down to 0.2M {sub ⊙}. They are located at distances between approximately 12 and 200 pc, mostly at low Galactic latitude. For the double-line spectroscopic binary YSC8, we present the first combined astrometric/radial-velocity orbit resulting from a self-consistent fit, leading to individual component masses of 0.897 ± 0.027 M {sub ⊙} and 0.857 ± 0.026 M {sub ⊙}; and an orbital parallax of 26.61 ± 0.29 mas, which compares very well with the Gaia DR2 trigonometric parallax (26.55 ± 0.27 mas). In combination with published photometry and trigonometric parallaxes, we place our objects on an H-R diagram and discuss their evolutionary status. We also present a thorough analysis of the precision and consistency of the photometry available for them.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

BICEP/Keck. XX. Component-separated Maps of the Polarized Cosmic Microwave Background and Thermal Dust Emission Using Planck and BICEP/Keck Observations through the 2018 Observing Season

We present component-separated polarization maps of the cosmic microwave background (CMB) and Galactic thermal dust emission, derived using data from the BICEP/Keck experiments through the 2018 observing season and Planck. By employing a maximum-likelihood method that utilizes observing matrices, we produce unbiased maps of the CMB and dust signals. We outline the computational challenges and demonstrate an efficient implementation of the component map estimator. We show methods to compute and characterize power spectra of these maps, opening up an alternative way to infer the tensor-to-scalar ratio from our data. We compare the results of this map-based separation method with the baseline BICEP/Keck analysis. Our analysis demonstrates consistency between the two methods, finding an 84% correlation between the pipelines.

cosmic inflation↗

Feasibility of peak temperature targets in light of institutional constraints

Despite faster-than-expected progress in clean energy technology deployment, global annual CO 2 emissions have increased from 2020 to 2023. The feasibility of limiting warming to 1.5 °C is therefore questioned. Here we present a model intercomparison study that accounts for emissions trends until 2023 and compares cost-effective scenarios to alternative scenarios with institutional, geophysical and technological feasibility constraints and enablers informed by previous literature. Our results show that the most ambitious mitigation trajectories with updated climate information still manage to limit peak warming to below 1.6 °C (‘low overshoot’) with around 50% likelihood. However, feasibility constraints, especially in the institutional dimension, decrease this maximum likelihood considerably to 5–45%. Accelerated energy demand transformation can reduce costs for staying below 2 °C but have only a limited impact on further increasing the likelihood of limiting warming to 1.6 °C. Our study helps to establish a new benchmark of mitigation scenarios that goes beyond the dominant cost-effective scenario design.

54 ENVIRONMENTAL SCIENCES↗

Improved Constraints on Primordial Gravitational Waves using Planck , WMAP, and BICEP/ Keck Observations through the 2018 Observing Season

Here, we present results from an analysis of all data taken by the BICEP2, Keck Array, and BICEP3 CMB polarization experiments up to and including the 2018 observing season. We add additional Keck Array observations at 220 GHz and BICEP3 observations at 95 GHz to the previous 95/150/220 GHz dataset. The Q/U maps now reach depths of 2.8, 2.8, and 8.8 μK CMB arcmin at 95,150, and 220 GHz, respectively, over an effective area of ≈ 600 square degrees at 95 GHz and ≈ 400 square degrees at 150 and 220 GHz. The 220 GHz maps now achieve a signal-to-noise ratio on polarized dust emission exceeding that of Planck at 353 GHz. We take auto- and cross-spectra between these maps and publicly available WMAP and Planck maps at frequencies from 23 to 353 GHz and evaluate the joint likelihood of the spectra versus a multicomponent model of lensed ΛCDM + r + dust + synchrotron + noise . The foreground model has seven parameters, and no longer requires a prior on the frequency spectral index of the dust emission taken from measurements on other regions of the sky. This model is an adequate description of the data at the current noise levels. The likelihood analysis yields the constraint r 0.05 < 0.036 at 95% confidence. Running maximum likelihood search on simulations we obtain unbiased results and find that σ(r) = 0.009 . These are the strongest constraints to date on primordial gravitational waves.

79 ASTRONOMY AND ASTROPHYSICS↗

ASCR Workshop Position Paper: Challenges and Opportunities in High Energy Physics

High energy particle physics and cosmology concern themselves with estimating fundamental parameters of nature, such as the masses and interactions of fundamental particles like the Higgs boson and the rate of expansion of the universe. In doing so, they analyze exabyte-scale datasets, some of the largest in all of science, and face many challenges in subsequent data analysis. These challenges are shared between the two disciplines, but we focus on particle physics to highlight one specific domain. In particle physics, the standard method for estimating parameters involves performing Monte Carlo (MC) integration as a function of both parameters of interest and nuisance parameters using an expensive simulator, counting the number of observed collision events (i.i.d. samples) from an experiment in the corresponding integration domains, and forming a Poisson likelihood function. This likelihood function is then used in a Frequentist manner to construct a maximum likelihood point estimate (MLE) and confidence set for the parameters. To sufficiently populate the high-dimensional integration domains, simulators consume billions of CPU-hours annually and produce hundreds of petabytes of intermediate output data. Several techniques have been developed to: optimize definitions of the integration domains so as to be maximally sensitive to a particular subset of parameters, efficiently estimate the integrals, and build robust surrogate models by interpolating between integral evaluations at different parameter points. One can view this whole endeavor as classical Simulation-Based Inference (SBI).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗