Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Dark Energy Survey Year 3 results: optimized $w$CDM simulation-based inference with weak lensing map-level hybrid statistics

We present cosmological constraints from the Dark Energy Survey Year 3 (DES Y3) weak lensing data using hierarchical hybrid statistics within a Bayesian simulation-based inference framework that is based on the Gower Street simulations. To maximize the precision of the inference, we have developed a new, information-theory based, data compression of the weak lensing maps to just seven highly informative summary statistics. The hybrid scheme exploits the high information content of the power spectrum, compressing both the power spectrum and neural-based summaries that are designed to extract further information. Our simulation-based approach enables principled forward modelling of all major sources of systematic uncertainty and survey properties into realistic mock observations, including the survey mask, photometric redshift uncertainties, intrinsic galaxy alignments, multiplicative shear calibration bias, source galaxy clustering, non-Gaussian shape noise, and non-linear structure formation. The summary statistics are then used in a Bayesian simulation-based inference pipeline. The inference is validated through coverage tests and checks for robustness against baryonic feedback. Assuming a $w$CDM cosmology, our analysis yields $S_8 = 0.808 \pm 0.017$, $Ω_{\rm m} = 0.325 \pm 0.024$, and $w < -0.766$ (marginalized posterior 68 per cent credible intervals). This rigorous combination of information theory, physics- and neural network-based extreme data compression, and principled Bayesian analysis improves the figure of merit for $(Ω_{\rm m}, S_8, w)$ by 60 per cent over the previous state-of-the-art, and by almost a factor of 3 over two-point analyses of the same data. They are the most precise joint constraints on $(Ω_{\rm m}, S_8, w)$ from weak gravitational lensing data alone of any survey to date. We intend to apply this analysis to the more recent DES Y6 data.

Williamson, J. [University Coll. London]↗

A climate index indicative of cloudiness derived from satellite infrared sounder data

In many current studies conducted to enhance the usefulness of meteorological satellite radiance data, one common objective is to infer conventional weather variables. The present investigation, on the other hand, is mainly concerned with the efficient retrieval (minimization of errors) of a nonstandard atmospheric descriptor. The atmosphere's Vertical Infrared Radiative Emitting Structure (VIRES) is retrieved. VIRES is described by the broadband infrared weighting function curve. The shapes of these weighting curves are primarily a function of the three-dimensional cloud structure. The weighting curves are retrieved by a method which uses satellite spectral radiance data. The basic theory involved in the VIRES retrieval procedure parallels the technique used to retrieve temperature soundings.

Abel, M. D.↗

Deducing Electron Properties from Hard X-Ray Observations

X-radiation from energetic electrons is the prime diagnostic of flare-accelerated electrons. The observed X-ray flux (and polarization state) is fundamentally a convolution of the cross-section for the hard X-ray emission process(es) in question with the electron distribution function, which is in turn a function of energy, direction, spatial location and time. To address the problems of particle propagation and acceleration one needs to infer as much information as possible on this electron distribution function, through a deconvolution of this fundamental relationship. This review presents recent progress toward this goal using spectroscopic, imaging and polarization measurements, primarily from the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI). Previous conclusions regarding the energy, angular (pitch angle) and spatial distributions of energetic electrons in solar flares are critically reviewed. We discuss the role and the observational evidence of several radiation processes: free-free electron-ion, free-free electron-electron, free-bound electron-ion, photoelectric absorption and Compton backscatter (albedo), using both spectroscopic and imaging techniques. This unprecedented quality of data allows for the first time inference of the angular distributions of the X-ray-emitting electrons and improved model-independent inference of electron energy spectra and emission measures of thermal plasma. Moreover, imaging spectroscopy has revealed hitherto unknown details of solar flare morphology and detailed spectroscopy of coronal, footpoint and extended sources in flaring regions. Additional attempts to measure hard X-ray polarization were not sufficient to put constraints on the degree of anisotropy of electrons, but point to the importance of obtaining good quality polarization data in the future.

Kontar, E. P.↗

The state of the atmosphere as inferred from the FGGE satellite observing systems during SOP-1

Data assimilation experiments were performed to test the influence of different elements of the satellite observing systems. Results from some of the experiments are presented. These findings show that the FGGE satellite systems are able to infer the three-dimensional motion field and improve the representation of the large-scale state of the atmosphere. Preliminary results of the forecast impact of the FGGE data sets are also presented.

Halem, M.↗

Further evidence of a latitude gradient in the solar wind velocity

Simultaneous Mariner and Explorer data are used in the present paper to show that the large-scale gradient in the bulk velocity of the solar wind observed by Coles (1972) is a heliographic latitude gradient. A value of roughly 15 km/sec/deg for the gradient is derived by a correlation technique employed by Coleman and Rosenberg (1971). A simple model of the velocity/latitude dependence is developed and is shown to be consistent with a direct comparison of the observed Mariner and Explorer velocities. The gradient inferred from the Mariner and Explorer data is compared with values obtained from corresponding analyses of Vela and IPS data.

Rhodes, E. J., Jr.↗

Remote Sensing of Clouds, Water Vapor, and Near-Surface Winds Under Various Aerosol Conditions During CAMP2Ex

The Cloud, Aerosol and Monsoon Processes Philippines Experiment (CAMP2Ex) field campaign took place from August – October 2019. CAMP2Ex science objectives include understanding aerosol-cloud interaction under various Meteorological conditions, and how these Meteorological phenomena affect aerosol distribution in the atmosphere. Numerous instruments were flown on the National Aeronautics and Space Administration (NASA) P-3 aircraft during 19 CAMP2Ex science flights, including the Advanced Microwave Precipitation Radiometer (AMPR) the Airborne Third Generation Precipitation Radar (APR-3), and the High Spectral Resolution Lidar 2 (HSRL2). Geophysical retrieval equations for cloud liquid water, columnar water vapor, and near-surface wind speed using AMPR brightness temperatures have been derived and tested using CAMP2Ex data. Water vapor and wind speed retrievals have been validated using in situ observations, such as dropsondes and shipborne instruments. This presentation will demonstrate these AMPR-based retrievals during CAMP2Ex, including discussions of retrieval uncertainties. Specific CAMP2Ex flights will be presented in greater detail, including inferences of other Meteorological phenomena in clear air and around precipitating and non-precipitating clouds, such as background wind speeds and potential identification of gust fronts. These analyses will be supplemented with APR-3 reflectivity and Doppler velocity data to infer microphysical processes occurring within and around selected clouds of interest. In cases where multiple remote-sensing measurements were obtained for the same cloud, a time-evolution analysis of these features may be performed. Throughout these analyses, HSRL2 data will be used to quantify aerosol properties beneath the P-3, and variations in the AMPR/APR-3 observations with respect to various aerosol conditions will be discussed.

Corey Amiot↗

Vehicle Motions as Inferred from Radio-signal- Strength Records

Considerable data on various parameters of a satellite and its launching vehicle can be obtained from the received-signal-strength records at the various satellite receiver stations. The doppler shifts of the satellite can be used to determine the orbital characteristics quite accurately. (Ref. 1 discusses the rapid determination of these parameters.) Information concerning the velocity increment and direction of each stage can be obtained if doppler data are received by several stations during the high-speed staging. The variations in signal strength during launch can be used to find the spin rate of the satellite before, during, and after staging, and to find variations in attitude, including precession, during launch. With spin and precession frequencies available, any changes in the ratios of moments of inertia can be determined. In this paper the launchings of the Explorer satellites will be used as a basis for the generalized conclusions concerning utilization of radio-signal-strength records. The discussion includes a description of the Explorer launching system.

Pilkington, W. C.↗

Dynamic properties of the thermosphere inferred from Pioneer Venus mass spectrometer measurements

The data obtained by the Pioneer Venus spectrometer experiments indicate that the day-night temperature contrast on Venus is associated with wind velocities of about 200 m/s which transport oxygen, helium, and hydrogen toward the night side. A mass exchange with the mesosphere commensurate with an eddy diffusion coefficient of 3 x 10 to the 7th is required to buffer the horizontal advection so as to reproduce the observed day time bulge in oxygen and the small diurnal variations in helium. The observed time response and magnitude of the day-night density variations require transport processes to be effective over time periods between five and ten days, implying a superrotation rate or prevailing winds in excess of 50 m/s at the equator. Nonlinear mass transport results in wave steepening and contributes to the amplification of the density extrema in hydrogen and helium.

Mayr, H. G.↗

The anisotropy in the xosmic microwave background at degree angular scales

We detect anisotropy in the cosmic microwave background (CMB) at degree angular scales and confirm a previous detection reported by Wollack et al. (1993). The root-mean-squared amplitude of the fluctuations is 44(sup+13)(sub -7)microK. This may be expressed as the square root of the angular power spectrum in a band of multiples between l(sub eff)=69(sup +29)(sub -22). We find delta T(sub l) = square root of (l(2l+1) expected value of ((absolute value of (a(sup m)(sub L)))(exp 2))/(4xpi))= 42(sup +12)(sub -7). The measured spectral index of the fluctuations is consistent with zero, the value expected for the CMB. The spectral index corresponding to Galactic free-free emission, the most likely foreground contaminant, is rejected at approximately 3 sigma. The analysis is based on three independent data sets. The first, taken in 1993, spans the 26-36 GHz frequency range with three frequency bands; the second was taken with the same radiometer as the first but during an independent observing campaign in 1994; and the third, also taken in 1994, spans the 36-46 GHz range in three bands. For each telescope position and radiometer channel, the drifts in the instrument offset are less than or equal to 4 microK/day averaged over a period of 1 month. The dependence of the inferred anisotropy on the calibration and data editing is addressed.

Netterfield, C. B.↗

Quantiles, parametric-select density estimation, and bi-information parameter estimators

A quantile-based approach to statistical analysis and probability modeling of data is presented which formulates statistical inference problems as functional inference problems in which the parameters to be estimated are density functions. Density estimators can be non-parametric (computed independently of model identified) or parametric-select (approximated by finite parametric models that can provide standard models whose fit can be tested). Exponential models and autoregressive models are approximating densities which can be justified as maximum entropy for respectively the entropy of a probability density and the entropy of a quantile density. Applications of these ideas are outlined to the problems of modeling: (1) univariate data; (2) bivariate data and tests for independence; and (3) two samples and likelihood ratios. It is proposed that bi-information estimation of a density function can be developed by analogy to the problem of identification of regression models.

Parzen, E.↗

Revealing Local Structures through Machine-Learning-Fused Multimodal Spectroscopy

Atomistic structures of materials offer valuable insights into their functionality. Determining these structures remains a fundamental challenge in materials science, especially for systems with defects. While both experimental and computational methods exist, each has limitations in resolving nanoscale structures. Core-level spectroscopies, such as X-ray absorption (XAS) or electron energy-loss spectroscopies (EELS), have been used to determine the local bonding environment and structure of materials. Recently, machine learning (ML) methods have been applied to extract structural and bonding information from XAS/EELS data. However, frameworks relying solely on a single data stream, defined as characterization data derived from a single element using one technique, are often insufficient because multiple local environments can yield similar spectral features, making it challenging to differentiate between competing structural hypotheses. Here, in this work, we address this challenge by integrating multimodal ab initio simulations, experimental data acquisition, and ML techniques for structure characterization. Our goal is to determine local structures and properties using EELS and XAS data from multiple elements and edges. To showcase our approach, we use various lithium nickel manganese cobalt (NMC) oxide compounds which are used for lithium ion batteries, including those with oxygen vacancies and antisite defects, as the sample material system. We successfully inferred local element content, ranging from lithium to transition metals, with quantitative agreement with experimental data. Beyond local element inference, we find that ML model based on multimodal spectroscopic data is able to determine whether local defects such as oxygen vacancy and antisites are present, a task which is impossible for single mode spectra or other experimental techniques. Furthermore, our framework is able to provide physical interpretability, bridging spectroscopy with the local atomic and electronic structures.

battery↗

Accelerating data acquisition with FPGA-based edge machine learning: a case study with LCLS-II

New scientific experiments and instruments generate vast amounts of data that need to be transferred for storage or further processing, often overwhelming traditional systems. Edge machine learning (EdgeML) addresses this challenge by integrating machine learning (ML) algorithms with edge computing, enabling real-time data processing directly at the point of data generation. EdgeML is particularly beneficial for environments where immediate decisions are required, or where bandwidth and storage are limited. In this paper, we demonstrate a high-speed configurable ML model in a fully customizable EdgeML system using a field programmable gate array (FPGA). Our demonstration focuses on an angular array of electron spectrometers, referred to as the ‘CookieBox,’ developed for the Linac Coherent Light Source II project. The EdgeML system captures 51.2 Gbps from a 6.4 GS s −1 analog to digital converter and is designed to integrate data pre-processing and ML inside an FPGA. Our implementation achieves an inference latency of 0.2 µs for the ML model, and a total latency of 0.4 µs for the complete EdgeML system, which includes pre-processing, data transmission, digitization, and ML inference. The modular design of the system allows it to be adapted for other instrumentation applications requiring low-latency data processing.

97 MATHEMATICS AND COMPUTING↗

PNNL-CompBio/bayesian-inference

Bayesian Metabolic Inference is a platform to integrate genome-scale multi-omics data into an iterative method to obtain optimized recommendations for optimal target compound production. This method uses a variational inference approach to approximate new posterior data to analyze in order to obtain useful correlations and control coefficients.

Kumar, Neeraj↗

Time Domain Identification of an Optimal Control Pilot Model with Emphasis on the Objective Function

A method for the identification of the pilot's control compensation using time domain techniques is proposed. From this information we hope to infer a quadratic cost function, supported by the data, that represents a reasonable expression for the pilot's control objective in the task being performed, or an inferred piloting strategy. The objectives for this method are: (1) obtain a better understanding of the fundamental piloting techniques in complex tasks, such as landing approach; (2) the development of a metric measurable in simulations and flight test that correlate with subjective pilot opinion; and (3) to further validate pilot models and pilot vehicle analysis methods.

Schmidt, D. K.↗

Algorithms for Spectral Decomposition with Applications to Optical Plume Anomaly Detection

The analysis of spectral signals for features that represent physical phenomenon is ubiquitous in the science and engineering communities. There are two main approaches that can be taken to extract relevant features from these high-dimensional data streams. The first set of approaches relies on extracting features using a physics-based paradigm where the underlying physical mechanism that generates the spectra is used to infer the most important features in the data stream. We focus on a complementary methodology that uses a data-driven technique that is informed by the underlying physics but also has the ability to adapt to unmodeled system attributes and dynamics. We discuss the following four algorithms: Spectral Decomposition Algorithm (SDA), Non-Negative Matrix Factorization (NMF), Independent Component Analysis (ICA) and Principal Components Analysis (PCA) and compare their performance on a spectral emulator which we use to generate artificial data with known statistical properties. This spectral emulator mimics the real-world phenomena arising from the plume of the space shuttle main engine and can be used to validate the results that arise from various spectral decomposition algorithms and is very useful for situations where real-world systems have very low probabilities of fault or failure. Our results indicate that methods like SDA and NMF provide a straightforward way of incorporating prior physical knowledge while NMF with a tuning mechanism can give superior performance on some tests. We demonstrate these algorithms to detect potential system-health issues on data from a spectral emulator with tunable health parameters.

Srivastava, Askok N.↗

Auroral energy deposition and neutral composition changes observed simultaneously by ESRO 4 and AE-C at different altitudes

Neutral composition data obtained simultaneously from ESRO 4 and AE-C during geomagnetically disturbed conditions at different altitudes (160 and 230 km) are used to investigate the atmospheric response to geomagnetic storms and to infer information regarding the excitation mechanism. The data are compared with a theoretical model that estimates the composition effects in terms of wind induced diffusion. A parametric study was conducted bearing on the influence of energy deposition at different altitudes and with varying latitudinal extent. In one of the observed events the composition effects at 160 km are substantially smaller than at 230 km for which we inferred by comparison with the theory that the energy mainly was deposited at 150 km altitude over a wide latitude range. Another event required energy deposition at somewhat lower altitudes near 120 km with a more localized energy source. Significant variations of the turbopause level were not necessary to explain the observed variations.

Trinks, H.↗

Ionospheric Convection in the Postnoon Auroral Oval: SuperDARN and Polar UVI Observations

Super Dual Auroral Radar Network (SuperDARN) observations, ultraviolet imaging from the Polar satellite (UVI), and particle precipitation data from DMSP satellites have been used to investigate the electrodynamics of the postnoon auroral oval in the Northern hemisphere. We show that: (1) For negative IMF By, the convection reversal (CR) was co-located with the maximum of auroral luminosity, but during positive IMF By the convection reversal was poleward of the auroral oval up to several degrees in latitude; (2) Postnoon auroral oval was associated with a large-scale upward field-aligned current (FAC) of the order of 6x10(exp -7). A m(exp -2) in magnitude (the FAC was inferred from the SuperDARN and UVI data). For negative IMF By, maximum of the auroral intensity coincides in latitude with the maximum of the upward field-aligned current. However, for positive IMF By. the maximum of the upward FAC was shifted to the poleward edge of the auroral oval; (3) In response to the IMF By turning from positive to negative, the maximum of the auroral luminosity did not change its position noticeably, but the position of the convection reversal changed considerably from 80-81 degs to about 76 degs MLAT, and the maximum of FAC moved from 77-78 degs to about 76 degs MLAT. Thus, after IMF By turns negative, both the FAC maximum and CR tend to coincide with the auroral maximum; (4) The IMF Bz positive deflection was followed by a decrease in both field-aligned current intensity and auroral luminosity. However, the decrease in the auroral luminosity lags behind the FAC decrease by about 12 min. Firstly, these observations allow us to suggest that the IMF By-related electric field can penetrate into the closed magnetosphere and produce convection and FAC changes in the region of the postnoon auroral oval. Secondly, we suggest that the interchange instability is a promising mechanism for the postnoon auroras.

Kozlovsky, A.↗