Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Hyper Suprime-Cam Year 3 results: Cosmology from galaxy clustering and weak lensing with HSC and SDSS using the emulator based halo model

We present cosmology results from a blinded joint analysis of cosmic shear, galaxy-galaxy weak lensing, and projected galaxy clustering, measured from the Hyper Suprime-Cam three-year (HSC-Y3) shape catalog and the Sloan Digital Sky Survey (SDSS) DR11 spectroscopic galaxy catalog—a cosmology analysis. We define luminosity-cut, and therefore nearly volume-limited, samples of SDSS galaxies to serve as the tracers of w p and as the lens samples for Δ⁢Σ in three spectroscopic redshift bins spanning the range 0.15± and Δ⁢Σ measurements, we use a single sample of about seven million source galaxies over 416 deg 2 , selected from HSC-Y3 based on having photometric redshifts (photo-z) greater than 0.75. The deep, high-quality HSC-Y3 data enable significant detections of the Δ⁢Σ signals, with integrated signal-to-noise ratio S/N~24 in the range 3≤R/[ℎ –1 Mpc]≤30 over the three lens samples. ξ ± has S/N ~19 in the range 8' ≤$\theta$ ≤5⁢0' and 30' ≤$\theta$ ≤15⁢0' for ξ + and ξ – , respectively. For cosmological parameter inference, we use the dark emulator package, combined with a halo occupation distribution prescription for the relation between galaxies and halos, to model w p and Δ⁢Σ down to quasinonlinear scales, and we estimate cosmological parameters after marginalizing over nuisance parameters. In our baseline analysis we employ an uninformative flat prior of the residual photo-z error, given by Π⁡(Δz ph )=$U$⁡(–1,1), to model a residual bias in the mean redshift of HSC source galaxies. Comparing the relative lensing amplitudes for Δ⁢Σ in the three redshift bins and for ξ ± with the single HSC source galaxy sample allows us to calibrate the photo-z parameter Δ⁢z ph to the precision of σ⁡(Δ⁢z ph )≃0.09. With these methods, we obtain a robust constraint on the cosmological parameters for the flat Λ⁢CDM model: S 8 =σ 8 ⁢(Ω m /0.3) 0.5 =$0.763^{+0.040}_{–0.036}$, or the best-constrained parameter given by $S^{'}_{8}$ = σ 8 ⁢(Ω m /0.3) 0.22 =0.721±0.028, determined with about 4% fractional precision. Based on multidimensional tension metrics, HSC-Y3 data exhibits about 2.5σ tension with the cosmological constraint inferred by Planck for the Λ⁢CDM model, and hints at a nonzero residual photo-z bias implying that the true mean redshift of the HSC galaxies at z ≳0.75 is higher than that implied by the original photo-z estimates.

79 ASTRONOMY AND ASTROPHYSICS↗

Uncertainty in Soil Moisture Retrievals: an Ensemble Approach Using SMOS L-Band Microwave Data

The uncertainty of soil moisture (SM) retrievals from satellite brightness temperature (TB) observations depends primarily on the choice of radiative transfer model (RTM) parameters, prior SM information and TB inputs. This paper studies the sensitivity of several (quasi-)operational and experimental SM retrieval products from the Soil Moisture Ocean Salinity (SMOS) mission to these choices at 11 reference sites, located in 7 watersheds across the United States (US). Different literature-based RTM parameter sets cause large biases between retrievals. Whereas typical RTM parameter sets are calibrated for SM retrievals, it is shown that a parameter set carefully optimized for TB forward modeling can also be used for retrieving SM. It is also shown that the inclusion of dynamic prior SM estimates in a Bayesian retrieval scheme can strongly improve SM retrievals, regardless of the choice of RTM parameters, and that the use of multi-angular and multi-polarization TB does not necessarily lead to superior retrievals compared to retrievals based on TB data at a single incidence angle and polarization. The second part of this paper evaluates ensemble uncertainty metrics for SM retrievals obtained by propagating a wide range of RTM parameters through the RTM. As expected for bounded variables, the spread in the ensemble SM retrievals is smallest for wet and dry SM values and highest for intermediate SM values. After removal of the strong long-term mean bias associated with the RTM parameter values for individual ensemble members, the remaining anomaly ensemble SM spread of 0.037 cu m/cu m approximates the actual time series unbiased root-mean-square-difference of 0.042 cu m/cu m between ensemble mean retrievals and in situ reference data across the reference sites. However, the temporal variability in the anomaly ensemble spread reveals higher-order biases in the retrieval error, which should be accounted for when characterizing retrieval error.

Jan Quets↗

Designing Resilience for Advanced Energy Systems

Advancements in energy technologies are making the grid more powerful, more efficient, and cleaner. As these promising innovations flourish across our communities, it is essential that our nation's infrastructure also becomes more resilient. Natural disasters, cyberattacks, user error, and a changing climate all present risks that could have devastating consequences. Individual emergencies are unique, but holistic planning and proactive measures can harden the grid and help anticipate and respond to any number of threats. The National Renewable Energy Laboratory (NREL) is at the forefront of this transition, establishing a vision for resilient energy systems today, and in the future.

energy disruption↗

Shifting the Intertial Navigation Paradigm with the MEMS Technology

"Why don't you use MEMS?" is of the most common questions posed to navigation systems engineers designing inertial navigation solutions in the modern era. The question stems from a general understanding that great strides have been made in terrestrial MEMS accelerometers and attitude rate sensors in terms of accuracy, mass, and power. Yet, when compared on a unit-to-unit basis, MEMS devices do not provide comparable performance (accuracy) to navigation grade sensors in several key metrics. This paper will propose a paradigm shift where the comparison in performance is between multiple MEMS devices and a single navigation grade sensor. The concept is that systematically, a sufficient number of MEMS sensors may mathematically provide comparable performance to a single navigation grade device and be competitive in terms power and mass allocations when viewed on a systems level. The implication is that both inertial navigation system design and fault detection, identification, and recovery could benefit from a system of MEMS devices in the same way that swarm sensing has benefited Earth observation and astronomy. A survey of the state of the art in inertial sensor accuracy scaled by mass and power will be provided to show the scaled error in MEMS and navigation graded devices, a mathematical comparison of multi-unit to single-unit sensor errors will be developed, and preliminary application to an Orion lunar skip atmospheric entry trajectory will be explored.

Crain, Timothy P., II↗

High‐Asymmetry Metasurface: A New Solution for Terahertz Resonance via Active Learning‐Augmented Diffusion Model

Terahertz (THz) metamaterials with high‐figure‐of‐merit (high‐FoM) performance resonance are essential for advancing sensors, detectors, and imagers. Conventional designs focus on symmetric or low‐asymmetry geometric structures, leaving high‐asymmetry designs largely unexplored due to the inefficiency of trial‐and‐error‐based rational design. Recent deep learning techniques offer automation and acceleration but are constrained by the need for large datasets inherent to their data‐driven nature. Here, a novel prior knowledge‐guided generative model augmented by a physics‐constrained active learning mechanism to design high‐asymmetry metamaterials. An advanced diffusion model learns features from a small set of classical structures with high‐FoM THz resonance and generates new high‐asymmetry structures. To mitigate the limited number of classical structures, the generated high‐asymmetry structures are actively selected and integrated into the initial training dataset based on their physical characteristics. Experimental results demonstrate the superior resonance performance of the generated high‐asymmetry metamaterials over classical designs, exhibiting improvements exceeding 30% in key resonance metrics. Remarkably, this performance is attained using only 68 classical structures as the initial training dataset, significantly reducing the data requirements for deep learning‐based metamaterial design. The proposed scheme for generating high‐asymmetry structures provides a new effective and efficient solution for high‐FoM resonance, expanding applications in high‐sensitivity THz metadevices.

diffusion model↗

Advanced Photovoltaic Module Characterization: Using Image Transformers for Current–Voltage Curve Prediction From Electroluminescence Images

Individual photovoltaic (PV) module health monitoring can be a daunting task for operation and maintenance of solar farms. Modules can be inspected through luminescence, thermal imaging, and current–voltage (I–V) curve analyzes for identification of damage and power loss. I–V curves provide easily interpretable data to determine module health as they directly provide electrical performance metrics. However, in order to obtain these curves, modules must be disconnected from the array and either removed to a solar simulator or characterized in situ with corrections for module temperature, the incident solar spectrum, and intensity. Luminescence or thermal images of a module are relatively easy to acquire in situ. Electroluminescence (EL) images highlight physical defects in the modules but do not provide easily interpretable features to correlate with electrical performance. This work presents a SWin transformer network to predict I–V curves for PV modules from their corresponding EL images. The predicted I–V curves allow the accurate prediction of the maximum power point (MPP), short-circuit current I sc , and open-circuit voltage V oc with a mean error less of than 1%. Comparing single diode model (SDM) parameters extracted from the predicted curves to those extracted from the true curves, the series resistance R s demonstrates a mean error of 5.19%, and the photocurrent I a mean error of 0.197%. The shunt resistance R sh and dark current Io parameters are predicted with larger errors because of their sensitivity to small changes in the I–V curve.

Byford, Brandon K. [New Mexico State Univ., Las Cr↗

In-Home Mobility Frequency and Stability in Older Adults Living Alone With or Without MCI: Introduction of New Metrics

Background: Older adults spend a considerable amount of time inside their residences; however, most research investigates out-of-home mobility and its health correlates. We measured indoor mobility using room-to-room transitions, tested their psychometric properties, and correlated indoor mobility with cognitive and functional status. Materials and Methods: Community-dwelling older adults living alone ( n = 139; age = 78.1 ± 8.6 years) from the Oregon Center for Aging & Technology (ORCATECH) and Minority Aging Research Study (MARS) were included in the study. Two indoor mobility features were developed using non-parametric parameters (frequency; stability): Indoor mobility frequency (room-to-room transitions/day) was detected using passive infrared (PIR) motion sensors fixed on the walls in four geographic locations (bathroom; bedroom; kitchen; living room) and using door contact sensors attached to the egress door in the entrance. Indoor mobility stability was estimated by variances of number of room-to-room transitions over a week. Test-retest reliability (Intra-class coefficient, ICC) and the minimal clinically important difference (MCID) defined as the standard error of measurement (SEM) were generated. Generalized estimating equations models related mobility features with mild cognitive impairment (MCI) and functional status (gait speed). Results: An average of 206 days (±127) of sensor data were analyzed per individual. Indoor mobility frequency and stability showed good to excellent test-retest reliability (ICCs = 0.91[0.88–0.94]; 0.59[0.48–0.70]). The MCIDs of mobility frequency and mobility stability were 18 and 0.09, respectively. On average, a higher indoor mobility frequency was associated with faster gait speed (β = 0.53, p = 0.04), suggesting an increase of 5.3 room-to-room transitions per day was associated with an increase of 10 cm/s gait speed. A decrease in mobility stability was associated with MCI (β = −0.04, p = 0.03). Discussion: Mobility frequency and stability in the home are clinically meaningful and reliable features. Pervasive-sensing systems deployed in homes can objectively reveal cognitive and functional status in older adults who live alone.

Wu, Chao-Yi↗

A Near-Real-Time Model for Predicting Electricity Disruptions in Texas During Winter Storms

There has been an increase in extreme weather events, posing a threat to power grid systems, potentially influenced by factors such as population growth, changes in ecosystems, land cover, and land use in the service area, as well as the growth of certain vegetation types. This research seeks to develop a predictive model to mitigate potential damages caused by future winter storms. This research utilizes the Light Gradient Boosting Machine (LightGBM), incorporating the number of power outages experienced at the county level, geographic details, weather information, and lagged outage and lagged weather data. The developed models were broadly divided into two groups, with six models in each group - one group without optimization and another with optimization, totaling 12 trained models. For model optimization, Bayesian optimization was employed using Root Mean Squared Error (RMSE) as the objective function. In results, when comparing Group 2 (the optimized group) with Group 1 (the non-optimized group), it was found that optimization did not always lead to a reduction in RMSE and Mean Absolute Error (MAE). However, in terms of Mean Directional Accuracy (MDA), while all results in Group 1 were below the baseline accuracy of 0.33, all results in Group 2 exceeded 0.33, with some cases showing an increase of more than three times the baseline. The results indicated that, in the optimized model group, Population and Pressure were the most influential factors when using current weather data and geographical information. When using lagged data, lagged recorded outages and lagged Pressure emerged as the most significant factors. Among the 12 developed models, the L-1-2-O model showed the lowest RMSE and MAE, as well as the highest accuracy, with values of 390.62 households and 168.13 households, respectively. To normalize the RMSE and MAE values, each metric was divided by the average number of households among the counties in Texas. For the L-1-2-O model, the scaled RMSE was 0.88% and the scaled MAE was 0.38%. In terms of MDA, which indicates the accuracy of the prediction direction, the L-1-O model achieved the highest score of 0.41. Although this study focused on Texas, which suffered the greatest impact from the winter storms in 2021, with additional validation, the methodology used in this research could be applied to other regions.

Lee, Jangjae [Texas A & M Univ., College Station, ↗

US-EUSST SSA Data Exchange for Improved Orbital Safety

Data sharing and exchange among different Space Situational Awareness (SSA) data collectors/providers is frequently discussed as a mechanism to improve the accuracy and precision of orbital safety products. Indeed, at the conceptual level this claim is quite sensible: objects with more tracking, and thus presumably better distribution of that tracking about their orbit, should produce updates with smaller epoch errors and more realistic covariances at epoch, which should then translate into better performance in prediction and thus improved close approach calculations. However, this thesis has not been verified with any large study involving two different data providers, through which the amount of realized improvement can be quantified and, perhaps more importantly, the logistics of effecting observation data sharing in a regularized way can be established and circulated to assist others. To create rubrics for helpful data sharing for conjunction assessment applications, and to collect empirical data on the improvements achieved through sharing of measurement data, the US Office of Space Commerce and the European Union Space Surveillance and Tracking (EUSST) Support Framework have embarked on a joint experiment to collect and exchange satellite metric observations on selected satellites of interest over an experimental period. Each entity will perform orbit determination with their own observations, the other entity’s observations, and with both observation data sets combined. The product results will be compared with each other, showing differences attributable both to the three different data groups and to the two entities’ different approaches to orbit determination. The exemplar satellites include both objects that have external precision reference ephemerides and those that do not, allowing the experiment to exercise both precision-comparison and assimilative-comparison techniques. The present reporting will give preliminary results and a set of lessons learned for data sharing; a second presentation later in 2023 will provide a full accounting of the experiment’s results. The hope is that, through this work, a pathway can be established for the expeditious and fruitful sharing among collection entities, both commercial and governmental.

space situational awareness↗

Hardware Implementation of Serially Concatenated PPM Decoder

A prototype decoder for a serially concatenated pulse position modulation (SCPPM) code has been implemented in a field-programmable gate array (FPGA). At the time of this reporting, this is the first known hardware SCPPM decoder. The SCPPM coding scheme, conceived for free-space optical communications with both deep-space and terrestrial applications in mind, is an improvement of several dB over the conventional Reed-Solomon PPM scheme. The design of the FPGA SCPPM decoder is based on a turbo decoding algorithm that requires relatively low computational complexity while delivering error-rate performance within approximately 1 dB of channel capacity. The SCPPM encoder consists of an outer convolutional encoder, an interleaver, an accumulator, and an inner modulation encoder (more precisely, a mapping of bits to PPM symbols). Each code is describable by a trellis (a finite directed graph). The SCPPM decoder consists of an inner soft-in-soft-out (SISO) module, a de-interleaver, an outer SISO module, and an interleaver connected in a loop (see figure). Each SISO module applies the Bahl-Cocke-Jelinek-Raviv (BCJR) algorithm to compute a-posteriori bit log-likelihood ratios (LLRs) from apriori LLRs by traversing the code trellis in forward and backward directions. The SISO modules iteratively refine the LLRs by passing the estimates between one another much like the working of a turbine engine. Extrinsic information (the difference between the a-posteriori and a-priori LLRs) is exchanged rather than the a-posteriori LLRs to minimize undesired feedback. All computations are performed in the logarithmic domain, wherein multiplications are translated into additions, thereby reducing complexity and sensitivity to fixed-point implementation roundoff errors. To lower the required memory for storing channel likelihood data and the amounts of data transfer between the decoder and the receiver, one can discard the majority of channel likelihoods, using only the remainder in operation of the decoder. This is accomplished in the receiver by transmitting only a subset consisting of the likelihoods that correspond to time slots containing the largest numbers of observed photons during each PPM symbol period. The assumed number of observed photons in the remaining time slots is set to the mean of a noise slot. In low background noise, the selection of a small subset in this manner results in only negligible loss. Other features of the decoder design to reduce complexity and increase speed include (1) quantization of metrics in an efficient procedure chosen to incur no more than a small performance loss and (2) the use of the max-star function that allows sum of exponentials to be computed by simple operations that involve only an addition, a subtraction, and a table lookup. Another prominent feature of the design is a provision for access to interleaver and de-interleaver memory in a single clock cycle, eliminating the multiple clock-cycle latency characteristic of prior interleaver and de-interleaver designs.

Moision, Bruce↗

In-situ radio-metric tracking to support navigation for interplanetary missions with multiple spacecraft

Doppler and ranging measurements between spacecraft can be obtained only when the ratio of the total received signal power to noise power density (P(sub t/N(sub 0)) at the receiving spacecraft is sufficiently large that reliable signal detection can be achieved within a reasonable time period. In this paper, the requirements on P(sub t)/N(sub 0) for reliable carrier signal detection is calculated as a function of various system parameters, including characteristics of the spacecraft computing hardware and a priori uncertainty in spacecraft-spacecraft relative velocity and acceleration. Also calculated is the P(sub t)/N(sub 0) requirement for relaible detection of a ranging signal, consistting of a carrier with pseudo-noise phase modulation. Once the P(sub t)/N(sub 0) requirement is determined, then for a given set of assumed spacecraft telecommunication characteristics (transmitted signal power, antenna gains, receiver noise temperatures) it is possible to calculate the maximum range at which a carrier signal or ranging signal may be acquired. A brief error covariance analysis has been conducted to illustrate the utility of in situ Doppler and ranging measurements for Mars approach navigation. The results indicate that navigation accuracies of a few kilometers can be achieved with either data type. The analysis also illustrates dependency of the achievable accuracy on the approach trajectory velocity.

Kahn, Robert D.↗

A Singular Perturbation Approach for Time-Domain Assessment of Phase Margin

This paper considers the problem of time-domain assessment of the Phase Margin (PM) of a Single Input Single Output (SISO) Linear Time-Invariant (LTI) system using a singular perturbation approach, where a SISO LTI fast loop system, whose phase lag increases monotonically with frequency, is introduced into the loop as a singular perturbation with a singular perturbation (time-scale separation) parameter Epsilon. First, a bijective relationship between the Singular Perturbation Margin (SPM) max and the PM of the nominal (slow) system is established with an approximation error on the order of Epsilon(exp 2). In proving this result, relationships between the singular perturbation parameter Epsilon, PM of the perturbed system, PM and SPM of the nominal system, and the (monotonically increasing) phase of the fast system are also revealed. These results make it possible to assess the PM of the nominal system in the time-domain for SISO LTI systems using the SPM with a standardized testing system called "PM-gauge," as demonstrated by examples. PM is a widely used stability margin for LTI control system design and certification. Unfortunately, it is not applicable to Linear Time-Varying (LTV) and Nonlinear Time-Varying (NLTV) systems. The approach developed here can be used to establish a theoretical as well as practical metric of stability margin for LTV and NLTV systems using a standardized SPM that is backward compatible with PM.

Zhu, J. Jim↗

Risk-Aware Framework Development for Disruption Prediction: Alcator C-Mod and DIII-D Survival Analysis

Abstract Survival regression models can achieve longer warning times at similar receiver operating characteristic performance than previously investigated models. Survival regression models are also shown to predict the time until a disruption will occur with lower error than other predictors. Time-to-event predictions from time-series data can be obtained with a survival analysis statistical framework, and there have been many tools developed for this task which we aim to apply to disruption prediction. Using the open-source Auton-Survival package we have implemented disruption predictors with the survival regression models Cox Proportional Hazards, Deep Cox Proportional Hazards, and Deep Survival Machines. To compare with previous work, we also include predictors using a Random Forest binary classifier, and a conditional Kaplan-Meier formalism. We benchmarked the performance of these five predictors using experimental data from the Alcator C-Mod and DIII-D tokamaks by simulating alarms on each individual shot. We find that developing machine-relevant metrics to evaluate models is an important area for future work. While this study finds cases where disruptive conditions are not predicted, there are instances where the desired outcome is produced. Giving the plasma control system the expected time-to-disruption will allow it to determine the optimal actuator response in real time to minimize risk of damage to the device.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quantum-Assisted Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

The quantum computing community has been searching for suitable applications to demonstrate the potential of near-term quantum devices. Quantum machine learning is a potential candidate, particularly using models that cannot be efficiently simulated with classical computers [1, 2]. This work focuses on a transition phase of quantum computers where the quantum machine learning model is still simulable classically but projected not to be simulable as the size of the model grows. Ultimately quantum computers may have advantages for high-dimensional real-world problems. Due to the limited number of qubits in current noisy intermediate-scale quantum (NISQ) devices, the direct application of quantum computers in high dimensional data is not feasible. To remedy this problem, an encoder-decoder architecture can be utilized. The encoder model would transform the high-dimensional data into a compact representation, to a level that small quantum computers can be used today (or in the near future), and the decoder would take the quantum processed outputs back to the high-dimensional space. Addressing the two challenges of quantum machine learning, this work investigates a hybrid supervised generative model with a quantum Ising Born machine embedded as the latent distribution. The model contains four main parts (Figure 1.a.): (1) a U-NET architecture responsible for learning segmentation flow, (2) a Prior network responsible for learning an encoded latent distribution of the input data, (3) a Born machine which represents the latent distribution, and (4) a Posterior network in charge of learning the joint encoded latent distribution of inputs and target data. The initial model, proposed by [3], is optimized by (1) maximizing the overlap of the prior and posterior latent distributions, and (2) minimizing the segmentation loss. The proposed model is designed to be investigated in a simulation environment applied to the real-world application of wildfire segmentation. Specifically, the model is designed to solve the patchy wildfire segmentations of Moderate Resolution Imaging Spectroradiometer (MODIS) by taking the MODIS observations and using Visible Infrared Imaging Radiometer Suite’s (VIIRS) consistent wildfire product as the target. The model solves patchy wildfire segmentations and provides insight into the epistemic errors sourced from model variation. The model utilizes the Born machine as a QUBO solver to represent the latent space as a Bernoulli distribution. The proposed configuration allows the variational segmentation model to leverage the true quantum probabilistic nature and derive a more expressive latent configuration, increasing the model performance in describing wildfire segmentations. The quantum probabilistic information of the Born machine is directly incorporated in the Kullback-Leibler divergence loss in the prior and posterior distributions, forcing the Bernoulli latent distribution to maximize the overlap of input and joint input-target distributions. The proposed model is then trained and compared with a baseline only consisting of direct Bernoulli latent distribution with no Born machine representing the latent space. The models are evaluated based on the segmentation metrics, such as precision, recall, intersect of union, with uncertainty boundaries accounting for the stochastic nature of the model. Our findings show that even in low latent-dimensional space (due to the limit in computational power of the classical quantum simulator), we are able to effectively capture the latent representation and hence the model performs better than the baseline. The findings are a projection for scaling the model into higher dimensional latent space with the Born machine surpassing the baseline performance. Figure 1. Sub-figure (a) demonstrates the architecture for the training phase. The model consists of a Prior and Posterior network that encode inputs and joint input-target data into compact representations, respectively. The Born machine represents the latent distribution, and the U-NET branch learns the segmentation patterns of the data. The stochasticity is introduced to the U-NET through its last layer to create meaningful but stochastic segmentations. Sub-figure (b) represents the inference phase where the model takes the stochastic behavior from the prior network and injects that into the U-NET. Each attempt of inference will generate different but similar segmentations from the same distribution of the wildfire event. REFERENCES [1] Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020). The Born supremacy: quantum advantage and training of an Ising Born machine. npj Quantum Information, 6(1), 1-11. [2] Liu, J. G., & Wang, L. (2018). Differentiable learning of quantum circuit born machines. Physical Review A, 98(6), 062324. [3] Kohl, S., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K., ... & Ronneberger, O. (2018). A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31.

quantum machine learning↗

AI-Driven Crack Detection for Remanufacturing Cylinder Heads Using Deep Learning and Engineering-Informed Data Augmentation

Detecting cracks in cylinder heads traditionally relies on manual inspection, which is time-consuming and susceptible to human error. As an alternative, automated object detection utilizing computer vision and machine learning models has been explored. However, these methods often face challenges due to a lack of sufficiently annotated training data, limited image diversity, and the inherently small size of cracks. Addressing these constraints, this paper introduces a novel automated crack-detection method that enhances data availability through a synthetic data generation technique. Unlike general data augmentation practices, our method involves copying cracks from one location to another, guided by both random and informed engineering decisions about likely crack formations due to cyclic thermomechanical loads. The innovative aspect of our approach lies in the integration of domain-specific engineering knowledge into the synthetic generation process, which substantially improves detection accuracy. We evaluate our method’s effectiveness using two metrics: the F2 score, which emphasizes recall to prioritize detecting all potential cracks, and mean average precision (MAP), a standard measure in object detection. Experimental results demonstrate that, without engineering insights, our method increases the F2 score from 0.40 to 0.65, while maintaining a stable MAP. Incorporating detailed engineering knowledge further enhances the F2 score to 0.70 and improves MAP to 0.57, representing increases of 63% and 43%, respectively. These results confirm that our approach not only mitigates the limitations of traditional data augmentation but also significantly advances the reliability and precision of crack detection in industrial settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗

Polarization Decomposition and Temperature Bias Resolution for SMAP Passive Soil Moisture Retrieval Using Time Series Brightness Temperature Observations

In passive microwave remote sensing of soil moisture, the tau-omega (τ-ω) model has often been used to provide soil moisture estimates at a spatial scale representative of the satellite footprint dimensions. For modeling simplicity, model parameters such as the single scattering albedo (ω) and vegetation opacity (τ) that go into the geophysical inversion process are often assumed to be independent of polarizations. Although this absence of polarization dependence can often be justified in special cases as in low-frequency remote sensing or under dense vegetation conditions, it is not a robust assumption in general. Additional model parameterization errors arising from this assumption are possible, leading to degradation in soil moisture estimation accuracy. In this paper, we propose a time series approach to try to resolve the polarization dependence of several τ-ω model parameters as well as the temperature bias arising from the ancillary temperature data. The Version 4 of the Soil Moisture Active Passive (SMAP) Level 1B brightness temperature time series observations were used to illustrate the mechanics of this approach, with an emphasis on a comparison between resulting satellite soil moisture retrievals and in situ data collected at several core validation sites. It was found that this time series approach resulted in significant reduction of the dry bias exhibited in the current SMAP passive soil moisture data products, while retaining the same performance in other metrics of the current baseline passive soil moisture retrieval algorithm.

time series↗

Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol applied to Earth system models

Abstract. Strongly coupled nonlinear phenomena such as those described by Earth system models (ESMs) are composed of multiple component models with independent mesh topologies and scalable numerical solvers. A common operation in ESMs is to remap or interpolate component solution fields defined on their computational mesh to another mesh with a different combinatorial structure and decomposition, e.g., from the atmosphere to the ocean, during the temporal integration of the coupled system. Several remapping schemes are currently in use or available for ESMs. However, a unified approach to compare the properties of these different schemes has not been attempted previously. We present a rigorous methodology for the evaluation and intercomparison of remapping methods through an independently implemented suite of metrics that measure the ability of a method to adhere to constraints such as grid independence, monotonicity, global conservation, and local extrema or feature preservation. A comprehensive set of numerical evaluations is conducted based on a progression of scalar fields from idealized and smooth to more general climate data with strong discontinuities and strict bounds. We examine four remapping algorithms with distinct design approaches, namely ESMF Regrid (Hill et al., 2004), TempestRemap (Ullrich and Taylor, 2015), generalized moving least squares (GMLS) (Trask and Kuberry, 2020) with post-processing filters, and WLS-ENOR (Li et al., 2020). By repeated iterative application of the high-order remapping methods to the test fields, we verify the accuracy of each scheme in terms of their observed convergence order for smooth data and determine the bounded error propagation using challenging, realistic field data on both uniform and regionally refined mesh cases. In addition to retaining high-order accuracy under idealized conditions, the methods also demonstrate robust remapping performance when dealing with non-smooth data. There is a failure to maintain monotonicity in the traditional L2-minimization approaches used in ESMF and TempestRemap, in contrast to stable recovery through nonlinear filters used in both meshless GMLS and hybrid mesh-based WLS-ENOR schemes. Local feature preservation analysis indicates that high-order methods perform better than low-order dissipative schemes for all test cases. The behavior of these remappers remains consistent when applied on regionally refined meshes, indicating mesh-invariant implementations. The MIRA intercomparison protocol proposed in this paper and the detailed comparison of the four algorithms demonstrate that the new schemes, namely GMLS and WLS-ENOR, are competitive compared to standard conservative minimization methods requiring computation of mesh intersections. The work presented in this paper provides a foundation that can be extended to include complex field definitions, realistic mesh topologies, and spectral element discretizations, thereby allowing for a more complete analysis of production-ready remapping packages.

58 GEOSCIENCES↗