Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ground truth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Identifying Light-Duty Vehicle Travel from Large-Scale Multimodal Wearable GPS Data with Novelty Detection Algorithms

Identifying travel mode within travel survey data sets, especially light-duty vehicle (LDV) travel, is foundational, though nontrivial, to travel behavior analysis and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. They are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the data requirements. This paper proposes an LDV travel mode detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique-one-class support vector machines (OCSVMs)-and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multimodal prediction.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

ADAPTIVE GROUP TESTING WITH MISMATCHED MODELS

Accurate detection of infected individuals is one of the critical steps in stopping any pandemic. When the underlying infection rate of the disease is low, testing people in groups, instead of testing each individual in the population, can be more efficient. In this work, we consider noisy adaptive group testing design with specific test sensitivity and specificity that select the optimal group given previous test results based on pre-selected utility function. As in prior studies on group testing, we model this problem as a sequential Bayesian Optimal Experimental Design (BOED) to adaptively design the groups for each test. We analyze the required number of group tests when using the updated posterior on the infection status and the corresponding Mutual Information (MI) as our utility function for selecting new groups. More importantly, we study how the potential bias on the ground-truth noise of group tests may affect the group testing sample complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2021

Tensorized Feature Spaces for Feature Explosion

In this paper 1 1 This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-000R22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan) This research used resources of the Oak Ridge Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC05-000R22725., we present a novel framework that uses tensor factorization to generate richer feature spaces for pixel classification in hyperspectral images. In particular, we assess the performance of different tensor rank decomposition methods as compared to the traditional kernel-based approaches for the hyperspectral image classification problem. We propose Orion, which takes as input a hyperspectral image tensor and a rank and outputs an enhanced feature space from the factor matrices of the decomposed tensor. Our method is a feature explosion technique that inherently maps low dimensional input space in $\mathbb{R}^{K}$ to high dimensional space in $\mathbb{R}^{R}$ , where $R\gg K$ , say in the order of 1000x, like a kernel. We show how the proposed method exploits the multi-linear structure of hyperspectral three dimensional tensor. We demonstrate the effectiveness of our method with experiments on three publicly available hyperspectral datasets with labeled pixels and compare their classification performance against traditional linear and non-linear supervised learning methods such as SVM with Linear, Polynomial, RBF kernels, and the Multi-Layer Perceptron model. Finally, we explore the relationship between the rank of the tensor decomposition and the classification accuracy using several hyperspectral datasets with ground truth.

Pasricha, Ravdeep Singh↗
DOE OSTI2024

Automated Calibration of Parallel and Distributed Computing Simulators: A Case Study

Many parallel and distributed computing research results are obtained in simulation, using simulators that mimic real-world executions on some target system. Each such simulator is configured by picking values for parameters that define the behavior of the underlying simulation models it implements. The main concern for a simulator is accuracy: simulated behaviors should be as close as possible to those observed in the real-world target system. This requires that values for each of the simulator's parameters be carefully picked, or “calibrated,” based on ground-truth real-world executions. Examining the current state of the art shows that simulator calibration, at least in the field of parallel and distributed computing, is often undocumented (and thus perhaps often not performed) and, when documented, is described as a labor-intensive, manual process. In this work we evaluate the benefit of automating simulation calibration using simple algorithms. Specifically, we use a real-world case study from the field of High Energy Physics and compare automated calibration to calibration performed by a domain scientist. Our main finding is that automated calibration is on par with or significantly outperforms the calibration performed by the domain scientist. Furthermore, automated calibration makes it straightforward to operate desirable tradeoffs between simulation accuracy and simulation speed.

Mc donald, Jesse↗
DOE OSTI2025

Advancing the Frontiers of Deep Learning for Low-Dose 3D Cone-Beam CT Reconstruction

X-ray computed tomography (CT) is an important noninvasive medical imaging modality for studying the structural details of internal organs. Image reconstruction in CT is an inverse problem of recovering an object's internal structure from the absorption profile of X-ray beams (sinogram) measured using a detector. The classical variational approach for CT reconstruction minimizes an energy functional using an appropriate iterative algorithm. Motivated by the success of deep learning (DL), researchers have begun to leverage training data and enhanced computing capabilities in recent years to produce high-fidelity reconstructed images. Nonetheless, much of the academic research in DL algorithms for CT has focused primarily on the two-dimensional setting (with simplified forward operators and noise model) for proofs-of-concept, and a comprehensive benchmarking of various classical and data-driven CT reconstruction approaches has not beenundertaken. The key objective of our CT reconstruction grand challenge was to promote methodological advancements for both classical and DL-based approaches for clinical CT with a reasonably accurately simulated 3D CT forward operator and noise model. We have utilized the publicly available LIDC-IDRI dataset and simulated sinograms and FDK images corresponding to two dose levels (clinical- and low-dose, constituting two tracks of the challenge) starting from the normal-dose images as the ground truth. In this paper, we summarize the motivation, context, and results of our challenge, and highlight the future research directions in DL for clinical CT.

X-ray tomography↗
DOE OSTI2024

Bilevel Nodal Behind-the-meter Solar Disaggregation Under Unexpected Extreme Weather Conditions

As the power grid undergoes significant paradigm shift due to the increasing penetration of renewable generation, the ever-growing installation of behind-the-meter (BTM) solar generation in the power grid also has a significant impact on nodal loads, posing challenges on transmission operators. Furthermore, increasing frequent and severe extreme weather events intertwine with ubiquitous BTM solar generations and have amplified the challenges of accurately model nodal load profiles, especially under the lack of ground-truth information for verification. To tackle these challenges, this paper introduces a bilevel model that utilizes year-long data (e.g., proxy solar, zonal load, and individual node load profiles) to disaggregate metered profiles into actual demand and BTM solar generation at each transmission node. The proxy solar not only scales the BTM solar generation of individual nodes but also create a compensation term for enhancing performance on days with unexpected extreme weather events. The proposed algorithm is validated with real-world PJM Interconnection data during unexpected events like the recent Winter Storm Elliott. For quantitative evaluations, a novel Score error is introduced, which is based on mean percentages and load scales and offers a universal assessment method suitable for all nodes and different data formats (e.g., normalized or raw values).

behind-the-meter solar, load disaggregations, load↗
DOE OSTI2022

Light-Duty Vehicle Trip Classification Using One-Class Novelty Detection and Exhaustive Feature Extraction

Travel mode classification within travel survey data sets, especially light-duty vehicle (LDV) trips, is foundational, though nontrivial, to emerging mobility systems, travel behavior analysis, and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. The detection approaches are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the dataset requirements. This work proposes an LDV trip detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique - one-class support vector machines (OCSVMs) - and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size and feature selection, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multi-modal trip prediction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Deep Factorization Machine Learning for Disaggregation of Transmission Load Profiles with High Penetration of Behind-The-Meter Solar

The ever-growing integration of distributed energy resources (DERs), especially behind-the-meter (BTM) solar generations, poses imperative operational challenges to system operators such as regional transmission organizations (RTOs). It is important for RTOs to effectively and accurately extract actual load profiles at the transmission level for a single node with significant BTM solar injection. This paper first illustrates the necessity of disaggregating the daily actual load profile of a single node. Furthermore, by segmenting nodes with selected timeseries features, nodes with significant BTM solar generation are identified. Lastly, a bi-level framework is proposed, comprising reference node disaggregation and DeepFM nodal disaggregation, aimed at disaggregating the nodal load profiles from which system operators require more information. By adopting a hybrid Deep Factorization Machine (DeepFM) model, the model achieve accurate results by extracting both linear and nonlinear relations between nodes in the same region and the zonal load and nodal load profile. To overcome the lack of ground truth, this paper segments the load profile into daytime, nighttime, and zero-crossing points and utilizes the latter two for evaluation purposes. The proposed disaggregation procedure is validated using real world, minute-level, normalized, and anonymized nodal data in the PJM service territory.

42 ENGINEERING↗
DOE OSTI2024

Surrogate Distributed Radiological Sources—Part II: Aerial Measurement Campaign

In this second part of a multipaper series, we present results from outdoor aerial measurements of surrogate distributed gamma-ray sources. Here we detail the design, manufacture, and testing of 300 individual ~7 mCi Cu-64 sealed sources at the Washington State University (WSU) research reactor and their deployment in various source patterns (each comprising up to 100 point sources) during the aerial measurement campaign. We show the results of two such measurements, in which approximate source shapes and qualitative source intensities can be seen from the count rate versus position plots, even without performing reconstructions. We also detail our efforts in ground-truthing the deployed sources and comparing measured gamma-ray data to model predictions. In particular, we compare measured versus expected count data using the Poisson deviance formalism of Part I to evaluate whether the fielded surrogate point-source arrays “look like” their truly continuous distributed source analogs. More generally, we find that the point-source array technique provides high source placement accuracy, relative ease of quantifying the true source configuration, scalability to source dimensions of ≲100 m, ease of reconfiguration and removal, and relatively low dose to personnel. Finally, we consider potential improvements and generalizations of the point-source array technique for future measurement campaigns.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Tri-Sectional Approximation of the Shortest Path to Long-Term Voltage Stability Boundary with Distributed Energy Resources

Ensuring long-term voltage stability is critical for reliable operations of power grids. High share of distributed energy resources (DERs) can create complicated system operation modes that may invalidate the traditional long-term voltage stability analysis based on typical operation modes. To address this challenge, this paper investigates how to compute the shortest path to the voltage stability boundary in the DER aggregated load space with large dispersion. Instead of working in the Euclidean space, we establish the analysis and computations on the algebraic power flow manifold to better capture the curvature change of the shortest path along the direction of losing stability. A modified optimal control framework is presented for obtaining the ground-truth of the smooth shortest path on the manifold. To efficiently and accurately solve for the shortest path, we further leverage the geometric features of the power flow manifold and propose a tri-sectional approximation model that is scalable for large-scale systems. Several numerical examples, up to the 1354-bus system, with different DER penetration levels and high dimensional renewable power injection variations are evaluated. The simulation results demonstrate that the tri-sectional approximation achieves high accuracy and efficiency to approximate the shortest path to the voltage stability boundary.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Semi-Supervised, Non-Intrusive Disaggregation of Nodal Load Profiles With Significant Behind-the-Meter Solar Generation

It is of imperative interests for regional transmission organizations (RTOs) to effectively extract actual load profiles at transmission nodes with significant behind-the-meter solar generation, which remains a gap in the existing technology paradigm. This paper proposes an explicit yet efficient linear estimator to disaggregate actual load profiles at transmission buses with significant behind-the-meter (BTM) solar generations. The proposed estimator is based on disaggregating (i.e., extracting) at locations close to transmission buses under consideration. Further, to overcome the lack of “ground truth” and validate the performance of the proposed algorithms, we first propose semi-supervised mechanisms with parameter tuning as well as unsupervised clustering and leverage the unique characteristics of zero-crossing points in BTM solar peaking behaviors, which we refer to as “Zone-to-Node (Z2N)” methods. Next, we further propose a bi-level Node-to-Node (N2N) framework that improves the overall disaggregation performances compared to Z2N. Numerical results are presented using real-world data at PJM Interconnection.

14 SOLAR ENERGY↗
DOE OSTI2020

Responses of tundra plant community carbon flux to experimental warming, dominant species removal and elevation

1. Rising temperatures can influence ecosystem processes both directly and indirectly, through effects on plant species and communities. An improved understanding of direct versus indirect effects of warming on ecosystem processes is needed for robust predictions of the impacts of climate change on terrestrial ecosystem carbon (C) dynamics. 2. To explore potential direct and indirect effects of warming on C dynamics in arctic tundra heath, we established a warming (open top chambers) and dominant plant species (Empetrum hermaphroditum Hagerup) removal experiment at a high and low elevation site. We measured the individual and interactive effects of warming, dominant species removal and elevation on plant species cover, the normalized difference vegetation index (NDVI), leaf area index (LAI), temperature, soil moisture and instantaneous net ecosystem CO 2 exchange. 3. We hypothesized that ecosystems would be stronger CO 2 sinks at the low elevation site, and that warming and species removal would weaken the CO 2 sink because warming should increase ecosystem respiration (ER) and species removal should reduce gross primary productivity (GPP). Furthermore, we hypothesized that warming and species removal would have the greatest impact on processes at the high elevation where site temperature should be most limiting and dominant species may buffer the overall community to environmental stress more compared to the low elevation site where plants are more likely to compete with the dominant species. 4. The instantaneous CO 2 flux, which reflected a weak CO 2 sink, was similar at both elevations. Neither experimental warming nor dominant species removal significantly changed GPP or instantaneous net ecosystem CO 2 exchange even though species removal significantly reduced ER, NDVI and LAI. 5. Our results show that even the loss of dominant plant species may not result in significant landscape-scale responses of net ecosystem CO 2 exchange to warming. They also show that NDVI and LAI may be limited in their ability to predict changes in GPP in these tundra heaths systems. Our study highlights the need for more detailed vegetation analyses and ground-truthed measurements in order to accurately predict direct and indirect impacts of climatic change on ecosystem C dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Stimulation of isoprene emissions and electron transport rates are a key mechanism of thermal tolerance in the tropical species Vismia guianensis

Tropical forests absorb large amounts of atmospheric CO 2 through photosynthesis, but high surface temperatures suppress this absorption while promoting isoprene emissions. While mechanistic isoprene emission models predict a tight coupling to photosynthetic electron transport (ETR) as a function of temperature, direct field observations of these phenomenon are lacking in the tropics and are necessary to assess the impact of a warming climate on global isoprene emissions. In this paper, we demonstrate that in the early successional species Vismia guianensis in the central Amazon, ETR rates increased with temperature in concert with isoprene emissions, even as stomatal conductance ($g _s$) and net photosynthetic carbon fixation ($P_n$) declined. We observed the highest temperatures of continually increasing isoprene emissions yet reported (50°C). While $P_n$ showed an optimum value of 32.6 ± 0.4°C, isoprene emissions, ETR, and the oxidation state of PSII reaction centers (q L ) increased with leaf temperature with strong linear correlations for ETR (ρ = 0.98) and q L (ρ= 0.99) with leaf isoprene emissions. In contrast, other photoprotective mechanisms, such as non-photochemical quenching (NPQ), were not activated at elevated temperatures. Inhibition of isoprenoid biosynthesis repressed $P_n$ at high temperatures through a mechanism that was independent of stomatal closure. While extreme warming will decrease $g_s$ and $P_n$ in tropical species, our observations support a thermal tolerance mechanism where the maintenance of high photosynthetic capacity under extreme warming is assisted by the simultaneous stimulation of ETR and metabolic pathways that consume the direct products of ETR including photorespiration and the biosynthesis of thermoprotective isoprenoids. Our results confirm that models which link isoprene emissions to the rate of ETR hold true in tropical species and provide necessary "ground-truthing" for simulations of the large predicted increases in tropical isoprene emissions with climate warming.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Yield From Iowa's First Commercial Miscanthus Fields: Implications of Spatial Variability for Productivity and Sustainability Beyond Research Plots

The cultivation of sterile giant miscanthus (Miscanthus × giganteus, M × g) for bioenergy and bioproducts has expanded into grain-cropped land in the United States (US) as local markets developed for this high-yielding perennial grass (10–30 Mg DM ha −1 ). However, the magnitude of spatial and temporal variability in yield within US Corn Belt fields, along with impacts on economic return and sustainable land management, is poorly understood. This study established a diagnostic model relating remote sensing-derived vegetation indices to ground truth data from 105 hand-harvested stem biomass samples, which were strategically selected to represent the full range of vegetation index observations. The high-resolution satellite-sensed vegetation indices captured > 90% of the yield variation measured within fields. This model was then used to predict yield variability and assess economic performance across four of the first commercial M × g fields in the Corn Belt state of Iowa, US. Significant spatial variability in biomass dry matter (DM) yields (9.3–18.1 Mg DM ha −1 ) and net profits ($\$$83 to $\$$1211.5 ha −1 ) was observed. All fields were profitable in all site-years. When low profit occurred, it was explained by limited management experience of the crop in Iowa. The breakeven yield at a selling price of $\$$130 Mg −1 varied from 9.0–12.1 Mg ha −1 at 15% moisture content (7.6–10.3 Mg DM ha −1 ). Breakeven prices ranged from $\$$73 to $\$$122.4 Mg −1 , matching ranges used in the Department of Energy Billion Ton Report (US Department of Energy, 2023). Notably, M × g yield and profits were commensurate with grain crops particularly with favorable precipitation. This study provides insight on the M × g management “learning curve”, performance on marginal land and in drought conditions, and demonstrates that addressing yield gaps, reducing costs, and implementing precision agriculture strategies can enhance profitability. These findings emphasize the value of remote sensing technologies in guiding sustainable and competitive commercial-scale M × g production.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Magnesium isotopes of the bulk solar wind from Genesis diamond-like carbon films

–NASA’s Genesis Mission returned solar wind (SW) to the Earth for analysis to derive the composition of the solar photosphere from solar material. SW analyses control the precision of the derived solar compositions, but their ultimate accuracy is limited by the theoretical or empirical models of fractionation due to SW formation. Mg isotopes are “ground truth” for these models since, except for CAIs, planetary materials have a uniform Mg isotopic composition (within ≤1&) so any significant isotopic fractionation of SW Mg is primarily that of SW formation and subsequent acceleration through the corona. This study analyzed Mg isotopes in a bulk SW diamond-like carbon (DLC) film on silicon collector returned by the Genesis Mission. A novel data reduction technique was required to account for variable ion yield and instrumental mass fractionation (IMF) in the DLC. The resulting SW Mg fractionation relative to the DSM-3 laboratory standard was ( 14.4&, 30.2&) (4.1&, 5.5&), where the uncertainty is 2σ SE of the data combined with a 2.5& (total) error in the IMF determination. Two of the SW fractionation models considered generally agreed with our data. Their possible ramifications are discussed for O isotopes based on the CAI nebular composition of McKeegan et al. (2011).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Identification Uncertainty in Inverse Material Model Parameter Determination: A Sensitivity‐Based Decision Process for Load Path Selection

This research proposes a sensitivity-based framework for selecting the optimal prescribed loading path for a biaxial cruciform specimen. Optimality here is determined by the direction and magnitude of the prescribed displacement that minimizes the influence of random noise on the material model parameter identification. Using simulated experimental data based on finite element simulation, in this work, we identify the material model parameters of a Ludwik hardening model and plane stress implementation of the Hill-48 yield criterion using finite element model updating (FEMU). Our analysis reveals that the identification (or estimator) uncertainty of model parameters depends on the displacement boundary conditions (i.e., loading sequence) and the ground-truth value of the individual parameters. Optimal experimental design (OED) criteria based on the Fisher information matrix were investigated to mitigate indecision in the choice of optimal load path when the identification uncertainty of different material model parameters optimized at different load paths. The determinant of the Fisher information matrix was chosen here as the more useful metric due to its ability to capture uncertainty of the most influential material model parameters. The proposed framework demonstrates potential for real-time automated load step selection using scalar criteria derived prior to mechanical loading. The framework can be generalized to other geometries, boundary conditions and material models, allowing this procedure to be utilized for different experimental configurations and materials.

Fayad, Samuel S. [University of Illinois at Urbana↗