Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Tutorial on In Situ and Operando (Scanning) Transmission Electron Microscopy for Analysis of Nanoscale Structure–Property Relationships

In situ and operando (scanning) transmission electron microscopy [(S)TEM] is a powerful characterization technique that uses imaging, diffraction, and spectroscopy to gain nano-to-atomic scale insights into the structure–property relationships in materials. This technique is both customizable and complex because many factors impact the ability to collect structural, compositional, and bonding information from a sample during environmental exposure or under application of an external stimulus. In the past two decades, in situ and operando (S)TEM methods have diversified and grown to encompass additional capabilities, higher degrees of precision, dynamic tracking abilities, enhanced reproducibility, and improved analytical tools. Much of this growth has been shared through the community and within commercialized products that enable rapid adoption and training in this approach. This tutorial aims to serve as a guide for students, collaborators, and nonspecialists to learn the important factors that impact the success of in situ and operando (S)TEM experiments and assess the value of the results obtained. As this is not a step-by-step guide, readers are encouraged to seek out the many comprehensive resources available for gaining a deeper understanding of in situ and operando (S)TEM methods, property measurements, data acquisition, reproducibility, and data analytics.

(S)TEM↗
DOE OSTI2026

Comparability of Liquid Chromatography Tandem Mass Spectrometry Analysis of Dissolved Organic Matter across Laboratories

Non-targeted liquid chromatography tandem highresolution mass spectrometry (LC−MS/MS) is increasingly applied for the structure-resolved chemical analysis of dissolved organic matter (DOM). With new developments in MS instrumentation and analysis software, the approach has gained substantial momentum over the past decade. However, achieving high-quality analytical data that is reproducible and comparable across laboratories can be a bottleneck in non-targeted metabolomics and organic matter chemical analysis, especially for data reuse in repository-scale analyses. Understanding the capabilities as well as challenges of comparing LC−MS/MS data from different laboratories is necessary for inferring global trends from public data sets. To illuminate instrumentation factors that drive differences and variability, we used a standardized data analysis pipeline, including classical (CMN) and featurebased molecular networking (FBMN), to analyze data from a ring trial by 24 laboratories on identical sample sets of algal and DOM extracts that were mixed in predefined concentrations and spiked with standards. Our results showed that data sets from similar mass spectrometer types with unified instrument parameters were qualitatively comparable, resolving the same general trends and shared mass spectral features. Interlaboratory comparability was best for high-intensity features, while low-intensity features showed greater detection variability. Our analysis also highlights challenges when comparing data from instruments with different acquisition rates or operating with less standardized methods. Lastly, we provide recommendations for data integration, public data sharing, standardization, and best practices for standardized LC−MS/MS data acquisition, which will be critical for long-term time series and intercomparability of DOM chemical analyses.

DOM↗
DOE OSTI2024

Analytical capabilities for iodine detection: Review of possibilities for different applications

This Review summarizes a range of analytical techniques that can be used to detect, quantify, and/or distinguish between isotopes of iodine (e.g., long-lived 129 I, short-lived 131 I, stable 127 I). One reason this is of interest is that understanding potential radioiodine release from nuclear processes is crucial to prevent environmental contamination and to protect human health as it can incorporate into the thyroid leading to cancer. It is also of interest for evaluating iodine retention performances of next-generation iodine off-gas capture materials and long-term waste forms for immobilizing radioiodine for disposal in geologic repositories. Depending upon the form of iodine (e.g., molecules, elemental, and ionic) and the matter state (i.e., solid, liquid, and gaseous), the available options can vary. In addition, several other key parameters vary between the methods discussed herein, including the destructive vs nondestructive nature of the measurement process (including in situ vs ex situ measurement options), the analytical data collection times, and the amount of sample required for analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Emulation and detection of physical faults and cyber-attacks on building energy systems through real-time hardware-in-the-loop experiments

The increasing use of remote or mobile access, integrated wearable technologies, data exchange, and cloud-based data analytics in modern smart buildings is steering the building industry towards open communication technologies. The increased connectivity and accessibility could lead to more cyber-attacks in smart buildings. On the other hand, physical faults (e.g., HVAC -heating, ventilation, and air-conditioning faults) may have similar adverse impacts as those from the cyber-attacks on building energy systems, such as occupant discomfort, energy wastage, and equipment downtime. However, current physical behavior-based anomaly detection methods fail to differentiate between cyber-attacks and physical faults in building energy systems. Moreover, the challenge in collecting real-world threat data with ground truth has led researchers to rely on numerical models with user-defined assumptions, which may not accurately reflect real-world conditions due to the lack of in-situ experimental datasets. To address these challenges and gaps, this paper presents a flexible hardware-in-the-loop (HIL) testbed for generating cyber-attack and physical fault datasets and demonstrating threat detection algorithms in a real building automation system (BAS) environment. This testbed combines hardware (i.e., real BAS with local HVAC controllers and a physical network) with software (i.e., high-fidelity models to represent behaviors of building envelope and HVAC energy systems), enabling emulations of realistic threats. Five HIL experiments, including one baseline without any threats, two with physical faults, and two with cyber-attacks, were conducted to generate datasets containing detailed network traffic and system states. A joint classification framework, incorporating a network analyzer and a physical HVAC fault detector, was proposed to automatically detect cyber-physical abnormalities on BAS at both the network and the physical HVAC levels. The network analyzer comprises a conditional random fields (CRF) based command validator and a statistics-based detection strategy. The fault detector employs a weather and schedule-based pattern matching and feature-based principal component analysis (WPM-FPCA) method. Evaluation of the classification using four metrics from the multi-class confusion matrix revealed an average accuracy of 90.2%, recall of 89.7%, precision of 88.5% and F1-score of 89.2%. Finally, these results demonstrate that the proposed joint classification framework can effectively differentiate between specific types of cyber-attacks (e.g., device reinitialization attack, network Denial-of-Service attack) and physical faults (e.g., air handling unit operational fault, cooling coil valve stuck) in real time for improved building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Scalable Technologies Achieving Risk-Informed Condition-Based Predictive Maintenance Enhancing the Economic Performance of Operating Nuclear Power Plants

The primary objective of the research presented in this report is to develop scalable technologies that are deployable across plant assets and across the nuclear fleet to achieve risk-informed predictive maintenance (PdM) strategies at commercial nuclear power plants (NPPs). Over the years, the nuclear fleet has relied on labor-intensive and time-consuming preventive maintenance (PM) programs, driving up operation and maintenance (O&M) costs to achieve high capacity factors. A well-constructed risk-informed PdM approach for an identified plant asset has been developed in this research, taking advantage of advancements in data analytics, machine learning (ML), artificial intelligence (AI), physics-informed modeling, and visualization. These technologies would allow commercial NPPs to reliably transition from current labor-intensive PM programs to a technology driven PdM program, eliminating unnecessary O&M costs. The work presented in the report is being developed as part of a collaborative research effort between Idaho National Laboratory and Public Service Enterprise Group Nuclear, LLC. This report (1) reflects the results of work by LWRS Program researchers with PSEG, Nuclear LLC-owned Salem and Hope Creek Nuclear Power Plants; (2) presents utilization of circulating water system (CWS) heterogeneous data and fault modes from both the Salem and Hope Creek nuclear power plant sites to develop salient fault signatures associated with each fault mode; (3) describes the integration of component-level predictive models into a robust system-level model enabled by the federated-transfer learning; (4) describes the development of physics-informed model of circulating water pump and motor; (5) develops a scalable risk and economic model; and (6) outlines the development of a user-centric visualization application. The outcomes presented in this report lays the foundation and provides a much-needed technical basis to focus on explainability and trustworthiness of ML and AI-based technologies, as part of future research.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Adaptive elasticity policies for staging-based in situ visualization

In situ processing aims to alleviate the growing gap between computation and I/O capabilities by performing data processing close to the data source. In situ processing is widely used to process data generated by multiple data sources, including observation data from edge devices or scientific observational facilities and the simulation data generated by scientific computation on a high-performance computing (HPC) platform. For a scientific workflow that is run on an HPC platform and composed of a simulation program and an in situ data analytics or visualization (abbreviated as ana/vis) task, there is an implicit assumption that the computing resources assigned to the workflow keep static during the workflow execution. However, with the converging trend between the HPC and cloud computing platform, running the in situ ana/vis task in an elastic way is promising to decrease its overhead and improve its resource utilization rate. Resource elasticity represents the ability to change resource configurations such as the number of computing nodes/processes during workflow execution. An elastic job may dynamically adjust resource configurations; it may use a few resources at the beginning and more resources toward the end of the job when interesting data appear. However, it is hard to predict a priori how many computing nodes/processes need to be added/removed during the workflow execution to adapt to changing workflow needs. How to efficiently guide elasticity operations, such as growing or shrinking the number of processes used for in situ analysis during workflow execution, is an open-ended research question. In this article, we present adaptive elasticity policies that adopt workflow runtime information collected during workflow execution to predict how to trigger the addition/removal of processes in order to minimize in situ processing overhead. Taking in situ visualization tasks as an example, we integrate the presented elasticity policies into a staging-based elastic workflow and evaluate its efficiency in multiple elasticity scenarios. Compared with the situation without elasticity or with a static elasticity policy that uses a fixed number of processes for each rescaling operation, the adaptive elasticity policy can save overhead in finding a proper resource configuration and improve resource utilization efficiency. Furthermore, one experiment illustrates that the adaptive elasticity policy saves 41% of core-hours compared with the situation without the resource elasticity.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2011

Transformation of Air Quality Monitor Data from the International Space Station into Toxicological Effect Groups

The primary reason for monitoring air quality aboard the International Space Station (ISS) is to determine whether air pollutants have collectively reached a concentration where the crew could experience adverse health effects. These effects could be near-real-time (e.g. headache, respiratory irritation) or occur late in the mission or even years later (e.g. cancer, liver toxicity). Secondary purposes for monitoring include discovery that a potentially harmful compound has leaked into the atmosphere or that air revitalization system performance has diminished. Typical ISS atmospheric trace pollutants consist of alcohols, aldehydes, aromatic compounds, halo-carbons, siloxanes, and silanols. Rarely, sulfur-containing compounds and alkanes are found at trace levels. Spacecraft Maximum Allowable Concentrations (SMACs) have been set in cooperation with a subcommittee of the National Research Council Committee on Toxicology. For each compound and time of exposure, the limiting adverse effect(s) has been identified. By factoring the analytical data from the Air Quality Monitor (AQM), which is in use as a prototype instrument aboard the ISS, through the array of compounds and SMACs, the risk of 16 specific adverse effects can be estimated. Within each adverse-effect group, we have used an additive model proportioned to each applicable 180-day SMAC to estimate risk. In the recent past this conversion has been performed using archival data, which can be delayed for months after an air sample is taken because it must be returned to earth for analysis. But with the AQM gathering in situ data each week, NASA is in a position to follow toxic-effect groups and correlate these with any reported crew symptoms. The AQM data are supplemented with data from real-time CO2 instruments aboard the ISS and from archival measurements of formaldehyde, which the AQM cannot detect.

James, John T.↗
DOE OSTI2023

Evaluation of the excitation spectra with diffusion Monte Carlo on an auxiliary bosonic ground state

We aim to improve upon the variational Monte Carlo (VMC) approach for excitations replacing the Jastrow factor by an auxiliary bosonic (AB) ground state and multiplying it by a fermionic component factor. The instantaneous change in imaginary time of an arbitrary excitation in the original interacting fermionic system is obtained by measuring observables via the ground-state distribution of walkers of an AB system that is subject to an auxiliary effective potential. The effective potential is used to (i) drive the AB system’s ground-state configuration space toward the configuration space of the excitations of the original fermionic system and (ii) subtract from a diffusion Monte Carlo (DMC) calculation contributions that can be included in conventional approximations, such as mean-field and configuration interaction (CI) methods. In this novel approach, the AB ground state is treated statistically in DMC, whereas the fermionic component of the original system is expanded in a basis. The excitation energies of the fermionic eigenstates are obtained by sampling a fermion–boson coupling term on the AB ground state. We show that this approach can take advantage of and correct for approximate eigenstates obtained via mean-field calculations or truncated interactions. We demonstrate that the AB ground-state factor incorporates the correlations missed by standard Jastrow factors, further reducing basis truncation errors. Relevant parts of the theory have been tested in soluble model systems and exhibit excellent agreement with exact analytical data and CI and VMC approaches. In particular, for limited basis set expansions and sufficient statistics, AB approaches outperform CI and VMC in terms of basis size for the same systems. The implementation of this method in current codes, despite being demanding, will be facilitated by reusing procedures already developed for calculating ground-state properties with DMC and excitations with VMC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2014

Space Weathering of Olivine in Lunar Soils: A Comparison to Itokawa Regolith Samples

Regolith particles from airless bodies preserve a record of the space weathering processes that occurred during their surface exposure history. These processes have major implications for interpreting remote-sensing data from airless bodies. Solar wind irradiation effects occur in the rims of exposed grains, and impact processes result in the accumulation of vapordeposited elements and other surface-adhering materials. The grains returned from the surface of Itokawa by the Hayabusa mission allow the space weathering "style" of a chondritic, asteroidal "soil" to be compared to the lunar case. Here, we present new studies of space-weathered olivine grains from lunar soils, and compare these results to olivine grains from Itokawa. Samples and Methods: We analyzed microtome thin sections of olivine grains from the 20-45 micron fractions of three lunar soils: 71061, 71501 and 10084 (immature, submature and mature, respectively). Imaging and analytical data were obtained using a JEOL 2500SE 200kV field-emission scanning-transmission electron microscope equipped with a thin-window energy-dispersive x-ray spectrometer. Similar analyses were obtained from three Hayabusa olivine grains. Results and Discussion: We observed lunar grains showing a range of solar flare track densities (from <10(exp 9) to approx.10(exp 12)/sq cm). The lunar olivines all show disordered, highly strained, nanocrystalline rims up to 150-nm thick. The disordered rim thickness is positively correlated with solar flare track density. All of the disordered rims are overlain by a Si-rich amorphous layer, ranging up to 50-nm thick, enriched in elements that are not derived from the host olivine (e.g., Ca, Al, and Ti). The outmost layer represents impact-generated vapor deposits typically observed on other lunar soil grains. The Hayabusa olivine grains show track densities <10(exp 10)/sq cm and display disordered rims 50- to 100-nm thick. The track densities are intermediate to those observed in olivines in immature and submature lunar soils and indicate surface exposures of approx. 10(exp 5) years. The outermost few nanometers of the disordered rims on Hayabusa olivines are more Si-rich and Mg- and Fe-depleted relative to the cores of the grains and likely represent a minor accumulation of impact-generated vapors or sputter deposits. Nanophase Fe metal particles are less abundant in the Hayabusa rims compared to the rims on lunar grains. Conclusions: The Hayabusa and lunar olivine grain rims have widths and microstructures consistent with formation from atomic displacement damage from solar wind ions. The space weathering features in the Hayabusa grains are similar to those observed in olivines from immature to submature lunar soils. A major difference, however, is that the Hayabusa grains appear to lack the hypervelocity impact products (melt spherules, thick vapor deposits, and abundant nanophase Fe metal particles) that are common in lunar soil grains with a similar exposure history.

Keller, L. P.↗
DOE OSTI2022

Multiscale spatial analysis of fracture arrangement and pattern reconstruction using Ripley's K-function

This work presents novel multiscale spatial data analytics using Ripley's K-function, as a measure of spatial interaction, to study one-dimensional arrangement of fractures. Fracture spatial arrangements are classified into clustered, anticlustered, or indistinguishable from random by testing statistical significance of the calculated Ripley's K-function. Characterizations of fracture arrangements are performed as a function of length scale and position. Analysis of the K-function along the study interval identifies where fracture clustering and anticlustering occur. Here, a simulation technique is also introduced here to statistically reconstruct spatial arrangements and to generate fracture realizations that are spatially similar to the fractures observed in the field. With this simulation technique, one can also fill spatial gaps in fracture measurements where data are absent, unreliable, or unused. Synthetic as well as field-measured 1D fracture datasets are used for testing and demonstration. Methods introduced in this work can be readily applied to fracture datasets observed in outcrops, borehole image logs, and cores.

58 GEOSCIENCES↗
DOE OSTI2020

Integrated Risk-Informed Condition Based Maintenance Capability and Automated Platform: Technical Report 1

Due to continuing global energy market trends, driven heavily by the abundant preserves of natural gas, there is an immediate need to reduce costs associated with operation and maintenance (O&M) for the current domestic nuclear power industry and for future reactor developments. This is to ensure that nuclear power generation remains an economically competitive and viable option in the energy market. O&M costs include labor-intensive preventive maintenance (PM) programs, which involve manually-performed inspection, calibration, testing, and maintenance of plant assets at periodic frequency and time-based replacement of assets, irrespective of their condition. This has resulted in an expensive, labor-centric business model to achieve high capacity factors. Fortunately, there are technologies (advanced sensors, data analytics, and risk assessment methodologies) that can enable the transition from a labor-centric business model to a technology-centric business model. The technology-centric business model will result in a significant reduction of PM activities, laying the foundation for real-time condition assessment of plant assets, reducing overall labor and part costs. To enable this transition, PKMJ Technical Services LLC is partnering with the U.S. Department of Energy’s Idaho National Laboratory (operated by the Battelle Energy Alliance, LLC) and the Public Services Enterprise Group (PSEG) Nuclear, LLC in the Integrated Risk-Informed Condition-Based Maintenance Capability and Automated Platform Project. In this report, the configuration of a digital cloud platform using Microsoft Azure is discussed, data from the PSEG Salem Nuclear Generating Station Units 1 & 2 are imported into a digital cloud platform, and the data is used for an evaluation of several key areas: cost impact analysis, risk-informed model development, and preventive maintenance strategy optimization. First, the cost impact analysis reviews which plant assets are potential good candidates for condition-based monitoring. Next, INL utilized the data in their local environment to develop the risk-informed model; which provides estimates of failure rates and probability of failures of assets based upon their past performance. The developed model is performed on assets selected from the cost impact analysis. Lastly, engineers assess the preventive maintenance strategy for the selected assets at PSEG against maintenance strategies in the nuclear industry for similar assets to potentially identify acceptable justification for the extension of current maintenance frequencies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Mic-hackathon 2024: hackathon on machine learning for electron and scanning probe microscopy

Microscopy is one of the primary sources of information on materials structure and functionality at the nanometer and atomic scales. The data generated through microscopy is often contained in well-structured datasets, enriched with extensive metadata and sample histories, although not always with the same level of detail or storage format. The broad incorporation of data management plans by major funding agencies ensures the preservation and accessibility of this data. However, deriving insights from these rich datasets remains challenging due to the lack of established code ecosystems, standardized benchmarks, and integration strategies. Correspondingly, the efficiency of data usage is very low, and time expenditures at the analysis stage are enormous. In addition to post-acquisition data analysis, the emergence of application programming interfaces by major microscope manufacturers now creates opportunities for real-time ML-based data analytics to enable automated decision making, and particularly ML-agent controlled real-time microscope operation. Despite these opportunities, there is a significant gap in integrating the ML community with the broader microscopy community, limiting the value that these methods bring to physics and materials discovery and materials optimization. Hackathons address these challenges by fostering collaboration between ML experts and microscopy professionals, encouraging the development of innovative solutions that leverage ML for microscopy and preparing the workforce of the future both for microscopy-intensive domains areas, instrument manufacturers, and ML scientists interested in real world applications for fundamental research, materials optimization, and manufacturing. The hackathon generated benchmark datasets and digital twins of microscopes that further contribute to the development of the field and establish data analysis ecosystems. All the codes can be found at GitHub(https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1) and Zenodo (https://zenodo.org/records/15579940).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Evaluating Optical Techniques to Characterize Solid State Samples for the Pu-238 Supply Program

This report documents steps that have been taken to establish advanced characterization capabilities for solid-state samples to support the 238 Pu Supply Program. The program has already invested significantly in spectroscopy and online monitoring development for liquid processes. Many of the data, analytical methods, and equipment could also be leveraged for the analysis of Np/Pu oxides and Np pellets to help classify material properties and link them to operations. The techniques described in this work include diffuse reflectance spectroscopy (DRS), Raman spectroscopy, and laser-induced breakdown spectroscopy (LIBS). Each technique is sensitive to various chemical and/or elemental species and can provide complimentary information to more standard methods such as powder x-ray diffraction and scanning electron microscopy. These options are remotely deployable via fiber-optic cables. DRS and Raman spectroscopy are already approved for glove box and hot cell work, but LIBS requires US Department of Energy approval for incorporation. Raman spectroscopy does require laser shielding, which means that DRS is the easiest method to implement. However, each technique provides complimentary data, and the most robust sample characterization could be achieved when all three, among other methods, are harnessed together. This report documents some of the progress made testing these capabilities, some of the challenges, and next steps to optimize the technology and integration strategies.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2021

A High Performance Sparse Tensor Algebra Compiler in MLIR

Sparse tensor algebra is widely used in many applications, including scientific computing, machine learning, and data analytics. The performance of sparse tensor algebra kernels strongly depends on the intrinsic characteristics of the input tensors, hence many storage formats are designed for tensors to achieve optimal performance for particular applications/architectures, which makes it challenging to implement and optimize every tensor operation of interest on a given architecture. We propose a tensor algebra domain-specific language (DSL) and compiler framework to automatically generate kernels for mixed sparse-dense tensor algebra operations. The proposed DSL provides high-level programming abstractions that resemble the familiar Einstein notation to represent tensor algebra operations. The compiler introduces a new Sparse Tensor Algebra dialect built on top of LLVM's extensible MLIR compiler infrastructure for efficient code generation while covering a wide range of tensor storage formats. Our compiler also leverages input-dependent code optimization to enhance data locality for better performance. Our results show that the performance of automatically generated kernels outperforms the state-of-the-art sparse tensor algebra compiler, with up to 20.92x, 6.39x, and 13.9x performance improvement over state-of-the-art tensor algebra compilers, for parallel SpMV, SpMM, and TTM, respectively.

Tian, Ruiqin↗
DOE OSTI2021

Analysis Program Annual Progress Report (FY2020)

During fiscal year 2020 (FY 2020), the U.S. Department of Energy Vehicle Technologies Office (VTO) funded analysis projects supportive of VTO’s goals to pursue early stage research in vehicle and mobility system technologies to reduce petroleum dependence, increase energy reliability and security, improve transportation affordability, and promote economic growth. VTO analysis projects result in a foundation of data, analytical models, and applied analyses that provide insights into critical transportation energy problems and assist in research investment prioritization and portfolio planning. This document presents a brief overview of VTO analysis efforts and progress for projects funded in FY 2020. Each of the progress reports includes project objectives, approach, and highlights of the technical results that were accomplished during the fiscal year.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Facilitating better and faster simulations of aerosol-cloud interactions in Earth system models

Focal Area(s): 1. Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising a hierarchy of models. 2. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: One major challenge that Earth system models (ESMs) face in providing credible prediction of the Earth system and its water cycle characteristics (e.g., mean state, variability, and extreme events) is to accurately simulate aerosol-cloud interactions (ACI). The physical, chemical, and dynamical processes affecting ACI are extremely complex and they range from nanoscale to planetary scale. In each model development cycle, scientists spend significant efforts investigating model deficiencies and uncertainties associated with aerosols (e.g., emissions, chemical processes, aerosol microphysics, and transport) and clouds (e.g., macrophysics, microphysics, turbulence, and large-scale circulation) in order to develop improved treatments. However, despite decades of active research, ACI is still a major source of uncertainty in climate projections, even though great progress has been made. Specific scientific challenges include: (i) Parameterizations are developed based on limited data; (ii) The complexity of a parameterization required for accurate predictions is not understood; (iii) Incomplete and unknown physics leads to errors in the fully coupled Earth system; and (iv) Complex physics is computationally too expensive to employ in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The good, the bad, and the ugly: Data-driven load profile discord identification in a large building portfolio

Reducing the overall energy consumption and associated greenhouse gas emissions in the building sector is essential for meeting our future sustainability goals. Recently, smart energy metering facilities have been deployed to enable monitoring of energy consumption data with hourly or subhourly temporal resolution. This unprecedented data collection has created various opportunities for advanced data analytics involving load profiles (e.g., building energy benchmarking programs, building-to-grid integration, and calibration of urban-scale energy models). These applications often need preprocessing steps to detect daily load profile discords, such as: 1) outliers due to system malfunctions (the bad) and 2) irregular energy consumption patterns, such as those resulting from holidays (the ugly) compared to normal consumption patterns (the good). However, current preprocessing methods predominantly focus on filtering using statistical threshold values, which fail to capture the contextual discords of daily profiles. In addition, discord detection algorithms in building research are often aimed at finding individual building-level discords, which are not suitable at a large scale. Thus, here, we develop a method for automated load profile discord identification (ALDI) in a large portfolio of buildings (more than 100 buildings). Specifically, ALDI 1) uses the matrix profile (MP) method to quantify the similarities of daily subsequences in time series meter data, 2) compares daily MP values with typical-day MP distributions using the Kolmogorov-Smirnov test, and 3) identifies daily load profile discords in a large building portfolio. We evaluate ALDI using the metering data of both an academic campus and a residential neighborhood. Our results demonstrate that ALDI efficiently discovers measurement errors by system malfunctions and low energy consumption days in the academic campus portfolio, and it detects unique load shape patterns likely driven by occupant behavior and extreme weather conditions in the residential neighborhood.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Big Data Analysis of Synchrophasor Data: Outcomes of Research Activities Supported by DOE FOA 1861

This report describes the key outcomes of research activities sponsored by the Department of Energy’s Funding Opportunity Announcement (FOA) number 1861 that was aimed at advancing the state-of-the-art in big data analytics applied to transmission-level synchrophasor measurements. The FOA resulted in eight research grants where the awardees developed machine learning and artificial intelligence tools and approaches. The commonalities in tools and approaches used by the awardees are explored, and insights gained from how the project outcomes might be operationalized are discussed. This report does not seek to comprehensively summarize all research supported by the FOA, rather it focuses on enabling the fast dissemination of major findings to the broader power systems community.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗