Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis, visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Computed Tomography Scanning and Petrophysical Measurements of the Lively Grove #1 Well Core

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core from the Lively Grove #1 Well (API 121892494700), drilled near Marissa, Washington County, Illinois. Core from the well was obtained as part of the Illinois Storage Corridor’s Carbon Storage Assurance Facility Enterprise (CarbonSAFE) project (DE FE0031892). The primary impetus of this work was to capture a detailed digital representation of the core from the Lively Grove #1 Well. The collaboration between the U.S. Department of Energy’s (DOE) NETL and the Illinois State Geological Survey (ISGS) enables other research entities to access information about this potential carbon storage location and Cambro-Ordovician Storage Complex formations of the Illinois Basin. The resultant datasets are presented in this report and can be accessed from NETL’s Energy Data eXchange (EDX) online system. All equipment and techniques used were non-destructive, enabling future examinations and analyses to be performed on these cores. Fractures, discontinuities, and millimeter-scale features were readily detectable with the medical CT scanner-acquired images. Imaging with the NETL medical CT scanner was performed on entire cores. Qualitative analysis of the medical CT images, coupled with X-ray fluorescence (XRF), gamma density, and magnetic susceptibility measurements from the MSCL were useful in identifying zones of interest for potential future analysis. Higher-resolution industrial and micro-CT images were acquired from selected zones along the depth of the core to visualize the structure in higher detail. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provides a multi-scale analysis of the core; with the resulting macro- and micro-descriptions relevant to many subsurface energy related examinations traditionally performed at NETL.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Lagrangian analysis of pockets of open cells over the southeastern Pacific

Abstract. Pockets of open cells (POCs) have been shown to develop within closed-cell stratocumulus (StCu), and a large body of evidence suggests that the development of POCs result from changes in small-scale processes internal to the boundary layer rather than large-scale forcings. Precipitation is widely viewed as a key process important to POC development and maintenance. In this study, GOES-16 satellite observations are used in conjunction with MERRA-2 winds to track and compare the microphysical and environmental evolution of two populations of closed-cell StCu selected by visual inspection over the southeastern Pacific Ocean: one group that transitions to POCs and another comparison group (CLOSED) that does not. The high spatiotemporal resolution of the new GOES-16 data allows for a detailed examination of the temporal evolution of POCs in this region. We find that POCs tend to develop near the coast, last tens of hours, are larger than 104 km2, and often (88 % of cases) do not re-close before they exit the StCu deck. Most POCs are observed to form at night and tend to exit the StCu during the day when the StCu is contracting in area. Relative to the CLOSED trajectories, POCs have systematically larger effective radii, lower cloud drop number concentrations, a comparable conditional in-cloud liquid water path, and a higher frequency of more intense precipitation. Meanwhile, no systematic environmental differences other than boundary layer height are observed between POC and CLOSED trajectories. Interestingly, there are no differences in reanalysis aerosol optical depth between both sets of trajectories, which may lead one to the interpretation that differences in aerosol concentrations are not influencing POC development or resulting in a large number that re-close. However, this largely depends on the reanalysis treatment of aerosol–cloud interactions, and the product used in this study has no explicit handling of these important processes. These results support the consensus view regarding the importance of precipitation on the formation and maintenance of POCs and demonstrate the utility of modern geostationary remote sensing data in evaluating the POC life cycle.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

AIMSim : An accessible cheminformatics platform for similarity operations on chemicals datasets

The recent advances in deep learning, generative modeling, and statistical learning have ushered in a renewed interest in traditional cheminformatics tools and methods. Quantifying molecular similarity is essential in molecular generative modeling, exploratory molecular synthesis campaigns, and drug-discovery applications to assess how new molecules differ from existing ones. Further, most tools target advanced users and lack general implementations accessible to the larger community. In this work, we introduce Artificial Intelligence Molecular Similarity (AIMSim), an accessible cheminformatics platform for performing similarity operations on collections of molecules called molecular datasets. AIMSim provides a unified platform to perform similarity-based tasks on molecular datasets, such as diversity quantification, outlier and novelty analysis, clustering, dimensionality reduction, and inter-molecular comparisons. AIMSim implements all major binary similarity metrics and molecular fingerprints and is provided as a Python package that includes support for command-line use as well as a Graphical User Interface for code-free utilization with fully interactive plots.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Limit Cycle Oscillating Detonation Wave Behavior Analysis Within a Rotating Detonation Engine

Limit cycle oscillation (LCO) detonation wave behaviors are presented and analyzed for test times exceeding 20 s in a water-cooled rotating detonation engine (RDE). LCO detonation waves exhibit cyclic acceleration and deceleration, resulting in oscillating wave spacing at unique process conditions. In previous RDE studies, similar behaviors have been studied as microsecond-scale instabilities leading to ascending or descending modal transitions. In the current work, however, LCO waves are considered a persistent wave mode, occupying unique portions of the operational envelope adjacent to those of their equally spaced counterparts. These occurrences of LCO waves are repeatable, enduring behaviors. A method to generate shifted contour surfaces specifically intended to extract and analyze wave spacing variation through time, termed limit cycle oscillation visualization (LCOV) surfaces, is presented. LCOV surfaces transform data into the reference frame of a primary traveling wave and are used to analyze quasi-steady, short-timescale, and transitional LCO modes. Results are leveraged to understand the relationship between fill height, wave strength, local wave acceleration, and subsequent LCO wave spacing for individual wave sets. In conclusion, quasi-steady LCO waves display wave spacing oscillations between equal spacing values associated with ±1 wave across runs exceeding 18 s.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Exploring MDSplus data-acquisition software and custom devices

MDSplus is a software tool designed for data acquisition, storage, and analysis of complex scientific experiments. Over the years, MDSplus has primarily been used for data management for fusion experiments. This paper demonstrates that MDSplus can be used for a much wider variety of systems and experiments. We present a step-by-step tutorial describing how to create a simple experiment, manage the data, and analyze it using MDSplus and Python. To this end, a custom example device was developed to be used as the data source. This device was built on an open-source electronic hardware platform, and it consists of a microcontroller and two sensors. Finally, we read data from these sensors, store it in MDSplus, and use JupyterLab to visualize and process it.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

National Cancer Institute Think-Tank Meeting Report on Proteomic Cartography and Biomarkers at the Single-Cell Level: Interrogation of Premalignant Lesions

A Think-Tank Meeting was convened by the National Cancer Institute (NCI) to solicit experts’ opinion on the development and application of multi-omic single-cell analyses, and especially single-cell proteomics, to improve the development of a new generation of biomarkers for cancer risk, early detection, diagnosis, prognosis as well as to discuss the discovery of new targets for prevention and therapy. It is anticipated that such markers and targets will be based on cellular, subcellular, molecular and functional aberrations within the lesion and within individual cells. Additionally, single-cell proteomic data will be essential for the establishment of new tools that with searchable and scalable features that include spatial and temporal cartographies of premalignant and malignant lesions. Challenges and potential solutions that were discussed included: • The best way/s to analyze single-cells from fresh and preserved tissue • Detection and analysis of secreted molecules and from single cells, especially from a tissue slice • Detection of new, previously undocumented cell type/s in the premalignant and early stage cancer tissue microenvironment • Multi-omic integration of data to support and inform proteomic measurements • Subcellular organelles – identifying abnormal structure, function, distribution and location within individual premalignant and malignant cells • How to improve the dynamic range of single-cell proteomic measurements for discovery of differentially expressed proteins and their post translational modifications (PTM) • The depth of coverage measured concurrently using single-cell techniques • Quantitation - absolute or semiquantitative? • Single methodology or multiplexed combinations? • Application of analytical methods for identification of biologically significant subsets • Data visualization of N-dimensional datasets • How to construct intercellular signaling networks in individual cells within premalignant tumor microenvironments (TME) • Associations between intrinsic cellular processes and extrinsic stimuli • How to predict cellular responses to stress inducing stimuli • Identification of new markers for prediction of progression from precursor, benign and localized lesions to invasive cancer, based on spatial and temporal changes within individual cells • Identification of new targets for immunoprevention or immunotherapy – identification of neoantigens and surfactome of individual cells within a lesion

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗
DOE OSTI2022

Hybrid Analysis of Fusion Data for Online Understanding of Complex Science on Extreme Scale Computers

The current practice for fusion scientists running first principle simulations on high performance computing plat-forms is to either run their simulations and output their data for post-hoc analysis, or to place in situ analytics into their code. In this paper we examine a complex workflow using XGC fusions simulation run on the Oak Ridge Leadership Computing Facility's supercomputer Summit, which also involve three anal-yses as part of the results necessary for scientific discovery. We discuss the challenges faced when implementing these algorithms and present an original hybrid staging technique to help enable the physicists to make discoveries during the execution of the simulation. By creating this infrastructure, we can examine complicated physics results, which may not have been possible without the infrastructure. For example, our work enables the online visualization of turbulent homoclinic tangle around the magnetic X-point, breaking the last confinement surface. This visualization could help fusion scientists to better understand and improve the turbulence spread of plasma exhaust heat, which is crucial toward realizing plasmas beyond the currently accessible physics regimes of present-day tokamak reactors. The physics of turbulent homoclinic tangle will be reported in a future physics publication, by utilizing the original online analysis/visualization framework presented in this paper.

Suchyta, Eric↗
DOE OSTI2022

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials and Components (Final Technical Report)

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study. In another approach, we investigate Thermal Tomography (TT), which is a computational method for reconstruction of depth profile of internal material defects from PIT nondestructive evaluation (NDE). TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of subsurface internals defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. Performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shape imported from scanning electron microscopy (SEM) images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on TT images of elliptical defects is capable of classifying shape and orientation of irregular defects. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN. We also investigate several approaches based on Gaussian Random Circle and Bezier Curves for constructing parametric models of irregular-shape defects.

36 MATERIALS SCIENCE↗
DOE OSTI2021

TEAL Output Visualization

Tool for Economic Analysis (TEAL) is an open-source economics calculation package written and maintained by Idaho National Laboratory (INL). As a plugin of the Risk Analysis Virtual ENvironment (RAVEN), TEAL provides economics analysis models to RAVEN workflow users. In addition, TEAL is used in other RAVEN plugins such as LOGOS and the Holistic Energy Resource Optimization Network (HERON) to complement other analyses with economic calculations. This report documents the efforts in developing the capability of TEAL output visualization for users to better understand and investigate TEAL simulation results. In the past, outputs (e.g., various cash flows) were generated and printed to screen. According to the need and purpose for visualization, users can select various bar charts and donut charts to visualize the cash flows including inflows, outflows, and net cash flows in each year or in a selected time range, in addition to observing data stored in comma-separated value files (CSVs). The visualization capability is flexible and user-friendly by introducing several user-defined parameters, for instance, the start and the end project year of interest and the type of colors to be assigned to the cash flows.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

VAIM-CFF: a variational autoencoder inverse mapper solution to Compton form factor extraction from deeply virtual exclusive reactions

We develop a new methodology for extracting Compton form factors (CFFs) from deeply virtual exclusive reactions such as the unpolarized DVCS cross section using a specialized inverse problem solver, a variational autoencoder inverse mapper (VAIM). The VAIM-CFF framework not only allows us access to a fitted solution set possibly containing multiple solutions in the extraction of all 8 CFFs from a single cross section measurement, but also accesses the lost information contained in the forward mapping from CFFs to cross section. We investigate various assumptions and their effects on the predicted CFFs such as cross section organization, number of extracted CFFs, use of uncertainty quantification technique, and inclusion of prior physics information. We then use dimensionality reduction techniques such as principal component analysis to visualize the missing physics information tracked in the latent space of the VAIM framework. Through re-framing the extraction of CFFs as an inverse problem, we gain access to fundamental properties of the problem not comprehensible in standard fitting methodologies: exploring the limits of the information encoded in deeply virtual exclusive experiments.

Accelerator Physics↗
DOE OSTI2022

Computational Tools and Workflows for Quantitative Risk Assessment and Decision Support for Geologic Carbon Storage Sites: Progress and Insights from the U.S. DOE’s National Risk Assessment Partnership

The 2005 Intergovernmental Panel on Climate Change (IPCC) Special Report on CCS raised the profile of CO2 capture and storage (CCS) as an important technology for reducing greenhouse gas (GHG) emissions. CCS is now recognized as a key component of most climate change mitigation scenarios. Since publication of that report the international research, development, and deployment (RD&D) community has advanced key technical aspects, clarified regulatory requirements, explored value chain and infrastructure solutions, and developed incentive paradigms to enable and promote large-scale deployment of CCS. These efforts have included research to better characterize geologic storage resources, to improve injection performance and storage efficiency, to assess and manage subsurface environmental risks, and to advance monitoring technologies to assure system conformance. These efforts have helped to build confidence in the viability of geologic carbon storage (GCS), but stakeholder concerns about long-term risks and liability associated with GCS remain a hurdle to broad acceptance and large-scale deployment of CCS. Since 2010, the U.S. DOE’s National Risk Assessment Partnership (NRAP) – a research collaboration between five contributing national laboratories – has worked to establish and demonstrate methods and tools to quantify and manage the subsurface environmental risks associated with GCS, amidst uncertainty. This work supports the Office of Fossil Energy and Carbon Management Carbon Transport and Storage Program’s goal of advancing safe and secure commercial-scale GCS deployment. To address the technical challenge of simulating the physical response of the GCS site to large-scale CO2 injection, NRAP has adopted an approach that relies on coupling computationally efficient reduced-order and/or data-driven proxy models of important system components (i.e., storage reservoir, sealing caprock, leakage pathways, intermediate formations, overlying groundwater aquifers, and the atmosphere) in integrated assessment framework. That integrated model of the physical system is complemented with fit-for purpose functionality to support site characterization and risk-related decisions. The recently released NRAP Phase II toolset includes the Open-Source Integrated Assessment Model (NRAP-Open-IAM) for evaluation of trends in leakage risk and potential impact, tools to support monitoring design optimization (Designs for Risk Evaluation and Management – DREAM v3.0 and Passive Seismic Monitoring Tool - PSMT), and tools for state of stress evaluation (State-of-Stress Analysis Tool - SOSAT) and forecasting induced seismicity risk. The NRAP team has also released a pair of reports describing conceptual workflows to incorporate physics-based, quantitative risk assessment into many of the design, planning, operation, and closure decisions for GCS projects. An online catalogue highlights published studies where these tools and methods are demonstrated. In this presentation, the utility of these products to assess risks and address key stakeholder questions will be highlighted through examples, and related insights about the safety and security of geologic carbon storage in qualified storage sites will be discussed. The prospect of rapid, large-scale deployment of GCS technology to aggressively reduce anthropogenic CO2 emissions requires careful consideration of interference between multiple commercial-scale storage projects within a basin. Going forward, NRAP is expanding and adapting site-scale risk quantification tools and methods to enable assessment of risks and inform management decisions for basin-scale deployment. Increasingly, this work will leverage next-generation approaches for surrogate modelling, fast prediction, and advanced visualization enabled by machine learning and artificial intelligence to promote virtual learning, scenario evaluation, and augment risk-based decision making.

quantitative risk assessment, geologic carbon stor↗
DOE OSTI2023

The inclusion of uncertainty in circularity transition modeling: A case study on wind turbine blade end-of-life management

The transition to a more circular economy (CE) is complex and hard to predict, including in sustainable energy technologies. Many sources of uncertainty make it challenging to model CE scenarios and their potential benefits. As an example, the high variability in costs and revenues of different recycling options makes future wind turbine blade recycling highly uncertain. To better understand this challenge, the circular economy, life cycle assessment and visualization (CELAVI) framework - a discrete event simulation and life cycle assessment framework - is modified to incorporate uncertainty analysis capabilities. Moreover, a 3-step procedure that covers different aspects of uncertainty in CE studies and includes a Monte-Carlo analysis is proposed. The procedure is tested in a case study on wind turbine blade recycling using CELAVI. Results highlight that grinding and landfilling costs are the most influential parameters for wind power circularity. The model's output coefficients of variation (when input parameter uncertainties are propagated) are between 92% and 384% depending on the indicator. The approach developed in this study may help researchers and decision-makers who study circularity prioritize their data collection effort. Finally, our method contributes to a mounting yet critical body of research: the measurement of uncertainty in circularity transitions.

17 WIND ENERGY↗
DOE OSTI2020

Macro-physical Properties of Shallow Cumulus from Integrated ARM Observations (Final Report)

Fair-weather shallow cumuli (ShCu) play an important role in many climate-related processes. Irregular geometry of ShCu and their strong temporal and spatial variability make it challenging to observe ShCu holistically and to represent them correctly in climate models. To improve ShCu parameterizations, information on both vertically and horizontally resolved cloud properties is required. Commonly, the vertically resolved cloud properties are provided by zenith pointing lidar-radar observations with a very narrow field of view (FOV). Thus, these “pencil-beam” properties may not be representative of a larger surrounding area. Limited number of areal-averaged cloud properties, such as fractional sky cover (FSC), are offered typically by wide-FOV observations. The main goal of our project was to integrate advantages of the narrow-FOV (vertical structure of clouds) and wide-FOV (spatial arrangement of clouds) observations for an improved characterization of single-layer ShCu observed at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site for an 18-yr period (2000-2017). There are four major accomplishments of our project, First, an updated operational cloud classification for days with ShCu has been suggested and evaluated through a detailed comparison with the manually curated records. Our classification extends successfully the latest ARM cloud type Value Added Product (VAP) based on the Active Remote Sensing of Clouds (ARSCL) cloud product by incorporating both cloud fraction (CF) provided by narrow-FOV ceilometer data and FSC from wide-FOV images offered by a Total Sky Imager (TSI). Moreover, our classification allows one to identify impact of instrumentation changes at the SGP site, namely the transition to KAZRARSCL with the updated cloud radar, on the identification of periods with single-layer ShCu. Second, a new approach that resolves cloud area distributions for a given region (up to 4x4 km 2 ) has been suggested and cloud equivalent diameters (CEDs) have been estimated for the first time. These estimations have been performed over a wide range of cloud sizes (about 0.01–3.5 km) with high temporal resolution (30s) using wide-FOV TSI images and cloud base height (CBH) provided by complementary narrow-FOV lidar measurements. Our simple and computationally inexpensive approach offers a previously unavailable dataset for process studies in the convective boundary layer and evaluation of ShCu parameterizations in cloud-resolving models. Third, a long-term integrated record of ShCu macrophysical properties has been developed. The developed record represents the longest available compilation of events with ShCu and includes (i) a novel visualization of the spatial variability in cloud cover both along- and across-wind directions, (ii) updated estimates of narrow-FOV CF and wide-FOV FSC, (iii) updated narrow-FOV CBH, and (iv) complementary data, such as wind speed and direction from the 915-MHz Radar Wind Profiler (RWP) data. The developed record has been used successfully to assess conventional observational estimates of cloud cover and their sensitivity to the following two factors: (i) instrument-dependent cloud detection and data merging criteria and (ii) FOV configuration. Fourth, co-variability of the ShCu macrophysical properties and environmental parameters has been analyzed for a 3-yr period (2016-2018). Our initial analysis includes diurnal changes of FSCs obtained for clouds with small, moderate and large CEDs and several environmental parameters, such as lifted condensation level (LCL) and mixed layer height (zi). Preliminary results of our analysis suggest that the horizontal extent of ShCu is controlled substantially by the sign and magnitude of difference between these two parameters (zi-LCL): the CED tends to grow with increase of this difference (zi exceeds LCL). We have initiated relationships between the ShCu and key atmospheric parameters that control both the development and evolution of ShCu using our new data product, which combines effectively the advantages of narrow-FOV data offered by zenith pointing cloud radars and lidars and wide-FOV TSI images. While the latest instrumentation at the ARM sites may address these challenging relationships in the future, we believe that the historical ARM data at the SGP site has not yet been fully utilized. Overall, our data product can be used by researchers working on a wide range of climate-related projects. These projects may include (i) a comprehensive evaluation of outputs from the Large-Eddy Simulation (LES) and single-column models for their future improvement, (ii) the representativeness of “short-period” results obtained from the previous model and observational studies and (iii) the planning of future field campaigns with focus on improved understanding of the diurnal cycle of cumulus convection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Securing Grid-interactive Efficient Buildings (GEB) through Cyber Defense and Resilient System (CYDRES)

The DOE CYDRES project is driven by the urgent need to address critical research gaps in the domain of cyber-physical security of smart buildings, including Grid-interactive Efficient Buildings (GEBs). CYDRES, a real-time advanced building resilient platform, aims to enhance the cyber-attack-immune capabilities of buildings through multi-layered prevention, detection, and adaptation mechanisms. CYDRES consists of five key modules: a multi-layer network analyzer, an Automatic Fault Detection, Diagnosis, and Prognosis (AFDDP) framework, an intelligent mode selector, a cyber-resilient control framework, and a situation awareness platform. The Network Analyzer employs a data-driven framework that includes a protocol state learning tool and a CRF (Conditional Random Field) command validator. In Hardware-In-the-Loop (HIL) testbeds, it achieved 100% detection accuracy with a false alarm rate of 3%, validating its efficacy in identifying selected cyber-attacks. The AFDDP framework leverages pattern matching, PCA (Principal Component Analysis)-based strategies, and a DBN (Dynamic Bayesian Network)-based fault diagnosis approach to pinpoint the causes of physical system abnormalities using Building Automation System (BAS) data. In HIL experiments, the AFDDP module attained a detection accuracy of over 95% with a false alarm rate below 7%. Additionally, the fault detector utilized machine learning (Random Forest) and deep learning (Multi-Layer Perceptron) methods with acoustic sensor data to achieve a 100% fault detection accuracy in Heating, Ventilation, and Air-Conditioning (HVAC) equipment. The Mode Selector offered real-time impact analysis, allowing immediate actions to protect BASs in the face of emerging threats. The cyber-resilient control framework included an adaptive Model Predictive Control (MPC) and a measurement compensator, reducing temperature violations by up to 94% and improving the total demand flexibility by up to 70% in HIL experiments. Such HIL experiments covered a cyber-attack case and a physical fault case, showcasing CYDRES’ efficiency in maintaining operational continuity during threats. The situation awareness platform in Grafana enhanced real-time threat detection and response visualization, augmenting the operational awareness for building operators. CYDRES demonstrated high technical effectiveness in various test scenarios, particularly in HIL environments. The project's phased development approach ensured efficient use of resources, highlighting its practical feasibility and readiness for commercialization. By enhancing the security and resilience of building operations, CYDRES represents a significant advance in mitigating risks associated with cyber-physical systems, thereby enhancing public confidence in the safety of modern building infrastructure. Future directions for the project include expanding testing protocols, refining AFDDP methodologies, exploring more comprehensive resilient control strategies, and testing in real commercial buildings.

42 ENGINEERING↗
DOE OSTI2022

DeepAdversaries: examining the robustness of deep learning models for galaxy morphology classification

With increased adoption of supervised deep learning methods for work with cosmological survey data, the assessment of data perturbation effects (that can naturally occur in the data processing and analysis pipelines) and the development of methods that increase model robustness are increasingly important. In the context of morphological classification of galaxies, we study the effects of perturbations in imaging data. In particular, we examine the consequences of using neural networks when training on baseline data and testing on perturbed data. We consider perturbations associated with two primary sources: (a) increased observational noise as represented by higher levels of Poisson noise and (b) data processing noise incurred by steps such as image compression or telescope errors as represented by one-pixel adversarial attacks. We also test the efficacy of domain adaptation techniques in mitigating the perturbation-driven errors. We use classification accuracy, latent space visualizations, and latent space distance to assess model robustness in the face of these perturbations. For deep learning models without domain adaptation, we find that processing pixel-level errors easily flip the classification into an incorrect class and that higher observational noise makes the model trained on low-noise data unable to classify galaxy morphologies. On the other hand, we show that training with domain adaptation improves model robustness and mitigates the effects of these perturbations, improving the classification accuracy up to 23% on data with higher observational noise. Domain adaptation also increases up to a factor of ${\approx}2.3$ the latent space distance between the baseline and the incorrectly classified one-pixel perturbed image, making the model more robust to inadvertent perturbations. Successful development and implementation of methods that increase model robustness in astronomical survey pipelines will help pave the way for many more uses of deep learning for astronomy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool

Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool's usefulness on Oak Ridge National Laboratory's Summit system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Genomes OnLine Database (GOLD) v.10: new features and updates

The Genomes OnLine Database (GOLD; https://gold.jgi.doe.gov/) at the Department of Energy Joint Genome Institute is a comprehensive online metadata repository designed to catalog and manage information related to (meta)genomic sequence projects. GOLD provides a centralized platform where researchers can access a wide array of metadata from its four organization levels namely Study, Organism/Biosample, Sequencing Project and Analysis Project. GOLD continues to serve as a valuable resource and has seen significant growth and expansion since its inception in 1997. With its expanded role as a collaborative platform, it not only actively imports data from other primary repositories like National Center for Biotechnology Information but also supports contributions from researchers worldwide. This collaborative approach has enriched the database with diverse datasets, creating a more integrated resource to enhance scientific insights. As genomic research becomes increasingly integral to various scientific disciplines, more researchers and institutions are turning to GOLD for their metadata needs. To meet this growing demand, GOLD has expanded by adding diverse metadata fields, intuitive features, advanced search capabilities and enhanced data visualization tools, making it easier for users to find and interpret relevant information. This manuscript provides an update and highlights the new features introduced over the last 2 years.

59 BASIC BIOLOGICAL SCIENCES↗