Virtual Infrastructure Twin for Computing-Instrument Ecosystems: Software and Measurements
Not Available
47 OTHER INSTRUMENTATION↗
SEARCH · Engineering Papers
Results for “ecosystem performance analytics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
CoSim: A Simulator for Co-Scheduling of Batch and On-Demand Jobs in HPC Datacenters
The increasing scale and complexity of scientific applications are rapidly transforming the ecosystem of tools, methods, and workflows adopted by the high-performance computing (HPC) community. Big data analytics and deep learning are gaining traction as essential components in this ecosystem in a variety of scenarios, such as, steering of experimental instruments , acceleration of high-fidelity simulations through surrogate computations, and guided ensemble searches. In this context, the batch job model traditionally adopted by the supercomputing in-frastructures needs to be complemented with support to schedule opportunistic on-demand analytics jobs, leading to the problem of efficient preemption of batch jobs with minimum loss of progress. In this paper, we design and implement a simulator, CoSim, that enables on-the-fly analysis of the trade-offs arising between delaying the start of opportunistic on-demand jobs, which leads to longer analytics latency, and loss of progress due to preemption of batch jobs, which is necessary to make room for on-demand jobs. To this end, we propose an algorithm based on dynamic programming with predictable performance and scalability that enables supercomputing infrastructure schedulers to analyze the aforementioned trade-off and take decisions in near real-time. Compared with other state-of-art approaches using traces of the Theta pre-Exascale machine, our approach is capable of finding the optimal solution, while achieving high performance and scalability.
batch job preemption↗
Comparing Model Representations of Physiological Limits on Transpiration at a Semi-arid Ponderosa Pine Site
Mechanistic representations of biogeochemical processes in ecosystem models are rapidly advancing, requiring advancements in model evaluation approaches. Here we quantify multiple aspects of model functional performance to evaluate improved process representations in ecosystem models. We compare semi-empirical stomatal models with hydraulic constraints against more mechanistic representations of stomatal and hydraulic functioning at a semi-arid pine site using a suite of metrics and analytical tools. We find that models generally perform similarly under unstressed conditions, but performance diverges under atmospheric and soil drought. The more empirical models better capture synergistic information flows between soil water potential and vapor pressure deficit to transpiration, while the more mechanistic models are overly deterministic. Although models can be parameterized to yield similar functional performance, alternate parameterizations could not overcome structural model constraints that underestimate the unique information contained in soil water potential about transpiration. Additionally, both multilayer canopy and big-leaf models were unable to capture the magnitude of canopy temperature divergence from air temperature, and we demonstrate that errors in leaf temperature can propagate to considerable error in simulated transpiration. This study demonstrates the value of merging underutilized observational data streams with emerging analytical tools to characterize ecosystem function and discriminate among model process representations.
54 ENVIRONMENTAL SCIENCES↗
PV Operations Software Transparency: A PVMAC Industry Snapshot
The rapid growth of photovoltaic (PV) deployment has increased reliance on software platforms for monitoring, workflow automation, diagnostics, and performance analytics. As these tools play a central role in asset management and operations and maintenance (O&M), greater transparency in methodologies, data handling, and validation practices benefits the broader PV ecosystem. To better understand current practices and identify opportunities for improved clarity and interoperability, 24 software providers contributed detailed responses through the PV O&M Analytics Collaborative (PVMAC) initiative, the first structured questionnaire of its kind in the industry, covering onboarding, interoperability, data quality, diagnostics, AI/ML, and other operational categories. These providers represent over 1.1 TW of solar assets under management. The analysis shows broad adoption of digital twins, AI/ML, and API integrations, but also highlights challenges in onboarding processes, inconsistent definitions and methodologies, variability in key performance indicator (KPI) calculations, and limited independent validation. Greater standardization, clearer documentation, and stronger validation frameworks could improve transparency, comparability, and trust across PV operations software platforms.
14 SOLAR ENERGY↗
Revisiting “Additional Carbon”: Tracking Atmosphere–Ecosystem Carbon Exchange to Establish Mitigation and Negative Emissions From Bio-Based Systems
Climate stabilization plans rely heavily on advanced bioenergy and bioproducts for substitution of fossil-based energy sources and materials, and increasingly, for negative emissions via the direct sequestration of biogenic carbon. Yet, there remain persistent, largely unresolved critiques of bioenergy assessment methodology, particularly in the areas of land use and biogenic carbon accounting. The concept of “additional carbon” calls for evaluating the climate performance of bio-based systems by whether feedstock production creates measurable new local agro-ecosystem uptake of carbon from the atmosphere. This concept is challenging to operationalize for first-generation biofuels, and has largely been advanced as a negative critique. However, carbon additionality is more straightforward to establish—and less critical to overall system mitigation performance—in advanced bioenergy systems. In this Perspective, I review the additional carbon critique, and why it is analytically challenging to address in first-generation biofuel systems based on conventional food crops with large existing markets. Next, I make a case that carbon additionality (1) is more readily achievable with cellulosic feedstocks, (2) is more directly observable for dedicated biomass crops, and (3) is not a strict requirement for achieving net mitigation in carbon-negative bio-based systems. I end by discussing how centering atmosphere–ecosystem carbon exchanges in bio-based system assessment could create new opportunities for enterprise-scale performance monitoring and verification, augmenting and diversifying the current reliance on model-based life-cycle assessment approaches.
54 ENVIRONMENTAL SCIENCES↗
CyclusJS: A Distributed Web-based Fuel Cycle Visual Analytics. Research Performance (Final Report)
The overall aim of the CyclusJS project has been to design novel approaches that support fuel cycle simulations and empower decision-makers and researchers with better tools to compare and contrast results from multiple simulations to understand the landscape of potential outcomes better. In particular, nuclear fuel cycle simulations focus on modeling the nuclear industry and ecosystem at a macroscopic level, and the analysis tools connect such simulations with decision support systems. As a demonstration of the novelty and effectiveness of the proposed approach, we study scenarios for transitioning from one technology, Light Water Reactors (LWR), to a newer Sodium-cooled Fast breeder Reactor (SFR) technology.
60 APPLIED LIFE SCIENCES↗
xSDK: Building an ecosystem of highly efficient math libraries for exascale
Current efforts to build increasingly powerful computer architectures are opening up new avenues for more complex and higher fidelity simulations coupled with data analytics and learning, leading to new scientific insights and deeper understanding. At one extreme, exascale computers will be much faster than previous computer generations (performing 10 18 operations per second—that is, 1,000 times faster than petascale). To achieve these performance improvements, computer architectures are becoming increasingly complex, with deep memory hierarchies, very high node and core counts, and heterogeneous features such as graphics processing units (GPUs). Such architectural changes impact the full breadth of computing scales, as heterogeneity pervades even current-generation laptops, workstations, and moderate-sized clusters. While emerging advanced architectures provide unprecedented opportunities, they also present significant challenges for developers of scientific applications, such as multiphysics and multiscale codes, who must adapt their software to handle disruptive changes in architectures and new programming models that have not yet stabilized. Developers must consider increasing concurrency while reducing communication and synchronization, and other complexities such as the potential for using mixed precision to leverage the compute power available in low-precision tensor cores. On one hand, developers must implement new scientific capabilities, which in turn increase code complexity. On the other hand, the codes must be ported to new architectures, requiring the inclusion of new programming models and the restructuring of code to achieve good performance. Addressing these issues is beyond the capability of any single person or team—leading to the need for collaboration among many teams, who encapsulate their expertise in reusable software and work together to create sustainable software ecosystems.
97 MATHEMATICS AND COMPUTING↗
Assessing CLUBB PDF Closure Assumptions for a Continental Shallow-to-Deep Convective Transition Case Over Multiple Spatial Scales
Assumed-PDF (probability density function) higher-order turbulence closures (APHOCs) are now widely used for parameterizing boundary layer turbulence and shallow convection in Earth system models (ESMs). A better understanding of the resolution-dependent behavior of APHOCs is essential for improving the performance of next-generation ESMs with intended horizontal resolutions finer than 10 km. In this study, we evaluate the PDF family of Analytic double-Gaussian 1 implemented in Cloud Layers Unified By Binormals (CLUBB) over a range of spatial scales (Dx) from 2 to 100 km. A 120-km-wide large eddy simulation (LES) for a continental convection case during 2016 Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign serves as benchmark to evaluate the PDF closure using an off-line approach. We find during the shallow convection period, the CLUBB PDF closure tends to produce positive biases of cloud properties and liquid water flux near cloud base for all scales of analysis. It produces negative biases for these variables near cloud top that are more severe for Dx larger than 25 km. Results show that replacing the CLUBB-parameterized moisture and temperature skewnesses with LES-derived ones can fix most of the biases if clipping of input moments is allowed to prevent the occurrence of unrealizable solutions. Overall, the performance of the PDF closure is better for smaller Dx = 2–5 km than for larger Dx = 50–100 km; for a given grid spacing, it is better when the convective clouds become deeper in the late afternoon. Likely causes for the resolution dependence and implications for improving the PDF closure are discussed.
54 ENVIRONMENTAL SCIENCES↗
Improving Additive Manufactured Component Performance through Multi-Scale Microstructure Simulation and Process Optimization
The purpose of this project was to utilize computational tools to understand the relationships between processing, microstructure, and properties for additively manufactured (AM) aluminum alloys for automotive applications, and to provide an engineering solution for helping to optimize process conditions. The project leverages ORNL developments in computational modeling, including AM process modeling, phase-field based microstructure evolution predictions, and data analytics techniques for mapping process conditions to material outcomes. The project utilized an Al-Cu-Mn-Zr alloy as a model material for studying formation of defects and microstructural features in response to variations in process conditions. Based on both pre-existing experimental data and simulation results, statistical process maps were constructed to identify regions of process space with minimal defect formation and advantageous microstructures and properties. The software tools used for this purpose were successful disseminated to GM, who were able to successful compile the relevant HPC codes within their own computing ecosystem and perform initial calculations to reproduce ORNL results.
36 MATERIALS SCIENCE↗
Hazard Detection Detector Cards
This report presents a comprehensive summary of five advanced anomaly detection tools developed and deployed by Oak Ridge National Laboratory in support of the VA’s Health Information Technology modernization. These detectors—Order Path Tracker, Trend Watcher, Pain Pointer, Performance Monitor, and Patient Record Flag Detector—leverage statistical and machine learning methods to monitor workflow disruptions, detect anomalies in care sequences and volumes, identify bottlenecks, and track system-level performance metrics across VistA and Millennium systems. All detectors have been integrated into the Health Data Analytics Platform (HDAP), with most having completed deployment and testing using live data from targeted stations in cardiology and oncology domains. This work enhances VA’s capacity for proactive system surveillance, promotes patient safety, and informs data-driven operational improvements across the EHR ecosystem.
97 MATHEMATICS AND COMPUTING↗
PowerAnalytics.jl: User-Centric Power Systems Analysis in Julia
The National Laboratory of the Rockies recently released version 1 of PowerAnalytics.jl, an analysis module for the outputs of its popular open-source electrical power systems modeling platform Sienna. It features an extensible framework - based on the flexible selecting of components, the execution of arbitrary metrics on them, and a familiar DataFrames-based output interface with embedded metadata - to process results in the Sienna style while keeping the interface as simple as possible for non-Julia experts. Here, I describe the package and where it fits into the Sienna ecosystem, how I harnessed user-centered design and Julia features to achieve beginner friendliness without sacrificing performance and expressibility, and what lessons might be drawn from the package's design and implementation.
97 MATHEMATICS AND COMPUTING↗
Importance of suberin biopolymer in plant function, contributions to soil organic carbon and in the production of bio-derived energy and materials
Abstract Suberin is a hydrophobic biopolymer of significance in the production of biomass-derived materials and in biogeochemical cycling in terrestrial ecosystems. Here, we describe suberin structure and biosynthesis, and its importance in biological (i.e., plant bark and roots), ecological (soil organic carbon) and economic (biomass conversion to bioproducts) contexts. Furthermore, we highlight the genomics and analytical approaches currently available and explore opportunities for future technologies to study suberin in quantitative and/or high-throughput platforms in bioenergy crops. A greater understanding of suberin structure and production in lignocellulosic biomass can be leveraged to improve representation in life cycle analysis and techno-economic analysis models and enable performance improvements in plant biosystems as well as informed crop system management to achieve economic and environmental co-benefits.
09 BIOMASS FUELS↗
ASER Annual Site Environmental Report 2020
Los Alamos National Laboratory’s (the Laboratory’s) annual site environmental reports are prepared each year by the Laboratory’s environmental organizations, as required by U.S. Department of Energy Order 231.1B, Administrative Change 1, Environment, Safety, and Health Reporting, and Order 458.1, Administrative Change 4, Radiation Protection of the Public and the Environment. The following chapters in this report discuss our success in complying with environmental laws, regulations, and orders (Chapter 2, Compliance Summary); how we manage the Laboratory’s environmental performance (Chapter 3, Environmental Programs and Analytical Data Quality); how we monitor for air emissions of radioactive materials and climate conditions (Chapter 4, Air Quality); how we monitor for effects of Laboratory operations on groundwater quality (Chapter 5, Groundwater Protection); how we monitor the movement of chemicals and radionuclides by storm water runoff and the levels of chemicals and radionuclides in deposited sediment (Chapter 6, Watershed Quality); how we monitor for the presence, levels, and effects of chemicals and radionuclides in plants, animals, soil, and vegetation (Chapter 7, Ecosystem Health); and finally, what radionuclide dose or risk from chemical exposure members of the public may experience as a result of Laboratory operations (Chapter 8, Public Dose and Risk Assessment).
54 ENVIRONMENTAL SCIENCES↗
A standardized quantitative analysis strategy for stable isotope probing metagenomics
ABSTRACT Stable isotope probing (SIP) facilitates culture-independent identification of active microbial populations within complex ecosystems through isotopic enrichment of nucleic acids. Many DNA-SIP studies rely on 16S rRNA gene sequences to identify active taxa, but connecting these sequences to specific bacterial genomes is often challenging. Here, we describe a standardized laboratory and analysis framework to quantify isotopic enrichment on a per-genome basis using shotgun metagenomics instead of 16S rRNA gene sequencing. To develop this framework, we explored various sample processing and analysis approaches using a designed microbiome where the identity of labeled genomes and their level of isotopic enrichment were experimentally controlled. With this ground truth dataset, we empirically assessed the accuracy of different analytical models for identifying active taxa and examined how sequencing depth impacts the detection of isotopically labeled genomes. We also demonstrate that using synthetic DNA internal standards to measure absolute genome abundances in SIP density fractions improves estimates of isotopic enrichment. In addition, our study illustrates the utility of internal standards to reveal anomalies in sample handling that could negatively impact SIP metagenomic analyses if left undetected. Finally, we present SIPmg , an R package to facilitate the estimation of absolute abundances and perform statistical analyses for identifying labeled genomes within SIP metagenomic data. This experimentally validated analysis framework strengthens the foundation of DNA-SIP metagenomics as a tool for accurately measuring the in situ activity of environmental microbial populations and assessing their genomic potential. IMPORTANCE Answering the questions, “who is eating what?” and “who is active?” within complex microbial communities is paramount for our ability to model, predict, and modulate microbiomes for improved human and planetary health. These questions can be pursued using stable isotope probing to track the incorporation of labeled compounds into cellular DNA during microbial growth. However, with traditional stable isotope methods, it is challenging to establish links between an active microorganism’s taxonomic identity and genome composition while providing quantitative estimates of the microorganism’s isotope incorporation rate. Here, we report an experimental and analytical workflow that lays the foundation for improved detection of metabolically active microorganisms and better quantitative estimates of genome-resolved isotope incorporation, which can be used to further refine ecosystem-scale models for carbon and nutrient fluxes within microbiomes.
54 ENVIRONMENTAL SCIENCES↗
Los Alamos National Laboratory 2022 Annual Site Environmental Report (Rev. 2)
Los Alamos National Laboratory (Laboratory) annual site environmental reports are prepared each year by the Laboratory’s environmental organizations as required by U.S. Department of Energy Order 231.1B, Administrative Change 1, Environment, Safety, and Health Reporting, and Order 458.1, Administrative Change 4, Radiation Protection of the Public and the Environment. The chapters in this report discuss our compliance with environmental laws, regulations, and orders (Chapter 2, Compliance Summary); how we manage the Laboratory’s environmental performance and assure the quality of data from analysis of environmental samples (Chapter 3, Environmental Programs and Analytical Data Quality); how we monitor for air emissions of radioactive materials and for weather conditions (Chapter 4, Air Quality); how we monitor for effects of Laboratory operations on groundwater quality (Chapter 5, Groundwater Protection); how we monitor the levels of chemicals and radionuclides in storm water runoff and sediment (Chapter 6, Watershed Quality); how we monitor for the levels and effects of chemicals and radionuclides in plants, animals, soil, and vegetation (Chapter 7, Ecosystem Health); and finally, what radioactive dose or risk from chemical exposure that members of the public could experience as a result of Laboratory operations (Chapter 8, Public Dose and Risk Assessment).
54 ENVIRONMENTAL SCIENCES↗
Machine learning models inaccurately predict current and future high-latitude C balances
The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.
54 ENVIRONMENTAL SCIENCES↗
Scalable Data-Intensive Geocomputation: A Design for Real-Time Continental Flood Inundation Mapping
The convergence of data-intensive and extreme-scale computing enables an integrated software and data ecosystem for scientific discovery. Developments in this realm will fuel transformative research in data-driven interdisciplinary domains. Geocomputation provides computing paradigms in Geographic Information Systems (GIS) for interactive computing of geographic data, processes, models, and maps. Because GIS is data-driven, the computational scalability of a geocomputation workflow is directly related to the scale of the GIS data layers, their resolution and extent, as well as the velocity of the geo-located data streams to be processed. Unique in high user interactivity and low end-to-end latency requirements, geocomputation applications will dramatically benefit from the convergence of high-end data analytics (HDA) and high-performance computing (HPC). The application level challenge, however, is to identify and eliminate computational bottlenecks that arise along a geocomputation workflow. Indeed, poor scalability at any of the workflow components is detrimental to the entire end-to-end pipeline. Here, we study a large geocomputation use case in flood inundation mapping that handles multiple national-scale geospatial datasets and targets low end-to-end latency. We discuss benefits and challenges for harnessing both HDA and HPC for data-intensive geospatial data processing and intensive numerical modeling of geographic processes. We propose an HDA+HPC geocomputation architecture design that couples HDA (e.g., Spark)-based spatial data handling and HPC-based parallel data modeling. Key techniques for coupling HDA and HPC to bridge the two different software stacks are reviewed and discussed.
Liu, Yan↗
Transfer learning for smart buildings: A critical review of algorithms, applications, and future perspectives
Smart buildings play a crucial role toward decarbonizing society, as globally buildings emit about one-third of greenhouse gases. In the last few years, machine learning has achieved a notable momentum that, if properly harnessed, may unleash its potential for advanced analytics and control of smart buildings, enabling the technique to scale up for supporting the decarbonization of the building sector. In this perspective, transfer learning aims to improve the performance of a target learner exploiting knowledge in related environments. The present work provides a comprehensive overview of transfer learning applications in smart buildings, classifying and analyzing 77 papers according to their applications, algorithms, and adopted metrics. The study identified four main application areas of transfer learning: (1) building load prediction, (2) occupancy detection and activity recognition, (3) building dynamics modeling, and (4) energy systems control. Furthermore, the review highlighted the role of deep learning in transfer learning applications that has been used in more than half of the analyzed studies. The paper also discusses how to integrate transfer learning in a smart building's ecosystem, identifying, for each application area, the research gaps and guidelines for future research directions.
Pinto, G↗