SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

All sources NASA NTRS DOE OSTI

DOE OSTI2021

A synthetic building operation dataset

Abstract This paper presents a synthetic building operation dataset which includes HVAC, lighting, miscellaneous electric loads (MELs) system operating conditions, occupant counts, environmental parameters, end-use and whole-building energy consumptions at 10-minute intervals. The data is created with 1395 annual simulations using the U.S. DOE detailed medium-sized reference office building, and 30 years’ historical weather data in three typical climates including Miami, San Francisco, and Chicago. Three energy efficiency levels of the building and systems are considered. Assumptions regarding occupant movements, occupants’ diverse temperature preferences, lighting, and MELs are adopted to reflect realistic building operations. A semantic building metadata schema - BRICK, is used to store the building metadata. The dataset is saved in a 1.2 TB of compressed HDF5 file. This dataset can be used in various applications, including building energy and load shape benchmarking, energy model calibration, evaluation of occupant and weather variability and their influences on building performance, algorithm development and testing for thermal and energy load prediction, model predictive control, policy development for reinforcement learning based building controls.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Leaky ribosomal scanning enables tunable translation of bicistronic ORFs in green algae

Advances in sequencing technology have unveiled examples of nucleus-encoded polycistrons, once considered rare. Exclusively polycistronic transcripts are prevalent in green algae, although the mechanism by which multiple polypeptides are translated from a single transcript is unknown. Here, we used bioinformatic and in vivo mutational analyses to evaluate competing mechanistic models for translation of bicistronic mRNAs in green algae. High-confidence manually curated datasets of bicistronic loci from two divergent green algae, Chlamydomonas reinhardtii and Auxenochlorella protothecoides, revealed a preference for weak Kozak-like sequences for ORF 1 and an underrepresentation of potential initiation codons before the ORF 2 start codon, which are suitable conditions for leaky ribosome scanning to allow ORF 2 translation. We used mutational analysis in A. protothecoides to test the mechanism. In vivo manipulation of the ORF 1 Kozak-like sequence and start codon altered reporter expression at ORF 2, with a weaker Kozak-like sequence enhancing expression and a stronger one diminishing it. A synthetic bicistronic dual reporter demonstrated inversely adjustable activity of green fluorescent protein expressed from ORF 1 and luciferase from ORF 2, depending on the strength of the ORF 1 Kozak-like sequence. Our findings demonstrate that translation of multiple ORFs in green algal bicistronic transcripts is consistent with episodic leaky scanning of ORF 1 to allow translation at ORF 2. This work has implications for the potential functionality of upstream open reading frames (uORFs) found across eukaryotic genomes and for transgene expression in synthetic biology applications.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Adaptive Client Selection in Federated Learning: A Network Anomaly Detection Use Case

Federated Learning (FL) has become a ubiquitous approach for training machine learning models on decentralized data, addressing the myriad privacy concerns inherent in traditional centralized methods. However, the efficiency of FL depends on effective client selection and robust privacy preservation mechanisms. Inadequate client selection may lead to suboptimal model performance, while insufficient privacy measures risk exposing sensitive data. This paper proposes a client selection framework for FL that integrates differential privacy and fault tolerance. Our adaptive approach dynamically adjusts the number of selected clients based on model performance and system constraints, ensuring privacy through calibrated noise addition. We evaluate our method on a network anomaly detection use case using the UNSW-NB15 and ROAD datasets. Results show up to a 7% increase in accuracy and a 25% reduction in training time compared to FedL2P. Moreover, we highlight the trade-offs between privacy budgets and model performance, with higher privacy budgets reducing noise and improving accuracy. Our fault tolerance mechanism, while causing a slight performance drop, enhances robustness to client failures. Statistical validation using Mann-Whitney U tests confirms the significance of these improvements (p < 0.05).

Marfo, William [University of Texas at El Paso,Dep↗

DOE OSTI2022

MICCO: An Enhanced Multi-GPU Scheduling Framework for Many-Body Correlation Functions

Calculation of many-body correlation functions is one of the critical kernels utilized in many scientific computing areas, especially in Lattice Quantum Chromodynamics (Lattice QCD). It is formalized as a sum of a large number of contraction terms each of which can be represented by a graph consisting of vertices describing quarks inside a hadron node and edges designating quark propagations at specific time intervals. Due to its computation- and memory-intensive nature, real-world physics systems (e.g., multi-meson or multi-baryon systems) explored by Lattice QCD prefer to leverage multi-GPUs. Different from general graph processing, many-body correlation function calculations show two specific features: a large number of computation-/data-intensive kernels and frequently repeated appearances of original and intermediate data. The former results in expensive memory operations such as tensor movements and evictions. The latter offers data reuse opportunities to mitigate the data-intensive nature of many-body correlation function calculations. However, existing graph-based multi-GPU schedulers cannot capture these data-centric features, thus resulting in a sub-optimal performance for many-body correlation function calculations. To address this issue, this paper presents a multi-GPU scheduling framework, MICCO, to accelerate contractions for correlation functions particularly by taking the data dimension (e.g., data reuse and data eviction) into account. This work first performs a comprehensive study on the interplay of data reuse and load balance, and designs two new concepts: local reuse pattern and reuse bound to study the opportunity of achieving the optimal trade-off between them. Based on this study, MICCO proposes a heuristic scheduling algorithm and a machine-learning-based regression model to generate the optimal setting of reuse bounds. Specifically, MICCO is integrated into a real-world Lattice QCD system, Redstar, for the first time running on multiple GPUs. The evaluation demonstrates MICCO outperforms other state-of-art works, achieving up to 2.25× speedup in synthesized datasets, and 1.49× speedup in real-world correlation functions.

Wang, Qihan↗

DOE OSTI2023

Leveraging High-Fidelity Datasets for Machine Learning-based Anomaly Detection in Smart Grids

Data-driven intrusion detection systems are increasingly becoming essential for protecting critical cyber-physical infrastructure, such as the power grid, against the growing number of sophisticated cyber-attacks. The development of such tools is reliant on the availability of high-fidelity cyber-physical datasets that cover a diverse variety of potential cyber events. In this work, a high-fidelity smart grid platform is utilized to develop an extensive dataset, which is used to train and test a machine learning-based intrusion detection system. The evaluation of the developed IDS shows robust performance even when tested with statistically diverse test data not used in training.

Hyder, Burhan↗

DOE OSTI2025

HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data retrieval with significantly reduced data movement cost. However, most existing progressive methods are designed for CPUs, leaving a gap for them to unleash the power of today’s heterogeneous computing systems with GPUs.In this work, we propose HP-MDR, a high-performance and portable data refactoring and progressive retrieval framework for GPUs. Our contributions are four-fold: (1) We carefully optimize the bitplane encoding and lossless encoding, two key stages in progressive methods, to achieve high performance on GPUs; (2) We propose pipeline optimization and incorporate it with data refactoring and progressive retrieval workflows to further enhance the performance for large data process; (3) We leverage our framework to enable high-performance data retrieval with guaranteed error control for common Quantities of Interest; (4) We evaluate HP-MDR and compare it with state of the arts using five real-world datasets. Experimental results demonstrate that HP-MDR delivers an average 13.68 × and 6.31 × throughput in data refactoring and progressive retrieval tasks, respectively. It also leads to 11.22 × throughput for recomposing required data representations under Quantity-of-Interest error control and 6.04 × performance for the corresponding end-to-end data retrieval, when compared with state-of-the-art solutions.

Li, Yanliang [University of Oregon]↗

DOE OSTI2022

Persistent memory as an effective alternative to random access memory in metagenome assembly

Abstract Background The assembly of metagenomes decomposes members of complex microbe communities and allows the characterization of these genomes without laborious cultivation or single-cell metagenomics. Metagenome assembly is a process that is memory intensive and time consuming. Multi-terabyte sequences can become too large to be assembled on a single computer node, and there is no reliable method to predict the memory requirement due to data-specific memory consumption pattern. Currently, out-of-memory (OOM) is one of the most prevalent factors that causes metagenome assembly failures. Results In this study, we explored the possibility of using Persistent Memory (PMem) as a less expensive substitute for dynamic random access memory (DRAM) to reduce OOM and increase the scalability of metagenome assemblers. We evaluated the execution time and memory usage of three popular metagenome assemblers (MetaSPAdes, MEGAHIT, and MetaHipMer2) in datasets up to one terabase. We found that PMem can enable metagenome assemblers on terabyte-sized datasets by partially or fully substituting DRAM. Depending on the configured DRAM/PMEM ratio, running metagenome assemblies with PMem can achieve a similar speed as DRAM, while in the worst case it showed a roughly two-fold slowdown. In addition, different assemblers displayed distinct memory/speed trade-offs in the same hardware/software environment. Conclusions We demonstrated that PMem is capable of expanding the capacity of DRAM to allow larger metagenome assembly with a potential tradeoff in speed. Because PMem can be used directly without any application-specific code modification, these findings are likely to be generalized to other memory-intensive bioinformatics applications.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Fluorine Limits and Impacts in High-Level Waste Glass Compositions

The impact of elevated fluorine (F) content on Hanford high-level waste (HLW) glasses has not previously been studied in detail. This effort represents the first systematic study to determine what F concentration limits should be used for the design of alkali-borosilicate-based Hanford Waste Treatment and Immobilization Plant (WTP) HLW glasses, and to document the technical basis for that limit. If alkali borosilicate glass made from Hanford HLW can accommodate a large amount of F, the large capital costs for complex sludge washing facilities may be avoided, as would much of the operational costs and negative schedule impacts associated with handling the large volumes of water required to dissolve these salts. In order to determine a limit for F in likely HLW glass compositions, an evaluation was conducted on glasses with F ≤ 0.90 mass% from previous nuclear waste glass studies. The collected dataset contains 239 glasses (232 HLW glasses and 7 LAW glasses) including 109 glasses with 0.9 ≤ F mass% ≤ 2.5, 116 with 2.5 < F mass% ≤ 8.0, and 14 with F mass% ≥ 8 (max. F mass% = 17.42). The collected composition and property data were analyzed to determine the basis for the F tolerance, i.e. the maximum F concentration that can be processed without potential issues. Fluorine volatility, product consistency test (PCT) response, liquidus temperature (T L ), glass melt viscosity, and crystallinity have been investigated. No limits for F concentration can be made based on F volatility, T L , or glass melt viscosity, because the data show that high F in glasses do not indicate, with high probability, being restricted by those property constrains. However, crystallinity and PCT response were used to estimate the F tolerance. The results show that glasses with high F (≥ 0.90 mass%) are more likely to form large fractions of F-containing crystal phases which may increase PCT responses, i.e. decrease the glass durability. Based on the results of crystallinity and PCT data, the F tolerance of 4.5 mass% is estimated. There is no evidence of other glass components, such as calcium oxides and alkali metal oxides have combined impacts with F on the glass properties. Overall, the available high-F glass data is limited, especially in the designed HLW glass composition regions. Future work on formulation and testing of HLW glasses with F ≥ 0.9 mass% will close the data gaps and expand operational flexibility with respect to the fluoride tolerances. Volatility of F from melters and corrosion of materials in contact with glass melts are important for processing of high-F wastes; yet no test data are currently available. It is recommended tests be conducted to address these two potential issues.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

AlphaBuilding - Synthetic Buildings Operation Dataset

This is a synthetic building operation dataset which includes HVAC, lighting, miscellaneous electric loads (MELs) system operating conditions, occupant counts, environmental parameters, end-use and whole-building energy consumptions at 10-minute intervals. The data is created with 1395 annual simulations using the U.S. DOE detailed medium-sized reference office building, and 30 years' historical weather data in three typical climates including Miami, San Francisco, and Chicago. Three energy efficiency levels of the building and systems are considered. Assumptions regarding occupant movements, occupants' diverse temperature preferences, lighting, and MELs are adopted to reflect realistic building operations. A semantic building metadata schema - BRICK, is used to store the building metadata. The dataset is saved in a 1.2 TB of compressed HDF5 file. This dataset can be used in various applications, including building energy and load shape benchmarking, energy model calibration, evaluation of occupant and weather variability and their influences on building performance, algorithm development and testing for thermal and energy load prediction, model predictive control, policy development for reinforcement learning based building controls.

AlphaBuilding↗

DOE OSTI2025

Discrete global grid system-based flow routing datasets in the Amazon and Yukon basins

Abstract. Discrete global grid systems (DGGS) are emerging spatial data structures widely used to organize geospatial datasets across scales. While DGGS have found applications in various scientific disciplines, including atmospheric science and ecology, their integration into physically based hydrological models and Earth system models (ESMs) has been hindered by the lack of flow routing datasets based on DGGS. In response to this gap, this study pioneers the development of new flow routing datasets using icosahedral Snyder equal-area (ISEA) DGGS and a novel mesh-independent flow direction model. We present flow routing datasets for two large basins, the tropical Amazon River basin and the Arctic Yukon River basin. These datasets (1) facilitate the adoption of DGGS for hydrological models and (2) provide flow routing inputs for evaluation of DGGS-based flow routing in the Amazon and Yukon river basins. The data are available at https://doi.org/10.5281/zenodo.8377765 (Liao, 2023).

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

The Southern Hemisphere Additional Ozonesondes (SHADOZ) 1998-2002 Tropical Ozone Climatology: Instrumentation and Station-to-Station Variability - 3

Abstract: Since 1998 the Southern Hemisphere ADditional OZonesondes (SHADOZ) project has collected more than 2000 ozone profiles from a dozen tropical and subtropical sites using balloon-borne electrochemical concentration cell (ECC) ozonesondes. The data (with accompanying pressure-temperature-humidity soundings) are archived. Analysis of ozonesonde imprecision within the SHADOZ dataset revealed that variations in ozonesonde technique could lead to station-to-station biases in the measurements. In this paper imprecisions and accuracy in the SHADOZ dataset are examined in light of new data. When SHADOZ total ozone column amounts are compared to version 8 TOMS (2004 release), discrepancies between sonde and satellite datasets decline 1-2 percentage points on average, compared to version 7 TOMS. Variability among stations is evaluated using total ozone normalized to TOMS and results of laboratory tests on ozonesondes (JOSE-2O00, Julich Ozonesonde Intercomparison Experiment). Ozone deviations from a standard instrument in the JOSE flight simulation chamber resemble those of SHADOZ station data relative to a SHADOZ-defined climatological reference. Certain systematic variations in SHADOZ ozone profiles are accounted for by differences in solution composition, data processing and instrument (manufacturer). Instrument bias leads to a greater ozone measurement above 25 km over Nairobi and to lower total column ozone at three Pacific sites compared to other SHADOZ stations at 0-20 deg.S.

Thompson, Anne M.↗

NASA NTRS2011

Incorporating Ameriflux Data into LVT

This paper describes a new generic data reader that was developed in Fortran to handle the Ameriflux data for the LIS Verification Toolkit (LVT). Researchers at the Hydrological Sciences Branch of NASA Goddard Space Flight Center have created a high resolution land surface modeling and data assimilation system known as the Land Information System (LIS), which provides an infrastructure to integrate state-of-the-art land surface models, data assimilation algorithms, observations of land surface from satellite and remotely sensed platforms to provide estimates of land surface conditions such as soil moisture, evaporation, snowpack and runoff. These model predictions are typically evaluated by comparing them with data from observational networks. The observational data; however, are usually available in disparate data formats and require significant effort to process them into a structure amenable for use with the model data. The motivation to develop a uniform approach for land surface verification as a way to alleviate these processing efforts has led to the development of LVT which is designed to enable the rapid evaluation of land surface modeling and analysis products from LIS. LVT focuses on the use of observational datasets in their native format. As the formats of these datasets vary widely, a major part of LVT is creating programs to read and process the native datasets. The primary goal of this project is to enhance LVT capabilities by incorporating observational datasets from Ameriflux

Georgiev, Teodor↗

NASA NTRS2016

Scientific and Technical Assistance for the Deployment of a Flexible Airborne Spectrometer System During C-MAPExp and COMEX: COMEX Version - 1.9T

The COMEX (CO2 and MEthane eXperiment) campaign supports the mission definition of CarbonSat and HyspIRI (Hyperspectral Infrared Imager) by providing representative airborne remote sensing data ‐ MAMAP (Methane Airborne MAPper) for CarbonSat; the Airborne Visual InfraRed Imaging Spectrometer (Classic & Next Generation) AVIRIS‐C/AVIRIS‐NG for HyspIRI ‐ as well as ground-based and airborne in‐situ data. The objectives of the COMEX campaign activities are (see Campaign Implementation Plan (RD‐4)): 1. Investigate spatial/spectral resolution trade‐offs for CH4 anomaly detection and flux inversion by comparison of MAMAP‐derived emission estimates with AVIRIS/AVIRIS‐NG derived data. 2. Evaluate sun‐glint observation geometry on CH4 retrievals for marine sources. 3. Characterize the effect of Surface Spectral Reflectance (SSR) heterogeneity on trace gas retrievals of CO2 and CH4 for medium and low‐resolution spectrometry. 4. Identify benefits from joint SWIR/TIR (ShortWave InfraRed/Thermal InfraRed ) data for trace gas detection and retrieval by comparison of MAMAP and AVIRIS/AVIRIS‐NG NIR/SWIR data with MAKO (Aerospace Corp.)TIR data. The ability to derive emission source strength for a range of strong emitting targets by remote sensing will be evaluated from combined AVIRIS‐NG and MAMAP data, adding significant value to the HyspIRI campaign AVIRIS‐NG dataset. The data will be used to quantify anomalies in atmospheric CO2 and CH4 from strong local greenhouse gas sources e.g. localized industrial complexes, landfills, etc. and to derive CO2 and CH4 emissions estimates from atmospheric gradient measurements. The original campaign concept was developed by University of Bremen and BRI. The COMEX campaign is funded bilaterally by NASA and ESA (European Space Agency). Whereas NASA funds the US part of the project via a contract with Dr. Ira Leifer, BRI (Bubbleology Research International), the contribution of MAMAP to the COMEX campaign is funded by ESA within the COMEX‐E project and NASA with respect to a 50 percent contribution to the flight-related costs of flying MAMAP on a US aircraft. The Data Acquisition Report (RD‐9) describes the instrumentation used, the measurements made by the team during the COMEX campaign in May/June 2014 and August/September 2014 in California, and an initial assessment of the data quality.

Point Sources↗

NASA NTRS2019

Prediction of Pushback Times and Ramp Taxi Times for Departures at Charlotte Airport

When optimizing the takeoff sequence and schedule for departures at busy airports, it is important to accurately predict the taxi times from gate to runway because those are used to calculate the earliest possible takeoff times. Several airports like Charlotte Douglas International Airport show relatively long taxi times inside the ramp area with large variations, with respect to the travel times in the airport movement area. Also, the pushback process times have not been accurately modeled so far mainly due to the lack of accurate data. The recent deployment of the integrated arrival, departure, and surface traffic management system at Charlotte airport by NASA enables more accurate flight data in the airport surface operations to be obtained. Taking advantage of this system, actual pushback times and ramp taxi times from historical flight data at this airport are analyzed. Based on the analysis, a simple, data-driven prediction model is introduced for estimating pushback times and ramp transit times of individual departure flights. To evaluate the performance of this prediction model, several machine learning techniques are also applied to the same dataset. The prediction results show that the data-driven prediction model is as good as the machine learning algorithms when comparing various prediction performance metrics.

Lee, Hanbong↗

NASA NTRS2019

Prediction of Pushback Times and Ramp Taxi Times for Departures at Charlotte Airport

airport surface operations↗

NASA NTRS2022

Measuring, mapping, and anticipating climate gentrification in Florida: Miami and Tampa case studies

This article introduces an experimental methodology to identify proxy indicators that are conceptually consistent with the processes of Climate Gentrification (“CG”), in which a change in demand preferences among consumers and investors drives the increased consumption for real estate, in part, on lower measures of physical risk from climate change. Evaluated through case studies in the state of Florida, this article builds on the integration of multiple datasets concerning rental properties, evictions, and socioeconomic data, as well as environmental risk indices to build a Climate Gentrification Risk Index (CGRI). In the Miami case study, we find that the CGRI identifies a hotly contested neighborhood that is already known to be in a state of transition consistent with the processes of CG. In the Tampa case, the index highlights a district that exhibits strong metrics for the future accelerated occurrence of CG. Our findings suggest that transitional land uses and flexible zoning in low-exposure areas are key elements for attracting new development consistent with CG and offer insight into the challenges that local governments face understanding the types and rates of change that may be catalyzed in the broader urban processes of public and private sector climate adaptation in the built environment.

Climate change↗

DOE OSTI2020

Accelerated Charged Particle Tracking with Graph Neural Networks on FPGAs

We develop and study FPGA implementations of algorithms for charged particle tracking based on graph neural networks. The two complementary FPGA designs are based on OpenCL, a framework for writing programs that execute across heterogeneous platforms, and hls4ml, a high-level-synthesis-based compiler for neural network to firmware conversion. We evaluate and compare the resource usage, latency, and tracking performance of our implementations based on a benchmark dataset. We find a considerable speedup over CPU-based execution is possible, potentially enabling such algorithms to be used effectively in future computing workflows and the FPGA-based Level-1 trigger at the CERN Large Hadron Collider.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Dynamic Model Agnostic Reliability Evaluation of Machine-Learning Models Integrated in Instrumentation & Control Systems

In recent years, the field of data-driven neural network-based machine learning (ML) algorithms has grown significantly and spurred research in its applicability to instrumentation and control systems. While they are promising in operational contexts, the trustworthiness of such algorithms is not adequately assessed. Failures of ML-integrated systems are poorly understood; the lack of comprehensive risk modeling can degrade the trustworthiness of these systems. In recent reports by the National Institute for Standards and Technology, trustworthiness in ML is a critical barrier to adoption and will play a vital role in intelligent systems' safe and accountable operation. Thus, in this work, we demonstrate a real-time model-agnostic method to evaluate the relative reliability of ML predictions by incorporating out-of-distribution detection on the training dataset. It is well documented that ML algorithms excel at interpolation (or near-interpolation) tasks but significantly degrade at extrapolation. This occurs when new samples are "far" from training samples. The method, referred to as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets, which is used to calculate a prediction's relative reliability. LADDR is demonstrated on a feedforward neural network-based model used to predict safety significant factors during different loss-of-flow transients. LADDR is intended as a "data supervisor" and determines the appropriateness of well-trained ML models in the context of operational conditions. Ultimately, LADDR illustrates how training data can be used as evidence to support the trustworthiness of ML predictions when utilized for conventional interpolation tasks.

97 MATHEMATICS AND COMPUTING↗