Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA BASE MANAGEMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Experiential findings for sustainable software ecosystems to support experimental and observational science

In the search for a sustainable approach for software ecosystems that supports experimental and observational science (EOS) across Oak Ridge National Laboratory (ORNL), we conducted a survey to understand the current and future landscape of EOS software and data. This paper describes the survey design we used to identify significant areas of interest, gaps, and potential opportunities, followed by a discussion on the obtained responses. The survey formulates questions about project demographics, technical approach, and skills required for the present and the next five years. Here, the study was conducted among 38 ORNL participants between June and July of 2021 and followed the required guidelines for human subjects training. We plan to use the collected information to help guide a vision for sustainable, community-based, and reusable scientific software ecosystems that need to adapt effectively to: (i) the evolving landscape of heterogeneous hardware in the next generation of instruments and computing (e.g. edge, distributed, accelerators), and (ii) data management requirements for data-driven science using artificial intelligence.

97 MATHEMATICS AND COMPUTING↗

Regionalized Life Cycle Greenhouse Gas Emissions of Forest Biomass Use for Electricity Generation in the United States

This study presents a cradle-to-grave life cycle analysis (LCA) of the greenhouse gas (GHG) emissions of the electricity generated from forest biomass in different regions of the United States (U.S.), taking into consideration regional variations in biomass availabilities and logistics. The regional biomass supply for a 20 MW bioelectricity facility is estimated using the Land Use and Resource Allocation (LURA) model. Results from LURA and data on regional forest management, harvesting, and processing are incorporated into the GHGs, Regulated Emissions, and Energy Use in Technologies (GREET) model for LCA. The results suggest that GHG emissions of mill residues-based pathways can be 15-52% lower than those of pulpwood-based pathways, with logging residues falling in between. Nonetheless, our analysis suggests that screening bioenergy projects on specific feedstock types alone is not sufficient because GHG emissions of a pulpwood-based pathway in one state can be lower than those of a mill residue-based pathway in another state. Furthermore, the available biomass supply often consists of several woody feedstocks, and its composition is region-dependent. Forest biomass-derived electricity is associated with 86-93% lower life-cycle GHG emissions than the emissions of the average grid electricity in the U.S. Key factors driving bioelectricity GHG emissions include electricity generation efficiency, transportation distance, and energy use for biomass harvesting and processing.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Anomaly Detection, Localization and Classification using Drifting Synchrophasor Data Streams

With ongoing automation and digitization of the electric power system, several Phasor Measurement Units(PMUs) have been deployed for monitoring and control. PMU data can have multiple anomalies, and many of the researchers in the past have concentrated on training machine/deep learning algorithms offline for anomaly detection over PMU data (i.e., not in real time). These machine/deep learning algorithms, when trained offline on a sample rather than a population of the dataset, fail to consider the dynamic behavior of the power grid in real-time, resulting in low accuracy. Considering the dynamic behavior of the power grid (e.g., change in load, generation, distributed energy resources (DERs) switching, network, controls), the definition of data anomalies varies in time and requires online training. A fundamental challenge is to enable online (i.e., real-time) training of machine/deep learning algorithms for anomaly detection over streaming PMU data. While machine/deep learning is often desirable to manage data streams, training a deep learning algorithm over streaming PMU data is nontrivial due to changes in data statistics caused by dynamic streaming data. This paper proposes PMUNET: a novel device-level deep learning-based data-driven approach for anomaly detection, localization, and classification over streaming PMU data, using online learning and multivariate data-drift detection algorithm .Two variants of PMUNET, Dynamic data Change Driven Learning (DCDL) and Continuity Driven Learning (CDL), are proposed and compared. DCDL aims to train the deep learning algorithm whenever the definition of anomaly changes due to the power grid dynamics. On the other hand, CDL continuously trains the deep learning algorithm over the PMU data-stream. The experimental results verify that DCDL outperforms CDL and other efficient anomaly detection methods over multiple events such as faults and load/ generator/capacitor/DERs variations/switching for IEEE 14 and 39 Bus test system as well as real PMU industrial data. The result verifies that DCDL variant of PMUNET improves over existing approach with a gain of 2% - 10% in terms of accuracy, false-positive rate, and false-negative rate.

adversarial deep learning↗

MIQS v0.6

In this research, we propose a novel Metadata Indexing and Querying for Self-describing formats (MIQS), which removes the external DBMS and utilizes in-memory index to achieve efficient metadata searching. MIQS follows the self-contained data management paradigm and provides portable and schema-free metadata indexing and querying functionalities for self-describing file formats. We have evaluated MIQS with the state-of-the-art MongoDB-based metadata indexing solution. MIQS achieved up to 99% time reduction in index construction and up to 172,000X search performance improvement with up to 75% reduction in memory footprint.

Byna, Suren↗

MIQS v0.6

In this research, we propose a novel Metadata Indexing and Querying for Self-describing formats (MIQS), which removes the external DBMS and utilizes in-memory index to achieve efficient metadata searching. MIQS follows the self-contained data management paradigm and provides portable and schema-free metadata indexing and querying functionalities for self-describing file formats. We have evaluated MIQS with the state-of-the-art MongoDB-based metadata indexing solution. MIQS achieved up to 99% time reduction in index construction and up to 172,000X search performance improvement with up to 75% reduction in memory footprint.

Byna, Suren↗

Microcontroller-based aerosol jet printer control software

This software is used with a microcontroller to control an aerosol jet printing system. It was written for a 32-bit ARM microcontroller, providing greater processing speed and complexity relative to more conventional low-cost printer controllers. The microcontroller software was written using a real-time operating system (FreeRTOS), which simplifies parallel operation of multiple functions and further customization. It supports simultaneous motion planning, pulse generation for stepper motors, reading encoder feedback, communicating with multiple mass flow controllers, controlling solid state relays, handling a software-based emergency stop, and sending data to the client PC. The program is written in C and communicates with the client PC via USB connection. Sandia National Laboratories is a multi-mission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-0436 O

Secor, EthanBenjamin↗

pvOps v.0.1

This python package contains a series of functions to facilitate fusion of text-based and time series production data collected at photovoltaic sites. The package also contains example datasets and tutorials to help demonstrate how the functions can be used. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1554 O

Gunda, Thushara↗

Enhancing Risk Analysis of Accidental Release Using CFD Modeling and Machine Learning

This project report presents the results from the AU31 project that is entitled “Enhancing Risk Analysis of Accidental Release Using CFD Modeling and Machine Learning” performed between FY2021 and FY2022. The technical objective of this project is to enhance risk analysis of accidental release of radioactive materials and provide novel risk forecasting and capabilities for assessing unplanned hazardous chemical releases for the U.S. Department of Energy (DOE). The approach includes a cross-platform finite element analysis of airborne chemical release, machine learning (ML) for simulation and forecasting, and a big data approach to data management, transformation and analysis capable of handling petabyte-scale unstructured and structured data. The outcome of these findings were assembled and accessible as a final output via an intuitive web hosted geospatial-based user interface for demonstration and general dissemination. These new results also provide a mechanism of combining this knowledge in a risk analysis framework tool. The geospatial analysis and output can utilize 5 years of qualified meteorological data to illustrate projected plume footprints that are generated from computational aspects of this study. Specifically, we show the development of a geospatial risk analysis capabilities to respond to and plan for accidental release of radioactive materials and to provide a risk forecasting tool for assessing hazardous chemical releases for the DOE. The focus of this effort is germane to common practices in risk analysis; and it is highly relevant to the timely and transparent release of information related to materials at risk including hazardous materials and chemical vapors and rapid assessment of the potential impacts on the workforce at active sites across the DOE complex.

42 ENGINEERING↗

Building 151 NNMA Clean Laboratory Project Soil Sampling and Analysis Plan

This Soil Sampling and Analysis Plan (SAP) was prepared by the Environmental Function Area (EFA)/Technical Services Department (TSD) of the Environment, Safety & Health (ES&H) Directorate for the Project Management Office (PMO) for the proposed Building 151 NNMA Clean Laboratory Project (project) located immediately south of Building 154. The purpose of the SAP was to describe the procedures for collection and analysis of environmental samples and evaluation of analytical data (chemical and radiological) to determine management options of excavated soil during project construction in accordance with Lawrence Livermore National Laboratory’s (LLNL) Soils Screening and Management Plan (SSMP) (LLNL, 2022), which is consistent with U.S. Environmental Protection Agency (EPA) guidance for developing Data Quality Objectives for environmental data (EPA, 2006). The SAP was developed in accordance with the SSMP and based on preliminary design information provided to EFA by PMO. In addition to environmental samples, geotechnical samples will be collected by Consolidated Engineering Laboratories (CEL) on behalf of PMO. Geotechnical samples will be collected from a dedicated geotechnical boring location or co-located with environmental samples. Collection of geotechnical samples is determined by CEL and is therefore not discussed in this SAP.

54 ENVIRONMENTAL SCIENCES↗

CAMEO: A Co-design Architecture for Multi-objective Energy System Optimization (Project Report)

CAMEO (Codesign Architecture for Multi-objective Energy System Optimization) is a modular workflow management framework that abstracts co-design problems as Directed Acyclic Graphs (DAG). The framework employs JSON-based workflow specifications that enable systematic decomposition of complex optimization problems into reusable, interchangeable components including data loaders, scenario generators, optimization solvers, and result summarizers.

97 MATHEMATICS AND COMPUTING↗

Qualitative Risk Assessment of Legacy Wells within the Estimated Prairie State Generating Company Area of Review

This report details the digitization of a legacy wellbore database, including data processing assumptions, parameter estimation, and risk assessment methodology. The database, comprising 6,454 documents, was provided by ISGS. It includes valuable data from the Prairie State Generating Company (PSGC) and One Earth Energy (OEE) sites of the CarbonSAFE Phase III – Illinois Storage Corridor project. The report focuses on wells within a 15-mile radius from the Lively Grove #1 (LG#1) well at PSGC site, evaluating subsurface conditions and potential risks. A total of 4,386 wellbores within 15 miles of the LG#1 well were filtered based on depth and formation codes. LG#1 is the stratigraphic well at the PSGC site drilled in 2021. Ninety-four (94) wells penetrating the Maquoketa Shale Group (the primary confining unit) within the estimated area-of-review (AoR) for the PSGC site were evaluated using a qualitative risk assessment (QRA) methodology. The QRA developed by Arbad et al. 2022 focuses on legacy wells within the AoR and categorizes them based on well construction details. The QRA identifies wells that need immediate attention by categorizing them based on penetration depth and protection. Wells within the AoR were categorized into nine groups based on penetrations and protections. These categories range from Type 1 wells, with no documentation, to Type 9 wells, which do not penetrate the primary confining unit or storage reservoir (unit). Well accessibility within the AoR varies based on well status, including Dry & Abandoned (DA), Plugged & Abandoned (PA), Injection (INJ), Oil/Gas Producing (PROD), and Observation (Obs) wells. Accessibility levels were determined by well construction, with DA wells being the least accessible and Observation wells the most accessible, impacting gas leakage detection possibilities. Remedial action priority of wells decreases from Type 1 to Type 9 wells. Type 1 to Type 6 wells with status DA and PA require immediate attention, while Type 7 and Type 8 wells are low priority. A risk matrix used to prioritize corrective actions for legacy wells is proposed to categorize wells within an AoR based on penetrations, protections, and accessibility. The methodology involves data acquisition, well categorization into nine types, and determining CO 2 leakage pathways using well schematics and geospatial mapping. This approach is particularly useful for managing the integrity of legacy wells throughout the lifecycle of a Carbon Capture and Storage (CCS) project. A qualitative risk assessment of 94 wells within the AoR of the PSGC site identified 54 wells with high priority for corrective action due to penetration of the primary containment seal. The assessment utilizes color-coded maps to categorize well types and prioritize corrective actions, providing a comprehensive analysis. Schematics of wells penetrating the primary confining unit were drawn, and leakage pathways were identified. Details of all wells penetrating the confining zone are provided in the appendix, including information on well types, plugging, and casing status.

01 COAL, LIGNITE, AND PEAT↗

Classification of animal sounds in a hyperdiverse rainforest using convolutional neural networks with data augmentation

To protect tropical forest biodiversity, we need to be able to detect it reliably, cheaply, and at scale. Automated detection of sound producing animals from passively recorded soundscapes via machine-learning approaches is a promising technique towards this goal, but it is constrained by the necessity of large training data sets. Using soundscapes from a tropical forest in Borneo and a Convolutional Neural Network model (CNN), we investigate i) the minimum viable training data set size for accurate prediction of call types (‘sonotypes’), and ii) the extent to which data augmentation and transfer learning can overcome the issue of small and imbalanced training data sets. We found that even relatively high sample sizes (>80 per sonotype) lead to mediocre accuracy, which however improved significantly with data augmentation and transfer learning, including at extremely small sample sizes (3 per sonotype), regardless of taxonomic group or call characteristics. Neither transfer learning nor data augmentation alone achieved high accuracy. Our results suggest that transfer learning and data augmentation could make the use of CNNs to classify species’ vocalizations feasible even for small soundscape-based projects with many rare species. Retraining our open-source model requires only basic programming skills which makes it possible for individual conservation initiatives to match their local context, in order to enable more evidence-informed management of biodiversity.

54 ENVIRONMENTAL SCIENCES↗

United States Nuclear Power Reactor Used Nuclear Fuel Database and Applications

The Unified Database (UDB) within STANDARDS serves as the foundational data infrastructure for managing the United States' spent nuclear fuel inventory of 315,111 discharged assemblies totaling 91,036 metric tons of heavy metal. The database organizes this complex inventory through over 200 interconnected tables structured into eight primary attribute categories, supporting integrated analyses across storage, transportation, and disposal domains. Data enters the UDB through the GC-859 Nuclear Fuel Data Survey, which transitioned to web-based collection in 2023, improving data quality through real-time validation. The UDB enables automated generation of input files for nuclear safety analyses, reducing preparation time from weeks to hours while maintaining traceability. Applications include national inventory reporting, Certificate of Compliance assessments, and facility optimization. The three-tier distribution model balances accessibility with security requirements for federal agencies, national laboratories, and research organizations. The UDB provides essential data infrastructure as spent fuel management transitions from site-specific to integrated national campaigns.

Stefanovic, Peter↗

Raccoon density estimation from camera traps for raccoon rabies management

Abstract Density estimation for unmarked animals is particularly challenging, yet density estimates are often necessary for effective wildlife management. Raccoons ( Procyon lotor ) are the primary terrestrial wildlife reservoir for Lyssavirus rabies within the United States. The raccoon rabies variant (RRVV) is actively managed at landscape scales using oral rabies vaccination (ORV) within the eastern United States. To effectively manage RRVV, it is important to know the density of raccoons to appropriately scale the density of ORV baits distributed on the landscape. We compared methods to estimate raccoon densities from camera‐trap data versus more intensive capture‐mark‐recapture (CMR) estimates across 2 land cover types (upland pine and bottomland hardwood) in the southeastern United States during 2019 and 2020. We evaluated the effect of alternative camera configurations and durations of camera trapping on density estimates and used an N‐mixture model to estimate raccoon densities, including covariates on abundance and detection. We further compared different methods of scaling camera‐based counts, with the maximum number of raccoons seen on any given image within a day best explaining density. Camera‐trap density estimates were moderately correlated with CMR estimates ( r = 0.56). However, densities from camera‐trap data were more reliable when classifying category of density as an index used to inform management (83% correct when compared to CMR estimates), although the densities in our study fell into the 2 lowest density classes only. Using more cameras reduced bias and uncertainty around density estimates; however, if ≤6 camera traps were used at a site, a line transect approach proved less biased than a grid design. Camera trapping should be conducted for at least 3 weeks for more accurate estimates of raccoon population density in our study area (<5% bias). We show that camera‐trap data can be used to assign raccoon densities to management‐relevant density index bins, but more studies are needed to ensure reliability across a greater range of environmental conditions and raccoon densities.

Davis, Amy J.↗

Future Intensity‐Duration‐Frequency Curves of Extreme Precipitation in the Midwest United States From Convection‐Permitting Modeling

Abstract During the last four decades, global warming has statistically significant intensified extreme precipitation events in the Midwestern United States (defined here as the region covering Illinois, Indiana, Ohio, and Kentucky), leading to increased risks to human life, property, and infrastructure. To enable climate change adaptation and resilience across various economic and social sectors in this region, updated information about future climate changes, specifically at finer spatial scales, is essential. Leveraging a new 150‐year dynamical downscaling data set at convection‐permitting resolution, this study introduces a framework to construct the projected future intensity‐duration‐frequency (IDF) curves of heavy precipitation, which are prominent tools for infrastructure design and water resources management. This framework generates IDF curves at both sub‐daily and multi‐day duration utilizing hourly in situ observations as well as quantile‐based statistical techniques in bias‐correction and return levels selection. The assumption of non‐stationarity in the distribution parameter fitting process is also implemented in this workflow. Compared to historical IDF curves for 1980–2022, future projected IDF curves for 2058–2100 under Representative Concentration Pathway (RCP) 4.5 and RCP 8.5 scenarios indicate an average intensity increase of approximately 15% and 25%, respectively, across 74 stations, considering both annual and seasonal timescales. Future projections suggest that extreme precipitation events may become more severe across six investigated return periods, with longer return periods showing a greater increase. The frequency of future extreme precipitation events in the Midwest region is also projected to double. Furthermore, current results reveal spatial heterogeneity of future trends across stations owing to the high‐resolution input data set. Plain Language Summary This study investigates the evolving nature of extreme precipitation events in the Midwestern United States under a changing climate. By leveraging a high‐resolution dynamical downscaling data set, we construct projected intensity‐duration‐frequency (IDF) curves for future extreme rainfall events. These curves serve as vital tools for infrastructure planning and water resource management. Our analysis reveals a significant increase in both the intensity and frequency of extreme precipitation events in the region. Future projected IDF curves for the late century indicate an average intensity increase of approximately 15%–25% compared to historical values. Moreover, the frequency of such events is expected to double. Spatial heterogeneity in future trends is observed across different stations within the Midwest, highlighting the importance of high‐resolution modeling in capturing localized climate variability. These findings underscore the urgent need for climate adaptation strategies to mitigate the increasing risks associated with extreme precipitation events in the region. Key Points This study introduces a workflow to construct future intensity‐duration‐frequency (IDF) curves over the Midwest United States using a new convection‐permitting modeling data set The current IDF construction workflow reproduces well the historical observed IDF 30 curves in summer months with median relative errors of 2.4% among 74 stations and 6 investigated durations The projected IDF curves show diverse future trends of extreme precipitation across stations, with intensity increases of approximately 15% and 25% under RCP4.5 and RCP8.5 climate scenarios, respectively, and a doubling of frequency on average

Nguyen, Trung↗

A machine learning pipeline for identifying infiltration managed aquifer recharge locations from satellite imagery in the San Joaquin Valley, California

This study focuses on an agricultural region in California’s Central Valley, USA, where Managed Aquifer Recharge (MAR) is widely implemented to mitigate groundwater depletion under increasing water demand and climate variability. A deep learning and machine learning framework was developed to identify infiltration-MAR locations using satellite imagery and environmental data. The framework integrates surface water detection from Sentinel-2 imagery, geospatial delineation of water bodies, spatiotemporal tracking of water body dynamics, and supervised classification using meteorological, environmental, and topographic variables. The framework was applied to a 2379 km² study area southwest of Fresno, where 765 water bodies were detected, including 139 identified MAR sites based on publicly available datasets and expert knowledge. The classification model achieved an accuracy of 0.94 and an F1 score of 0.85. Feature importance analysis indicates that cropland, normalized difference vegetation index (NDVI), and evaporation are among the most influential predictors for infiltration-MAR. Notably, the framework suggests that engineered water management in infiltration-MAR systems can disrupt or even reverse the expected positive correlation between surface water extent and precipitation. These findings provide physically interpretable insights into the characteristics of existing infiltration-MAR facilities and demonstrate the potential of the proposed framework as a reproducible, interpretable, and potentially transferable tool for data-driven infiltration-MAR identification and inventory development under growing climatic and hydrological uncertainty.

Classification↗

Policy Innovation and Governance for Irrigation Sustainability in the Arid, Saline San Joaquin River Basin

This paper provides a chronology and overview of events and policy initiatives aimed at addressing irrigation sustainability issues in the San Joaquin River Basin (SJRB) of California. Although the SJRB was selected in this case study, many of the same resource management issues are being played out in arid, agricultural regions around the world. The first part of this paper provides an introduction to some of the early issues impacting the expansion of irrigated agriculture primarily on the west side of the San Joaquin Valley and the policy and capital investments that were used to address salinity impairments to the use of the San Joaquin River (SJR) as an irrigation water supply. Irrigated agriculture requires large quantities of water if it is to be sustained, as well as supply water of adequate quality for the crop being grown. The second part of the paper addresses these supply issues and a period of excessive groundwater pumping that resulted in widespread land subsidence. A joint federal and state policy response that resulted in the facilities to import Delta water provided a remedy that lasted almost 50 years until the Sustainable Groundwater Management Act of 2014 was passed in the legislature to address a recurrence of the same issue. The paper describes the current state of basin-scale simulation modeling that many areas, including California, are using to craft a future sustainable groundwater resource management policy. The third section of the paper deals with unique water quality issues that arose in connection with the selenium crisis at Kesterson Reservoir and the significant threats to irrigation sustainability on the west side of the San Joaquin Valley that followed. The eventual policy response to this crisis was incremental, spanning two decades of University of California-led research programs focused on finding permanent solutions to the salt and selenium contamination problems constraining irrigated agriculture, primarily on the west side. Arid-zone agricultural drainage-induced water quality problems are becoming more ubiquitous worldwide. One policy approach that found traction in California is an innovative variant on the traditional Total Maximum Daily Load (TMDL) approach to salinity regulation, which has features in common with a scheme in Australia’s Hunter River Basin. The paper describes the real-time salinity management (RTSM) concept, which is geared to improving coordination of west side agricultural and wetland exports of salt load with east side tributary reservoir release flows to improve compliance with river salinity objectives. RTSM is a concept that requires access to continuous flow and electrical conductivity data from sensor networks located along the San Joaquin River and its major tributaries and a simulation model-based decision support designed to make salt load assimilative capacity forecasts. Web-based information dissemination and data sharing innovations are described with an emphasis on experience with stakeholder engagement and participation. The last decade has seen wide-scale, global deployment of similar technologies for enhancing irrigation agriculture productivity and protecting environmental resources.

54 ENVIRONMENTAL SCIENCES↗

PDQ Users Manual. Manual Version 2, for PDQ Code Version 1.20

PDQ is a tool for the management of the input and execution of batch jobs for simulation codes that use a text based input system. It accomplishes this goal by operating at two levels. First, it takes input file templates (commonly known at LANL as input deck templates) and creates multiple instantiations by performing substitutions of data from table files into symbols (variables) found in the template. Second, it provides commands to submit the created files to the SLURM batch system for execution. These two activities taken together produce a whole that is greater than the sum of its parts and provides an elegant way of executing studies across multiple similar simulations while minimizing the risk of typographical errors in the input files. PDQ was originally developed as a job management system called XVS by Jeff McAninch while he was at LANL. Besides the capabilities described here, XVS had many other features specific for interactions with particular simulation codes. After Jeff’s departure, maintenance of XVS was taken over by Rendell Carver; he added some new features as well as kept it functioning as the batch system at LANL was changed from LSF to MOAB to SLURM. In 2017, Rob Pelak decided to develop a different version that removed the additional features (many of which were rendered obsolete with the retirement of the simulation code or batch system that they supported) and produced a cleaner “bare bones” version of XVS. A few other behaviors of XVS that Rob found irksome were altered. Rob gave the resulting code a new name: PDQ. In 2022 Danielle McDermott developed a version that runs under Python 3.X. As suggested by Rob, she used the python2to3 utility to identify most changes. Given that PDQ continues to operate with Python version 2.7 we have advanced the version number to 1.20.

97 MATHEMATICS AND COMPUTING↗