SEARCH · Engineering Papers

Results for “DATA BASE MANAGEMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Biodefense Knowledge Management System

After the Amerithrax attacks, the Department of Homeland Security (DHS) recognized the need to link technical scientific information with law enforcement and national security information in the fight against bioterrorism. The Biodefense Knowledge Center (BKC) was formed to provide timely analysis of technical biodefense-related topics to support DHS and its customers in the interagency. The Biodefense Knowledge Management System (BKMS) was created as the backbone for information management within the BKC. It is a scalable, web-based knowledge management system for organizing disparate data sources. By combining information from 35+ data sources, the BKMS provides a searchable repository for technical information including scientific reports, journal articles, news articles, research funding databases, patent databases, and genomic datasets. The current system contains over 58 million documents and 450 million genomic records, and operates at several classification levels.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

DOE OSTI2021

Energy Efficient Data Centers

Energy efficient data center strategies include thermal/environmental guidelines, air management, free cooling, and liquid-based cooling. A case study highlighting the data center cooling system at the National Renewable Energy Laboratory Energy Systems Integration Facility illustrates many of these principles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Energy Efficient Data Centers

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Digital Twin for Hydropower System Object Modeling: Alder Dam (FY2023)

Hydropower is the world's largest source of renewable electricity, and hydropower plants are distributed all over the world. Typical major components of a hydropower plant are the governor, excitation, generator, thrust bearing, hydraulic turbine, transformer, the main lead, metering and control, tailwater depression, and dissolved oxygen. For each component, various measures are taken. The measurements are acquired by various heterogeneous systems, including standalone sensors, programmable logic controllers (PLC), Supervisory control and data acquisition (SCADA), Internet of Things (IoT), and data acquisition and integration platforms such as OSI/PI. The measured data are often archived within the plant by a data management platform, and many institutions have cloud-based archive systems, such as Hydropower Research Institution (HRI), U.S. Army Corps of Engineers (USACE), and Columbia River Data Access in Real Time (DART). Object Modeling is a general framework for designing information systems. It focuses on objects, the actions they perform, and the messages they send to one another to cause those actions to be taken. The major differences among object modeling, network modeling, data modeling, and process modeling are that in the first we focus on the actions in response to information, objects which form the system, the actions they perform, and how they pass information to one another, while in the second we concentrate on where, when and how much information is moved, while in the third we focus on what information is moved and where it is moved, while in the last we focus on how it is moved and when it is moved. Object modeling was developed basically as a method to develop object-oriented systems and to support object-oriented programming. It describes the static structure of the system. The object Modeling Technique is easy to draw and use. That is why we choose object modeling to connect physical hydropower plants to Digital Twin. It recognizes the objects and the relationship between them. It identifies the attributes and functions of each class. Dynamic Modeling: It explains how objects respond to events. Functional Modeling indicates the processes executed in an object and how data changes when it moves to objects. It has been used in many applications like telecommunication, transportation, etc.

13 HYDRO ENERGY↗

DOE OSTI2021

Interactive Web Application for Traffic Simulation Data Management and Visualization

As traffic simulation software becomes more effective for realistically simulating and analyzing traffic dynamics and vehicle interactions on the mesoscopic and microscopic level, the management, dissemination, and collaborative visualization of traffic simulation results produced by individual transportation planners presents a significant challenge. Existing online content management systems have a very limited capability in allowing users to query specific traffic simulation scenarios and geospatially visualize simulation results through shareable and interactive web interfaces. This paper presents a web-based application for promoting the archiving, sharing, and visualization of large-scale traffic simulation outputs. The application is developed to enhance cyber-physical controls, communications, and public education for collaborative transportation planning. Unique features of the web application include: (a) allowing users to upload their new traffic simulation scenarios (parameters and outputs), as well as search existing scenarios using easily accessible interfaces; (b) optimizing simulation output files with heterogeneous data formats and projected coordinate systems for web-based storage and management using a scalable and searchable data/metadata standard; (c) standardizing user-uploaded simulation outputs using web interfaces and data processing libraries with parallel computing capacity; and (d) providing shareable web visual interfaces for visualizing the traffic flow and signal information stored in simulation outputs (e.g., regional traffic patterns and individual vehicle interactions) and visually comparing multiple simulation outputs both spatially and temporally. Furthermore, the paper presents the conceptual design and implementation of this application, and demonstrates the application’s performance for sharing, comparing, and visualizing simulation outputs from VISSIM and SUMO, two commonly used traffic simulation software programs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2022

LANL Contributions to pyiron: An integrated development environment for computational materials science

To support and accelerate the development of simulation protocols in atomistic modelling, we introduce an integrated development environment (IDE) for computational materials science called pyiron (http://pyiron.org). The pyiron IDE combines a web based source code editor, a job management system for build automation, and a hierarchical data management solution. The core components of the pyiron IDE are pyiron objects based on an abstract class, which links application structures such as atomistic structures, projects, jobs, simulation protocols and computing resources with persistent storage and an interactive user environment. The simulation protocols within the pyiron IDE are constructed using the Python programming language. To highlight key concepts of this tool as well as to demonstrate its ability to simplify the implementation and testing of simulation protocols we discuss two applications. In these examples we show how pyiron supports the whole life cycle of a typical simulation, seamlessly combines ab initio with empirical potential calculations, and how complex feedback loops can be implemented. While originally developed with focus on ab initio thermodynamics simulations, the concepts and implementation of pyiron are general thus allowing to employ it for a wide range of simulation topics.

Janssen, Jan↗

DOE OSTI2020

Comprehensive Land Use and Environmental Stewardship

Comprehensive Land Use and Environmental Stewardship (CLUES) Report serves as a summary document of the land use and environmental stewardship activities occurring on the Idaho National Laboratory (INL) Site (Desert) and the Research and Education Campus (REC) within Idaho Falls. Land and facility use planning and decisions at the INL Site are guided by a comprehensive planning process in accordance with the United States (U.S.) Department of Energy (DOE) Order 430.1C, “Real Property Asset Management,” which states "Establish a data-driven, risk-informed, performance-based approach to the life-cycle management of real property assets that aligns the real property portfolio with DOE mission needs; acquire, manage, positively account for, and dispose of real property assets in a safe, secure, cost-effective, and sustainable manner; and ensure the real property portfolio is appropriately sized, aligned, and in the proper condition to support efficient mission execution." Land use planning, like Campus Master Planning and 5-Year Facility Planning, provides a means for better, more sustainable use of the INL Site in a coordinated effort to ensure current and future mission needs are met, including acquisition, recapitalization, maintenance, disposition, real property utilization and long-term stewardship. This document and all functions of INL are guided by the DOE Vision for INL and the INL Mission and builds on the baseline established in the FY 2015 CLUES Report. However, it delivers a revised structure with focus on new resource management zones, which provide organization of key management considerations and access restrictions to optimize land use and environmental stewardship. A new set of thematic Guiding Principles presented in this report provide the intent and sustainable management direction to protect the INL Site natural environment. They demonstrate that the mission and vision of DOE and INL can be realized with inclusion of first of a kind technology, private sector development, and globally recognized testing and demonstration. This CLUES Report encourages comprehensive management decision-making with additional resource discussions for sustainability, the built environment, and the ecological landscape at the INL Site. Enhanced resource considerations and trends emphasize the importance of air, land use, environmental, subsurface, and cultural resources. The INL Site supports exceptional and interdependent resources. A diversity of bat species are accommodated by culturally significant caves distributed around the Site. Big game species like elk, deer, and moose seek vegetation communities which are protected by long-term stewardship and monitoring programs.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2020

Reliable machine prognostic health management in the presence of missing data

Prognostics and health management enables the prediction of future degradation and remaining useful life (RUL) for in-service systems based on historical and contemporary data, showing promise for many practical applications. One major challenge for prognostics is the common occurrence of missing values in time-series data, often caused by disruptions in sensor communication or hardware/software failures. Another major concern is that the sufficient prior knowledge of critical component degradation with a clear failure threshold is often not readily available in practice. These issues can significantly hinder the application of advanced signal and data analysis methods and consequently degrade the health management performance. In this article, we propose a novel data-driven framework that is capable of providing accurate and reliable predictions of degradation and RUL. In this approach, one-hot health state indicators are appended to the historical time series so that the model learns end-of-life automatically. A modified gate recurrent unit based variational autoencoder is employed in generative adversarial networks to model the temporal irregularity of the incomplete time series. Furthermore, experiments on multivariate time-series datasets collected from real-world aeroengines verify that significant performance improvement can be achieved using the proposed model for robust long-term prognostics.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2025

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗

DOE OSTI2025

Active learning path-dependent properties using a cloud-based materials acceleration platform

Solid state materials are central to many modern technologies in which a given material may be exposed to a variety of environments. The material properties often vary with the sequence of environments in an irreversible manner, resulting in a quintessential path-dependency in experimental observables. While sequential learning techniques have been effectively deployed for accelerating learning of state properties of materials, they often use a consistent environment path in all experiments. To elevate such techniques for making optimal decisions in experimental investigations of path-dependent properties, we introduce an iterated expected information gain acquisition function that optimizes over entire experimental trajectories. This approach is implemented within a cloud-based Materials Acceleration Platform architecture utilizing an event-driven stateful broker coupled with remote HELAO (Hierarchical Experimental Laboratory Automation and Orchestration) instances and an AI science manager. The platform's efficacy was demonstrated through a case study optimizing multi-step spectro-electrochemical experiments to identify optically stable potential windows in (Co–Ni–Sb)O z metal oxides. The system successfully integrated AI-driven experiment design, remote laboratory automation, and cloud-based data infrastructure, validating the platform's capability for managing complex, adaptive, path-dependent workflows in materials discovery.

Guevarra, Dan [California Institute of Technology ↗

DOE OSTI2021

Impact Analysis of Data Integrity Attacks on FACTS-based Wide-Area Voltage Control System

Energy management system (EMS) consists of several wide-area control applications that serve as a backbone for security, stability, and reliability of the power system. Wide-area voltage control system (WAVCS), one of the critical wide-area applications, operates in coordination with local Flexible AC Transmission System (FACTS) devices to provide voltage security and optimal management of active and reactive power resources. Since the WAVCS relies on wide-area communication and data sharing devices, possible cybersecurity vulnerabilities have to be addressed to ensure the closed-loop operation of WAVCS. In this paper, we present a methodology for performing an impact analysis of cyber-attacks in WAVCS cybersecurity. In particular, different types of data integrity attacks, such as malicious tripping, fault replay, and signal altering attacks, are considered, and detailed impact analysis is conducted in a testbed environment using the Kundur's four machine two-area system. For performing an impact analysis, the transient voltage stability of the sensitive bus voltage is studied, followed by the quantitative assessment and severity ranking using the voltage profile index. Our experimental evaluation reveals that the data integrity attacks on control signals exhibit a higher attack severity than on the measurement signals. Further, the severity of these attacks varies with nature (static or dynamic), location, and types of attacks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

PRIMO – The Oil & Gas Well Plugging Optimizer

This work presents PRIMO’s main capabilities and introduces the PRIMO web application, an intuitive user interface that leverages our sophisticated mathematical optimization model to rigorously optimize P&A priorities and plugging campaign efficiency. The web app simplifies user interaction, provides a powerful data management framework, and supports a broad user base (e.g., state agencies, well owners/operators, and plugging companies) to use PRIMO for decision-making. Specifically, we provide a demonstration of how to input the information on candidate wells, plugging campaign budget, user-defined priority and efficiency criteria to PRIMO. A real-world case study that consists of 1411 oil and gas wells and impact and efficiency priorities (e.g., well age, well proximity to schools/hospitals, well accessibility, distance between wells in projects) is presented to showcase PRIMO’s core capabilities: (i) ranking a candidate well population based on priorities, (ii) recommending high-impact and high-efficiency P&A projects, and (iii) assigning impact and efficiency scores to projects allowing for rigorous quantitative comparison among them.

02 PETROLEUM↗

DOE OSTI2024

Homomorphic Encryption for Electrical Metering Aggregation: Protecting the Privacy of Building Tenants

Electrical meters are devices that measure consumer electricity usage. The data collected by these meters is necessary for utility billing and electrical grid management but can also be used to assess the environmental impact of buildings. Prior research has found that unprotected metering data could potentially be used to infer some information about the behaviors of building tenants by detecting changes in electricity usage. For example, a period of low electricity usage could suggest that the tenants are not in the building. As smart metering becomes more common, there is a growing need for data privacy protections for metering data that do not negatively impact the quality and availability of data used for energy management and billing applications. To identify potential solutions, we developed a Python-based data aggregation platform to analyze the potential efficacy of privacy-enhancing technologies for energy metering applications. This platform aggregates groups of metering sites into virtual buildings, which could potentially detach changes in electrical activity from individual tenants, making it more difficult to track the activity of a specific tenant. To further protect data during analysis, this project utilizes homomorphic encryption as part of its initial approach. Homomorphic encryption offers a means of protecting energy consumption data while permitting mathematical operations to be performed without the need to know the data contents. This allows for data to be processed into usable statistics without revealing energy consumption information. A series of homomorphic encryption libraries were evaluated to determine their applicability and limitations in the context of metering data. The use of these techniques may help to reassure consumers and encourage further adoption of smart grid infrastructure.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Securing Environmental IoT Data Using Masked Authentication Messaging Protocol in a DAG-Based Blockchain: IOTA Tangle

The demand for the digital monitoring of environmental ecosystems is high and growing rapidly as a means of protecting the public and managing the environment. However, before data, algorithms, and models can be mobilized at scale, there are considerable concerns associated with privacy and security that can negatively affect the adoption of technology within this domain. In this paper, we propose the advancement of electronic environmental monitoring through the capability provided by the blockchain. The blockchain’s use of a distributed ledger as its underlying infrastructure is an attractive approach to counter these privacy and security issues, although its performance and ability to manage sensor data must be assessed. We focus on a new distributed ledger technology for the IoT, called IOTA, that is based on a directed acyclic graph. IOTA overcomes the current limitations of the blockchain and offers a data communication protocol called masked authenticated messaging for secure data sharing among Internet of Things (IoT) devices. We show how the application layer employing the data communication protocol, MAM, can support the secure transmission, storage, and retrieval of encrypted environmental sensor data by using an immutable distributed ledger such as that shown in IOTA. Finally, we evaluate, compare, and analyze the performance of the MAM protocol against a non-protocol approach.

Gangwani, Pranav (ORCID:0000000159226002)↗

DOE OSTI2024

New opportunities in produced water management: A market-based approach to produced water trading

Produced water (PW) is a byproduct of oil and gas (O&G) production. Obtained alongside the more valuable energy products, PW is usually characterized by high levels of salinity and often contains many contaminants (chemicals, soluble and insoluble oil, organics, etc.) making it unsuitable for release without substantial treatment. Couple this with the fact that PW is typically obtained at multiple times the rate of oil or gas, and the added transport, treatment, and disposal costs become a serious challenge for operators. These realities have led to ad-hoc practices including cooperation between industry competitors to recycle, share, or otherwise mitigate PW costs. The National Energy Technology Laboratory (NETL) in partnership with the Ground Water Protection Council (GWPC) is pursuing novel technology solutions to address PW issues that complement or improve ad-hoc practices adopted by operators. In this paper, we observe that well-established market management practices used in electrical power generation have natural analogues in the PW supply chain. These parallels open up a new line of research where we view PW management as a market equilibrium problem, and explore solutions that foster active and data-based collaboration among operators through market structures similar to power markets, with the ultimate objective of improving PW management costs and recycling rates. Here, we make a case for our observations, present a PW market clearing optimization model that shows how such a market system could operate in the O&G space, and provide an illustrative case study for demonstration.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Evaluating Awkward Arrays, uproot, and coffea as a query platform for High Energy Physics Data

Query languages for High Energy Physics (HEP) are an ever present topic within the field. A query language that can efficiently represent the nested data structures that encode the statistical and physical meaning of HEP data will help analysts by ensuring their code is more clear and pertinent. As the result of a multi-year effort to develop an in-memory columnar representation of high energy physics data, the NumPy, Awkward Array, and uproot Python packages present a mature and efficient interface to HEP data. Atop that base, the coffea package adds functionality to launch queries at scale, manage and apply experiment-specific transformations to data, and present a rich object-oriented columnar data representation to the analyst. Recently, a set of Analysis Description Language (ADL) benchmarks has been established to compare HEP queries in multiple languages and frameworks. In this paper we present these benchmark queries implemented within the coffea framework and discuss their readability and performance characteristics. We find that the columnar queries perform as well or better than the implementations given in previous studies.

Gray, L.↗

DOE OSTI2024

FedFleet 2024: Federal Fleet Boot Camp - Federal Motor Vehicle Fleet Data Reporting [Slides]

This presentation is intended as a 15-minute overview of federal motor vehicle fleet data reporting using the Federal Automotive Statistical Tool, presented as part of a half-day pre-conference workshop led by GSA's Office of Government-wide Policy for federal fleet managers at FedFleet 2024. This presentation covers what FAST is, what types of information agencies report through FAST, and where fleet managers can turn for assistance with fleet data reporting. FAST is a web-based information system sponsored by GSA's Office of Government-wide Policy and DOE's Federal Energy Management Program to collect information about the US federal government's fleet of motor vehicles; FAST is developed, maintained, and supported by DOE's Idaho National Laboratory (INL).

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

Analysis of prescribed fire days in climate model output

This code analyzes openly available, downscaled climate model output and counts days in a year that are available to conduct prescribed fire based on meteorological prescription data obtained from US land management agencies.

Jonko, Alexandra↗