Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Human Specimen Repository: Sample Collection for the Future [#133-000445]

In early 2014, an executive memo was released directing the improvement of the management of and access to scientific collections funded by government resources. In the spirit of this memo, NASA’s Human Research Program (HRP) funded a project to review existing residual samples in long-term storage for viability, identification, and scientific significance. These samples were to be collected in a centralized location and a detailed inventory was to be conducted to create the Human Sample Repository (HSR). HSR would work to review data from over 27,000 samples, from flight research projects dating back to 1998. The samples themselves would be reviewed, re-labeled, and organized into easy to retrieve, long-term storage. In addition to the older residual samples, HSR would expand to include pristine samples from all consenting crew who have flown on International Space Station (ISS) missions. All samples inventoried and managed by HSR are intended for the same purpose; to support future research projects which will utilize advanced technologies or techniques, by providing one-of-a-kind sample collections that can not be replicated. With this mission in mind, HSR will continue to collect residual samples from HRP funded projects and pristine samples from consenting crew, to further build this unique collection and increase the diversity of flight samples available to the scientific community.

Human Specimen Repository↗

Review of Cementitious Materials Development and Applications That Have Supported DOE-EM Missions: Waste Treatment, Conditioning, Containment Structures, Tank Closures, Facility Decommissioning, Environmental Restoration, and Structural Assessments

The Department of Energy (DOE) is tasked with managing the legacy defense wastes that resulted from nuclear materials production and nuclear arms development. Nuclear-waste management encompasses generation, processing (treatment and packaging), storage, transport, and disposal. To date, there are over 100 million gallons of liquid radioactive and chemical mixed wastes within the Department of Energy complex as well as solid waste, debris, and environmental restoration media that require disposal. DOE has been able to meet the challenges involved in dispositioning this waste using unique technical approaches and application-specific data required due to the nature of the constituents to be managed (e.g., long-lived radionuclides and highly mobile radionuclides in the near surface environments). Cementitious materials have played a prominent role historically in the successful disposition of these wastes, in the reduction of risk to the public, and in the closure of decommissioned tanks and facilities across the DOE complex.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Securing the Modern Grid: Federal Investments, Digitization, and Supply Chain Strategy

Across the United States (U.S.) grid expansion and modernization is underway, paving the way for accelerated load growth and intelligent resource management. Digitization of the grid is supported by several state and federal programs, providing support for utilities installing advanced metering infrastructure (AMI), AI-powered analytics systems, battery energy storage systems (BESS), and distributed energy resource management systems (DERMS) to transform the grid from a one-way power delivery system into an intelligent, responsive network that will enable faster load growth and power expansion of data centers for advanced artificial intelligence (AI) applications. The digital transformation of America's grid presents opportunity for increased efficiency and resiliency but also introduces new digital risks that require careful management. Digital equipment often contains several vulnerabilities such as unencrypted communication protocols, and persistent remote access capabilities that could be exploited to manipulate device settings, coordinate service disruptions, or inject false data into grid operations. These digital risks become particularly important as the grid must rapidly scale to support AI-driven data centers, which the administration has identified as essential for maintaining U.S. technological leadership and economic competitiveness. These vulnerabilities are compounded by supply chain realities: Chinese manufacturers currently produce 70-90% of essential grid components including inverters, batteries, and control systems, with the U.S. lacking domestic manufacturing capacity for critical assets like extra-high voltage transformers. Recent federal legislation has established Foreign Entity of Concern (FEOC) restrictions to address these risks, requiring projects to achieve escalating thresholds of non-FEOC content to receive tax credits while utilities work to expand sourcing channels for their supply chains and strengthen security measures. These restrictions arrive precisely when utilities face unprecedented electricity demand growth driven by the rapid growth in data centers, creating a considerable challenge: rapidly expanding infrastructure while navigating complex compliance requirements while lacking viable alternatives for many critical components. Idaho National Laboratory (INL) and its partners have developed practical approaches to help utilities navigate these intersecting challenges as they leverage federal investment to strengthen and grow the grid. These solutions include Cyber-Informed Engineering (CIE) principles that build resilience directly into systems, the Cirrus tool for secure cloud migration, and enhanced procurement guidance that embeds security requirements throughout equipment lifecycles. Federal initiatives, such as the Technical Assistance for Digital Assurance (TADA) project, provide direct support to utilities implementing these approaches while facilitating knowledge sharing across the industry. While these tools and frameworks cannot eliminate all risks inherent in foreign supply chain dependencies, they offer pragmatic pathways for strengthening security posture without sacrificing the deployment momentum essential to meeting surging electricity demand. Ultimately, securing America's digital energy infrastructure demands dedicated coordination across multiple fronts: building domestic supply chains, implementing robust digital assurance practices, and maintaining the aggressive modernization timeline necessary for reliability, resilience, and energy independence.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

Three-Dimensional Grid Visualization for Planning Activities: A Dubai Case Study

National Laboratory of the Rockies (NLR), in collaboration with the Dubai Electricity and Water Authority (DEWA) and Infra-X, has undertaken the Energy Visualization Analysis Project. The aim of this project is to enhance analytical and 3D visualization capabilities for distribution network planning and renewable energy integration. As modern grid continues to evolve with large-scale solar PV deployment and emerging distributed energy resources (DERs), the ability to effectively analyze, visualize, and communicate complex grid behaviors has become increasingly critical. The project focuses on developing empirical use cases based on real distribution feeder data and engineering workflows, ensuring the outcomes are directly aligned with operational environment. Through time-series power flow simulations and nodal hosting capacity analysis, the study quantifies the impacts of high PV penetration on voltage and thermal limits within representative 11 kV feeders. These analyses identify specific nodes and conditions where DER integration challenges arise. Furthermore, a Battery Energy Storage System (BESS) optimization algorithm was applied to determine the optimal size and placement of storage systems that can mitigate network constraints and enhance hosting capacity. The comparative results between base-case and BESS-augmented scenarios clearly demonstrate improvements in network stability and load management efficiency. In parallel, the NLR team developed an immersive 3D visualization framework, enabling interactive exploration of grid simulations using commodity head-mounted display (HMD) systems. This framework transforms conventional 2D simulation data into spatially intuitive visual environments - allowing engineers to analyze feeder conditions, PV hosting potential, and BESS effects in real time. This report represents the first foundational phase in establishing a visualization-driven analytical ecosystem. It provides a methodological foundation for data integration, visualization architecture, and simulation-based decision support, paving the way for large-scale adoption of immersive visualization across DEWA's Smart Grid Initiative, R&D activities, and future network resilience studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Buffering the impacts of extreme climate variability in the highly engineered Tigris Euphrates river system

More extreme and prolonged floods and droughts, commonly attributed to global warming, are affecting the livelihood of major sectors of the world’s population in many basins worldwide. While these events could introduce devastating socioeconomic impacts, highly engineered systems are better prepared for modulating these extreme climatic variabilities. Herein, we provide methodologies to assess the effectiveness of reservoirs in managing extreme floods and droughts and modulating their impacts in data-scarce river basins. Our analysis of multiple satellite missions and global land surface models over the Tigris-Euphrates Watershed (TEW; 30 dams; storage capacity: 250 km 3 ), showed a prolonged (2007–2018) and intense drought (Average Annual Precipitation [AAP]: < 400 km 3 ) with no parallels in the past 100 years (AAP during 1920–2020: 538 km 3 ) followed by 1-in-100-year extensive precipitation event (726 km 3 ) and an impressive recovery (113 ± 11 km 3 ) in 2019 amounting to 50% of losses endured during drought years. Dam reservoirs captured water equivalent to 40% of those losses in that year. Additional studies are required to investigate whether similar highly engineered watersheds with multi-year, high storage capacity can potentially modulate the impact of projected global warming-related increases in the frequency and intensity of extreme rainfall and drought events in the twenty-first century.

54 ENVIRONMENTAL SCIENCES↗

A Low Voltage DC Power Electronic Hub to Support Buildings

This paper presents the communication, control, and architecture, for a low voltage (nominal 480V) hybrid AC/DC microgrid for supporting small commercial buildings with critical data center loads. The proposed system is based on a dc-power electronic hub (PEH) that seamlessly integrates renewable energy resources, energy storage, and back-up generation to support commercial building economical energy management and reliability. This PEH concept provides a parallelization of critical power to the commercial and industrial buildings leading to increased efficiency and reliability compared to traditional uninterruptable power supplies. The demonstration of the proposed PEH architecture and controls is conducted through a controller hardware in the loop validation.

Starke, Michael↗

LANL Contributions to pyiron: An integrated development environment for computational materials science

To support and accelerate the development of simulation protocols in atomistic modelling, we introduce an integrated development environment (IDE) for computational materials science called pyiron (http://pyiron.org). The pyiron IDE combines a web based source code editor, a job management system for build automation, and a hierarchical data management solution. The core components of the pyiron IDE are pyiron objects based on an abstract class, which links application structures such as atomistic structures, projects, jobs, simulation protocols and computing resources with persistent storage and an interactive user environment. The simulation protocols within the pyiron IDE are constructed using the Python programming language. To highlight key concepts of this tool as well as to demonstrate its ability to simplify the implementation and testing of simulation protocols we discuss two applications. In these examples we show how pyiron supports the whole life cycle of a typical simulation, seamlessly combines ab initio with empirical potential calculations, and how complex feedback loops can be implemented. While originally developed with focus on ab initio thermodynamics simulations, the concepts and implementation of pyiron are general thus allowing to employ it for a wide range of simulation topics.

Janssen, Jan↗

The Value of Storage and Demand Response for Renewble Integration

Increased contributions from wind and solar power resources are necessary to meet California’s goal to use 33 percent renewable energy by 2020. Using these renewable resources, however, will substantially increase the variability and uncertainty in electricity generation resources available to California’s electricity grid operators. Automated demand response and energy storage systems can help reduce this variability and uncertainty through energy buying and selling (arbitrage) in day-ahead markets that would levelize loads and prices throughout the day. They could also provide load-following capability through bids in the real-time market and system management (or regulation) services to the system operator. The project identified policies, technologies (energy storage), and control methods (demand response) that could reduce the cost and improve the reliability of electric power for California ratepayers. Data and assumptions describing energy storage and demand response resources were provided by the Electric Power Research Institute, the California Energy Storage Alliance, and the Demand Response Research Center. The California Independent System Operator provided the production simulation model and supporting data.

14 SOLAR ENERGY↗

How does Mercury Methylation Respond to Intensive Forest Management and the Creation of Anoxia in Floodplain Soils

This research endeavor, entitled “How does Mercury Methylation Respond to Intensive Forest Management and the Creation of Anoxia in Floodplain Soils?” represents a collaborative effort undertaken by the University of North Carolina at Greensboro, led by Principal Investigator Dr. James S. Coleman, the United States Forest Service Santee Experimental Forest (SEF) Station Director Dr. Carl C. Trettin as Co-Principal Investigator, and The Chinese University of Hong Kong Dr. Martin Tsz-Ki Tsui and Dr. Alex T. Chow serving as Co-Principal Investigators. The overarching objective of this proposed project was to capture and elucidate the immediate and short-term effects of forest disturbances, namely clear-cutting and thinning, on the biogeochemical cycling of mercury (Hg) within the SEF in Huger, South Carolina. To accomplish this objective, a two-year exploratory study was proposed to conduct soil sampling and measurements of Hg and toxic methylmercury (MeHg), and soil physiochemical data within the experimental watershed (WS77) at SEF, following the clear-cutting process initiated for the preparation of the native longleaf pine restoration project by the USFS. Based on our mercury and hydrological data assessment, we concluded that the implementation of forest management practices, particularly mechanical thinning and clear-cutting, appears to enhance the potential for Hg methylation. Furthermore, these forest management practices may disrupt and alter the storage, mobility, and transformations of atmospherically deposited Hg in these lowland forests. We advocate for further research to comprehensively evaluate the impact of forest management on Hg cycling within forest ecosystems.

54 ENVIRONMENTAL SCIENCES↗

AOIPS data base management systems support for GARP data sets

A data base management system is identified, developed to provide flexible access to data sets produced by GARP during its data systems tests. The content and coverage of the data base are defined and a computer-aided, interactive information storage and retrieval system, implemented to facilitate access to user specified data subsets, is described. The computer programs developed to provide the capability were implemented on the highly interactive, minicomputer-based AOIPS and are referred to as the data retrieval system (DRS). Implemented as a user interactive but menu guided system, the DRS permits users to inventory the data tape library and create duplicate or subset data sets based on a user selected window defined by time and latitude/longitude boundaries. The DRS permits users to select, display, or produce formatted hard copy of individual data items contained within the data records.

Gary, J. P.↗

Systems aspects of COBE science data compression

A general approach to compression of diverse data from large scientific projects has been developed and this paper addresses the appropriate system and scientific constraints together with the algorithm development and test strategy. This framework has been implemented for the COsmic Background Explorer spacecraft (COBE) by retrofitting the existing VAS-based data management system with high-performance compression software permitting random access to the data. Algorithms which incorporate scientific knowledge and consume relatively few system resources are preferred over ad hoc methods. COBE exceeded its planned storage by a large and growing factor and the retrieval of data significantly affects the processing, delaying the availability of data for scientific usage and software test. Embedded compression software is planned to make the project tractable by reducing the data storage volume to an acceptable level during normal processing.

Freedman, I.↗

A browse facility for Earth science remote sensing data: Center director's discretionary fund final report

An image data visual browse facility is developed for a UNIX platform using the X Windows 11 system. It allows one to visually examine reduced resolution image data to determine which data are applicable for further research. Links with a relational data base manager then allow one to extract not only the full resolution image data, but any other ancillary data related to the case study. Various techniques are examined for compression of the image data in order to reduce data storage requirements and time necessary to transmit the data on the internet. Data used were from the WetNet project.

Meyer, P. J.↗

Proposed Space Flight Experiment Hardware

The primary thrust for this plan is to develop design tools and fundamental understanding that are timely and consistent with the goal of the various exploration initiatives. The plan will utilize ISS facilities, such as the Fluids Integrated Rack (FIR) and the Microgravity Science Glovebox (MSG). A preliminary flow schematic of Two-Phase Flow Facility (T(phi)FFy) which would utilize FIR is shown in Figure 3. MSG can be utilized to use the Boiling eXperiment Facility (BXF) and Contact Line Dynamics Experiment (CLiDE) Facility. The T(phi)FFy system would have multiple test sections whereby different configurations of heat exchangers could be used to study boiling and condensation phenomena. The test sections would be instrumented for pressure drop, void fraction, heat fluxes, temperatures, high-speed imaging and other diagnostics. Besides a high-speed data acquisition system with a large data storage capability, telemetry could be used to update control and test parameters and download limited amounts of data. In addition, there would be multiple accumulators that could be used to investigate system stability and fluid management issues. The system could accommodate adiabatic tests through either the space station nitrogen supply or have an experiment-specific compressor to pressurize a sufficient amount of air or other non-condensable gas for reuse as the supply bottle is depleted.

Source record↗

Comparative analysis of data base management systems

A study to determine if the Remote File Inquiry (RFI) system would handle the future requirements of the user community is discussed. RFI is a locally written and locally maintained on-line query/update package. The current and future on-line requirements of the user community were studied. Additional consideration was given to the types of data structuring the users required. The survey indicated the features of greatest benefit were: sort, subtotals, totals, record selection, storage of queries, global updating and the ability to page break. The major deficiencies were: one level of hierarchy, excessive response time, software unreliability, difficult to add, delete and modify records, complicated error messages and the lack of ability to perform interfield comparisons. Missing features users required were: formatted screens, interfield comparions, interfield arithmetic, multiple file access, security and data integrity. The survey team recommended Kennedy Space Center move forward to state-of-the-art software, a Data Base Management System which is thoroughly tested and easy to implement and use.

Smith, R.↗

Improved PV System Control Strategies to Reduce Power Management Costs in Nanogrids

An improved PV system control method is proposed to reduce nanogrid operation costs in this paper. A model including it various components such as photovoltaic (PV) systems, energy storage systems (ESSs), gateways, and household loads is considered with the constraints of the ESS, PV irradiance from real data, and household load. We designed an optimal economic dispatch strategy with an improved PV system control method. Combining the proposed optimal economic dispatch and PV system control strategies, it can improve the control performance for both transient and steady-state responses thereby enabling the maximum power to be extracted from the PV. Consequently, the PV power is maximized, which allows the ESS to use less power and sell the surplus to external power sources, which means the proposed method decreases the nanogrid operation costs. Furthermore, this performance is verified via nanogrid simulations and PV experimental kit.

PV system control↗

From Radtrack to eMWaste(r) G2 process-based integration

This paper provides a process-based examination of the integration of two separate but related software applications into Sandia National Laboratories’ (SNL’s) Radioactive and Mixed Waste Management Facility’s (RMWMF) data management system. First, data collection will be upgraded through the use of a new web-based Waste Description and Disposal Request (WDDR), which SNL personnel whose work creates radioactive and hazardous waste (generators) will use to characterize dozens of specific attributes of each waste parcel. Second, a commercial software package for data storage and manipulation — eMWaste® G2 by Attention IT — will replace two existing software applications and will track all radioactive and mixed waste at Sandia. Integrating these applications into a web-based system will give the RMWMF increased system flexibility, reduced reliance on key personnel, and improved document control, traceability and efficiency. To meet these goals and ensure the applications are developed in an efficient, quality-oriented environment, it is critical to first conduct a thorough evaluation of the affected processes. This paper will analyze the processes supported by the new applications and the requirements for a successful integration. A comprehensive analysis of both project flow and data management requirements, illustrated through original flow diagrams and other charts, will provide support to the development team and programmers as they work to integrate the applications into the new system.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An asynchronous traversal engine for graph-based rich metadata management

Rich metadata in high-performance computing (HPC) systems contains extended information about users, jobs, data files, and their relationships. Property graphs are a promising data model to represent heterogeneous rich metadata flexibly. Specifically, a property graph can use vertices to represent different entities and edges to record the relationships between vertices with unique annotations. The high-volume HPC use case, with millions of entities and relationships, naturally requires an out-of-core distributed property graph database, which must support live updates (to ingest production information in real time), low-latency point queries (for frequent metadata operations such as permission checking), and large-scale traversals (for provenance data mining). Among these needs, large-scale property graph traversals are particularly challenging for distributed graph storage systems. Most existing graph systems implement a "level synchronous" breadth-first search algorithm that relies on global synchronization in each traversal step. This performs well in many problem domains; but a rich metadata management system is characterized by imbalanced graphs, long traversal lengths, and concurrent workloads, each of which has the potential to introduce or exacerbate stragglers (i.e., abnormally slow steps or servers in a graph traversal) that lead to low overall throughput for synchronous traversal algorithms. Previous research indicated that the straggler problem can be mitigated by using asynchronous traversal algorithms, and many graph-processing frameworks have successfully demonstrated this approach. Such systems require the graph to be loaded into a separate batch-processing framework instead of being iteratively accessed, however. In this work, we investigate a general asynchronous graph traversal engine that can operate atop a rich metadata graph in its native format. We outline a traversal-aware query language and key optimizations (traversal-affiliate caching and execution merging) necessary for efficient performance. We further explore the effect of different graph partitioning strategies on the traversal performance for both synchronous and asynchronous traversal engines. Our experiments show that the asynchronous graph traversal engine is more efficient than its synchronous counterpart in the case of HPC rich metadata processing, where more servers are involved and larger traversals are needed. Furthermore, the asynchronous traversal engine is more adaptive to different graph partitioning strategies.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗