Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Management Platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

PlanetSense: A Real-time Streaming and Spatio-temporal Analytics Platform for Gathering Geo-spatial Intelligence from Open Source Data

Geospatial intelligence has traditionally relied on the use of archived and unvarying data for planning and exploration purposes. In consequence, the tools and methods that are architected to provide insight and generate projections only rely on such datasets. Albeit, if this approach has proven effective in several cases, such as land use identification and route mapping, it has severely restricted the ability of researchers to inculcate current information in their work. This approach is inadequate in scenarios requiring real-time information to act and to adjust in ever changing dynamic environments, such as evacuation and rescue missions. In this work, we propose PlanetSense, a platform for geospatial intelligence that is built to harness the existing power of archived data and add to that, the dynamics of real-time streams, seamlessly integrated with sophisticated data mining algorithms and analytics tools for generating operational intelligence on the fly. The platform has four main components – i) GeoData Cloud – a data architecture for storing and managing disparate datasets; ii) Mechanism to harvest real-time streaming data; iii) Data analytics framework; iv) Presentation and visualization through web interface and RESTful services. Using two case studies, we underpin the necessity of our platform in modeling ambient population and building occupancy at scale.

big data architecture↗

A Data Science and Machine Learning Platform Supporting Large Particle Accelerator Control and Diagnostics Applications Final Report: SBIR Initial Phase II DE-SC0022583

The Machine Learning Data Platform (MLDP) is a product providing full-stack support for data science, Machine Learning, and Artificial Intelligence (ML/AI) applications at particle accelerator and large experimental physics facilities. It supports ML/AI applications from front-end, high-speed acquisition of heterogeneous, time-series data, through data archiving and management, to back-end analysis. The MLDP embodies a “data-science ready” platform for data analysis and ML/AI applications in diagnosis, modelling, control, and optimization of these facilities. It provides data scientists and applications a consistent, datacentric interface to archive data standardizing implementation and deployment of ML/AI algorithms to different operations configurations within the same facility, or between facilities. Being an open-source, public-domain project, the MLDP is intended for broadest possible impact by increasing accessibility and minimizing the required expertise for installation and operation. The MLDP can also be deployed at user facilities for experimental data collection, archiving, and analysis. It is capable of acquisition and archiving of heterogeneous data from experimental equipment (e.g., images, arrays, structures, etc.) along with system hardware configurations (e.g., scalars, tables), control system process variables, and any metadata required for provenance. Thus, the MLDP can manage experimental data through its entire lifecycle, from acquisition and archiving, through analysis and investigation, to release and final publication.

43 PARTICLE ACCELERATORS↗

Data Fusion With Uncertainty Quantification for Sub-City-Scale Air Quality Assessment and Forecasting

Many information sources can support air quality assessment and forecasting, including atmospheric chemistry model outputs, satellite retrievals of column chemical and aerosol constituents, and surface-based air quality monitoring data from both regulatory and low-cost instruments. Systematic integration of these data sources provides a major opportunity to improve understanding and management of air quality, but also presents technical barriers, especially in resource- and data-constrained settings in the Global South. This presentation describes a data fusion system, currently under development using the Google Earth Engine platform, which aims to integrate the information sources listed above to support comprehensive sub-city-scale assessment and management of air quality. Furthermore, the data fusion framework includes provisions for the quantification of uncertainties in the resulting fused estimates based on the variability of and among the input data sources. These capabilities will allow air quality managers to better understand their local air quality situation, including relative confidence in the fused estimates for different constituents, locations, and times, leading to better informed air quality management decisions. This presentation covers the underlying methodology of the data fusion and uncertainty quantification approaches, provides an update on the status of its implementation, and presents early qualitative and quantitative results.

Carl Malings↗

A path to intelligent watersheds: coordinating the data to decision pipeline

Operations of multi-reservoir systems are challenged in-part by the interplay of complex physical processes functioning within the watershed. The employment of intelligent systems can be of aid by linking environmental sensing, information technology, data analytics, simulation and decision support to achieve a data-to-decision flow of information. A further challenge is that watershed resources are managed for multiple purposes requiring some level of coordination among numerous resource managers, asset operators and users. System intelligence in this context relies on shared community platforms (data portals, community models), and coordinated communication between decision makers. Opportunities to enrich watershed intelligence has been the subject of a roadmapping exercise for the Department of Energy’s Water Power Technologies Office which has relied on broad stakeholder engagement. Initial phases of engagement involved personal interviews and a series of virtual group meetings, which focused on identifying opportunities to improve the intelligence of the physical infrastructure within our watersheds—examples of feedback include improved sensing of snowpack and runoff, data standards for facilitated data sharing, and better forecasting tools. The latter phase of engagement involved the conduct of a case study in the Upper Colorado River basin where key stakeholders were interviewed to map how their decisions are informed by intelligence from other basin stakeholders. Our presentation will highlight the interdisciplinary flow of information in complex watershed systems and identify physical and institutional opportunities toward the strategic operation of water infrastructure.

Colorado River↗

SERVIR-Africa: Developing an Integrated Platform for Floods Disaster Management in Africa

SERVIR-Africa is an ambitious regional visualization and monitoring system that integrates remotely sensed data with predictive models and field-based data to monitor ecological processes and respond to natural disasters. It aims addressing societal benefits including floods and turning data into actionable information for decision-makers. Floods are exogenous disasters that affect many parts of Africa, probably second only to drought in terms of social-economic losses. This paper looks at SERVIR-Africa's approach to floods disaster management through establishment of an integrated platform, floods prediction models, post-event flood mapping and monitoring as well as flood maps dissemination in support of flood disaster management.

Macharia, Daniel↗

Science and Engineering Team Repository Selection and Validation

The National Nuclear Security Administration’s Office of Nuclear Smuggling Detection and Deterrence (NSDD), Science and Engineering Team (SET) has engaged Brookhaven National Laboratory (BNL) in the selection, development and management of a knowledge management platform. This platform will serve as a repository for programmatic documents, data, and other relevant files. In support of this effort, BNL implemented a sixteen-month process to ensure the selection of the most relevant and user-friendly repository from among several commercially available and open source options.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Topical Report on Water Balance Model Development and Initial Application

This topical report summarizes results from developing a generic dynamic water balance tool which can be used by coal-fired power plant operators to evaluate FGD water management strategies. EPRI is using a statistical software model created on the GoldSim platform and data from coal-fired energy plants to determine the fraction of power plant water needs that can be satisfied by electrodialysis reversal treatment and, correspondingly, the discharge volume and/or byproducts that still need to be managed. The generic model is designed to accept a number of easily obtainable process variables and generate probabilities of resultant water characteristics. The model is also constructed as a universal process flow; one that can be adjusted to accommodate most major components of an FGD blowdown handling system. The generic model is dynamic and utilizes user-inputted operational variation in water quality and quantity to best provide a probabilistic representation of potential performance outcomes. In order to account for complexities of water composition and treatment, a separate chemical modeling software is used to evaluate water chemistry and unit operation performance. The thermodynamic modeling software, OLI Studio, is employed to convert ion data from laboratory analyses into balanced molecular concentrations that are classified as dissolved and suspended solids. The dynamic water model is designed to import a total of 11 species commonly found in FGD blowdown water as molecular concentrations.Water management unit operations are used in the model and categorized by either physical unit operation blocks or chemical unit operations blocks. As the name implies, the physical water treatment blocks are unit operations that are exclusively physical changes to the system (e.g., separations and volume changes). The chemical water treatment blocks are unit operations where chemical changes occur and require the use of OLI Studio to characterize subsequent streams. Water and material balances from three unique coal-fired power plants were obtained and preliminary modeling on the dynamic water balance tool was performed using the extracted data from these power plants. These three power plants were chosen due to their unique configurations and water profiles that represented a variety of operational changes. Results from using the dynamic tool with the three plant configurations are presented and discussed in the context of the existing tool and planned future capabilities.

01 COAL, LIGNITE, AND PEAT↗

Topical Report on Water Balance Model Development and Initial Application

This topical report summarizes results from developing a generic dynamic water balance tool which can be used by coal-fired power plant operators to evaluate FGD water management strategies. EPRI is using a statistical software model created on the GoldSim platform and data from coal-fired energy plants to determine the fraction of power plant water needs that can be satisfied by advanced treatment technologies and, correspondingly, the discharge volume and/or byproducts that still need to be managed. The initial evaluations presented in this report represent generic scenarios, while the final evaluations will incorporate results from advanced treatment and encapsulation studies conducted during later stages of the project.

01 COAL, LIGNITE, AND PEAT↗

Opportunities for an Integrated Web-Based Workbench for Data Access and Analysis - 20244

Management of environmental issues can require integration of multiple types of data and information, conducting data analysis and interpretation, and providing data visualization for effective communications. These data elements are important for site management to support regulator interactions and provide defensibility for remedial decisions. Databases and information repositories are core elements of managing data; however, efficient data access and analysis also enable effective site management. The U.S. Department of Energy (DOE) Hanford Site is an example of a complex site with a voluminous quantity of environmental data and a need for efficient site management. Different tiers of data and information tools have been developed and deployed to address site needs. These tools are configured for ready access via the web site interfaces and meet the rigorous quality requirements for environmental site management. Evolving efforts are focused on an integrated platform to meet site environmental management needs. In this platform, users can access site information at multiple levels of detail based on their need and permissions, so that data and associated analyses are presented within the context of the site mission and the user's management or technical needs. This concept is not only applicable at individual sites like Hanford but also applicable at other sites within the DOE complex. An integrated web-based architecture that links data visualization, data analytics, and management tools can provide holistic access to large data sets, minimize complexity, and maximize interactivity and technical communication. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An Integrated Platform for Mission Performance: Goddard Space Flight Center's Meta Information System

Successful management of NASA Goddard Space Flight Centers portfolio of mission projects (i.e. spacecraft, spacecraft instruments / subsystems, and ground systems) depends upon numerous processes, data and information resources coming together throughout the life-cycle of the projects to enable sound decision-making, risk reduction, conformance with requirements and continual improvement. In the summer of 2012, GSFC SMA management recognized that the set of legacy data systems used to support the SMA mission and responsibilities at GSFC were not effective, integrated nor on par with best practices. Accordingly, GSFC SMA management launched a project to transform the GSFC electronic management system to create and deploy an integrated, state-of-the-market information system for process performance, data management and analytics that is currently operating in support of GSFC overall mission performance. The information system, known as Meta, provides controlled, process-based applications, integrated data management, and analytics for a robust set of integrated applications. Since the inception of the project, a lean, award-winning SMA project team has thus far designed, configured and managed the system to serve as an integrated platform for 18 applications that support key processes for GSFC and the Science Mission Directorate at NASA headquarters, such as internal Management System assessments, Supplier Assessments, Supplier Research & Analysis, Problem Reporting for in-house mission projects, On-orbit Anomaly Reporting for GSFC-operated spacecraft, GSFC Project Life-Cycle Reviews, Risk Management and Reporting, and SMA Project Team Reporting. The system has experienced steady growth in utilization with 1,917 users (NASA employees and support contractor personnel) and 44 gigabytes of data and related files managed by the system as of the end of April 2018. Overall, Meta has achieved increasing levels of process management and real-time data / information integration to enable improved process performance, richer analytics and informed decision-making. This paper will present and examine the need, goals, approach and design driving the management and operation of the Meta information system and its ongoing growth as an integrated platform for advancing NASA mission performance.

Integration↗

Big Data Analytics for Long-Term Meteorological Observations at Hanford Site

A growing number of physical objects with embedded sensors with typically high volume and frequently updated data sets has accentuated the need to develop methodologies to extract useful information from big data for supporting decision making. This study applies a suite of data analytics and core principles of data science to characterize near real-time meteorological data with a focus on extreme weather events. To highlight the applicability of this work and make it more accessible from a risk management perspective, a foundation for a software platform with an intuitive Graphical User Interface (GUI) was developed to access and analyze data from a decommissioned nuclear production complex operated by the U.S. Department of Energy (DOE, Richland, USA). Exploratory data analysis (EDA), involving classical non-parametric statistics, and machine learning (ML) techniques, were used to develop statistical summaries and learn characteristic features of key weather patterns and signatures. The new approach and GUI provide key insights into using big data and ML to assist site operation related to safety management strategies for extreme weather events. Specifically, this work offers a practical guide to analyzing long-term meteorological data and highlights the integration of ML and classical statistics to applied risk and decision science.

54 ENVIRONMENTAL SCIENCES↗

Use of ERTS-1 DCS in the management and control of water resources systems

The ERTS-1 experimental hydrologic Data Collection Platform System that has been established at the New England Division (NED), the reasons for getting involved with the experiment, some of the initial problems associated with the data collection hardware, and a preliminary conclusion based on operating experiences are reviewed. The New England Region includes the states of Maine, New Hampshire, Vermont, Massachusetts, Rhode Island and Connecticut. The entire area consists of approximately 97,000 sq. km. (60,000 square miles), half of which is in the state of Maine. The limits of the NED are all of Maine, New Hampshire and Vermont to the western limits of the Connecticut River basin, Massachusetts, Connecticut to the western edge of the Housatonic River basin and Rhode Island. All reservoirs have flood control as a primary purpose. Other uses include water supply, recreation and low flow augmentation. However, none of the reservoirs are presently operated for hydroelectric power, navigation, or irrigation purposes. Basically then, flood control regulation is NED's primary concern.

Finegan, J. W., Jr.↗

Berkeley Nuclear Data Cloud (BDC) v2.3

The software was developed to serve and curate arbitrarily large datasets comprising data acquired from various mobile platforms. The software is contained in a number of server and client libraries. The former manage the ingestion, indexing, querying, and serving of the data. The latter libraries are distributed for Linux, Mac OSX, and Windows and enable users to interact with data downloaded from the service either in the form of an HDF5 file or streamed in a BSON data chunk. Using the Berkeley Data Cloud, researchers from varying fields can collaborate, compare results and curate both their raw data and the derived products of their analysis.

Cholia, Shreyas↗

Jemez Pueblo Agriculture: Monitoring Rangeland Conditions to Inform Drought and Land Management in New Mexico

The Jemez Pueblo, a community located in the semi-arid high desert region of northcentral New Mexico, faces challenges with drought mitigation and livestock management. NASA DEVELOP partnered with the Pueblo of Jemez Natural Resources Department and The Nature Conservancy to provide recent and historical rangeland conditions to aid present decision-making, which relies on cultural practices, site familiarity, available resources, and physical data. This partnership offers the opportunity to support management practices by leveraging remote sensing and virtual fencing technologies. Our project explored Rangeland Analysis Platform (RAP) products incorporating NASA Earth observation Landsat 5 TM, Landsat 7 ETM+, Landsat 8 OLI, and Landsat 9 OLI-2 remote-sensed imagery as an agricultural land management tool. We performed linear regression analysis to evaluate RAP data to field data and explored RAP annual herbaceous biomass, ground cover trends, and climatic factors at the pasture level. We then computed study area summary statistics, performed pixel-by-pixel trend analysis across the study period, and evaluated ground cover trends near water sources. Based on available data, RAP was poorly correlated to bare ground and herbaceous biomass, generally underestimating the former and overestimating the latter. To improve the evaluation of RAP products, we suggest increasing the spatiotemporal distribution of the field dataset. According to RAP, from 1986 to 2023, the site became hotter and drier, bare ground increased, and annual forbs and grasses increased while perennials decreased. RAP products did not agree with field-collected data; however, the trends over time may be useful for informing rangeland management actions.

cattle grazing management↗

Distributed Lunar Data Platform with Advanced Machine Learning Capabilities in Support of Lunar Science and Exploration

The United States 2020 Space Policy directive declares that NASA, in cooperation with private industry, will “extend human economic activity into deep space by establishing a permanent human presence on the Moon”. This goal will require advanced data management, as well as analysis, modeling and representation of lunar information in order to prepare for Artemis human missions, lunar science investigations and exploration. To meet this requirement, we conceptualize and present an implementation strategy for a distributed platform for lunar data retrieval, inferencing and analysis, which will be based on federated learning and the NASA Celestial Mapping System (CMS). In addition to demonstrating the imperative of enabling lunar-borne data to remain in-situ but still accessible, this presentation will also include examples of how third parties could contribute both datasets and new functionality into this platform using an AI-based data import pipeline and a plug-in architecture respectively.

Artificial Intelligence↗

Modular Subsurface Sensors and Integrated Software for Advanced Subsurface Characterization and Monitoring using Unoccupied Vehicles

The advent and subsequent proliferation of autonomous airborne, waterborne, and groundbased vehicles (i.e., “drones”) promises to broadly transform the geosciences and associated industries, including fossil energy exploration and development, mineral resource exploration and development, water-resource management, and environmental remediation. For geophysical characterization and monitoring, the prospect of programming highly repeatable and low-cost drone missions for subsurface imaging will allow for deployments in hazardous and previously inaccessible areas. Coupled with autonomous workflows for data processing, management, and visualization, drone-based geophysical characterization and monitoring will enable unprecedented, real-time insight into diverse subsurface properties and processes of scientific and engineering importance. Toward this end, the objectives of this Lab Directed Research and Development (LDRD) project were to develop new (1) instrumentation for dronebased electromagnetic induction (EMI) geophysical imaging, including separated transmitter and receivers and associated electronics, (2) software for real-time data telemetry, processing, management, and visualization. Although EMI has been previously deployed using unoccupied aerial systems (UASs), these applications failed to capitalize on the game-changing capabilities of drone platforms. Whereas drone-based data acquisition allows for collection of rich, three-dimensional (3D) multi-offset/multi-angle configurations between transmitters and receivers, past efforts have relied on conventional instrumentation that was designed for ground-based data collection with the transmitter and a single receiver housed in the same unit; nor did these previous applications demonstrate real-time delivery of results to support rapid management decisions in the field. In this 1-year project, we (1) designed and constructed new lightweight independent transmitter and receiver antenna platforms that communicate with a laptop computer; (2) developed software to control data acquisition, manage/transfer data, and visualize data as its collected; and (3) demonstrated the operation of the new hardware and software systems in a ground-based field test. Our work entails major technological advances for EMI and established a foundation on which to build a new drone-based, real-time geophysical EMI imaging capability to support diverse challenges facing the nation.

47 OTHER INSTRUMENTATION↗

Field Validation of a Grid-Interactive Efficient Building Software Solution

The U.S. General Services Administration's (GSA's) Green Proving Ground (GPG) program, in partnership with the National Laboratory of the Rockies (NLR), completed a field study of a Grid-Interactive Efficient Buildings (GEB) software solution. The study focused on a single testbed facility to test the GEB functionality of the software solution, along with other features. The testbed facility - a courthouse - is a common building type in GSA's vast building portfolio, offering potentially impactful findings on a scalable level. The study evaluated Prescriptive Data's technology, Nantum OS, a connected building operating system ("GEB Solution") which aggregates multiple sources of previously siloed building data and combines that data with external sources, such as weather information or utility signals, into a single integrated platform. A GEB Solution is a type of Energy Management Information System (EMIS). EMIS is defined as a system of devices, data services, and software applications that communicates with any building system or third-party data source to aggregate and transform data into new capabilities to aid in the optimization of energy use at the building, campus, or agency level. This specific GEB Solution is an EMIS with ASO, automated system optimization, offering supervisory control of certain aspects of the Building Automation System (BAS). Multiple features were evaluated including, but not limited to, Continuous Demand Management to avoid setting new monthly kilowatt (kW) peaks, energy efficiency for reduction of kilowatt hours (kWh) and natural gas consumption, and automated demand response (ADR) for purposes of lowering demand during a utility called Demand Response (DR) event. The testbed facility was the Foley Federal Building and US Courthouse ("Foley Federal Building") located in Las Vegas, NV. This is a 209,496 sq. ft. building constructed in the 1960s with major renovations in 2004. The facility was a good candidate due to the large prevalence of office and courthouse spaces in the GSA portfolio of buildings. It also has many features which allow integration into and control of the building and a strong facilities team to assist with the study. Quantitative and qualitative performance objectives were developed using GSA's GPG GEB project template along with input from the vendor and building facility staff; these are outlined in Table 1. The quantitative performance objectives focused on continuous demand management, energy efficiency, and automated demand response. The qualitative performance objectives focused on the ease of installation and commissioning as well as the operability of the GEB solution. Other performance metrics that are reported on include carbon reduction, cost effectiveness, and occupant acceptance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A digital twin platform for building performance monitoring and optimization: Performance simulation and case studies

Advancements in sensor technology, data analytics, affordable compute, and communication infrastructure have paved the way for Digital Twin technology in optimizing building operations and controls. This study presents the development of an open and interoperable web-based Digital Twin platform for integrating diverse data streams and facilitating effective user interactions. The platform utilizes modern technologies for the web framework and time-series data management, ensuring scalability and responsiveness. The backend supports seamless integration of diverse data sources and emulators, incorporating data from building sensors and meters, external weather Application Programming Interfaces, and advanced EnergyPlus simulation models of the building and its energy systems including the Distributed Energy Resources that are formulated in Functional Mockup Units. A simulation case study was conducted with FlexLab, a test facility on Lawrence Berkeley National Laboratory campus. The case study includes normal operations, Distributed Energy Resource integration, and power outage scenarios, to illustrate the Digital Twin’s ability to provide critical insights into energy performance and thermal resilience. The results demonstrated the platform’s potential as a decision-support tool for optimizing building energy performance and enhancing resilience against extreme weather events. Future work will focus on deploying the Digital Twin platform to a real building for field validation, extending its capabilities to cover more scenarios such as bidirectional Electric Vehicle interactions, and enhancing user engagement.

EnergyPlus↗