Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Data from: "A guide to using GitHub for developing and versioning data standards and reporting formats"

These data are the results of a systematic review that investigated how data standards and reporting formats are documented on the version control platform GitHub. Our systematic review identified 32 data standards in earth science, environmental science, and ecology that use GitHub for version control of data standard documents. In our analysis, we characterized the documents and content within each of the 32 GitHub repositories to identify common practices for groups that version control their documents on GitHub.In this data package, there are 8 CSV files that contain data that we characterized from each repository, according to the location within the repository. For example, in 'readme_pages.csv' we characterize the content that appears across the 32 GitHub repositories included in our systematic review. Each of the 8 CSV files has an associated data dictionary file (names appended with '_dd.csv' and here we describe each content category within CSV files.There is one file-level metadata file (flmd.csv) that provides a description of each file within the data package.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2023

Recent advances in integrated hydrologic models: Integration of new domains

Over the past several decades, hydrologic models have advanced from independent models of the surface and subsurface to integrated models that can capture the terrestrial hydrologic cycle within one framework. In recent years, these coupled frameworks have seen the inclusion of biogeochemical processes, ecohydrology, sedimentation and erosion, cold region hydrology, anthropogenic activities, and atmospheric processes. This expansion is the result of increased computational, data, and modeling capabilities and capacities, as well as improved understanding of the processes that drive these integrated systems. Here, in this study, we review these recent advances to integrate new processes and systems into existing terrestrial hydrologic models and highlight the significant challenges and opportunities that remain. We identify that with so many models currently available and in development, selecting the most appropriate model is difficult, and we suggest a path for new or novice modelers to find the most appropriate code based on their needs. In addition, data required to parameterize and calibrate these models can often constrain their applicability and usefulness. However, advances in environmental sensors and measurement technology, in addition to data assimilation of non-traditional data (e.g. remote sensing, qualitative data) are providing new ways of addressing this issue. As we expand hydrologic models to integrate more processes and systems, our computational demands also increase. Recent and emerging advances in computational platforms, including cloud and quantum computing, in addition to the use of machine learning to capture some processes, will continue to support the use of increasingly larger and more complex, process-based models. Finally, we highlight that it is critical to develop state-of-the-science models that are accessible to all model users, not just those applied for research and development. We encourage continued development of diverse modeling platforms, considering the user needs, data availability, and computational resources.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

National Geothermal Data System (NGDS) Geothermal Data: Community Requirements and Information Engineering

To satisfy the critical need for geothermal data to advance geothermal energy as a viable renewable energy contender, the U.S. Department of Energy is investing in the development of the National Geothermal Data System (NGDS). This paper outlines efforts among geothermal data providers nationwide to supply cutting edge geo-informatics. NGDS geothermal data acquisition, delivery, and methodology are discussed. In particular, this paper addresses the various types of data required to effectively assess geothermal energy potential and why simple links to existing data are insufficient. To create a platform for ready access by all geothermal stakeholders, the NGDS includes a work plan that addresses data assets and resources of interest to users, a survey of data providers, data content models, and how data will be exchanged and promoted, as well as lessons learned within the geothermal community.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

A semantics-driven framework to enable demand flexibility control applications in real buildings

Decarbonising and digitalising the energy sector requires scalable and interoperable Demand Flexibility (DF) applications. Semantic models are promising technologies for achieving these goals, but existing studies focused on DF applications exhibit limitations. These include dependence on bespoke ontologies, lack of computational methods to generate semantic models, ineffective temporal data management and absence of platforms that use these models to easily develop, configure and deploy controls in real buildings. This paper introduces a semantics-driven framework to enable DF control applications in real buildings. The framework supports the generation of semantic models that adhere to Brick and SAREF while using metadata from Building Information Models (BIM) and Building Automation Systems (BAS). The work also introduces a web platform that leverages these models and an actor and microservices architecture to streamline the development, configuration and deployment of DF controls. The paper demonstrates the framework through a case study, illustrating its ability to integrate diverse data sources, execute DF actuation in a real building, and promote modularity for easy reuse, extension, and customisation of applications. The paper also discusses the alignment between Brick and SAREF, the value of leveraging BIM data sources, and the framework's benefits over existing approaches, demonstrating a 75% reduction in effort for developing, configuring, and deploying building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics

Abstract Artificial intelligence (AI) promises to reshape scientific inquiry and enable breakthrough discoveries in areas such as energy storage, quantum computing, and biomedicine. Scanning transmission electron microscopy (STEM), a cornerstone of the study of chemical and materials systems, stands to benefit greatly from AI-driven automation. However, present barriers to low-level instrument control, as well as generalizable and interpretable feature detection, make truly automated microscopy impractical. Here, we discuss the design of a closed-loop instrument control platform guided by emerging sparse data analytics. We hypothesize that a centralized controller, informed by machine learning combining limited a priori knowledge and task-based discrimination, could drive on-the-fly experimental decision-making. This platform may unlock practical, automated analysis of a variety of material features, enabling new high-throughput and statistical studies.

47 OTHER INSTRUMENTATION↗
DOE OSTI2014

Web-based Visual Analytics for Extreme Scale Climate Science

In this paper, we introduce a Web-based visual analytics framework for democratizing advanced visualization and analysis capabilities pertinent to large-scale earth system simulations. We address significant limitations of present climate data analysis tools such as tightly coupled dependencies, ineffi- cient data movements, complex user interfaces, and static visualizations. Our Web-based visual analytics framework removes critical barriers to the widespread accessibility and adoption of advanced scientific techniques. Using distributed connections to back-end diagnostics, we minimize data movements and leverage HPC platforms. We also mitigate system dependency issues by employing a RESTful interface. Our framework embraces the visual analytics paradigm via new visual navigation techniques for hierarchical parameter spaces, multi-scale representations, and interactive spatio-temporal data mining methods that retain details. Although generalizable to other science domains, the current work focuses on improving exploratory analysis of large-scale Community Land Model (CLM) and Community Atmosphere Model (CAM) simulations.

climate science↗
DOE OSTI2024

Gulf of Mexico Turbulence Intensity Model Data in Observational Space

The dataset archives model-simulated turbulence intensity and meteorological profiles and timeseries at the Shell Exploration and Production Corporation's Tension Leg Platforms Ursa and Mars. The simulated data are interpolated in time and/or space according to observed quantities. The simulations were carried out for the Gulf of Mexico region using the revised Weather Research and Forecasting (WRF) model version 4.2 that incorporates the implementation of online turbulence intensity (TI) calculations (Tai et al. 2023). The simulated atmospheric profiles near the Shell Exploration and Production Corporation's Tension Leg Platforms Ursa and Mars are archived. Physics parameterizations chosen for the simulations include the Thompson microphysics parameterization, Mellor-Yamada-Nakanishi Niino (MYNN) boundary layer parameterization, Mellor-Yamada-Janjic surface layer parameterization, Unified Noah land-surface parameterization, and the RRTMG longwave and shortwave radiation parameterization. Initial and boundary conditions are taken from NOAA’s High-Resolution Rapid Refresh (HRRR) product. The JPL 0.01-degree Level 4 Multiscale Ultrahigh Resolution (MUR) Global Foundation Sea Surface Temperature (SST) Analysis (V4.1) data are used as the model’s SST forcing.

17 WIND ENERGY↗
DOE OSTI2023

Control systems and data management for high-power laser facilities

The next generation of high-power lasers enables repetition of experiments at orders of magnitude higher frequency than what was possible using the prior generation. Facilities requiring human intervention between laser repetitions need to adapt in order to keep pace with the new laser technology. A distributed networked control system can enable laboratory-wide automation and feedback control loops. These higher-repetition-rate experiments will create enormous quantities of data. A consistent approach to managing data can increase data accessibility, reduce repetitive data-software development and mitigate poorly organized metadata. An opportunity arises to share knowledge of improvements to control and data infrastructure currently being undertaken. We compare platforms and approaches to state-of-the-art control systems and data management at high-power laser facilities, and we illustrate these topics with case studies from our community

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Oak Ridge National Laboratory EAGLE-I TM : Modeling Electric Utility County Customers for Situational Awareness

During natural hazard events (hurricanes, wildfires, earthquakes, etc.) and recent man-made events (e.g., cyber attacks), the exchange of near real-time, spatially refined data within the response community is critical. The EAGLE-I$^{TM}$ platform is one tool that facilitates this data for decision makers within the energy sector. While much information can be collected and integrated into the system directly, other pertinent data must be augmented by other derived data products to enhance the information and allow for a consistent evaluation of on-the-ground conditions. One such data set that requires the addition of other derived data is the electric utility customer outage data that is aggregated to the county level within the EAGLE-I application. Without a county customer data set, outages can only be compared on total counts, which gives greater importance to higher population outages. Including an electric utility customer data set at the county level allows for these outage counts to be converted to percent outages and brings a consistent classification of outages and equal importance to all outages. To achieve this, several available data sets were combined and spatial disaggregation techniques were employed to model customer estimates at the county scale. This paper presents the approach to produce this data for the United States and lessons learned from working with these disparate data sets. Data validation is provided, where possible, and limitations of the model and possible improvements are discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first data from the National Science Foundation–Department of Energy Vera C. Rubin Observatory, comprising raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and ancillary data products. DP1 is based on 1792 optical–near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera (LSSTComCam) on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile in late 2024. DP1 covers ∼15 deg 2 distributed across seven roughly equal-sized noncontiguous fields, each independently observed in six broad photometric bands, ugrizy. The median FWHM of the point-spread function across all bands is approximately 1"14, with the sharpest images reaching about 0." 58. The 5σ point-source depths for coadded images in the deepest field, the Extended Chandra Deep Field South, are u = 24.55, g = 26.18, r = 25.96, i = 25.71, z = 25.07, and y = 23.1. Other fields are no more than 2.2 mag shallower in any band, where they have nonzero coverage. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band in coadds, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and is available to Vera C. Rubin Observatory data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations ahead of full operations in 2026.

Ground-based astronomy↗
DOE OSTI2025

RTN-095: The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first release of data from the NSF-DOE Vera C. Rubin Observatory, consisting of raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and other derived data products. DP1 is based on 1792 science-grade optical/near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera, LSSTComCam, on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile during the first on-sky commissioning campaign in late 2024. DP1 covers a total of ~15 sq. deg. over seven roughly equally-sized non-contiguous fields, each independently observed in six broad photometric bands, ugrizy, spanning a range of stellar densities and latitudes and overlapping with external reference datasets. The median image quality across all bands, measured by the FWHM of the point-spread function, is approximately 1.13 arcseconds, with the sharpest images reaching about 0.65 arcseconds. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and available to Rubin data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations across all four LSST themes, providing a valuable opportunity to engage with Rubin data ahead of the start of full operations in late 2025.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

National Ignition Facility Opacity Time Resolved Spectrometer Systems Engineering Final Project

The National Ignition Facility (NIF) is the world’s largest and most energetic laser facility. The NIF system is designed to produce high energy density (temperature and pressure) conditions through the application of its 192 laser beams. One of the users of NIF is the opacity platform developed to study the opacities at temperatures and densities relevant to the solar interior and stellar evolution. The platform was developed to study iron (Fe) opacity at temperatures relevant to the solar interior. The opacity campaign uses spectrometers to gather data. Spectrometers utilize crystals to produce x-ray spectra that are recorded on time-integrated and time-resolved detectors. The opacity spectrometer (OpSpec) currently fielded and in use at NIF uses a time integrated film channel to collect data. The opacity spectrometer time resolved (OpSpecTR) will utilize novel hCMOS detectors to capture time resolved images of spectra of interest. The key stakeholders identified for OpSpecTR included the physicists responsible for OpSpec and OpSpecTR, the Target Area Science and Engineering (TASE) department at NIF, the NIF and Photon Science (NIF & PS) Opacity program, the Nevada National Security Site (NNSS) Physics and Engineering program, the Sandia hCMOS manufacturing and testing program, and the Los Alamos National Laboratory (LANL) program sponsor. The Target and Experimental Operations (TEXOPS) was identified as a key stakeholder because the group includes the individuals that will physically interact with the OpSpecTR system as it participates in NIF experiments. The opacity platform collects data in a unique orientation relative to the existing diagnostics fielded at NIF. The existing infrastructure at NIF uses a diagnostic manipulator (DIM) to insert the diagnostic near the target chamber center to collect data during a NIF shot. Existing diagnostics collect data through the center line of the DIM axis and collect relevant data perpendicular to this axis. The opacity platform requires crystals mounted in a specific orientation which requires data collection parallel to the DIM axis. This deviation from standard NIF practices was a key factor in developing requirements.

42 ENGINEERING↗
DOE OSTI2016

Next Day Building Load Predictions based on Limited Input Features Using an On-Line Laterally Primed Adaptive Resonance Theory Artificial Neural Network.

Optimal integration of thermal energy storage within commercial building applications requires accurate load predictions. Several methods exist that provide an estimate of a buildings future needs. Methods include component-based models and data-driven algorithms. This work implemented a previously untested algorithm for this application that is called a Laterally Primed Adaptive Resonance Theory (LAPART) artificial neural network (ANN). The LAPART algorithm provided accurate results over a two month period where minimal historical data and a small amount of input types were available. These results are significant, because common practice has often overlooked the implementation of an ANN. ANN have often been perceived to be too complex and require large amounts of data to provide accurate results. The LAPART neural network was implemented in an on-line learning manner. On-line learning refers to the continuous updating of training data as time occurs. For this experiment, training began with a singe day and grew to two months of data. This approach provides a platform for immediate implementation that requires minimal time and effort. The results from the LAPART algorithm were compared with statistical regression and a component-based model. The comparison was based on the predictions linear relationship with the measured data, mean squared error, mean bias error, and cost savings achieved by the respective prediction techniques. The results show that the LAPART algorithm provided a reliable and cost effective means to predict the building load for the next day.

25 ENERGY STORAGE↗
DOE OSTI2020

Database Management Module Framework for Dynamic Contingency Analysis and Visualization

The Dynamic Contingency Analysis Tool (DCAT) is being developed to mimic the response of generation dynamics, protection, and load components to extreme contingencies in power systems. Currently, DCAT generates a huge data set, with the analysis results stored in multiple subfolders using a great many files in different formats (power flow cases, time series, figures, spreadsheets). To help power system engineers thoroughly understand and analyze system behavior under many scenarios and contingencies, we developed a database management module (DBM) that enables future integration of DCAT with industry-grade Big Data analytical and interactive visualization platforms. In this paper, we demonstrate the DBM framework with interactive analytics and visualization for DCAT on the synthetic South Carolina 500-bus power system model using hurricane contingencies that capture possibilities for an extreme contingency. DCAT’s advanced data management and interactive visualization can help planning engineers to visually explore and analyze system behavior, all in one view.

Cascading, dynamic simulations, database managemen↗
DOE OSTI2013

NATIONAL GEOTHERMAL DATA SYSTEM (NGDS) GEOTHERMAL DATA DOMAIN: ASSESSMENT OF GEOTHERMAL COMMUNITY DATA NEEDS

To satisfy the critical need for geothermal data to ad- vance geothermal energy as a viable renewable ener- gy contender, the U.S. Department of Energy is in- vesting in the development of the National Geother- mal Data System (NGDS). This paper outlines efforts among geothermal data providers nationwide to sup- ply cutting edge geo-informatics. NGDS geothermal data acquisition, delivery, and methodology are dis- cussed. In particular, this paper addresses the various types of data required to effectively assess geother- mal energy potential and why simple links to existing data are insufficient. To create a platform for ready access by all geothermal stakeholders, the NGDS in- cludes a work plan that addresses data assets and re- sources of interest to users, a survey of data provid- ers, data content models, and how data will be ex- changed and promoted, as well as lessons learned within the geothermal community.

15 GEOTHERMAL ENERGY↗