Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2013

End-to-End Data Movement Using MPI-IO Over Routed Terabots Infrastructures

Scientific discovery is nowadays driven by large-scale simulations running on massively parallel high-performance computing (HPC) systems. These applications each generate a large amount of data, which then needs to be post-processed for example for data mining or visualization. Unfortunately, the computing platform used for post processing might be different from the one on which the data is initially generated, introducing the challenge of moving large amount of data between computing platforms. This is especially challenging when these two platforms are geographically separated since the data needs to be moved between computing facilities. This is even more critical when scientists tightly couple their domain specific applications with a post processing application. The paper presents a solution for the data transfer between MPI applications using a dedicated wide area network (WAN) terabit infrastructure. The proposed solution is based on parallel access to data files and the Message Passing Interface (MPI) over the Common Communication Infrastructure (CCI) for the data transfer over a routed infrastructure. In the context of this research, the Energy Sciences Network (ESnet) of the U.S. Department of Energy (DOE) is targeted for the transfer of data between DOE national laboratories.

Vallee, Geoffroy R↗
DOE OSTI2023

Pillars of Cloud-Based Earth Observation Science Education

Earth observation (EO) is undergoing a paradigm shift with the development of cloud-based analytical platforms supporting EO data collection and access, parallel processing, easier communication of results, and expanded accessibility. As the global community of users and the diversity of applications grow, there is a clear need for expanded educational capacity to leverage these developments and increase the impact of EO research and teaching. Drawing upon extensive conversations between educators, practitioners, and researchers, we propose three pillars that must be prioritized to prepare students, researchers, and professionals to take full advantage of the cloud-based EO paradigm and guide future growth.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Effects of EMF Emissions from Cables and Junction Boxes on Marine Species

Studies have shown that diverse aquatic species are electrosensitive. Many fishes, and marine mammals, can either detect, navigate by, or are affected by electromagnetic fields (EMF) with various sensitivities, and their behavior may be impacted by unnatural EMF emissions in the water column. Sharks, rays and skates are known to have the highest sensitivity to electric fields. Electric field emissions in the range 0.5–100 micro volt/m appear to attract them, and emissions over 100 micro volt/m to repulse them. A marine hydrokinetic MHK device will have multiple components and associated multiple submarine cables on the seafloor and running through the water column and would potentially increase the level of EMF emissions to which the marine species at the site may be exposed to. There are therefore concerns amongst stakeholders that EMF emissions associated with MHK devices and their components may act as barriers to species migration, cause disorientation, change community compositions and ecosystems, and that they may attract sharks, leading to a local increase in the risk of shark attacks. However, field data to validate and model potential relationships between observed responses and the EMF emissions in situ are sparse. A program of experimental field surveys were conducted off the coast of South Florida, USA to characterize the electromagnetic field (EMF) emissions in the water column from a submarine cable, and to monitor for responses of local aquatic species. The field surveys were conducted at the South Florida Ocean Measurement Facility (SFOMF) off Fort Lauderdale, which is a cabled offshore in-water navy range. It consists of multiple active submarine power cables and a number of junction boxes, with the capability to transmit AC/DC power at a range of strength and frequencies. The site includes significant marine life activities and community structure, including highly mobile species, such as sharks, stingrays, mammals and turtles. SFOMF therefore typifies a setting representative of an offshore location where a MHK device may be sited. Background electromagnetic field (EMF) levels and EMF emissions due to submarine cables were measured using a custom E-field sensor and a commercial magnetometer deployed from an autonomous underwater vehicle (AUV) at various fixed altitudes above the seafloor. EMF signatures detected from power cables and junction boxes are contrasted against ambient background levels and other EMF sources. The potential responses of local marine species were observed at selected representative locations using divers on SCUBA, complemented with fixed cameras on the sea bottom and by a set of video cameras mounted on the AUV. The objectives of the study were: 1) to characterize the EMF emission levels associated with submarine cables 2) to monitor potential responses of aquatic animals to the emissions and 3) to develop an associated database of field observations. As control, observations of EMF levels and in situ marine species were conducted with power in the cable turned off. Good quality measurements of EMF emissions were obtained using the mobile AUV platform and the data from the surveys were used to develop contour maps of the EMF levels in the water column above the live cable as well as to provide information about how the field decays away from the cable. The measurements show good agreement with theoretical models of the how EMF levels decay away from the cable in deep and shallow water environment. Electric fields in excess of 200µV/m were measured in the vicinity of the cable during the power on state. Quarterly surveys by SCUBA divers were conducted, using point and transect count methods, over a period of one year at three locations, one at a shallow site where the water depth is approximately 5m, and the other at the Barracuda Reef where the water depth is approximately 10m. The sampling results were analyzed to determine if the presence of an SFOMF generated EMF alters: (1) abundance, species richness, and assemblage structure of coral reef fishes, (2) the behavior of fishes including elasmobranchs, and (3) the distribution of marine turtles and mammals. Diver observations were also used in attempt to discern if there were any noticeable organismal responses during the transitional period between ambient OFF to energized AC or DC power states, and video footage was intended to augment the in-situ visual survey data and aid in interpretation of the results. Comparisons are provided between observation datasets between the three sites and between the point and transect count methods. Presence of several individual elasmobranch species, including sharks and stingrays, were recorded during the surveys. No apparent effect on richness could be discerned between the power on and off states. No apparent sudden animal movements were observed during transitions between power states.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

The IsoGenie database: an interdisciplinary data management solution for ecosystems biology and environmental research

Modern microbial and ecosystem sciences require diverse interdisciplinary teams that are often challenged in “speaking” to one another due to different languages and data product types. Here we introduce the IsoGenie Database, a de novo developed data management and exploration platform, as a solution to this challenge of accurately representing and integrating heterogenous environmental and microbial data across ecosystem scales. The IsoGenieDB is a public and private data infrastructure designed to store and query data generated by the IsoGenie Project, a ~10 year DOE-funded project focused on discovering ecosystem climate feedbacks in a thawing permafrost landscape. The IsoGenieDB provides (i) a platform for IsoGenie Project members to explore the project’s interdisciplinary datasets across scales through the inherent relationships among data entities, (ii) a framework to consolidate and harmonize the datasets needed by the team’s modelers, and (iii) a public venue that leverages the same spatially explicit, disciplinarily integrated data structure to share published datasets. The IsoGenieDB is also being expanded to cover the NASA-funded Archaea to Atmosphere (A2A) project, which scales the findings of IsoGenie to a broader suite of Arctic peatlands, via the umbrella A2A Database (A2A-DB). The IsoGenieDB’s expandability and flexible architecture allow it to serve as an example ecosystems database.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Gamification for Measuring Cyber Security Situational Awareness

Cyber defense competitions arising from U.S. service academy exercises, offer a platform for collecting data that can inform research that ranges from characterizing the ideal cyber warrior to describing behaviors during certain challenging cyber defense situations. This knowledge could lead to better preparation of cyber defenders in both military and civilian settings. This paper describes how one regional competition, the PRCCDC, a participant in the national CCDC program, conducted proof of concept experimentation to collect data during the annual competition for later analysis. The intent is to create an ongoing research agenda that expands on this current work and incorporates augmented cognition and gamification methods for measuring cybersecurity situational awareness under the stress of cyber attack.

Cyber Defense Competitions, CCDC, cyber defender, ↗
DOE OSTI2016

Framework and algorithms for illustrative visualizations of time-varying flows on unstructured meshes

Photo- and physically realistic techniques are often insufficient for visualization of fluid flow simulations, especially for 3D and time-varying studies. Substantial research effort has been dedicated to the development of non-photorealistic and illustration-inspired visualization techniques for compact and intuitive presentation of such complex datasets. However, a great deal of work has been reproduced in this field, as many research groups have developed specialized visualization software. Additionally, interoperability between illustrative visualization software is limited due to diverse processing and rendering architectures employed in different studies. In this investigation, a framework for illustrative visualization is proposed, and implemented in MarmotViz, a ParaView plug-in, enabling its use on a variety of computing platforms with various data file formats and mesh geometries. Region-of-interest identification and feature-tracking algorithms incorporated into this tool are described. Implementations of multiple illustrative effect algorithms are also presented to demonstrate the use and flexibility of this framework. Here, by providing an integrated framework for illustrative visualization of CFD data, MarmotViz can serve as a valuable asset for the interpretation of simulations of ever-growing scale.

42 ENGINEERING↗
DOE OSTI2026

Cross-domain digital twin architecture for predictive maintenance via machine learning and Large Language Models

This research introduces a comprehensive framework for creating and deploying a digital twin platform for continuous monitoring and predictive maintenance within industrial settings. Through utilizing advanced technologies, including Unreal Engine 5, Unity 3D, the Message Queue Telemetry Transport protocol, Random Forest machine learning algorithms, and Large Language Models (LLMs), we establish a platform that digitally reproduces physical equipment and translates digital controls into real-world actions. This facilitates preventive maintenance approaches and improves operational effectiveness. The digital twin platform gathers sensor data from operational equipment, analyzes it using machine learning, and delivers practical insights to prevent potential malfunctions and enhance equipment performance. Furthermore, the incorporation of a web portal enables efficient monitoring and access to historical data, educational materials, and equipment status information. Preliminary findings indicate that digital twins can transform industrial equipment management and maintenance methodologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Control and prevention measures for legionellosis in hospitals: A cross-sectional survey in Italy

Highlights: • Legionellosis risk is high in Italian hospitals with many hospitalizations. • Legionella contamination in the water system was assessed in 97% of hospitals. • Risk assessment was performed in 73% of hospitals but only 53% had a dedicated team. • Measures to reduce legionellosis risk were adopted in 93.3% of hospitals. • Training courses on Legionnaires’ disease were planned in 36.5% of hospitals. Risk assessment, environmental monitoring, and the disinfection of water systems are the key elements in preventing legionellosis risk. The Italian Study Group of Hospital Hygiene of the Italian Society of Hygiene, Preventive Medicine, and Public Health and the Italian Multidisciplinary Society for the Prevention of Health Care-Associated Infections carried out a national cross-sectional survey to investigate the measures taken to prevent and control legionellosis in Italian hospitals. A multiple-choice questionnaire was developed, comprising 71 questions regarding hospital location, general characteristics, clinical and environmental surveillance, and control and preventive measures for legionellosis in 2015. Overall, 739 hospitals were enrolled from February to June 2017, and 178 anonymous questionnaires were correctly completed and evaluated (response rate: 24.1%). The survey was conducted using the SurveyMonkey® platform, and the data were analyzed using Stata 12 software. Of the participating hospitals, 63.2% reported at least one case of legionellosis, of which 28.2% were of proven nosocomial origin. The highest case numbers were reported in the Northern Italy, in hospitals with a pavilion structure or cooling towers, and in hospitals with higher numbers of beds, wards and operating theaters. Laboratory diagnosis was performed using urinary antigen testing alone (31.9%), both urinary antigen testing and single antibody titer (17.8%), or with seroconversion also added (21.5%). Culture-based or molecular investigations were performed in 28.8% and 22.1% of the clinical specimens, respectively. The water systems were routinely tested for Legionella in 97.4% of the hospitals, 62% of which detected a positive result (> 1000 cfu/L). Legionella pneumophila serogroup 2–15 was the most frequently isolated species (58.4%). The most common control measures were the disinfection of the water system (73.7%), mostly through thermal shock (37.4%) and chlorine dioxide (34.4%), and the replacement (69.7%) or cleaning (70.4%) of faucets and showerheads. A dedicated multidisciplinary team was present in 52.8% of the hospitals, and 73% of the hospitals performed risk assessment. Targeted training courses were organized in 36.5% of the hospitals, involving nurses (30.7%), physicians (28.8%), biologists (21.5%), technicians (26.4%), and cleaners (11%). Control and prevention measures for legionellosis are present in Italian hospitals, but some critical aspects should be improved. More appropriate risk assessment is necessary, especially in large facilities with a high number of hospitalizations. Moreover, more sensitive diagnostic tests should be used, and dedicated training courses should be implemented.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Assessing uncertainty in the timing of energy use during cost-optimal distributed energy technology selection and sizing

This paper empirically derives uncertainty ranges in cost-optimal solar PV and storage sizing by comparing results from the REopt Lite optimization platform from metered data and a set of simulated Department of Energy Commercial Reference Building (CRB) profiles at 65 sites. We find load profile shape alone does not explain a site’s optimal configurations (i.e., PV, Storage, PV and Storage, No System). Still, load profile shape does introduce uncertainty to optimal PV and storage capacities. Across all cases where PV is part of an optimal configuration, we find the average ratio of power capacities derived from metered loads to capacities derived from CRB profiles to be 0.97 (and as high as 1463), where 1 would be a perfect match in system size. For storage, the ratio is 1.6 (and as high as 42). We also assess how, in the absence of complete metered data, a CRB profile can be selected that would be expected to yield the most similar solar PV and storage capacities. From those metrics that can be available from billing data (i.e., peak demand, monthly load totals), we find that uncertainty is most reduced by selecting the CRB’s with an annual peak occurring at the most similar time, or those with the lowest average root mean square error (RMSE) among monthly peak loads. This research can help improve the implementation and interpretation of results derived from simulated load profiles and is an important next step in advancing smart grid solutions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

MULTI-MODAL global surveillance methodology for predictive and on-demand characterization of localized processes using cube satellite platforms and deep learning techniques

This paper presents the work completed towards the development of a multi-modal global surveillance methodology using cube satellite (CubeSat) platforms and novel data analysis techniques. A CubeSat system equipped with adequate sensors and data analytics capabilities can autonomously characterize various phenomena of interest on the Earth’s surface. CubeSats are advantageous over conventional satellites in certain remote monitoring applications because of their reduced construction costs (due to the availability of commercially-off-the-shelf components) and are easier to launch. The CubeSat surveillance system developed in this paper focused on phenomena of interest surrounding the nuclear fuel cycle in support of nuclear non-proliferation and emergency response. To observe the phenomena, a constellation of 3U and 6U CubeSats deployed from the ISS with adequate components was chosen. Four different sensor configurations were identified for remote sensing: panchromatic/multispectral in the visible and near-infrared spectrum, multispectral in infrared spectrum, hyperspectral in infrared spectrum, and multispectral in ultraviolet spectrum. While a panchromatic/multispectral sensor configuration has CubeSat flight heritage at the required spatial resolutions, the other three sensor types need future 3 development to meet signature and system requirements. Once each sensor onboard the CubeSat system collects data on a target of interest, the onboard computers would then apply the deep learning-based characterization methodology developed in this paper to identify phenomena. Four surrogate datasets containing representative simplified “images” were created for each sensor type to train the characterization methodology. A convolutional neural network was applied to each dataset and produced recall rates for the phenomena between 89.7% - 99.3% and precision rates between 92.3% - 99.9%. Each phenomenon’s presence probability from each network is then combined into a final characterization solution for a target area. This paper covers multiple interdisciplinary areas to develop the foundation for a CubeSat surveillance system focused on phenomena surrounding the nuclear fuel cycle.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

Navigating phase diagram complexity to guide robotic inorganic materials synthesis

Abstract Efficient synthesis recipes are needed to streamline the manufacturing of complex materials and to accelerate the realization of theoretically predicted materials. Often, the solid-state synthesis of multicomponent oxides is impeded by undesired by-product phases, which can kinetically trap reactions in an incomplete non-equilibrium state. Here we report a thermodynamic strategy to navigate high-dimensional phase diagrams in search of precursors that circumvent low-energy, competing by-products, while maximizing the reaction energy to drive fast phase transformation kinetics. Using a robotic inorganic materials synthesis laboratory, we perform a large-scale experimental validation of our precursor selection principles. For a set of 35 target quaternary oxides, with chemistries representative of intercalation battery cathodes and solid-state electrolytes, our robot performs 224 reactions spanning 27 elements with 28 unique precursors, operated by 1 human experimentalist. Our predicted precursors frequently yield target materials with higher phase purity than traditional precursors. Robotic laboratories offer an exciting platform for data-driven experimental synthesis science, from which we can develop fundamental insights to guide both human and robotic chemists.

Chen, Jiadong (ORCID:0009000476038838)↗
DOE OSTI2023

An open-source framework for simulation-based testing of buildings control strategies

Here this paper presents a simulation framework for evaluating building control strategies (BCSs), developed with VOLTTRON, an opensource platform that integrates data, devices, and systems for sensing and control applications, and is based on co-simulation interfaces. It realizes an integrated environment for both testing and deploying BCSs, thereby eliminating the need for having a dedicated implementation of BCS for testing. For the first time, this framework provides critical functionalities, including scalable communication management and time-drive simulation advance, i.e., advancing the simulation based on clock time. We applied this framework to evaluating two BCSs from ASHRAE Guideline 36-2008 and ASHRAE Standard 90.1-2019. The evaluation results show that those BCSs primarily benefit the heating operation by reducing gas usage but yield insignificant savings in electricity consumption. The results also emphasize the importance of tuning the parameters of the BCSs to achieve better performances.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

First Calorimetric Energy Reconstruction of Beam Events with ARAPUCA Light Detector in ProtoDUNE-SP

ProtoDUNE Single Phase at CERN is the large scale prototype for the far detector of the future DUNE experiment. ProtoDUNE is in stable operation since Oct. 2018 at the CERN Neutrino Platform. Test beam data in the energy range of sub-GeV to a few GeV were collected in fall 2018 providing a set of key measurements. Particles (electrons, protons, pions, muons and kaons) are identified combining information from a set of beam-line detectors (Time of Flight, Cherenkov) and TPC reconstruction. Three different technologies are implemented in the protoDUNE photon detector system (PDS). Results from the ARAPUCA response, one of the PDS components, are presented providing first calorimetric energy measurements and particle ID of beam events from LAr scintillation light signals.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2016

Measuring water fluxes in forests: The need for integrative platforms of analysis

To understand the importance of analytical tools such as those provided by Berdanier et al. (2016) in this issue of Tree Physiology , one must understand both the grand challenges facing Earth system modelers, as well as the minutia of engaging in ecophysiological research in the field. It is between these two extremes of scale that many ecologists struggle to translate empirical research into useful conclusions that guide our understanding of how ecosystems currently function and how they are likely to change in the future. Likewise, modelers struggle to build complexity into their models that match this sophisticated understanding of how ecosystems function, so that necessary simplifications required by large scales do not themselves change the conclusions drawn from these simulations. As both monitoring technology and computational power increase, along with the continual effort in both empirical and modeling research, the gap between the scale of Earth system models and ecological observations continually closes. In addition, this creates a need for platforms of model–data interaction that incorporate uncertainties in both simulations and observations when scaling from one to the other, moving beyond simple comparisons of monthly or annual sums and means.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Mesh Network Design for Smart Charging Infrastructure and Electric Vehicle Remote Monitoring

Plug-In Electric Vehicle (PEV) charging today happens with little knowledge of the state of the vehicle being charged. In order to implement smart charging algorithms and other capabilities of the future smart grid, provisions for remote PEV monitoring will have to be developed and tested. The UCLA Smart-grid Energy Research Center (SMERC) is working on a smart charging research platform that includes data acquired in real time from PEVs being charged in order to investigate smart charging algorithms and demand response (DR) strategies for PEVs in large parking garage settings. The system outlined in this work allows PEVs to be remotely monitored throughout the charging process by a smart-charging controller communicating through a mesh network of charging stations and in-vehicle monitoring devices. The approach may be used for Vehicle to Grid (V2G) communication as well as PEV monitoring.

Shepelev, Aleksey↗
DOE OSTI2023

Automated Controller Hardware-In-The-Loop Testbed for EV Charger Resilience Analysis

This paper focuses on the development of a tool that includes an automated testbed with controls, protection, and communications integrated into a real-time system to provide a platform to generate data sets for failure modes and effects analysis. This tool establishes a value for automation of data generation for different scenarios and addresses the gap of nonexistent field data for different applications and use cases. The features of this tool can further be expanded to include multiple power electronics models, communication protocols, and scaled system architectures. This general framework was evaluated for a DC fast charger system use case to provide quantitative solution for resiliency.

Starke, Michael↗
DOE OSTI2024

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗
DOE OSTI2018

Toward A Universal Biomedical Data Translator

Myriad biomedical data are available today and bring with them a need to “translate” those data into meaningful information that can be used to accelerate clinical and translational science and drive innovations in clinical care and drug discovery. We describe the work of The Biomedical Data Translator Consortium to develop a platform that supports the translation of data into knowledge by applying inferential methods to a graph representation of biomedical entities and their relationships.

60 APPLIED LIFE SCIENCES↗