Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96

Harmonic Modeling, Data Generation and Analysis of Power Electronics-Interfaced Residential Loads

The share of electronics-based residential load is expected to rise as devices such as variable frequency drives (VFDs), electric vehicle chargers, and inverter-based distributed energy resources (DERs), e.g., photovoltaic (PV) systems become more common. These loads may introduce significant harmonics into power networks that need to be closely studied in order to perform accurate load modeling and forecasting. However, it can be difficult to obtain harmonic-rich voltage and current data - necessary for identifying accurate load models - for residential electrical loads. Recognizing this need, we identify and model a set of electronics-based end-use loads and DERs in an electromagnetic transients program (EMTP) tool for a residence with a single- phase split-phase supply. Further, a procedure is developed to model harmonic interactions between end-use loads connected to the same non-ideal supply voltage in a residential setting. Finally, a harmonic-rich dataset produced via the proposed procedure is utilized to identify frequency coupling matrix (FCM) based load model. Numerical results demonstrate the accuracy of the model, and explore model identifiability with limited data points.

harmonics, power quality, load modeling↗

Athena: High-Performance Sparse Tensor Contraction Sequence on Heterogeneous Memory

Sparse tensor contraction sequence has been widely employed in many fields, such as chemistry and physics. However, how to efficiently implement the sequence faces multiple challenges, such as redundant computations and memory operations, massive memory consumption, and inefficient utilization of hardware. To address the above challenges, we introduce Athena, a high-performance framework for SpTC sequences. Athena introduces new data structures, leverages emerging Optane-based heterogeneous memory (HM) architecture, and stage parallelism. In particular, Athena introduces shared hash table-represented sparse accumulator to eliminate unnecessary input processing and data migration; Athena uses a novel data-semantic guided dynamic migration solution to make the best use of the Optane-based HM for high performance; Athena also co-runs execution phases with different characteristics to enable high hardware utilization. Evaluating with 12 datasets, we show that Athena brings 327-7362× speedup over the state-of-the-art SpTC algorithm. With the dynamic data placement guided by data semantics, Athena brings performance improvement on Optane-based HM over a state-of-the-art software-based data management solution, a hardware-based data management solution, and PMM-only by 1.58×, 1.82×, and 2.34× respectively.

Liu, Jiawen↗

VisIO: enabling interactive visualization of ultra-scale, time-series data via high-bandwidth distributed I/O systems

Petascale simulations compute at resolutions ranging into billions of cells and write terabytes of data for visualization and analysis. Interactive visuaUzation of this time series is a desired step before starting a new run. The I/O subsystem and associated network often are a significant impediment to interactive visualization of time-varying data; as they are not configured or provisioned to provide necessary I/O read rates. In this paper, we propose a new I/O library for visualization applications: VisIO. Visualization applications commonly use N-to-N reads within their parallel enabled readers which provides an incentive for a shared-nothing approach to I/O, similar to other data-intensive approaches such as Hadoop. However, unlike other data-intensive applications, visualization requires: (1) interactive performance for large data volumes, (2) compatibility with MPI and POSIX file system semantics for compatibility with existing infrastructure, and (3) use of existing file formats and their stipulated data partitioning rules. VisIO, provides a mechanism for using a non-POSIX distributed file system to provide linear scaling of 110 bandwidth. In addition, we introduce a novel scheduling algorithm that helps to co-locate visualization processes on nodes with the requested data. Testing using VisIO integrated into Para View was conducted using the Hadoop Distributed File System (HDFS) on TACC's Longhorn cluster. A representative dataset, VPIC, across 128 nodes showed a 64.4% read performance improvement compared to the provided Lustre installation. Also tested, was a dataset representing a global ocean salinity simulation that showed a 51.4% improvement in read performance over Lustre when using our VisIO system. VisIO, provides powerful high-performance I/O services to visualization applications, allowing for interactive performance with ultra-scale, time-series data.

97 MATHEMATICS AND COMPUTING↗

Enabling Space Biology Knowledge Discovery Through Biospecimen Sharing: The NASA Biological Institutional Scientific Collection and Space Microbial Culture Collection

NASA and international partners have conducted experiments in space to understand the biological impacts and address hazards to health. The resulting basic and applied science is imperative to enabling humanity to venture back to the Moon and then to Mars and beyond. Sending organisms into space is a costly endeavor. All biospecimens not required by spaceflight-relevant Principal Investigators are harvested, preserved, and archived in the NASA Biological Institutional Scientific Collection (NBISC) to maximize the scientific return. The NASA Biological and Physical Sciences (BPS) Division ‘Open Science’ endeavor includes NASA Genelab, the Space Biology Program’s Biospecimen Sharing Program, Physical Sciences Informatics, the Ames Life Sciences Data Archive, and NBISC to integrate extensive data and biospecimen resources from spaceflight and/or ground-based analog experiments. NBISC biospecimens are collected and preserved according to well-established standard operating procedures to maintain scientific quality and are available on-request by the international scientific community. NBISC currently stores over 32,000 biospecimens from Shuttle, International Space Station, and ground-based space analog investigations. Tissue sharing has resulted in at least 33 publications since 2011 and 48 requests since 2016. Many requests for NBISC biospecimen come from first-time investigators who subsequently submit grants as the port-of-entry into the field of space biology. Some NBISC biospecimens have been awarded to NASA Genelab, who then generate various ‘Open Science’ -omics data sets on their platform for bioinformatics. Other NBISC biospecimen awards have led to multiple studies such as fecal microbiome analysis, DNA damage analysis using single-cell DNA sequencing, enzymatic-pathway identification involved in spaceflight muscle atrophy, and characterization of ocular morphological changes. Of note, NBISC has expanded to include a new Space Microbial Culture Collection (SMCC) for the collection, identification, documentation, long-term preservation, and distribution of space-related microbial isolates.

biospecimens↗

Enabling Space Biology Knowledge Discovery Through Biospecimen Sharing: The NASA Biological Institutional Scientific Collection

NASA and international partners have conducted experiments in space to understand the biological impacts and address hazards to health. The resulting basic and applied science is imperative to enabling humanity to venture back to the Moon and then to Mars and beyond. Sending organisms into space is a costly endeavor. All biospecimens not required by spaceflight-relevant Principal Investigators are harvested, preserved, and archived in the NASA Biological Institutional Scientific Collection (NBISC) to maximize the scientific return. The NASA Biological and Physical Sciences (BPS) Division has an ‘Open Science’ endeavor which includes NASA Genelab, the Space Biology Program’s Biospecimen Sharing Program, Physical Sciences Informatics, the Ames Life Sciences Data Archive, and NBISC. Its purpose is to integrate extensive data and biospecimen resources from spaceflight and/or ground-based analog experiments. NBISC biospecimens are collected and preserved according to well-established standard operating procedures to maintain scientific quality and are available on-request by the international scientific community. NBISC currently stores over 32,000 biospecimens from Shuttle, International Space Station, and ground-based space analog investigations. Tissue sharing has resulted in at least 33 publications since 2011 and 48 requests since 2016. Many requests for NBISC biospecimen come from first-time investigators who subsequently submit grants as the port-of-entry into the field of space biology. Some NBISC biospecimens have been awarded to NASA Genelab, who then generate various ‘Open Science’ -omics data sets on their platform for bioinformatics. Other NBISC biospecimen awards have led to multiple studies such as fecal microbiome analysis, DNA damage analysis using single-cell DNA sequencing, enzymatic-pathway identification involved in spaceflight muscle atrophy, and characterization of ocular morphological changes. Of note, NBISC has expanded to include a new Space Microbial Culture Collection (SMCC) for the collection, identification, documentation, long-term preservation, and distribution of space-related microbial isolates.

Ryan T. Scott↗

Ontobee: A linked ontology data server to support ontology term dereferencing, linkage, query and integration

Linked Data (LD) aims to achieve interconnected data by representing entities using Unified Resource Identifiers (URIs), and sharing information using Resource Description Frameworks (RDFs) and HTTP. Ontologies, which logically represent entities and relations in specific domains, are the basis of LD. Ontobee (http://www.ontobee.org/) is a linked ontology data server that stores ontology information using RDF triple store technology and supports query, visualization and linkage of ontology terms. Ontobee is also the default linked data server for publishing and browsing biomedical ontologies in the Open Biological Ontology (OBO) Foundry (http://obofoundry.org) library. Ontobee currently hosts more than 180 ontologies (including 131 OBO Foundry Library ontologies) with over four million terms. Ontobee provides a user-friendly web interface for querying and visualizing the details and hierarchy of a specific ontology term. Using the eXtensible Stylesheet Language Transformation (XSLT) technology, Ontobee is able to dereference a single ontology term URI, and then output RDF/eXtensible Markup Language (XML) for computer processing or display the HTML information on a web browser for human users. Statistics and detailed information are generated and displayed for each ontology listed in Ontobee. In addition, a SPARQL web interface is provided for custom advanced SPARQL queries of one or multiple ontologies.

97 MATHEMATICS AND COMPUTING↗

GMLS-Nets: A Framework for Learning from Unstructured Data

Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a nonparametric technique for estimating linear bounded functionals from scattered data, and has recently been used in the literature for solving partial differential equations. By parameterizing the GMLS estimator, we obtain learning methods for operators with unstructured stencils. In GMLS-Nets the necessary calculations are local, readily parallelizable, and the estimator is supported by a rigorous approximation theory. We show how the framework may be used for unstructured physical data sets to perform functional regression to identify associated differential operators and to regress quantities of interest. The results suggest the architectures to be an attractive foundation for data-driven model development in scientific machine learning applications.

42 ENGINEERING↗

GMLS-Nets: Scientific Machine Learning Methods for Unstructured Data

Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a nonparametric technique for estimating linear bounded functionals from scattered data, and has recently been used in the literature for solving partial differential equations. By parameterizing the GMLS estimator, we obtain learning methods for operators with unstructured stencils. In GMLS-Nets the necessary calculations are local, readily parallelizable, and the estimator is supported by a rigorous approximation theory. We show how the framework may be used for unstructured physical data sets to perform functional regression to identify associated differential operators and to regress quantities of interest. The results suggest the architectures to be an attractive foundation for data-driven model development in scientific machine learning applications

97 MATHEMATICS AND COMPUTING↗

GMLS-Nets: A Framework for Learning from Unstructured Data

Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a non-parametric technique for estimating linear bounded functionals from scattered data, and has recently been used in the literature for solving partial differential equations. By parameterizing the GMLS estimator, we obtain learning methods for operators with unstructured stencils. In GMLS-Nets the necessary calculations are local, readily parallelizable, and the estimator is supported by a rigorous approximation theory. We show how the framework may be used for unstructured physical data sets to perform functional regression to identify associated differential operators and to regress quantities of interest. The results suggest the architectures to be an attractive foundation for data-driven model development in scientific machine learning applications

97 MATHEMATICS AND COMPUTING↗

Using Public Participation to Improve MELs Energy Data Collection

Miscellaneous Electric Loads (MELs) have proliferated in the last decade, and comprise an increasing share of building energy consumption. Because of the diversity of MELs and our lack of understanding about how people use them, large-scale data collection is needed to inform meaningful energy reduction strategies. Traditional methods of data collection, however, usually incur high labor and metering equipment expenses. As an alternative, this paper investigates the feasibility of crowdsourcing data collection to satisfy at least part of the data collection needs with acceptable accuracy. This study assessed the reliability and accuracy of crowdsourced data, by recruiting over 20 volunteers (from the 2012 Lawrence Berkeley Lab, Open House event) to test our crowdsourcing protocol. The protocol asked volunteers to perform the following tasks for three test products with increasing complexity - record power meter and product characteristics, identify all power settings available, and report the measured power. Based on our collected data and analysis, we concluded that volunteers performed reasonably well for devices with functionalities with which they are familiar, and might not produce highly accurate field measurements for complex devices. Accuracy will likely improve when participants are measuring the power used by devices in their home which they know how to operate, by providing more specific instructions including instructional videos. When integrated with existing programs such as the Home Energy Saver tool, crowdsourcing data collection from individual homeowners has the potential to generate a substantial amount of information about MELs energy use in homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Compare Energy Use in Variable Refrigerant Flow Heat Pumps Field Demonstration and Computer Model

Variable Refrigerant Flow (VRF) heat pumps are often regarded as energy efficient air-conditioning systems which offer electricity savings as well as reduction in peak electric demand while providing improved individual zone setpoint control. One of the key advantages of VRF systems is minimal duct losses which provide significant reduction in energy use and duct space. However, there is limited data available to show their actual performance in the field. Since VRF systems are increasingly gaining market share in the US, it is highly desirable to have more actual field performance data of these systems. An effort was made in this direction to monitor VRF system performance over an extended period of time in a US national lab test facility. Due to increasing demand by the energy modeling community, an empirical model to simulate VRF systems was implemented in the building simulation program EnergyPlus. This paper presents the comparison of energy consumption as measured in the national lab and as predicted by the program. For increased accuracy in the comparison, a customized weather file was created by using measured outdoor temperature and relative humidity at the test facility. Other inputs to the model included building construction, VRF system model based on lab measured performance, occupancy of the building, lighting/plug loads, and thermostat set-points etc. Infiltration model inputs were adjusted in the beginning to tune the computer model and then subsequent field measurements were compared to the simulation results. Differences between the computer model results and actual field measurements are discussed. The computer generated VRF performance closely resembled the field measurements.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

THE LOW-VELOCITY, RAPIDLY FADING TYPE Ia SUPERNOVA 2002es

SN 2002es is a peculiar subluminous Type Ia supernova (SN Ia) with a combination of observed characteristics never before seen in an SN Ia. At maximum light, SN 2002es shares spectroscopic properties with the underluminous SN 1991bg subclass of SNe Ia, but with substantially lower expansion velocities ({approx}6000 km s{sup -1}) more typical of the peculiar SN 2002cx subclass. Photometrically, SN 2002es differs from both SN 1991bg-like and SN 2002cx-like supernovae. Although at maximum light it is subluminous (M{sub B} = -17.78 mag), SN 2002es has a relatively broad light curve ({Delta}m{sub 15}(B) = 1.28 {+-} 0.04 mag), making it a significant outlier in the light-curve width versus luminosity relationship. We estimate a {sup 56}Ni mass of 0.17 {+-} 0.05 M{sub Sun} synthesized in the explosion, relatively low for an SN Ia. One month after maximum light, we find an unexpected plummet in the bolometric luminosity. The late-time decay of the light curves is inconsistent with our estimated {sup 56}Ni mass, indicating that either the light curve was not completely powered by {sup 56}Ni decay or the ejecta became optically thin to {gamma}-rays within a month after maximum light. The host galaxy is classified as an S0 galaxy with little to no star formation, indicating that the progenitor of SN 2002es is likely from an old stellar population. We also present a less extensive data set for SN 1999bh, an object which shares similar photometric and spectroscopic properties. Both objects were found as part of the Lick Observatory Supernova Search, allowing us to estimate that these objects should account for 2.5% of SNe Ia within a fixed volume. Current theoretical models are unable to explain the observed characteristics of SN 2002es.

79 ASTRONOMY AND ASTROPHYSICS↗

Arm DevSummit Keynote: Environment for Data Engineering in Virtual Reality: Ethical Considerations

Currently, the US Government is going through a large-scale data Transformation effort, where the GSA playbook is guiding all agencies to make their processes data-driven with the help of emerging technologies. To address concerns about algorithm sharing, AI adoption, and vendor lock-in, the NASA Langley Research Center Digital Transformation Group has developed the Environment for Data Engineering in Virtual Reality (EnDEVR), a data science ecosystem that allows users to command and investigate customizable data analyses from a VR environment. The system has been evaluated in the Oculus Rift S and Quest environments, two popular VR systems powered by the ARM architecture. Current and future development will employ several AI capabilities to guide research and automation within the environment and to facilitate algorithm sharing. In this talk, we will discuss the results of an initial ethical investigation and recommended considerations for the use of AI within the system.

Artificial Intelligence↗

TagIt: An Integrated Indexing and Search Service for File Systems

Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy.In this paper, we present TagIt, a scalable data management service framework aimed at scientific datasets, which is tightly integrated into a shared-nothing distributed file system. A key feature of TagIt is a scalable, distributed metadata indexing framework, using which we implement a flexible tagging capability to support data discovery. The tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. Our evaluation shows that TagIt can expedite data search by up to 10X over the extant decoupled approach.

Sim, Hyogi↗

Comparative analysis for various redox flow batteries chemistries using a cost performance model

A robust performance-based cost model is developed for all-vanadium, iron-vanadium and iron chromium redox flow batteries. Systems aspects such as shunt current losses, pumping losses and thermal management are accounted for. The objective function, set to minimize system cost, allows determination of stack design and operating parameters such as current density, flow rate and depth of discharge (DOD). Component costs obtained from vendors are used to calculate system costs for various time frames. A 2 kW stack data was used to estimate unit energy costs and compared with model estimates for the same size electrodes. The tool has been shared with the redox flow battery community to both validate their stack data and guide future direction.

electrolyte↗

Extending Component Lifetime And Improving Inverter Reliability (ECLAIIR)

Inverter reliability remains one of the most persistent challenges limiting the performance, availability, and economic viability of utility‑scale photovoltaic (PV) plants. Industry data consistently show that inverters account for the highest share of corrective maintenance events and unplanned outages across PV fleets. These failures result in energy losses, increased O&M costs, and reduced confidence in long‑term solar asset performance. Motivated by these challenges, this project—Extending Component Lifetime and Improving Inverter Reliability (ECLAIIR)—was undertaken to systematically investigate inverter degradation and failure mechanisms, develop predictive maintenance capabilities, and establish data‑driven pathways to improve service life and reduce the Levelized Cost of Energy (LCOE) for large‑scale PV systems. The primary goal of the project was to identify pre‑failure signatures in string inverters using both lab‑based accelerated lifetime testing and field‑based data and to develop predictive maintenance algorithms that can anticipate inverter faults before they occur. Through collaboration with inverter testing laboratory, solar PV plant owner, and failure‑analysis experts, the project advanced the technical understanding of inverter reliability. By instrumenting inverters with thermistors, humidity sensors, power‑quality meters, and acoustic sensors, the research established how multiple sensing modalities can reliably detect deviations from normal behavior hours to days before failure. These findings substantially enhance scientific understanding of inverter failure kinetics and provide the PV industry with the most comprehensive cross‑OEM characterization of early‑stage failure indicators reported to date. Technically, the project demonstrated the effectiveness of predictive maintenance by developing and validating the PreDICT (Predictive Diagnostics of PV Inverters Using Condition Monitoring and Trend Analysis) framework—a multi‑layer diagnostic architecture combining peer‑to‑peer analytics, historical trend modeling, and advanced machine‑learning techniques such as the Sequential Conditional Variational Autoencoder (SCVAE). This predictive model achieved more than 90% accuracy in detecting pre‑failure conditions and provided up to four days of lead time before inverter failure in field scenarios. Economically, the project’s LCOE analysis showed that predictive maintenance can reduce lifetime energy losses and minimize corrective maintenance interventions. Modeling indicated that, depending on inverter failure rates and replacement timelines, predictive maintenance can significantly reduce LCOE impacts associated with inverter downtime: from as high as 19.4% under conventional maintenance strategies to 0.1%–10.17% when predictive analytics are adopted. These results confirm that predictive maintenance is both technically feasible and economically advantageous for utilities and plant operators. The project’s findings also have broad public benefit. By improving inverter reliability and reducing downtime, predictive maintenance directly increases electricity generation from existing PV assets. Enhanced reliability lowers operational costs for utilities, which can translate over time into lower energy costs for consumers. Furthermore, the project’s technical publications, conference presentations, and industry workshops ensure that knowledge gained is shared broadly across the solar industry, supporting workforce development and enabling utilities of all sizes to adopt modern asset‑health monitoring practices. The retrofitting case study and service‑life prediction framework further support informed decision‑making for aging PV fleets, helping operators extend system life and reduce electronic waste. In summary, the ECLAIIR project significantly advanced the state of knowledge on inverter degradation, demonstrated the technical and economic value of predictive maintenance, and delivered actionable tools and insights that support more reliable, cost‑effective, and sustainable PV plant operation. The outcomes of this project will continue to inform utility practices, guide inverter design improvements, and strengthen the long‑term performance of solar assets nationwide.

14 SOLAR ENERGY↗

Efficient loading of reduced data ensembles produced at ORNL SNS/HFIR neutron time-of-flight facilities

We present algorithmic improvements to the loading operations of certain reduced data ensembles produced from neutron scattering experiments at Oak Ridge National Laboratory (ORNL) facilities. Ensembles from multiple measurements are required to cover a wide range of the phase space of a sample material of interest. They are stored using the standard NeXus schema on individual HDF5 files. This makes it a scalability challenge, as the number of experiments stored increases in a single ensemble file. The present work follows up on our previous efforts on data management algorithms, to address identified input output (I/O) bottlenecks in Mantid, an open-source data analysis framework used across several neutron science facilities around the world. We reuse an in-memory binary-tree metadata index that resembles data access patterns, to provide a scalable search and extraction mechanism. In addition, several memory operations are refactored and optimized for the current common use cases, ranging most frequently from 10 to 180, and up to 360 separate measurement configurations. Results from this work show consistent speed ups in wall-clock time on the Mantid LoadMD routine, ranging from 19% to 23% on average, on ORNL production computing systems. The latter depends on the complexity of the targeted instrument-specific data and the system I/O and compute variability for the shared computational resources available to users of ORNL’s Spallation Neutron Source (SNS) and the High Flux Isotope Reactor (HFIR) instruments. Nevertheless, we continue to highlight the need for more research to address reduction challenges as experimental data volumes, user time and processing costs increase.

Godoy, William↗