Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Availability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Translytics: A Novel Approach for Runtime Selection of Database Layout Based on User’s Context

Currently, organizations have to maintain separate systems for transactions and analytics inside the company. Notably, different vendors provide the capabilities for either of these tasks that require specialized hardware or software. Data engineers are required to retrieve data from one source and transform it into another format to obtain the maximum benefit in a minimum time. Organizations strive for a competitive advantage that is achieved by fetching data from their customers and getting insights earliest for timely decision making. Present practices do not permit the view of the latest data for analytics since the first data have to be fetched from the source, transformed, and loaded to other systems to be utilized for analysis by relevant teams. This paper introduces a single system for both transactions and analytics. Our proposed solution would permit companies to seamlessly adapt our solution without the need to shift all of their data to newer systems and allow all the teams. It would grant all the teams to have a view of the latest available data without extra expertise and budget.

Tanvir, Muhammad Makhshif↗

Multiscale Patterning from Competing Interactions and Length Scales

We live in an era of complexity marked by impressive new tools powering the scientific method to accelerate discovery, prediction, and control of increasingly complex systems. In common with many disciplines and societal challenges and opportunities, materials and condensed matter sciences are beneficiaries. The volume and fidelity of experimental, computational, and visualization data available, and tools to rapidly interpret them, are remarkable. Conceptual frameworks, including multiscale, multiphysics modeling of this complexity, are fueled by the data and, in turn, guide directions for future experimental and computational strategies. In this spirit, we discuss the importance of competing interactions, length scales, and constraints as pervasive sources of spatio-temporal complexity. We use representative examples drawn from materials and condensed matter, including the important role of elasticity in some technologically important quantum materials.

36 MATERIALS SCIENCE↗

2021 NIRT Mini Drill (After Action Report)

During the summer and fall of 2021, several functional area drills were held that focused on exercising Consequence Management’s (CM) ability to extract and use data from RadResponder for the purpose of answering intermediate-phase questions presented as technical inject requests for information (RFI) in Sandia National Laboratories (SNL) Consequence Management Operational System (COSMOS) software. The scenario chosen was that of Northern Lights 2016 (NL16) which was a large-scale nuclear power plant (NPP) release exercise in the state of Minnesota. The NL16 data was extracted from the Radiological Assessment and Monitoring System (RAMS) event where it was created and was reformatted for implanting to a new RadResponder event. Next, the beta-version of a laboratory sample data simulator was used to generate more sample data that was injected to the event. Five “mini-drills” were devised with each prompt defined by a data-based need. For each drill, a team of assessment and NARAC scientists worked the problem using the drill prompt and the available data in RadResponder. The teams held a kickoff meeting, had several days to work the problem, and then reported their results as well as observations in a hotwash. Several areas for improvement in both the software and process were identified during the course of these drills. This report will document the process of addressing each RFI and the discovered gaps in both software capability and methodology so that they can be considered for future development and investment by the CM and NIRT programs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

WA-Omic_LA.1.0 - Quantitative Lipidomics, Metabolomics, and Sequencing (16S/ITS) Publication Data DOI Package

Corresponding Data Publication: "Rapid remodeling of the soil lipidome in response to a drying-rewetting event." This study reveals specific changes in lipids and metabolites that are indicative of stress adaptation, substrate use, and cellular recovery during soil drying and subsequent rewetting. Drought induced nutrient limitation was reflected in the lipidome and polar metabalome, both of which rapidly shifted (within hours) upon rewet. Reduced nutrient access in dry soil caused the replacement of glycerophospholipids with phosphorus-free lipids and impeded resource-expensive osmolyte accumulation. Elevated levels of ceramides and lipids with long chain polyunsaturated fatty acids, in dry soil suggests that lipids play an important role in fungal drought tolerance. Increasing abundance of bacterial glycerophospholipids and triacylglycerols with fatty acids typical of bacteria and polar metabolites suggest metabolic recovery in representative bacteria once the environmental conditions are conducive for growth. These results underscore the importance of the soil lipidome as a robust indicator of microbial community responses, especially at the short time scales of cell-environment reactions. Data package contents reported here are the first version and contain pre- and post-processed data acquisition and subsequent downstream analysis files using various data source instrument method techniques and Mass Spectroscopy (MS) EMSL capabilities. This publication data package DOI is a comprehensive high-throughput multi-omics data lifecycle collection containing processed data method metadata. Support files include additional data download “Read Me” file containing data descriptor information and data source application ontologies (see data dictionary). Reported data download contents are structured for compliance with project data sharing guidelines, community standards initiatives, and sponsor stakeholder policies supporting FAIR data principles. For increased data availability and interoperability, GC-MS/LC-MS mass spectrometry datasets (Thermo .raw ) were deposited at the MassIVE database repository under the related data accession MSV000086931 and can be accessed by using the API. Statistical data processing software, analysis tools, and data workflows are listed below corresponding to the host repository long-term location.

Amplicon sequencing 16S ITS LC-MS/MS lipidomics mu↗

WA-Omic_LA.1.0 - Quantitative Lipidomics, Metabolomics, and Sequencing (16S/ITS) Publication Data DOI Package

Corresponding Data Publication: "Rapid remodeling of the soil lipidome in response to a drying-rewetting event." This study reveals specific changes in lipids and metabolites that are indicative of stress adaptation, substrate use, and cellular recovery during soil drying and subsequent rewetting. Drought induced nutrient limitation was reflected in the lipidome and polar metabalome, both of which rapidly shifted (within hours) upon rewet. Reduced nutrient access in dry soil caused the replacement of glycerophospholipids with phosphorus-free lipids and impeded resource-expensive osmolyte accumulation. Elevated levels of ceramides and lipids with long chain polyunsaturated fatty acids, in dry soil suggests that lipids play an important role in fungal drought tolerance. Increasing abundance of bacterial glycerophospholipids and triacylglycerols with fatty acids typical of bacteria and polar metabolites suggest metabolic recovery in representative bacteria once the environmental conditions are conducive for growth. These results underscore the importance of the soil lipidome as a robust indicator of microbial community responses, especially at the short time scales of cell-environment reactions. Data package contents reported here are the first version and contain pre- and post-processed data acquisition and subsequent downstream analysis files using various data source instrument method techniques and Mass Spectroscopy (MS) EMSL capabilities. This publication data package DOI is a comprehensive high-throughput multi-omics data lifecycle collection containing processed data method metadata. Support files include additional data download “Read Me” file containing data descriptor information and data source application ontologies (see data dictionary). Reported data download contents are structured for compliance with project data sharing guidelines, community standards initiatives, and sponsor stakeholder policies supporting FAIR data principles. For increased data availability and interoperability, GC-MS/LC-MS mass spectrometry datasets (Thermo .raw ) were deposited at the MassIVE database repository under the related data accession MSV000086931 and can be accessed by using the API. Statistical data processing software, analysis tools, and data workflows are listed below corresponding to the host repository long-term location.

Amplicon sequencing 16S ITS LC-MS/MS lipidomics mu↗

WA-Omic_LA.1.0 - Quantitative Lipidomics, Metabolomics, and Sequencing (16S/ITS) Publication Data DOI Package

Corresponding Data Publication: "Rapid remodeling of the soil lipidome in response to a drying-rewetting event." This study reveals specific changes in lipids and metabolites that are indicative of stress adaptation, substrate use, and cellular recovery during soil drying and subsequent rewetting. Drought induced nutrient limitation was reflected in the lipidome and polar metabalome, both of which rapidly shifted (within hours) upon rewet. Reduced nutrient access in dry soil caused the replacement of glycerophospholipids with phosphorus-free lipids and impeded resource-expensive osmolyte accumulation. Elevated levels of ceramides and lipids with long chain polyunsaturated fatty acids, in dry soil suggests that lipids play an important role in fungal drought tolerance. Increasing abundance of bacterial glycerophospholipids and triacylglycerols with fatty acids typical of bacteria and polar metabolites suggest metabolic recovery in representative bacteria once the environmental conditions are conducive for growth. These results underscore the importance of the soil lipidome as a robust indicator of microbial community responses, especially at the short time scales of cell-environment reactions. Data package contents reported here are the first version and contain pre- and post-processed data acquisition and subsequent downstream analysis files using various data source instrument method techniques and Mass Spectroscopy (MS) EMSL capabilities. This publication data package DOI is a comprehensive high-throughput multi-omics data lifecycle collection containing processed data method metadata. Support files include additional data download “Read Me” file containing data descriptor information and data source application ontologies (see data dictionary). Reported data download contents are structured for compliance with project data sharing guidelines, community standards initiatives, and sponsor stakeholder policies supporting FAIR data principles. For increased data availability and interoperability, GC-MS/LC-MS mass spectrometry datasets (Thermo .raw ) were deposited at the MassIVE database repository under the related data accession MSV000086931 and can be accessed by using the API. Statistical data processing software, analysis tools, and data workflows are listed below corresponding to the host repository long-term location.

Amplicon sequencing 16S ITS LC-MS/MS lipidomics mu↗

An analysis of aircraft accidents involving fires

All U. S. Air Carrier accidents between 1963 and 1974 were studied to assess the extent of total personnel and aircraft damage which occurred in accidents and in accidents involving fire. Published accident reports and NTSB investigators' factual backup files were the primary sources of data. Although it was frequently not possible to assess the relative extent of fire-caused damage versus impact damage using the available data, the study established upper and lower bounds for deaths and damage due specifically to fire. In 12 years there were 122 accidents which involved airframe fires. Eighty-seven percent of the fires occurred after impact, and fuel leakage from ruptured tanks or severed lines was the most frequently cited cause. A cost analysis was performed for 300 serious accidents, including 92 serious accidents which involved fire. Personal injury costs were outside the scope of the cost analysis, but data on personnel injury judgements as well as settlements received from the CAB are included for reference.

Lucha, G. V.↗

Interpretation and classification of microvolt T wave alternans tests

Measurement of microvolt-level T wave alternans (TWA) during routine exercise stress testing now is possible as a result of sophisticated noise reduction techniques and analytic methods that have become commercially available. Even though this technology is new, the available data suggest that microvolt TWA is a potent predictor of arrhythmia risk in diverse disease states. As this technology becomes more widely available, physicians will be called upon to interpret microvolt TWA tracings. This review seeks to establish uniform standards for the clinical interpretation of microvolt TWA tracings.

NASA Discipline Cardiopulmonary↗

Visual Data Analysis for Satellites

The Visual Data Analysis Package is a collection of programs and scripts that facilitate visual analysis of data available from NASA and NOAA satellites, as well as dropsonde, buoy, and conventional in-situ observations. The package features utilities for data extraction, data quality control, statistical analysis, and data visualization. The Hierarchical Data Format (HDF) satellite data extraction routines from NASA's Jet Propulsion Laboratory were customized for specific spatial coverage and file input/output. Statistical analysis includes the calculation of the relative error, the absolute error, and the root mean square error. Other capabilities include curve fitting through the data points to fill in missing data points between satellite passes or where clouds obscure satellite data. For data visualization, the software provides customizable Generic Mapping Tool (GMT) scripts to generate difference maps, scatter plots, line plots, vector plots, histograms, timeseries, and color fill images.

Lau, Yee↗

Surface Temperature Data Analysis

Small global mean temperature changes may have significant to disastrous consequences for the Earth's climate if they persist for an extended period. Obtaining global means from local weather reports is hampered by the uneven spatial distribution of the reliably reporting weather stations. Methods had to be developed that minimize as far as possible the impact of that situation. This software is a method of combining temperature data of individual stations to obtain a global mean trend, overcoming/estimating the uncertainty introduced by the spatial and temporal gaps in the available data. Useful estimates were obtained by the introduction of a special grid, subdividing the Earth's surface into 8,000 equal-area boxes, using the existing data to create virtual stations at the center of each of these boxes, and combining temperature anomalies (after assessing the radius of high correlation) rather than temperatures.

Hansen, James↗

Development of Machine Learning Algorithms to Segment and Study Images of Astromaterial Samples

Introduction: Micrometer-scale chemical analyses of chondritic meteorites and mission-returned asteroid samples can reveal details of the physical and chemical processes operating in the early solar system, including processes that gave rise to planets, moons, and minor bodies. These primitive astromaterials are comprised of chondrules, calcium- and aluminum-rich inclusions (CAI), and many other silicates, oxides, metals, sulfides, and fine-grained materials. The chemical and mineralogical complexity of these samples, vast populations of different components, and heterogeneity across mm to km scales, all limit our understanding of the origin and evolution of these materials. Here, we describe recent efforts to use machine learning techniques to automate the segmentation of chemical maps of chondritic meteorites, designed to aid studies of asteroid samples returned by spacecraft. By automating the task of segmentation it will become possible to rapidly analyze and interpret the sizes, shapes, mineralogy, chemistry, and other properties of every chondrule, calcium- and aluminum-rich inclusion (CAI) and other clast within and between asteroid samples. Sample return missions significantly accelerate and heighten the need to develop such new data analysis techniques, and associated data repositories. Techniques: Neural networks require abundant training data, i.e. images which have been segmented by a human user. We have manually segmented data available from previous petrologic and chemical work at NASA Johnson Space Center and the American Museum of Natural History [1-4]. These data were derived from energy- and wavelength-dispersive X-ray spectroscopy (EDS, WDS) mapping of samples from many chondrite groups. The Deeplabv3+ [5] neural network architecture was trained on human-labeled masks and used to create machine-labeled masks. Several different algorithms were investigated, with inputs ranging from common RGB image formats through to hyperspectral datasets, with raw data comprising greyscale maps of Mg, Ca, and Al, with or without Si, Fe, Ti for both EDS and WDS data, and extending to other elements in EDS only. Each greyscale image was paired with a binary mask for each labelled particle type. Results: The trained algorithms can segment (Fig 1), classify, and measure the dimensions of thousands of particles in chemical maps of a standard 1-inch round petrographic section in seconds to minutes, rather than many hours needed by a human. Accuracy of the algorithms varied from chondrite to chondrite and across particle types. Further results and details of the algorithms will be presented at the workshop. Future directions: Machine learning has the potential to revolutionize our understanding of complex particle populations contained within primitive astromaterial, with segmentation being a critical first step. Example applications include better understanding of particle transport, nebular reservoirs, parent body accretion, and a deeper understanding of the relationships between particle populations and bulk rock elemental and isotopic compositions. In addition to benefits that machine learning can bring to individual researchers, building a community data repository of thousands to millions of particles across hundreds of samples will open up many other possibilities. For example, with a large enough dataset it will be possible to search for exceptionally closely matching particles across disparate samples. Such a capability would enable a single CAI from OSIRISREx or Hayabusa/II samples to be matched to chondritic CAIs that exhibit near-identical size, texture, and mineralogy, down to the level of similar core phenocrysts, zonation, and rim sequences. Such comparative analyses will help to disentangle precursor chemistry, chronology, gas/dust reservoirs during heating, and accretion. Such an endeavor would be impossible without machine learning and a large community data repository of astromaterial chemical/mineralogic maps.

Machine Learning↗

Summary Report of the FY24 DOE Contributions to the GIF VHTR CMVB

The Generation-IV Forum (GIF) Very-High-Temperature Reactor-Computational Methods Validation and Benchmark (VHTR-CMVB) initiative, involving organizations from Korea Atomic Energy Research Institute (KAERI) (South Korea), Institute of Nuclear and New Energy Technology of Tsinghua University (INET) (China), U.S. Department of Energy (DOE) (U.S.), Joint Research Centre (JRC) (Europe), and Japan Atomic Energy Agency (JAEA) (Japan), is dedicated to the verification and validation of tools for High-Temperature Gas-Cooled Reactors (HTGRs) analysis, using data shared by Computational Methods Validation and Benchmark (CMVB) signatories. For FY24, the US DOE CMVB has committed to several critical activities. Under WP1, led by the US, the integration of the High Temperature Gas Cooled Reactor - Pebble-Bed Module (HTR-PM) Phenomena Identification and Ranking Table (PIRT) into the comparative PIRT is progressing, with a new draft of the comparison tables issued earlier this year and currently being utilized by INET for their contribution. Neutronic validation efforts under WP3 include the preparation of the burnup analysis benchmark, preliminary calculations, and the development of reference models and results. In WP2, a validation exercise for hot gas mixing in the lower plenum of HTR-PM is in progress, using experimental data from INET (China) to validate modeling approaches. A model of the experimental facility has been developed using StarCCM+, with initial calculations slated for presentation at the GIF CMVB meeting this fall. Another WP2 activity focuses on validating numerical models for air-cooled Reactor Cavity Cooling System (RCCS) with experimental data from the Wisconsin Madison RCCS facility. A high-fidelity model, developed using NEK-RS, is currently being validated with available data from a low power forced convection test. These efforts are aimed at enhancing and confirming the accuracy of HTGR analysis tools, ensuring their alignment with experimental data and regulatory requirements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computing Facility (OLCF), however, we unveiled user behavior about the Summit supercomputer by collecting data from a user’s point of view with ordinary Unix commands.In this paper, we discuss the process, challenges, and lessons learned while preparing this dataset for publication and submission to an open data challenge. The original dataset contains personal identifiable information (PII) about the users of OLCF which needed be masked prior to publication, and we determined that anonymization, which scrubs PII completely, destroyed too much of the structure of the data to be interesting for the data challenge. We instead chose to pseudonymize the dataset, which reduced the linkability of the dataset to the users’ identities. Pseudonymization is significantly more computationally expensive than anonymization, and the size of our dataset, which is approximately 175 million lines of raw text, necessitated the development of a parallelized workflow that could be reused on different HPC machines. We demonstrate the scaling behavior of the workflow on two leadership class HPC systems at OLCF, and we show that we were able to bring the overall makespan time from an impractical 20+ hours on a single node down to around 2 hours. As a result of this work, we release the entire pseudonymized dataset and make the workflows and source code publicly available.

Maheshwari, Ketan↗

Prediction of Distributed River Sediment Respiration Rates Using Community-Generated Data and Machine Learning

River sediment microbial respiration is a key indicator of ecosystem functioning and the biogeochemical fluxes across this critical zone link surface and subsurface waters. As such, there is tremendous interest in measuring and mapping these respiration rates. Respiration observations are expensive and labor intensive; there is limited data available to the community. An open science, collaborative initiative is collecting samples for respiration rate analysis and multi-scale metadata; this evolving data set is being used for making machine learning (ML) predictions at unsampled sites to help inform continued community engagement. However, it is a challenge to find an optimum configuration for ML models to work with this feature-rich (i.e., 100+ possible input variables) data set. Here, we present results from a two-tiered approach to managing the analysis of this complex data set: (a) a stacked ensemble of models that automatically optimizes hyperparameters and manages the training of many models and (b) feature permutation importance to detect the most important features in the models. The major elements of this workflow are modular, portable, open, and cloud-based thus making this implementation a potential template for other applications. The models developed here predict that sediment organic matter chemistry is one of the most important features for predicting sediment respiration rate. Other larger-scale, important features fall into the categories of climatic, ecological, geological, and fluvial settings. Leveraging these larger-scale features to generate data-driven estimates of river sediment respiration rates reveals spatially consistent but heterogeneous patterns across the river network of the Columbia River Basin.

54 ENVIRONMENTAL SCIENCES↗

Analysis of Skylab fluid mechanics science demonstrations

The results of the data reduction and analysis of the Skylab fluid mechanics demonstrations are presented. All the fluid mechanics data available from the Skylab missions were identified and surveyed. The significant fluid mechanics phenomena were identified and reduced to measurable quantities wherever possible. Data correlations were performed using existing theories. Among the phenomena analyzed were: static low-g interface shapes, oscillation frequency and damping of a liquid drop, coalescence, rotating drop, liquid films and low-g ice melting. A survey of the possible applications of the results was made and future experiments are recommended.

Tegart, J. R.↗

Data analysis of the LPSP experiment on OSO-8

The first and statistically most reliable step in the data analysis - the computation of the vertical phase lag between photospheric and chromospheric oscillations - was completed. Unfortunately, the error associated with this calculated phase lag is so great that the result has no physical significance. Since the subsequent data analysis that was originally planned would have much larger associated errors, it was concluded that the data available is insufficient to allow any meaningful results to be derived. Accordingly, the project was terminated. The reasons for the failure of the data are discussed. There are two basic reasons for this failure; (1) the very low signal to noise ratio of the raw data, and (1) the small statistical sample that resulted from the very small number of usable orbits. The final phase of data analysis is described. Finally, some comments and recommendations of a general nature are made concerning this entire contract effort. It is hoped that at least some lessons can be learned from this particular Guest Investigator project, so that future Guest Investigator programs can be pursued more effectively, and with less risk.

Frazier, E. N.↗

The impact of conventional surface data upon VAS regression retrievals in the lower troposphere

Surface temperature and dewpoint reports are added to the infrared radiances from the VISSR Atmospheric Sounder (VAS) in order to improve the retrieval of temperature and moisture profiles in the lower troposphere. The conventional (airways) surface data are combined with the twelve VAS channels as additional predictors in a ridge regression retrieval scheme, with the aim of using all available data to make high resolution space-time interpolations of the radiosonde network. For one day of VAS observations, retrievals using only VAS radiances are compared with retrievals using VAS radiances plus surface data. Temperature retrieval accuracy evaluated at coincident radiosonde sites shows a significant impact within the boundary layer. Dewpoint retrieval accuracy shows a broader improvement within the lowest tropospheric layers. The most dramatic impact of surface data is observed in the improved relative spatial and temporal continuity of low-level fields retrieved over the Midwestern United States.

Lee, T. H.↗

The impact of conventional surface data upon VAS regression retrievals in the lower troposphere

Surface temperature and dewpoint reports are added to the infrared radiances from the VISSR Atmospheric Sounder (VAS) in order to improve the retrieval of temperature and moisture profiles in the lower troposphere. The conventional (airways) surface data are combined with the twelve VAS channels as additional predictors in a ridge regression retrieval scheme, with the aim of using all available data to make high resolution space-time interpolations of the radiosonde network. For one day of VAS observations, retrievals using only VAS radiances are compared with retrievals using VAS radiances plus surface data. Temperature retrieval accuracy evaluated at coincident radiosonde sites shows a significant impact within the boundary layer. Dewpoint retrieval accuracy shows a broader improvement within the lowest tropospheric layers. The most dramatic impact of surface data is observed in the improved relative spatial and temporal continuity of low-level fields retrieved over the Midwestern United States. Previously announced in STAR as N83-27522

Lee, T.-H.↗