Generating Fine-Scale Aerosol Data through Downscaling with an Artificial Neural Network Enhanced with Transfer Learning
Explore the source record for details and available documents.
Menglin Wang↗
SEARCH · Engineering Papers
Results for “data enhancement”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Algorithms and File Structure to Extend and Enhance Liquid Chromatography and Ion Mobility Mass Spectrometry Workflows
The purpose of this project is to continue supporting customizations of algorithms and raw data file structures to enhance software workflows for liquid chromatography (LC), mass spectrometry (MS) and ion mobility mass spectrometry (IM-MS)-based protein and metabolite characterization.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
The New Face of Data Accessibility
Management of medical and research data at NASA's Johnson Space Center has been addressed with two separate, independent systems: the Lifetime Surveillance of Astronaut Health (formerly, The Longitudinal Study of Astronaut Health) (LSAH) and the Life Sciences Data Archive (LSDA). Project management for these has been autonomous with little or no cross-over of goals, objectives or strategy. The result has been limited debate and discussion regarding how contents from one repository might impact or guide the direction of the other. It is decidedly more efficient to use existing data and information than to re-generate them. Ensuring that both clinical and research data / information are accessible for review is a central concept to the decision to unify these repositories. In the past, research data from flight and ground analogs has been held in the LSDA and medical data held in the Electronic Medical Record or in console flight surgeon logs and records. There was little cross-pollination between medical and research findings and, as a result, applicable research was not being fully incorporated into clinical, in-flight practice. Conversely, findings by the console surgeon were not being picked up by the research community. The desired life cycle for risk mitigation was not being fully realized. The goal of unifying these repositories and processes is to provide a closely knit approach to handling medical and research data, which will not only engender discussion and debate but will also ensure that both categories of data and information are used to enhance the use of medical and research data to reduce risk and promote the understanding of space physiology, countermeasures and other mitigation strategies
Fitts, Mary A.↗
Principal Component Analysis of Thermographic Data
Principal Component Analysis (PCA) has been shown effective for reducing thermographic NDE data. While a reliable technique for enhancing the visibility of defects in thermal data, PCA can be computationally intense and time consuming when applied to the large data sets typical in thermography. Additionally, PCA can experience problems when very large defects are present (defects that dominate the field-of-view), since the calculation of the eigenvectors is now governed by the presence of the defect, not the "good" material. To increase the processing speed and to minimize the negative effects of large defects, an alternative method of PCA is being pursued where a fixed set of eigenvectors, generated from an analytic model of the thermal response of the material under examination, is used to process the thermal data from composite materials. This method has been applied for characterization of flaws.
Winfree, William P.↗
WIS and WIGOS Metadata as the Foundation for a Sustainable Framework for Global Greenhouse Gas Watch Data Exchange
Metadata (data about data) is a critical component of data discovery, description, evaluation, documentation, and preservation. Developing and propagating metadata standards has been a longstanding area of activity in WMO and beyond. The WIS2 and WIGOS metadata models are being actively developed and maintained by dedicated task teams, established under the WMO Expert Team on Metadata. The metadata representations and vocabularies are governed by well-established processes within WMO. These standards are being used in a number of metadata/data exchange activities (e.g., WMO Information System 2.0 (WIS2), WIGOS (WMDR), Climate Data Management Systems (CMDS), etc.). It should also be noted that the application of the WIS2 and WIGOS standards fully support the WMO Unified Data Policy and open data policy as well as greatly enhance the value of observations by fostering data F.A.I.R.ness. Furthermore, the WMO metadata standards can serve as the foundation for a framework that will facilitate metadata mapping between the existing schemas used in well-established data centres, e.g., WMO WDCGG (World Data Centre for Greenhouse Gases) and NOAA ObsPack (Observation Package Data Products) and to automate metadata exchange between data centres as well as with WMO. These activities will play a central role in integrating measurements sponsored by various member countries and organizations to provide a more comprehensive characterization of the temporal and spatial distribution of the greenhouse gases. At the same time, this metadata exchange can lead to member countries and partner organizations improving their current metadata collection process for data discoverability, interoperability, and (re)usability. This presentation will describe metadata activities in the context of WIS2 and WIGOS and how they apply to GGGW data integration via metadata mapping and exchange.
Gao Chen↗
Pre-coding method and apparatus for multiple source or time-shifted single source data and corresponding inverse post-decoding method and apparatus
A pre-coding method and device for improving data compression performance by removing correlation between a first original data set and a second original data set, each having M members, respectively. The pre-coding method produces a compression-efficiency-enhancing double-difference data set. The method and device produce a double-difference data set, i.e., an adjacent-delta calculation performed on a cross-delta data set or a cross-delta calculation performed on two adjacent-delta data sets, from either one of (1) two adjacent spectral bands coming from two discrete sources, respectively, or (2) two time-shifted data sets coming from a single source. The resulting double-difference data set is then coded using either a distortionless data encoding scheme (entropy encoding) or a lossy data compression scheme. Also, a post-decoding method and device for recovering a second original data set having been represented by such a double-difference data set.
Yeh, Pen-Shu↗
Pre-coding method and apparatus for multiple source or time-shifted single source data and corresponding inverse post-decoding method and apparatus
A pre-coding method and device for improving data compression performance by removing correlation between a first original data set and a second original data set, each having M members, respectively. The pre-coding method produces a compression-efficiency-enhancing double-difference data set. The method and device produce a double-difference data set, i.e., an adjacent-delta calculation performed on a cross-delta data set or a cross-delta calculation performed on two adjacent-delta data sets, from either one of (1) two adjacent spectral bands coming from two discrete sources, respectively, or (2) two time-shifted data sets coming from a single source. The resulting double-difference data set is then coded using either a distortionless data encoding scheme (entropy encoding) or a lossy data compression scheme. Also, a post-decoding method and device for recovering a second original data set having been represented by such a double-difference data set.
Yeh, Pen-Shu↗
Learning-Based Real-Time Event Identification Using Rich Real PMU Data
A large-scale deployment of phasor measurement units (PMUs) that reveal the inherent physical laws of power systems from a data perspective enables an enhanced awareness of power system operation. However, the high-granularity and non-stationary nature of PMU data and imperfect data quality could bring great technical challenges for real-time system event identification. To address these challenges, this paper proposes a two-stage learning-based framework. In the first stage, a Markov transition field (MTF) algorithm is exploited to extract the latent data features by encoding temporal dependency and transition statistics of PMU data in graphs. Then, a spatial pyramid pooling (SPP)-aided convolutional neural network (CNN) is established to efficiently and accurately identify power events. The proposed method fully builds on and is also tested on a large real-world dataset from several tens of PMU sources (and the corresponding event logs), located across the U.S., with a time span of two consecutive years. We report the numerical results validate that our method has high identification accuracy while showing good robustness against poor data quality.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Inference-Optimized AI and High Performance Computing for Gravitational Wave Detection at Scale
We introduce an ensemble of artificial intelligence models for gravitational wave detection that we trained in the Summit supercomputer using 32 nodes, equivalent to 192 NVIDIA V100 GPUs, within 2 h. Once fully trained, we optimized these models for accelerated inference using NVIDIA TensorRT. We deployed our inference-optimized AI ensemble in the ThetaGPU supercomputer at Argonne Leadership Computer Facility to conduct distributed inference. Using the entire ThetaGPU supercomputer, consisting of 20 nodes each of which has 8 NVIDIA A100 Tensor Core GPUs and 2 AMD Rome CPUs, our NVIDIA TensorRT-optimized AI ensemble processed an entire month of advanced LIGO data (including Hanford and Livingston data streams) within 50 s. Our inference-optimized AI ensemble retains the same sensitivity of traditional AI models, namely, it identifies all known binary black hole mergers previously identified in this advanced LIGO dataset and reports no misclassifications, while also providing a 3X inference speedup compared to traditional artificial intelligence models. We used time slides to quantify the performance of our AI ensemble to process up to 5 years worth of advanced LIGO data. In this synthetically enhanced dataset, our AI ensemble reports an average of one misclassification for every month of searched advanced LIGO data. We also present the receiver operating characteristic curve of our AI ensemble using this 5 year long advanced LIGO dataset. This approach provides the required tools to conduct accelerated, AI-driven gravitational wave detection at scale.
97 MATHEMATICS AND COMPUTING↗
The Lunar Geophysical Network Mission
Overarching Principles: Must be better than Apollo (coverage, duration, instrument performance); Learn from the Apollo experience. Lunar Geophysical Network (LGN) New Frontiers (NF)-class mission, as part of the NF-5 call. “This mission consists of several identical landers distributed across the lunar surface, each carrying geophysical instrumentation. The primary science objectives are to characterize the Moon’s internal structure, seismic activity, global heat flow budget, bulk composition, & magnetic field.” Global distribution of multiple stations. Each station should contain a seismometer, heat flow probe, electromagnetic sounder, laser retroreflector (lunar nearside). Each station must be long-lived (e.g., approximately10 years)to allow other stations (from other countries?) to be integrated with the anchor nodes to form the International Lunar Network. Why LGN? Planetary Science: Moon represents an end-member in planetary evolution (large small body, small rocky planet); Primary planetary differentiation preserved; Key to understanding terrestrial planet initial differentiation. Lunar Science: Heat flow probes yield crustal heat budget estimates; Combined with EMS (ElectroMagnetic Sounding), the temperature profile of the deep interior can be modeled along with mineralogy; Seismic and LLR (Lunar Laser Ranging) data also yield structure and compositional information of the lunar interior; High fidelity data from LGN would enhance the usefulness of the GRAIL (Gravity Recovery and Interior Laboratory) and SELENE (Selenological and Engineering Explorer) gravity data. Human Exploration: LGN must be established prior to renewed human lunar activity - we do not know the exact locations or causes of the shallow moonquakes (SMQs) - the largest magnitude seismic events recorded by Apollo (1 event per year of magnitude greater than or equal to 5); Establishing surface infrastructure near SMQ epicenters must be avoided.
Neal, C. R.↗
The R -process Alliance: Fifth Data Release from the Search for R -process-enhanced Metal-poor Stars in the Galactic Halo with the GTC
Understanding the abundance pattern of metal-poor stars and the production of heavy elements through various nucleosynthesis processes offers crucial insights into the chemical evolution of the Milky Way, revealing primary sites and major sources of rapid neutron-capture process (r-process) material in the Universe. In this fifth data release from the R-Process Alliance (RPA), we present the detailed chemical abundances of 41 faint (down to V = 15.8) and extremely metal-poor (down to [Fe/H] = -3.3) halo stars selected from the RPA. We obtained high-resolution spectra for these objects with the HORuS spectrograph on the Gran Telescopio Canarias. We measure the abundances of light, α, Fe-peak, and neutron-capture elements. We report the discovery of five carbon-enhanced metal-poor, one limited-r, three r-I, and four r-II stars, and six Mg-poor stars. We also identify one star of a possible globular cluster origin at an extremely low metallicity at [Fe/H] = -3.0. This adds to the growing evidence of a lower-limit metallicity floor for globular cluster abundances. We use the abundances of Fe-peak elements and the α-elements to investigate the contributions from different nucleosynthesis channels in the progenitor supernovae. We find the distribution of [Mg/Eu] as a function of [Fe/H] to have different enrichment levels, indicating different possible pathways and sites of their production. We also reveal differences in the trends of the neutron-capture element abundances of Sr, Ba, and Eu of various r-I and r-II stars from the RPA data releases, which provide constraints on their nucleosynthesis sites and subsequent evolution.
79 ASTRONOMY AND ASTROPHYSICS↗
Algorithms and file structures to extend and enhance liquid chromatography and ion mobility mass spectrometry workflows (CRADA Final Report)
The purpose of this project was to continue supporting customizations of algorithms and raw data file structures to enhance software workflows for liquid chromatography (LC), mass spectrometry (MS) and ion mobility mass spectrometry (IM-MS)-based protein and metabolite characterization. PNNL worked with Agilent to design, implement, evaluate, and demonstrate new algorithms and integrated them as functionalities into the PNNL-PreProcessor software. The project augmented PNNL’s capabilities to analyze complex proteomics and metabolomics samples. These capabilities are directly beneficial to DOE and PNNL efforts to characterize and analyze these compounds in microbial and plant communities. The project assisted Agilent in further developing improved instrument-software solutions combining liquid chromatography and ion mobility with mass spectrometry for widespread applications in life sciences and other fields.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Novel Advancements in Internet-Based Real Time Data Technologies
AZ Technology has been working with MSFC Ground Systems Department to find ways to make it easier for remote experimenters (RPI's) to monitor their International Space Station (ISS) payloads in real-time from anywhere using standard/familiar devices. AZ Technology was awarded an SBIR Phase I grant to research the technologies behind and advancements of distributing live ISS data across the Internet. That research resulted in a product called "EZStream" which is in use on several ISS-related projects. Although the initial implementation is geared toward ISS, the architecture and lessons learned are applicable to other space-related programs. This paper presents the high-level architecture and components that make up EZStream. A combination of commercial-off-the-shelf (COTS) and custom components were used and their interaction will be discussed. The server is powered by Apache's Jakarta-Tomcat web server/servlet engine. User accounts are maintained in a My SQL database. Both Tomcat and MySQL are Open Source products. When used for ISS, EZStream pulls the live data directly from NASA's Telescience Resource Kit (TReK) API. TReK parses the ISS data stream into individual measurement parameters and performs on-the- fly engineering unit conversion and range checking before passing the data to EZStream for distribution. TReK is provided by NASA at no charge to ISS experimenters. By using a combination of well established Open Source, NASA-supplied. and AZ Technology-developed components, operations using EZStream are robust and economical. Security over the Internet is a major concern on most space programs. This paper describes how EZStream provides for secure connection to and transmission of space- related data over the public Internet. Display pages that show sensitive data can be placed under access control by EZStream. Users are required to login before being allowed to pull up those web pages. To enhance security, the EZStream client/server data transmissions can be encrypted to preclude interception. EZStream was developed to make use of a host of standard platforms and protocols. Each are discussed in detail in this paper. The I3ZStream server is written as Java Servlets. This allows different platforms (i.e. Windows, Unix, Linux . Mac) to host the server portion. The EZStream client component is written in two different flavors: JavaBean and ActiveX. The JavaBean component is used to develop Java Applet displays. The ActiveX component is used for developing ActiveX-based displays. Remote user devices will be covered including web browsers on PC#s and scaled-down displays for PDA's and smart cell phones. As mentioned. the interaction between EZStream (web/data server) and TReK (data source) will be covered as related to ISS. EZStream is being enhanced to receive and parse binary data stream directly. This makes EZStream beneficial to both the ISS International Partners and non-NASA applications (i.e. factory floor monitoring). The options for developing client-side display web pages will be addressed along with the development of tools to allow creation of display web pages by non-programmers.
Myers, Gerry↗
Diverse Super-Resolution (diversity_SR) [SWR-21-60]
Deep learning tools for enhancing the spatial resolution of wind data. The software is developed in Python using the TensorFlow deep learning package. Models for diversity super-resolution is provided. Included in the package are pretrained models with example code/data to perform the super-resolution as well as tools of training models for different enhancement- or data-types. The super-resolution is an inherently ill-conditioned problem, with multiple high-resolution fields plausibly mapping to the same coarse field. Considitional GANs provide a framework for generating a distribution of high-resolution realizations from a given low-resolution input. Stochastic estimation is used to inform the network of the expected degree and location of sub-grid diversity. The package includes a pretrained network to generate distributions of 10x-enhanced fields of wind data.
Glaws, Andrew↗
WHONDRS-GUI: a web application for global survey of surface water metabolites
Background The Worldwide Hydrobiogeochemistry Observation Network for Dynamic River Systems (WHONDRS) is a consortium that aims to understand complex hydrologic, biogeochemical, and microbial connections within river corridors experiencing perturbations such as dam operations, floods, and droughts. For one ongoing WHONDRS sampling campaign, surface water metabolite and microbiome samples are collected through a global survey to generate knowledge across diverse river corridors. Metabolomics analysis and a suite of geochemical analyses have been performed for collected samples through the Environmental Molecular Sciences Laboratory (EMSL). The obtained knowledge and data package inform mechanistic and data-driven models to enhance predictions of outcomes of hydrologic perturbations and watershed function, one of the most critical components in model-data integration. To support efforts of the multi-domain integration and make the ever-growing data package more accessible for researchers across the world, a Shiny/R Graphical User Interface (GUI) called WHONDRS-GUI was created. Results The web application can be run on any modern web browser without any programming or operational system requirements, thus providing an open, well-structured, discoverable dataset for WHONDRS. Together with a context-aware dynamic user interface, the WHONDRS-GUI has functionality for searching, compiling, integrating, visualizing and exporting different data types that can easily be used by the community. The web application and data package are available at https://data.ess-dive.lbl.gov/view/doi:10.15485/1484811 , which enables users to simultaneously obtain access to the data and code and to subsequently run the web app locally. The WHONDRS-GUI is also available for online use at Shiny Server ( https://xmlin.shinyapps.io/whondrs/ ).
59 BASIC BIOLOGICAL SCIENCES↗
WCRP Task Team for the Intercomparison of ReAnalyses (TIRA): Motivation and Progress
Reanalyses have proven to be an important resource for weather and climate related research, as well as societal applications at large. New atmospheric reanalyses in various forms are produced every few years. In addition, land and ocean communities are producing disciplinary uncoupled reanalyses, and regional reanalyses are emerging in addition to global reanalyses. Systems of data information are being developed to facilitate the intercomparison of reanalyses among themselves and with observations and climate change experiments (e.g. CREATE-IP and WRIT). Current research and development in reanalysis is directed at (1) extending the length of reanalyzed period and (2) use of coupled Earth system models for climate reanalysis. While the World Climate Research Programme (WCRP) involvement in the reanalyses communities through its Data Advisory Council (WDAC) has been substantial, for example in organizing international conferences on reanalyses. However, these efforts have previously not included an analysis of the differences among reanalyses and their inherent uncertainties which are important questions for both users and developers of reanalyses. Therefore, the WCRP Task Team for the Intercomparison of ReAnalyses (TIRA) task team has been formed as collaborative effort to address reanalyses role in WCRP. This constitutes a logical progression that fills the needs of the community and contributes to the WCRP mission. The primary charge to TIRA is to develop a reanalysis intercomparison project plan that will attain the following objectives.1)To foster understanding and estimation of uncertainties in reanalysis data by intercomparison and other means)To communicate new developments and best practices among the reanalyses producing centers3)To enhance the understanding of data and assimilation issues and their impact on uncertainties, leading to improved reanalyses for climate assessment4)To communicate the strengths and weaknesses of reanalyses, their fitness for purpose, and best practices in the use of reanalysis datasets by the scientific communityThis contribution outlines the need for a task team on reanalyses, their intercomparison, the objectives of the team and progress thus far. Results for some pilot intercomparisons will also be discussed.
Bosilovich, Michael↗
Quality Assessment of Molten Salt Thermochemical Property Data
Recommendations are made to enhance user confidence in property values included in the Molten Salt Thermal Database-Thermochemical Properties (MSTDB-TC). Specifically, it is recommended that all available measured values be included with a transparent assessment of each to arrive at a preferred value for each salt composition in the database. The use of a quality assessment and ranking system is recommended for data and property values compiled in the MSTDB-TC that is analogous to the approach developed for data and property values included in the MSTDB-Thermophysical Properties (TP) database. The approach includes assessments of five features of data collection: the method used to measure the property value, calibration of devices used to make the measurements, the quantified uncertainty of the results, control of the environmental conditions, and determination of the salt composition. The quality of each facet is ranked as High, Moderate, or Incomplete based on objective metrics. The overall quality of the dataset is ranked based on rankings of the five data features and traceability of the reported property value, with rankings of A and B indicating the data and property value are deemed suitable for quantitative use, C indicating the value is computed and not validated and U indicating uncertainties restrict the recommended use to qualitative purposes. Sufficient information should be provided or cited within each data set included in the database to verify the reported property value. The recommended approach is suitable for assessing data already in the MSTDB-TC and screening new entries.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Overview of the NASA Earth Action Strategies Wildland Fire Initiative
As part of NASA’s new Earth Action strategy, the Wildland Fire initiative was established, which includes both the NASA Wildland Fire Program (WFP) and the FireSense project. NASA has over 50 years of experience generating data and technology to enhance fire science and operational management. The WFP’s mission is threefold: 1) assemble communities of practice through collaborative efforts with government, academia, and the private sector; 2) co-develop knowledge and applications with relevant partners and stakeholders in the wildfire community; and 3) improve wildland fire management through the transitioning of NASA data, technology, tools, and science to stakeholder organizations. The WFP is focusing on supporting proactive fire management, including situational awareness, preparedness, and risk mitigation. This will be accomplished through selected projects that identify management challenges, relevant to partners and end users, and the NASA data that will be utilized to deliver innovative solutions to enhance the management of wildland fires. Examples include: i) investigation of evaporative stress from OpenET to help predict the risk of wildfire occurrence in watersheds; ii) incorporation of space based LiDAR for the generation of 3-dimensional forest fuel metrics, used to improve wildfire risk and behavior models; iii) integration of global, multi-platform geostationary active-fire data in near-real-time into NASA’s Fire Information for Resource Management System (FIRMS); and iv) identification of post-fire ecohydrological conditions using thermal, multispectral, synthetic aperture radar (SAR), and hyperspectral remotely-sensed data to improve flood hazard forecast models. The FireSense project is a US-focused 5-year project that will focus on delivering NASA’s unique Earth science and technological capabilities to operational agencies, striving towards enhancing fire fighting and air quality management. The project will include airborne campaigns and new technology that will likely have global implications. Initial stakeholder engagement led FireSense to focus on four use-cases focused on the characterization and measurement of: (i) pre-fire fuels conditions, (ii) active fire-dynamics; (iii) post-fire impact and threats; and iv) air quality impacts and forecasting, each-developed with identified stakeholders.
Wildland Fire program↗