Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Behavior sensitivities for control augmented structures

During the past few years it has been recognized that combining passive structural design methods with active control techniques offers the prospect of being able to find substantially improved designs. These developments have stimulated interest in augmenting structural synthesis by adding active control system design variables to those usually considered in structural optimization. An essential step in extending the approximation concepts approach to control augmented structural synthesis is the development of a behavior sensitivity analysis capability for determining rates of change of dynamic response quantities with respect to changes in structural and control system design variables. Behavior sensitivity information is also useful for man-machine interactive design as well as in the context of system identification studies. Behavior sensitivity formulations for both steady state and transient response are presented and the quality of the resulting derivative information is evaluated.

Manning, R. A.↗

Predictive Indicators of the Performance of Large Language Models

In several mission contexts, it is desirable to estimate the performance of large language models (LLMs) on tasks that we cannot run directly. In light of published “scaling laws” our hypothesis is that some tasks should be consistently more challenging than others based on characteristics of the task. The goal of this project was to begin quantifying how much information about LLM performance can be gained from the features of a model and a task. Two of our statistical models struggled to converge. Pass/fail test results may provide limited information for inference beyond model quality and task difficulty, but we see no evidence at this time for significant feature interaction effect sizes, arguing for simple models. Future work extending the models to capitalize on perplexity of ground truth answers is suggested. This project also introduces “Depth of Knowledge Variant Testing” as a strategy for more finely assessing language models on open domain question and answer tasks. We developed sets of questions that ask a language model to produce similar information while demonstrating increasing depth of knowledge, and also relabeled existing Q&A test questions with their depth of knowledge. Our results suggest further consideration of Bloom’s taxonomy and further refinement of prompts to properly elicit information at varying depths. In the course of this work, we set up a basic infrastructure for standardizing tasks and testing many language models on these tasks. In addition to testing the predictive quality of model features and performance across test suites, with this project we have introduced two new task features to contextualize each test question: the Dewey Classification main category of information covered, and the Bloom’s taxonomy level that corresponds to the depth of knowledge probed by the question. Splits across these and other features produced over five hundred task subtypes with distinct feature vectors, which we tested on half a dozen models.

97 MATHEMATICS AND COMPUTING↗

All Source Solution Decision Support Products Created for Stennis Space Center in Response to Hurricane Katrina

In the aftermath of Hurricane Katrina and in response to the needs of SSC (Stennis Space Center), NASA required the generation of decision support products with a broad range of geospatial inputs. Applying a systems engineering approach, the NASA ARTPO (Applied Research and Technology Project Office) at SSC evaluated the Center's requirements and source data quality. ARTPO identified data and information products that had the potential to meet decision-making requirements; included were remotely sensed data ranging from high-spatial-resolution aerial images through high-temporal-resolution MODIS (Moderate Resolution Imaging Spectroradiometer) products. Geospatial products, such as FEMA's (Federal Emergency Management Agency's) Advisory Base Flood Elevations, were also relevant. Where possible, ARTPO applied SSC calibration/validation expertise to both clarify the quality of various data source options and to validate that the inputs that were finally chosen met SSC requirements. ARTPO integrated various information sources into multiple decision support products, including two maps: Hurricane Katrina Inundation Effects at Stennis Space Center (highlighting surge risk posture) and Vegetation Change In and Around Stennis Space Center: Katrina and Beyond (highlighting fire risk posture).

Ross, Kenton W.↗

Flexible Data Fusion for Air Quality Estimation and Forecasting in Google Earth Engine to support Global Health Management Needs

The assessment and forecasting of air quality around the world at high spatial and temporal resolution can be enhanced by integrating data from multiple sources including models, satellites, regulatory monitors, and low-cost sensors. Such integration is subject to numerous technical challenges, however, including heterogeneous data resolution and formatting, different levels of data availability and reliability, and computational and capacity challenges to developing data fusion tools and platforms. This presentation will provide an overview of a NASA-funded effort to develop a data fusion system within the Google Earth Engine platform which integrates these air quality data sources to produce comprehensive assessments and forecasts of key air pollutants at sub-daily and sub-city scales. The system is being developed in collaboration with city- and regional-level air quality managers, and will provide them with information to the assess and anticipate the health impacts of poor air quality, track local changes in air quality due to ongoing transportation and land use changes, and identify potential gaps in their current air quality monitoring strategies. The presentation will report advances achieved through the project, including bringing local air quality monitoring data into Google Earth Engine, quantifying uncertainties in air quality estimates and forecasts, and tailored communications tools providing integration into end-user processes to meet their needs.

Carl Malings↗

Flexible Data Fusion for Air Quality Estimation and Forecasting in Google Earth Engine to support Global Health Management Needs

The assessment and forecasting of air quality around the world at high spatial and temporal resolution can be enhanced by integrating data from multiple sources including models, satellites, regulatory monitors, and low-cost sensors. Such integration is subject to numerous technical challenges, however, including heterogeneous data resolution and formatting, different levels of data availability and reliability, and computational and capacity challenges to developing data fusion tools and platforms. This presentation will provide an overview of a NASA-funded effort to develop a data fusion system within the Google Earth Engine platform which integrates these air quality data sources to produce comprehensive assessments and forecasts of key air pollutants at sub-daily and sub-city scales. The system is being developed in collaboration with city- and regional-level air quality managers and will provide them with information to the assess and anticipate the health impacts of poor air quality, track local changes in air quality due to ongoing transportation and land use changes, and identify potential gaps in their current air quality monitoring strategies. The presentation will report advances achieved through the project, including bringing local air quality monitoring data into Google Earth Engine, quantifying uncertainties in air quality estimates and forecasts, and tailored communications tools providing integration into end-user processes to meet their needs.

Nathan R. Pavlovic↗

Measurement of Cyanobacterial Bloom Magnitude Using Satellite Remote Sensing

Cyanobacterial harmful algal blooms (cyano HABs) are a serious environmental, water quality and public health issue worldwide because of their ability to form dense biomass and produce toxins. Models and algorithms have been developed to detect and quantify cyanoHABs biomass using remotely sensed data but not for quantifying bloom magnitude,information that would guide water quality management decisions. We propose a method to quantify seasonal and annual cyanoHAB magnitude in lakes and reservoirs. The magnitude is the spatio temporal mean of weekly or biweekly maximum cyanobacteria biomass for the season or year. CyanoHAB biomass is quantified using a standard reflectance spectral shape based algorithm that uses data from Medium Resolution Imaging Spectrometer (MERIS). We demonstrate the method to quantify annual and seasonal cyanoHAB magnitude in Florida and Ohio (USA) respectively during 2003-2011 and rank the lakes based on median magnitude over the study period. The new method can be applied to Sentinel-3 Ocean Land Color Imager (OLCI) data for assessment of cyanoHABs and the change over time, even with issues such as variable data acquisition frequency or sensor calibration uncertainties between satellites. CyanoHAB magnitude can support monitoring and management decision making for recreational and drinking water sources.

Sachidananda Mishra↗

The global spectrum of plant form and function: enhanced species-level trait dataset

Here we provide the ‘Global Spectrum of Plant Form and Function Dataset’, containing species mean values for six vascular plant traits. Together, these traits –plant height, stem specific density, leaf area, leaf mass per area, leaf nitrogen content per dry mass, and diaspore (seed or spore) mass – define the primary axes of variation in plant form and function. The dataset is based on ca. 1 million trait records received via the TRY database (representing ca. 2,500 original publications) and additional unpublished data. It provides 92,159 species mean values for the six traits, covering 46,047 species. The data are complemented by higher-level taxonomic classification and six categorical traits (woodiness, growth form, succulence, adaptation to terrestrial or aquatic habitats, nutrition type and leaf type). Data quality management is based on a probabilistic approach combined with comprehensive validation against expert knowledge and external information. Intense data acquisition and thorough quality control produced the largest and, to our knowledge, most accurate compilation of empirically observed vascular plant species mean traits to date.

54 ENVIRONMENTAL SCIENCES↗

Utilization of ERTS-1 for appraising changes in continental migratory bird habitat

The author has identified the following significant results. Information on numbers, distribution, and quality of wetlands in the breeding range of migratory waterfowl is important for the management of this wildlife resource. Using computer processing of data gathered by the ERTS-1 multispectral scanner, techniques for obtaining indices of annual waterfowl recruitment, and habitat quality are examined. As a primary task, thematic maps and statistics relating to open surface water were produced. Discrimination of water was based upon water's low apparent radiance in a single, near-infrared waveband. An advanced technique using multispectral information for discerning open water at a level of detail finer than the virtual resolution of the data was also successfully tested. In another related task, vegetation indicators were used for detecting conditions of latent or occluded water and upland habitat characteristics.

Gilmer, D. S.↗

NDE of ceramics and ceramic composites

Although nondestructive evaluation (NDE) techniques for ceramics are fairly well developed, they are difficult to apply in many cases for high probability detection of the minute flaws that can cause failure in monolithic ceramics. Conventional NDE techniques are available for monolithic and fiber reinforced ceramic matrix composites, but more exact quantitative techniques needed are still being investigated and developed. Needs range from flaw detection to below 100 micron levels in monolithic ceramics to global imaging of fiber architecture and matrix densification anomalies in ceramic composites. NDE techniques that will ultimately be applicable to production and quality control of ceramic structures are still emerging from the lab. Needs are different depending on the processing stage, fabrication method, and nature of the finished product. NDE techniques are being developed in concert with materials processing research where they can provide feedback information to processing development and quality improvement. NDE techniques also serve as research tools for materials characterization and for understanding failure processes, e.g., during thermomechanical testing.

Vary, Alex↗

NDE of ceramics and ceramic composites

Although nondestructive evaluation (NDE) techniques for ceramics are fairly well developed, they are difficult to apply in many cases for high probability detection of the minute flaws that can cause failure in monolithic ceramics. Conventional NDE techniques are available for monolithic and fiber reinforced ceramic matrix composites, but more exact quantitative techniques needed are still being investigated and developed. Needs range from flaw detection to below 100 micron levels in monolithic ceramics to global imaging of fiber architecture and matrix densification anomalies in ceramic composites. NDE techniques that will ultimately be applicable to production and quality control of ceramic structures are still emerging from the lab. Needs are different depending on the processing stage, fabrication method, and nature of the finished product. NDE techniques are being developed in concert with materials processing research where they can provide feedback information to processing development and quality improvement. NDE techniques also serve as research tools for materials characterization and for understanding failure processes, e.g., during thermomechanical testing.

Vary, Alex A.↗

ORNL Package Testing Program Software Quality Assurance Plan

The Oak Ridge National Laboratory (ORNL) Package Testing Program (PTP) uses commercial off-the-shelf (COTS) software in performing data collection of thermal test results for package designs that contain radioactive materials. Specifically, this software is used to collect temperature data from the furnace, packages, and ambient air to prepare and execute the thermal test specified in 10 CFR 71.73, “Thermal Test.” This software quality assurance (SQA) plan sets forth the guidelines, standards, and procedures that shall be used to provide SQA for PTP software applications. This is a living document that will be maintained for the lifecycle of the PTP program. The SQA plan follows the requirements set forth in ORNL Standards Based Management System (SBMS): Information Technology; Subject Area: Software Quality Assurance. When applicable to the requirements as described in ORNL SBMS, Software Quality Assurance, the software shall be listed in the ORNL Software Registration System (SRS). Exemptions to this SBMS are COTS and firmware that are not modified; spreadsheet applications and personal productivity tools that do not have a utility or safety application, research applications, legacy software, system software, vendor-supplied software used to interface with the vendor’s services, software used within the organization to facilitate processing or management of information, and software developed for applications not specific to the US Department of Energy (DOE).

97 MATHEMATICS AND COMPUTING↗

Quality Ranking of Unary Fluoride Salt Property Data in MSTDB-TP

Molten salt reactor developers rely on thermal property data to design, license and operate the reactors they are developing. The Molten Salt Thermal Database-Thermophysical Properties (MSTDB-TP) is being developed under the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program and managed by Oak Ridge National Laboratory. The MSTDB-TP is intended to serve as a single source of measured thermophysical property values for a wide variety of molten salt systems available to researchers, molten salt reactor developers, and regulators. These properties include melting and boiling points, heat capacity, density, viscosity and thermal diffusivity and conductivity. Published measurements of molten salt properties are lacking for many salts and the data that are available are often inconsistent. This creates a challenge for MSR developers in determining which property values to select when designing their reactors. The MSDTDB-TP collects all available property data and down-selects to preferred data sets or correlations. It is the purpose of this work to apply a recently developed ranking system that indicates the quality of property values listed in the database to inform decisions about how to use the available data. Quality assessments and rankings are being applied to data in MSTDB-TP to provide an indication of the quality of the data available. A previous report detailed the ranking system that was followed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network

Abstract Background Estimation of the accuracy (quality) of protein structural models is important for both prediction and use of protein structural models. Deep learning methods have been used to integrate protein structure features to predict the quality of protein models. Inter-residue distances are key information for predicting protein’s tertiary structures and therefore have good potentials to predict the quality of protein structural models. However, few methods have been developed to fully take advantage of predicted inter-residue distance maps to estimate the accuracy of a single protein structural model. Result We developed an attentive 2D convolutional neural network (CNN) with channel-wise attention to take only a raw difference map between the inter-residue distance map calculated from a single protein model and the distance map predicted from the protein sequence as input to predict the quality of the model. The network comprises multiple convolutional layers, batch normalization layers, dense layers, and Squeeze-and-Excitation blocks with attention to automatically extract features relevant to protein model quality from the raw input without using any expert-curated features. We evaluated DISTEMA’s capability of selecting the best models for CASP13 targets in terms of ranking loss of GDT-TS score. The ranking loss of DISTEMA is 0.079, lower than several state-of-the-art single-model quality assessment methods. Conclusion This work demonstrates that using raw inter-residue distance information with deep learning can predict the quality of protein structural models reasonably well. DISTEMA is freely at https://github.com/jianlin-cheng/DISTEMA

59 BASIC BIOLOGICAL SCIENCES↗

Information theory optimization of signals from small-angle scattering measurements

Small-angle X-ray scattering (SAXS) of particles in solution informs on the conformational states and assemblies of biological macromolecules (bioSAXS) outside of cryo- and solid-state conditions. In bioSAXS, the SAXS measurement under dilute conditions is resolution limited, and through an inverse Fourier transform, the measured SAXS intensities directly relate to the physical space occupied by the particles via the P (r)-distribution. Yet, this inverse transform of SAXS data has been historically cast as an ill-posed, ill-conditioned problem requiring an indirect approach. Here, we show that through the applications of matrix and information theories, the inverse transform of SAXS intensity data is a well-conditioned problem. The so-called ill-conditioning of the inverse problem is directly related to the Shannon number. By exploiting the oversampling enabled by modern detectors, a direct inverse Fourier transform of the SAXS data is possible, provided the recovered information does not exceed the Shannon number. The Shannon limit corresponds to the maximum number of significant singular values that can be recovered in a SAXS experiment, suggesting this relationship is a fundamental property of band-limited inverse integral transform problems. This correspondence reduces the complexity of the inverse problem to the Shannon limit and maximum dimension. We propose a hybrid scoring function using an information theory framework that assesses both the quality of the model-data fit as well as the quality of the recovered P (r)-distribution. The hybrid score utilizes the Akaike information criteria and Durbin-Watson statistic that considers parameter-model complexity, i.e., degrees of freedom, and the randomness of the model-data residuals. The described tests and findings extend the boundaries for bioSAXS by completing the information theory formalism initiated by Peter B. Moore to enable a quantitative measure of resolution in SAXS, robustly determine maximum dimension, and more precisely define the best parameter model appropriately representing the observed scattering data.

Rambo, Robert P. [Science and Technology Facilitie↗

Air Quality Analysis and Tools For Policy

South Asia is home to some of the most significant air quality challenges in the world. More than 99% of the region’s population is exposed to unhealthy fine particulate matter (PM2.5) concentrations, as defined by the World Health Organization. Recent policy initiatives in South Asia show that air quality policy is a priority, given the health impacts of air pollution. At the same time, capacity and data to assess and address air pollution remains limited in many areas. The main objective of this report is to outline a set of publicly-available tools that can be used to inform policies to improve air quality in South Asia. The report primarily focuses on tools such as emission inventories and integrated modeling systems with country-level resolution and illustrates their air quality assessment capabilities through examples and brief technical summaries. The report focuses on: (a) the Community Emissions Data System (CEDS) that provides historical emissions of key pollutants for all countries in South Asia, and (b) profiles an analysis of Indian air pollution and policy scenarios, using several integrated modeling tools. Both of these examples draw on recent research and data that outlines the scale of the challenge as well as the policy options for reducing air pollution in the region. The report concludes with key recommendations for regional stakeholders working towards mitigating air pollution in South Asia.

54 ENVIRONMENTAL SCIENCES↗

User's guide for the Solar Backscattered Ultraviolet (SBUV) and the Total Ozone Mapping Spectrometer (TOMS) RUT-S and RUT-T data sets: October 31, 1978 to November 1, 1980

Raw data from the Solar Backscattered Ultrviolet/Total Ozone Mapping Spectrometer (SBUV/TOMS) Nimbus 7 operation are available on computer tape. These data are contained on two separate sets of RUTs (Raw Units Tapes) for SBUV and TOMS, labelled RUT-S and RUT-T respectively. The RUT-S and RUT-T tapes contain uncalibrated radiance and irradiance data, housekeeping data, wavelength and electronic calibration data, instrument field-of-view location and solar ephemeris information. These tapes also contain colocated cloud, terrain pressure and snow/ice thickness data, each derived from an independent source. The "RUT User's Guide" describes the SBUV and TOMS experiments, the instrument calibration and performance, operating schedules, and data coverage, and provides an assessment of RUT-S and -T data quality. It also provides detailed information on the data available on the computer tapes.

Fleig, A. J.↗

Clarifying the trophic state concept to advance macroscale freshwater science and management

For over a century, ecologists have used the concept of trophic state (TS) to characterize an aquatic ecosystem's biological productivity. However, multiple TS classification schemes, each relying on a variety of measurable parameters as proxies for productivity, have emerged to meet use‐specific needs. Frequently, chlorophyll a, phosphorus, and Secchi depth are used to classify TS based on autotrophic production, whereas phosphorus, dissolved organic carbon, and true color are used to classify TS based on both autotrophic and heterotrophic production. Both classification approaches aim to characterize an ecosystem's function broadly, but with varying degrees of autotrophic and heterotrophic processes considered in those characterizations. Moreover, differing classification schemes can create inconsistent interpretations of ecosystem integrity. For example, the US Clean Water Act focuses exclusively on algal threats to water quality, framed in terms of eutrophication in response to nutrient loading. This usage lacks information about non‐algal threats to water quality, such as dystrophication in response to dissolved organic carbon loading. Consequently, the TS classification schemes used to identify eutrophication and dystrophication may refer to ecosystems similarly (e.g., oligotrophic and eutrophic), yet these categories are derived from different proxies. These inconsistencies in TS classification schemes may be compounded when interdisciplinary projects employ varied TS frameworks. Even with these shortcomings, TS can still be used to distill information on complex aquatic ecosystem function into a set of generalizable expectations. The usefulness of distilling complex information into a TS index is substantial such that usage inconsistencies should be explicitly addressed and resolved. To emphasize the consequences of diverging TS classification schemes, we present three case studies for which an improved understanding of the TS concept advances freshwater research, management efforts, and interdisciplinary collaboration. To increase clarity in TS, the aquatic sciences could benefit from including information about the proxy variables, ecosystem type, as well as the spatiotemporal domains used to classify TS. As the field of aquatic sciences expands and climatic irregularity increases, we highlight the importance of re‐evaluating fundamental concepts, such as TS, to ensure their compatibility with evolving science.

classification↗

A Multi-Analysis Approach for Estimating Regional Health Impacts from the 2017 Northern California Wildfires

In the evening of October 8 and early hours of October 9, 2017, high winds in Northern California downed trees and power lines, igniting some of the most devastating wildfires the state had seen, and within hours unhealthy air quality impacted millions of people. We simulated these air quality conditions using fire detection information from the MODIS, VIIRS, and GOES-16 ABI satellite instruments, and applying a set of three WRF–CMAQ simulations, one data fusion, and three machine learning methods. We investigated using the 5-min available GOES-16 fire detection data to simulate timing of fire activity to allocate emissions hourly for the WRF-CMAQ air quality modeling system. Interestingly, this approach did not necessarily improve results compared to the baseline case, which used a default time profile. However, this approach was key to simulating the initial 12-hr explosive fire activity and smoke impacts. The WRF-CMAQ simulations compared well with observational data for the October 8-15 time period and tended to overestimate concentrations October 16-20. To improve these results, we applied three machine learning algorithms. We also had a unique opportunity to evaluate results with temporary monitors deployed specifically for wildfires, and performance was markedly different. For example, at the permanent monitoring locations, the WRF-CMAQ simulations had a Pearson correlation of 0.65, and the data fusion approach improved this (Pearson correlation = 0.95), while at the temporary monitor locations across the WRF-CMAQ, data fusion, and machine learning datasets, the best Pearson correlation was 0.5. The data fusion and machine learning results were biased low and WRF-CMAQ results were biased high. Finally, we applied the optimized PM2.5 exposure estimate in a short-term exposure-response function. Total estimated mortality attributable to PM2.5 exposure during the smoke episode was 83 (95% confidence interval: 0, 196) with 47% of these deaths attributable to wildland fire smoke.

O'Neill, Susan↗