Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as 'recommendations'. We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most 'quality' recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as recommendations . We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most quality recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗

Mission leverage education: NSU/NASA innovative undergraduate model

The BEST Lab (Center for Excellence in Science Education), the Center for Materials Research (CMR), and the Chemistry, Mathematics, Physics, and Computer Science (CS) Departments at Norfolk State University (NSU) joined forces to implement MiLEN(2) IUM - an innovative approach tu integrate current and emerging research into the undergraduate curricula and train students on NASA-related fields. An Earth Observing System (EOS) mission was simulated where students are educated and trained in many aspects of Remote Sensing: detector physics and spectroscopy; signal processing; data conditioning, analysis, visualization; and atmospheric science. This model and its continued impact is expected to significantly enhance the quality of the Mathematics, Science, Engineering and Technology (MSET or SMET) educational experience and to inspire students from historically underrepresented groups to pursue careers in NASA-related fields. MiLEN(2) IUM will be applicable to other higher education institutions that are willing to make the commitment to this endeavor in terms of faculty interest and space.

Chaudhury, S. Raj↗

The Biotechnology Facility for International Space Station

The primary mission of the Cellular Biotechnology Program is to advance microgravity as a tool in basic and applied cell biology. The microgravity environment can be used to study fundamental principles of cell biology and to achieve specific applications such as tissue engineering. The Biotechnology Facility (BTF) will provide a state-of-the-art facility to perform cellular biotechnology research onboard the International Space Station (ISS). The BTF will support continuous operation, which will allow performance of long-duration experiments and will significantly increase the on-orbit science throughput. With the BTF, dedicated ground support, and a community of investigators, the goals of the Cellular Biotechnology Program at Johnson Space Center are to: Support approximately 400 typical investigator experiments during the nominal design life of BTF (10 years). Support a steady increase in investigations per year, starting with stationary bioreactor experiments and adding rotating bioreactor experiments at a later date. Support at least 80% of all new cellular biotechnology investigations selected through the NASA Research Announcement (NRA) process. Modular components - to allow sequential and continuous experiment operations without cross-contamination Increased cold storage capability (+4 C, -80 C, -180 C). Storage of frozen cell culture inoculum - to allow sequential investigations. Storage of post-experiment samples - for return of high quality samples. Increased number of cell cultures per investigation, with replicates - to provide sufficient number of samples for data analysis and publication of results in peer-reviewed scientific journals.

Goodwin, Thomas↗

Fundamental Test of a Hovering Rotor: Comprehensive Measurements for CFD Validation

A model-scale hover test of a 4-bladed, 11.08-ft diameter rotor was recently completed inside the National Full-Scale Aerodynamics Complex 80- by 120-Foot Wind Tunnel test section. The primary objective of the test was to acquire key experimental data for a hovering rotor of sufficient quality and quantity to allow validation of state-of-the-art analysis codes. A comprehensive measurement set has been acquired, including rotor performance, blade airloads, flow transition locations, blade deflections, and wake geometry for a range of tip Mach numbers and collective settings. The present paper provides an overview of the test, including detailed descriptions of the hardware, instrumentation, and measurement systems. In addition, the specific test objectives, approach, and sample results are presented. The full test database, as well as detailed rotor geometry information, will ultimately be shared openly on a NASA-sponsored website to serve as a benchmark validation dataset.

Hover↗

The effect of ambient ozone exposure on three types of diabetes: a meta-analysis

Background: Ozone as an air pollutant is gradually becoming a threat to people's health. However, the effect of ozone exposure on risk of developing diabetes, a fast-growing global metabolic disease, remains controversial. Objective: To evaluate the impact of ambient ozone exposure on the incidence rate of type 1, type 2 and gestational diabetes mellitus. Method: We systematically searched PubMed, Web of Science, and Cochrane Library databases before July 9, 2022, to determine relevant literature. Data were extracted after quality evaluation according to the Newcastle Ottawa Scale (NOS) and the agency for healthcare research and quality (AHRQ) standards, and a meta-analysis was used to evaluate the correlation between ozone exposure and type 1 diabetes mellitus (T1D), type 2 diabetes mellitus (T2D), and gestational diabetes mellitus (GDM). The heterogeneity test, sensitivity analysis, and publication bias were performed using Stata 16.0. Results: Our search identified 667 studies from three databases, 19 of which were included in our analysis after removing duplicate and ineligible studies. Among the remaining studies, three were on T1D, five were on T2D, and eleven were on GDM. The result showed that ozone exposure was positively correlated with T2D [effect size (ES) = 1.06, 95% CI: 1.02, 1.11] and GDM [pooled odds ratio (OR) = 1.01, 95% CI: 1.00, 1.03]. Subgroup analysis demonstrated that ozone exposure in the first trimester of pregnancy might raise the risk of GDM. However, no significant association was observed between ozone exposure and T1D. Conclusion: Long-term exposure to ozone may increase the risk of T2D, and daily ozone exposure during pregnancy was a hazard factor for developing GDM. Decreasing ambient ozone pollution may reduce the burden of both diseases.

60 APPLIED LIFE SCIENCES↗

Space Shuttle flying qualities and flight control system assessment study, phase 2

A program of flying qualities experiments as part of the Orbiter Experiments Program (OEX) is defined. Phase 1, published as CR-170391, reviewed flying qualities criteria and shuttle data. The review of applicable experimental and shuttle data to further define the OEX plan is continued. An unconventional feature of this approach is the use of pilot strategy model identification to relate flight and simulator results. Instrumentation, software, and data analysis techniques for pilot model measurements are examined. The relationship between shuttle characteristics and superaugmented aircraft is established. STS flights 1 through 4 are reviewed from the point of view of flying qualities. A preliminary plan for a coordinated program of inflight and simulator research is presented.

Myers, T. T.↗

Regional Assimilation of NASA Atmospheric Infrared Sounder (AIRS) Data

The NASA Short-term Prediction Research and Transition (SPORT) Center seeks to accelerate the infusion of NASA Earth Science Enterprise (ESE) observations, data assimilation and modeling research into NW S forecast operations and decision-making. The Atmospheric Infrared Sounder (AIRS), is expected to advance climate research and weather prediction into the 21 st century. It is one of six instruments onboard Aqua, a satellite that is part of NASA s Earth Observing System. AIRS, along with two partner microwave sounding instruments, represents the most advanced atmospheric sounding system ever deployed in space. The system is capable of measuring the atmospheric temperature in the troposphere with radiosonde accuracies of 1 K over 1 km-thick layers under both clear and cloudy conditions, while the accuracy of the derived moisture profiles will exceed that obtained by radiosondes. It is imperative that the scientific community is prepared to take full advantage of next-generation satellite data that will become available within the next decade. The purpose of this paper is to describe a procedure designed to optimally assimilate AIRS data at high spatial resolution over both land and ocean. The assimilation system used in this study is the Local Analysis and Prediction System (LAPS) developed at the Forecast System Laboratory used extensively around the globe. Results will focus on quality control issues associated with AIRS, optimal assimilation strategies, and the impact of the AIRS data on subsequent numerical forecasts at 12 km produced by the next generation Weather Research and Forecast (WRF) model.

Chou, Shih-Hung↗

The Effects of Development Team Skill on Software Product Quality

This paper provides an analysis of the effect of the skill/experience of the software development team on the quality of the final software product. A method for the assessment of software development team skill and experience is proposed, and was derived from a workforce management tool currently in use by the National Aeronautics and Space Administration. Using data from 26 smallscale software development projects, the team skill measures are correlated to 5 software product quality metrics from the ISO/IEC 9126 Software Engineering Product Quality standard. in the analysis of the results, development team skill is found to be a significant factor in the adequacy of the design and implementation. In addition, the results imply that inexperienced software developers are tasked with responsibilities ill-suited to their skill level, and thus have a significant adverse effect on the quality of the software product. Keywords: software quality, development skill, software metrics

Beaver, Justin M.↗

Critical statistical assessment of data in metal additive manufacturing

Obtaining high quality data reflecting the relationships between the additive manufacturing (AM) process parameters, material microstructure and mechanical properties is crucial for the use of machine learning in AM. A database of over 4,000 data entries of metal AM was created thanks to a large number of literature studies on key process parameters and indicators of build quality. Meta-analysis reveals critical biases in the literature. Firstly, majority of studies report only high quality builds, these imbalances in reporting result in weak correlation between process parameters, properties and consolidation, limiting the ability of machine learning models to generalize beyond optimized conditions. Nevertheless, the trained models accurately predict yield strength ($R^2 = 0.85$), suggesting that certain process–property relationships are effectively captured within these models. Secondly, quantitative microstructural data are largely absent, limiting the learning of the microstructure-mechanical properties relationships. Finally, current process window identification is based largely on the consolidation, despite significant uncertainty in its measurement. It is important to identify the process map on the basis of not only the consolidation, but also mechanical behaviour under loading. Such a identification shows that 316 L and Inconel have much larger process map (i.e. highly printable) in comparison to the AlSi10Mg and Ti6Al4V.

Additive manufacturing↗

Multidecadal Trends in Ozone Chemistry in the Baltimore-Washington Region

Over the past four decades, policy-led reductions in anthropogenic emissions have improved air quality over the Baltimore-Washington region (BWR). Most of the improvements in meeting the ozone air quality metrics (NAAQS) did not occur until the early 2000s despite large reductions in ozone precursors (NOx, CO, and volatile organic compounds (VOCs)) in the prior decades. We use observations of ozone and ozone precursors from satellites, ground-based sites, and the 2011 DISCOVER-AQ aircraft campaign in Maryland to illustrate how ozone chemistry in the BWR evolved between 1972 and 2019. Analysis of weekday vs weekend probability of ozone exceedance indicates the BWR transitioned to the NOx-limited regime by 2000–2003. A data-constrained box model agrees with this transition period and illustrates the key roles of reduced emissions of formaldehyde (HCHO), aromatics, and other VOCs since 1996, which reduced the peak of ozone production at the time of the transition and likely prevented the BWR from experiencing worsening surface air quality as the region transitioned to NOx-limited chemistry. Analysis of satellite observations of tropospheric column HCHO to NO2 analyzed using a new approach for evaluation of chemical regimes derived from DISCOVER-AQ data also provide a consistent depiction of the timing of the transition period that we infer from ground-based observations and the box model. Finally, despite significant improvements in air quality over the past two decades, the BWR still has not met the EPA standard for surface ozone. With predominantly NOx-limited ozone chemistry over the BWR, continued decreases in emission of NOx will slow the rate of ozone production and help improve air quality. We highlight emissions of NO2 from the diesel truck fleet as a worthwhile focus for future policy because emissions from this source appear to influence day-of-week variations in observed NO2, with an accompanying effect on ozone.

Ozone↗

Mixing model analysis of telescopic lunar spectra

We have analyzed very high quality reflectance spectra of the lunar surface from the University of Hawaii lunar spectral data collection using a spectral mixing model. The spectra analyzed are those of 45 mare sites and 75 highland sites. The spectra were selected on the basis of very high signal to noise ratios based on error bars and point to point scatter, and on quality of removal of telluric water bands. The spectral mixing model used 7 components, not all of which were used in each fit. Four of the components were mineral spectra of the orthopyroxene, a clinopyroxene, an olivine and an anorthite, measured at the Brown University's RELAB. All of the minerals were 45-90 micron splits. Lunar soil contains other components which have the effect of reddening and darkening the soil as well as reducing spectral contrast. In addition, lunar soil contains spectral neutral bright material (likely very fine grained feldspar) which serves to reduce spectral contrast and brighten soils. Early attempts to fit many of the spectra pointed out the need for a component which has a very broad smooth absorption feature centered near 1.1 microns. Glass is a good candidate for this component. For the bright component we used a flat reflectance of 70 percent to represent fine grained feldspar. For the 'glass' component we used a telescopic spectrum of a pyroclastic glass present on the Aristarchus plateau which is characterized by a strong smooth band centered at 1.07 microns. In addition to exhibiting the glass band this spectrum is very red and has a low albedo. On the assumption that the dark component and the red component are agglutinates, which is reasonable but not necessarily true, we sought a dark red component. To derive its properties we modelled the spectrum of an Apollo 16 soil (16xxx) and assumed the dark red component to comprise 60 percent of the soil, appropriate to agglutinate abundance in mature soil. We adjusted the albedo and slope of a straight line representing the dark red component until the contrast and albedo of the model spectrum matched the soil spectrum. The mixing was done after conversion to a single scattering albedo.

Lucey, Paul G.↗

Validation of MODIS FLH and In Situ Chlorophyll a from Tampa Bay, Florida (USA)

Satellite observation of phytoplankton concentration or chlorophyll-a (chla) is an important characteristic, critically integral to monitoring coastal water quality. However, the optical properties of estuarine and coastal waters are highly variable and complex and pose a great challenge for accurate analysis. Constituents such as suspended solids and dissolved organic matter and the overlapping and uncorrelated absorptions in the blue region of the spectrum renders the blue-green ratio algorithms for estimating chl-a inaccurate. Measurement of suninduced chlorophyll fluorescence, on the other hand, which utilizes the near infrared portion of the electromagnetic spectrum may, provide a better estimate of phytoplankton concentrations. While modelling and laboratory studies have illustrated both the utility and limitations of satellite algorithms based on the sun induced chlorophyll fluorescence signal, few have examined the empirical validity of these algorithms or compared their accuracy against bluegreen ratio algorithms . In an unprecedented analysis using a long term (2003-2011) in situ monitoring data set from Tampa Bay, Florida (USA), we assess the validity of the FLH product from the Moderate Resolution Imaging Spectrometer against a suite of water quality parameters taken in a variety of conditions throughout this large optically complex estuarine system. . Overall, the results show a 106% increase in the validity of chla concentration estimation using FLH over the standard chla estimate from the blue-green OC3M algorithm. Additionally, a systematic analysis of sampling sites throughout the bay is undertaken to understand how the FLH product responds to varying conditions in the estuary and correlations are conducted to see how the relationships between satellite FLH and in situ chlorophyll-a change with depth, distance from shore, from structures like bridges, and nutrient concentrations and turbidity. Such analysis illustrates that the correlations between FLH and in situ chla measurements increases with increasing distance between monitoring sites and structures like bridges and shore. Due probably to confounding factors, expected improvement in the FLH- chla relationship was not clearly noted when increasing depth and distance from shore alone (not including bridges). Correlations between turbidity and nutrient concentrations are discussed further and principle component analyses are employed to address the relationships between the multivariate data sets. A thorough understanding of how satellite FLH algorithms relate to in situ water quality parameters will enhance our understanding of how MODIS s global FLH algorithm can be used empirically to monitor coastal waters worldwide.

Fischer, Andrew↗

Rapid, High-Resolution Detection of Environmental Change over Continental Scales from Satellite Data - the Earth Observation Data Cube

The effort and cost required to convert satellite Earth Observation (EO) data into meaningful geophysical variables has prevented the systematic analysis of all available observations. To overcome these problems, we utilise an integrated High Performance Computing and Data environment to rapidly process, restructure and analyse the Australian Landsat data archive. In this approach, the EO data are assigned to a common grid framework that spans the full geospatial and temporal extent of the observations - the EO Data Cube. This approach is pixel-based and incorporates geometric and spectral calibration and quality assurance of each Earth surface reflectance measurement. We demonstrate the utility of the approach with rapid time-series mapping of surface water across the entire Australian continent using 27 years of continuous, 25 m resolution observations. Our preliminary analysis of the Landsat archive shows how the EO Data Cube can effectively liberate high-resolution EO data from their complex sensor-specific data structures and revolutionise our ability to measure environmental change.

Lewis, Adam↗

T0TEM - T0 Test Evaluation Module Development and Verification

Transition temperature testing of ferritic steels evaluates the ductile to brittle transition temperature, where the behavior of the steel changes from controlled ductile tearing to uncontrollable brittle fracture. This testing is governed by ASTM (American Society of Testing and Materials) E1921 standard. The calculations and plots required by this standard are iterative in nature and require significant effort to produce by standard hand calculations. In addition to analysis of a complete data set, intermediate analysis during testing is beneficial to determine optimal test temperatures. Given the exhaustive nature of calculating the transition temperature, being able to quickly update target temperatures is a significant benefit to not only the quality of tests, but the number of required tests as well. T0 Test Evaluation Module (T0TEM) v1.5 is a software application created under the Layered Pressure Vessel (LPV) certification effort. To reduce the analysis time of transition temperature test data sets producedfor this effort, T0TEM was created to calculate the E1921 Master Curve along with all required data and validity checks. By creating this program, hundreds of hours of analysis time were saved. In addition, the creation of a standard program provided a significant improvement in the consistency with which results were reported. T0TEM also calculates the results and plots required for the E1921 inhomogeneity annex to determine whether a material behaves in a homogenous manner. This program was created by Levi Shelton and Cameron Bosley at NASA, with input and review from the E1921 committee. The results generated by T0TEM were compared to the validation data sets provided by ASTM with good concurrence. ASTM committee members have reviewed and applied T0TEM to other data sets with satisfactory results. T0TEM was originally released to the NASA Software Repository and publicly via SourceForge in May of 2020. Version 1.5 was released in April of 2021 with minor functionality updates and additional statistical analysis methods.

Levi Shelton↗

Land use management in Minnesota

The author has identified the following significant results. Preliminary analysis of bulk imagery suggests that the forty-acre data cell used in the Minnesota Land Management Information Systems (MLMIS) can be utilized in interpretation of ERTS-1 data. High quality bulk images of the Twin Cities metropolitan area suggest that detail in urban land use patterns is much greater than originally anticipated. This implies a greater work effort in this area than was planned. Furthermore, the forest classes of land use can also be usefully divided into subcategories. Preliminary analysis of one rather low quality image also indicates that subclasses of wetlands can be identified. Prospects are bright for improving the potential detail that ERTS-1 can contribute to MLMIS.

Sizer, J. E.↗

SYMBIOSYS: A Methodology for Performance Analysis of Composable HPC Data Services

Microservices are a powerful new way of building, customizing, and deploying distributed services owing to their flexibility and maintainability. Several large-scale distributed platforms have emerged to serve the growing needs of data-centric workloads and services in commercial computing. Concurrently, high-performance computing (HPC) systems and software are rapidly evolving to meet the demands of diversified applications and heterogeneity. The interplay of hardware factors, software configuration parameters, and the flexibility offered with a microservice architecture makes it nontrivial to estimate the optimal service instantiation for a given application workload. Further, this problem is exacerbated when considering that these services operate in a dynamic and heterogeneous HPC environment. An optimally integrated service can be vastly more performant than a haphazardly integrated one. Existing performance tools for HPC either fail to understand the request-response model of communication inherent to microservices or they operate within a narrow scope, limiting the insight that can be gleaned from employing them in isolation. We propose a methodology for integrated performance analysis of HPC microservices frameworks and applications called SYMBIOSYS. We describe its design and implementation within the context of the Mochi framework. This integration is achieved by combining distributed callpath profiling and tracing with a performance data exchange strategy that collects fine-grained, low-level metrics from the RPC communication library and network layers. The result is a portable, low-overhead performance analysis setup that provides a holistic profile of the dependencies among microservices and how they interact with the Mochi RPC software stack. Using HEPnOS, a production-quality Mochi data service, we demonstrate the low-overhead operation of SYMBIOSYS at scale and use it to identify the root causes of poorly performing service configurations.

microservices↗

BETO 2021 Peer Review - Strategic Analysis Support WBS 4.1.1.30

Strategic Analysis Support. The objective of the NREL strategic support project is to provide sound, unbiased, and consistent analyses to inform the strategic direction of the DOE BETO office. This project addresses key technological questions, provides critical data needed to inform strategy, and highlights barriers, gaps and data needs in support of the DOE BETO's mission to improve the affordability of bio-based fuels and products. This task employs various quantitative (techno-economic analysis, TEA) and qualitative (gap analysis) approaches to allow for direct comparisons of biomass conversion technologies across a wide slate of processing platforms and products. Furthermore, this project develops and utilizes novel analyses beyond traditional biorefinery focused TEA/LCAs to identify both technical (e.g., in sustainable design) and non-technical (e.g., in value proposition) barriers, as well as to outline mitigation strategies and R&D needs for emerging technologies. Additionally, the project is tasked with evaluating drivers that support the growing bio-economy, which is achieved by the development and public release of tools to advance the understanding and facilitate comparisons of socio-economic impacts along the supply chain. Critical to the success of this project is the development of defensible methodologies, analyses, and tools that are publicly available to support stakeholders and bioeconomy growth. To develop such high-quality analyses, the biggest challenge to this project, as with most analysis focused projects, is the availability and reliability of the underlying data. Therefore, the project team works extensively with key stakeholders (e.g., policy makers, bioenergy technology developers, and investors) in developing and reviewing the results of these analyses to overcome this challenge. Any remaining uncertainties associated with the analysis efforts are clearly defined and quantified.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗