Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Antarctic ice sheet model comparison with uncurated geological constraints shows that higher spatial resolution improves deglacial reconstructions

Accurately reconstructing past changes to the shape and volume of the Antarctic ice sheet relies on the use of physically based and thus internally consistent ice sheet modeling, benchmarked against spatially limited geologic data. The challenge in model benchmarking against geologic data is diagnosing whether model-data misfits are the result of an inadequate model, inherently noisy or biased geologic data, and/or incorrect association between modeled quantities and geologic observations. In this work we address this challenge by (i) the development and use of a new model-data evaluation framework applied to an uncurated data set of geologic constraints, and (ii) nested high-spatial-resolution modeling designed to test the hypothesis that model resolution is an important limitation in matching geologic data. While previous approaches to model benchmarking employed highly curated datasets, our approach applies an automated screening and quality control algorithm to an uncurated public dataset of geochronological observations (specifically, cosmogenic-nuclide exposure-age measurements from glacial deposits in ice-free areas). This optimizes data utilization by including more geological constraints, reduces potential interpretive bias, and allows unsupervised assimilation of new data as they are collected. We also incorporate a nested model framework in which high-resolution domains are downscaled from a continent-wide ice sheet model. We highlight the application of this framework by applying these methods to a small ensemble of deglacial ice-sheet model simulations, and demonstrate that the nested approach improves the ability of model simulations to match exposure age data collected from areas of complex topography and ice flow. We develop a range of diagnostic model-data comparison metrics to provide more insight into model performance than possible from a single-valued misfit statistic, showing that different metrics capture different aspects of ice sheet deflation.

Geosciences↗

Preliminary investigation of effects of heavy rain on the performance of aircraft

A guideline was defined for the analysis of flight data to determine the effects of rain on the aerodynamic performance of an aircraft. It distinguishes and separates the effects of horizontal wind shears, downdrafts, gusts at the phugoid frequency, and rain based on various aerodynamic parameters. Flight data from NASA LaRC's TCV B-737 were inconclusive because precipitation rates encountered probably were not high enough. However, the guideline seemed to be valid and can be used on further flight data evaluations. Difficulties in this type of data analysis are discussed. Other indirect influences of rain on the degradation of airplane performance are also considered.

Lee, O. W. K.↗

Overview of TM Applications Research Reports

Applications-oriented users of TM data have every reason to be excited about the possibility of opening up other horizons using TM data. The data appear to be of excellent quality, and the investigations conducted to date, although preliminary, substantiate the findings of earlier research conducted with simulated TM data. Techniques used for sensor/data quality evaluation; data processing, analysis, and display; and comparisons of TM versus MSS data are summarized.

Williams, D. L.↗

Onboard Science Data Analysis: Opportunities, Benefits, and Effects on Mission Design

Much of the initial focus for spacecraft autonomy has been on developing new software and systems concepts to automate engineering functions of the spacecraft: guidance, navigation and control, fault protection, and resources management. However, the ultimate objectives of NASA missions are science objectives, which implies that we need a new framework for perfoming science data evaluation and observation planning autonomously onboard spacecraft.

spacecraft autonomy observation planning science d↗

Challenges of Using Indistinguishable from Background as a Release Criterion at FUSRAP Projects - 18157

The US Army Corps of Engineers (USACE) utilizes the Multi-Agency Radiation Survey and Site Investigation Manual (MARSSIM) approach to site release on Formerly Utilized Sites Remedial Action Program (FUSRAP) projects. Use of Indistinguishable from Background (IFB) as a release criterion is discussed in MARSSIM as Scenario B; however, the discussion is arguably limited and refers the user to other documents. USACE has utilized the IFB approach at select FUSRAP projects. USACE experience is that use of IFB as a release criterion has been difficult to implement at best. There are many challenges in using the IFB approach. These include: release criterion is required per MARSSIM; multiple reference areas need to be established; and data presentation. Potential methods to overcome these challenges are discussed. USACE has utilized alternative statistical approaches as well as the IFB approach discussed in MARSSIM for specific purposes at FUSRAP sites. Alternatives to the IFB approach discussed in this paper include other statistical tests such as the Tukey Kramer test. These alternatives may be better suited to release an area of a property prior to the development of release criteria. USACE has found using the IFB criterion useful in certain specific circumstances. These include post MARSSIM Scenario A final status survey data evaluations and for review of historical data. The challenges, alternatives, and circumstances to use the IFB approach are discussed. Other environmental remediation projects attempting to utilize IFB as a criterion may benefit from the USACE experiences as discussed herein. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

SU-E-T-235: Data Mining for Evaluating Treatment Performances Over a Large Quantity of Data to Monitor and Improve SBRT Workflow

Purpose: To quality assure a large quantity of retrospective treatment cases for treatment performances by randomly sampling is inefficient. Here we provide a method to efficiently monitor and investigate the QA of SBRT workflow over Mosaiq. Methods: The code developed with Microsoft SQL Server Management Studio 2008R2 and VBA was used for retrieving and sorting data from Mosaiq (version 2.3–2.6 during 2012–2015). SBRT patients were filtered by fractional dose over 350cGy and total fraction number less than 6, which SBRT prescriptions were defined. The quality assurance on the SBRT workflow was focused on the treatment deliveries such as patient positioning setup, CBCT indicated offsets and couch shifted corrections. The treatment delivery were done by Varian Truebeam systems and the record/verify by Mosaiq. Results: Total 82 SBRT patients corresponding to 103 courses and 854 CBCT images were found by the retrieval query. Most centers record daily pre-treatment (Pre-Tx: before treatment shift) image-guided shifts along treatment course for inter-fraction motion record, and it is useful to also verify it with post-treatment imaging (Post-Tx: after treatment CBCT verification) to verify intra-fraction motion. Analyzing the details of daily recorded shifts can reveals the information of patient-setup and staff’s record/verify behaviors. 3 examples were provided as solid evidences and on-going rectification for preventing future mistakes. Conclusions: The report gave feasible examples for inspector to verify a large amount of data during site investigation. This program can also be extended to a scheduled data mining with software to periodical analyze the timely records in Mosaiq, for example, a various control charts for different QA purposes. As the current trend of automation in radiation therapy field, the data mining would be a necessary tool in the future, just as the automatic plan quality evaluation has been under development in Eclipse.

60 APPLIED LIFE SCIENCES↗

Association between thyroid profile and perfluoroalkyl acids: Data from NHNAES 2007–2008

The effect of six perfluoroalkyl acids (PFAAs), namely, perfluorooctane sulfonate (PFOS), perfluorooctanoic acid (PFOA), perfluorodecanoic acid (PFDE), perfluorohexane sulfonic acid (PFHxS), 2-(N-methyl-perfluorooctane sulfonamide) acetic acid (MPAH), and perfluorononanoic acid (PFNA) on the levels of six thyroid function variables, namely, thyroid stimulating hormone (TSH), free and total thyroxine (FT4, TT4), free and total triiodothyronine (FT3, TT3), and thyroglobulin (TGN) was evaluated. Data from National Health and Nutrition Examination Survey for the years 2007–2008 were used for this evaluation. TSH levels increased with increase in levels of PFOA (p<0.01). There were no statistically significant associations between the levels of FT3, and FT4 with the levels of any of the six PFAAs. Levels of TT3 were found to increase with the levels of PFOA (p=0.01) and TT4 levels were found to increase with increase in PFHxS levels (p<0.01). Males had statistically significantly higher levels of FT3 than females and females had statistically significantly higher levels of TT4 than males. As compared to non-Hispanics whites and Hispanics, non-Hispanic blacks had lower levels of TSH, FT3, TT3, and TT4 but Hispanics had the lowest levels of TGN. Age was negatively associated with FT3 and TT3 but positively associated with FT4 and TT4. Non-smokers had higher levels of TSH and TT4 than smokers and smokers had higher levels of FT3 and TGN than non-smokers. Iodine deficiency was associated with increased levels of TSH, TT3, TT4, and TGN. -- Highlights: • Levels of total triiodothyronine were found to increase with the levels of PFOA. • Total thyroxine increased with increase in levels of perfluorohexane sulfonic acid. • There was a positive association between the levels of PFOA and TSH. • Iodine deficiency was associated with elevated levels of TSH, total T3 and T4. • Iodine deficiency was associated with elevated levels of thyroglobulin.

60 APPLIED LIFE SCIENCES↗

General Guidelines on Criteria for Adoption or Rejection of Evaluated Libraries and Data by the Nuclear Data Team

This memo contains general guidelines on what documentation and tools need to be in place as well as format and data testing requirements such that evaluated nuclear data sets or entire libraries can be adopted by the nuclear data team. Additional requirements beyond this memo might apply for specific nuclear data observables. These guidelines were established based on discussions between J.L. Conlin, M.G. Gray, A.P. McCartney, D. Neudecker, D.K. Parsons and M.C. White.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Streamlining and Transparently Automating Complex Waste Determinations at Los Alamos National Laboratory - 17286

Environmental programs at Los Alamos National Laboratory (LANL) generate a large amount of sampling activities that can result in waste that needs to be characterized and properly disposed. Since 2011, sampling results are managed in the cloud-based Environmental Information Management (EIM) database, which contains over 16 million current and historical data records. In many cases, the database's analytical records are used to characterize and dispose waste from environmental operations. Three factors contribute to streamlining of the waste disposition operations: (1) if possible, use of the existing analytical data for waste characterization to avoid additional laboratory analysis; (2) reduction in time spent on data evaluation for various waste acceptance criteria; and (3) choice of the proper and least expensive disposal alternative. Use of the existing analytical data, when allowed by law, creates some paradoxical problems: when chemical analysis is requested with the purpose of characterizing waste, it creates only 100 to 400 analytical records. However, use of exiting analytical data at LANL may lead to evaluation of tens of thousands of analytical records, with many records for each single analyte. This occurs because data were collected for environmental characterization and not waste characterization. To streamline data analysis for waste disposition using existing data, LANL has created a Waste Data Summary (WDS) module in the site's EIM database. Recognizing that waste determination is performed by groups outside the environmental program at LANL, the WDS allows for logically guided data selection for a specific waste determination (solids, liquids, radiological, etc.) and reduces potentially thousands of rows of data into simple formatted data reports that are easy to comprehend and process. This allows the waste evaluators to review data using multiple approaches to make their own determination on the most appropriate disposal method. There are four basic principles of WDS operation: (1) The highest detected analytical result is evaluated for the selected samples (or the lowest undetected result if there are no detected results); (2) All approved disposal pathways are evaluated; (3) Any failures of the Waste Acceptance Criteria are visibly highlighted to focus the attention of the evaluator; and (4) The decision of the disposal path is left to the trained waste evaluator (WDS does not choose or suggest any disposal paths). The summary results are presented as the set of short data reports. These reports can be divided into two groups: general comparison reports and disposal pathway specific forms. The general comparison forms show all Resource Conservation and Recovery Act (RCRA) analytes with pass/fail evaluation and with preference for toxicity characteristic leaching procedure (TCLP) results (or 20x rule) for solid samples, the potential RCRA hazard codes assignment for detected analytes, and all rad results. The detected chemical and radioactivity results are compared to the background values and to Soil Screening and Soil Action limits (SSL/SAL limits). Disposal pathway specific forms follow Waste Acceptance Criteria requirements for all disposal pathways available at LANL. The programming of the WDS tries to maximize existing data by analyte substitutions (like using gross alpha for necessary alpha emitting isotopes) or by making calculations when analytical results do not agree with legal requirements (like total chlordane in the RCRA regulations, which is most often analyzed and reported as individual isomers). All forms may be annotated by the waste evaluator to provide additional information to support decision making. Upon final decision of a disposal path, the complete dataset used in the evaluation and the WDS forms with annotations is 'frozen' as an un-editable PDF export to document the data used in the waste disposal determination. The streamlined process results in less work for waste evaluators and reduces overall labor and analytical costs. By comparison, a full review of a 10,000 record parent dataset may take a waste evaluator over a week to review, whereas with the WDS module, the task can be accomplished in less than one hour with clear, reproducible results. These results can be reviewed and checked at any time by quality assurance personnel, thus ensuring transparency in the decision making process. LANL believes this approach has broad applicability to other sites where waste determination is based on review of existing data collected for more generalized environmental purposes. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Coordinated activities on evaluation of collisional data for fusion applications

It is the role of the Atomic and Molecular Data Unit of the International Atomic Energy Agency to review progress in the production, compilation and evaluation of atomic, molecular and plasma-surface interaction (AM/PSI) data for the fusion program and to support the development of internationally recommended libraries of AM/PSI data for fusion. In response to increasing requests from the fusion community the Unit has increased its effort to promote the assessment of data quality by organizing a series of meetings on the relevant issues: 1) Error propagation and sensitivity analysis, 2) Current status of evaluated databases, 3) Uncertainty estimates of theoretical data, 4) Experimental data evaluation, 5) Data evaluation methods and semi-empirical fits and 6) Establishment of an evaluators' network. The discussions and conclusions are summarized here.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Status of Marshall Space Flight Center solar house

The Marshall Space Flight Center (MSFC) solar facility is described herein, and test results obtained from late May 1974 to September 1974 are discussed. This facility was assembled to provide operational experience in the utilization of solar energy for heating and cooling buildings. The major subsystems are the solar collector, the energy storage tank, the simulated living space, the air conditioning and heating subsystems, and the controls. These subsystems are described with emphasis placed on major results and conclusions. A cursory evaluation of the system for cooling is given from energy and power consumption viewpoints. This data evaluation indicates the current system is capable of supplying 50 per cent of the thermal energy required to drive the air conditioner. A preliminary evaluation of winter data indicates that more than 90 per cent of the heating required can be provided by the solar system.

Humphries, W. R.↗

Appendix A: NAS-Wide Encounter Rate Evaluation Using Historical Radar Data and the Airspace Concept Evaluation System (ACES)

Regulations that establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions. Those requirements will apply to detect-and-avoid (DAA) systems and other equipment necessary to integrate UAS with the National Airspace System (NAS) and are determined according to their contribution to the overall level of safety required to operate in the airspace. Several key gaps must be addressed in order to link equipment requirements to an airspace level of safety. Foremost among these is the calculation of the relative effectiveness of a particular system to mitigate violations of a separation standard with other aircraft, which is known as the systems risk ratio. The risk ratio is calculated as the probability of mid-air collision with a DAA system divided by the probability of mid-air collision without a DAA system. The risk ratio of a DAA system, in combination with the risk ratios of other collision avoidance mitigations, will determine the overall safety of the airspace measured in terms of the number of mid-air collisions per flight hour. Defining the required risk ratio that the DAA system needs to ensure the safety of the airspace requires an evaluation of the current airspace and a simulated evaluation that incorporates UAS aerodynamic performance and the mission characteristics of future UAS operations that are projected to be conducted in areas that interact with current operations. These evaluations will produce the frequency of encounters that currently exist in the airspace and those that could be generated with the introduction of UAS. Together, the frequency of encounters, an evaluation of unmitigated risk of collision, and a desired level of safety of the airspace will yield a required risk ratio of the DAA system. This study will focus on evaluating the encounter rates between aircraft based on historical radar data and encounter rates that could occur based on simulated UAS missions.

Unmanned Aircraft Systems↗

Physical and Flow Properties of Glass Forming Chemicals (V2O5, SnO, SnO2, Cr2O3, FeCr2O4, and ZrSiO4) and Mixtures

For a sustainable nuclear waste vitrification process at the Hanford Tank Waste Treatment and Immobilization Plant (WTP), proper selection and consistent supply of glass-forming chemicals (GFCs) are crucial. Establishing rigorous acceptance criteria for the characterization of GFCs will be required to operate the vitrification facility and to mitigate any processing issues or failures. Low-activity wastes (LAW) are blended with GFCs to form slurry melter feeds and vitrified in a melter. To enhance properties of waste glasses, new chemicals are being introduced to the current GFC mixture (Vienna et al. 2016; Muller et al. 2017, 2019). In this study, three new GFCs were evaluated for enhanced LAW glass formulations: chromium oxide (Cr 2 O 3 ), vanadium oxide (V 2 O 5 ), and stannic oxide (SnO 2 ). These three oxide components are included in enhanced waste glass (EWG) formulations and GFCs with the appropriate physical and flow properties are needed. As a starting point, single metal oxide GFCs: Cr 2 O 3 , V 2 O 5 , and SnO 2 were sourced and tested. To characterize these new individual GFCs and mixtures of GFCs, the industrial bulk characterization consultant, Jenike and Johanson, was employed to measure physical and flow properties of individual GFCs and their mixtures. Pacific Northwest National Laboratory (PNNL) also measured several selected physical properties for data evaluation as a quality assurance step. In addition, PNNL measured physical and rheological properties of slurry melter feeds containing those GFCs. Subsequent data analyses and verification were conducted. The purpose of this report is to assess the applicability of these GFCs for LAW vitrification based on their properties. This report will help understand measured data and evaluate new GFCs for use. Moreover, this report may give useful insights to help troubleshoot any GFC and melter feed transport and mixing issues that arise during processing, leading to a successful cleanup mission at WTP.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

JRC-IRMM/ORNL Collaboration on Nuclear Data for Nuclear Criticality Safety - 14486

Concerns about using cross sections recommended in the main evaluated data libraries (i.e. ENDF/B, JEFF and JENDL) for nuclear criticality calculations have been a prime motivator for new cross section measurements. The measurements and evaluations discussed in this work are part of a collaboration between the Oak Ridge National Laboratory (ORNL) and the Institute for Reference Material and Measurements of the Joint Research Center (JRC-IRMM) of the European Commission (EC). They are performed in response to the US Nuclear Criticality Safety Program (NCSP) data needs. In particular, the NCSP five-year plan encompasses a listing of elements that have been identified for measurements and evaluations to address issues on criticality safety applications. This listing is based on data deficiency concerns in practical applications that are conveyed by criticality safety practitioners. In general these deficiencies are obtained through the analysis of benchmark calculations. A wealth of evaluations in the main libraries were derived from results of measurements made with poor time-of-flight resolution, and also the description of some data in the neutron energy range above several tens of keV is crude. This impacts both the resolved and unresolved resonance region, and leads to bias effects when resonance structures play an important role. As a consequence only average corrections can be applied in calculations for nuclear criticality calculations where self-shielding, multiple scattering, or Doppler broadening are important. This can lead to erroneous results. Furthermore, many evaluations for nuclides having small neutron-capture cross sections show erroneously high cross sections because the influence of the neutron sensitivity of the old measurement systems was underestimated. Although their neutron capture cross sections are small, these nuclides, if occurring in large amounts, can be important absorbers in criticality calculations, so an accurate determination of these cross sections is required. Over the last seven years the JRC-IRMM/ORNL collaboration has produced many neutron induced cross section data using the Geel Electron Linear Accelerator (GELINA) neutron time-of-flight facility. This facility is ideally suited to measure total, fission and capture cross sections in the energy range from 1 eV to ∼600 keV, which is important for nuclear criticality calculations. In this paper the facility and experimental set-ups at GELINA will be described together with the data reduction and analysis procedures which result in experimental observables including their full covariance information. The importance of combining transmission and partial cross section data will be emphasized. We will give a list of the measured nuclides and discuss the impact of the resulting data and evaluations. (authors)

42 ENGINEERING↗

The analysis of shape data including normalization and the impact on prompt fission neutron spectrum measurements

While measurements of physical quantities contain an intrinsic absolute scale based on details of the experiment, sometimes only the value of each measured data point relative to the others, i.e., the shape, is of interest. Additionally, in contrast to absolute measurements of quantities like nuclear cross sections, shape measurements are unique in that the result is contained entirely in the relative value of each measured point with respect to all others. This fundamental attribute of shape data is sometimes discussed by data evaluators, but it is common that shape data are reported by experimenters with covariances directly from the raw data as though an absolute measurement has been performed, thereby misrepresenting the true knowledge of the measured shape. A normalization procedure must be carried out including careful covariance propagation in order to accurately represent the uncertainty in a measured shape. Known consequences of this procedure, such as the exclusion of constant fully-correlated uncertainties, are sometimes applied ad hoc to shape data. However, normalization also produces features of shape data that are otherwise difficult to apply, such as partial exclusion of strongly-correlated uncertainty sources, a redistribution of uncertainties across data points, and consistency of the covariance matrix obtained when combining separate shape measurements. In this study all of the above features are shown in a generalized fashion and exhibited using prompt fission neutron spectrum data from the Chi-Nu experiment with recommendations for analysis of future shape measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Neutron Cross Section Measurements at ORELA for Improved Nuclear Data and Their Application

Many older neutron cross-section evaluations from libraries such as ENDF/B-VI or JENDL-3.2 exhibit deficiencies or do not cover energy ranges that are important for criticality safety applications. These deficiencies may occur in the resolved and unresolved-resonance regions. Consequently, these evaluated data may not be adequate for nuclear criticality calculations where effects such as self-shielding, multiple scattering, or Doppler broadening are important. To support the Nuclear Criticality Predictability Program, neutron cross-section measurements have been initiated at the Oak Ridge Electron Linear Accelerator (ORELA). ORELA is the only high-power white neutron source with excellent time resolution still operating in the United States. It is ideally suited to measure fission, neutron total, and capture cross sections in the energy range from 1 eV to {approx}600 keV, which is important for many nuclear criticality safety applications.

43 PARTICLE ACCELERATORS↗

Image processing developments and applications for water quality monitoring and trophic state determination

Remote sensing data analysis of water quality monitoring is evaluated. Data anaysis and image processing techniques are applied to LANDSAT remote sensing data to produce an effective operational tool for lake water quality surveying and monitoring. Digital image processing and analysis techniques were designed, developed, tested, and applied to LANDSAT multispectral scanner (MSS) data and conventional surface acquired data. Utilization of these techniques facilitates the surveying and monitoring of large numbers of lakes in an operational manner. Supervised multispectral classification, when used in conjunction with surface acquired water quality indicators, is used to characterize water body trophic status. Unsupervised multispectral classification, when interpreted by lake scientists familiar with a specific water body, yields classifications of equal validity with supervised methods and in a more cost effective manner. Image data base technology is used to great advantage in characterizing other contributing effects to water quality. These effects include drainage basin configuration, terrain slope, soil, precipitation and land cover characteristics.

Blackwell, R. J.↗

Mathematical analysis study for radar data processing and enhancement. Part 1: Radar data analysis

A study is performed under NASA contract to evaluate data from an AN/FPS-16 radar installed for support of flight programs at Dryden Flight Research Facility of NASA Ames Research Center. The purpose of this study is to provide information necessary for improving post-flight data reduction and knowledge of accuracy of derived radar quantities. Tracking data from six flights are analyzed. Noise and bias errors in raw tracking data are determined for each of the flights. A discussion of an altiude bias error during all of the tracking missions is included. This bias error is defined by utilizing pressure altitude measurements made during survey flights. Four separate filtering methods, representative of the most widely used optimal estimation techniques for enhancement of radar tracking data, are analyzed for suitability in processing both real-time and post-mission data. Additional information regarding the radar and its measurements, including typical noise and bias errors in the range and angle measurements, is also presented. This is in two parts. This is part 1, an analysis of radar data.

James, R.↗