Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

An Evaluation of “Drug Ineffective” Postmarketing Reports in Drug Safety Surveillance

Introduction: The most commonly reported adverse event, based on frequency of Medical Dictionary for Regulatory Activities (MedDRA) preferred terms (PTs), in the US FDA Adverse Event Reporting System (FAERS) database is ‘‘drug ineffective’’ (DI). This study aimed to describe the DI reports and provide data to support recommendations on how to best evaluate these reports. Methods: We characterized all FAERS reports coded with the MedDRA PT ‘‘drug ineffective’’ received between 1 September 2012 and 31 August 2016 using all other FAERS reports as a comparator. Additionally, we conducted a manual evaluation to identify informative data elements in the report narratives. Results: During the study period, 247,513 (6.4% of all FAERS reports) DI reports were entered in FAERS. Compared with non-DI reports, DI reports were more likely to be reported by consumers (69.8 vs. 48.1%) and less likely to report a serious outcome (26.2 vs. 56.3%). Most DI reports (88%) were from the USA. Manual evaluation of 552 sample US reports identified 43 reports (7.8%) deemed ‘‘useful’’; a higher proportion of ‘‘useful’’ reports provided a batch or lot number (39.5 vs. 17.2%) and were coded with additional PTs beyond ‘‘drug ineffective’’ (83.7 vs. 59.2%), the most frequent of which were ‘‘product quality issue’’ (23.3%) and ‘‘product substitution issue’’ (18.6%). Conclusions: DI was the most frequently reported adverse event in the FAERS database; however, the yield from these reports in terms of usefulness from a pharmacovigilance perspective was low. Efficient strategies are needed to identify which DI reports are more likely to contain useful information.

60 APPLIED LIFE SCIENCES↗

SNAPSHOT: A MODERN, SUSTAINABLE HOLDUP MEASUREMENT SYSTEM

SNAPSHOT is a software platform designed to eventually replace Holdup Measurement System 4 (HMS 4), which is the current state-of-the-art for acquisition and analysis of nondestructive assay measurement data for in situ nuclear materials, holdup, in support of criticality safety and material control and accounting. HMS 4 is over 10 years old and is currently unsustainable due to hardware and software incompatibilities that have arisen from advances in detector electronics, primarily updates to multi-channel analyzers (MCAs), and both computer and handheld operating systems. SNAPSHOT is a complete redesign of HMS 4 that addresses the issue of compatibility with modern MCAs and operating systems and that is designed with a flexible architecture to support long-term sustainability. It also provides an updated and more user friendly interface and is being developed under an NQA 1 software quality assurance (SQA) program to facilitate site acceptance for safety-related applications. This paper provides an overview of the SNAPSHOT project including details of the software development process, the SQA program, and the architecture designed to support sustainability.

Rowe, Nathan C↗

Biofuel Air Emissions Analysis

U.S. has goals to produce 3 billion gallons of sustainable aviation fuel (SAF) annually by 2030, increasing to 35 billion gallons by 2050 to decarbonize the aviation sector. Meeting these production targets will require large number of biorefineries to be set up. However, ability to comply with federal air quality standards is prerequisite to being issued a construction permit. Negotiating the permitting process for a new biorefinery can be quite onerous and cost the investors significant time and money. Although there can be numerous reasons for delayed biorefinery construction, air permitting is fraught with pitfalls because the permitting process relies on precedence, which the future SAF biorefineries lack. NREL's Biofuel Air Emissions Analysis project is unique and innovative in terms of the tools, approaches, and analyses provided. NREL is the only national laboratory that is actively working at the intersection of Federal air quality regulations, emissions and air quality analysis across the supply chain, and process design. This project is focused on providing much needed data and analyses that address biorefinery air permitting. This project develops models and quantitative analyses and measures progress towards meeting air quality regulatory requirements. These models and methods are applied to analyze air permitting related to wastewater sludge to biofuel conversion pathways using hydrothermal liquefaction (HTL), impacts of HTL pathway on local and regional air quality including an assessment of health and equity impacts. In addition to filling research gaps, this project also disseminates the findings to the relevant stakeholders at BETO, other national labs, and regulatory agencies.

air quality↗

A comprehensive guide to CAN IDS data and introduction of the ROAD dataset

Although ubiquitous in modern vehicles, Controller Area Networks (CANs) lack basic security properties and are easily exploitable. A rapidly growing field of CAN security research has emerged that seeks to detect intrusions or anomalies on CANs. Producing vehicular CAN data with a variety of intrusions is a difficult task for most researchers as it requires expensive assets and deep expertise. To illuminate this task, we introduce the first comprehensive guide to the existing open CAN intrusion detection system (IDS) datasets. We categorize attacks on CANs including fabrication (adding frames, e.g., flooding or targeting and ID), suspension (removing an ID’s frames), and masquerade attacks (spoofed frames sent in lieu of suspended ones). We provide a quality analysis of each dataset; an enumeration of each datasets’ attacks, benefits, and drawbacks; categorization as real vs. simulated CAN data and real vs. simulated attacks; whether the data is raw CAN data or signal-translated; number of vehicles/CANs; quantity in terms of time; and finally a suggested use case of each dataset. State-of-the-art public CAN IDS datasets are limited to real fabrication (simple message injection) attacks and simulated attacks often in synthetic data, lacking fidelity. In general, the physical effects of attacks on the vehicle are not verified in the available datasets. Only one dataset provides signal-translated data but is missing a corresponding “raw” binary version. This issue pigeon-holes CAN IDS research into testing on limited and often inappropriate data (usually with attacks that are too easily detectable to truly test the method). The scarcity of appropriate data has stymied comparability and reproducibility of results for researchers. As our primary contribution, we present the Real ORNL Automotive Dynamometer (ROAD) CAN IDS dataset, consisting of over 3.5 hours of one vehicle’s CAN data. ROAD contains ambient data recorded during a diverse set of activities, and attacks of increasing stealth with multiple variants and instances of real (i.e. non-simulated) fuzzing, fabrication, unique advanced attacks, and simulated masquerade attacks. To facilitate a benchmark for CAN IDS methods that require signal-translated inputs, we also provide the signal time series format for many of the CAN captures. Our contributions aim to facilitate appropriate benchmarking and needed comparability in the CAN IDS research field.

97 MATHEMATICS AND COMPUTING↗

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Mineral Database and Dashboard

The scarcity of water resources, the need for beneficial water reuse, and the challenges of wastewater treatment are becoming increasingly pressing in economic, social, and environmental domains. Addressing these concerns requires effective treatment strategies to manage wastewater streams and tackle environmental and economic issues. Furthermore, the recovery of critical minerals from the waste streams associated with energy production holds the promise of offsetting treatment costs and securing local sources of valuable minerals. However, relevant data on these waste streams are dispersed and challenging to locate. The process of ingesting such data into modeling software often involves multiple steps, requiring data restructuring to meet software-input requirements. The non-standardized reporting of water data makes data aggregation and reformatting a time-consuming process. Additionally, essential attributes necessary for modeling water treatment and mineral scale formation are frequently missing. Moreover, data gaps vary depending on the region of interest. Consequently, there is a pressing need for high-quality energy-water composition data that can be easily imported into water chemistry modeling software. To address this need, the National Energy Technology Laboratory has created the National Energy Water Treatment and Speciation (NEWTS) Database and Dashboard—a free online tool catering to community leaders and water researchers. NEWTS facilitates a comprehensive understanding of the composition of energy-related wastewater streams in the United States. The datasets provide detailed concentrations and speciation of major and minor aqueous compounds in energy-related wastewater streams, including power plant leachate, acid mine drainage, brackish water, and oil and gas produced water across the United States. Many of the aqueous species are critical minerals (Li, REEs) in high demand to modernize the world’s energy infrastructure. Many of the datasets also contain volumetric flow-rates needed to model the treatment and reuse scenarios in advanced aqueous chemistry software programs. The NEWTS Database and Dashboard offer public access to hitherto challenging-to-access datasets, presented in a standardized format that is tailored for easy input into aqueous chemistry modeling software. By performing the work needed to transform dispersed, disparate data sources into unified, model-ready datasets, NEWTS serves as an essential resource in advancing water treatment research and sustainable water resource management.

produced water management↗

INFORMATION: Audit Report on "Accounting and Reporting for the American Recovery and Reinvestment Act by the Department of Energy's Funding Recipients"

The American Recovery and Reinvestment Act of 2009 (Recovery Act) was established to jumpstart the U.S. economy, create or save millions of jobs, and invest in the Nation's energy future. The Department of Energy received approximately $37 billion through the Recovery Act to support a variety of science, energy and environmental initiatives. The Office of Management and Budget (OMB) issued guidance for carrying out stimulus-related activities which requires, among other things, that recipients ensure funds provided by the Recovery Act are clearly distinguishable from non-Recovery Act funds in all reporting systems and that recipients' actions are transparent to the public. To meet these requirements, the Department's recipients must clearly and accurately track and report on 18 separate data elements. In addition, the Department was to develop and implement a process to ensure that recipient information reported to the public was free from material omissions and significant reporting errors. Our recent report (OAS-RA-10-01, October 2009) noted that the Department had developed a quality assurance process to facilitate the quarterly reviews of recipient data and planned to test it during the first quarterly reporting cycle. To determine whether the Department's quality assurance process was effective, we examined information reported by recipients of Departmental funding as of September 30, 2009. We also sought to determine whether the Department's prime contractors were prepared to track and report on Recovery Act activities. The Department had taken a number of actions designed to ensure the accuracy and transparency of reported Recovery Act results. This process identified potential anomalies with information reported by 1,113 of 2,038, or 55 percent of recipients. We view the Department's data quality assurance efforts as both timely and significant. As noted by our audit testing, however, opportunities exist to strengthen the process. In particular: (1) Site officials did not always ensure that anomalies, once identified during the quality assurance process, were actually resolved. For example, the Department's process identified that about 740 of the approximately 10,000 jobs reported in the first quarter of Fiscal Year 2010 as created/retained were for projects reported as having no funds spent. Although these problems were referred to site officials for follow-up and/or correction, the information was never actually changed; (2) The Department did not always utilize the correct basis when evaluating the accuracy of 'funds provided' data submitted by grant recipients. For example, in its analysis process, the Department used data reflecting 'funds obligated' rather than the correct amount of 'total grant awards'. This generated a number of potential false positives; and, (3) Duplicate reports by certain recipients, resulting in overstatements of as much as $137 million of the more than $18 billion obligated, were not corrected. We observed that the Department had taken prompt action to ensure that its prime facility management contractors could properly report Recovery Act information. Notably, the seven contractors in this category included in our review had modified their accounting systems, as necessary, to ensure that they could accurately track and report on Recovery Act activities. The systems at each of these entities had been restructured so that they: (i) could separate Recovery Act and non-Recovery Act funds; and, (ii) had adequate processing capacity to handle the projected increase in transactions. We found the Department's decision to limit its reviews to the four elements that it considered to be critical (award amount, invoiced amount, jobs created/retained, and project status) to be reasonable. We concluded, however, other elements or dependent relationships should not be completely excluded from review. Beyond its initial development and implementation of its quality assurance process, the Department had taken steps to improve its ability to ensure that Recovery Act information was both accurate and transparent to the public. Specifically, officials changed the quality assurance plan based on initial data reviews. Department officials also informed us that they are in the process of updating their quality assurance process to meet new OMB requirements. For example, recent guidance directed agencies to focus on certain data elements, such as award number and recipient name, during their quality assurance reviews. In addition, subsequent to our review, the Department added two more data elements and comparisons to its quarterly assurance process, including an analysis of costs/expenditures and a comparison of the recipient reported project status to the Department's data contained in its financial system.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Planck CMB anomalies: astrophysical and cosmological secondary effects and the curse of masking

Large-scale anomalies have been reported in CMB data with both WMAP and Planck data. These could be due to foreground residuals and or systematic effects, though their confirmation with Planck data suggests they are not due to a problem in the WMAP or Planck pipelines. If these anomalies are in fact primordial, then understanding their origin is fundamental to either validate the standard model of cosmology or to explore new physics. We investigate three other possible issues: 1) the trade-off between minimising systematics due to foreground contamination (with a conservative mask) and minimising systematics due to masking, 2) astrophysical secondary effects (the kinetic Doppler quadrupole and kinetic Sunyaev-Zel'dovich effect), and 3) secondary cosmological signals (the integrated Sachs-Wolfe effect). We address the masking issue by considering new procedures that use both WMAP and Planck to produce higher quality full-sky maps using the sparsity methodology (LGMCA maps). We show the impact of masking is dominant over that of residual foregrounds, and the LGMCA full-sky maps can be used without further processing to study anomalies. We consider four official Planck PR1 and two LGMCA CMB maps. Analysis of the observed CMB maps shows that only the low quadrupole and quadrupole-octopole alignment seem significant, but that the planar octopole, Axis of Evil, mirror parity and cold spot are not significant in nearly all maps considered. After subtraction of astrophysical and cosmological secondary effects, only the low quadrupole may still be considered anomalous, meaning the significance of only one anomaly is affected by secondary effect subtraction out of six anomalies considered. In the spirit of reproducible research all reconstructed maps and codes will be made available for download here http://www.cosmostat.org/anomaliesCMB.html.

79 ASTRONOMY AND ASTROPHYSICS↗

Guideline for Performing Systematic Approach to Evaluate and Qualify Legacy Documents that Support Advanced Reactor Technology Activity

The establishment of a systematic process for the evaluation of historic technology information for use in advanced reactor licensing is described. Efforts are underway to recover and preserve Experimental Breeder Reactor II and Fast Flux Test Facility historical data. These efforts have generally emphasized preserving information from data-acquisition systems and hard-copy reports and entering it into modern electronic formats suitable for data retrieval and examination. The guidance contained in this document has been developed to facilitate consistent and systematic evaluation processes relating to quality attributes of historic technical information (with focus on sodium-cooled fast reactor (SFR) technology) that will be used to eventually support licensing of advanced reactor designs. The historical information may include, but is not limited to, design documents for SFRs, research-and-development (R&D) data and associated documents, test plans and associated protocols, operations and test data, international research data, technical reports, and information associated with past U.S. Nuclear Regulatory Commission (NRC) reviews of SFR designs. The evaluation process is prescribed in terms of SFR technology, but the process can be used to evaluate historical information for any type of advanced reactor technology. An appendix provides a discussion of typical issues that should be considered when evaluating and qualifying historical information for advanced reactor technology fuel and source terms, based on current light water reactor (LWR) requirements and recent experience gained from Next Generation Nuclear Plant (NGNP).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Automated Clean Chemistry for Bulk Analysis of Environmental Swipe Samples – Final Report

Sample preparation methods for mass spectrometry are being automated using commercial-off-the-shelf (COTS) equipment to shorten lengthy and costly manual chemical purification procedures. This development addresses a serious need in the International Atomic Energy Agency’s (IAEA) Network of Analytical Laboratories (NWAL) to increase efficiency in the Bulk Analysis of Environmental Samples for Safeguards program with a method that allows unattended, overnight operation. In collaboration with Elemental Scientific Inc. (ESI), the prepFAST-MC2 was designed based on COTS equipment. It was modified for uranium/plutonium separations using renewable columns packed with Eichrom TEVA® and UTEVA® resins, with a chemical separation method based on the Oak Ridge National Laboratory (ORNL) NWAL chemical procedure. Initial verification of individual columns yielded small elution volumes with consistent elution profiles and good recovery. Combined column calibration demonstrated ample separation without crosscontamination of the eluent. Automated packing and unpacking of the built-in columns initially showed >15% deviation in resin loading by weight, which can lead to inconsistent separations. Optimization of the packing and unpacking methods led to a reduction in the variability of the packed resin to less than 5% daily. Based on the initial experience at ORNL with the prepFAST-MC2, a second-generation model, the prepFAST-SR, was built by ESI. The newly designed prepFAST-SR has several upgrades compared with the original prepFAST-MC2. The upgrades largely addressed issues with the reliability of unpacking the Eichrom columns and with ventilation to ensure adequate removal of acid vapors. Both systems are currently installed in the Ultra-Trace Forensics Science Center at ORNL. Separations of mixed uranium and plutonium samples containing certified reference materials were analyzed by multi-collector inductively coupled plasma mass spectrometry and yielded good results. Current efforts have demonstrated a wider applicability of the prepFAST system. Near-quantitative removal of metal interferences was achieved with the system in both uranium and plutonium separated fractions. Successful system validation was completed with several archived samples. Isotopic results from archived samples and certified reference materials were well within data quality limits for the IAEA NWAL. Additional COTS equipment has been evaluated for its potential to aid the prepFAST-SR system in reducing the time allotments and cleanroom infrastructure requirements for accurate separations. Overall, these efforts help ensure continued efficient and effective operation of the NWAL. Comparison of the amount of personnel time necessary for successful manual vs. automated chemical separations showed a significant decrease in hands-on time from 9.8 hours to 35 minutes for seven samples, respectively. This documented time savings and reduced labor translates to a significant cost savings per sample. Overall, the system will enable faster sample reporting times at reduced cost by limiting personnel hours dedicated to the chemical separation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

FUSRAP Case Study - Benefits and Lessons Learned from Implementation of a Modern Data Solution at Maywood - 18399

This paper focuses on data production and management practices dating back to 1999 that continue to evolve to support the project today. In 2000, the FUSRAP Maywood Project began using a software environmental data management system and laboratory information management system, developed by a single database administrator (DA) and authored in Microsoft Access{sup TM} (MS Access). The original databases included basic functionality including sample number assignment and label generation, tracking of LIMS gamma spec QC and assignment of basic qualifiers and basic database queries. The DA continued over the next fifteen years to refine the EDMS/LIMS by integrating project-specific data evaluation guidance document processes and Quality Assurance/Quality Control (QA/QC) charting and excursion warning tools. With the retirement of the original DA, the U.S. Army Corps of Engineers (USACE)-Cabrera Team procured and implemented a commercial-leaning solution using modern database tools and an established EDMS vendor. For the database transition process, the project team established and configured the new EDMS/LIMS with basic architecture and accessibility; evaluated existing workflows; established/revised LIMS and EDMS-related documentation (manuals and procedures); and conducted dry runs and validation testing. The overall team coordinated closely to facilitate a seamless transition from initial assessment and authoring, to data migration, and finally to resumption of normal ongoing operations. Key features of the new EDMS Subcontractor's software included lookup tables, an import wizard, data checking options and unique indexes. Since the database systems became operational, the technical staff gathered useful feedback from end users (e.g., lab staff, field engineers, task managers, and the third-party data validator) to refine the EDMS/LIMS operation. This feedback triggered improvements in the performance of onsite laboratory qualification forms, promoted consistency in sample ID numbers between the database sample planning screens and field chain-of-custodies, corrected bugs in the LIMS Duplicate Evaluation Report, eliminated data import issues such as blank, inconsistent or missing data from key fields. One of the advantages of the commercial database solution was that it allowed the project to cut cost over time due to the lower cost of database maintenance provided by the commercial database vendor versus the cost of an on-staff DA. Cost savings are estimated at $40,000 per year. There were also indirect cost savings resulting from implementation of the new database since it allowed better integration of the LIMS and EDMS. While there will always be challenges associated with long term records/data management for any old remediation site, the Maywood Team's approach to an upgraded EDMS/LIMS implementation serves as one element of the overall effort to enhance the integrity and reproducibility of critical data that supports the remediation program while at the same time, more effectively using available resources. These lessons-learned will enhance implementation of cost-effective solutions for similar environmental remediation sites. (authors)

97 MATHEMATICS AND COMPUTING↗

Statistically significant relational data mining :

This report summarizes the work performed under the project (3z(BStatitically significant relational data mining.(3y (BThe goal of the project was to add more statistical rigor to the fairly ad hoc area of data mining on graphs. Our goal was to develop better algorithms and better ways to evaluate algorithm quality. We concetrated on algorithms for community detection, approximate pattern matching, and graph similarity measures. Approximate pattern matching involves finding an instance of a relatively small pattern, expressed with tolerance, in a large graph of data observed with uncertainty. This report gathers the abstracts and references for the eight refereed publications that have appeared as part of this work. We then archive three pieces of research that have not yet been published. The first is theoretical and experimental evidence that a popular statistical measure for comparison of community assignments favors over-resolved communities over approximations to a ground truth. The second are statistically motivated methods for measuring the quality of an approximate match of a small pattern in a large graph. The third is a new probabilistic random graph model. Statisticians favor these models for graph analysis. The new local structure graph model overcomes some of the issues with popular models such as exponential random graph models and latent variable models.

Berry, Jonathan W.↗

Quality Control of Silicon Sensor Modules for Particle Detectors

The High-Luminosity Large Hadron Collider (HL-LHC) will produce a higher rate of particle collisions than the current Large Hadron Collider (LHC), requiring important upgrades to the Compact Muon Solenoid (CMS) to handle an increased amount of data. An important upgrade is the Phase-2 Outer Tracker Upgrade, which consists of 13,000 silicon sensor modules made of two parallel silicon sensors and readout electronics. These modules undergo careful quality control checks both during and after module assembly to ensure precise and reliable detector performance. This project focuses on precision testing for quality control of silicon sensor modules at Fermilab. Hands-on work includes visual inspection, current-voltage testing, module testing, and ultraviolet (UV) light exposure of modules showing abnormal current-voltage behavior. The ultraviolet exposure process improves the abnormal sensor readout data by placing the selected sensor side of the module directly under the UV light inside a controlled box. In addition to laboratory testing and ultraviolet experiments, I developed a Python-based data tool that connects to a module database and allows selected testing conditions and module information to be retrieved and displayed efficiently. These different testing procedures, experimental processes, and computational tools support the broader goal of identifying module issues and improving modules that will be used in the CMS Outer Tracker Phase-2 Upgrade.

Siddiqui, Hooriya [DuPage Coll.] (ORCID:0009000151↗

Time-Based Data Streams: Fundamental Concepts for a Data Resource for Streams

Real time data, which we call data streams, are readings from instruments, environmental, bodily or building sensors that are generated at regular intervals and often, due to their volume, need to be processed in real time. Often a single pass is all that can be made on the data, and a decision to discard or keep the instance is made on the spot. Too, the stream is for all practical purposes indefinite, so decisions must be made on incomplete knowledge. This notion of data streams has a different set of issues from a file, for instance, that is byte streamed to a reader. The file is finite, so the byte stream is becomes a processing convenience more than a fundamentally different kind of data. Through the duration of the project we examined three aspects of streaming data: the first, techniques to handle streaming data in a distributed system organized as a collection of web services, the second, the notion of the dashboard and real time controllable analysis constructs in the context of the Fermi Tevatron Beam Position Monitor, and third and finally, we examined provenance collection of stream processing such as might occur as raw observational data flows from the source and undergoes correction, cleaning, and quality control. The impact of this work is severalfold. We were one of the first to advocate that streams had little value unless aggregated, and that notion is now gaining general acceptance. We were one of the first groups to grapple with the notion of provenance of stream data also.

97 MATHEMATICS AND COMPUTING↗

Quality Control of Silicon Sensor Modules for Particle Detectors

The High-Luminosity Large Hadron Collider (HL-LHC) will produce a higher rate of particle collisions than the current Large Hadron Collider (LHC), requiring significant upgrades to the Compact Muon Solenoid (CMS) to handle the increased amount of data. An important upgrade is the Phase-2 Outer Tracker Upgrade, which consists of 13,000 silicon sensor modules made of two parallel silicon sensors and readout electronics. These modules undergo careful quality control checks both during and after module assembly to ensure precise and reliable detector performance. This project focuses on precision testing for quality control of silicon sensor modules at Fermilab. Hands-on work includes visual inspection, current-voltage testing, module testing, and ultraviolet (UV) light exposure of modules showing abnormal current-voltage behavior. The ultraviolet exposure process improves the abnormal sensor readout data by placing the selected sensor side of the module directly under the UV light inside a controlled box. In addition to laboratory testing and ultraviolet experiments, I developed a Python-based data tool that connects to a module database and allows selected testing conditions and module information to be retrieved and displayed efficiently. These different testing procedures, experimental processes, and computational tools support the broader goal of identifying module issues and improving modules that will be used in the CMS Outer Tracker Phase-2 Upgrade.

Siddiqui, Hooriya [DuPage Coll.; Fermilab] (ORCID:↗

A Public-Private-Academic Partnership to Advance Solar Power Forecasting

Executive Summary NOAA is making major contributions to the solar forecasting project in three areas. First, it is improving its forecasts of solar irradiance, clouds, and aerosols in its numerical weather prediction models. Second, it is providing advanced satellite products for DOE's FOA awardees to use in their forecast systems. Third, it is using high-quality ground-based measurements from SURFRAD and ISIS stations to verify and validate forecast model output. This reports covers results from all three areas for the period May 1, 2014 - April 30, 2015. Modeling In its modeling effort, NOAA continues work to improve the skill of solar forecasts from the Earth System Research Lab (ESRL) research versions of the 13-km Rapid Refresh (RAP) and the 3-km High-Resolution Rapid Refresh (HRRR) models, which are in turn transitioned into operations at the National Centers for Environmental Prediction (NCEP). A major milestone was achieved in September 2014 with the initial operational implementation of the HRRR at NCEP. In the ESRL research versions of the models, testing and development, in both real-time runs and retrospective experiments, is guided by an extensive in-house verification system. Early in the SFIP project, we developed the capability to verify our model forecasts against the high-quality surface radiation measurements from the SURFRAD and ISIS networks. This highlighted some shortcomings with the RAP and HRRR forecasts of incoming shortwave radiation. Most of our effort during Phase 1 of SFIP was focused on addressing these problems with a variety of model system improvements. The RAP and HRRR models during the warm season of 2014 had a noticeable warm and dry bias in near-surface conditions over most of the central and eastern United States, and our new SURFRAD/ISIS verification revealed that there was also a large excess of incoming global horizontal irradiance in the models. We hypothesized that a lack of cloud cover (particularly low-level cloud cover) in the models was resulting in too much heating of the land surface. This, in turn, caused unrealistically strong surface heat fluxes and turbulent mixing in the planetary boundary layer (PBL), which further reduced the already deficient cloud cover. We addressed these issues with a combination of data assimilation system modifications and model physics improvements. Many of our data assimilation changes were made with a view towards improving the near-term representation of clouds and precipitation. One of these changes involved better accounting for regions of weak reflectivity in the RAP cloud / hydrometeor assimilation system, in order to improve the representation of light precipitation in the RAP initial conditions and provide more realistic initial cloud cover. Additional modifications more accurately accounted for radar beam blockage and data gaps (particularly in the western United States), which improves shorter lead times forecasts of clouds and precipitation. We have also tested the assimilation of new data sources within the RAP and the HRRR, including radar radial velocity data and surface mesonet observations. Within the HRRR, we have tested the cycling of the 3-km land surface fields to allow a higher-resolution treatment of land surface processes. In terms of model physics development for SFIP, we have implemented a shallow cumulus scheme within the RAP, and have made numerous improvements to the Mellor-Yamada-Nakanishi-Niino (MYNN) PBL scheme to address insufficient low-level cloud cover in the models. We have conducted tests incorporating the radiation effects of (parameterized) boundary-layer clouds within the modified MYNN PBL scheme (independent of the convective schemes). The Grell-Freitas-Olson shallow cumulus scheme has also been tested within the 3-km HRRR. Finally, we have also modified the RUC land surface model (LSM) treatment of the vegetation wilting point, reducing it to increase evapotranspiration and increase cloud cover in the boundary layer. All of these changes work in tandem to significantly improve the model forecasts of cloud cover, incoming shortwave radiation, and near-surface temperature and moisture. Satellite The role of NOAA/NESDIS in the Solar Forecasting Improvement Project is to provide Advanced Satellite Products (ASPs) for the two forecasting teams at NCAR and IBM. The ASPs are cloud, surface, and atmosphere products derived from geostationary satellite imagery at the highest possible spatial and temporal resolution - such quantities as cloud mask, cloud probability, cloud transmission, cloud top height, cloud top temperature, cloud effective particle size, etc. Ancillary data, such as elevation and numerical weather prediction fields are provided in the files at the same resolution as well. There are at this time 147 different variables in the ASP output, including quality flags and processing information. The main goals for Year 1 of the project were to implement an Advanced Satellite Products system for the use of the IBM and NCAR teams, begin validation, and make any needed changes based on feedback from the teams. ASP files are being produced every GOES Imager acquisition, which occur on a 15-30 minute schedule. Processing is done on a dedicated computer, with a turn-around time of 8-21 minutes from image acquisition to results available on ftp. Several helpful visualizations of the data are also created for users on web pages. Users have been provided with a document titled "User's Guide for 1km Cloud Products Derived from GOES Imager Data using CLAVR-x", which discusses the basics of the source imagery, the process by which it is turned into Advanced Satellite Products, and considerations users should make when using the data. Validation of selected variables from the older 4km version of the products was also included. Future work will concentrate on validation of the 1km products and improving the turn-around time, product variety, and product quality as needed. Ground Observations In the ground-based measurement effort, NOAA's main objectives are to provide high quality radiation products for validation and verification of short-term to day-ahead solar forecasts. More specifically for the three year project, our goals include (1) Maintaining and providing data from our 7 SURFRAD and 7 ISIS; (2) Update ISIS radiation measurements from 3 min to 1 min data: (3) Purchase and install new pyrheliometers for direct solar irradiance measurements at the 7 SURFRAD sites; (4) Building, testing, and deploying two mobile SURFRAD stations at two utility plants in collaboration with DOE sponsored partners, and includes ongoing maintenance and processing of the data at the mobile sites; (5) Upgrading the data acquisition and communications at 7 SURFRAD sites and 7 ISIS sites; (6) Providing radiation data at the 7 SURFRAD sites in near real-time; (7) Develop and provide aerosol optical depth and cloud images and cloud fraction at our two mobile sites; (8) Provide data recovery rates each year; (9) Provide temporally and spatially averaged radiation products for comparison to HRRR and RAP solar forecasts and advanced satellite products; (10) Provide a data-set for analysis of conversion of direct and diffuse to sloped surfaces; (11) and as time permits develop and provide spectral solar irradiance, cloud optical depth and spectral albedo from the mobile sites. Milestones this year include working with the DOE sponsored teams to find locations to deploy two mobile SURFRAD stations. One existing unit was deployed at a 30MW PV facility in the San Luis Valley in collaboration with Xcel and the NCAR team in August, 2014. The second unit was built and tested at our facilities in Boulder, CO and deployed near Green Mountain Power's Education Center in Rutland, VT in collaboration with Green Mountain Power and the IBM Team in October, 2014. Data processing was implemented and the radiation data from these two mobile sites have been made available on our ftp server in near real-time. We also are providing images and cloud fraction from the TSI cameras for these two mobile sites on our ftp site. Another milestone was upgrading our data acquisition and communication systems at 7 SURFRAD and 7 ISIS sites. We accelerated our schedule for these upgrades to provide timely radiation products. These upgrades allow more reliable and near-real time radiation data delivery to the DOE sponsored teams to meet their goals. Lastly, we changed the data rate at the ISIS sites from 3 min to 1 min.

14 SOLAR ENERGY↗

Use of XRF to characterize pre-Hanford orchards in the 100-OL-1 operable unit - 15717

Prior to 1943, Hanford site included several small towns with approximately 5,000 acres of orchards; at the time lead arsenate (PbHAsO{sub 4}) was the most commonly used pesticide. High concentration of lead and arsenic have been recorded where trees and stumps are still visible. Pre-Hanford orchards have been designated as 100-OL-1 Operable Unit. An Optimization study evaluated optimal counting time and position of the XRF from soils collected at the site. A Pilot Study included the evaluation of a field portable x-ray fluorescence (XRF) analyzer determining if performance results meet quality assurance criteria for cleanup. XRF has only previously been used as a screening tool. Four Decision Units (DUs) are to be analyzed: Ol-14. OL-32. OL-IU6-4 and OL-FR2-1. The DUs vary in size and have had distinct historic activities; such as 46.4 acres OL-14 having a military camp in the 1950's unlike OL-FR2-1 having been disturbed as it is near the F area reactor. Together the DUs provide an adequate representation of the Operable Unit. Screening criteria for lead (250 mg/kg) and arsenic (20 mg/kg). Six samples were collected ranging above, at, and below the screening criteria of 250 mg/kg for Pb and 20 mg/kg for As at the Decision Units OL-14 and OL-IU6-4, and labeled respectively. Samples were hand sieved, homogenized and placed in sample cups. Three replicates were prepared for each sample. Each sample cup was analyzed 3 times for 30 sec. A Standard Reference Material (SRM) was analyzed after every 20 readings. Three samples were selected for 15, 30, 45, 60, 90, 120, 150 and 180 second fixed and variable analysis. Two transects at OL-14, and one at OL-IU6-4 were created by selecting locations 90. around ground zero at distances of 0.5, 1, 2, 4, 8 and 12 feet (16 ft for OL-14). Locations were scanned in triplicate for 60 seconds each. 4 Decision Units spanning roughly 370 acres were chosen to represent 100-OL-1 Operable Unit. 40 locations within each DU were selected using Visual Sample Plan (VSP) with a random start and systematic grid pattern. Each location would be analyzed with 3 replicates and a 60 second count time. The Standard Reference Material (SRM) and blank are analyzed after every 20 counts to ensure accuracy. Data is extracted from XRF to be implemented in GIS for visual representation of site with 1943 and 2013 aerial imagery. Discussion/Conclusion: - XRF provided a good indication of precision and accuracy relative to ICP with a linear correlation R{sup 2} value higher than anticipated at .9735; - MDL proved the detection limit is significantly lower than the screening criteria; - When comparing results from the first 40 locations of OL-14 to the total 80 locations of OL-14, the same variability was seen; - We expect high concentrations of Pb and As to be where past orchards are present though this does not occur as all sites. Significance: - XRF is competent for decision making as values fall within ±20% ICP data; - The highest concentrations are not where expected, which may be an issue for sites outside of Hanford that have had more development; - The size of the DU does not affect the number of samples measured. Future Work: - Verification and validation of the XRF Data (QA/QC); - Revise conceptual site model; - Statistical evaluations to investigate: Estimation of variability in surface soils, appropriate size for DU, and sample size per DU; - Coordinating sample results through CORE; - Displaying sample results in PHOENIX (GIS tool)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Dark energy survey operations: years 4 and 5

The Dark Energy Survey is a “stage III” dark energy experiment, performing an optical imaging survey to measure cos-mological equation of state parameters using four independent methods. The scope and complexity of the survey, originallyscheduled for 525 nights of observing spread over five years and combining a 5000 degree wide survey with a 10 field weeklytime-domain survey, introduced complex strategic and tactical scheduling problems that needed to be addressed. We beginwith an overview of the process used to develop DES strategy and tactics, from the inception of the project, to task forces thatstudied and developed strategy changes over the course of the survey, to the nightly pre-observing meeting in which imme-diate tactical issues were addressed. We then summarize the strategic choices made for each sub-survey, including metrics,scheduling considerations, choice of time domain fields and their sequences of exposures, and wide survey footprint andpointing layout choices. We go on to describe the detailed process that determined which specific exposures were taken atwhich specific times. We give a chronology of the strategic and tactical peculiarities of each year of observing, including theproposal and execution of a sixth year. We give an overview ofobstac, the implementation of the DES scheduler used to sim-ulate and evaluate strategic and tactical options, and automate exposure scheduling; and describe developments inobstacfor use after DES. Appendices describe further details of data quality evaluation,τ, andteff; airmass calculation; and model-ing of the seeing and sky brightness. The significant corpus of DES data indicates that the simple scaling relations for seeingas a function of wavelength and airmass derived from the Kolmogorov turbulence model work adequately for exposureplanning purposes: deviations from these relations are modest in comparison with short time-scale seeing variations

Gruendl, Robert A.↗

Hyundai FCEV Testing, Data Collection and Validation Fleet

This report summarizes the work conducted under Award Number DE-EE0005970 by Hyundai America Technical Center, Inc. (HATCI) to demonstrate and validate Hyundai Tucson Fuel Cell Electric Vehicles (FCEV) reliability in real world applications. HATCI operated 10 light-duty FCEVs throughout various geographical regions in United States to collect and submit vehicle performance durability data over 5 years. HATCI introduced FCEVs in two phases. First phase deployed 5 vehicles in Southern California to study customer real world usage and prove its reliability under commute and fleet driving pattern from 2013 to 2015. As the hydrogen station infrastructure expanded its network, second phase deployed and operated 5 additional vehicles under various climate zones (hot, cold, high altitude) and validated fuel cell performance from 2016 to 2017. California Air Resources Board (Sacramento, CA), California Fuel Cell Partnership, US Department of Energy (Washington DC), Hyundai Motor America, HATCI (Ann Arbor, Michigan), National Renewable Energy Laboratory (Golden, CO), and South Coast Air Quality Management District were the fleet operators. Four different stack degradation mechanism issues were addressed through validation project: fuel cell stack dry-out, flooding, cathode oxidation, and platinum dissolution. By developing counter-measures to each fuel cell stack degradation mechanism through performance validation fleet, Hyundai was able to successfully develop the next generation fuel cell vehicle NEXO, with longest range, large cost reduction, and best fuel cell powertrain warranty in its class (100,000 miles, 10 years warranty).

08 HYDROGEN↗