Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Combined Impedance Probe and Langmuir Probe Studies of the Low-Latitude E Region

The EQUIS-2 sounding rocket and radar campaign, launched from Kwajalein Atoll in 2004, included a mission to study low-latitude irregularities and electrodynamics, led by NASA GSFC. This mission included two instrumented rockets launched into the nighttime E region (apogee near 120 km), which included comprehensive electrodynamics and neutral density instrumentation. These rockets carried the first of a new generation of impedance probes, that utilize a wide-band drive signal to simultaneously measure the impedance of an antenna in a plasma as a function of frequency from 7 kEIz to 4 MHz. at a rapid cadence. This technique promises to permit true plasma spectroscopy, and resulted in the identification of multiple plasma resonances and accurate measurements of the plasma density, even in the low density nighttime E region. We present analyses of the technique and resulting spectra, and show how these data may be combined with fixed-bias Langmuir Probe data to infer the temperature structure of the E region as well as providing accurate absolute calibrations for the very high time resolution fixed-bias probe data. The data is shown to agree well with data from ionosonde, the ALTAIR radar, and the Peruvian beacon experiment.

Rowland, D. E.↗

Joint Observation Estimates of XCO2

Localized, correlated biases exist in OCO-2 (Orbiting Carbon Observatory-2) data. These biases do not improve with averaging. These have been noted by O'Dell (various OCO-2 telecons), Worden (2017), Kulawik (2018). We propose to utilize information from adjacent observations to reduce this bias. This works on the assumption that grouping the observations allows the system to find a better, global minimum. Pooling adjacent observations could allow more accurate characterization of interferents (e.g. retrieving additional albedo parameters), reducing entanglement with CO2.

Kulawik, Susan S.↗

Does Collection Time Bias the Ecology of Cleanroom Air Samples?

Microbial monitoring of astromaterials collections has taken on increased importance with the return of biologically sensitive samples from the asteroids Ryugu and Bennu and the initiation of the Mars Sample Return Program. Terrestrial bacteria and fungi can alter the mineralogy and organic composition of our collections causing irreversible contamination of pristine samples and increasing the risk of false positives for life detection measurements. NASA has conducted routine microbial monitoring of its existing collections since 20181. Initial monitoring focused on surface samples collected with foam swabs. Although, airborne microbiology is often decoupled from surface microbiology in the built environment2 culture-based air sampling techniques like impactors were not compliant with existing contamination control requirements. Bringing organic rich media, gelatin or liquids into curation cleanrooms presents an unacceptable risk to pristine samples. In 2022 NASA purchased a materials complaint air sampler and began collecting air samples from the cleanrooms in addition to surface samples3. The new instrument uses an electret filter to collect samples that are suitable for cultivating organisms or for direct DNA sequencing. Preliminary DNA sequencing results appeared to indicate that longer sampling times biased the microbial community in favor of hearty, spore-forming bacteria3. We present the results of a study comparing overnight sampling (17 hours) to short (1 hour) sampling of unoccupied curation cleanrooms. The results will help us optimize our monitoring protocols and develop a more detailed inventory of the ecology of astromaterials curation cleanrooms. Methods: We analyzed 72 paired air samples from six different cleanrooms including the meteorite processing lab (ISO 7 equivalent, 16 samples), the lunar lab (ISO 6 equivalent, 10 samples), the stardust lab (ISO 5 equivalent 14 samples), the OSIRIS-REx lab (ISO 5 equivalent, 12 samples), the Hayabusa2 lab (ISO 5 equivalent, 14 samples), and the Genesis lab (ISO 4 equivalent, 6 samples). All the samples were collected with an InnovaPrep Bobcat air sampler operating at a sampling rate of 200 L/min. The sampler operates for 5 minutes out of every 20 minute period. Half of the samples were collected by filtering 3,000L (15 min. of active sampling) of air across an electret filter for one hour. The rest of the samples were collected by filtering approximately 51,000 L air across the filter overnight (~17 hours, 255 min. of active sampling). Cells were eluted from the filter using 6-7 ml of pressurized 0.15% tween 20 in PBS (phosphate buffered saline). This liquid was used to cultivate bacteria according to previously published methods1,4,5 and for DNA extraction and next generation sequencing. DNA was extracted with a Qiagen MagAttract PowerMicrobiome kit6. To identify bacteria and archaea, the 16S rRNA gene was amplified using Earth Microbiome primers for the V4 region 7. The amplified DNA was sequenced on an Illumina MiSeq using a V3 reagent kit. The resulting sequences were processed using DADA2 and QIIME2 as implemented on the EDGE bioinformatics platform8–10. Results: Only two of the 72 samples had no amplifiable DNA. Amplified DNA concentrations ranged from 2.67 – 0.272 ng/µl. The median concentration of amplified DNA for the 1 hour samples was 0.770 ± 0.368 ng/µl. The median concentration of amplified DNA for the overnight samples was 0.877 ± 0.434 ng/µl. On average the overnight samples had slightly more sequences (58,960 vs. 59,456) and ASV’s (amplicon sequence variants) (60 vs 64.5) than the one hour samples, but these differences are not statistically significant. The most abundant ASV in every sample mapped to the genus Cupravidus. ASV’s mapping to the genuses Bacillus, Schlegelella, Thermus, and Staphylococcus were also common. Discussion and Future Work: Alpha diversity statistics like Shannon Entropy and Faith Phylogenetic Diversity are used to describe the diversity of organisms in a single sample. If a longer sampling time was biasing the data, we would expect to see a change in these diversity statistics vs. sample time. However, we did not observe this in our data. The median Shannon entropy was slightly higher for the overnight samples (3.773 vs 3.611) as was the Faith Phylogenetic Diversity (4.042 vs 3.596), but both values were within a standard deviation of each other for the two sampling times (Fig. 1). It is unlikely, that the longer sampling time is introducing bias into our data. We do observe a significant decrease in diversity when comparing the air samples by lab. The Genesis lab (ISO 4 equivalent) has a lower median number of ASV’s (45.5) than the other labs (62). Median values for Shannon Entropy (3.717 vs. 3.430) and Faith Phylogenetic Diversity (3.796 vs. 3.548) are also lower for Genesis, but those values are with one standard deviation of each other for the different sampling times. This is consistent with previous culture-based results suggesting that the environment in cleanrooms tends to select for a core group of organisms capable of surviving under dry, low nutrient, conditions. The presence of the ASV’s mapping to Cupravidus and Thermus in our sequencing blanks and controls suggests that several of the most common organisms in our samples represent contaminants from the reagents used to perform the DNA extractions and sequencing. Further work is needed to identify these contaminants, remove them from our data and recalculate the diversity statistics. This is a systematic error. Therefore, we do not expect removing the sequencing contaminants to change our conclusions. Longer air sample collection times appear to result in slightly higher diversity and do not bias the results towards “hardy” bacteria like spore-formers. Based on these preliminary results we conclude that sampling at least 3,000 liters of air is sufficient to capture the microbial diversity of cleanrooms, and that air samples can also be collected overnight without negatively impacting diversity. These results allow us to be flexible when designing microbial monitoring plans so that they do not interfere with routine lab activity. References: 1. Regberg, A. B. et al. 49th Lunar and Planetary Science Conference (2018). 2. The United States Pharmacopeial Convention. USP General Chapter <1116> (2013). 3. Regberg, A. B., et al. 54th Lunar and Planetary Science Conference (2023). 4. Regberg, A. B. et al. 53rd Lunar and Planetary Science Conference ( 2022). 5. Davis, R. E.,et al. 50th Lunar and Planetary Science Conference (2019). 6. Qiagen. MagAttract® PowerMicrobiome® DNA/RNA EP Kit Handbook. (2018). 7. Walters, W. et al. mSystems 1, (2015). 8. Callahan, B. J. et al. Nat. Methods 13, 581–583 (2016). 9. Hall, M. & Beiko, R. G. Microbiome Analysis: Methods and Protocols113–129 (Springer, 2018). 10. Philipson, C. et al. Bio-Protoc. 7, e2622 (2017).

A. B. Regberg↗

Instrumental Biases in Ionospheric Measurement Derived from GPS Data

Line-of-sight ionosphere measurements derived from differencing dual frequency GPS range data are corrupted by instrumental biases in both receiver and GPS satellite transmitters due to hardware delays in the L1 and L2 signal paths. Using a global ionospheric shell model to fit GPS based ionospheric delay data from a world wide network of 30 to 40 receivers, we can estimate, with a single fit, satellite biases for the entire GPS constellation and receiver biases for all the uncalibrated receivers.

GPS↗

Missing Data and Multiple Imputation: An Unbiased Approach

The default method of dealing with missing data in statistical analyses is to only use the complete observations (complete case analysis), which can lead to unexpected bias when data do not meet the assumption of missing completely at random (MCAR). For the assumption of MCAR to be met, missingness cannot be related to either the observed or unobserved variables. A less stringent assumption, missing at random (MAR), requires that missingness not be associated with the value of the missing variable itself, but can be associated with the other observed variables. When data are truly MAR as opposed to MCAR, the default complete case analysis method can lead to biased results. There are statistical options available to adjust for data that are MAR, including multiple imputation (MI) which is consistent and efficient at estimating effects. Multiple imputation uses informing variables to determine statistical distributions for each piece of missing data. Then multiple datasets are created by randomly drawing on the distributions for each piece of missing data. Since MI is efficient, only a limited number, usually less than 20, of imputed datasets are required to get stable estimates. Each imputed dataset is analyzed using standard statistical techniques, and then results are combined to get overall estimates of effect. A simulation study will be demonstrated to show the results of using the default complete case analysis, and MI in a linear regression of MCAR and MAR simulated data. Further, MI was successfully applied to the association study of CO2 levels and headaches when initial analysis showed there may be an underlying association between missing CO2 levels and reported headaches. Through MI, we were able to show that there is a strong association between average CO2 levels and the risk of headaches. Each unit increase in CO2 (mmHg) resulted in a doubling in the odds of reported headaches.

Foy, M.↗

The dark energy survey supernova program: investigating beyond-ΛCDM

We report constraints on a variety of non-standard cosmological models using the full 5-yr photometrically classified type Ia supernova sample from the Dark Energy Survey (DES-SN5YR). Both Akaike Information Criterion (AIC) and Suspiciousness calculations find no strong evidence for or against any of the non-standard models we explore. When combined with external probes, the AIC and Suspiciousness agree that 11 of the 15 models are moderately preferred over Flat-|$\Lambda$|CDM suggesting additional flexibility in our cosmological models may be required beyond the cosmological constant. We also provide a detailed discussion of all cosmological assumptions that appear in the DES supernova cosmology analyses, evaluate their impact, and provide guidance on using the DES Hubble diagram to test non-standard models. An approximate cosmological model, used to perform bias corrections to the data holds the biggest potential for harbouring cosmological assumptions. We show that even if the approximate cosmological model is constructed with a matter density shifted by |$\Delta \Omega _{\rm m}\sim 0.2$| from the true matter density of a simulated data set the bias that arises is subdominant to statistical uncertainties. Nevertheless, we present and validate a methodology to reduce this bias.

79 ASTRONOMY AND ASTROPHYSICS↗

An overview of MAP/GLOBUS NO(x)

GLOBUS NO(x) is a combined observation of nitrogen compounds by more than 20 experiments, from satellites, remote and in situ instruments on board balloons and ground observatories, within a short time period. Held in September 1985 above Southern France, the field campaign has been a technical success. Most of the observations were achieved as anticipated. NO, NO2 and relevant species and physical parameters involved in their photochemistry, were measured between 5 and 40 km at several periods of the day. A first step of data interpretation which consists of instrumental intercomparisons, is now achieved. Several systematic biases between data of various origins which have appeared in the past, are now understood and reduced. A second step which deals with atmospheric photochemistry issues like diurnal cycles and budget, is now on its way. It will be the object of a close exchange between experimenters involved in the campaign and modelers.

Pommereau, J. P.↗

Planning Bias: Planning as a Source of Sampling Bias

Many data-driven planning methods are trained on data generated by planners. It is well known that many statistical learning methods are sensitive to sampling bias, and yet there has been little or no attention to planning as a sampling method and its role in introducing sampling bias into planner-generated training data. Recently, it has been demonstrated that A**,* in the presence of problems with variable heuristic error, prefers some solutions over other equally cost-optimal solutions. But, as we discuss in this paper, mitigation may not be as simple as resolving arbitrary tie-breaking by sampling from ties uniformly at random. In this paper, we formalize an intuition of planning bias. We focus on problems which output a single solution. Diverse planning only complicates the problem by generalizing it to bias in the set of sets; we show how it is subject to bias in the single solution. We make some useful observations about deterministic algorithms in contrast to non-deterministic algorithms. We explain how information entropy may be a good way to measure planning bias, and discuss some issues in evaluating practical approaches to measurement. We address the intuition that uniform random tiebreaking should mitigate bias; and sketch a novel approach to constructing an appropriate random distribution for duplicate detection during forward search for unbiased A*. Finally, we suggest directions for future work.

Planning Scheduling Algorithms↗

Interactions between large space power systems and low-Earth-orbit plasmas

There is a growing tendency to plan space missions that will incorporate very large space power systems. These space power systems must function in the space plasma environment, which can impose operational limitations. As the power output increases, the operating voltage also must increase and this voltage, exposed at solar array interconnects, interacts with the local plasma. The implications of such interactions are considered. The available laboratory data for biased array segment tests are reviewed to demonstrate the basic interactions considered. A data set for a floating high voltage array test was used to generate approximate relationships for positive and negative current collection from plasmas. These relationships were applied to a hypothetical 100 kW power system operating in a 400 km, near equatorial orbit. It was found that discharges from the negative regions of the array are the most probable limiting factor in array operation.

Stevens, N. J.↗

Using Laser Altimetry to Detect Topographic Change in Long Valley Caldera, California

Long Valley caldera California, is a site of extensive volcanism, persistent seismicity, and uplift of a resurgent dome, currently at a rate of about 3 cm/year. Airborne laser altimetry was used to determine the surface topography of the region in 1993. A repeat mission occurred in 1995. Three different laser altimeters were flown, dubbed ATLAS, SLICER and RASCAL. Data processing consists of the combination of the aircraft trajectory and attitude data with the laser range, the determination of an atmospheric delay, laser pulse timing errors, laser system biases, and data geolocation to obtain the position of the laser spot on the ground. Results showed that using the ATLAS and SLICER instruments, the elevation of an overflown lake is determined to precisions of 3.3 cm and 2.9 cm from altitudes of 500 m and 3 km above the ground, and about 10 cm using the RASCAL instrument from 500 m above ground. Comparison with tide gauge data showed the laser measurements are able to resolve centimeter-level changes in the lake elevation over time. Repeat pass analysis of tracks over flat surfaces indicate no systematic biases affect the measurement procedure of the ATLAS and SLICER instruments. Comparison of GPS and laser-derived elevations of easily-identifiable features in the caldera confirm the horizontal accuracy of the measurement is within the diameter of the laser footprint, and vertical accuracy is within the error inherent in the measurement. Crossover analysis shows that the standard error of the means at track intersection points within the caldera, and dome (i.e., where zero and close to the maximum amount of uplift is expected) are about I cm, indicating elevation change at the 3 cm/year level should be detectable. We demonstrate one of the powerful advantages of scanning laser altimetry over other remote sensing techniques; the straightforward creation of precise digital elevation maps of overflown terrain. Initial comparison of the 1993-1995 data indicates uplift occurred, but filtering is required to remove vegetation effects. Although research continues to utilize the full potential of laser altimetry data, the results constitute a successful demonstration that the technique may be used to perform geodetic monitoring of surface topographic change.

Hofton, M. A.↗

Using Laser Altimetry to Detect Topographic Change at Long Valley Caldera, California

Long Valley caldera, California, is a site of extensive volcanism, persistent seismicity, and uplift of a resurgent dome, currently at a rate of approximately 3 cm/year. Airborne laser altimetry was used to determine the surface topography of the region in 1993. A repeat mission occurred in 1995. Three different laser altimeters were flown, dubbed ATLAS, SLICER and RASCAL. Data processing consists of the combination of the aircraft trajectory and attitude data with the laser range, the determination of an atmospheric delay, laser pulse timing errors, laser system biases, and data geolocation to obtain the position of the laser spot on the ground. Results showed that using the ATLAS and SLICER instruments, the elevation of an overflown lake is determined to precisions of 3.3 cm and 2.9 cm from altitudes of 500 m and 3 km above the ground, and approximately 10 cm using the RASCAL instrument from 500 m above ground. Comparison with tide gauge data showed the laser measurements are able to resolve centimeter-level changes in the lake elevation over time. Repeat pass analysis of tracks over flat surfaces indicate no systematic biases affect the measurement procedure of the ATLAS and SLICER instruments. Comparison of GPS and laser-derived elevations of easily-identifiable features in the caldera confirm the horizontal accuracy of the measurement is within the diameter of the laser footprint, and vertical accuracy is within the error inherent in the measurement. Crossover analysis shows that the standard error of the means at track intersection points within the caldera and dome (i.e., where zero and close to the maximum amount of uplift is expected) are about 1 cm, indicating elevation change at the 3 cm/year level should be detectable. We demonstrate one of the powerful advantages of scanning laser altimetry over other remote sensing techniques; the straightforward creation of precise digital elevation maps of overflown terrain. Initial comparison of the 1993-1995 data indicates uplift occurred, but filtering is required to remove vegetation effects. Although research continues to utilize the full potential of laser altimetry data, the results constitute a successful demonstration that the technique may be used to perform geodetic monitoring of surface topographic change.

Hofton, M. A.↗

A Comparison of Methods for a Priori Bias Correction in Soil Moisture Data Assimilation

Data assimilation is being increasingly used to merge remotely sensed land surface variables such as soil moisture, snow and skin temperature with estimates from land models. Its success, however, depends on unbiased model predictions and unbiased observations. Here, a suite of continental-scale, synthetic soil moisture assimilation experiments is used to compare two approaches that address typical biases in soil moisture prior to data assimilation: (i) parameter estimation to calibrate the land model to the climatology of the soil moisture observations, and (ii) scaling of the observations to the model s soil moisture climatology. To enable this research, an optimization infrastructure was added to the NASA Land Information System (LIS) that includes gradient-based optimization methods and global, heuristic search algorithms. The land model calibration eliminates the bias but does not necessarily result in more realistic model parameters. Nevertheless, the experiments confirm that model calibration yields assimilation estimates of surface and root zone soil moisture that are as skillful as those obtained through scaling of the observations to the model s climatology. Analysis of innovation diagnostics underlines the importance of addressing bias in soil moisture assimilation and confirms that both approaches adequately address the issue.

Kumar, Sujay V.↗

DEEPEN 3D PFA Weights for Exploration Datasets in Magmatic Environments

DEEPEN stands for DE-risking Exploration of geothermal Plays in magmatic ENvironments. As part of the development of the DEEPEN 3D play fairway analysis (PFA) methodology for magmatic plays (conventional hydrothermal, superhot EGS, and supercritical), weights needed to be developed for use in the weighted sum of the different favorability index models produced from geoscientific exploration datasets. This GDR submission includes those weights. The weighting was done using two different approaches: one based on expert opinions, and one based on statistical learning. The weights are intended to describe how useful a particular exploration method is for imaging each component of each play type. They may be adjusted based on the characteristics of the resource under investigation, knowledge of the quality of the dataset, or simply to reduce the impact a single dataset has on the resulting outputs. Within the DEEPEN PFA, separate sets of weights are produced for each component of each play type, since exploration methods hold different levels of importance for detecting each play component, within each play type. The weights for conventional hydrothermal systems were based on the average of the normalized weights used in the DOE-funded PFA projects that were focused on magmatic plays. This decision was made because conventional hydrothermal plays are already well-studied and understood, and therefore it is logical to use existing weights where possible. In contrast, a true PFA has never been applied to superhot EGS or supercritical plays, meaning that exploration methods have never been weighted in terms of their utility in imaging the components of these plays. To produce weights for superhot EGS and supercritical plays, two different approaches were used: one based on expert opinion and the analytical hierarchy process (AHP), and another using a statistical approach based on principal component analysis (PCA). The weights are intended to provide standardized sets of weights for each play type in all magmatic geothermal systems. Two different approaches were used to investigate whether a more data-centric approach might allow new insights into the datasets, and also to analyze how different weighting approaches impact the outcomes. The expert/AHP approach involved using an online tool (https://bpmsg.com/ahp/) with built-in forms to make pairwise comparisons which are used to rank exploration methods against one-another. The inputs are then combined in a quantitative way, ultimately producing a set of consensus-based weights. To minimize the burden on each individual participant, the forms were completed in group discussions. While the group setting means that there is potential for some opinions to outweigh others, it also provides a venue for conversation to take place, in theory leading the group to a more robust consensus then what can be achieved on an individual basis. This exercise was done with two separate groups: one consisting of U.S.-based experts, and one consisting of Iceland-based experts in magmatic geothermal systems. The two sets of weights were then averaged to produce what we will from here on refer to as the "expert opinion-based weights," or "expert weights" for short. While expert opinions allow us to include more nuanced information in the weights, expert opinions are subject to human bias. Data-centric or statistical approaches help to overcome these potential human biases by focusing on and drawing conclusions from the data alone. More information on this approach along with the dataset used to produce the statistical weights may be found in the linked dataset below.

15 GEOTHERMAL ENERGY↗

The National Climate Data Base (NCDB): A Bias-Corrected High-Resolution Climate Dataset

Assessing renewable energy resources under future climate scenarios has been highlighted in recent years to analyze and understand potential impacts of future change in renewable generation on the power sector. Solar energy is well-known as the most plentiful among various renewable resources and usually converted to electricity using photovoltaics (PV) technologies, and the global deployment of PV technology has increased rapidly in recent decades. In this study, we develop a statistical technique to downscale the future projection of solar irradiance for PV energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the proposed downscaling method and future extension of this research.

climate data↗

An Analysis of Gravity-Field Estimation Based on Intersatellite Dual-1-Way Biased Ranging

The GRACE (Gravity Recovery And Climate Experiment) mission is designed to make global, highly accurate measurements of the Earth's gravity field with high spatial resolution. Ancillary GPS occultation measurements are also to be carried out for atmospheric monitoring. In the dual-1-way biased ranging of this mission, the range between two satellites separated by 100 to 200 km in nearly polar, coplanar, circular orbits, is measured to very high precision, to within an additive constant, through the exchange of K- and Ka-band sinusoidal signals. Such biased ranging data, along with GPS L-band range and phase data, can be processed and fit over successive multiday intervals to obtain accurate estimates of the Earth's gravity field. This report approximately models and analyzes this process, from the generation of the RF signals at the two satellites through the extraction of the geopotential. The steps include generation of the transmitted signals, processing the received signals to extract high-rate baseband phase, carrying out a dual-1-way combination of baseband phase to extract high-rate biased range for each band, combining K- and Ka-band ranges to correct for the ionosphere effect, and processing the resulting high-rate biased range values to extract three types of reduced-rate observables: biased range, range rate and range acceleration. The version of dual-1-way biased ranging developed by this report improves upon previous versions in a number of ways: highly accurate satellite-timetag corrections derived from concurrent GPS data, better baseband phase extraction using highly digital processing, highly accurate USO-rate calibration derived from concurrent GPS data, an improved method for extracting high-rate biased range from baseband phase, improved filtering for extracting reduced- rate observables from high-rate biased range, and parallel extraction of three observable types.

SINUSOIDAL SIGNALS↗

Comprehensive Assessment of Models and Events Using Library Tools (CAMEL) Framework: Time Series Comparisons

The Comprehensive Assessment of Models and Events using Library Tools (CAMEL) framework leverages existing Community Coordinated Modeling Center services: Run on Request post processing tools that generate model time series outputs and the new Community Coordinated Modeling Center Metadata Registry that describes simulation runs using Space Physics Archive Search and Extract metadata. The new CAMEL visualization tool compares the modeled time series with observational data and computes a suite of skill scores such as Prediction Efficiency, Root Mean Square Error, and Symmetric Signed Percentage Bias. Model data pairs used for skill calculations are obtained considering a user selected maximum difference between the time of observation and the nearest model output. The system renders available data for all locations and time periods selected using interactive visualizations that allow the user to zoom, pan, and pick data values along traces. Skill scores are reported for each selected event or aggregated over all events for all participating model runs. Separately, scores are reported for all locations (satellites or stations) and for each location individually. We are building on past experiences with model data comparisons of magnetosphere and ionosphere model outputs from GEM2008, GEMCEDAR Electrodynamics Thermosphere Ionosphere, and the SWPC Operational Space Weather Model challenges. The CAMEL visualization tool is demonstrated using three validation studies: (a) Wang Sheeley Arge heliosphere simulations compared against OMNI solar wind data, (b) ground magnetic perturbations from several magnetosphere and ionosphere electrodynamics models as observed by magnetometers, and (c) electron fluxes from several ring current simulations compared to Radiation Belt Storm Probes Helium Oxygen Proton Electron instrument measurements, integrated over different energy ranges.

Rastätter, Lutz↗

Bias Corrected NOAA HRRR Wind Resource Data for Grid Integration Applications

To address the need for regularly updated wind resource data, NREL has processed the High-Resolution Rapid Refresh (HRRR) outputs for use in grid integration modeling. The HRRR is an hourly-updated operational forecast product produced by the National Oceanic and Atmospheric Administration (NOAA) (Dowell et al., 2022). Several barriers have prevented the HRRR's widespread proliferation in the wind energy industry: missing timesteps (prior to 2019), challenging file format for wind energy analysis, limited vertical height resolution, and negative bias versus legacy WIND Toolkit data (2007-2013). NREL has applied re-gridding, interpolation, and bias-correction to the native HRRR data to overcome these limitations. This results in the now-publicly-available bias corrected and interpolated HRRR (BC-HRRR) dataset for weather years 2015 to 2023. Bias correction is necessary for wind resource consistency across weather years to be used simultaneously in planning-focused grid integration studies alongside the original WIND Toolkit data. We show that quantile mapping with the WIND Toolkit as a historical baseline is an effective method for bias correcting the interpolated HRRR data: the BC-HRRR has reduced mean bias versus comparable gridded wind resource datasets (+0.12 m/s versus Vortex) and has very low mean bias versus ground measurement stations (+0.01 m/s) (Buster et al., 2024). BC-HRRR's consistency with the legacy WIND Toolkit allows NREL to extend grid integration analysis to 15+ weather years of wind data with low-overhead extensibility to future years as they are made available by NOAA. As with historical datasets like the WIND Toolkit, BC-HRRR is intended for use in grid integration modeling (e.g., capacity expansion, production cost, and resource adequacy modeling) both independently and alongside the legacy WIND Toolkit.

Array↗

Addressing and Presenting Quality of Satellite Data via Web-Based Services

With the recent attention to climate change and proliferation of remote-sensing data utilization, climate model and various environmental monitoring and protection applications have begun to increasingly rely on satellite measurements. Research application users seek good quality satellite data, with uncertainties and biases provided for each data point. However, different communities address remote sensing quality issues rather inconsistently and differently. We describe our attempt to systematically characterize, capture, and provision quality and uncertainty information as it applies to the NASA MODIS Aerosol Optical Depth data product. In particular, we note the semantic differences in quality/bias/uncertainty at the pixel, granule, product, and record levels. We outline various factors contributing to uncertainty or error budget; errors. Web-based science analysis and processing tools allow users to access, analyze, and generate visualizations of data while alleviating users from having directly managing complex data processing operations. These tools provide value by streamlining the data analysis process, but usually shield users from details of the data processing steps, algorithm assumptions, caveats, etc. Correct interpretation of the final analysis requires user understanding of how data has been generated and processed and what potential biases, anomalies, or errors may have been introduced. By providing services that leverage data lineage provenance and domain-expertise, expert systems can be built to aid the user in understanding data sources, processing, and the suitability for use of products generated by the tools. We describe our experiences developing a semantic, provenance-aware, expert-knowledge advisory system applied to NASA Giovanni web-based Earth science data analysis tool as part of the ESTO AIST-funded Multi-sensor Data Synergy Advisor project.

Leptoukh, Gregory↗