Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bad data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Accurate determination of ferric iron in garnets

Numerous techniques are available to determine the amount of Fe 2+ and Fe 3+ in minerals. Calculating Fe 2+ and Fe 3+ by charge-balance using electron probe microanalysis (EPMA) data is the most common method, but several studies question the usefulness and accuracy of this approach (Canil and O’Neill 1996; Dyar et al. 1993, 2012; Lalonde et al. 1998; Li et al. 2005; McGuire et al. 1989; Schingaro et al. 2016; Schmid et al. 2003; Sobolev et al. 2011). We compile and compare data for natural garnets that have been analyzed by both EPMA and Mössbauer spectroscopy. Comparison of Fe3+/ΣFe determined by charge-balance vs. Mössbauer spectroscopy shows an approximate 1:1 correlation. The EPMA data set of Dyar et al. (2012) is reexamined and it is shown that disagreement between EPMA and Mössbauer for their data is not nearly as bad as reported. Finally, data for charge-balance vs. Mössbauer spectroscopy are compared and show that the EPMA/charge-balance approach provides a suitable alternative when other methods are not practical.

58 GEOSCIENCES↗

Raw soil carbon dioxide, moisture, temperature and micrometeorological data in the East River Watershed, Colorado June 2021-June 2024. (DE-SC0021139)

This dataset contains raw data from four tripod stations along an elevation gradient on Snodgrass Mountain in the East River Watershed, CO, USA. Each station contains a datalogger connected to 3 soil Carbon Dioxide CO2 gas probes, 3 soil temperature/moisture sensors and a micrometeorological station. Sensors are scanned every minute, and the 30 minute average is reported. The file snodgrass_soil_ESS.csv contains raw data, a row of column descriptors, and units of measurements. some data processing and QA/QC was done to filter out data from sensors that went bad and extreme outliers. CO2 sensors that went bad were replaced with new sensors as soon as possible. This research was performed to investigate the ecohydrological linkages of belowground carbon processes in the East River watershed forested communities to better understand how these ecosystems will respond to a changing cold-season moisture input. This is the second version of this data set and was modified on 10/01/2024. The primary change in the data was the addition of data from the fall of 2022 to June of 2024. In addition, minor QA/QC was done to filter out data from sensors that went bad and extreme outliers. THe filtered data are now NA's in this data frame and primarily the CO2 sensors. Limited to no QA/QC has been done on the other environmental data. This is now the third version of the data set, and was modified 03/25/2026. The primary change in the data was the addition of data from the June of 2024 to December 2025. Further r QA/QC was done with the new data to filter out bad data from faulty sensors and extreme outliers. The filtered data are now NA's in this data frame and primarily the CO2 sensors. Limited to no QA/QC has been done on the other environmental data. ##This additional data was funded under DE-SC0024218( Responses of Plant and Microbial Respiration Sources to Changing Cold Season Climate Drivers in the East River Watershed)

54 ENVIRONMENTAL SCIENCES↗

A Graph Convolutional Network for Active Distribution System Anomaly Detection Considering Measurement Spatial-Temporal Correlations

The accuracy of distribution system state estimation may be significantly impacted by the existence of bad measure-ments and unexpected topology errors. This paper proposes a data-driven Graph Convolutional Network (GCN) for anomaly detection, including bad measurements and topology change events. Compared to many existing machine learning approaches, the proposed approach embeds both spatial-temporal measure-ment correlations, which allows us to detect and distinguish different anomalies. Numerical results carried out on the IEEE 37-node system demonstrate that the proposed-based method can obtain high accuracy in detecting bad data and topology changes as compared to other approaches, even in the presence of high PV penetrations.

active distribution system↗

SAIL-Net Raw and Post Corrected POPS Data Fall 2021 - Summer 2023

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleation particles (INP). This network enables the investigation of small-scale variations in complex terrain. Two datasets are provided - one containing raw data and the other containing post-corrected data. The raw dataset provides the raw data recorded from the POPS which were deployed at each of the six sites. These data are organized by site and broken down into daily data files. The six site names used here are: “gothic”, “irwin”, “cbtop”, “cbmid”, “pumphouse”, and “snodgrass”. These data are not cleaned or post-corrected, but some flags have been added. The data are reported at 1 second time resolution. The post-corrected dataset provides the post-corrected and cleaned data recorded from the POPS which were deployed at each of the six sites. This data are also organized by site (same as those found in the raw data) and broken down into daily data files. Unlike the raw POPS data, these data have already been cleaned to remove what we believe are bad values. These data should be ready to use with no cleaning. For a full description of the cleaning and post-correction process, see the readme.

54 ENVIRONMENTAL SCIENCES↗

Nuclear Data Matters - The obvious case of a bad mixing ratio for 58 Co

We present results of modeled cross sections for neutron- and proton-induced reactions leading to the final product nucleus 58 Co. In each case the gamma-cascade branching ratios given in the ENSDF database circa 2014 predict modeled nuclear cross sections leading to the ground and first excited metastable state that are incompatible with measured cross sections found in the NNDC experimental cross section database EXFOR. We show that exploring the uncertainty in the mixing ratio used to calculate the gamma-cascade branching ratios for the 53.15 keV 2 nd excited state leads to changes in the predicted partial cross sections by amounts that give good agreement with measured data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Resilient data staging through MxN distributed transactions.

Scientific computing-driven discoveries are frequently driven from workflows that use persistent storage as a staging area for data between operations. With the bad and progressively worse bandwidth vs. data size issues as we continue towards exascale, eliminating persistent storage through techniques like data staging will both enable these workflows to continue online, but also enable more interactive workflows reducing the time to scientific discoveries. Data staging has shown to be an effective way for applications running on high-end computing platforms to offload expensive I/O operations and to manage the tremendous amounts of data they produce. This data staging approach, however, lacks the ACID style guarantees traditional straight-to-disk methods provide. Distributed transactions are a proven way to add ACID properties to data movements, however distributed transactions follow 1xN data movement semantics, where our highly parallel HPC environments employ MxN data movement semantics. In this paper we present a novel protocol that extends distributed transaction terminology to include MxN semantics which allows our data staging areas to benefit from ACID properties. We show that with our protocol we can provide resilient data staging with a limited performance penalty over current data staging implementations.

99 GENERAL AND MISCELLANEOUS↗

The Magnetic Future of the Sun

We analyze space- and ground-based data for the old (7.0 ± 0.3 Gyr) solar analogs 16 Cyg A and B. The stars were observed with the Cosmic Origins UV Spectrographs on the Hubble Space Telescope (HST) on 2015 October 23 and 2016 February 3, respectively, and with the Chandra X-ray Observatory on 2016 February 7. Time-series data in Ca ii data are used to place the UV data in context. The UV spectra of 18 Sco (3.7 ± 0.5 Gyr), the Sun (4.6 ± 0.04 Gyr), and α Cen A (5.4{sub −0.2}{sup +1.2} Gyr) appear remarkably similar, pointing to a convergence of magnetic heating rates for G2 main-sequence stars older than ≈2–4 Gyr. But the B component’s X-ray (0.3–2.5 keV) flux lies 20× below a well-known minimum level reported by Schmitt. As reported for α Cen A, the coronal temperature probably lies below that detectable in soft X-rays. No solar UV flux spectra of comparable resolution to those of stellar data exist, but they are badly needed for comparison with stellar data. Center-to-limb variations are reevaluated for lines such as Ca ii through X-rays, with important consequences for observing activity cycles in such features. We also call into question work that has mixed solar intensity–intensity statistics with flux–flux relations of stars.

79 ASTRONOMY AND ASTROPHYSICS↗

Theory of Nonlinear Diffusion with a Physical Gapped Mode

In a system with one conserved charge the charge diffusion is modified by nonlinear self-interactions within an effective field theory (EFT) of diffusive fluctuations. We include the slowest ultraviolet (UV) mode, constructing a UV-regulated EFT. The relaxation time of this UV mode is protected from renormalization, as supported by experimental data in a bad metal system. Furthermore, the retarded density-density Green’s function acquires four branch points, eventually increasing the range of applicability. We discuss the fate of long time tails as well as implications for the quark gluon plasma. Published by the American Physical Society 2024

Physics↗

WADeG-IP

The software takes the images and runs a variety of processing on them. These include calculating per pixel statistics to generate combined images and determine which pixels have signal and which have noise. This is done via two methods: 1) Take a series of images and find the median value for each pixel, then generate new images from that, or 2) calculate the kurtosis for each pixel, and only keep the pixel values from the pixels with high kurtosis values generating a single signal image. Then, the image(s) are processed to find features in the images. Since the above work has been done to remove data caused by bad pixels, the task basically is to find the bright pixels (i.e., ones with substantial amounts of energy deposited) and group them into events. Either a threshold value can be specified, or any pixel that is more than 5 standard deviations from the mean pixel value can be considered bright. Then, pixel groups are created by finding a minimum spanning tree that has no elements greater than a maximum value. This finds separate lines and groups of pixels that are usually caused by one high energy electron. These statistics for the image are tallied and then output. The output includes the location of each event and the total number of events.

Cogliati, JoshuaJ.↗

SU-F-J-189: A Method to Improve the Spatial Resolution of Prompt Gamma Based Compton Imaging for Proton Range Verification

Purpose: To test two new techniques, the distance-of-closest approach (DCA) and Compton line (CL) filters, developed as a means of improving the spatial resolution of Compton camera (CC) imaging. Methods: Gammas emitted from {sup 22}Na, {sup 137}Cs, and {sup 60}Co point sources were measured with a prototype 3-stage CC. The energy deposited and position of each interaction in each stage were recorded and used to calculate a “cone-of-origin” for each gamma that scattered twice in the CC. A DCA filter was developed which finds the shortest distance from the gamma’s cone-of-origin surface to the location of the gamma source. The DCA filter was applied to the data to determine the initial energy of the gamma and to remove “bad” interactions that only contribute noise to the image. Additionally, a CL filter, which removes gamma events that do not follow the theoretical predictions of the Compton scatter equation, was used to further remove “bad” interactions from the measured data. Then images were reconstructed with raw, unfiltered data, DCA filtered data, and DCA+CL filtered data and the achievable image resolution of each dataset was compared. Results: Spatial resolutions of ∼2 mm, and better than 2 mm, were achievable with the DCA and DCA+CL filtered data, respectively, compared to > 5 mm for the raw, unfiltered data. Conclusion: In many special cases in medical imaging where information about the source position may be known, such as proton radiotherapy range verification, the application of the DCA and CL filters can result in considerable improvements in the achievable spatial resolutions of Compton imaging.

60 APPLIED LIFE SCIENCES↗

Enhancing Data Quality Monitoring at CMS with Interactive Visualization Tools and Automated Reference Run Selection

Current data quality monitoring (DQM) tools at CMS offer granularity limited to per-run analysis. Consequently, issues manifesting at the per-lumisection level can go unnoticed or, even if detectable, often lead to the classification of the whole run as bad, resulting in unnecessary data loss. Additionally, shifters have to evaluate a large set of monitoring elements during their long shifts, increasing the probability of human errors or overlooked problems. In this contribution, we present ongoing work on the development of tools that will provide shifters with an accessible, granularity-enhanced view of DQM data through interactive and dynamic visualizations. Furthermore, we introduce a reference run selection tool currently under development, which will automate the selection based on data-taking conditions and will offer a curated set of training data for machine learning models that will be used for the partial automation of the offline data certification process. These endeavors will be integrated into the DIALS website, enabling enhancements in data certification accuracy and improving the accessibility of DQM at CMS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

BCL-2 family protein, BAD is down-regulated in breast cancer and inhibits cell invasion

We have previously demonstrated that the anti-apoptotic protein BAD is expressed in normal human breast tissue and shown that BAD inhibits expression of cyclin D1 to delay cell-cycle progression in breast cancer cells. Herein, expression of proteins in breast tissues was studied by immunohistochemistry and results were analyzed statistically to obtain semi-quantitative data. Biochemical and functional changes in BAD-overexpressing MCF7 breast cancer cells were evaluated using PCR, reporter assays, western blotting, ELISA and extracellular matrix invasion assays. Compared to normal tissues, Grade II breast cancers expressed low total/phosphorylated forms of BAD in both cytoplasmic and nuclear compartments. BAD overexpression decreased the expression of β-catenin, Sp1, and phosphorylation of STATs. BAD inhibited Ras/MEK/ERK and JNK signaling pathways, without affecting the p38 signaling pathway. Expression of the metastasis-related proteins, MMP10, VEGF, SNAIL, CXCR4, E-cadherin and TlMP2 was regulated by BAD with concomitant inhibition of extracellular matrix invasion. Inhibition of BAD by siRNA increased invasion and Akt/p-Akt levels. Clinical data and the results herein suggest that in addition to the effect on apoptosis, BAD conveys anti-metastatic effects and is a valuable prognostic marker in breast cancer. - Highlights: • BAD and p-BAD expressions are decreased in breast cancer compared with normal breast tissue. • BAD impedes breast cancer invasion and migration. • BAD inhibits the EMT and transcription factors that promote cancer cell migration. • Invasion and migration functions of BAD are distinct from the BAD's role in apoptosis.

60 APPLIED LIFE SCIENCES↗

Characterization of Soil and Rock Magnetic Properties along Multiple Hillslope Transects at Teller Road Site, Seward Peninsula, Alaska, 2018 and 2023

The magnetometer data was collected in multiple directions across the watershed hillslope at the NGEE Arctic Teller Road site at mile marker 27 (TL_MM27) on the Seward Peninsula, Alaska over multiple years in March 2018 and April 2023. The magnetic data were collected using a Geometrics Inc. G-858 gradiometer and G-857 base station in 2018 and the G-864 gradiometer and G857 base station in 2023. The data was collected (in all instances) by towing the gradiometer behind a snow machine around the watershed with the two sensors in a vertical profile with constant spacing during the continuous survey in that specific year. Magnetic total field measurements were collected by gradiometer and base station, and the data processing was performed in Geometrics MagMap2000 software. The processing steps were limited to removal of data spikes (despiking), reading dropouts, and correction/removal of bad GPS points. All offsets between sensors and GPS are stated within the data files and metadata, alongwith the processed and raw data. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).In this data submission there are two sets of raw magnetic data (.bin and .stn for 2018 and base for 2023; raw rover mag for 2023 is in .csv) inside two .zip files that identify the year the mag data was collected. The data are proprietary format to Geometrics and can be opened and processed with MagMap2000 which can be downloaded for free at Geometrics website. There are also two processed data files *.csv for each year and two metadata files *.csv.

54 ENVIRONMENTAL SCIENCES↗

A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys

As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., E ( B − V ) < 0.04 ). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in good and bad categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys.

Luo, Yufeng (ORCID:0000000246230683)↗

How bad or good are the external forward shock afterglow models of gamma-ray bursts?

The external forward shock models have been the standard paradigm to interpret the broadband afterglow data of gamma-ray bursts (GRBs). One prediction of the models is that some afterglow temporal breaks at different energy bands should be achromatic; that is, the break times should be the same in different frequencies. Multiwavelength observations in the Swift era have revealed chromatic afterglow behaviors at least in some GRBs, casting doubts on the external forward shock origin of GRB afterglows. In this paper, using a large sample of GRBs with both X-ray and optical afterglow data, we perform a systematic study to address the question: how bad or good are the external forward shock models? Our sample includes 85 GRBs up to 2014 March with well-monitored X-ray and optical light curves. Based on how well the data abide by the external forward shock models, we categorize them into five grades and three samples. The first two grades (Grade I and II) include 45 of 85 GRBs. They show evidence of, or are consistent with having, an achromatic break. The temporal and spectral behaviors in each afterglow segment are consistent with the predictions (the “closure relations”) of the forward shock models. These GRBs are included in the Gold sample. The next two grades (Grade III and IV) include 37 of 85 GRBs. They are also consistent with having an achromatic break, even though one or more afterglow segments do not comply with the closure relations. These GRBs are included in the Silver sample. Finally, Grade V (3/85) shows direct evidence of chromatic behaviors, suggesting that the external shock models are inconsistent with the data. These are included in the Bad sample. We further perform statistical analyses of various observational properties (temporal index α, spectral index β, break time t{sub b}) and model parameters (energy injection index q, electron spectral index p, jet opening angle θ{sub j}, radiative efficiency η{sub γ}, and so on) of the GRBs in the Gold sample, and derive constraints on the magnetization parameter ϵ{sub B} in the forward shock. Overall, we conclude that the simplest external forward shock models can account for the multiwavelength afterglow data of at least half of the GRBs. When more advanced modeling (e.g., long-lasting reverse shock, structured jets, arbitrary circumburst medium density profile) is invoked, up to >90% of the afterglows may be interpreted within the framework of the external shock models.

79 ASTRONOMY AND ASTROPHYSICS↗

Data Analysis of X-ray Panels Used in X-ray CT Scientific Instruments

This report is a follow-up study on M. Skeate’s study on System Drift Detection for Health Monitoring (Skeate, 2023). The following report highlights analyses of the panel’s behavior with extended use. This includes effects of burn-in on the panel from over-use and bad pixels (defined in Methodology.) Using data-forward statistical analyses across a sequence of scans, and given that the other conditions present in the data can be replicated, this study show that overtime use of panels does not affect bad pixel count. Also, I present conclusive evidence of a direct relationship between the regions of the panel that are exposed to radiation and burn-in damage to that region overtime. Additionally, this study also highlights the effect of the duty cycle on the dark current change in the panel.

42 ENGINEERING↗

colormap_util

Our Python module, colormap_module, presented here can be used to analyze and manipulate colormaps and has two main aims: (i) compare existing and new custom colormaps quantitatively by comparing their values in a color space, called CAM02-UCS, that directly shows how a human perceives their hue, saturation, and lightness values and (ii) create isoluminant colormaps from existing or custom colormaps and (iii) mix isoluminant colormap data with a 4th dimension of data by manipulating lightness values across the image and present the new image. Our module was designed to be a tool for the community to use as a whole, allowing scientists to present, analyze, and manipulate colormaps they have created and/or decided to use for a particular type of data. By being able to do this, the scientific community as a whole will think more about the colormaps they choose, see why particular colormaps are bad to use for certain types of data, and move toward using colormaps our eyes can interpret much more efficiently.

Source record↗

colormap_util

Our Python module, colormap_module, presented here can be used to analyze and manipulate colormaps and has two main aims: (i) compare existing and new custom colormaps quantitatively by comparing their values in a color space, called CAM02-UCS, that directly shows how a human perceives their hue, saturation, and lightness values and (ii) create isoluminant colormaps from existing or custom colormaps and (iii) mix isoluminant colormap data with a 4th dimension of data by manipulating lightness values across the image and present the new image. Our module was designed to be a tool for the community to use as a whole, allowing scientists to present, analyze, and manipulate colormaps they have created and/or decided to use for a particular type of data. By being able to do this, the scientific community as a whole will think more about the colormaps they choose, see why particular colormaps are bad to use for certain types of data, and move toward using colormaps our eyes can interpret much more efficiently.

Source record↗