SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Weak-lensing Analysis of X-Ray-selected XXL Galaxy Groups and Clusters with Subaru HSC Data

We present a weak-lensing analysis of X-ray galaxy groups and clusters selected from the XMM-XXL survey using the first-year data from the Hyper Suprime-Cam (HSC) Subaru Strategic Program. Our joint weaklensing and X-ray analysis focuses on 136 spectroscopically confirmed X-ray-selected systems at 0.031 6 z 6 1.033 detected in the 25 deg2 XXL-N region, which largely overlaps with the HSC-XMM field. With high-quality HSC weak-lensing data, we characterize the mass distributions of individual clusters and establish the concentration–mass (c–M) relation for the XXL sample, by accounting for selection bias and statistical effects and marginalizing over the remaining mass calibration uncertainty. We find the mass-trend parameter of the c–M relation to be β = -0.07 ± 0.28 and the normalization to be c200 = 4.8 ± 1.0 (stat) ± 0.8 (syst) at M 200 = 1014h -1M and z = 0.3. We find no statistical evidence for redshift evolution. Our weaklensing results are in excellent agreement with dark-matter-only c–M relations calibrated for recent ΛCDM cosmologies. The level of intrinsic scatter in c200 is constrained as σ(ln c 200 ) < 24% (99.7% CL), which is smaller than predicted for the full population of ΛCDM halos. This is likely caused in part by the X-ray selection bias in terms of the cool-core or relaxation state. We determine the temperature–mass (TX–M 500 ) relation for a subset of 105 XXL clusters that have both measured HSC lensing masses and X-ray temperatures. The resulting TX–M 500 relation is consistent with the self-similar prediction. Our TX–M 500 relation agrees with the XXL DR1 results at group scales but has a slightly steeper mass trend, implying a smaller mass scale in the cluster regime. The overall offset in the TX–M 500 relation is at the ~ 1.5σ level, corresponding to a mean mass offset of (34 ± 20)%. We also provide bias-corrected, weak-lensing-calibrated M 200 and M 500 mass estimates of individual XXL clusters based on their measured X-ray temperatures.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Nutri‐cereal tissue‐specific transcriptome atlas during development: Functional integration of gene expression to identify mineral uptake pathways in little millet ( Panicum sumatrense )

SUMMARY Little millet (Panicum sumatrenseRoth ex Roem. & Schult.) is an essential minor millet of southeast Asia and Africa's temperate and subtropical regions. The plant is stress‐tolerant, has a short life cycle, and has a mineral‐rich nutritional profile associated with unique health benefits. We report the developmental gene expression atlas of little millet (genotype JK‐8) from ten tissues representing different stages of its life cycle, starting from seed germination and vegetative growth to panicle maturation. The developmental transcriptome atlas led to the identification of 342 827 transcripts. The BUSCO analysis and comparison with the transcriptomes of related species confirm that this study presents high‐quality, in‐depth coverage of the little millet transcriptome. In addition, the eFP browser generated here has a user‐friendly interface, allowing interactive visualizations of tissue‐specific gene expression. Using these data, we identified transcripts, the orthologs of which inArabidopsisand rice are involved in nutrient acquisition, transport, and response pathways. The comparative analysis of the expression levels of these transcripts holds great potential for enhancing the mineral content in crops, particularly zinc and iron, to address the issue of “hidden hunger” and to attain nutritional security, making it a valuable asset for translational research.

Plant Sciences↗

DOE OSTI2021

Dark Energy Survey year 3 results: covariance modelling and its impact on parameter estimation and quality of fit

ABSTRACT We describe and test the fiducial covariance matrix model for the combined two-point function analysis of the Dark Energy Survey Year 3 (DES-Y3) data set. Using a variety of new ansatzes for covariance modelling and testing, we validate the assumptions and approximations of this model. These include the assumption of Gaussian likelihood, the trispectrum contribution to the covariance, the impact of evaluating the model at a wrong set of parameters, the impact of masking and survey geometry, deviations from Poissonian shot noise, galaxy weighting schemes, and other sub-dominant effects. We find that our covariance model is robust and that its approximations have little impact on goodness of fit and parameter estimation. The largest impact on best-fitting figure-of-merit arises from the so-called fsky approximation for dealing with finite survey area, which on average increases the χ2 between maximum posterior model and measurement by $3.7{{\ \rm per\ cent}}$ (Δχ2 ≈ 18.9). Standard methods to go beyond this approximation fail for DES-Y3, but we derive an approximate scheme to deal with these features. For parameter estimation, our ignorance of the exact parameters at which to evaluate our covariance model causes the dominant effect. We find that it increases the scatter of maximum posterior values for Ωm and σ8 by about $3{{\ \rm per\ cent}}$ and for the dark energy equation-of-state parameter by about $5{{\ \rm per\ cent}}$.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

EastCoast v1.0.0

This repository contains data and code for statistically comparing soil microbial communities across four different wetland sites and making publication quality figures. It is similar to other microbiome analysis but is specific for this project.

de Mesquita, CliftonB↗

DOE OSTI2025

CQM-Analysis v1.0

This repository contains the data and code necessary to reproduce the primary analysis and figures for the manuscript "Pathways to productivity: mapping the relationship between multimodal transportation infrastructure, commute quality, and economic vitality for the United States workforce". The analysis demonstrates a newly defined commute quality metric (CQM) characterizing the quality, as a monetized consumer surplus, of travel for the purpose of work for every census tract in the continental United States. The analysis additionally demonstrates the correlation of that CQM with key economic vitality indicators. Specifically median household income and unemployment rate.

Spurlock, C Anna [Lawrence Berkeley National Labor↗

DOE OSTI2021

A consensus-based ensemble approach to improve transcriptome assembly

Systems-level analyses, such as differential gene expression analysis, co-expression analysis, and metabolic pathway reconstruction, depend on the accuracy of the transcriptome. Multiple tools exist to perform transcriptome assembly from RNAseq data. However, assembling high quality transcriptomes is still not a trivial problem. This is especially the case for non-model organisms where adequate reference genomes are often not available. Different methods produce different transcriptome models and there is no easy way to determine which are more accurate. Furthermore, having alternative-splicing events exacerbates such difficult assembly problems. While benchmarking transcriptome assemblies is critical, this is also not trivial due to the general lack of true reference transcriptomes. In this study, we first provide a pipeline to generate a set of the simulated benchmark transcriptome and corresponding RNAseq data. Using the simulated benchmarking datasets, we compared the performance of various transcriptome assembly approaches including both de novo and genome-guided methods. The results showed that the assembly performance deteriorates significantly when alternative transcripts (isoforms) exist or for genome-guided methods when the reference is not available from the same genome. To improve the transcriptome assembly performance, leveraging the overlapping predictions between different assemblies, we present a new consensus-based ensemble transcriptome assembly approach, ConSemble. Without using a reference genome, ConSemble using four de novo assemblers achieved an accuracy up to twice as high as any de novo assemblers we compared. When a reference genome is available, ConSemble using four genome-guided assemblies removed many incorrectly assembled contigs with minimal impact on correctly assembled contigs, achieving higher precision and accuracy than individual genome-guided methods. Furthermore, ConSemble using de novo assemblers matched or exceeded the best performing genome-guided assemblers even when the transcriptomes included isoforms. We thus demonstrated that the ConSemble consensus strategy both for de novo and genome-guided assemblers can improve transcriptome assembly. The RNAseq simulation pipeline, the benchmark transcriptome datasets, and the script to perform the ConSemble assembly are all freely available from: http://bioinfolab.unl.edu/emlab/consemble/.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

DAISY: A Rapid Approach to Evaluating Marine Energy Converter Sound (Final Technical Report)

This project’s objective was to improve the quality of acoustic information about marine energy converters that could be collected from groups of drifting hydrophones, while reducing the costs of deployment and data analysis. This was achieved through technology development addressing four focus areas: (1) minimizing flow-noise and self-noise, (2) integrating metadata streams into a single data acquisition system, (3) developing post-processing routines to facilitate rapid data review, and (4) enabling objective identification of marine energy converter sound against a backdrop of ambient noise using time-delay-of-arrival localization.

16 TIDAL AND WAVE POWER↗

DOE OSTI2024

Wearable Technology and Its Influence on Motor Development and Biomechanical Analysis

The convergence among biomechanics, motor development, and wearable technology redefines our understanding of human movement. These technologies allow for the continuous monitoring of motor development and the state of motor abilities from infancy to old age, enabling early and personalized interventions to promote healthy motor skills. For athletes, they offer valuable insights to optimize technique and prevent injuries, while in old age, they help maintain mobility and prevent falls. Integration with artificial intelligence further extends these capabilities, enabling sophisticated data analysis. Wearable technology is transforming the way we approach motor development and maintenance of motor skills, offering unprecedented possibilities for improving health, performance, and quality of life at every stage of life. The promising future of these technologies paves the way for an era of more personalized and effective healthcare, driven by innovation and interdisciplinary collaboration.

Morouço, Pedro (ORCID:0000000259569790)↗

DOE OSTI2021

Optimizing Error-Bounded Lossy Compression for Scientific Data by Dynamic Spline Interpolation

Today's scientific simulations are producing vast volumes of data that cannot be stored and transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and network bandwidth. The situation is getting worse over time because of the ever-increasing gap between relatively slow data transfer speed and fast-growing computation power in modern supercomputers. Error-bounded lossy compression is becoming one of the most critical techniques for resolving the big scientific data issue, in that it can significantly reduce the scientific data volume while guaranteeing that the reconstructed data is valid for users because of its compression-error-bounding feature. In this paper, we present a novel error-bounded lossy compressor based on a state-of-the-art prediction-based compression framework. Our solution exhibits substantially better compression quality than all of the existing error-bounded lossy compressors, with comparable compression speed. Specifically, our contribution is threefold. (1) We provide an in-depth analysis of why the best-existing prediction-based lossy compressor can only minimally improve the compression quality. (2) We propose a dynamic spline interpolation approach with a series of optimization strategies that can significantly improve the data prediction accuracy, substantially improving the compression quality in turn. (3) We perform a thorough evaluation using six real-world scientific simulation datasets across different science domains to evaluate our solution vs. all other related works. Experiments show that the compression ratio of our solution is higher than that of the second-best lossy compressor by 20%similar to 460% with the same error bound in most of the cases.

Zhao, Kai↗

DOE OSTI2020

Simulation of the Charge Measurements for the SuperCDMS Soudan Experiment

Astronomical observations lead us to believe that dark matter constitutes the majority of the mass of the Universe, yet it has never been directly observed experimentally. The Super Cryogenic Dark Matter Search Experiment (SuperCDMS) aims to discover the particle nature of dark matter, by developing and using some of the most sensitive detectors ever built. The SuperCDMS detectors are capable of rejecting known particles to search for dark matter interactions, but the discrimination is a complicated analysis task. Previous analyses with SuperCDMS set world leading sensitivity limits to dark matter interactions, but the analysis techniques have not been based on simulations. Now we have developed an efficient simulations infrastructure that will help better understand the detectors, develop a better background model, and optimize the next generation dark matter searches. In this thesis we present the fully-functional simulations infrastructure to produce high quality samples a s well as results for the charge system readout simulations, and comparisons to expectations from data. We show that our simulations well-reproduce dominant features of data, bringing SuperCDMS closer to a robust simulation-based analysis method, much needed for the upcoming SuperCDMS dark matter searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Rapid subsurface analysis of frequency-domain thermoreflectance images with K-means clustering

K-means clustering analysis is applied to frequency-domain thermoreflectance (FDTR) hyperspectral image data to rapidly screen the spatial distribution of thermophysical properties at material interfaces. Performing FDTR while raster scanning a sample consisting of 8.6 μm of doped-silicon (Si) bonded to a doped-Si substrate identifies spatial variation in the subsurface bond quality. Routine thermal analysis at select pixels quantifies this variation in bond quality and allows assignment of bonded, partially bonded, and unbonded regions. Performing this same routine thermal analysis across the entire map, however, becomes too computationally demanding for rapid screening of bond quality. To address this, K-means clustering was used to reduce the dimensionality of the dataset from more than 20 000 pixel spectra to just K = 3 component spectra. The three component spectra were then used to express every pixel in the image through a least-squares minimized linear combination providing continuous interpolation between the components across spatially varying features, e.g., bonded to unbonded transition regions. Fitting the component spectra to the thermal model, thermal properties for each K cluster are extracted and then distributed according to the weighting established by the regressed linear combination. Thermophysical property maps are then constructed and capture significant variation in bond quality over 25 μm length scales. The use of K-means clustering to achieve these thermal property maps results in a 74-fold speed improvement over explicit fitting of every pixel.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Using Boosted Decision Trees to Select High Quality Measurements in the Mu2e Experiment at Fermilab

This thesis presents the implementation and evaluation of a Boosted Decision Tree (BDT) model to improve the selection of high-quality track measurements in the Mu2e experiment at Fermilab. The Mu2e experiment is a high-energy physics experiments seeking to observe a rare theoretical physics process known as Charged Lepton Flavor Violation. A significant challenge faced by the Mu2e experiment are so-called background events, which are events whose data mimics that of the rare physics process the experiment seeks to observe. Without a mechanism to reduce background, it would be impossible to know whether Charged Lepton Flavor Violation occurred or not. To this end, high-quality track measurements must be distinguished from low-quality track measurements. A track can be conceived of as the reconstructed path of a particle that traveled through the Mu2e detector. In addition to other data, data about such tracks is stored using a C++-based framework, specific to the domain of high-energy physics, known as ROOT. A boosted decision tree model was trained using ROOT’s Toolkit For Multivariate Analysis by leveraging variables ancillary to track quality. In evaluation, the BDT achieves a ROC-AUC of 0.927 in discriminating good-quality tracks from poor-quality tracks. Such a score is indicative of both strong discrimination and strong generalization. Subsequently, it is shown that applying a BDT-based quality cut to the distribution of particle momenta significantly enhances the signal-to-background distinction for signal electrons, paving the way for improved sensitivity to Charged Lepton Flavor Violation.

Mullany, Brendan T. [Drew U.] (ORCID:0009000818888↗

DOE OSTI2025

High-speed tunable generation of random number distributions using actuated perpendicular magnetic tunnel junctions

Perpendicular magnetic tunnel junctions (pMTJs) actuated by nanosecond pulses are emerging as promising devices for true random number generation (TRNG) due to their intrinsic stochastic behavior and high throughput. In this work, we demonstrate the tunability and quality of random number distributions generated by pMTJs operating at a frequency of 104 MHz. First, changing the pulse amplitude is used to systematically vary the probability bias. The variance of the resulting bitstreams closely matches the expected binomial distribution, demonstrating consistency with an underlying sequence of Bernoulli trials. Second, the quality of uniform distributions of 8-bit random numbers generated with a probability bias of 0.5 is considered. A reduced chi-square analysis of these data shows that only two XOR operations are sufficient to achieve this distribution with p-values greater than 0.05. Finally, we show that there is a correlation between long-term probability bias variations and pMTJ resistance. These findings suggest that variations in the characteristics of the pMTJ underlie the observed variation of probability bias. In conclusion, our results highlight the potential of stochastically actuated pMTJs for high-speed, tunable TRNG applications, showing the importance of the stability of pMTJ device characteristics in achieving reliable, long-term performance.

Magnetic tunnel junctions↗

DOE OSTI2021

Literature Data on Foam Fracturing Fluid

At the beginning of this project, the Temple team spent significant effort to collect data relevant to foam fracturing. More than 40 articles/reports were found in the open literature that reported the properties of aqueous foams under various testing conditions. The foam properties included viscosity and stability in terms of half-life, while were influenced by the foam quality, shear rate, temperature, pressure, as well as surfactants and additives used in making the foam base solutions. As a result, more than 1100 data points were collected, which are included in a master worksheet named "Literature data on Foam Fracturing Fluid". These data points are organized based on following parameters: 1. Literature source, including authors and publication year 2. Gaseous phase (e.g. CO2, N2) 3. Liquid phase (e.g. tap water, DI water, salt water) 4. Surfactants and their concentrations 6. Additives 7. Foam quality 8. Pressure 9. Temperature 10. Viscosity 11. Foam stability, which was characterized by its half-life: Half-life Foam study data base with data analysis was completed and a webpage is designed hosted on public server at https://surfactant-dashboard.herokuapp.com

15 GEOTHERMAL ENERGY↗

DOE OSTI2021

Hardening DOE R&D Software Tools for Web-based Visualization SBIR Phase I Final Report

Ubiquitous web-based visualization is essential to delivering large-scale data visualization to various stakeholders, from the scientist to the board member. These stakeholders will not tolerate a stalled application or a pop-up window asking them to wait for the processing to complete. They require a responsive and interactive visualization environment with high-quality imagery suitable for detailed analysis and boardroom presentations. At Kitware, Inc., we have accomplished web visualization to this point, leveraging state-of-the-art tools like HTML5, CSS3, SVG, Canvas, and WebGL. Solutions that leverage a combination of these technologies are necessary to handle workloads that vary significantly in data size efficiently. However, it is not always practical to move large data to the web client for visualization. Kitware's ParaView as a Service combines client-side visualization using both distributed processing and remote rendering on big data impractical to move. Existing distributed processing and remote rendering solution's interactivity is below the expectations of web-based applications. Our project examined proposed solutions to the areas outlined above in ParaView as a Service. We have investigated concurrent pipelines, streaming images, progressive rendering, and optimization of algorithms and data movement to address these concerns. For the Phase I project, we completed the proposed work plan. As a result, the project produced three prototypes of essential importance for web visualization and the ParaView as a Service community. We created a simple desktop application for an interactive streamline placement prototype, a web-based interactive streamline placement prototype, and a web-based progressive rendering utilizing raytracing prototype. These prototypes relied on the hardening of emerging software toolkits funded by the Department of Energy (DOE) Advanced Scientific Computing Research (ASCR) program (such as ParaView, VTK-m, and Mochi). We blended these components into web-based visualization prototypes that meet the industry's expectations for interactivity and responsiveness. The Phase I project had four essential focus areas: 1. Develop prototype ParaView as a Service backend server using asynchronous, non-blocking design principles. 2. Develop a prototype web application that uses the ParaView as a Service backend server for remote data visualization. 3. Implement image streaming with encoding/compression and progressive rendering capabilities in the proposed platform. 4. Evaluate the prototype developed and summarize observations, including the challenges and pitfalls of our approach. After our successful completion of Phase I, we are strongly positioned to propose a successful Phase II project.

Geveci, Berk↗

DOE OSTI2022

Disruption Prediction and Avoidance in High Beta Long Pulse KSTAR Plasmas

This research is a concentrated and coordinated experimental and physics analysis program by a small U.S. team, focused on the topical area of “Long Pulse Control” as stated in the proposal solicitation. The overall goal of the research is to produce world-class analysis regarding forecasting and avoidance of disruptions in a long-pulse, superconducting tokamak at high stability parameters (e.g. normalized beta) with direct, quantifiable figures of merit (i.e. plasma disruption rate - “disruptivity”) and its reduction based on improved stability physics and control. The research targets the backbone of the problem – the basic, main issues – to produce this quantitative analysis by: (1) Creating and applying a new physics-based paradigm to understand how to eliminate disruptions: disruption event characterization, and event chain analysis – a direct manifestation of the approach suggested in the DOE Transients Report, (2) Ensuring that the components required to produce high-quality measurements and analysis needed for disruption event characterization for the tokamak in question (here, KSTAR) exist (e.g. pressure profile peaking, high-accuracy pitch angle data, compensated low frequency toroidal mode number n = 1 mode measurement) to create a primarily physics-based disruption forecasting capability, and (3) Addressing disruption avoidance for the first time in KSTAR by attacking primary disruption ‘event chains’, utilizing the most important associated plasma measurements (dynamic n = 1 field). The focus of this work will be avoidance of macroscopic instabilities, especially global modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Reinventing wastewater treatment plants: energy neutral treatment and enhanced fertilizer production through a novel resource recovery center

Wastewater treatment plants (WWTPs) are typically energy intensive, mainly due to the secondary treatment processes such as activated sludge (AS) for treatment of organics as well as nutrients like nitrogen. Nitrogen removal presents a big problem for WWTPs. The main form of nitrogen in wastewater is ammonium, and an AS process uses oxygen to convert ammonium into nitrite and nitrate which is then converted to nitrogen through denitrification process. During anaerobic digestion (AD), organic nitrogen gets degraded, resulting in an effluent stream (centrate) with a high nitrogen content, mostly in the form of ammonium. This contributes 15-30% of total nitrogen to the wastewater influent which further increases energy consumption for aeration. The project aims to transform this conventional municipal WWTPs into energy-neutral, resource-recovering facilities by integrating three core technologies: • Cloth Media Filtration (CMF) to replace conventional primary sedimentation (CPS) and increase the diversion of organics from the energy intensive secondary treatment to AD. This results in reduced energy demand for aeration in the secondary process while simultaneously increasing the biogas production in the anaerobic digesters. • Anerobic Digester to increase biogas and ammonia production. • Membrane Evaporation (ME) to recover ammonia from AD centrate and produce marketable fertilizer. The benefits of proposed WWTP process modifications were evaluated using techno economic analysis (TEA) and life cycle assessment (LCA). For CMF portion of the research a statistical analysis was employed to develop data-driven tools that could be used to enhance and optimize its performance in terms of energy savings and effluent quality. The main objective of this project is to reduce the energy demand for secondary treatment at municipal WWTPs by at least 50%, increase anaerobic digester (AD) biogas and ammonia production by 100% and 120%, respectively, and recover 90% of ammonia from the AD. Integrated CMF, AD, and ME was shown to work synergistically toward achieving these decarbonization targets through energy-positive treatment and fertilizer recovery techniques.

42 ENGINEERING↗

DOE OSTI2022

The Open Cluster Chemical Abundances and Mapping Survey. VI. Galactic Chemical Gradient Analysis from APOGEE DR17

The goal of the Open Cluster Chemical Abundances and Mapping (OCCAM) survey is to constrain key Galactic dynamic and chemical evolution parameters by the construction and analysis of a large, comprehensive, uniform data set of infrared spectra for stars in hundreds of open clusters. This sixth contribution from the OCCAM survey presents analysis of SDSS/APOGEE Data Release 17 (DR17) results for a sample of stars in 150 open clusters, 94 of which we designate to be "high-quality" based on the appearance of their color–magnitude diagram. We find the APOGEE DR17-derived [Fe/H] values to be in good agreement with those from previous high-resolution spectroscopic open cluster abundance studies. Using a subset of the high-quality sample, the Galactic abundance gradients were measured for 16 chemical elements, including [Fe/H], for both Galactocentric radius ($R$ GC ) and guiding center radius ($R$ guide ). We find an overall Galactic [Fe/H] versus RGC gradient of -0.073 ± 0.002 dex kpc -1 over the range of 6 > $R$ GC < 11.5 kpc, and a similar gradient is found for [Fe/H] versus $R$ guide . Significant Galactic abundance gradients are also noted for O, Mg, S, Ca, Mn, Na, Al, K, and Ce. Our large sample additionally allows us to explore the evolution of the gradients in four age bins for the remaining 15 elements.

79 ASTRONOMY AND ASTROPHYSICS↗