Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data integrity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

BESS-STAIR: a framework to estimate daily, 30m, and all-weather crop evapotranspiration using multi-source satellite data for the US Corn Belt

Abstract. With increasing crop water demands and drought threats, mapping andmonitoring of cropland evapotranspiration (ET) at high spatial and temporalresolutions become increasingly critical for water management andsustainability. However, estimating ET from satellites for precise waterresource management is still challenging due to the limitations in bothexisting ET models and satellite input data. Specifically, the process of ETis complex and difficult to model, and existing satellite remote-sensing datacould not fulfill high resolutions in both space and time. To address theabove two issues, this study presents a new high spatiotemporal resolution ETmapping framework, i.e., BESS-STAIR, which integrates a satellite-drivenwater–carbon–energy coupled biophysical model, BESS (Breathing Earth SystemSimulator), with a generic and fully automated fusion algorithm, STAIR(SaTallite dAta IntegRation). In this framework, STAIR provides daily 30'mmultispectral surface reflectance by fusing Landsat and MODIS satellite datato derive a fine-resolution leaf area index and visible/near-infrared albedo,all of which, along with coarse-resolution meteorological and CO 2 data, are used to drive BESS to estimate gap-free 30 m resolution daily ET.We applied BESS-STAIR from 2000 through 2017 in six areas across the US CornBelt and validated BESS-STAIR ET estimations using flux-tower measurementsover 12 sites (85 site years). Results showed that BESS-STAIR daily ETachieved an overall R2=0.75, with root mean square error RMSE=0.93 mm d -1 and relative error RE =27.9 % when benchmarkedwith the flux measurements. In addition, BESS-STAIR ET estimations capturedthe spatial patterns, seasonal cycles, and interannual dynamics well indifferent sub-regions. The high performance of the BESS-STAIR frameworkprimarily resulted from (1) the implementation of coupled constraints onwater, carbon, and energy in BESS, (2) high-quality daily 30 m data from theSTAIR fusion algorithm, and (3) BESS's applicability under all-skyconditions. BESS-STAIR is calibration-free and has great potentials to be areliable tool for water resource management and precision agricultureapplications for the US Corn Belt and even worldwide given the globalcoverage of its input data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Time-Integrated Neutrino Source Searches with 10 Years of IceCube Data

This Letter presents the results from pointlike neutrino source searches using ten years of IceCube data collected between April 6, 2008 and July 10, 2018. We evaluate the significance of an astrophysical signal from a pointlike source looking for an excess of clustered neutrino events with energies typically above ~1 TeV among the background of atmospheric muons and neutrinos. We perform a full-sky scan, a search within a selected source catalog, a catalog population study, and three stacked Galactic catalog searches. The most significant point in the northern hemisphere from scanning the sky is coincident with the Seyfert II galaxy NGC 1068, which was included in the source catalog search. The excess at the coordinates of NGC 1068 is inconsistent with background expectations at the level of 2.9σ after accounting for statistical trials from the entire catalog. The combination of this result along with excesses observed at the coordinates of three other sources, including TXS 0506+056, suggests that, collectively, correlations with sources in the northern catalog are inconsistent with background at 3.3σ significance. The southern catalog is consistent with background. Finally these results, all based on searches for a cumulative neutrino signal integrated over the 10 years of available data, motivate further study of these and similar sources, including time-dependent analyses, multimessenger correlations, and the possibility of stronger evidence with coming upgrades to the detector.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

From Simple Labels to Time-Use Integrations: Supporting the Spectrum of Qualitative Travel Behavior Data

In transportation research, applications of travel behavior data collection are context-specific and require different types of qualitative inputs. These inputs can be viewed as spanning a spectrum of user burden and data quality, from simple trip labels to complex time-use surveys. However, each currently active smartphone-based travel diary platform appears to only support one type of qualitative input, and the effort required for customization is unclear. In this paper, we characterize the spectrum by defining four canonical use cases: (i) trip labels, (ii) trip questionnaire, (iii) counterfactual trips, and (iv) time-use surveys. We then outline a mechanism for supporting configurable user inputs on the same underlying smartphone-based sensing mechanism and demonstrate that it can support all the use cases without any code changes. We further demonstrate that the flexible data model that underpins this mechanism can enable real-time monitoring and analysis. Finally, we evaluate per-user data collection and engagement metrics for large-scale deployments of three canonical use cases, spanning 10 programs, 435 users, and 251,041 trips, and a maximum duration of 800 days. Future efforts may support additional use cases through an expanded configuration and provide greater insight into user engagement. We hope that these insights enable the research community to look at qualitative inputs through a new lens and experiment with novel use cases to fill in the spectrum.

ADVANCED PROPULSION SYSTEMS,POWER TRANSMISSION AND↗
DOE OSTI2020

Beyond integration: modeling every pixel to obtain better structure factors from stills

Most crystallographic data processing methods use pixel integration. In serial femtosecond crystallography (SFX), the intricate interaction between the reciprocal lattice point and the Ewald sphere is integrated out by averaging symmetrically equivalent observations recorded across a large number (10 4 -10 6 ) of exposures. Although sufficient for generating biological insights, this approach converges slowly, and using it to accurately measure anomalous differences has proved difficult. This report presents a novel approach for increasing the accuracy of structure factors obtained from SFX data. A physical model describing all observed pixels is defined to a degree of complexity such that it can decouple the various contributions to the pixel intensities. Model dependencies include lattice orientation, unit-cell dimensions, mosaic structure, incident photon spectra and structure factor amplitudes. Maximum likelihood estimation is used to optimize all model parameters. The application of prior knowledge that structure factor amplitudes are positive quantities is included in the form of a reparameterization. The method is tested using a synthesized SFX dataset of ytterbium(III) lysozyme, where each X-ray laser pulse energy is centered at 9034 eV. This energy is 100 eV above the Yb 3+ L -III absorption edge, so the anomalous difference signal is stable at 10 electrons despite the inherent energy jitter of each femtosecond X-ray laser pulse. This work demonstrates that this approach allows the determination of anomalous structure factors with very high accuracy while requiring an order-of-magnitude fewer shots than conventional integration-based methods would require to achieve similar results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Peak Prediction Using Multi Layer Perceptron (MLP) for Edge Computing ASICs Targeting Scientific Applications

High data rate detectors play an integral part in scientific research and their development is actively pursued at High Energy Physics (HEP) facilities around the world. Edge Machine Learning (ML) offers the ability to reduce data rates by integrating ML algorithms into Application Specific Integrated Circuits (ASICs) on the front end electronics. In this work, we explore a set of neural network architectures for predicting the peak amplitudes in the detector's sensor response. We have designed and synthesized several MLP based neural networks comparing their inference accuracy, power consumption, and area targeting for minimal latency. The neural networks are synthesized in a commercial 65nm process. The effect of quantizing the network's weights and biases on hardware performance and area is reported. We also conduct design space exploration to compare between design alternatives

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

21 cm Power Spectrum Analysis of North Celestial Pole Observations with the Tianlai Dish Pathfinder Array

The Tianlai Dish Pathfinder Array (TDPA) is a radio interferometer designed to test techniques for 21 cm intensity mapping in the post-reionization Universe as a means of measuring large-scale cosmic structure. Using nine nights of observations targeting the North Celestial Pole field, totaling approximately 107 hr of integration time, we analyze data in the frequency range 700–800 MHz (corresponding to redshift z ∼ 0.9). We do the data format conversion, radio frequency interference flagging, calibration, imaging and point source subtraction, and foreground removal via Singular Value Decomposition. The spherically averaged power spectrum Δ 2 (k) is obtained. Furthermore, this work successfully establishes and validates a comprehensive data analysis framework for the TDPA. We identify key improvements including sky model refinement, increased integration time, and pipeline optimization that will enable future detection of the 21 cm signal through auto-correlation and cross-correlation with optical galaxy surveys.

cosmology: large-scale structure of universe↗
DOE OSTI2024

Test of lepton flavor universality with a measurement of R ( D * ) using hadronic B tagging at the Belle II experiment

The ratio of branching fractions R ( D * ) = B ( B ¯ → D * τ − ν ¯ τ ) / B ( B ¯ → D * ℓ − ν ¯ ℓ ) , where ℓ is an electron or muon, is measured using a Belle II data sample with an integrated luminosity of 189 fb − 1 at the SuperKEKB asymmetric-energy e + e − collider. Data is collected at the ϒ ( 4 S ) resonance, and one B meson in the ϒ ( 4 S ) → B B ¯ decay is fully reconstructed in hadronic decay modes. The accompanying signal B meson is reconstructed as B ¯ → D * τ − ν ¯ τ using leptonic τ decays. The normalization decay, B ¯ → D * ℓ − ν ¯ ℓ , produces the same observable final-state particles. The ratio of branching fractions is extracted in a simultaneous fit to two signal-discriminating variables in both channels and yields R ( D * ) = 0.262 − 0.039 + 0.041 ( stat ) − 0.032 + 0.035 ( syst ) . This result is consistent with the current world average and with Standard Model predictions. Published by the American Physical Society 2024

Adachi, I. (ORCID:0000000322870173)↗
DOE OSTI2023

Data transfer for STAR grid jobs

The Solenoidal Tracker at RHIC (STAR) is a multipurpose experiment at the Relativistic Heavy Ion Collider (RHIC) with the primary goal to study the formation and properties of the quark-gluon plasma. STAR is an international collaboration of member institutions and laboratories from around the world. Yearly data-taking period produces PBytes of raw data collected by the experiment. STAR primarily uses its dedicated facility at BNL to process this data, but has routinely leveraged distributed systems, both high throughput (HTC) and high performance (HPC) computing clusters, to significantly augment the processing capacity available to the experiment. The ability to automate the efficient transfer of large data sets on reliable, scalable, and secure infrastructure is critical for any large-scale distributed processing campaign. For more than a decade, STAR computing has relied upon GridFTP with its x509-based authentication to build such data transfer systems and integrate them into its larger production workflow. The end of support by the community for both GridFTP and the x509 standard requires STAR to investigate other approaches to meet its distributed processing needs. In this study we investigate two multi-purpose data distribution systems, Globus.org and XRootD, as alternatives to GridFTP. We compare both their performance and the ease by which each service is integrated into the type of secure and automated data transfer systems STAR has previously built using GridFTP. The presented approach and study may be applicable to other distributed data processing use cases beyond STAR.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Interpretation of Ion Irradiation and Neutron Irradiation Damage in Additively Manufactured 316 Stainless Steel using Multiscale Modeling

The accelerated adoption of nuclear energy necessitates advanced manufacturing technologies, such as additive manufacturing, to meet heightened supply chain requirements and support innovative reactor technologies. Due to the unique microstructural characteristics of additively manufactured materials under distinct solidification conditions, comprehensive evaluation of their performance in reactor environments is essential. The Advanced Materials and Manufacturing Technologies program under the Department of Energy's Office of Nuclear Energy focuses on understanding the irradiation performance and damage evolution of laser powder bed fusion 316 stainless steel, with an emphasis on integrating ion and neutron irradiation data to accelerate the development and qualification of materials for advanced nuclear reactor applications. While ion irradiation is a cost- and time-effective method, modeling and simulation are required to interpret the data for the broader range of irradiation conditions encountered in advanced reactors. In fiscal year 2025, integrated multiscale modeling and simulations were conducted to assess irradiation damage in additively manufactured 316 stainless steel. Key outcomes include predictions of chromium enrichment at grain boundaries, nickel enrichment at dislocation cell walls and void surfaces, and heterogeneous void evolution under ion and neutron irradiation conditions. Cluster dynamics simulations revealed the coarsening of voids at high irradiation temperatures and the suppression of void growth by high network dislocation density, while also demonstrating significant growth and coarsening of voids and self-interstitial atom loops at low dose rates. Machine learning-accelerated atomistic simulations highlighted the impact of the local environment and chromium concentration on vacancy diffusivity, providing key insights on the influence of composition on void swelling and radiation-induced segregation. Additionally, molecular dynamics simulations demonstrated the presence of defect production bias and a significant effect of carbon content on defect cluster behavior. These combined efforts aim to predict the performance of additively manufactured materials under various reactor conditions, supporting their qualification for nuclear reactor applications by interpreting ion irradiation data. This report underscores the potential of integrated multiscale modeling to analyze ion irradiation data in the effort to accelerate the qualification of additively manufactured materials for nuclear reactor components.

316 stainless steel↗
DOE OSTI2025

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗
DOE OSTI2026

Data for A Hybrid Biophysical-Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing

Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81–0.94) and H (R2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

AI/ML↗
DOE OSTI2025

Data as a Key Resource in Catalysis: A Community Account

The deployment of artificial intelligence (AI) is transforming the scientific fields central to interdisciplinary catalysis research. By enabling more effective use of data, AI (including simpler machine learning and data science tools) holds great promise for accelerating discoveries. However, progress has so far been modest, largely due to the lack of standardized, machine-readable, and openly shared catalysis data. This perspective, accounting for community insights emerging at conferences, analyses the underlying reasons for these challenges and proposes solutions to a future whereFAIR data management becomes an integral part of research in catalysis. In the short-term, we deem that mandatory FAIR data depositing prior to scientific publications along with consensualized top-down guidelines on data sharing powered by ease-to-use tools can make the necessary step change happen to catalyse data as key resource in our community.

36 - MATERIALS SCIENCE↗
DOE OSTI2022

Development of machine learning framework for interface force closures based on bubble tracking data

Interfacial force closures in the two-fluid model play a critical role for the predictive capabilities of void fraction distribution. However, the practices of interfacial force modeling have long been challenged by the inherent physical complexity of the two-phase flows. The rapidly expanding computational capabilities in the recent years have made high-fidelity data from the interface-captured direct numerical simulation become more available, and hence potential for data-driven interfacial force modeling has prevailed. In this work, we established a data-driven modeling framework integrated to the HZDR multiphase Eulerian-Eulerian framework for computational fluid dynamics simulations. The data-driven framework is verified in a benchmark problem, where a feedforward neural network managed to capture the non-linear mapping between bubble Reynolds number and drag coefficient and reproduce the void distribution resulting from the baseline model in the test case. The second focus is on utilizing the bubble tracking data set to form a closure for the bubble drag in the turbulent bubbly flow, in which the drag coefficient is set to be correlated with the bubble Reynolds number and the Eötvös number. Pseudo-steady state filtering in the Frenet Frame was carried out to obtain the drag coefficient from the turbulent bubbly flow data. The performance of the data-driven drag model is also examined through a case study, where improvement of model’s prediction near-wall is regarded necessary. In conclusion, discussion and further plans of investigation are provided.

42 ENGINEERING↗
DOE OSTI2025

Search for the Higgs boson decays to a ρ 0 , ϕ, or K ⁎0 meson and a photon in proton-proton collisions at $\sqrt{s} = 13$ TeV

Three rare decay processes of the Higgs boson to a ρ(770) 0 , Φ(1020), or K ⁎ (892) 0 meson and a photon are searched for using $\sqrt{s} = 13$ TeV proton-proton collision data collected by the CMS experiment at the LHC. Events are selected assuming the mesons decay into a pair of charged pions, a pair of charged kaons, or a charged kaon and pion, respectively. Depending on the Higgs boson production mode, different triggering and reconstruction techniques are adopted. The analyzed data sets correspond to integrated luminosities up to 138 fb -1 , depending on the reconstructed final state. After combining various data sets and categories, no significant excess above the background expectations is observed. Upper limits at 95% confidence level on the Higgs boson branching fractions into ρ(770) 0 $γ$, Φ(1020)$γ$, and K ⁎ (892) 0 are determined to be 3.7 x 10 -4 , 3.0 x 10 -4 , and 3.0 x 10 -4 , respectively. In case of the ρ(770) 0 $γ$ and Φ(1020)$γ$ channels, these are the most stringent experimental limits to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Data Placement Optimization for ATLAS in a Multi-Tiered Storage System within a Data Center

Scientific experiments and computations, especially in High Energy Physics, are generating and accumulating data at an unprecedented rate. Effectively managing this vast volume of data while ensuring efficient data analysis poses a significant challenge for data centers, which must integrate various storage technologies. This paper proposes addressing this challenge by designing and developing a precise data popularity prediction model utilizing state-of-theart AI/ML techniques. This model is crafted from the analysis of ATLAS data and access patterns. It enables us to migrate infrequently accessed data to more economical storage media, such as tape drives, while storing frequently accessed data on faster yet costlier storage media like HDD or SSD. This strategic approach ensures data is placed optimally into the appropriate storage classes, thereby maximizing storage capacity while minimizing data access latency for end-users. Furthermore, the paper includes a performance evaluation of the prediction model using various key metrics such as F1 score, accuracy, precision and recall. Finally, we present a prototype use case, leveraging real-world file access data to assess the model’s impact on performance.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗