Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data integrity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Uncovering Where Compensating Errors Could Hide in ENDF/B-VIII.0

Unconstrained physics spaces between two or more nuclear data observables in a library occur when their values can be simultaneously adjusted without violating the uncertainties in either differential information or simulations of relevant integral experiments. Differential data are often too imprecise to fully bound all nuclear data observables of interest for application simulations. Integral data are simulated with combinations of nuclear data so that an error in one observable may be hidden by a counterbalancing error in another. In this manner compensating errors may lurk within nuclear data libraries and these errors have the potential to undermine the predictive power of neutron transport simulations, particularly in situations where there is no conclusive validation experiment that resembles the application of interest. The EUCLID project (Experiments Underpinned by Computational Learning for Improvements in Nuclear Data) developed a preliminary workflow to identify these unconstrained physics spaces by bringing together results from a large collection of integral experiments with their simulated counter-parts as well as differential information that have a one-to-one correspondence to nuclear data. This wealth of information is processed by machine learning tools for subsequent refinement by human experts. Here, we show how the EUCLID work-flow is executed by applying it first to 239 Pu and then to 9 Be nuclear data in ENDF/B-VIII.0.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Measurement of integrated luminosities at BESIII for data samples at center-of-mass energies between 4.0 and 4.6 GeV*

Abstract The integrated luminosities of data samples collected in the BESIII experiment in 2016–2017 at center-of-mass energies between 4.19 and 4.28 GeV are measured with a precision better than 1% by analyzing large-angle Bhabha scattering events. The integrated luminosities of old datasets collected in 2010–2014 are updated by considering corrections related to detector performance, offsetting the effect of newly discovered readout errors in the electromagnetic calorimeter, which can haphazardly occur.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2014

Recent Advances in Registration, Integration and Fusion of Remotely Sensed Data: Redundant Representations and Frames

In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.

Fusion↗
DOE OSTI2025

miss-SNF: a multimodal patient similarity network integration approach to handle completely missing data sources

Abstract Motivation Precision medicine leverages patient-specific multimodal data to improve prevention, diagnosis, prognosis, and treatment of diseases. Advancing precision medicine requires the non-trivial integration of complex, heterogeneous, and potentially high-dimensional data sources, such as multi-omics and clinical data. In the literature, several approaches have been proposed to manage missing data, but are usually limited to the recovery of subsets of features for a subset of patients. A largely overlooked problem is the integration of multiple sources of data when one or more of them are completely missing for a subset of patients, a relatively common condition in clinical practice. Results We propose miss-Similarity Network Fusion (miss-SNF), a novel general-purpose data integration approach designed to manage completely missing data in the context of patient similarity networks. miss-SNF integrates incomplete unimodal patient similarity networks by leveraging a non-linear message-passing strategy borrowed from the SNF algorithm. miss-SNF is able to recover missing patient similarities and is “task agnostic”, in the sense that can integrate partial data for both unsupervised and supervised prediction tasks. Experimental analyses on nine cancer datasets from The Cancer Genome Atlas (TCGA) demonstrate that miss-SNF achieves state-of-the-art results in recovering similarities and in identifying patients subgroups enriched in clinically relevant variables and having differential survival. Moreover, amputation experiments show that miss-SNF supervised prediction of cancer clinical outcomes and Alzheimer’s disease diagnosis with completely missing data achieves results comparable to those obtained when all the data are available. Availability and implementation miss-SNF code, implemented in R, is available at https://github.com/AnacletoLAB/missSNF.

Biochemistry & Molecular Biology↗
DOE OSTI2022

Perspectives on the integration between first-principles and data-driven modeling

Efficiently embedding and/or integrating mechanistic information with data-driven models is essential if it is desired to simultaneously take advantage of both engineering principles and data-science. Further the opportunity for hybridization occurs in many scenarios, such as the development of a faster model of an accurate high-fidelity computer model; the correction of a mechanistic model that does not fully-capture the physical phenomena of the system; or the integration of a data-driven component approximating an unknown correlation within a mechanistic model. At the same time, different techniques have been proposed and applied in different literatures to achieve this hybridization, such as hybrid modeling, physics-informed Machine Learning (ML) and model calibration. In this paper we review the methods, challenges, applications and algorithms of these three research areas and discuss them in the context of the different hybridization scenarios. Moreover, we provide a comprehensive comparison of the hybridization techniques with respect to their differences and similarities, as well as advantages and limitations and future perspectives. Finally, we apply and illustrate hybrid modeling, physics-informed ML and model calibration via a chemical reactor case study.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1999

Forced and Moment Measurements with Pressure-Sensitive Paint

The potential of pressure-sensitive paint (PSP) to provide aerodynamic loads measurements has been a driving force behind the development of this measurement technique. To demonstrate the suitability of PSP for this purpose, it is necessary to show that PSP-derived pressures can be accurately integrated over the model surface. This cannot be done simply by demonstrating the accuracy of PSP as compared to pressure taps. PSP errors due to misregistration or temperature sensitivity may be high near model edges, where they will have a strong effect on moment measurements, but where pressure taps are rarely installed. A more suitable technique is to compare integrated PSP data over the entire model surface with balance and/or CFD results. This paper presents results from three experiments in which integrated PSP data is compared with balance and/or CFD data. This allows the usefulness of PSP for force and moment measurements, and by implication for loads measurements, to be assessed.

Bell, James H.↗
DOE OSTI2020

New Architecture to Support Integration and Processing of Seismic Data from Heterogeneous Sources

The Geophysical Monitoring Program (GMP) at Lawrence Livermore National Lab (LLNL) maintains a database and supporting infrastructure for geophysical data used in support of the Nuclear Detonation Detection mission. This database includes data from multiple sources, many of which do not distribute data to the public or for which there is no automated means of access. For example, Figure 1 shows (left) the distribution of waveform data in our database by source. The Incorporated Research Institutions for Seismology Data Management Center (IRISDMC) is our major source of waveform data and those data may be retrieved at will using the Federated Digital Seismograph Networks FDSN web Application Programming Interface (API). However, the next 6 most important sources of waveform data have no or only limited automated access to waveforms. As Figure 1 (right) shows, it is very common for waveform records associate with an event in our database to come from two or more sources, and in some cases data come from 10 sources. This diversity of data sources drives our need for efficient and correct integration of metadata, parametric data, and waveform data.

58 GEOSCIENCES↗
DOE OSTI2025

Seismicity-constrained fault detection and characterization with a multitask machine learning model

Geological fault detection and characterization are crucial for understanding subsurface dynamics across scales. While methods for fault delineation based on either seismicity location analysis or seismic image reflector discontinuity are well-established, a systematic approach that integrates both data types remains absent. We develop a novel machine learning model that unifies seismic reflector images and seismicity location information to automatically identify geological faults and characterize their geometrical properties. The model encodes a seismic image and a seismicity location image separately, and fuses the encoded features with a spatial-channel attention fusion module to improve the learning of important features in both inputs. We design an automated strategy to generate high-quality synthetic training data and labels. To improve the realism of the seismicity location image, we include random seismicity noise and missing seismicity location associated with some of the faults. We validate the model’s efficacy and accuracy using synthetic data examples and two field data examples. Moreover, we show that fine-tuning the trained model with a small, domain-specific dataset enhances its fidelity for field data applications. The results demonstrate that integrating seismicity location and seismic images into a unified framework allows the end-to-end neural network to achieve higher fidelity and accuracy in delineating subsurface faults and their geometrical properties compared with image-only fault detection methods. Our approach offers an adaptive data-driven tool for geological fault characterization and seismic hazard mitigation, bridging the gap between seismicity location and image-based fault detection methods.

58 GEOSCIENCES↗
DOE OSTI2023

Uncovering Where Compensating Errors Could Hide in ENDF/B-VIII.0

Unconstrained physics spaces between two or more nuclear data observables in a library occur when their values can be simultaneously adjusted without violating the uncertainties in either differential information or simulations of relevant integral experiments. Differential data are often too imprecise to fully bound all nuclear data observables of interest for application simulations. Integral data are simulated with combinations of nuclear data so that an error in one observable may be hidden by a counterbalancing error in another. In this manner compensating errors may lurk within nuclear data libraries and these errors have the potential to undermine the predictive power of neutron transport simulations, particularly in situations where there is no conclusive validation experiment that resembles the application of interest. The EUCLID project (Experiments Underpinned by Computational Learning for Improvements in Nuclear Data) developed a preliminary workflow to identify these unconstrained physics spaces by bringing together results from a large collection of integral experiments with their simulated counter-parts as well as differential information that have a one-to-one correspondence to nuclear data. This wealth of information is processed by machine learning tools for subsequent refinement by human experts. Here, we show how the EUCLID work-flow is executed by applying it first to 239 Pu and then to 9 Be nuclear data in ENDF/B-VIII.0.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

In-depth analysis on parallel processing patterns for high-performance Dataframes

The Data Science domain has expanded monumentally in both research and industry communities during the past decade, predominantly owing to the Big Data revolution. Artificial Intelligence (AI) and Machine Learning (ML) are bringing more complexities to data engineering applications, which are now integrated into data processing pipelines to process terabytes of data. Typically, a significant amount of time is spent on data preprocessing in these pipelines, and hence improving its efficiency directly impacts the overall pipeline performance. The community has recently embraced the concept of Dataframes as the de-facto data structure for data representation and manipulation. However, the most widely used serial Dataframes today (R, pandas) experience performance limitations while working on even moderately large data sets. We believe that there is plenty of room for improvement by taking a look at this problem from a high-performance computing point of view. In a prior publication, we presented a set of parallel processing patterns for distributed dataframe operators and the reference runtime implementation, Cylon. In this paper, we are expanding on the initial concept by introducing a cost model for evaluating the said patterns. Furthermore, we evaluate the performance of Cylon on the ORNL Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Data Center Cybersecurity, Supply Chain Risk Management, and Emerging Regulation Cohort Summary: Takeaways and Action Plans

This report summarizes the outcomes of the Data Center Cohort under the Department of Energy’s Technical Assistance for Digital Assurance (TADA) initiative, aimed at enhancing grid resilience through cybersecurity, supply chain risk management (SCRM), and Cyber-Informed Engineering (CIE). The cohort engaged 17 organizations across utilities, data center operators, vendors, and technology providers in three sessions combining presentations, discussions, and exercises. Key topics included AI-driven load behavior, cybersecurity vulnerabilities in UPS/BESS and cooling systems, governance gaps at utility–data center boundaries, and supply chain integrity. Five cross-cutting themes emerged: interconnection architecture vulnerabilities, fragmented governance, AI-driven stability risks, lack of regulatory frameworks, and long-term supply chain concerns. Actionable recommendations were developed, including implementing DMZ segmentation, formalizing vendor access agreements, designing AI workload limits, and advancing standards through NERC and state-level programs. These strategies aim to strengthen resilience, clarify responsibilities, and ensure secure integration of data centers into the grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1976

The measurement of carbon monoxide and methane in the national capital air quality control region. III - Correlation interferometer results

Two types of experiments were performed with a correlation interferometer on-board a Bell Jet Ranger 206 Helicopter. The first consisted of simultaneous ground- and air-truth measurements as the instrumented helicopter passed over the Cheverly site. The second consisted of several measurement flights in and around the national capital air quality control region (Washington, D.C.). The correlation interferometer data, the infrared Fourier spectrometer data, and the integrated altitude sampling data showed agreement within the errors of the individual measurements. High values for CO were found from the D.C. flight data to be reproducible and concentrated in areas of stop-and-go traffic. It is concluded, that pollutants at low altitudes are detectable from an air-borne platform by remote correlation interferometry and that the correlation interferometer measurements agree with ground- and air-truth data.

Goldstein, H. W.↗
NASA NTRS1980

Development of an information data base for watershed monitoring

Landsat multispectral scanner data, Defense Mapping Agency digital terrain data, conventional maps, and ground data were integrated to create a comprehensive information data base (the Image Based Information System), to monitor the water quality of the Lake Tahoe Basin. Landsat imagery was used as the planimetric base to which all other data were registered. A georeference image plane, which provided an interface between all data planes for the Lake Tahoe Basin data base, was created from the drainage basin map. The data base was used to extract each drainage basin for separate display. The Defense Mapping Agency-created elevation image was processed with VICAR software to produce a component representing slope magnitude, which was cross-tabulated with the drainage basin georeference table. Future applications of the data base include the development of precipitation modeling, surface runoff models, and classification of drainage basin cover types.

Smith, A. Y.↗
NASA NTRS1980

Description of a user-oriented geographic information system - The resource analysis program

This paper describes the Resource Analysis Program, an applied geographic information system. Several applications are presented which utilized soil, and other natural resource data, to develop integrated maps and data analyses. These applications demonstrate the methods of analysis and the philosophy of approach used in the mapping system. The applications are evaluated in reference to four major needs of a functional mapping system: data capture, data libraries, data analysis, and mapping and data display. These four criteria are then used to describe an effort to develop the next generation of applied mapping systems. This approach uses inexpensive microcomputers for field applications and should prove to be a viable entry point for users heretofore unable or unwilling to venture into applied computer mapping.

Tilmann, S. E.↗
NASA NTRS1984

An initial approach to the utilization of VAS satellite sounding data

The primary objective is the development of methods to utilize satellite soundings. To achieve that, a more precise understanding of the characteristics of satellite derived soundings is required. The initial approach in the utilization of satellite soundings is to find a way to combine rawinsondes and satellite data into a unified data set. If this can be done in a meaningful way, satellite data could be integrated into existing data and interpretation would be enhanced. In this attempt, both rawinsonde and satellite soundings will be decomposed by the use of the Fourier cosine series. Then, each harmonic will be compared to get a better understanding of the representativeness of the satellite sounding data. Harmonics taken from satellite and rawinsonde soundings will be combined to provide a unified data set that can be used both over data sparse ocean areas as well as over land where rawinsonde data are available.

Shin, Kyung-Sup↗
NASA NTRS1993

Thermal infrared emission spectroscopy of natural surfaces: Application to desert varnish coatings on rocks

Thermal infrared spectroscopy has become an increasingly important tool for remote compositional analysis and geologic mapping. Most published laboratory measurements have been obtained in bidirectional reflection or transmission, whereas remotely sensed thermal infrared data are obtained by measuring the emitted energy. Section 2 of this paper describes a laboratory technique for determining calibrated emissivities of natural surfaces. Equations are developed to account for the energy reflected from the environment and to determine directly the sample temperature from measurements of hot and cold blackbody targets. Two methods for determining emissivity are developed: one in which only a hot sample measurement is made and the reflected background energy is removed by modeling, and a second in which the sample is cooled and the reflected energy is measured directly. Relative emissivity can be obtained to approximately 1% and absolute emissivities can be obtained to 2-15%, depending on the validity of the assumption that the emissivity of the sample is unity at some wavelength. The emission data agree well within the hemispherically integrated reflection data but point out probelms associated with bidirectional reflectance measurements. Section 3 applies emissivity measurements to the study of layered surfaces consisting of desert varnish coatings on granite and granodiorite rock suites. Two linear models are developed: the first assumes linear mixing of independent emission from the substrate and varnish (checkerboard model); the second models tansmission through an absorbing/emitting medium. Regardless of whether the varnish is or is not relatively transparant and strongly absorptive, the spectral effect of varnish increases linearly with varnish thickness, indicating that thick patches of varnish dominate the spectral properties. As a result, medium varnish thickness can be determined from spectral measurements. In addition, the composition of a substrate can be estimated through varnish layers up to 40-50 micrometers in median thickness, and the composition of the varnish material can be determined if the substrate material is known. The varnishes studied are composed primarily of clay materials, consistent with previous studies of varnish composition.

Christensen, Philip R.↗
NASA NTRS1997

Opus: A Coordination Language for Multidisciplinary Applications

Data parallel languages, such as High Performance fortran, can be successfully applied to a wide range of numerical applications. However, many advanced scientific and engineering applications are multidisciplinary and heterogeneous in nature, and thus do not fit well into the data parallel paradigm. In this paper we present Opus, a language designed to fill this gap. The central concept of Opus is a mechanism called ShareD Abstractions (SDA). An SDA can be used as a computation server, i.e., a locus of computational activity, or as a data repository for sharing data between asynchronous tasks. SDAs can be internally data parallel, providing support for the integration of data and task parallelism as well as nested task parallelism. They can thus be used to express multidisciplinary applications in a natural and efficient way. In this paper we describe the features of the language through a series of examples and give an overview of the runtime support required to implement these concepts in parallel and distributed environments.

Chapman, Barbara↗