Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data integrity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Secure Peer-to-Peer Networks for Scientific Information Sharing

The most common means of remote scientific collaboration today includes the trio of e-mail for electronic communication, FTP for file sharing, and personalized Web sites for dissemination of papers and research results. With the growth of broadband Internet, there has been a desire to share large files (movies, files, scientific data files) over the Internet. Email has limits on the size of files that can be attached and transmitted. FTP is often used to share large files, but this requires the user to set up an FTP site for which it is hard to set group privileges, it is not straightforward for everyone, and the content is not searchable. Peer-to-peer technology (P2P), which has been overwhelmingly successful in popular content distribution, is the basis for development of a scientific collaboratory called Scientific Peer Network (SciPerNet). This technology combines social networking with P2P file sharing. SciPerNet will be a standalone application, written in Java and Swing, thus insuring portability to a number of different platforms. Some of the features include user authentication, search capability, seamless integration with a data center, the ability to create groups and social networks, and on-line chat. In contrast to P2P networks such as Gnutella, Bit Torrent, and others, SciPerNet incorporates three design elements that are critical to application of P2P for scientific purposes: User authentication, Data integrity validation, Reliable searching SciPerNet also provides a complementary solution to virtual observatories by enabling distributed collaboration and sharing of downloaded and/or processed data among scientists. This will, in turn, increase scientific returns from NASA missions. As such, SciPerNet can serve a two-fold purpose for NASA: a cost-savings software as well as a productivity tool for scientists working with data from NASA missions.

Karimabadi, Homa↗

Integrated detector array preprocessing for infrared astronomical applications

On-board preprocessing of astronomical data from integrated infrared detector arrays and discrete detectors will allow increases in sensitivity and reductions in costs for observations from cryogenic space telescopes. A variety of preprocessing functions for this application, which could be implemented either through analog on-chip devices or through external microprocessors, is identified. Software simulations and laboratory evaluations are underway to determine the effectiveness of these preprocessing schemes.

Mccreight, C. R.↗

Progress Towards Integrating the Finite-Volume Cubed-Sphere (FV3) Dynamical Core Tangent Linear and Adjoint Models into JEDI

The Joint Effort for Data assimilation Integration (JEDI) -- led by the Joint Center for Satellite Data Assimilation (JCSDA) -- is an inter-organizational endeavor to develop a common framework for performing data assimilation. This extensive framework will ultimately provide solvers, observation operators, interpolation and model interfaces using object oriented modeling. Two partners involved in JEDI use or plan to use the Finite Volume Cubed-Sphere (FV3) dynamical core to produce weather forecasts; these are NASA's Global Modeling and Assimilation Office and NOAA's National Center for Environment Prediction. In this work we present an update on ongoing efforts to integrate the FV3 tangent linear and adjoint models into the prototype JEDI framework. We setup and run a simple cycled data assimilation experiment using 4DVAR on the cubed sphere grid and with the FV3 tangent linear and adjoint models. Development of the observation operators for JEDI is separately underway. Instead of using real observations a simplified set of simulated observations will be used. We discuss the steps required to bring the FV3 linearized model into the object oriented framework and consider what would be the computational requirements of running this configuration for an operational system. FV3 uses a small time-step to ensure that small scales are well resolved, however this presents design challenges when running 4DVAR with the adjoint. An approach to storing the FV3 model trajectory has been developed that maintains the flexibility of using automatic differentiation. We discuss how this approach is incorporated into the framework. Other important uses of adjoint models include computing observation impacts and singular vectors, we consider how these tools can be included in JEDI.

Holdaway, Daniel↗

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

FY22 Progress Report: SRNL Analysis of ICCWR LCM and WAMS Data for Corrosion and Cracking

Algorithms for machine learning and data analysis for the 3013 Surveillance Program are being developed in an ongoing collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). To detect the presence of corrosion and cracking, data is collected from large binary files generated by a Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS). Software is being developed to use the physical attributes in the data files (e.g., height, color, and grayscale values; all as functions of a location in a plane projection) to detect the presence of surface corrosion and cracking. A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data for training ML algorithms, flag significant features, execute Machine Learning (ML) algorithms, output parameters from trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Surface defects can be called out by setting user-specified thresholds, feature based analysis or machine learning algorithms. Enhancements to data labeling capability have been developed to address this essential precursor to application of ML routines. Efficient labeling is particularly important in view of the very large volume of data required to train ML algorithms.

3013 Corrosion↗

Real Time Phasor Analytics (RTPA) and RTPA-SCR System Strength Online Tool

This presentation showcases the Real-Time Phasor Analytics (RTPA) framework for monitoring inertia and assessing system strength in power grids. RTPA is an open-source tool designed to standardize access to data from Power Management Units (PMUs) and Phasor Data Concentrators (PDCs). It facilitates real-time connectivity to multiple PDCs in accordance with the IEEE C37.118-2 standard and supports asynchronous data stream integration. Additionally, RTPA can simulate a PDC server streaming C37.118-2 data and provides Python bindings for seamless interaction with the framework, eliminating the need for direct Rust programming.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Toward Coupled Data Assimilation in NASA’s GEOS: Developments in the Ocean Context

The Global Modeling & Assimilation Office (GMAO) at NASA GSFC produces analyses and predictions of the Earth system using various configurations of the Goddard Earth Observing System (GEOS) model and assimilation system. The current sub-seasonal-to-seasonal prediction system (GEOS-S2S) is based on a coupled atmosphere-ocean-land-ice configuration of GEOS which includes the Modular Ocean Model version 5 (MOM5) run at approximately 50-km resolution and a de-coupled OI-based ocean analysis that uses an initialization of MOM5 forced by the MERRA-2 reanalysis. GMAO will soon implement an updated GEOS-S2S system that will run at 25-km resolution and adopt aspects of the hybrid four-dimensional ensemble-variational (H4DEnVar) system already running in the production-version atmospheric analysis system, including a Local Ensemble Transform Kalman Filter (LETKF) to provide initial conditions for the oceanic state. This presentation will focus on developments to sustain the GMAO's systems on longer time horizons, where more radical transformations will be required to adapt to advanced computing environments, higher resolution and more diverse model components, and new observations for the Earth system. Results will describe progress toward a version of the GEOS coupled system that will be based around the Joint Effort for Data assimilation Integration (JEDI) framework being developed within Joint Center for Satellite Data Assimilation (JCSDA) and include an updated ocean model, MOM6. Discussion will focus specifically on the use of a Unified Forward Operator (UFO) for simulating observations and the Object Oriented Prediction System (OOPS) for providing the state estimate. These features are being developed as a multi-agency effort under the auspices of the JCSDA and are being adopted in the GMAO for all its applications of coupled data assimilation including S2S, numerical weather prediction, and reanalysis.

Mahajan, Rahul↗

Automating Traffic Microsimulation from SYNCHRO UTDF to SUMO

Modern transportation research relies on seamlessly integrating traffic signal data with robust network representation and simulation tools. This study presents utdf2gmns, an open-source Python tool that automates conversion of the Universal Traffic Data Format, including network representation, signalized intersections, and turning volumes into the General Modeling Network Specification (GMNS) Standard. The resulting GMNS-compliant network can be converted for microsimulation in SUMO. By automatically extracting intersection control parameters and aligning them with GMNS conventions, utdf2gmns minimizes manual preprocessing and data loss. utdf2gmns also integrates with the Sigma-X engine to extract and visualize key traffic control metrics, such as phasing diagrams, turning volumes, volume-tocapacity ratios, and control delays. This streamlined workflow enables efficient scenario testing, accurate model building, and consistent data management. Validated through case studies, utdf2gmns reliably models complex urban corridors, promoting reproducibility and standardization. Documentation is available on GitHub and PyPI, supporting easy integration and community engagement.

Luo, Roy [ORNL] (ORCID:0009000312909983)↗

Data Sharing in Radiobiology; Towards FAIR

The value of scientific data depends on their findability, accessibility, integrability and reusability according to the FAIR principles. Together with the sustainability of data preservation and access, these principles underpin the long term benefits of scientific research. Within the domain of radiobiology we have a huge array of data types, themes and complexities which make standardisation of metadata, data structure and data integration very challenging. Moreover, it is clear that, for example, in the area of disaster preparedness, the ready discovery and availability of multiple types of data, for example on biological effects of exposure, climatology, ecology, human behavioural and attitudinal studies, is important for an integrated scientific approach. Because these data are spread over many databases, journal supplementary information resources and even the computers of the investigators, their discovery and reuse can be challenging. Despite exhortations from funding agencies and scientific institutions over the past two decades there is still a serious deficit in the willingness and in some cases the ability of investigators to share data, and although much may not be formally „Public domain“, information about the existence of the data, their metadata, and how to obtain them should always be available. We report the progress of work on three databases, the STORE and the NASA GeneLab and LSDA repositories to leverage the Radiation Biology Ontology (RBO), a structured terminology for metadata that can be used by all radiation biology-relevant databases to unite federated and automated data searches across multiple databases, for example using web services, and through semantic web technologies supporting data discovery. The initial primary use-cases for RBO were archiving data in the STORE database (https://www.storedb.org/), the repository used for the RadoNorm and Pianoforte Projects among others, and in the NASA Open Science Data Repository (https://osdr.nasa.gov/bio). The scope of radiobiology research ranges from basic physics to radiation oncology to sociolegal studies; no existing ontology had the necessary breadth or depth to fulfill this need. In addition, a formal ontology has the advantage of being usable for machine learning and, importantly, for tasks like data integration, knowledge extraction from the scientific literature and for query extension and data classification. Standardisation of metadata is one of the primary objectives of the FAIR principles for open data; RBO is an important landmark for FAIR-compliant radiation biology data sharing. The RBO is developed using the open-source tools of GitHub and the OBO Foundry-led Ontology Development Kit, and published through GitHub and the NIH/NCBI BioPortal website. This initial phase of concept modeling has yielded an ontology that has more than 300 declared concepts, with more than 3500 additional concepts imported from other OBO Foundry ontologies with relevance to radiation biology (for example, concepts from the ISO standard Basic Formal Ontology, the Environment Ontology and the Gene Ontology). We welcome input into the development of RBO and encourage its adoption.

ontologies↗

Data Sharing in Radiation Biology: Towards FAIR

The value of scientific data depends on their findability, accessibility, integrability and reusability according to the FAIR principles. Together with the sustainability of data preservation and access, these principles underpin the long term benefits of scientific research. Within the domain of radiobiology we have a huge array of data types, themes and complexities which make standardisation of metadata, data structure and data integration very challenging. Moreover, it is clear that, for example, in the area of disaster preparedness, the ready discovery and availability of multiple types of data, for example on biological effects of exposure, climatology, ecology, human behavioural and attitudinal studies, is important for an integrated scientific approach. Because these data are spread over many databases, journal supplementary information resources and even the computers of the investigators, their discovery and reuse can be challenging. Despite exhortations from funding agencies and scientific institutions over the past two decades there is still a serious deficit in the willingness and in some cases the ability of investigators to share data, and although much may not be formally "Public domain“, information about the existence of the data, their metadata, and how to obtain them should always be available. We report the progress of work on three databases, the STORE and the NASA GeneLab and LSDA repositories to leverage the Radiation Biology Ontology (RBO), a structured terminology for metadata that can be used by all radiation biology-relevant databases to unite federated and automated data searches across multiple databases, for example using web services, and through semantic web technologies supporting data discovery. The initial primary use-cases for RBO were archiving data in the STORE database (https://www.storedb.org/), the repository used for the RadoNorm and Pianoforte Projects among others, and in the NASA Open Science Data Repository (https://osdr.nasa.gov/bio). The scope of radiobiology research ranges from basic physics to radiation oncology to sociolegal studies; no existing ontology had the necessary breadth or depth to fulfill this need. In addition, a formal ontology has the advantage of being usable for machine learning and, importantly, for tasks like data integration, knowledge extraction from the scientific literature and for query extension and data classification. Standardisation of metadata is one of the primary objectives of the FAIR principles for open data; RBO is an important landmark for FAIR-compliant radiation biology data sharing. The RBO is developed using the open-source tools of GitHub and the OBO Foundry-led Ontology Development Kit, and published through GitHub and the NIH/NCBI BioPortal website. This initial phase of concept modeling has yielded an ontology that has more than 300 declared concepts, with more than 3500 additional concepts imported from other OBO Foundry ontologies with relevance to radiation biology (for example, concepts from the ISO standard Basic Formal Ontology, the Environment Ontology and the Gene Ontology). We welcome input into the development of RBO and encourage its adoption.

ontologies↗

Time for a drought experiment: Do you know your plants’ water status?

Abstract Drought stress is an increasing concern because of climate change and increasing demands on water for agriculture. There are still many unknowns about how plants sense and respond to water limitation, including which genes and cellular mechanisms are impactful for ecology and crop improvement in drought-prone environments. A better understanding of plant drought resistance will require integration of several research disciplines. A common set of parameters to describe plant water status and quantify drought severity can enhance data interpretation and research integration across the research disciplines involved in understanding drought resistance and would be especially useful in integrating the flood of genomic data being generated in drought studies. Water potential (ψw) is a physical measure of the free energy status of water that, along with related physiological measurements, allows unambiguous description of plant water status that can apply across various soil types and environmental conditions. ψw and related physiological parameters can be measured with relatively modest investment in equipment and effort. Thus, we propose that increased use of ψw as a fundamental descriptor of plant water status can enhance the insight gained from many drought-related experiments and facilitate data integration and sharing across laboratories and research disciplines.

Juenger, Thomas E. (ORCID:0000000195509288)↗

Transient Data Library of Solar Grid Integrated Distributed System

This submission contains an open-source library of transient events in distributed system with high solar PV. The library includes the collected data, related documents and scripts for loading the data. The data library is built for transient event detection and machine learning based analysis algorithm development. The data was collected via both field test and software simulation. The units for the data are included in the data file headers for each data series. A text editor or spreadsheet software, such as Excel, and Matlab is required to view the data.

algorithms↗

Multiple Critical Unresolved Region Integral Experiment (MCURIE): A Proposed Integral Critical Experimental Framework for Unresolved Region and Intermediate Energies

The Critical Unresolved Region Integral Experiment (CURIE) critical experiment was performed at the National Criticality Experiments Research Center (NCERC) at the Device Assembly Facility (DAF) at the Nevada Nuclear Security Sites (NNSS) in 2020. The objective of CURIE was to improve the quality of integral nuclear data in the uranium-235 ( 235 U) unresolved resonance region (URR) by performing benchmark integral experiments that were sensitive to the URR energy ranges. The CURIE experiment was evaluated for the International Criticality Safety Benchmark Evaluation Project (ICSBEP) handbook and the benchmark evaluation was accepted in 2022. The URR is a region within the intermediate neutron energy range (the intermediate energy ranges from 0.7 eV to 100 keV). The observed resonance structure in neutron cross sections is due to discrete energy levels in the nucleus and are characterized by resonance parameters. In the URR region, the resonance parameters are only partially resolved as the resolution of the experiment techniques becomes comparable to the average width of the resonances themselves, and the resonances are so close to one another that the structure cannot be determined empirically. The ENDF/B-VIII.0 and JEFF-3.3 nuclear data libraries define the URR as beginning at 2.25 keV and continuing until 25 keV. There are minimal intermediate neutron energy benchmarks available in the ICSBEP benchmark handbook, and aside from CURIE there are none that are highly sensitive in the URR energy region. There is a current need for additional experiments sensitive to the URR energy region. There is a new proposed subgroup for the Organization for Economic Co-operation and Development and Nuclear Energy Agency (OECD NEA) Working Party on International Nuclear Data Evaluation Cooperation (WPEC), so any new models or information will need experimental validation and testing. The NEA Working Party on Nuclear Criticality Safety (WPNCS) recent experimental needs and priority list includes intermediate energy 235 U and 238 U experiments, as does the recent Integral Experiments to Address Nuclear Criticality Safety Needs Meeting (May 2023). A variant on the original CURIE experiment called the Multiple Critical Unresolved Region Integral Experiment (MCURIE) is proposed to provide further investigation of the intermediate and URR energy region for uranium. MCURIE will utilize existing fuels at NCERC but use alternative moderators and reflectors to modify the neutron absorption, scattering, and fission spectra of the experiments, allowing for precise targeting of nuclear data sensitivities. The overall goal of MCURIE is to develop a framework for designing and performing integral benchmark experiments with high sensitivities in the intermediate and URR energy regions for nuclear data validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Integrating Earth Observations and Socioeconomic Data to Identify Vulnerable Populations and Support Environmental Justice Initiatives

Part of NASA’s Earth Applied Sciences, DEVELOP is a dual capacity building program that introduces communities to applications of NASA Earth observation data to help inform environmental decision making. These projects are conducted by small teams of students, recent graduates, and early and transitioning career professionals and are tailored specifically to end-user decision making processes. Since 2018, a collaboration between NASA DEVELOP, Groundwork USA and its network of trusts, the AGU Thriving Earth Exchange, and local communities such as the City of Cambridge and the City of San Diego, has culminated in a campaign of 14 projects focused on assessing vulnerability to environmental threats such as extreme heat and flooding. These projects have explored the integration of satellite data and socio-economic data to discern populations at risk of being negatively impacted and align with Groundwork’s Climate Safe Neighborhoods Initiative that explores the relationship between historical race-based housing segregation and current and predicted impacts of climate change. This presentation will introduce an overview of the DEVELOP projects using Earth observations to support vulnerabilities assessments and community resilience, the collaboration with Groundwork USA, and future plans for environmental justice efforts at NASA.

Capacity Building↗

Apollo 17 Lunar Sounder Data provide Insight into Aitken Crater's Subsurface Structure

In preparation for the forthcoming avalanche of data from Lunar Reconnaissance Orbiter (LRO), we conducted a pilot study to demonstrate integration of multiple geophysical data sets. We applied methods of data integration that are used by the commercial mineral exploration industry to enhance the value of historical data sets and to provide a roadmap for future efforts.

Cooper, Bonnie L.↗

Adamantine 1.0: A Thermomechanical Simulator for Additive Manufacturing

Adamantine is a thermomechanical simulation code that is written in C++ and built on top of deal.II (Arndt et al., 2023), p4est (Burstedde et al., 2011), ArborX (Lebrun-Grandié et al., 2020), Trilinos (The Trilinos Project Team, 2020), and Kokkos (Trott et al., 2022). Adamantine was developed with additive manufacturing in mind and it is particularly well adapted to simulate fused filament fabrication, directed energy deposition, and powder bed fusion. Adamantine employs the finite element method with adaptive mesh refinement to solve a nonlinear anisotropic heat equation, enabling support for various additive manufacturing processes. It can also perform elastoplastic and thermoelastoplastic simulations. It can handle materials in three distinct phases (solid, liquid, and powder) to accurately reflect the physical state during different stages of the manufacturing process. To enhance simulation accuracy, adamantine incorporates data assimilation techniques (Asch et al., 2016). This allows it to integrate experimental data from sensors like thermocouples and infrared (IR) cameras. This combined approach helps account for errors arising from input parameters, material properties, models, and numerical calculations, leading to more realistic simulations that reflect what occurs in a particular print.

36 MATERIALS SCIENCE↗

Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement

Atmospheric data are collected by researchers every day. Campaigns such as GOAmazon 2014/2015 and the Amazon Tall Tower Observatory collect essential data on aerosols, gases, cloud properties, and meteorological parameters in the Brazilian Amazon basin. These data products provide insights and essential information for analyzing and predicting natural processes. However, in Brazil, it is estimated that more than 80% of the scientific data collected are not published due to the lack of web portals that collect and store these data. This makes it difficult, or even impossible, to access and integrate the data, which can result in the loss of significant amounts of information and significantly affect the understanding of the overall data. To address this problem, we propose a data portal architecture and open data deployment that enable Big Data processing, human interaction, and download-oriented approaches with tools that help users catalog, publish and visualize atmospheric data. Thus, we describe the architecture developed, based on the experience of the Atmospheric Radiation Measurement Data Center, which incorporates the principles of FAIR, the infrastructure and content management system for managing scientific data. The portal partial results were tested with environmental data from contaminated areas at the University of São Paulo. Overall, this data portal creates more shared knowledge about atmospheric processes by providing users with access to open environmental data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Integration of diverse remote sensing data sets for geologic mapping and resource exploration

The use of high-quality multispectral images in the visible, near-infrared, shortwave infrared, thermal infrared, and microwave regions of the spectrum for producing thematic maps showing details of the surface geology is reported. The airborne data sets used in the study include the Airborne Visible/Infrared Imaging Spectrometer, the Thermal Infrared Multispectral Scanner, and the airborne SAR. Ancillary data include a digital elevation model, National High Altitude Photography, Landsat Multispectral Scanner data, Landsat Thematic Mapper data, laboratory and field spectral measurements, and traditional geologic mapping. The integrated, multispectral images are shown to provide new geologic information that can be used in mineral deposit models to provide exploration targets.

Kruse, Fred A.↗