Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data diversity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Low Altitude AVIRIS Data for Mapping Land Cover in Yellowstone National Park: Use of Isodata Clustering Techniques

Yellowstone National Park (YNP) contains a diversity of land cover. YNP managers need site-specific land cover maps, which may be produced more effectively using high-resolution hyperspectral imagery. ISODATA clustering techniques have aided operational multispectral image classification and may benefit certain hyperspectral data applications if optimally applied. In response, a study was performed for an area in northeast YNP using 11 select bands of low-altitude AVIRIS data calibrated to ground reflectance. These data were subjected to ISODATA clustering and Maximum Likelihood Classification techniques to produce a moderately detailed land cover map. The latter has good apparent overall agreement with field surveys and aerial photo interpretation.

Spruce, Joe↗

Mars Mission Scenario: Data Volume and PDT Notes

Objectives of this work are: (1) Investigate methods for quantifying the value of interoperability for deep space missions: A network of optical receive stations Each one potentially owned by a different space agency. Reduces overall cost to any individual agency Provides geographically diverse locations to mitigate weather problems (clouds, wind, rain, dust, etc.) (2) Metrics: a. Total data volume returned over mission duration b. Percent data transferred (PDT) or something similar.

deep space optical communications↗

Evaluation of Graph Pattern Matching Workloads in Graph Analysis Systems

Graph analysis has emerged as a powerful method for data scientists to represent, integrate, query, and explore heterogeneous data sources. As a result, graph data management and mining became a popular area of research, and led to the development of plethora of systems in recent years. Unfortunately, the number of emerging graph analysis systems and the wide range of applications, coupled with a lack of apples-to-apples comparisons, make it difficult to understand the trade-offs between different systems and the graph operations for which they are designed. A fair comparison of these systems is a challenging task for the following reasons: multiple data models, non-standardized serialization formats, various query interfaces to users, and diverse environments they operate in. To address these key challenges, in this paper we present a new benchmark suite by extending the Lehigh University Benchmark (LUBM) to cover the most common capabilities of various graph analysis systems. We provide the design process of the benchmark, which generalizes the workflow for data scientists to conduct the desired graph analysis on different graph analysis systems. Equipped with this extended benchmark suite, we present performance comparison for nine subgraph pattern retrieval operations over six graph analysis systems, namely NetworkX, Neo4j, Jena, Titan, GraphX, and uRiKA. Through the proposed benchmark suite, this study reveals both quantitative and qualitative findings in (1) implications in loading data into each system; (2) challenges in describing graph patterns for each query interface; and (3) different sensitivity of each system to query selectivity. We envision that this study will pave the road for: (i) data scientists to select the suitable graph analysis systems, and (ii) data management system designers to advance graph analysis systems.

Hong, Seokyong↗

Accelerating scientific discoveries through data-driven innovations

Developing artificial intelligence (AI) and machine learning (ML) methods that can accelerate scientific discoveries and advance science has become one of the important research directions for the AI/ML research community. It has been gaining increasing attention from researchers in diverse scientific areas, including biomedical science, materials science, climate science, physics, chemistry, and many others. Data-driven AI/ML innovations to enable reliable predictions and optimal decision making for scientific discoveries face several critical challenges, among which are high system complexity, large search space, incomplete knowledge, and small data, all of which demand novel strategies to effectively address them. Meeting these challenges and thereby accelerating scientific discoveries and industrial innovations, calls for research that can take full advantage of the latest advances in AI/ML to integrate data-driven techniques with scientific knowledge and is able to execute them in modern high-performance computing (HPC) environments at scale. This Patterns special collection "Accelerating scientific discoveries through data-driven innovations" features articles that showcase the promising roles of AI/ML and data-driven modeling in accelerating scientific discoveries and may inspire the next wave of data-driven innovations in various scientific domains.

97 MATHEMATICS AND COMPUTING↗

A Methodology for the Rapid Development of Scalable HPC Data Services

There is growing evidence in the scientifc computing community that parallel file systems are not sufficient for all HPC storage workloads. This realization has motivated extensive research in new storage system designs. The question of which alternative we should turn towards implies that there could be a single answer satisfying a wide range of very diverse applications. We argue that such a generic solution does not exist. Instead, custom data services should be designed and tailored to the needs of specific applications on specific hardware. Furthermore, custom data services should be designed in close collaboration with users. In this paper, we present a methodology for the rapid development of such data services. This methodology promotes the design of reusable building blocks that can be composed together efficiently through a runtime based on high-performance threading, tasking, and remote procedure calls. We illustrate the success of our methodology by showcasing three examples of data services designed from the same building blocks, yet targeting entirely different applications.

Dorier, Mattieu↗

Evaluation of remote sensing and automatic data techniques for characterization of wetlands

This investigation has been conducted in the Atchafalaya River Basin of South Central Louisiana. This is a humid area of heavily forested swamps with a large volume of flow mostly from a diversion of the lower Mississippi River. Techniques to obtain enlarged imagery from computer compatible tapes of ERTS data without photographic enlargement is explained and illustrated. Techniques of extraction of environmental information from single bands and multiband pattern recognition procedures are explained and evaluated. A comparison of pattern recognition classifications of the Atchafalaya Basin by aircraft multispectral scanner and ERTS MSS data is made. Data for this comparison were gathered within three weeks of each other in the winter of 1973. Scorecards of the accuracy of the classifications are presented. Recommendations are made concerning the utilization of each sensor platform to perform specific tasks of wetlands characterization.

Cartmill, R. H.↗

HEP Science Network Requirements--Final Report

The Energy Sciences Network (ESnet) is the primary provider of network connectivity for the US Department of Energy Office of Science, the single largest supporter of basic research in the physical sciences in the United States. In support of the Office of Science programs, ESnet regularly updates and refreshes its understanding of the networking requirements of the instruments, facilities, scientists, and science programs that it serves. This focus has helped ESnet to be a highly successful enabler of scientific discovery for over 20 years. In August 2009 ESnet and the Office of High Energy Physics (HEP), of the DOE Office of Science, organized a workshop to characterize the networking requirements of the programs funded by HEP. The International HEP community has been a leader in data intensive science from the beginning. HEP data sets have historically been the largest of all scientific data sets, and the communty of interest the most distributed. The HEP community was also the first to embrace Grid technologies. The requirements identified at the workshop are summarized below, and described in more detail in the case studies and the Findings section: (1) There will be more LHC Tier-3 sites than orginally thought, and likely more Tier-2 to Tier-2 traffic than was envisioned. It it not yet known what the impact of this will be on ESnet, but we will need to keep an eye on this traffic. (2) The LHC Tier-1 sites (BNL and FNAL) predict the need for 40-50 Gbps of data movement capacity in 2-5 years, and 100-200 Gbps in 5-10 years for HEP program related traffic. Other key HEP sites include LHC Tier-2 and Tier-3 sites, many of which are located at universities. To support the LHC, ESnet must continue its collaborations with university and international networks. (3) While in all cases the deployed 'raw' network bandwidth must exceed the user requirements in order to meet the data transfer and reliability requirements, network engineering for trans-Atlantic connectivity is more complex than network engineering for intra-US connectivity. This is because transoceanic circuits have lower reliability and longer repair times when compared with land-based circuits. Therefore, trans-Atlantic connectivity requires greater deployed bandwidth and diversity to ensure reliability and service continuity of the user-level required data transfer rates. (4) Trans-Atlantic traffic load and patterns must be monitored, and projections adjusted if necessary. There is currently a shutdown planned for the LHC in 2012 that may affect projections of trans-Atlantic bandwidth requirements. (5) There is a significant need for network tuning and troubleshooting during the establishment of new LHC Tier-2 and Tier-3 facilities. ESnet will work with the HEP community to help new sites effectively use the network. (6) SLAC is building the CCD camera for the LSST. This project will require significant bandwidth (up to 30Gbps) to NCSA over the next few years. (7) The accelerator modeling program at SLAC could require the movement of 1PB simulation data sets from the Leadership Computing Facilities at Argonne and Oak Ridge to SLAC. The data sets would need to be moved overnight, and moving 1PB in eight hours requires more than 300Gbps of throughput. This requirement is dependent on the deployment of analysis capabilities at SLAC, and is about five years away. (8) It is difficult to achieve high data transfer throughput to sites in China. Projects that need to transfer data in or out of China are encouraged to deploy test and measurement infrastructure (e.g. perfSONAR) and allow time for performance tuning.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Interdisciplinary Research Collaborative Trains Students to See Through Turbulent Systems

Despite the availability of interdisciplinary academic training programs, the practice of environmental science is often hampered by a lack of convergence across diverse disciplines. This gap is particularly salient in settings characterized by complex environmental issues, such as multiple-use coastal ecosystems. In response, we developed and implemented a training, research, and communication framework to provide undergraduates with an authentic operative experience working at the interface of interdisciplinary science and public decision-making within a case study of marine renewable energy. In our program, students gained hands-on experience with the scientific process and learned how to make information relevant, useful, and accessible to diverse stakeholder groups. Application of this framework demonstrates that the process of integrating data from biological (visual and acoustic monitoring of fish and marine mammals), physical (hydrodynamics), and social (local ecological knowledge) sciences can provide a more complete understanding of complex and turbulent ecosystems for better informed decision-making. We offer several recommendations to facilitate the adaptation and implementation of our interdisciplinary framework to diverse research contexts, with a focus on interdisciplinary training for the next generation of marine scientists.

54 ENVIRONMENTAL SCIENCES↗

Management and Storage of Scientific Data

Scientific discoveries rely heavily on efficient access, search, and management of massive data sets. Data management technologies have, for decades, provided foundational capabilities for scientific computing. Just as storage, input/output (I/O), and data management have been fundamental to simulation-based science for many years, so too are capable data-management technologies key to the success of today’s scientific workflows utilizing data intensive and machine learning (ML) techniques. The Department of Energy, Office of Science, Advanced Scientific Computing Research (ASCR) program has invested broadly in data-management research focused on high-performance computing (HPC) systems, from parallel file systems that store data to application software that makes these systems more productive. Still, advances in technology combined with growing diversity of supported science strongly motivate continued investment in this area. In January 2022, ASCR convened a workshop to identify priority research directions in the area of data management for high-performance and scientific computing. Attendees were challenged to identify promising approaches that would support the breadth of the DOE mission, including the explosion of artificial intelligence (AI) uses and the growing needs of experimental and observational science. Technological and science drivers were identified and considered as they relate to key aspects of data management such as interfaces, architectural design, and FAIR principles (Findable, Accessible, Interoperable, and Reusable). The thoughts of the workshop participants were distilled into a set of four priority research directions with the potential for high impact on DOE science. These research directions are summarized in the following pages.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Nuclear Smuggling Detection and Deterrence FY 2016 Data Analysis Annual Report

The National Nuclear Security Administration’s Office of Nuclear Smuggling Detection and Deterrence (NSDD) has facilitated the installation of more than 3,500 radiation portal monitors (RPMs) at 606 sites in 56 countries worldwide. This collection of RPMs represents the world’s largest network of radiation detectors and provides one element in the defense-in-depth approach that supports the Global Nuclear Detection Architecture. These systems support NSDD’s mission to build partner country capability to deter, detect, and interdict the illicit transport of radiological and fissile material through strategic points of entry and exit at seaports, airports, and border crossings. NSDD works collaboratively with partner countries and international organizations to optimize the operation of these RPMs. The large amount of data provided by NSDD partner countries highlights the close cooperation and partnerships NSDD has built with 56 countries around the world. Thirty-seven of these countries shared at least some RPM-related data with NSDD in fiscal year 2016. This significant level of data sharing is a key element that distinguishes the NSDD office as unique among nuclear nonproliferation programs and initiatives: NSDD can provide specific, objective, data-driven decisions and support for sustaining the radiation detection systems it helped deploy. This data analysis report summarizes and aggregates the RPM data provided to the NSDD office for analysis and review in fiscal year 2016. The data can be used to describe RPM performance and characterize the wide diversity of NSDD deployment sites. For example, NSDD deploys detector systems across sites with natural background radiation levels that can vary by a factor of approximately six from site to site. Some lanes have few occupancies, whereas others have approximately 8,000 occupancies per day and the different types of cargo that travel through a site can result in site-wide alarm rates that range from near 0% at some sites to above 3% at others. Based on the data received, the global average uptime for NSDD RPMs was above 96% for fiscal year 2016. NSDD takes all of these factors into account in making recommendations to partner countries on how to most effectively manage and maintain site operations. NSDD utilizes reports and other information products created by data analysts to efficiently allocate the resources needed to detect and ultimately interdict illicit nuclear and radiological material.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Flight Acoustics Measurement Techniques and Applications

Careful consideration must be given to data acquisition and analysis techniques in the design of experiments for the measurement of noise generated by flight vehicles. Although noise measurement locations and data reduction procedures are specified for aircraft certification by FAA and ICAO directives, for example, there are virtually no established procedures for aircraft noise measurement for other purposes. To optimize the quality and quantity of information obtained in a flight acoustics experiment, microphone layout, data acquisition, and analysis must be tailored to the specific test objective. This paper will review flight acoustics technology at NASA Langley Research Center developed over the past decade. In particular, the paper will focus on flight experiments performed for three diverse objectives: (1) research applications, such as noise prediction code validation, (2) noise impact modeling, and (3) noise abatement flight procedures. To best achieve these diverse objectives, different deployments of microphone systems on the ground are required, and different data analysis techniques are needed. In all cases, accurate positioning of the aircraft synchronized in time with the data recording is necessary. However, there are some restrictions on flight operations unique to each case for the methods to properly work.

Preisser, J. S.↗

Understory plant communities and the functional distinction between savanna trees, forest trees, and pines

Although savanna trees and forest trees are thought to represent distinct functional groups with different effects on ecosystem processes, few empirical studies have examined these effects. In particular, it remains unclear if savanna and forest trees differ in their ability to coexist with understory plants, which comprise the majority of plant diversity in most savannas. We used structural equation modeling (SEM) and data from 157 sites across three locations in the southeastern United States to understand the effects of broadleaf savanna trees, broadleaf forest trees, and pine trees on savanna understory plant communities. After accounting for underlying gradients in fire frequency and soil moisture, abundances (i.e., basal area and stem density) of forest trees and pines, but not savanna trees, were negatively correlated with the cover and density (i.e., local-scale species richness) of C4 graminoid species, a defining savanna understory functional group that is linked to ecosystem flammability. In analyses of the full understory community, abundances of trees from all functional groups were negatively correlated with species density and cover. For both the C4 and full communities, fire frequency promoted understory plants directly, and indirectly by limiting forest tree abundance. There was little indirect influence of fire on the understory mediated through savanna trees and pines, which are more fire tolerant than forest trees. We conclude that tree functional identity is an important factor that influences overstory tree relationships with savanna understory plant communities. In particular, distinct relationships between trees and C4 graminoids have implications for grass-tree coexistence and vegetation-fire feedbacks that maintain savanna environments and their associated understory plant diversity.

60 APPLIED LIFE SCIENCES↗

Data-Efficient Methods for Determining Flory–Huggins χ Parameters in Multicomponent Polymer Formulations

Polymer formulations are essential in diverse applications including personal care products, coatings, paints, adhesives, and plastic materials. Designing these formulations requires navigating large, complex design spaces, where phase and self-assembly behavior critically impact performance. The Flory–Huggins χ parameter, which quantifies segmental miscibility, is widely used to parametrize the excess free energy of mixing in formulation models. In this work, we introduce two data-efficient, top-down methods for estimating χ parameters using the Random Phase Approximation (RPA): (i) Boundary Nonlinear Regression (Boundary-NLR), which fits theoretical spinodal boundaries to experimental phase boundaries, and (ii) Surrogate Model Inverse Parameter Estimation (SMIPE), which uses a Gaussian Process Classifier to fit sparse phase maps via a surrogate model. Both methods allow rapid parametrization of polymer field-theoretic models without the need for additional experiments. We evaluate these approaches on data sets involving polymer–solvent–nonsolvent ternary mixtures and block copolymer–solvent systems, demonstrating their robustness to experimental noise and their relevance for real-world formulation design.

copolymers↗

Expansion of the Human Phenotype Ontology (HPO) knowledge base and resources

The Human Phenotype Ontology (HPO)––a standardized vocabulary of phenotypic abnormalities associated with 7000+ diseases––is used by thousands of researchers, clinicians, informaticians and electronic health record systems around the world. Its detailed descriptions of clinical abnormalities and computable disease definitions have made HPO the de facto standard for deep phenotyping in the field of rare disease. The HPO’s interoperability with other ontologies has enabled it to be used to improve diagnostic accuracy by incorporating model organism data. It also plays a key role in the popular Exomiser tool, which identifies potential disease-causing variants from whole-exome or whole-genome sequencing data. Since the HPO was first introduced in 2008, its users have become both more numerous and more diverse. To meet these emerging needs, the project has added new content, language translations, mappings and computational tooling, as well as integrations with external community data. The HPO continues to collaborate with clinical adopters to improve specific areas of the ontology and extend standardized disease descriptions. The newly redesigned HPO website (www.human-phenotypeontology.org) simplifies browsing terms and exploring clinical features, diseases, and human genes.

59 BASIC BIOLOGICAL SCIENCES↗

A Concept of Operations for Earth Science Data Archive and Distribution in the Cloud

Science data systems can enable more comprehensive Earth system research by evolving to take advantage of advances in commercial computer technology services. Since their inception twenty five years ago, NASA's Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs) have periodically evolved to utilize new technology and expand research using the exponential growth and diversity of Earth observations. Recently, with the advent of a maturing commercial compute services industry and upcoming high data volume missions such as the Surface Water and Ocean Topography (SWOT) mission and the NASA-Indian Space Research Organization Synthetic Aperture Radar (NISAR) mission, options were explored and a decision made to utilize commercial compute and storage services. This paper presents an overview of the concept of operations under development for the DAACs in the Cloud. We highlight the goals and expected advantages of utilizing Cloud services. We outline EOSDIS operations tenets and driving principles. A high-level view of EOSDIS system of systems target architecture serves as context for describing principle interactions. Concepts for key DAAC system and EOSDIS enterprise functions characterize automated end-to-end operations but mark nominal check and recovery points. Concepts are presented for managing Cloud resources, including organizational roles and responsibilities of the NASA project and DAAC personnel. Scenarios we use to further distinguish between what the system will do and what configuration and controls operators will have. Examples include interactions with data providers and data consumers with both in-cloud and on-premise facilities.

Moses, John F.↗

Nuclear Smuggling Detection and Deterrence (FY 2018 Data Analysis Annual Report)

The National Nuclear Security Administration’s Office of Nuclear Smuggling Detection and Deterrence (NSDD) has facilitated the installation of more than 3,728 radiation portal monitors (RPMs) at 660 sites in 63 countries. This collection of RPMs represents the world’s largest network of radiation detectors and provides one element of the defense-in-depth approach that supports the Global Nuclear Detection Architecture. These systems support NSDD’s mission to build partner country capability to deter, detect, and interdict the illicit transport of radiological and fissile material through strategic points of entry and exit at seaports, airports, and border crossings.NSDD works collaboratively with partner countries and international organizations to optimize the operation of these RPMs. The large amount of data provided by NSDD partner countries (summarized in the banner to the right) highlights the close cooperation and partnerships NSDD has built with 63 countries around the world. Thirty-two of these countries shared at least some RPM-related data with NSDD in fiscal year (FY) 2018. This significant level of data sharing is a key element that distinguishes the NSDD office as unique among nuclear nonproliferation programs and initiatives: NSDD can provide specific, objective, data-driven decisions and support for sustaining the radiation detection systems it helped deploy. This data analysis report summarizes and aggregates the RPM data provided to the NSDD office for analysis and review in FY 2018.The data can be used to describe RPM performance and characterize the wide diversity of NSDD deployment sites. For example, NSDD deploys detector systems across sites with natural background radiation levels that can vary by a factor of up to nine from site to site. Some RPM lanes have few occupancies, whereas others have up to approximately 8,000 occupancies per day, and the different types of cargo traveling through a site can result in site-wide alarm rates that range from near 0% at some sites to above 3% at others. Based on the data received, the global average uptime for NSDD RPMs was 97% for FY 2018. NSDD takes all these factors into account in making recommendations to partner countries on how to most effectively manage and maintain site operations. NSDD utilizes reports and other information products created by ORNL Radiation Inspection Systems Team (RIST) data analysts to efficiently allocate the resources needed to detect and ultimately interdict illicit nuclear and radiological material.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Prediction of softening kinetics and recrystallization texture in non-isothermally annealed bulged tubes using CPFEM and CA models

A hierarchically coupled cellular automata (CA) model, crystal plasticity finite element method (CPFEM), and thermal finite element (FE) model is developed to predict the softening kinetics of the bulged steel tube during non-isothermal annealing. Through the developed model, the kinetics of softening mechanisms including static recovery (SRV) and static recrystallization (SRX), as well as the recrystallization texture are predicted. Later, the Johnson-Mehl-Avrami-Kohnogorov (JMAK) model based on the predicted SRX data is developed to interpret the recrystallization behavior of the material. To perform this study, diverse experimental tests including tube hydroforming (THF), annealing, uniaxial tensile test, hardness test, as well as microstructure observations through optical microscopy and Electron Backscatter Diffraction (EBSD) tests on steel tube are performed. The obtained experimental data are utilized to calibrate and verify the implemented CPFEM model for simulation of THF process, thermal FE model for prediction of the local temperature over annealing time, and CA algorithm for modeling of the softening kinetics and texture evolution throughout the annealing process. The study shows that the predicted deformation characteristics, softening kinetics, recrystallization texture and temperature profile during non-isothermal annealing are in good agreement with experimental data. During the annealing process, a total of four stages for the kinetics of softening mechanisms is observed: No softening; SRV only; SRV dominant; and SRX dominant. During the progress of SRX, the behavior of recrystallization is abruptly changed, confirming that two different mechanisms are controlling the kinetics of transformation.

36 MATERIALS SCIENCE↗

An Agent-Based Interface to Terrestrial Ecological Forecasting

The latest generation of NASA Earth Observing System (EOS) satellites has brought a new dimension to continuous monitoring of the living part of the Earth System, the biosphere. EOS data can now provide weekly global measures of vegetation productivity and ocean chlorophyll, and many related biophysical factors such as land cover changes or snowmelt rates. However, the highest economic value would come from forecasting impending conditions of the biosphere, to allow decision makers to mitigate dangers or exploit positive trends. NASA's strategic plan for the Earth Science Enterprise i d e n a s ecological forecasting as a focus for research. Ecological forecasting predicts the effects of changes in the physical, chemical and biological environment on ecosystem activity. Possible applications of such a system include predicting shortfalls or bumper crops of agricultural production, populations of threatened or invasive species or wildfire danger in time to allow improves preparation and logistical efficiency. Petabytes of remote sensing data are now available to help measure, understand and forecast changes in the Earth system, but using these data effectively can be surprisingly hard. The volume and variety of data files and formats are daunting. Simple data management activities, such as locating and transferring files, changing file formats, gridding point data, and scaling and reprojecting gridded data, can consume far more personnel time and resources than the actual data analysis. Some scientists commit to a particular data source or resolution just because using anything different would be more effort that it's worth. Better tools can help, but most of the tools developed to date are little more than shell scripts; they lack the flexibility to meet the diverse needs of users and are difficult to extend to handle changes in available data sources.

Golden, Keith↗