Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Data-Intensive Science meets Inquiry-Driven Pedagogy: Interactive Big Data Exploration, Threshold Concepts, and Liminality

Threshold concepts in any discipline are the core concepts an individual must understand in order to master a discipline. By their very nature, these concepts are troublesome, irreversible, integrative, bounded, discursive, and reconstitutive. Although grasping threshold concepts can be extremely challenging for each learner as s/he moves through stages of cognitive development relative to a given discipline, the learner's grasp of these concepts determines the extent to which s/he is prepared to work competently and creatively within the field itself. The movement of individuals from a state of ignorance of these core concepts to one of mastery occurs not along a linear path but in iterative cycles of knowledge creation and adjustment in liminal spaces - conceptual spaces through which learners move from the vaguest awareness of concepts to mastery, accompanied by understanding of their relevance, connectivity, and usefulness relative to questions and constructs in a given discipline. For example, challenges in the teaching and learning of atmospheric science can be traced to threshold concepts in fluid dynamics. In particular, Dynamic Meteorology is one of the most challenging courses for graduate students and undergraduates majoring in Atmospheric Science. Dynamic Meteorology introduces threshold concepts - those that prove troublesome for the majority of students but that are essential, associated with fundamental relationships between forces and motion in the atmosphere and requiring the application of basic classical statics, dynamics, and thermodynamic principles to the three dimensionally varying atmospheric structure. With the explosive growth of data available in atmospheric science, driven largely by satellite Earth observations and high-resolution numerical simulations, paradigms such as that of dataintensive science have emerged. These paradigm shifts are based on the growing realization that current infrastructure, tools and processes will not allow us to analyze and fully utilize the complex and voluminous data that is being gathered. In this emerging paradigm, the scientific discovery process is driven by knowledge extracted from large volumes of data. In this presentation, we contend that this paradigm naturally lends to inquiry-driven pedagogy where knowledge is discovered through inductive engagement with large volumes of data rather than reached through traditional, deductive, hypothesis-driven analyses. In particular, data-intensive techniques married with an inductive methodology allow for exploration on a scale that is not possible in the traditional classroom with its typical problem sets and static, limited data samples. In addition, we identify existing gaps and possible solutions for addressing the infrastructure and tools as well as a pedagogical framework through which to implement this inductive approach.

Ramachandran, Rahul↗
DOE OSTI2021

Science Capsule - Capturing the Data Life Cycle

The data generated from scientific workflows often become unusable due to the lack or incompleteness of information required for processing and analyzing the data. Reproducibility of scientific data and workflows facilitates efficient processing and analyses. A key to enabling reproducibility is to capture the end-to-end workflow life cycle, and any contextual metadata and provenance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
NASA NTRS1983

NASA's computer science research program

Following a major assessment of NASA's computing technology needs, a new program of computer science research has been initiated by the Agency. The program includes work in concurrent processing, management of large scale scientific databases, software engineering, reliable computing, and artificial intelligence. The program is driven by applications requirements in computational fluid dynamics, image processing, sensor data management, real-time mission control and autonomous systems. It consists of university research, in-house NASA research, and NASA's Research Institute for Advanced Computer Science (RIACS) and Institute for Computer Applications in Science and Engineering (ICASE). The overall goal is to provide the technical foundation within NASA to exploit advancing computing technology in aerospace applications.

Larsen, R. L.↗
DOE OSTI2017

Software Defined Cyberinfrastructure

Within and across thousands of science labs, researchers and students struggle to manage data produced in experiments, simulations, and analyses. Largely manual research data lifecycle management processes mean that much time is wasted, research results are often irreproducible, and data sharing and reuse remain rare. In response, we propose a new approach to data lifecycle management in which researchers are empowered to define the actions to be performed at individual storage systems when data are created or modified: actions such as analysis, transformation, copying, and publication. We term this approach software-defined cyberinfrastructure because users can implement powerful data management policies by deploying rules to local storage systems, much as software-defined networking allows users to configure networks by deploying rules to switches.We argue that this approach can enable a new class of responsive distributed storage infrastructure that will accelerate research innovation by allowing any researcher to associate data workflows with data sources, whether local or remote, for such purposes as data ingest, characterization, indexing, and sharing. We report on early experiments with this approach in the context of experimental science, in which a simple if-trigger-then-action (IFTA) notation is used to define rules.

Foster, Ian↗
DOE OSTI2014

Data-Model Needs for Belowground Ecology. A Summary Report from the Terrestrial Ecosystem Science (TES) Mini-Workshop, May 8, 2014

Terrestrial life on Earth depends on belowground cycling and storage of a significant portion of the planet’s biologically-active carbon. The interplay among organic inputs by primary producers, soil organic matter stabilization, and assimilation and mineralization by soil organisms drives belowground ecology. Understanding belowground carbon dynamics, including the stability and vulnerability of soil organic carbon stocks, is necessary to project the responses and feedbacks of terrestrial ecosystems to a changing climate. Although conceptually understood, belowground hydrobiogeochemical systems are not well characterized with quantitative and mechanistic representations of critical functions. As a result, these systems are inadequately represented in modeling efforts, limiting our ability to understand and project terrestrial carbon source/sink relationships at various temporal and spatial scales. The belowground science community lacks robust databases and data libraries against which model sensitivities and performance can be tested and enhanced. Improved understanding of belowground ecosystems, including biotic and abiotic interactions, is needed to ensure that model structures include and provide adequate representations of critical belowground processes, functions, and dynamics. A one-day workshop brought together experimental and modeling representatives from the four Department of Energy (DOE) National Laboratories where the Office of Biological and Environmental Research (BER) Terrestrial Ecosystem Science (TES) program has investments in belowground ecology. The group focused on identifying and characterizing (1) critical experimental and observational datasets for testing and developing existing and future belowground-process models and land models; (2) the limitations and needs for modeling belowground processes within ecosystem models; and (3) key areas for leveraging current research activities across the National Laboratories and BER-funded projects. Discussion results are organized in this report as: (I) over-arching data requirements for advancing understanding of belowground ecosystems; (II) efforts that could rapidly improve understanding and model representations of belowground components of terrestrial ecosystems; and (III) longer-term research needs that would benefit from greater and more sustained support.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

EMP, Attachment 2: Data Management Plan

This Data Management Plan (DMP) is an attachment to the Pacific Northwest National Laboratory Environmental Radiological Air Monitoring Plan (EMP). PNNL is a U.S. Department of Energy Office of Science national laboratory. Radioactive effluent monitoring and environmental surveillance for PNNL operations in Washington State are the responsibility of the PNNL Environmental Protection and Regulatory Programs division and are conducted by the Environmental Radiation Task staff. This DMP describes the data management processes for PNNL radioactive air emissions (stack) monitoring and environmental radiological ambient air surveillance activities.

40 CFR 61 Subpart H↗
DOE OSTI2022

Can machine learning accelerate process understanding and decision‐relevant predictions of river water quality?

Abstract The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub‐daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state‐of‐the art applications of ML for water quality models and discuss opportunities to improve the use of ML with emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model‐data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge‐guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision‐relevant predictions of riverine water quality.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Book Review: Reiner Salzer and Heinz W. Siesler (Eds.): Infrared and Raman spectroscopic imaging, 2nd ed.

This second edition of "Infrared and Raman Spectroscopic Imaging" propels practitioners in that wide-ranging field, as well as other readers, to the current state of the art in a well-produced and full-color, completely revised and updated, volume. This new edition chronicles the expanded application of vibrational spectroscopic imaging from yesterday's time-consuming point-by-point buildup of a hyperspectral image cube, through the improvements afforded by the addition of focal plane arrays and line scan imaging, to methods applicable beyond the diffraction limit, instructs the reader on the improved instrumentation and image and data analysis methods, and expounds on their application to fundamental biomedical knowledge, food and agricultural surveys, materials science, process and quality control, and many others.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

First Constraint on Atmospheric Millicharged Particles with the LUX-ZEPLIN Experiment

We report on a search for millicharged particles (mCPs) produced in cosmic ray atmospheric interactions using data collected during the first science run of the LUX-ZEPLIN experiment. The mCPs produced by two processes—meson decay and proton bremsstrahlung—are considered in this study. This search utilized a novel signature unique to liquid xenon (LXe) time projection chambers, allowing sensitivity to mCPs with masses ranging from 10 to 1000 MeV/c 2 and fractional charges between 0.001 and 0.02 of the electron charge (𝑒). With an exposure of 60 live days and a 5.5 metric ton fiducial mass, we observed no significant excess over background. This represents the first experimental search for atmospheric mCPs and the first search for mCPs using an underground LXe experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2016

Storage and Read-Optimized Data Placement Structures for High-Performance Analysis [Book Chapter]

Here, we present state-of-art structures and methods for efficient data preparation and representation for analysis. Our intent is to introduce the data science and analytics communities to open source data placements, structures, and methods. These practices can make the foundational processes of data preparation and access dramatically more efficient than typical raw file or database representations and use more conservative storage. To illustrate this, we introduce two highly efficient data placement structures. We then present a tutorial, supported by step-by-step examples, of how to create, use, and access data, structured by Parquet or ORC (Optimized Row Columnar), using Apache Spark. Finally, we illustrate the benefits of using these structures with computational and storage volume benchmarks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A perspective on Bayesian methods applied to materials discovery and design

For more than two decades, there has been increasing interest in developing frameworks for the accelerated discovery and design of novel materials that could enable promising and transformative technologies. The Integrated Computational Materials Engineering (ICME) program called for integrating computational tools to establish linkages along process-structure-property-performance (PSPP) chains. The Materials Genome Initiative called for integrating experiments and computations within data science frameworks as a strategy to accelerate the materials development cycle. While these frameworks and paradigms have been quite influential, traditional ICME or data science-based approaches tend to have some limitations, mainly when querying the materials space is costly and very little information is available. Bayesian methods are more suitable in this context due to their efficiency gains. To this end, the materials discovery problem is framed as a Bayesian Optimization (BO). Different examples in which BO has been applied to solve materials discovery problems are presented. The methods/examples discussed include BO under model uncertainty, multi-information source BO, multi-objective and multi-constraint BO, and batch BO. Bayesian Materials Discovery is a promising area of research that is likely to become more influential as more attention is put on autonomous materials discovery platforms. Therefore, a discussion is provided on the potential development of such methods to increase the ability of existing platforms in materials discovery. Here, the ultimate goal is to pave the way to autonomous materials discovery.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Long Range Plan: Dense matter theory for heavy-ion collisions and neutron stars

Since the release of the 2015 Long Range Plan in Nuclear Physics, major events have occurred that reshaped our understanding of quantum chromodynamics (QCD) and nuclear matter at large densities, in and out of equilibrium. The US nuclear community has an opportunity to capitalize on advances in astrophysical observations and nuclear experiments and engage in an interdisciplinary effort in the theory of dense baryonic matter that connects low- and high-energy nuclear physics, astrophysics, gravitational waves physics, and data science. This is a white paper prepared by a group of nuclear physicists during the 2023 LRP process.

Lovato, Alessandro↗
NASA NTRS1966

Mariner-Mars science subsystem

Mariner-Mars science subsystem - cosmic ray telescope, cosmic dust detector, trapped radiation detector, ionization chamber, plasma probe, magnetometer, and data processing

MARINER IV SPACE PROBE↗
NASA NTRS1983

Reduction and analysis of data from the plasma wave instruments on the IMP-6 and IMP-8 spacecraft

The primary data reduction effort during the reporting period was to process summary plots of the IMP 8 plasma wave data and to submit these data to the National Space Science Data Center. Features of the electrostatic noise are compared with simultaneous observations of the magnetic field, plasma and energetic electrons. Spectral characteristics of the noise and the results of this comparison both suggest that in its high frequency part at least the noise does not belong to normal modes of plasma waves but represents either quasi-thermal noise in the non-Maxwellian plasma or artificial noise generated by spacecraft interaction with the medium.

Gurnett, D. A.↗
NASA NTRS1995

Research & Technology Report Goddard Space Flight Center

The main theme of this edition of the annual Research and Technology Report is Mission Operations and Data Systems. Shifting from centralized to distributed mission operations, and from human interactive operations to highly automated operations is reported. The following aspects are addressed: Mission planning and operations; TDRSS, Positioning Systems, and orbit determination; hardware and software associated with Ground System and Networks; data processing and analysis; and World Wide Web. Flight projects are described along with the achievements in space sciences and earth sciences. Spacecraft subsystems, cryogenic developments, and new tools and capabilities are also discussed.

Soffen, Gerald A.↗
NASA NTRS2000

Climatological Processing of Radar Data for the TRMM Ground Validation Program

The Tropical Rainfall Measuring Mission (TRMM) satellite was successfully launched in November, 1997. The main purpose of TRMM is to sample tropical rainfall using the first active spaceborne precipitation radar. To validate TRMM satellite observations, a comprehensive Ground Validation (GV) Program has been implemented. The primary goal of TRMM GV is to provide basic validation of satellite-derived precipitation measurements over monthly climatologies for the following primary sites: Melbourne, FL; Houston, TX; Darwin, Australia; and Kwajalein Atoll, RMI. As part of the TRMM GV effort, research analysts at NASA Goddard Space Flight Center (GSFC) generate standardized TRMM GV products using quality-controlled ground-based radar data from the four primary GV sites as input. This presentation will provide an overview of the TRMM GV climatological processing system. A description of the data flow between the primary GV sites, NASA GSFC, and the TRMM Science and Data Information System (TSDIS) will be presented. The radar quality control algorithm, which features eight adjustable height and reflectivity parameters, and its effect on monthly rainfall maps will be described. The methodology used to create monthly, gauge-adjusted rainfall products for each primary site will also be summarized. The standardized monthly rainfall products are developed in discrete, modular steps with distinct intermediate products. These developmental steps include: (1) extracting radar data over the locations of rain gauges, (2) merging rain gauge and radar data in time and space with user-defined options, (3) automated quality control of radar and gauge merged data by tracking accumulations from each instrument, and (4) deriving Z-R relationships from the quality-controlled merged data over monthly time scales. A summary of recently reprocessed official GV rainfall products available for TRMM science users will be presented. Updated basic standardized product results and trends involving monthly accumulation, Z-R relationship, and gauge statistics for each primary GV site will be also displayed.

Kulie, Mark↗
NASA NTRS2001

Lessons from Adaptive Level One Accelerator (ALOA) System Implementation

The Adaptive Level One Accelerator (ALOA) system was developed as part of the Earth Science Data and Information System (ESDIS) project. The reconfigurable computing technologies were investigated for Level 1 satellite telemetry data processing to achieve computing acceleration and cost reduction for the next-generation Level 1 data processing systems. The MODIS instrument calibration algorithm was implemented using reconfigurable a computer. The system development process and the lessons learned throughout the design cycle are summarized in this paper.

Patel, Umesh D.↗
NASA NTRS2003

NASA's Scientific Agenda for GPM Mission

The objectives of the Global Precipitation Measurement (GPM) Mission are to: 1) Understand the horizontal and vertical structure of rainfall, its macro- and micro-physical nature, and its associated latent heating, 2) Train and calibrate retrieval algorithms for constellation radiometers, 3) Provide sufficient global sampling to significantly reduce uncertainties in short-term rainfall accumulations, and 4) Extend scientific and societal applications. The GPM mission design consists of a core satellite, constellation satellties, precipitation validation sites for error characterization, and a precipitation processing center. This viewgraph presentation profiles the science goals of the mission, and its capability for producing climate data and weather predictions.

Smith, Eric A.↗