Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Advanced Air Mobility and Safety Management Systems

Our current air transportation system has underserved markets, including local, regional, intraregional, and urban transportation of both people and cargo. Recent advances in aviation technology such as small highly-automated vehicles, electric aircraft, and automated air traffic are enabling business opportunities in these markets. Advanced Air Mobility, or AAM, refers to a community effort to overcome the gaps in operational rules, safety analysis, and overall acceptance, so that these new operations will be possible. For full details, please see: https://www.nasa.gov/aam As we think about how we can safely introduce these new operations, fundamental questions about how the structure of Safety Management Systems can be applied to AAM, and how that structure can be used to help us overcome the necessary technical and societal obstacles arise. Two of these questions are: • How do we tailor the requirements and desired level of monitoring and assessment to achieve safety given the breadth of possible operations and the associated risk of those operations? • How do we aid innovation by rapidly evaluating the safety of novel operations without losing associated rigor? We assume that a Safety Management System that enables these future systems will incorporate knowledge of the acceptable level of risk, and will utilize data science to automate the core monitor, assess and mitigate functions that will allow us to respond to risks and hazards in time to prevent safety incidents. In 2018, the National Academies proposed an In-Time Aviation Safety Management System (IASMS) that would advance these goals. (https://www.nap.edu/catalog/24962/in-time-aviation-safety-management-challenges-and-research-for-an) The National Academies made a clear distinction between in-time systems, in which hazards could be identified and risks mitigated in time to prevent incidents, and real-time systems, since many hazards and risks do not need real-time data and analysis to detect and mitigate.

In-Time Aviation Safety Management System↗
DOE OSTI2020

LDM-148: Rubin Observatory Data Management System Design

The Rubin Observatory LSST Data Management System (DMS) is a set of services employing a variety of software components running on computational and networking infrastructure that combine to deliver science data products to the observatory's users and support observatory operations. This document describes the components, their service instances, and their deployment environments as well as the interfaces among them, the rest of the LSST system, and the outside world.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1991

The Pilot Land Data System (PLDS) at the Ames Research Center manages aircraft data in collaboration with an ecosystem research project

The Pilot Land Data System (PLDS) is a data and information system serving NASA-supported investigators in the land science community. The three nodes of the PLDS, one each at the Ames Research Center (ARC), the Goddard Space Flight Center (GSFC) and the Jet Propulsion Laboratory (JPL), cooperate in providing consistent information describing the various data holding in the hardware and software (accessible via network and modem) that provide information about and access to PLDS-held data, which is available for distribution. A major new activity of the PLDS node at the Ames Research Center involves the interaction of the PLDS with an active NASA ecosystem science project, the Oregon Transect Ecosystems Research involves the management of, access to, and distribution of the large volume of widely-varying aircraft data collected by OTTER. The OTTER project, is managed by researchers at the Ames Research Center and Oregon State University. Its principal objective is to estimate major fluxes of carbon, nitrogen, and water of forest ecosystems using an ecosystem process model driven by remote sensing data. Ten researchers at NASA centers and universities are analyzing data for six sites along a temperature-moisture gradient across the western half of central Oregon (called the Oregon Transect). Sensors mounted on six different aircraft have acquired data over the Oregon Transect in support of the OTTER project.

Angelici, Gary↗
NASA NTRS2015

The Role of the NASA Global Hawk Link Module as an Information Nexus For Atmospheric Mapping Missions

The Link Module described in this paper was developed for the NASA Uninhabited Aerial System (UAS) Global Hawk Pacific Mission (GloPAC) Airborne Science Campaign; four flights of 30 hour duration, supporting the Aura Validation Experiment (AVE). It was used again during the Genesis and Rapid Intensification Processes (GRIP) experiment, a NASA Earth Science field experiment to better understand how tropical storms form and develop into major hurricanes. In these missions, the Link Module negotiated all communication over the high bandwidth Ku satellite link, archived all the science data from onboard experiments in a spatially enabled database, routed command and control of the instruments from the Global Hawk Operations Center, and re-transmitted select data sets directly to experimenters control and analysis systems. The availability of aggregated information from collections of sensors, and remote control capabilities, in real-time, is revolutionizing the way Airborne Science is being conducted. The Link Module NG now being flown in support of the NASA Earth Venture missions, the Hurricane and Severe Storm Sentinel (HS3) mission, and Airborne Tropical Tropopause Experiment (A TTREX) mission, has advanced data fusion technologies that are further advancing the Scientific productivity, flexibility and robustness of these systems. On-the-fly traffic shaping has been developed to allow the high definition video, used for critical flight control segments, to dynamically allocate variable bandwidth on demand. Historically, the Link Module evolved from the instrument and communication interface controller used by NASA's Pathfinder and Pathfinder plus solar powered UAS's in the late 1990' s. It later was expanded for use in the AIRDAS four channel scanner flown on the NASA Altus UAS, and then again to a module in the AMS twelve channel multispectral scanner flying on the NASA (Predator-b) Ikhana UAS. The current system is the answer to the challenges imposed by extremely long duration UASs, with on-board multi-instrument (>= 12) Sensor Webs.

Hurricanes↗
NASA NTRS1997

The HSCaRS Summer Enrichment Program; Research Opportunities for Minority and Women Undergraduates in Global Change Science

The primary objective of the HSCaRS Summer Enrichment Program (SEP) is to make significant contributions to the NASA Mission to Planet Earth (MTPE) and the Alabama A&M University (AAMU) Center for Hydrology, Soil Climatology and Remote Sensing (HSCaRS) research missions by providing undergraduate student research internships with an emphasis on minority and women students. Additional objectives are to encourage more minority and women students to pursue advanced degrees in Earth system and global change science and to increase the participation of minority institutions in the U.S. Global Change Research Program. Also, the SEP strives to make students in the traditional science disciplines more aware of the opportunities in Earth System Science. In designing the SEP, it was acknowledged that HSCaRS was a new research effort and Center. Consequently, students were not expected to immediately recognize the Center as one would older, more established research laboratories with national reputations, such as Los Alamos, Battelle, National Consortium for Atmospheric Research (NCAR), etc. Yet we still wanted to compete nationally for the best students. Therefore, we designed the program with a competitive financial package that includes a stipend of $400 per week, round-trip transportation from home to the summer research site, and free campus housing and meal plans provided by Alabama A&M University. Students also received a modest living allowance of approximately $25 per week. The internship program was 10 weeks in residence at Alabama A&M University or IGCRE, and gave students the opportunity to select from six general research areas: micro-meteorology, soil data analysis, soil moisture modeling, instrumentation, geographic information systems, and computer science. Student participants also enrolled in an introductory global change science course as part of the summer program (a copy of the course outline is in the appendix). The program included participation in a field program for approximately two weeks. All students were required to participate in the field program as a learning experience, regardless of the relationship of the field program to their majors or particular research project.

Estes, Jr., Maurice G.↗
DOE OSTI2021

A science paradigm shift is needed for Earth and Environmental Systems Sciences (EESS) to integrate Knowledge-Guided Artificial Intelligence (KGAI) and lead new EESS-KGAI theories

The focal area of this white paper is learning from complex data through the use of AI techniques and AI-derived model components. Specifically, we advocate for research programs to develop knowledge-guided AI (KGAI) in the Earth and Environmental Systems sciences (EESS) as a basic research paradigm that is separate from (but supports) any specific Earth system model, modeling components, and modeling workflows, and even separates from specific hypothesis-driven questions about individual Earth system processes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2000

The Use of HDTV Format and the Electronic Theater in Presenting Earth Science

In order to maximize the public's awareness of earth science observations, earth science data must be available in multiple media formats. This talk will focus on the use High Definition TV format in presenting earth science data, The Television (HDTV) networks are mandated to completely switch over from the current TV standard (NTSC) to HDTV in the next seven years. Museums are also beginning to use HDTV format in their displays. The Visualization Analysis Laboratory at Goddard Space Flight Center has been experimenting with the use of HDTV to present earth science data. The experimental package we have developed is called the Electronic Theater (e-theater). The e-theater is a mobile presentation system used for displaying and teaching groups about earth science and the delicate interdependence between the various earth systems. The e-theater takes advantage of a double-wide screen to show the audiences high resolution data displays. The unique architecture used in this exhibit allows several data sets to be displayed at one time, demonstrating the connections between different earth systems. The data animations are manipulated in real-time during the presentation and can be paused, moved forward, backward, looped, or zoomed into, to maximize the flexibility of the presentation. Because HDTV format is used within the e-theater, the materials generated for the e-theater are made available to the news media and museums.

Summey, Barbara↗
DOE OSTI2022

Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computing Facility (OLCF), however, we unveiled user behavior about the Summit supercomputer by collecting data from a user’s point of view with ordinary Unix commands.In this paper, we discuss the process, challenges, and lessons learned while preparing this dataset for publication and submission to an open data challenge. The original dataset contains personal identifiable information (PII) about the users of OLCF which needed be masked prior to publication, and we determined that anonymization, which scrubs PII completely, destroyed too much of the structure of the data to be interesting for the data challenge. We instead chose to pseudonymize the dataset, which reduced the linkability of the dataset to the users’ identities. Pseudonymization is significantly more computationally expensive than anonymization, and the size of our dataset, which is approximately 175 million lines of raw text, necessitated the development of a parallelized workflow that could be reused on different HPC machines. We demonstrate the scaling behavior of the workflow on two leadership class HPC systems at OLCF, and we show that we were able to bring the overall makespan time from an impractical 20+ hours on a single node down to around 2 hours. As a result of this work, we release the entire pseudonymized dataset and make the workflows and source code publicly available.

Maheshwari, Ketan↗
NASA NTRS2019

Data Preservation: Final Step in the Life Cycle of a Mission

Many NASA Earth Observing System (EOS) have either already reached the end of their active life or are nearing it. Preservmissionsation of data products is a fairly well defined task for the NASA EOS Data Centers or DAACs.The Goddard Earth Sciences Data and Information Services Center (GES-DISC) has implemented a repository system, which is capable of long-term archive of documentation artifacts and other associated digital content. The existing GES-DISC Repository System is based on Fedora Commons, an open-source repository management software, for cost savings and flexibility.The first mission to utilize the GES-DISC Repository System was the High Resolution Dynamics Limb Sounder (HIRDLS) on the Aura spacecraft. Since then, the GES DISC has gathered documentation from the UARS and TOMS into the Repository. The Microwave Limb Sounder (MLS) team has begun delivering some early pre-launch documents to the GES-DISC Repository System as well. Other missions in planning or progress include AIRS, OMI, SORCE, SNPP Sounder, and TRMM.

Johnson, J.↗
NASA NTRS2016

The Kepler Science Data Processing Pipeline Source Code Road Map

We give an overview of the operational concepts and architecture of the Kepler Science Processing Pipeline. Designed, developed, operated, and maintained by the Kepler Science Operations Center (SOC) at NASA Ames Research Center, the Science Processing Pipeline is a central element of the Kepler Ground Data System. The SOC consists of an office at Ames Research Center, software development and operations departments, and a data center which hosts the computers required to perform data analysis. The SOC's charter is to analyze stellar photometric data from the Kepler spacecraft and report results to the Kepler Science Office for further analysis. We describe how this is accomplished via the Kepler Science Processing Pipeline, including, the software algorithms. We present the high-performance, parallel computing software modules of the pipeline that perform transit photometry, pixel-level calibration, systematic error correction, attitude determination, stellar target management, and instrument characterization.

Kepler pipeline software↗
NASA NTRS2016

Making Connections: Where STEM Learning and Earth Science Data Services Meet

STEM (Science, Technology, Engineering, Mathematics) learning is most effective when students are encouraged to see the connections between science, technology and real world problems. Helping to make these connections has become an increasingly important aspect of Earth Science data research. The Global Hydrology Resource Center (GHRC), one of NASA's 12 EOSDIS (Earth Observing System Data Information System) data centers, has developed a new type of documentation called the micro article to facilitate making connections between data and Earth science research problems.

Micro articles↗
NASA NTRSDate not supplied

Mercury Trek: A New Online NASA Visualization and Analysis Portal

In its investigations of the planet Mercury, NASA’s MESSENGER returned an immense amount of data detailing the dynamic surface of our solar system’s innermost planet. As the European and Japanese space agencies prepared for the launch of BepiColombo, the next mission to explore Mercury, BepiColombo’s project science team asked NASA to produce a new portal within the Solar System Treks suite (https://trek.nasa.gov) featuring data returned by MESSENGER from Mercury. This new portal would be used both for mission planning and for public outreach by the BepiColombo mission. While initially populated with Messenger data, the portal is also being designed to facilitate visualization, analysis, and dissemination of data from BepiColombo after it commences science operations in orbit around Mercury. The initial release of the Mercury Trek in 2019 shortly followed the launch of BepiColombo on its journey to Mercury.

B. H. Day↗
DOE OSTI2023

UAS remote sensing (3DR SOLO platform): multispectral reflectance and normalized difference vegetation index, Seward Peninsula, Alaska, 2022

Airborne remote sensing data collected using a Parrot Sequoia+ multispectral sensor installed on a 3DR SOLO unoccupied aerial system (UAS) – operated by the Terrestrial Ecosystem Science & Technology group https://www.bnl.gov/envsci/testgroup/ at Brookhaven National Laboratory. This package includes data from 19 flights flown over the NGEE-Arctic, Kougarok Mile Marker (MM) 80, Kougarok Fire Complex (KFC) and Teller MM 27 sites in July 2022. Derived image products include point cloud, ortho-mosaiced multispectral image, a digital surface model (DSM) using the structure from motion (SfM) technique, and a normalized difference vegetation index (NDVI) map. Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.txt, *.json, *hdr,), tabular (*.dat, *.csv), point cloud (*.laz), Cloud Optimized GeoTIFF (COG, *.tif), and image (*.jpg, *.tif, *png) formats.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1998

Development of a Low Cost Data Acquisition System for the Solid Rocket Booster Program

The Space Transportation System's (STS) Solid Rocket Boosters (SRBs) experience a severe environment during their brief flight. During the last few years several SRB's have sustained noticeable structural damage. The environmental characteristics (vibration, structure, and thermal) encountered by the SRB's during ascent, descent and water impact are in most cases unknown. A developmental flight instrumentation (DFI) system collected data from the SRB's first four flights in the early 1980's, and after the first three flights during the shuttle return-to-flight phase after the Challenger accident. However, the DFI data collected are of low fidelity and do not correlate well with the observed structural damage. The DFI system was evaluated for reuse, but the cost to fly it was prohibitive. The STS is presently scheduled to fly until 2030. To support the STS schedule the avionics on SRB's will be upgraded. The environments on the different sections of the SRB will need to be defined to properly qualify the avionics for multiple flights. The DFI data previously gathered does not provide enough information to properly qualify the avionics. Marshall Space Flight Centers (MSFC) SRB Project Office requested the Science and Engineering Directorate to develop a self contained data acquisition system that could collect data from any area of the booster. This paper summarizes the effort to develop, test, qualify and fly an Enhanced Data Acquisition System (EDAS) using state-of-the-art commercial off the shelf (COTS) equipment. The first flight of this system occurred on shuttle mission STS-91 in June 1998.

Crawford, Kevin↗
DOE OSTI2023

System design and prototyping for the CMS Level-1 Trigger at the High-Luminosity LHC

For the High-Luminosity Large Hadron Collider, the trigger and data acquisition system of the CMS experiment will be entirely replaced. Novel design choices have been explored, including ATCA prototyping platforms with SoC controllers and newly available interconnect technologies with serial optical links with data rates up to 28 Gb/s. Trigger analyses will be performed through sophisticated algorithms, including widespread use of Machine Learning, in large FPGAs, such as the Xilinx Ultrascale family. The system will process over 50 Tb/s of detector data with an event rate of 750 kHz. Here, we describe system design and prototyping and review trigger algorithm exemplars.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1991

Data compression for data archival, browse or quick-look

Soon after space and Earth science data is collected, it is stored in one or more archival facilities for later retrieval and analysis. Since the purpose of the archival process is to keep an accurate and complete record of data, any data compression used in an archival system must be lossless, and protect against propagation of error in the storage media. A browse capability for space and Earth science data is needed to enable scientists to check the appropriateness and quality of particular data sets before obtaining the full data set(s) for detailed analysis. Browse data produced for these purposes could be used to facilitate the retrieval of data from an archival facility. Quick-look data is data obtained directly from the sensor for either previewing the data or for an application that requires very timely analysis of the space or Earth science data. Two main differences between data compression techniques appropriate to browse and quick-look cases, are that quick-look can be more specifically tailored, and it must be limited in complexity by the relatively limited computational power available on space platforms.

Dozier, Jeff↗
NASA NTRS2000

Development of a Vehicle Health Monitoring System for the Space Shuttle Solid Rocket Booster Program

During their brief flight, the space shuttle solid rocket boosters (SRBs) experience a severe environment. This environment in most cases is unknown. When the design engineers believe they understand the environments, something new occurs. For example, at water impact several SRBs have sustained noticeable structural damage. The severity of the damage is usually dependent upon the waves that the SRB encounter at splashdown. The space shuttle is presently scheduled to fly until 2030. To support the shuttle flight schedule, the avionics on the SRB's will need to be upgraded. The environments on the different sections of the SRB will need to be defined more completely to properly qualify the avionics for multiple flights. The combination of new avionics systems and unknown flight environments led Marshall Space Flight Center's (MSFC) SRB Project Office to request the Science and Engineering (S&E) Directorate to develop a stand-alone data acquisition system that could collect data from any area of the booster. The Enhanced Data Acquisition System (EDAS) was developed to meet this request. However, the EDAS has some technical drawbacks that needed resolved. To answer the EDAS problems, the SRB Project Office has funded MSFC's Avionics Department to begin investigating a new vehicle health monitoring (VHM) system. The major requirements are the system shall have 64 channels, have programmable sample rates up to 10,000 samples per second, have sufficient memory for a twenty minute flight and not interfere with existing operational flight avionics hardware. This paper will describe the effort to develop a VHM system that can meet the SRB requirements.

Crawford, Kevin↗
DOE OSTI2020

Data Federation Challenges in Remote Near-Real-Time Fusion Experiment Data Processing

Fusion energy experiments and simulations provide critical information needed to plan future fusion reactors. As next-generation devices like ITER move toward long-pulse experiments, analyses, including AI and ML, should be performed in a wide range of time and computing constraints, from near-real-time constraints, between-shot analysis, and to campaign-wide long-term analysis. However, the data volume, velocity, and variety make it extremely challenging for analyses using only local computational resources. Researchers need the ability to compose and execute workflows spanning edge resources to large-scale high-performance computing facilities.We present Delta, a system to address data analysis challenges, including AI/ML, in fusion science, by leveraging the ADIOS I/O library and middleware, to support executing science workflows over the wide area network for near-real-time streaming. We discuss the data federation challenges in performing remote workflows, focusing on on-going research work in (1) managing, reducing, and streaming data to minimize I/O and data movement overheads, (2) decompressing and reorganizing data for analysis, and (3) executing workflows for automated data analysis. We introduce examples for deep-learning based data analysis for the fusion domain and demonstrate how we use Delta to construct end-to-end workflows for a fusion device in Korea, connecting a remote DOE facility in the USA. The capability demonstrated by this project is the basis for improving the state of the art for near-real-time data federation amongst remote facilities.

Choi, Jong Youl↗