Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

New Earth Science Data and Access Methods

NASA's Earth Science Enterprise, working with its domestic and international partners, provides scientific data and analysis to improve life here on Earth. NASA provides science data products that cover a wide range of physical, geophysical, biochemical and other parameters, as well as services for interdisciplinary Earth science studies. Management and distribution of these products is administered through the Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs), which all hold data within a different Earth science discipline. This paper will highlight selected EOS datasets and will focus on how these observations contribute to the improvement of essential services such as weather forecasting, climate prediction, air quality, and agricultural efficiency. Emphasis will be placed on new data products derived from instruments on board Terra, Aqua and ICESat as well as new regional data products and field campaigns. A variety of data tools and services are available to the user community. This paper will introduce primary and specialized DAAC-specific methods for finding, ordering and using these data products. Special sections will focus on orienting users unfamiliar with DAAC resources, HDF-EOS formatted data and the use of desktop research and application tools.

Moses, John F.↗

Web-based Visualization and Analytics of Petascale Data: Equity as a Tide that Lifts All Boats

Scientists generate petabytes of data daily to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other environmental variables is essential to predicting and establishing root causes of future undesirable scenarios and assessing possible mitigation strategies. While supercomputer centers provide a powerful infrastructure for generating petabytes of simulation output, accessing and analyzing these datasets interactively remains challenging on multiple fronts. This paper presents an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. Our novel data fabric abstraction layer allows user-friendly querying of scientific information while hid-ing the complexities of dealing with file systems or cloud services.We also optimize network utilization while streaming from petas-cale repositories through state-of-the-art progressive compression algorithms. Based on this abstraction, we provide customizable dashboards that can be accessed from any device with any inter-net connection, enabling interactive visual analysis of vast amounts of data to a wide range of users - from top scientists with access to leadership-class computing environments to undergraduate students of disadvantaged backgrounds from minority-serving institutions. We focus on NASA’s use of petascale climate datasets as an example of particular societal impact and, therefore, a case where achieving equity in science participation is critical. We validate our approach by improving the ability of climate scientists to visually explore their data via two fully interactive dashboards. We further validate our approach by deploying the dashboards and simplified training materials in the classroom at a minority-serving institution.These dashboards, released in simplified form to the general public, contribute significantly to a broader push to democratize the access and use of climate data.

Data visualization↗

Marine Corps Base Camp Lejeune Avian Point Count Data 2011

Critical military training and testing on lands along the nation’s coastal and estuarine shorelines are increasingly placed at risk because of encroachment pressures in surrounding areas, impairments due to other anthropogenic disturbances, and changes in climate and sea level. The U.S. Department of Defense (DoD) intends to enhance and sustain its training and testing assets and also optimize its stewardship of natural resources through the development and application of an ecosystem-based management approach on DoD installations. To accomplish this goal, particularly for installations in estuarine/coastal environments, the Strategic Environmental Research and Development Program (SERDP) launched the Defense Coastal/Estuarine Research Program (DCERP) as a 10-year effort at Marine Corps Base Camp Lejeune (MCBCL) in North Carolina. The results of the second 5 years of the program (DCERP2) are presented in the DCERP2 Final Report.There were four overarching objectives of DCERP2. The first objective was to understand the effects of climate change impacts, including warming temperatures, variability in the hydrological cycle, storm events, and sea level rise on the coastal ecosystems at MCBCL from observations and measurements made over the 10-year program. The second objective was to understand the carbon cycle of the coastal and terrestrial ecosystems at MCBCL through a highly integrated sampling program. The third objective was to develop models, tools, and indicators to evaluate current and projected future ecosystem state changes and translate scientific findings into actionable information for installation managers. The last objective was to recommend adaptive management strategies to sustain ecosystem natural resources within the context of an active military installation.The census points were sampled in 2009 and again in 2010 and 2011 (2009 and 2010 data are in MARDIS). We used point counts to census birds following a methodology from Ralph et al. (1995) by Kirkpatrick et al. (2006). Surveys were conducted between April 10 and July 10 starting at sunrise and going no later than 10 a.m. (or 4 hours after dawn), on days without precipitation and with wind speeds less than 12 km/h (Ralph et al., 1995; Rosenstock et al., 2002). We recorded temperature (°C), wind speed (km/h), cloud cover, and background noise level. After initially arriving at a point, we waited for a 1-minute silent period, and then recorded any birds seen or heard for an 8-minute period (Farnsworth et 14-8 al., 2002; Rosenstock et al., 2002). We estimated the distance to each bird, using a Rangefinder whenever necessary (Buckland, 2001; Rosenstock et al., 2002).

54 ENVIRONMENTAL SCIENCES↗

Enabling real-time multi-messenger astrophysics discoveries with deep learning

Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravitational wave sources and their electromagnetic and astroparticle counterparts, and make a number of recommendations to maximize their potential for scientific discovery. These recommendations refer to the design of scalable and computationally efficient machine learning algorithms; the cyber-infrastructure to numerically simulate astrophysical sources, and to process and interpret multi-messenger astrophysics data; the management of gravitational wave detections to trigger real-time alerts for electromagnetic and astroparticle follow-ups; a vision to harness future developments of machine learning and cyber-infrastructure resources to cope with the big-data requirements; and finally, the need to build a community of experts to realize the goals of multi-messenger astrophysics.

79 ASTRONOMY AND ASTROPHYSICS↗

The genome portal of the Department of Energy Joint Genome Institute: 2014 updates

The U.S. Department of Energy (DOE) Joint Genome Institute (JGI), a national user facility, serves the diverse scientific community by providing integrated high-throughput sequencing and computational analysis to enable system-based scientific approaches in support of DOE missions related to clean energy generation and environmental characterization. The JGI Genome Portal (http://genome.jgi.doe.gov) provides unified access to all JGI genomic databases and analytical tools. The JGI maintains extensive data management systems and specialized analytical capabilities to manage and interpret complex genomic data. A user can search, download and explore multiple data sets available for all DOE JGI sequencing projects including their status, assemblies and annotations of sequenced genomes. In this paper, we describe major updates of the Genome Portal in the past 2 years with a specific emphasis on efficient handling of the rapidly growing amount of diverse genomic data accumulated in JGI.

59 BASIC BIOLOGICAL SCIENCES↗

Publications of the Jet Propulsion Laboratory, 1985

This bibliography describes and indexes by primary author the externally distributed technical reporting, released during calender year 1985, that resulted from scientific and engineering work performed, or managed, by the Jet Propulsion Laboratory. Three classes of publications are included: JPL publications in which the information is complete for a specific accomplisment; Articles from the quarterly Telecommunications and Data Acquisition (TDA) Progress Report; and article published in the open literature.

Source record↗

Publications of the Jet Propulsion Laboratory, 1988

This bibliography describes and indexes by primary author the externally distributed technical reporting, released during calendar year 1988, that resulted from scientific and engineering work performed, or managed, by the Jet Propulsion Laboratory. Three classes of publications are included: JPL publications in which the information is complete for a specific accomplishment; articles from the quarterly Telecommunications and Data Acquisition (TDA) Progress Report; and articles published in the open literature.

Source record↗

Overview of the Landsat-7 Mission

Landsat-7 is scheduled for launch on April 15 from the Western Test Range at Vandenberg Air Force Base, Calif., on a Delta-H expendable launch vehicle. The Landsat 7 satellite consists of a spacecraft bus being provided by Lockheed Martin Missiles and Space (Valley Forge, Pa.) and the Enhanced Thematic Mapper Plus instrument built by Raytheon (formerly Hughes) Santa Barbara Remote Sensing (Santa Barbara, Calif.). The instrument on board Landsat 7 is the Enhanced Thematic Mapper Plus (ETM+). ETM+ improves upon the previous Thematic Mapper (TM) instruments on Landsat's 4 and 5 (Fig. la and lb). It includes the previous 7 spectral bands measuring reflected solar radiation and emitted thermal emissions but, in addition, includes a new 15 in panchromatic (visible-near infrared) band. The spatial resolution of the thermal infrared band has also been improved to 60 m. Both the radiometric precision and accuracy of the sensor are also improved from the previous TM sensors. After being launched into a sun-synchronous polar orbit, the satellite will use on-board propulsion to adjust its orbit to a circular altitude of 438 miles (705 kilometers) crossing the equator at approximately 10 a.m. on its southward track. This orbit will place Landsat 7 along the same ground track as previous Landsat satellites. The orbit will be maintained with periodic adjustments for the life of the mission. A three-axis attitude control subsystem will stabilize the satellite and keep the instrument pointed toward the Earth to within 0.05 degrees. Later this year, plans call for the NASA Earth Observation System (EOS) Terra (AM-1) observatory and the experimental EO-1 mission to closely follow Landsat-7's orbit to support synergistic research and applications from this new suite of terrestrial sensor systems. Landsat is the United States' oldest land-surface observation satellite system, with satellites continuously operating since 1972. Although the program has scored numerous successes in scientific and resource-management applications, Landsat has had a tumultuous history of management and funding changes over its nearly 27-year history. Landsat-7 marks a new direction in the program to reduce the cost of data and increase systematic global coverage for use in global change research as well as commercial and regional applications. With the passage of the Land Remote Sensing Policy Act in 1992, oversight of the Landsat program began to shift from the commercial sector to the federal government. NASA integrated Landsat-7 into its EOS science program in 1994. Landsat-7 is managed and operated jointly by NASA and U.S. Geological Survey (USGS). As a result, the costs of acquiring observations from

Williams, Darrel↗

Integrating Indigenous Traditional, Local and Scientific Knowledge for Improved Management, Policy and Decision-Making in Reindeer Husbandry in the Russian Arctic

As scientists and policy-makers from both indigenous and non-indigenous communities begin to build closer partnerships to address common sustainability issues such as the health impacts of climate change and anthropogenic activities, it becomes increasingly important to create shared information management systems which integrate all relevant factors for optimal information sharing and decision-making. This paper describes a new GIs-based system being designed to bring local and indigenous traditional knowledge together with scientific data and information, remote sensing, and information technologies to address health-related environment, weather, climate, pollution and land use change issues for improved decision/policy-making for reindeer husbandry. The system is building an easily-accessible archive of relevant current and historical, traditional, local and remotely-sensed and other data and observations for shared analysis, measuring, and monitoring parameters of interest. Protection of indigenous culturally sensitive information will be respected through appropriate data protocols. A mechanism which enables easy information sharing among all participants, which is real time and geo-referenced and which allows interconnectivity with remote sites is also being designed into the system for maximum communication among partners. A preliminary version of our system will be described for a Russian reindeer test site, which will include a combination of indigenous knowledge about local conditions and issues, remote sensing and ground-based data on such parameters as the vegetation state and distribution, snow cover, temperature, ice condition, and infrastructure.

Maynard, Nancy G.↗

The NASA Ames Life Sciences Data Archive: Biobanking for the Final Frontier

The NASA Ames Institutional Scientific Collection involves the Ames Life Sciences Data Archive (ALSDA) and a biospecimen repository, which are responsible for archiving information and non-human biospecimens collected from spaceflight and matching ground control experiments. The ALSDA also manages a biospecimen sharing program, performs curation and long-term storage operations, and facilitates distribution of biospecimens for research purposes via a public website (https:lsda.jsc.nasa.gov). As part of our best practices, a tissue viability testing plan has been developed for the repository, which will assess the quality of samples subjected to long-term storage. We expect that the test results will confirm usability of the samples, enable broader science community interest, and verify operational efficiency of the archives. This work will also support NASA open science initiatives and guides development of NASA directives and policy for curation of biological collections.

Biobank↗

Enabling Real-time Multi-messenger Astrophysics Discoveries with Deep Learning

Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravitational wave sources and their electromagnetic and astroparticle counterparts, and make a number of recommendations to maximize their potential for scientific discovery. These recommendations refer to the design of scalable and computationally efficient machine learning algorithms; the cyber-infrastructure to numerically simulate astrophysical sources, and to process and interpret multi-messenger astrophysics data; the management of gravitational wave detections to trigger real-time alerts for electromagnetic and astroparticle follow-ups; a vision to harness future developments of machine learning and cyber-infrastructure resources to cope with the big-data requirements; and the need to build a community of experts to realize the goals of multi-messenger astrophysics.

E A Huerta↗

Experiences in managing the Prometheus Project

Congress authorized NASA?s Prometheus Project in February 2003, with the first Prometheus mission slated to explore the icy moons of Jupiter. The Project had two major objectives: (1) to develop a nuclear reactor that would provide unprecedented levels of power and show that it could be processed safely and operated reliably in space for long-duration, deep-space exploration and (2) to explore the three icy moons of Jupiter - Callisto, Ganymede, and Europa - and return science data that would meet the scientific goals as set forth in the Decadal Survey Report of the National Academy of Sciences. Early in Project planning, it was determined that the development of the Prometheus nuclear powered Spaceship would be complex and require the intellectual knowledge residing at numerous organizations across the country. In addition, because of the complex nature of the Project and the multiple partners, approaches beyond those successfully used to manage a typical JPL project would be needed. This paper1 will describe the key experiences in managing Prometheus that should prove useful for future projects of similar scope and magnitude

nuclear↗

National Aeronautics and Space Administration fundamental research program. Information utilization and evaluation, appendices

Important points presented and recommendations made at an information and decision processes workshop held in Asilomar, California; at a data and information performance workshop held in Houston, Texas; and at a data base use and management workshop held near San Jose, California are summarized. Issues raised at a special session of the Soil Conservation Society of America's remote sensing for resource management conference in Kansas City, Missouri are also highlighted. The goals, status and activities of the NASA program definition study of basic research requirements, the necessity of making the computer science community aware of user needs with respect to information related to renewable resources, performance parameters and criteria for judging federal information systems, and the requirements and characteristics of scientific data bases are among the topics reported.

Estes, J. E.↗

DOE Advanced Scientific Computing Advisory Subcommittee (ASCAC) Report: Top Ten Exascale Research Challenges

Exascale computing systems are essential for the scientific fields that will transform the 21st century global economy, including energy, biotechnology, nanotechnology, and materials science. Progress in these fields is predicated on the ability to perform advanced scientific and engineering simulations, and analyze the deluge of data. On July 29, 2013, ASCAC was charged by Patricia Dehmer, the Acting Director of the Office of Science, to assemble a subcommittee to provide advice on exascale computing. This subcommittee was directed to return a list of no more than ten technical approaches (hardware and software) that will enable the development of a system that achieves the Department's goals for exascale computing. Numerous reports over the past few years have documented the technical challenges and the non¬-viability of simply scaling existing computer designs to reach exascale. The technical challenges revolve around energy consumption, memory performance, resilience, extreme concurrency, and big data. Drawing from these reports and more recent experience, this ASCAC subcommittee has identified the top ten computing technology advancements that are critical to making a capable, economically viable, exascale system.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Main Power Distribution Unit for the Jupiter Icy Moons Orbiter (JIMO)

Around the year 2011, the Jupiter Icy Moons Orbiter (JIMO) will be launched and on its way to orbit three of Jupiter s planet-sized moons. The mission goals for the JIMO project revolve heavily around gathering scientific data concerning ingredients we, as humans, consider essential: water, energy and necessary chemical elements. The JIM0 is an ambitious mission which will implore propulsion from an ION thruster powered by a nuclear fission reactor. Glenn Research Center is responsible for the development of the dynamic power conversion, power management and distribution, heat rejection and ION thrusters. The first test phase for the JIM0 program concerns the High Power AC Power Management and Distribution (PMAD) Test Bed. The goal of this testing is to support electrical performance verification of the power systems. The test bed will incorporate a 2kW Brayton Rotating Unit (BRU) to simulate the nuclear reactor as well as two ION thrusters. The first module of the PMAD Test Bed to be designed is the Main Power Distribution Unit (MPDU) which relays the power input to the various propulsion systems and scientific instruments. The MPDU involves circuitry design as well as mechanical design to determine the placement of the components. The MPDU consists of fourteen relays of four different variations used to convert the input power into the appropriate power output. The three phase system uses 400 Vo1ts(sub L-L) rms at 1000 Hertz. The power is relayed through the circuit and distributed to the scientific instruments, the ION thrusters and other controlled systems. The mechanical design requires the components to be positioned for easy electrical wiring as well as allowing adequate room for the main buss bars, individual circuit boards connected to each component and power supplies. To accomplish creating a suitable design, AutoCAD was used as a drafting tool. By showing a visual layout of the components, it is easy to see where there is extra room or where the components may interfere with one another. By working with the electrical engineer who is designing the circuit, the specific design requirements for the MPDU were determined and used as guidelines. Space is limited due to the size of the mounting plate therefore each component must be strategically placed. Since the MPDU is being designed to fit into a simulated model of the spacecraft systems on the JIMO, components must be positioned where they are easily accessible to be wired to the other onboard systems. Mechanical and electrical requirements provided equally important limits which are combined to produce the best possible design of the MPDU.

Papa, Melissa R.↗

Governing Data Findability, Accessibility, Interoperability and Reusability (FAIR) Compliance

The most recent data strategy documents at both the federal and NASA levels stipulate that systems should strive for the data they manage to be Findable, Accessible, Interoperable, and Reusable (FAIR). The NASA Life Sciences Portal (NLSP) has already begun leading efforts in this area for HRP, initiating efforts to comply with the FAIR principles. The broad interpretation of the FAIR principles has led to a plethora of tools that use a splay of metrics specifically but variably developed to judge how compliant data and systems are with the principles. A recent review [3] identified and studied 1,180 metrics across 20 publicly available tools for checking FAIR compliance of data and systems. Because of their very recent development, many organizations and data systems managers and developers have not yet had adequate time or resources to understand these FAIR compliance tools and metrics, their variations in design, accuracy or ease of application to their specific data sets and systems. Thus, it would be best for larger organizations like NASA to approach formulating a strategy for governance of FAIR compliance that can be flexibly applied and is adaptable to an evolving awareness knowledge of FAIR compliance methods and tools. In September 2024, the NASA Science Mission Directorate(SMD) organized a workshop on NASA science data repositories, including the topics of implementing FAIR and governing FAIR compliance across SMD. The initial part of these FAIR discussions focused on developing consensus around required science metadata fields. This is challenging given the diverse nature of NASA’s scientific data portfolio, the variety of metadata models and vocabularies used, and variable level of resources available to curate these data. Later discussion focused on three possible approaches to governing FAIR compliance: distributed, in which various programs, projects or systems define their own methods for assessing FAIR compliance, reporting results up appropriate management lines; centralized, in which higher-level organization(s) specify compliance tools or methods for the various data systems; and multi-level, in which a group comprised of individuals with expertise from multiple levels with organizations is formed to provide guidance and/or specifications for governing FAIR compliance. We report on the recommendations this session yielded, and how these might be shaped specifically to help implement and govern the compliance with FAIR of Human Research Program data and systems.

governance↗

dCache - Keeping up With the Evolution of Science

The dCache project provides open-source software deployed internationally to satisfy ever more demanding storage requirements of various scientific communities. Its multifaceted approach provides an integrated way of supporting different use-cases with the same storage, from high throughput data ingest, through wide access and easy integration with existing systems, including event driven workflow management. With this presentation, we will show some of the recent developments that optimize data management and access to maximise the gain from stored data.

Mkrtchyan, Tigran↗

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗