Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Standardized naming of microbiome samples in Genomes OnLine Database

The power of next-generation sequencing has resulted in an explosive growth in the number of projects aiming to understand the metagenomic diversity of complex microbial environments. The interdisciplinary nature of this microbiome research community, along with the absence of reporting standards for microbiome data and samples, poses a significant challenge for follow-up studies. Commonly used names of metagenomes and metatranscriptomes in public databases currently lack the essential information necessary to accurately describe and classify the underlying samples, which makes a comparative analysis difficult to conduct and often results in misclassified sequences in data repositories. The Genomes OnLine Database (GOLD) (https:// gold.jgi.doe.gov/) at the Department of Energy Joint Genome Institute has been at the forefront of addressing this challenge by developing a standardized nomenclature system for naming microbiome samples. GOLD, currently in its twenty-fifth anniversary, continues to enrich the research community with hundreds of thousands of metagenomes and metatranscriptomes with well-curated and easy-to-understand names. Through this manuscript, we describe the overall naming process that can be easily adopted by researchers worldwide. Additionally, we propose the use of this naming system as a best practice for the scientific community to facilitate better interoperability and reusability of microbiome data.

59 BASIC BIOLOGICAL SCIENCES↗

Implementation and Evaluation of Active Storage in Modern Parallel File Systems

Active Storage is a technology aimed at reducing the bandwidth requirements of current supercomputing systems, and leveraging the processing power of the storage nodes used by some modern file systems. Active Storage achieves both objectives by moving certain processing tasks to the storage nodes, near the data they manage. Our proposal for Active Storage has several key features: user-space implementation which facilitates the port to different file systems, analytical model to anticipate the performance of Active Storage with respect to a traditional system, support for striped files and complex format files such as netCDF, scientific-friendly programming and runtime environment, etc.

99 GENERAL AND MISCELLANEOUS↗

New York-Presbyterian and Columbia University Irving Medical Center Requirements (Analysis Report)

EPOC uses the Deep Dive process to discuss and analyze current and planned science, research, or education activities and the anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. Between February and June 2024, staff members from the Engagement and Performance Operations Center (EPOC) met with researchers and staff from New York-Presbyterian (NYP), Columbia University Irving Medical Center (CUIMC), and NYSERNet for the purpose of a Deep Dive into scientific and research drivers. The goal of this activity was to help characterize the requirements for a number of campus use cases, and to enable cyberinfrastructure support staff to better understand the needs of the researchers within the community. Material for this event included the written documentation from each of the profiled research areas, documentation about the current state of technology support, and a write-up of the discussion that took place via e-mail and video conferencing. The case studies highlighted the ongoing challenges and opportunities that NYP and CUIMC have in supporting a cross-section of established and emerging research use cases. Each case study mentioned unique challenges which were summarized into common needs.

97 MATHEMATICS AND COMPUTING↗

Roles of the ground and flight crew in Apollo operations.

The functions performed by ground personnel and flight crews of Apollo missions are reviewed, covering vehicle systems operation and management, Saturn launch vehicle, command-service and lunar modules, lunar rover, communication relay unit and ground-commanded TV assembly. Details of the flight path, scientific experiments, photographic equipment and crew health monitoring are also discussed in terms of these functions. The coordinated combination of large numbers of experts and data processing equipment on the ground with the crew's capabilities to operate the spacecraft and exercise on-the-spot judgements is viewed as the backbone of the successful fulfillment of Apollo missions.

Wolfer, B. M.↗

Reconfigurable modular computer networks for spacecraft on-board processing

The core electronics subsystems on unmanned spacecraft, which have been sent over the last 20 years to investigate the moon, Mars, Venus, and Mercury, have progressed through an evolution from simple fixed controllers and analog computers in the 1960's to general-purpose digital computers in current designs. This evolution is now moving in the direction of distributed computer networks. Current Voyager spacecraft already use three on-board computers. One is used to store commands and provide overall spacecraft management. Another is used for instrument control and telemetry collection, and the third computer is used for attitude control and scientific instrument pointing. An examination of the control logic in the instruments shows that, for many, it is cost-effective to replace the sequencing logic with a microcomputer. The Unified Data System architecture considered consists of a set of standard microcomputers connected by several redundant buses. A typical self-checking computer module will contain 23 RAMs, two microprocessors, one memory interface, three bus interfaces, and one core building block.

Rennels, D. A.↗

PVDaCS - A prototype knowledge-based expert system for certification of spacecraft data

On-line data management techniques to certify spacecraft information are mandated by increasing telemetry rates. Knowledge-based expert systems offer the ability to certify data electronically without the need for time-consuming human interaction. Issues of automatic certification are explored by designing a knowledge-based expert system to certify data from a scientific instrument, the Orbiter Ultraviolet Spectrometer, on an operating NASA planetary spacecraft, Pioneer Venus. The resulting rule-based system, called PVDaCS (Pioneer Venus Data Certification System), is a functional prototype demonstrating the concepts of a larger system design. A key element of the system design is the representation of an expert's knowledge through the usage of well ordered sequences. PVDaCS produces a certification value derived from expert knowledge and an analysis of the instrument's operation. Results of system performance are presented.

Wharton, Cathleen↗

Three Years of Operation of the Chandra X-Ray Observatory

The Chandra X-Ray Observatory is a NASA facility that provides scientific data to the international astronomical community in response to proposals for its use. Data becomes public at most one year after the observation. The Observatory is the product of the efforts of many commercial, academic, and government organizations in the United States and Europe. NASA's Marshall Space Flight Center (MSFC) manages the Project and provides Project Science TRW Space and Electronics Group served as prime contractor responsible for providing the spacecraft, the telescope, and assembling and testing the observatory the Smithsonian Astrophysical Observatory (SAO) provides technical support and is responsible for around operations including the Chandra X Ray Center (CXC).

Weisskopf, Martin C.↗

The Lunar Mapping and Modeling Project Update

The Lunar Mapping and Modeling Project (LMMP) is managing the development of a suite of lunar mapping and modeling tools and data products that support lunar exploration activities, including the planning, design, development, test, and operations associated with crewed and/or robotic operations on the lunar surface. In addition, LMMP should prove to be a convenient and useful tool for scientific analysis and for education and public outreach (E/PO) activities. LMMP will utilize data predominately from the Lunar Reconnaissance Orbiter, but also historical and international lunar mission data (e.g. Lunar Prospector, Clementine, Apollo, Lunar Orbiter, Kaguya, and Chandrayaan-1) as available and appropriate. LMMP will provide such products as image mosaics, DEMs, hazard assessment maps, temperature maps, lighting maps and models, gravity models, and resource maps. We are working closely with the LRO team to prevent duplication of efforts and ensure the highest quality data products. A beta version of the LMMP software was released for limited distribution in December 2009, with the public release of version 1 expected in the Fall of 2010.

Noble, S.↗

REPORT OF THE ISS OSI INVITED MEETING, VIENNA, 24-27 MARCH, 2009

The International Scientific Studies project (ISS) was initiated in early 2008 with the objective of creating a series of activities aimed at application of modern scientific methods to improve the efficiency of analysis and the quality of verification of the Comprehensive Nuclear Test-Ban Treaty Organization (CTBTO). The ISS On-Site Inspection (OSI) Invited Meeting convened on March 24, 2009 with the objectives of gaining a better understanding of the phenomenology of underground nuclear explosions (UNE) for OSI purposes and to identify areas of interest to OSI that could benefit significantly from contributions by the general scientific community. Fifteen invited experts from four countries, along with fifteen members of the OSI Division of the Provisional Technical Secretariat (PTS) met for four days at the Vienna International Center in an informal setting to discuss the application of observational methods, geophysical techniques, radionuclide measurement methods, environmental sampling methods, drilling techniques, and information management in the context UNE phenomena and OSI implementation. The meeting began with the identification and description of two general OSI scenarios, a vertical borehole emplacement and a horizontal tunnel emplacement, that serve as general examples of past UNE testing activities that can be used as a reference to identify UNE phenomena relevant for OSI observations. A significant portion of the first day of the meeting was spent in the description of the details of these scenarios and their implications for OSI observables. This discussion then served as a foundation for the discussions of the following three days in which OSI methods and technologies were evaluated in the context of UNE phenomenology and signatures. The methods and technologies discussed included visual observation from air and ground, radiation detection from the air, ground, and subsurface, ground-based and airborne geophysical observations and analysis, collection strategies for air, water, and solid samples, drilling concepts, and aspects of data fusion, information management, and modeling and simulation. The informal setting of the meeting provided a 'brainstorming' atmosphere and participation was excellent. One important aspect of this particular group was the very wide breadth of experience and expertise represented, ranging from those sharing their knowledge of UNE testing practice, radiological measurements and sampling, and knowledge of the underground effects of UNEs, to those with extensive experience in scientific and commercial geophysical measurements and surveys, to others with rich experience gained from several OSI field exercises, including the recent OSI Integrated Field Exercise in held in Kazakhstan in September 2008. During the workshop a number of topic areas relevant to OSI, explained in the list below, were identified that will benefit from collaboration with the international scientific community. Most of the topics represent the potential for studies of long-term interest, but some topics were identified that could be addressed, either by workshop participants or others known to the participants, that could be included as abstracts for submission to the ISS meeting taking place in June 2009. Items with topics that could be covered in the June meeting are annotated in the list. The meeting ended with the general understanding that ISS will not be completed with the June 2009 Conference. Rather, the ISS is considered as a long term project sponsoring relevant ongoing international scientific initiatives to expand and improve the verification capabilities of the Comprehensive Nuclear Test-Ban Treaty.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

The EXOSAT database and archive

The EXOSAT database provides on-line access to the results and data products (spectra, images, and lightcurves) from the EXOSAT mission as well as access to data and logs from a number of other missions (such as EINSTEIN, COS-B, ROSAT, and IRAS). In addition, a number of familiar optical, infrared, and x ray catalogs, including the Hubble Space Telescope (HST) guide star catalog are available. The complete database is located at the EXOSAT observatory at ESTEC in the Netherlands and is accessible remotely via a captive account. The database management system was specifically developed to efficiently access the database and to allow the user to perform statistical studies on large samples of astronomical objects as well as to retrieve scientific and bibliographic information on single sources. The system was designed to be mission independent and includes timing, image processing, and spectral analysis packages as well as software to allow the easy transfer of analysis results and products to the user's own institute. The archive at ESTEC comprises a subset of the EXOSAT observations, stored on magnetic tape. Observations of particular interest were copied in compressed format to an optical jukebox, allowing users to retrieve and analyze selected raw data entirely from their terminals. Such analysis may be necessary if the user's needs are not accommodated by the products contained in the database (in terms of time resolution, spectral range, and the finesse of the background subtraction, for instance). Long-term archiving of the full final observation data is taking place at ESRIN in Italy as part of the ESIS program, again using optical media, and ESRIN have now assumed responsibility for distributing the data to the community. Tests showed that raw observational data (typically several tens of megabytes for a single target) can be transferred via the existing networks in reasonable time.

Reynolds, A. P.↗

Sources of toxicity and exposure information for identifying chemicals of high concern to children

Due to the large number of chemicals in commerce without adequate toxicity characterization data, coupled with an ineffective federal policy for chemical management in the United States, many states are grappling with the challenge to identify toxic chemicals that may pose a risk to human health and the environment. Specific populations (e.g., children, elderly) are particularly sensitive to these toxic chemicals. In 2008, the Children's Safe Product Act (CSPA) was passed in Washington State. The CSPA included specific requirements to identify High Priority Chemicals (HPCs) and Chemicals of High Concern to Children (CHCCs). To implement this legislation, a methodology was developed to identify HPCs from authoritative scientific and regulatory sources on the basis of toxicity criteria. Another set of chemicals of concern was then identified from authoritative sources, based on their potential exposure to children. Exposure potential was evaluated by identifying chemicals detected in biomonitoring studies (i.e., human tissues), as well as those present in residential exposure media (e.g., indoor air, house dust, drinking water, consumer products). Accordingly, CHCCs were defined as HPCs that also appear in biomonitoring studies or relevant exposure media. For chemicals with unique Chemical Abstracts Service (CAS) numbers, we identified 2044 HPCs and 2219 chemicals with potential exposure to children, resulting in 476 CHCCs. The process of chemical identification is dynamic, so that chemicals may be added or subtracted as new information becomes available. Although beyond the scope of this paper, the 476 CHCCs will be prioritized in a more detailed assessment, based on the strength and weight of evidence of toxicity and exposure data. Our approach was developed to be flexible which allows the addition or removal of specific sources of toxicity or exposure information, as well as transparent to allow clear identification of inputs. Although the methodology was constrained by specific requirements in the CSPA, the intent of this work was to identify HPCs and CHCCs that might guide future regulatory actions and inform chemical management policies, aimed at protecting children's health.

54 ENVIRONMENTAL SCIENCES↗

Experimental evaluation of a flexible I/O architecture for accelerating workflow engines in ultrascale environments

The increasing volume of scientific data and the limited scalability and performance of storage systems are currently presenting a significant limitation for the productivity of the scientific workflows running on both high-performance computing (HPC) and cloud platforms. Clearly needed is better integration of storage systems and workflow engines to address this problem. This paper presents and evaluates a novel solution that leverages codesign principles for integrating Hercules—an in-memory data store—with a workflow management system. We consider four main aspects: workflow representation, task scheduling, task placement, and task termination. As a result, the experimental evaluation on both cloud and HPC systems demonstrates significant performance and scalability improvements over existing state-of-the-art approaches.

97 MATHEMATICS AND COMPUTING↗

An Overview of the Performance of the Chandra X-ray Observatory

The Chandra X-ray Observatory is the X-ray component of NASA's Great Observatory Program which includes the recently launched Spitzer Infrared Telescope, the Hubble Space Telescope (HST) for observations in the visible, and the Compton Gamma-Ray Observatory (CGRO) which, after providing years of useful data has reentered the atmosphere. All these facilities provide, or provided, scientific data to the international astronomical community in response to peer-reviewed proposals for their use. The Chandra X-ray Observatory was the result of the efforts of many academic, commercial, and government organizations primarily in the United States but also in Europe. NASA s Marshall Space Flight Center (MSFC) manages the Project and provides Project Science; Northrop Grumman Space Technology (NGST - formerly TRW) served as prime contractor responsible for providing the spacecraft, the telescope, and assembling and testing the Observatory; and the Smithsonian Astrophysical Observatory (SAO) provides technical support and is responsible for ground operations including the Chandra X-ray Center (CXC). Telescope and instrument teams at SAO, the Massachusetts Institute of Technology (MIT), the Pennsylvania State University (PSU), the Space Research Institute of the Netherlands (SRON), the Max-Planck Institut fur extraterrestrische Physik (MPE), and the University of Kiel support also provide technical support to the Chandra Project. We present here a detailed description of the hardware, its on-orbit performance, and a brief overview of some of the remarkable discoveries that illustrate that performance.

Weisskopf, M. C.↗

Ensemble Simulations on Leadership Computing Systems

Scientific productivity can be enhanced through workflow management tools, relieving large High Performance Computing (HPC) system users from the tedious tasks of scheduling and designing the complex computational execution of scientific applications. This paper presents a study on the usage of ensemble workflow tools to accelerate science using the Summit and Frontier supercomputing systems. The research aims to connect science domain simulations using Oak Ridge Leadership Computing Facility (OLCF) supercomputing platforms with ensemble workflow methods in order to accelerate HPC-enabled discovery and boost scientific impact. We present the coupling, porting and optimization of Radical-Cybertools on three applications: Chroma, NAMD and LAMMPS. The tools augment traditional HPC monolithic runs with a pilot scheduler. Lessons-learned are discussed for physics, biology and materials science applications. We discuss intrinsic limitations of coupling and porting ensemble workflow tools to applications that run on large HPC systems. The origins of technical challenges and their solutions developed during the implementation process are discussed. Data management strategies, OLCF’s policies for ensembles, and natively supported workflow tools are also summarized.

Georgiadou, Antigoni [ORNL] (ORCID:000000020977631↗

Harnessing Systems Engineering Methodology in Using Earth Science Research Data for Real Applications

For the last three decades, Earth science remote sensing technologies have been providing an enormous amount of useful data and information serving to broaden our understanding of the home planet as a system. NASA's Earth science program has deployed about 18 complex satellites and is in the process of defining and launching multiple observing systems in this decade. At the same time, the European Community and many other countries such as Russia, France, India, Japan, and China have also significantly contributed to Earth science research. To date, the majority of such efforts have concentrated on expanding our scientific understanding of the multiple nonlinear and chaotic processes of Earth's behavior. In recent years, legislators and stakeholders have put serious pressure on the science community to devote more attention to making use of scientific results for societal benefit. For instance, there are a number of areas such as energy forecasting, aviation safety, agricultural efficiency, disaster management, air quality and public health that can directly take advantage of Earth science results to analyze and predict large scale problems and conditions. This is becoming even more important now that we live in a global economy interconnected via the internet and transportation systems; regional environmental conditions can have far reaching impact across continental boundaries. These factors dictate requirements for global data that can help us assess and control the devastating problems of famine, water resources, wildfires, human health and more. To do this requires a serious, organized, and systematic approach that transfers fundamental research products to the applied sciences domain. This paper presents a systems engineering and management process that can effectively make such transfer of data to the user community. Examples are presented on how the above decision making framework can help in solving critical problems such as the spread of vector borne diseases, forecasts of harmful algal blooms as well as forest fires and wildfires, and the intercontinental transport of dust storms and pollution.

Habib, Shahid↗

Enhancing Lifeline Infrastructure Resilience

Establish operational critical infrastructure research environment with focus on control systems security Continue enhancement of critical infrastructure cyber-physical interdependency analysis and knowledge management capabilities

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

NASA WorldWind: Open Source Visualization Technology for Earth Observation

NASA WorldWind: Open Source Visualization Technology for Earth Observation WorldWind, open source virtual globe technology for Java, iOS, Android and Web, is provided by NASA and is architected as API-centric modular componentry. This enable it to be continually optimized and feature-enriched in ways that allow applications based on this SDK (Software Development Kit) to benefit Earth Observation, especially Open Science, with minimal or no adjustment for the decade ahead. The next-generation National Airspace System (NAS) aviation management system for the U.S. Federal Aviation Administration, FAA, uses WorldWind, as do applications currently being developed by the European Space Agency, along with several other US and European government agencies and industry partners. This presentation will demonstrate several NASA open source use cases for WorldWind technology that include advances being made to optimize access to NetCDF and HDF data via WebWorldWind.NASA WorldWind: Multidimensional Geospatial Web Platform The ability to see spatial data in its native context is essential for that data to be appreciated whether by the scientific community, policy and decision-makers or the general public. Recently, the accessibility of spatial data has dramatically improved. Without the need to install an application, spatial data can now be experienced via any web browser, mobile devices included. For developers, by simply updating the app on your server, the latest version of your application is now immediately available to your entire usercommunity. Unlike other virtual globes such as Google Earth, NASA World Wind offers something very special, full control to customize the interface with any features or functionalities you might need. You decide how the data is accessed and experienced. This allows you to provide maximum value of the information to your user community. The web version of NASA WorldWind (WebWorldWind) has made it possible for a whole new suite of applications for managing and sharing spatial data. Apps built with this web version are ideal for immediate social media type activity and also facilitate delivery of sophisticated data exchange scenarios such as weather and climate research, disaster response, personal navigation, and industrial-strength tracking for transportation, supply chain, aviation and satellites. WebWorldWind is an application component, not an app in itself. It is written in JavaScript and provides the real world geographic context for spatial data and information visualization, using a rich set of shapes and graphic primitives. WebWorldWind also provides platform independence, while accommodating any number of data types. Web WorldWind runs on any platform via a browser, i.e., Internet Explorer, Firefox, Chrome and Safari. Features include, 3D virtual globe, 2D map with multiple projection choices (Mercator, Polar, UPS, Equirectangular), imagery and elevation import, extensible, data retrieval (via REST, WMS, WCS, WFS, Bing, User-Defined), decluttering, measurement, accurate line-ofsight, subsurface visualization, and more.

Open Source Mapping↗

Basic Energy Sciences Exascale Requirements Review. An Office of Science review sponsored jointly by Advanced Scientific Computing Research and Basic Energy Sciences, November 3-5, 2015, Rockville, Maryland

Computers have revolutionized every aspect of our lives. Yet in science, the most tantalizing applications of computing lie just beyond our reach. The current quest to build an exascale computer with one thousand times the capability of today’s fastest machines (and more than a million times that of a laptop) will take researchers over the next horizon. The field of materials, chemical reactions, and compounds is inherently complex. Imagine millions of new materials with new functionalities waiting to be discovered — while researchers also seek to extend those materials that are known to a dizzying number of new forms. We could translate massive amounts of data from high precision experiments into new understanding through data mining and analysis. We could have at our disposal the ability to predict the properties of these materials, to follow their transformations during reactions on an atom-by-atom basis, and to discover completely new chemical pathways or physical states of matter. Extending these predictions from the nanoscale to the mesoscale, from the ultrafast world of reactions to long-time simulations to predict the lifetime performance of materials, and to the discovery of new materials and processes will have a profound impact on energy technology. In addition, discovery of new materials is vital to move computing beyond Moore’s law. To realize this vision, more than hardware is needed. New algorithms to take advantage of the increase in computing power, new programming paradigms, and new ways of mining massive data sets are needed as well. This report summarizes the opportunities and the requisite computing ecosystem needed to realize the potential before us. In addition to pursuing new and more complete physical models and theoretical frameworks, this review found that the following broadly grouped areas relevant to the U.S. Department of Energy (DOE) Office of Advanced Scientific Computing Research (ASCR) would directly affect the Basic Energy Sciences (BES) mission need. Simulation, visualization, and data analysis are crucial for advances in energy science and technology. Revolutionary mathematical, software, and algorithm developments are required in all areas of BES science to take advantage of exascale computing architectures and to meet data analysis, management, and workflow needs. In partnership with ASCR, BES has an emerging and pressing need to develop new and disruptive capabilities in data science. More capable and larger high-performance computing (HPC) and data ecosystems are required to support priority research in BES. Continued success in BES research requires developing the next-generation workforce through education and training and by providing sustained career opportunities.

97 MATHEMATICS AND COMPUTING↗