Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Towards the Interoperability of Web, Database, and Mass Storage Technologies for Petabyte Archives

At the San Diego Supercomputer Center, a massive data analysis system (MDAS) is being developed to support data-intensive applications that manipulate terabyte sized data sets. The objective is to support scientific application access to data whether it is located at a Web site, stored as an object in a database, and/or storage in an archival storage system. We are developing a suite of demonstration programs which illustrate how Web, database (DBMS), and archival storage (mass storage) technologies can be integrated. An application presentation interface is being designed that integrates data access to all of these sources. We have developed a data movement interface between the Illustra object-relational database and the NSL UniTree archival storage system running in a production mode at the San Diego Supercomputer Center. With this interface, an Illustra client can transparently access data on UniTree under the control of the Illustr DBMS server. The current implementation is based on the creation of a new DBMS storage manager class, and a set of library functions that allow the manipulation and migration of data stored as Illustra 'large objects'. We have extended this interface to allow a Web client application to control data movement between its local disk, the Web server, the DBMS Illustra server, and the UniTree mass storage environment. This paper describes some of the current approaches successfully integrating these technologies. This framework is measured against a representative sample of environmental data extracted from the San Diego Ba Environmental Data Repository. Practical lessons are drawn and critical research areas are highlighted.

Moore, Reagan↗

Enhanced Microbial Detection Capabilities by a Rapid Portable Instrument

We present data describing a progression of continuing technology development - from expanding the detection capabilities of the current PTS unit to re-outfitting the instrument with a protein microarray increasing the number of detectable compounds. To illustrate the adaptability of the cartridge format, on-orbit operations data from the ISS demonstrate the detection of the fungal cell wall compound beta-glucan using applicable LOCAD-PTS cartridges. LOCAD-PTS is a handheld device consisting of a spectrophotometer, an onboard pumping mechanism, and data storage capabilities. A suite of interchangeable cartridges lined with four distinct capillaries allow a hydrated sample to mix with necessary reagents in the channels before being pumped to the optical well for spectrophotometric analysis. The reagents housed in one type of cartridge trigger a reaction based on the Limulus Amebocyte Lysate (LAL) assay, which results in the release of paranitroaniline dye. The dye is measured using a 395 nm filter. The LAL assay detects the Gram-negative bacterial cell wall molecule, endotoxin or lipopolysaccharide (LPS). The more dye released, the greater the concentration of endotoxin in the sample. Sampling, quantitative analysis, and data retrieval require less than 20 minutes. This is significantly faster than standard culture-based methods, which require at least a 24 hour incubation period.Using modified cartridges, we demonstrate the detection of Gram negative bacteria with protein microarray technology. Additionally, we provide data from multiple field tests where both standard and advanced PTS technologies were used. These tests investigate the transfer of target microbial molecules from one surface to another. Collectively, these data demonstrate that the new cartridges expand the number of compounds detected by LOCAD-PTS, while maintaining the rapid, in situ analysis characteristic of the instrument. The unit provides relevant data for verifying sterile sample collection protocols, which are critical for conducting accurate scientific experiments during future missions to the Moon and Mars.

Morris, Heather↗

An Autonomous MCP Bridge to Rucio: Enhancing Data Management Accessibility for High Energy Physics

The Rucio Data Management System [1] is an important tool used by High Energy Physics experiments, including those at Fermi National Accelerator Laboratory, to store and manage exabyte-scale scientific datasets. Despite its central role in coordinating data across globally distributed storage sites, Rucio's command line interface (CLI) presents a steep learning curve, and makes it difficult for scientists to navigate through. To solve this issue, a containerized Model Context Protocol (MCP) [2] server was built that connects Large Language Models directly to Rucio, allowing AI agents to handle data tasks by using simple, natural language rather than memorized terminal commands. The core engineering focus of this project was moving the server away from slow terminal commands that require text parsing and replacing them with a native Python Client API toolset and a planned REST API framework. Moving to the Python API handles data operations directly in memory, which helps clear up formatting errors, provides the AI with clean, structured JSON data and speeds up tool execution. To prove that the system actually works, a benchmarking pipeline was also built with various questions to test the AI across four different model configurations. The questions included finding data scopes, tracking down specific datasets, and checking replication rules. Through benchmarking, early runs showed that with raw terminal text, the model would get confused and stuck, whereas switching to the Python API to feed the AI clean, structured data yielded massive improvement. By creating an intelligent and autonomous bridge to a storage network, this project shows how AI can be implemented in scientific data management, which ultimately helps scientists at Fermilab spend less time sorting through data and more time focusing on their experiments and analysis.

Akella, Kashyap [William Rainey Harper Coll.]↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

Final Technical Report for: A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization

The placement and movement of data is becoming the key limiting factor on both performance and energy efficiency of high performance computations. As systems generate more data, it is becoming increasingly difficult to actually move that data elsewhere for post-processing, as the rate of improvements in supporting I/O infrastructure is not keeping pace. Together, these trends are creating a shift in how we think about exascale computations, from a viewpoint that focuses on FLOPS to one that focuses on data and data-centric operations as fundamental to the reasoning about, and optimization of, scientific workflows on extreme-scale architectures. The overarching goal of our effort was the study of a unified data-driven approach for programming applications and in situ analysis and visualization. Our work was to understand the interplay between data-centric programming model requirements at extreme-scale and the overall impact of those requirements on the design, capabilities, flexibility, and implementation details for both applications and the supporting in situ infrastructure. In this context, we made many improvements to the Legion programming system (one of the leading data-centric models today) and demonstrated in situ analyses on real application codes using these improvements.

97 MATHEMATICS AND COMPUTING↗

Unsupervised word embeddings capture latent knowledge from materials science literature

The overwhelming majority of scientific knowledge is published as text, which is difficult to analyse by either traditional statistical analysis or modern machine learning methods. By contrast, the main source of machine-interpretable data for the materials research community has come from structured property databases, which encompass only a small fraction of the knowledge present in the research literature. Beyond property values, publications contain valuable knowledge regarding the connections and relationships between data items as interpreted by the authors. To improve the identification and use of this knowledge, several studies have focused on the retrieval of information from scientific literature using supervised natural language processing, which requires large hand-labelled datasets for training. Here we show that materials science knowledge present in the published literature can be efficiently encoded as information-dense word embeddings (vector representations of words) without human labelling or supervision. Without any explicit insertion of chemical knowledge, these embeddings capture complex materials science concepts such as the underlying structure of the periodic table and structure-property relationships in materials. Furthermore, we demonstrate that an unsupervised method can recommend materials for functional applications several years before their discovery. This suggests that latent knowledge regarding future discoveries is to a large extent embedded in past publications. Lastly, our findings highlight the possibility of extracting knowledge and relationships from the massive body of scientific literature in a collective manner, and point towards a generalized approach to the mining of scientific literature.

36 MATERIALS SCIENCE↗

Opportunity for early science return by the Artemis Program

The purpose of the Artemis Program is to gather vital scientific and engineering data by conducting robotic exploration missions on the lunar surface both prior to and concurrent with human missions. The Artemis Program includes rapid, near-term development of a variety of small experimental and operational payloads, a low-cost capacity to deliver these payloads to any location on the lunar surface, and the analysis of the data returned. The Artemis Program will provide opportunities to improve the understanding of lunar geosciences, to demonstrate the Moon's unique capacity as an astronomical platform to study the universe, to conduct scientific and technology development experiments, and to prepare for and complement human missions.

Meyer, Charles↗

An analysis of the Hubble Space Telescope fine guidance sensor fine lock mode

There are two guiding modes of the Hubble Space Telescope (HST) used for the acquisition of astronomical data by one of its six scientific instruments. The more precise one is called Fine Lock. Command and control problems in the onboard electronics has limited Fine Lock to brighter stars, V less than 13.0 mag, instead of fulfilling its goal of V = 14.5 mag. Consequently, the less precise guiding mode of Coarse Track (approximately 40 milli-arc seconds) has to be used fairly frequently. Indeed, almost half of the scientific observations to have been made with the HST will be compromised. The only realistic or extensive simulations of the Fine Lock guidance mode are reported. The theoretical analysis underlying the Monte Carlo experiments and the numerical computations clearly show both that the control electronics are severely under-engineered and how to adjust the various control parameters to successfully extend Fine Lock guiding performance back to V = 14.0 mag and sometimes beyond.

Taff, L. G.↗

Toward implementing autonomous adaptive data acquisition for scanning hyperspectral imaging of biological systems

Autonomous experimentation is an emerging area of research, primarily related to autonomous vehicles, scientific combinatorial discovery approaches in materials science and drug discovery, and iterative research loops of planning, experimentation, and analysis. However, autonomous approaches developed in these contexts are difficult to apply to high-dimensional mapping technologies, such as scanning hyperspectral imaging of biological systems, due to sample complexity and heterogeneity. We briefly cover the history of adaptive sampling algorithms and surrogate modeling in order to define autonomous adaptive data acquisition as an objective-based, flexible building block for future biological imaging experimentation driven by intelligent infrastructure. We subsequently summarize the recent implementations of autonomous adaptive data acquisition (AADA) for scanning hyperspectral imaging, assess how these address the difficulties of autonomous approaches in hyperspectral imaging, and highlight the AADA design variation from a goal-oriented perspective. Finally, we present a modular AADA architecture that embeds AADA-driven flexible building blocks to address the challenge of time resolution for high-dimensional scanning hyperspectral imaging of nonequilibrium dynamical systems. In our example research-driven experimental design case, we propose an AADA infrastructure for time-resolved, noninvasive, and label-free scanning hyperspectral imaging of living biological systems. This AADA infrastructure can accurately target the correct state of the system for experimental workflows that utilize subsequent expensive, high-information-content analytical techniques.

59 BASIC BIOLOGICAL SCIENCES↗

Comparison and Analysis of the Venus Global Reference Atmospheric Model

The goal of this research was to analyze the Venus Global Reference Atmospheric Model (Venus-GRAM) and determine how accurately the model is following its primary source data from the Venus International Reference Atmosphere (VIRA). A comparative analysis between Venus-GRAM and the Venus Climate Database (VCD) was also conducted. The VCD is an atmospheric model developed by the Laboratoire de Météorologie Dynamique (LMD) for both scientific and engineering purposes. The purpose of this work is to ensure the most up-to-date data is being used to prepare for future probe and aerocapture missions.

Libby Cutler↗

Commerce Laboratory: Mission analysis payload integration study

A mission model which will accommodate commercial users and provide a basic data base for further mission planning is reported. The data bases to be developed are: (1) user requirements; (2) apparatus capabilities and availabilities; and (3) carrier capabilities. These data bases are synthesized in a trades and analysis phase along with the STS flight apparatus, and optimum missions will be identified. The completed work is reported. The user requirements data base was expanded to identify within the six scientific disciplines the areas of investigation, investigation categories and status, potential commercial application, interested parties, process, and experiment requirements. The scope of the apparatus data base was expanded to indicate apparatus status as to whether it is ground or flight equipment and, within both categories, whether the apparatus is: (1) existing, (2) under development, (3) planned, or (4) needed. Applications for the apparatus are listed. The methodology is revised in the areas of trades and analysis and mission planning. The carrier capabilities data base was updated and completed.

Bannister, T. C.↗

Skylab program: Earth resources experiment package. Sensor performance evaluation. Volume 6: (S194) L-band radiometer

Analysis of the Skylab S194 L-band radiometer experiment data provided significant results pertaining to the actual realized performance during flight. Analysis of preflight test data provided a baseline from which to compare the experiment flight performance, although many radiometric data performance capabilities could only be demonstrated in the flight environment. The final results establish the overall hardware performance of the S194 system from which prospective users of the flight data can refer for various scientific applications. Instrument performance is presented in the areas of housekeeping and internal calibration parameters, antenna system integrity, dynamic range, linearity, precision, resolution, and absolute accuracy. Supplementary evaluations were included for an error analysis of system calibration stability. Results of the evaluation show that the instrument performance was generally as expected. Conclusions are drawn from the final evaluation results, and recommendations for improving the effectiveness of a future program are offered.

Kenney, G. P.↗

Feature-Based Analysis of Plasma-Based Particle Acceleration Data

Plasma-based particle accelerators can produce and sustain thousands of times stronger acceleration fields than conventional particle accelerators, providing a potential solution to the problem of the growing size and cost of conventional particle accelerators. To facilitate scientific knowledge discovery from the ever growing collections of accelerator simulation data generated by accelerator physicists to investigate next-generation plasma-based particle accelerator designs, we describe a novel approach for automatic detection and classification of particle beams and beam substructures due to temporal differences in the acceleration process, here called acceleration features. The automatic feature detection in combination with a novel visualization tool for fast, intuitive, query-based exploration of acceleration features enables an effective top-down data exploration process, starting from a high-level, feature-based view down to the level of individual particles. We describe the application of our analysis in practice to analyze simulations of single pulse and dual and triple colliding pulse accelerator designs, and to study the formation and evolution of particle beams, to compare substructures of a beam and to investigate transverse particle loss.

43 PARTICLE ACCELERATORS↗

The Mars Surveyor '01 Rover and Robotic Arm

The Mars Surveyor 2001 Lander will carry with it both a Robotic Arm and Rover to support various science and technology experiments. The Marie Curie Rover, the twin sister to Sojourner Truth, is expected to explore the surface of Mars in early 2002. Scientific investigations to determine the elemental composition of surface rocks and soil using the Alpha Proton X-Ray Spectrometer (APXS) will be conducted along with several technology experiments including the Mars Experiment on Electrostatic Charging (MEEC) and the Wheel Abrasion Experiment (WAE). The Rover will follow uplinked operational sequences each day, but will be capable of autonomous reactions to the unpredictable features of the Martian environment. The Mars Surveyor 2001 Robotic Arm will perform rover deployment, and support various positioning, digging, and sample acquiring functions for MECA (Mars Environmental Compatibility Assessment) and Mossbauer Spectrometer experiments. The Robotic Arm will also collect its own sensor data for engineering data analysis. The Robotic Arm Camera (RAC) mounted on the forearm of the Robotic Arm will capture various images with a wide range of focal length adjustment during scientific experiments and rover deployment

Bonitz, Robert G.↗

Geologic Investigations Spurred by Analog Testing at the 7504 Cone-SP Mountain Area of the San Francisco Volcanic Field

The SP Mountain area of the San Francisco Volcanic Field, AZ, has been used as an analog mission development site for NASA since 1998. This area consists of basaltic cinder cones, lava flows and maar craters that have been active since mid-Miocene, with the youngest events occurring within the last 10,000 years. The area has been used because its geologic and topographic resemblance to lunar and Martian terrains provides an ideal venue for testing hardware and science operations practices that might be employed on planetary surfaces, as well as training astronauts in field geology. Analog operations have often led to insights that spurred new scientific investigations. Most recently, an investigation of the 7504 cone was initiated due to perceptions that Apollo-style traverse plans executed during the Desert RATS 2010 mission had characterized the area incorrectly, leading to concerns that the Apollo traverse planning process was scientifically flawed. This investigation revealed a complex history of fissure eruptions of lava and cinders, cinder cone development, a cone-fill-and-spill episode, extensive rheomorphic lava flow initiation and emplacement, and cone sector collapse that led to a final lava flow. This history was not discernible on pre-RATS mission photogeology, although independent analysis of RATS 2010 data and samples develped a "75% complete solution" that validated the pre-RATS mission planning and Apollo traverse planning and execution. The study also pointed out that the development of scientific knowledge with time in a given field area is not linear, but may follow a functional form that rises steeply in the early period of an investigation but flattens out in the later period, asymptotically approaching a theoretical "complete knowledge" point that probably cannot be achieved. This implies that future human missions must be prepared to shift geographic areas of investigation regularly if significant science returns are to be forthcoming.

Eppler, Dean B.↗

Automated Miniaturized Instrument for Space Biology Applications and the Monitoring of the Astronauts Health Onboard the ISS

Human space travelers experience a unique environment that affects homeostasis and physiologic adaptation. The spacecraft environment subjects the traveler to noise, chemical and microbiological contaminants, increased radiation, and variable gravity forces. As humans prepare for long-duration missions to the International Space Station (ISS) and beyond, effective measures must be developed, verified and implemented to ensure mission success. Limited biomedical quantitative capabilities are currently available onboard the ISS. Therefore, the development of versatile instruments to perform space biological analysis and to monitor astronauts' health is needed. We are developing a fully automated, miniaturized system for measuring gene expression on small spacecraft in order to better understand the influence of the space environment on biological systems. This low-cost, low-power, multi-purpose instrument represents a major scientific and technological advancement by providing data on cellular metabolism and regulation. The current system will support growth of microorganisms, extract and purify the RNA, hybridize it to the array, read the expression levels of a large number of genes by microarray analysis, and transmit the measurements to Earth. The system will help discover how bacteria develop resistance to antibiotics and how pathogenic bacteria sometimes increase their virulence in space, facilitating the development of adequate countermeasures to decrease risks associated with human spaceflight. The current stand-alone technology could be used as an integrated platform onboard the ISS to perform similar genetic analyses on any biological systems from the tree of life. Additionally, with some modification the system could be implemented to perform real-time in-situ microbial monitoring of the ISS environment (air, surface and water samples) and the astronaut's microbiome using 16SrRNA microarray technology. Furthermore, the current system can be enhanced substantially by combining it with other technologies for automated, miniaturized, high-throughput biological measurements, such as fast sequencing, protein identification (proteomics) and metabolite profiling (metabolomics). Thus, the system can be integrated with other biomedical instruments in order to support and enhance telemedicine capability onboard ISS. NASA's mission includes sustained investment in critical research leading to effective countermeasures to minimize the risks associated with human spaceflight, and the use of appropriate technology to sustain space exploration at reasonable cost. Our integrated microarray technology is expected to fulfill these two critical requirements and to enable the scientific community to better understand and monitor the effects of the space environment on microorganisms and on the astronaut, in the process leveraging current capabilities and overcoming present limitations.

Human space travelers↗

Cross-Cutting Software Solutions in Support of Experimental Analysis Challenges at National Scattering Facilities

Rapid improvements in instrumentation at neutron and light source combined with new capabilities in computing, data analytics, and machine learning offer unprecedented scientific capabilities to address fundamental and applied science questions in a wide area of subjects from quantum materials to biological systems. In order to make these capabilities accessible to the broader scientific community, significant developments are needed related to workflow spanning from experimental control to advanced materials simulations as well as the underpinning scientific software. In this chapter, we explore these needs and recent developments at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory. A central part of the workflow at the SNS is the data reduction framework Mantid which is developed as a partnership between European and US neutron-scattering facilities.

Proffen, Thomas↗

Analysis and interpretation of diffuse x-ray emission using data from the Einstein satellite

An ambitious program to create a powerful and accessible archive of the HEAO-2 Imaging Proportional Counter (IPC) database was outlined. The scientific utility of that database for studies of diffuse x ray emissions was explored. Technical and scientific accomplishments are reviewed. Three papers were presented which have major new scientific findings relevant to the global structure of the interstellar medium and the origin of the cosmic x ray background. An all-sky map of diffuse x ray emission was constructed.

Helfand, David J.↗