Using Cloud to Host Large Open-Source Datasets
An overview of how EDX leveraged Google's Open Data Program to host 5 large, publicly accessible datasets (over 200TBs) for free.
Rowan, Chad↗
SEARCH · Engineering Papers
Results for “Open Access”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Support for Systematic Code Reviews with the SCRUB Tool
SCRUB is a code review tool that supports both large, team-based software development efforts (e.g., for mission software) as well as individual tasks. The tool was developed at JPL to support a new, streamlined code review process that combines human-generated review reports with program-generated review reports from a customizable range of state-of-the-art source code analyzers. The leading commercial tools include Codesonar, Coverity, and Klocwork, each of which can achieve a reasonably low rate of false-positives in the warnings that they generate. The time required to analyze code with these tools can vary greatly. In each case, however, the tools produce results that would be difficult to realize with human code inspections alone. There is little overlap in the results produced by the different analyzers, and each analyzer used generally increases the effectiveness of the overall effort. The SCRUB tool allows all reports to be accessed through a single, uniform interface (see figure) that facilitates brows ing code and reports. Improvements over existing software include significant simplification, and leveraging of a range of commercial, static source code analyzers in a single, uniform framework. The tool runs as a small stand-alone application, avoiding the security problems related to tools based on Web browsers. A developer or reviewer, for instance, must have already obtained access rights to a code base before that code can be browsed and reviewed with the SCRUB tool. The tool cannot open any files or folders to which the user does not already have access. This means that the tool does not need to enforce or administer any additional security policies. The analysis results presented through the SCRUB tool s user interface are always computed off-line, given that, especially for larger projects, this computation can take longer than appropriate for interactive tool use. The recommended code review process that is supported by the SCRUB tool consists of three phases: Code Review, Developer Response, and Closeout Resolution. In the Code Review phase, all tool-based analysis reports are generated, and specific comments from expert code reviewers are entered into the SCRUB tool. In the second phase, Developer Response, the developer is asked to respond to each comment and tool-report that was produced, either agreeing or disagreeing to provide a fix that addresses the issue that was raised. In the third phase, Closeout Resolution, all disagreements are discussed in a meeting of all parties involved, and a resolution is made for all disagreements. The first two phases generally take one week each, and the third phase is concluded in a single closeout meeting.
Holzmann, Gerald J.↗
Investigation of Ruthenium Dissolution in Advanced Membrane Electrode Assemblies for Direct Methanol Based Fuel Cell Stacks
Dissolution of ruthenium was observed in the 80-cell stack. Duration testing was performed in single cell MEAs to determine the pathway of cell degradation. EDAX analysis on each of the single cell MEAs has shown that the Johnson Matthey commercial catalyst is stable in DMFC operation for 250 hours, no ruthenium dissolution was observed. Changes in the hydrophobicity of the cathode backing papers was minimum. Electrode polarization analysis revealed that the MEA performance loss is attributed to changes in the cathode catalyst layer. Ruthenium migration does not seem to occur during cell operation but can occur when methanol is absent from the anode compartment, the cathode compartment has access to air, and the cells in the stack are electrically connected to a load (Shunt Currents). The open-to-air cathode stack design allowed for: a) The MEAs to have continual access to oxygen; and b) The stack to sustain shunt currents. Ruthenium dissolution in a DMFC stack can be prevented by: a) Developing an internally manifolded stacks that seal reactant compartments when not in operation; b) Bringing the cell voltages to zero quickly when not in operation; and c) Limiting the total number of cells to 25 in an effort to limit shunt currents.
alternative power sources↗
Web Map Services (WMS) Global Mosaic
The WMS Global Mosaic provides access to imagery of the global landmass using an open standard for web mapping. The seamless image is a mosaic of Landsat 7 scenes; geographically-accurate with 30 and 15 meter resolutions. By using the OpenGIS Web Map Service (WMS) interface, any organization can use the global mosaic as a layer in their geospatial applications. Based on a trade study, an implementation approach was chosen that extends a previously developed WMS hosting a Landsat 5 CONUS mosaic developed by JPL. The WMS Global Mosaic supports the NASA Geospatial Interoperability Office goal of providing an integrated digital representation of the Earth, widely accessible for humanity's critical decisions.
web map services↗
Technical Note: NASAaccess – A Tool for Access, Reformatting, and Visualization of Remotely Sensed Earth Observation and Climate Data
The National Aeronautics and Space Administration (NASA) has launched a new initiative, the Open-Source Science Initiative (OSSI), to enable and support science towards openness. The OSSI supports open-source software development and dissemination. In this work, we present NASAaccess, which is an open-source software package and web-based environmental modeling application for earth observation data accessing, reformatting, and presenting quantitative data products. The main objective of developing the NASAaccess platform is to facilitate exploration, modeling, and understanding of earth data for scientists, stakeholders, and concerned citizens whose objectives align with the new OSSI goals. The NASAaccess platform is available as software packages (i.e., the R and conda packages) as well as an interactive-format web-based environmental modeling application for earth observation data developed with Tethys Platform. NASAaccess has been envisioned as lowering the technical barriers and simplifying the process of accessing scalable distributed computing resources and leveraging additional software for data and computationally intensive modeling frameworks. Specifically, NASAaccess has been developed to meet the need for seamless earth observation remote-sensing and climate data ingestion into various hydrological modeling frameworks. Moreover, NASAaccess is also contributing to keeping interested parties and stakeholders engaged with environmental modeling, accessing the information available in various remote-sensing products. NASAaccess' current capabilities cover various NASA datasets and products that include the Global Precipitation Measurement (GPM) data products, the Global Land Data Assimilation System (GLDAS) land surface states and fluxes, and the NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) Coupled Model Intercomparison Project Phase 5 (CMIP5) and Coupled Model Intercomparison Project Phase 6 (CMIP6) climate change dataset products.
Ibrahim Nourein Mohammed↗
Highly Charged Ions in a New Era of High Resolution X-Ray Astrophysics
X‐ray astronomy and ground‐based atomic physics have a long history of fruitful collaboration: Sound understanding of the underlying atomic physics is the key to reliable interpretation of the spectra from celestial sources; conversely, astronomical spectra have been used to benchmark and advance atomic physics. This interplay is about to become even more important as we enter a new era of high‐resolution X‐ray astrophysics with large effective collection area. Although high‐resolution observations with the gratings on the Chandra and XMM‐Newton observatories continue to drive new science, upcoming planned and proposed missions will open up new discovery space in the near future that is currently challenging to access: high‐resolution spectroscopy on extended sources, in the Fe K band, and on short time scales. This review summarizes open questions in these areas and the design parameters for the Hitomi, XRISM, Athena, and Arcus observatories. The expected high quality of spectra taken with these observatories puts new constraints on the accuracy of atomic reference data required to take full advantage of the diagnostic potential of these spectra.
Natalie Hell↗
Lunar and Meteorite Sample Education Disk Program - Space Rocks for Classrooms, Museums, Science Centers, and Libraries
NASA is eager for students and the public to experience lunar Apollo samples and meteorites first hand. Lunar rocks and soil, embedded in Lucite disks, are available for educators to use in their classrooms, museums, science centers, and public libraries for education activities and display. The sample education disks are valuable tools for engaging students in the exploration of the Solar System. Scientific research conducted on the Apollo rocks reveals the early history of our Earth-Moon system and meteorites reveal much of the history of the early solar system. The rocks help educators make the connections to this ancient history of our planet and solar system and the basic processes accretion, differentiation, impact and volcanism. With these samples, educators in museums, science centers, libraries, and classrooms can help students and the public understand the key questions pursued by many NASA planetary missions. The Office of the Curator at Johnson Space Center is in the process of reorganizing and renewing the Lunar and Meteorite Sample Education Disk Program to increase reach, security and accountability. The new program expands the reach of these exciting extraterrestrial rocks through increased access to training and educator borrowing. One of the expanded opportunities is that trained certified educators from science centers, museums, and libraries may now borrow the extraterrestrial rock samples. Previously the loan program was only open to classroom educators so the expansion will increase the public access to the samples and allow educators to make the critical connections to the exciting exploration missions taking place in our solar system. Each Lunar Disk contains three lunar rocks and three regolith soils embedded in Lucite. The anorthosite sample is a part of the magma ocean formed on the surface of Moon in the early melting period, the basalt is part of the extensive lunar mare lava flows, and the breccias sample is an important example of the violent impact history of the Moon. The disks also include two regolith soils and orange glass from a pyroclastic deposit. Each Meteorite Disk contains two ordinary chondrites, one carbonaceous chondrite, one iron, one stony iron, and one achondrite. These samples will help educators share the early history of the solar system with students and the public. Educators may borrow either lunar or meteorite disks and the accompanying education materials through the Johnson Space Center Curatorial Office. In trainings provided by the NASA Aerospace Education Services Program specialists, educators certified to borrow the disk learn about education resources, the proper use of the samples, and the special security for care and shipping of the disks. The Lunar and Meteorite Sample Education Disk Program will take NASA exploration to more people. Getting Space Rocks out to the public and inspiring the public about new space exploration is the focus of the NASA disk loan program.
Allen, Jaclyn↗
Advancing Open Source Science Initiatives Through Public-Private Partnerships
Collaboration is fundamental to advancing open science within the science community. With the recent developments in technology and research, the establishment of formal partnerships between the private sector and government agencies are needed to bridge the knowledge gaps and expedite the time to actionable science. NASA’s Interagency Implementation and Advanced Concepts Team (IMPACT) seeks to address this challenge by establishing non-reimbursable Space Act Agreements with industry leaders in cloud computing, artificial intelligence (AI) and machine learning. The purpose of these agreements is to advance open source science initiatives in the areas of data discovery, access and use of high value NASA science data sets on the cloud. As well as, jointly work on common research problems to accelerate the development and adoption of new AI technologies. Current success stories include co-locating NASA datasets from multiple science disciplines on one platform using Amazon Web Services Open Data Registry, developing AI Foundation Models for Science with IBM and co-hosting training workshops and tutorials for the science community aimed at providing hands-on experience with using NASA data and AI models on the cloud. In summary, we will present an overview of our partnerships supporting open source science initiatives, describe current activities and lessons learned that may be useful to others considering similar partnerships with the private sector.
Elizabeth Fancher↗
A New Architecture for Visualization: Open Mission Control Technologies
Open Mission Control Technologies (MCT) is a new architecture for visualisation of mission data. Driven by requirements for new mission capabilities, including distributed mission operations, access to data anywhere, customization by users, synthesis of multiple data sources, and flexibility for multi-mission adaptation, Open MCT provides users with an integrated customizable environment. Developed at NASAs Ames Research Center (ARC), in collaboration with NASAs Advanced Multimission Operations System (AMMOS) and NASAs Jet Propulsion Laboratory (JPL), Open MCT is getting its first mission use on the Jason 3 Mission, and is also available in the testbed for the Mars 2020 Rover and for development use for NASAs Resource Prospector Lunar Rover. The open source nature of the project provides for use outside of space missions, including open source contributions from a community of users. The defining features of Open MCT for mission users are data integration, end user composition and multiple views. Data integration provides access to mission data across domains in one place, making data such as activities, timelines, telemetry, imagery, event timers and procedures available in one place, without application switching. End user composition provides users with layouts, which act as a canvas to assemble visualisations. Multiple views provide the capability to view the same data in different ways, with live switching of data views in place. Open MCT is browser based, and works on the desktop as well as tablets and phones, providing access to data anywhere. An early use case for mobile data access took place on the Resource Prospector (RP) Mission Distributed Operations Test, in which rover engineers in the field were able to view telemetry on their phones. We envision this capability providing decision support to on console operators from off duty personnel. The plug-in architecture also allows for adaptation for different mission capabilities. Different data types and capabilities may be added or removed using plugins. An API provides a means to write new capabilities and to create data adaptors. Data plugins exist for mission data sources for NASA missions. Adaptors have been written by international and commercial users. Open MCT is open source. Open source enables collaborative development across organizations and also makes the product available outside of the space community, providing a potential source of usage and ideas to drive product design and development. The combination of open source with an Apache 2 license, and distribution on GitHub, has enabled an active community of users and contributors. The spectrum of users for Open MCT is, to our knowledge, unprecedented for mission software. In addition to our NASA users, we have, through open source, had users and inquires on projects ranging from Internet of Things, to radio hobbyists, to farming projects. We have an active community of contributors, enabling a flow of ideas inside and outside of the space community.
Trimble, Jay↗
Latent Catalysis as a Platform for Accessing Diverse Material Properties in Vat Photopolymerization 3D Printing
Vat photopolymerization (VP) 3D printing is an attractive strategy to manufacture customized polymer parts. The properties of printed materials are limited by the need to employ a low viscosity liquid resin and achieve rapid polymerization kinetics. To circumvent this limitation, dual‐cure methods have been developed using reagents embedded in the liquid resin formulation; however, the reagent‐based approach requires the discovery and optimization of new chemistry for each desired material. Here, in this work, we demonstrate a catalytic, dual‐cure platform that enables access to both Nylon‐6 and polyester interpenetrating networks through VP 3D printing under a universal approach. Structure–reactivity relationships of the latent NHC catalysts led to the identification of a magnesium chloride–NHC adduct as a latent catalyst that is orthogonal to radical polymerization and can be unmasked at elevated temperatures post‐printing to initiate ring‐opening polymerization of lactones and lactams. This strategy results in access to semicrystalline materials, which are a challenging morphology to access via VP 3D printing, that have attractive mechanical properties and can be printed at high resolution. This work represents the first photochemical‐based 3D printing of Nylon‐based materials and demonstrates the value of catalytic approaches to access new material properties in VP 3D printing.
Colliver, Cali N. [University of North Carolina, C↗
E-Standards For Mass Properties Engineering
A proposal is put forth to promote the concept of a Society of Allied Weight Engineers developed voluntary consensus standard for mass properties engineering. This standard would be an e-standard, and would encompass data, data manipulation, and reporting functionality. The standard would be implemented via an open-source SAWE distribution site with full SAWE member body access. Engineering societies and global standards initiatives are progressing toward modern engineering standards, which become functioning deliverable data sets. These data sets, if properly standardized, will integrate easily between supplier and customer enabling technically precise mass properties data exchange. The concepts of object-oriented programming support all of these requirements, and the use of a JavaTx based open-source development initiative is proposed. Results are reported for activity sponsored by the NASA Langley Research Center Innovation Institute to scope out requirements for developing a mass properties engineering e-standard. An initial software distribution is proposed. Upon completion, an open-source application programming interface will be available to SAWE members for the development of more specific programming requirements that are tailored to company and project requirements. A fully functioning application programming interface will permit code extension via company proprietary techniques, as well as through continued open-source initiatives.
Cerro, Jeffrey A.↗
Open Science for Life in Space: Data Sharing and Tools for Knowledge Discovery
The next era in human space exploration is rapidly approaching. The use of health countermeasures and biomonitoring systems for space missions are required to counteract space health hazards and to support life to thrive in deep space (e.g., humans, animals, plants, crops; entire ecosystems within spacecrafts/habitats/spacesuits). The development of these mission components will be highly dependent on our understanding of basic biological and health responses to myriad space hazards (ionizing radiation, altered gravitational fields, altered day-night cycles, confined isolation, hostile-closed environments, distance-duration from Earth, planetary dust-regolith, and extreme temperatures/atmospheres). The fast-growing array of space biological and mission telemetry data, which in the past was simply archived after minimal analysis, holds great potential once applied to these mission challenges if it can be reorganized and formatted for Open Science. Organizing the data for such analysis is a challenge because of its multi-hierarchical, multi-modal, and heterogenous nature (molecular, cellular, tissue, organ, whole organism, behavior, ecosystem, microbiome; tabular, omics, imaging, video, biospecimen, environmental physical-chemical telemetry). This session focuses on current approaches in this domain such as: making space biological data FAIR (findable, accessible, interoperable, reusable), effective data ingestion/dissemination, observational versus experimental data, Open Science collaborations, data analysis techniques, AI/ML/knowledge graph/modeling methods, and data integration/discovery tools.
open science↗
Characterizing parallel file-access patterns on a large-scale multiprocessor
Rapid increases in the computational speeds of multiprocessors have not been matched by corresponding performance enhancements in the I/O subsystem. To satisfy the large and growing I/O requirements of some parallel scientific applications, we need parallel file systems that can provide high-bandwidth and high-volume data transfer between the I/O subsystem and thousands of processors. Design of such high-performance parallel file systems depends on a thorough grasp of the expected workload. So far there have been no comprehensive usage studies of multiprocessor file systems. Our CHARISMA project intends to fill this void. The first results from our study involve an iPSC/860 at NASA Ames. This paper presents results from a different platform, the CM-5 at the National Center for Supercomputing Applications. The CHARISMA studies are unique because we collect information about every individual read and write request and about the entire mix of applications running on the machines. The results of our trace analysis lead to recommendations for parallel file system design. First the file system should support efficient concurrent access to many files, and I/O requests from many jobs under varying load conditions. Second, it must efficiently manage large files kept open for long periods. Third, it should expect to see small requests predominantly sequential access patterns, application-wide synchronous access, no concurrent file-sharing between jobs appreciable byte and block sharing between processes within jobs, and strong interprocess locality. Finally, the trace data suggest that node-level write caches and collective I/O request interfaces may be useful in certain environments.
Purakayastha, Apratim↗
VESIcal Part I: An open-source thermodynamic model engine for mixed volatile (H2O-CO2) solubility in silicate melts
Thermodynamics has been fundamental to the interpretation of geologic data and modeling of geologic systems for decades. However, more recent advancements in computational capabilities and a marked increase in researchers’ accessibility to computing tools has outpaced the functionality and extensibility of currently available modeling tools. Here we present VESIcal (Volatile Equilibria and Saturation Identification calculator): the first comprehensive modeling tool for H 2 O, CO 2 , and mixed (H 2 O-CO 2 ) solubility in silicate melts that: a) allows users access to seven commonly used models, plus easy inter-comparison between models; b) provides universal functionality for all models (e.g., functions for calculating saturation pressures, degassing paths, etc.); c) can process large datasets (1,000’s of samples) automatically; d) can output computed data into an excel spreadsheet for simple post-modeling analysis; e) integrates advanced plotting capabilities directly within the tool; and f) provides all of these within the framework of a python library, making the tool extensible by the user and allowing any of the model functions to be incorporated into any other code capable of calling python. The tool is presented within this manuscript, which is a Jupyter notebook containing worked examples accessible to python users with a range of skill levels. The basic functions of VESIcal can also be access via a web app (https://vesical.anvil.app). The VESIcal python library is open-source and available for download at https://github.com/kaylai/VESIcal.
K. Iacovino↗
Breaking Barriers: Integrating Geo-Leo Aerosol Data with an Open-Source Approach
The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively fusing the polar observations with various spatial and temporal resolutions. However, the merged data will present a significant ""Big Data"" challenge, including processing, storage, data discoverability, accessibility, and migration within cloud computing environments. We have developed an open-source package to fuse aerosol optical depths (AOD) products from six satellite sensors in the past four years (2019~2023), and this presentation will update our recent progress. Using this Python-based package, we produced a level 3 global (AOD) product in a quarter-degree spatial resolution every half-hour, fusing the Level 2 AOD data with the Dark Target aerosol retrieval algorithm from six satellites: three geostationary (GOES-16/17 and Himawari-8) with high temporal resolution, and three polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS) with global coverage. By integrating these observations, the diurnal cycle of global AOD in this fused product can be characterized at local, regional, and global scales. Furthermore, we are committed to openness and transparency by providing our package and its associated functionalities as open-source. Our dedication to adhering to the FAIR, CARE, and TRUST principles ensures that our users can rely on the integrity and ethical standards of our work. For instance of Interoperability, this package fuses remote sensing products on demand into desired temporal and spatial domains. It can be run in a central processing unit (CPU) or a Graphics processing unit (GPU) mode. This package will empower researchers and practitioners to use satellite and sensor data efficiently in various applications and research.
Xiaohua Pan↗
High School Citizen Scientists Use AI/ML to Predict Intra-Ocular Pressure From Gene Expression Data for Spaceflown Mice
Artificial Intelligence (AI) and Machine Learning (ML) have increasingly become pivotal in biological and biomedical research, largely due to the culture of open data sharing and its associated benefits. The methodologies inherent in AI/ML are particularly adept at identifying and forecasting biological phenotypes from the vast amounts of data generated by next-generation sequencing technologies. These techniques offer substantial promise for advancing research in space biosciences and for the development of automated systems for monitoring space health. Nevertheless, there are crucial aspects to consider when training, validating, and testing machine learning models in both biological research and clinical contexts. It is essential that Open Science principles, including data sharing and the availability of open-source code, are complemented by high-quality, publicly accessible training resources. These resources should focus on best practices and include modules based on real-world scientific cases and data to ensure that future AI/ML practitioners gain practical experience with genuine problems. Addressing this knowledge gap, we have designed, developed, and delivered both interactive and self-paced training programs for citizen scientists worldwide, enabling them to utilize AI/ML for space biology research. This initiative was made possible through generous funding from a Transformation to Open Science Training grant. The interactive training sessions, conducted this summer, utilized AI/ML techniques to analyze data from the Open Science Data Repository, specifically targeting the effects of spaceflight on ocular structure and function. The dataset OSD-583, from the Rodent Research 9 mission, provides experimental data detailing the ocular responses of mice subjected to a 35-day spaceflight, compared with ground control counterparts. Using OSD-583 as observational data, our summer training participants applied AI/ML methods to predict intraocular pressure from RNA-seq data and identify the genes most predictive of the observed responses. Further analysis through pathway enrichment and gene set enrichment revealed that these genes are involved in molecular and cellular processes contributing to retinal degeneration.
James Casaletto↗
Effect of microstructure and temperature on nuclear graphite oxidation using the 3D Random Pore Model
This work compared the 3D Random Pore Model (3D-RPM) with experimental and characterization data to systematically study the effect of nuclear graphite microstructure and air oxidation temperature. It is well known that oxidation-induced weight loss at elevated temperatures degrades graphite structure and properties; however, a fundamental understanding of the role of graphite microstructure is still unclear. In this work, three diverse grades of nuclear graphite—IG-110, NBG-18, and PCEA—were examined and tested at air oxidation temperatures of 600, 650, 700, and 750 °C following ASTM D7542. Here, the 3D-RPM reproduced the microstructure and temperature dependence of mass loss curves for these grades. For the first time, measurements and modeling were combined to show how bulk density and the amount and spatial distribution of open and closed porosity affects oxidation. IG-110 was less dense and had an open pore network that is finer and more uniformly spread, and showed fastest oxidation. PCEA porosity was less uniform and showed less oxidation, while NBG-18 was more dense, had the least fine and uniform porosity, and showed the slowest oxidation. In general, oxidation proceeds faster if open porosity is more uniformly distributed and can incrementally access closed pore surface area with more ease.
36 MATERIALS SCIENCE↗
Impact of operating reserve rules on electricity prices with high penetrations of renewable energy
In competitive wholesale electricity markets, significant effort is devoted to designing markets that set efficient prices for maintaining supply-demand balance. One factor that can impact prices is administratively-set scarcity pricing, which sets prices to a preset level when the market is not able to meet operating reserve or energy requirements. When energy and operating reserves are co-optimized, assumptions surrounding operating reserve requirements and scarcity pricing can impact system-wide price outcomes for both operating reserves and energy. This study uses production cost modeling of an ERCOT-like system to evaluate the impact of operating reserve eligibility, scarcity pricing, and quantity rules on electricity prices, and therefore also on generator revenues. Results reveal economic and operational benefits with allowing open participation in reserve markets, as this enables greater access to the full set of capable resources at lowest cost. Furthermore, both energy and reserve prices are strongly impacted by reserve scarcity pricing events, which reveals that reserve scarcity pricing assumptions can impact price outcomes even for units not providing reserves. This study highlights the importance of operating reserve scarcity pricing rules because of the strong coupling between energy and reserve prices and because these rules serve as proxies for true price responsive demand.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗