Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Access”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Quantifying and Understanding the Access Time to Dockless Micromobility: A Case Study in Washington, D.C.

Micromobility has been widely deployed in many cities. Similar as how access time/distance affects the travel demand to use public transit and informs transit system design, access time/distance to micromobility service measures its service efficiency and also serves as an equity indicator to inform city agencies from a regulation perspective. Though there is an increasing need to understand it, access to micromobility has not been sufficiently studied. This paper developed a framework to quantity the access time to dockless micromobility service (i.e., the minimum time needed to walk to reach the closest dockless micromobility vehicles). Based on the real-time vehicle location data collected from Washington, DC, this research quantified the access time to dockless micromobility, analyzed its spatial and temporal variation patterns and investigated its relationship with socio-demographic variables (i.e., population density, employment density and low-income population). The results revealed that the access time to dockless micromobility ranges between 0 to 4 minutes with the most frequently observed range of 0.5 to 1 minutes, and the city center area tends to have shorter access time than the outskirts areas. Results also indicate a quite stable access time level in DC with access time standard deviation of 0.2 to 0.5 minutes. After correlating the access time at census-block-group level with socio-demographic data, it was discovered that shorter access time usually aligns with larger population and employment density, and the proportion of low-income population was found not helpful with explaining the access time variation, which indicating a relatively equitable micromobility program.

access time↗
NASA NTRS1996

User-Centered Indexing for Adaptive Information Access

We are focusing on information access tasks characterized by large volume of hypermedia connected technical documents, a need for rapid and effective access to familiar information, and long-term interaction with evolving information. The problem for technical users is to build and maintain a personalized task-oriented model of the information to quickly access relevant information. We propose a solution which provides user-centered adaptive information retrieval and navigation. This solution supports users in customizing information access over time. It is complementary to information discovery methods which provide access to new information, since it lets users customize future access to previously found information. It relies on a technique, called Adaptive Relevance Network, which creates and maintains a complex indexing structure to represent personal user's information access maps organized by concepts. This technique is integrated within the Adaptive HyperMan system, which helps NASA Space Shuttle flight controllers organize and access large amount of information. It allows users to select and mark any part of a document as interesting, and to index that part with user-defined concepts. Users can then do subsequent retrieval of marked portions of documents. This functionality allows users to define and access personal collections of information, which are dynamically computed. The system also supports collaborative review by letting users share group access maps. The adaptive relevance network provides long-term adaptation based both on usage and on explicit user input. The indexing structure is dynamic and evolves over time. Leading and generalization support flexible retrieval of information under similar concepts. The network is geared towards more recent information access, and automatically manages its size in order to maintain rapid access when scaling up to large hypermedia space. We present results of simulated learning experiments.

Chen, James R.↗
DOE OSTI2022

Energy Resilience for Mission Assurance: Agile Co-simulation for Cyber Energy System Security (ACCESS), Model Advancements for Resilience Analysis

Agile Co-simulation for Cyber Energy System Security (ACCESS) is a co-simulation platform developed by Lawrence Livermore National Laboratory (LLNL). The primary high-level use-case for ACCESS is to study existing or new cyber-physical critical infrastructure systems, with a heavy emphasis on 1) systems that utilize communication networks, and 2) studies that seek to understand cyber-related system impacts. ACCESS is currently used for several energy system resilience projects at LLNL. In the Energy Resilience for Mission Assurance (ERMA) project, ACCESS is used in the Modeling for Metric Calculation task (specifically, subtask 4.3, Communications and Cyber Modeling) to model and simulate the cyber and communication system aspects of Defense Critical Electric Infrastructure (DCEI) systems, with a focus on computing specific communication system metrics that can impact system resilience and mission performance. Simulated communication system performance will be fed back to other ERMA system components so that mission performance can be evaluated holistically. This report describes several enhancements to the ACCESS platform that were implemented during the execution of the ERMA project in support of reslience analysis. This includes the addition of new models and subsystems, enhancements to existing models, and integration with external systems. The remainder of this report is structured as follows. In Section 2, a brief background description of the ACCESS platform is provided, including an outline of ACCESS components, example usecases, and a set of communication network resilience metrics that can be computed with ACCESS. Section 3 describes the ACCESS model enhancements for ERMA in detail. Finally, Section 4 briefly outlines future integration opportunities between ACCESS and project participant capabilities identified during the progression of the project.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Energy Resilience for Mission Assurance, Agile Co-simulation for Cyber Energy System Security (ACCESS) Model Advancements for Resilience Analysis (Version 3, July 2023)

Agile Co-simulation for Cyber Energy System Security (ACCESS) is a co-simulation platform developed by Lawrence Livermore National Laboratory (LLNL). The primary high-level use-case for ACCESS is to study existing or new cyber-physical critical infrastructure systems, with a heavy emphasis on 1) systems that utilize communication networks, and 2) studies that seek to understand cyber-related system impacts. ACCESS is currently used for several energy system resilience projects at LLNL. In the Energy Resilience for Mission Assurance (ERMA) project, ACCESS is used in the Mod eling for Metric Calculation task (specifically, subtask 4.3, Communications and Cyber Modeling) to model and simulate the cyber and communication system aspects of Defense Critical Electric Infrastructure (DCEI) systems, with a focus on computing specific communication system metrics that can impact system resilience and mission performance. Simulated communication system per formance will be fed back to other ERMA system components so that mission performance can be evaluated holistically. This report describes several enhancements to the ACCESS platform that were implemented during the execution of the ERMA project in support of reslience analysis. This includes the addition of new models and subsystems, enhancements to existing models, and integration with external systems. The remainder of this report is structured as follows. In Section 2, a brief background description of the ACCESS platform is provided, including an outline of ACCESS components, example use cases, and a set of communication network resilience metrics that can be computed with ACCESS. Section 3 describes the ACCESS model enhancements for ERMA in detail. Finally, Section 4 briefly outlines future integration opportunities between ACCESS and project participant capabilities identified during the progression of the project.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2013

Access Control of Web- and Java-Based Applications

Cybersecurity has become a great concern as threats of service interruption, unauthorized access, stealing and altering of information, and spreading of viruses have become more prevalent and serious. Application layer access control of applications is a critical component in the overall security solution that also includes encryption, firewalls, virtual private networks, antivirus, and intrusion detection. An access control solution, based on an open-source access manager augmented with custom software components, was developed to provide protection to both Web-based and Javabased client and server applications. The DISA Security Service (DISA-SS) provides common access control capabilities for AMMOS software applications through a set of application programming interfaces (APIs) and network- accessible security services for authentication, single sign-on, authorization checking, and authorization policy management. The OpenAM access management technology designed for Web applications can be extended to meet the needs of Java thick clients and stand alone servers that are commonly used in the JPL AMMOS environment. The DISA-SS reusable components have greatly reduced the effort for each AMMOS subsystem to develop its own access control strategy. The novelty of this work is that it leverages an open-source access management product that was designed for Webbased applications to provide access control for Java thick clients and Java standalone servers. Thick clients and standalone servers are still commonly used in businesses and government, especially for applications that require rich graphical user interfaces and high-performance visualization that cannot be met by thin clients running on Web browsers

Tso, Kam S.↗
DOE OSTI2024

Inappropriate antibiotic access practices at the community level in Eastern Ethiopia

Access to antibiotic medications is critical to achieving the Sustainable Development Goal for good health and well-being. However, non-prescribed and informal sources are implicated as the most common causes of inappropriate antibiotic access practices, resulting in untargeted therapy, which leads to antibiotic resistance. Hence, knowing antibiotic access practices at the community level is essential to target misuse sources. In this study, 2256 household representatives were surveyed between July and September 2023 to examine their antibiotic access practices. Of 1245 household members who received antibiotics, 45.6% did so inappropriately. Non-prescribed antibiotic access was more common among urban residents and individuals not enrolled in health insurance schemes. This means of antibiotic access was also more common among individuals concerned about distance, drug availability, and healthcare convenience at public facilities. In addition, women and rural individuals were more likely to get antibiotics from unauthorized sources. Unrestricted antibiotic dispensing practices in urban areas enabled their non-prescribed access, while unlicensed providers prevailed with this access practice in rural areas. In this regard, personal behaviors and healthcare-related gaps such as the lack of health insurance, inconvenience, and drug unavailability have led community members to seek antibiotics from unofficial and non-prescribed sources. Targeting the identified behavioral and institutional factors can enhance antibiotic access through prescriptions, hence reducing antibiotic resistance.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Incorporating Social Vulnerability Variables in Measures to Quantify Access to Opportunities

Herein this study quantifies access to travel opportunities to understand what societal factors are linked with local access and to identify communities with reduced access. We introduce a method to compare accessibility across all census tracts in the United States that can be used across geographically diverse communities ranging from sparsely to densely populated areas. This study considers six key opportunities which we consider essential for all communities (grocery stores, public schools, daycares, primary care doctors, pharmacies, and parks), and six additional destinations which can be viewed as a social safety net (homeless shelters, women’s shelters, food pantries, libraries, vocational schools, and banks). We quantify accessibility to these opportunities within a 15 min walk, transit trip, bicycle ride, and automobile drive for every census tract in the United States, and observe a decrease in vehicle miles traveled and vehicle ownership in tracts with increased walkability. Through analysis at the census tract level, this study incorporates variables of social vulnerability with these cumulative opportunity metrics to better understand diminished accessibility as attributed to social and racial inequities. As example findings, we find decreased access to financial services in communities with high minority and limited English speaking populations, no apparent change in access for childcare in communities with high percentages of single-parent families, and potentially increased or decreased access to women’s healthcare resources for Black women depending on the travel mode.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Navigating Urban Mobility: Evaluating Infrastructure Strategies for Enhanced Energy-Efficient Access for Micromobility

Cities and communities continue to expand pedestrian and bicycle infrastructure as part of their sustainable mobility and post-pandemic recovery plans. However, the emergence of micro-mobility (e.g., electric bicycles) has created new challenges for urban transport planning. As the popularity of micro-mobility modes has grown, so have safety concerns due to rising injuries, thus challenging many cities to come up with regulatory measures that enable efficient access while minimizing negative impacts from micro-mobility. Leveraging the Open-Source Tool (Mobility Energy Productivity metric), powered by an open-source dataset (OpenStreetMap), and enhanced through the incorporation of perceived discomfort (level-of-traffic stress), this research study focuses on evaluating the accessibility implications of infrastructure planning and regulatory measures for micro-mobility. Five scenarios pertaining to level of traffic stress, sidewalk access, traffic calming, and bike lane coverage were tested in the Denver-Aurora region in Colorado. Maximum improvements in energy-efficient access are realized when allowing sidewalks for micro-mobility use. Cities and planning agencies could leverage this information to assess sidewalk use policies for micro-mobility, while ensuring pedestrian safety and ADA access. Results indicate that expansion of bicycle lane coverage yields 11% accessibility benefits for micro-mobility compared to implementing traffic calming measures yielding 3% accessibility improvements. Further, it was observed most of the population in the Denver-Aurora region is experiencing lower accessibility in-part due to presence of a high-stress connections in the network. Although not generalizable, the use of open-source data and access calculation methodology, make this analysis reproducible and transferable to other locations.

ADVANCED PROPULSION SYSTEMS↗
NASA NTRS2004

Accessing FMS Functionality: The Impact of Design on Learning

In modern commercial and military aircraft, the Flight Management System (FMS) lies at the heart of the functionality of the airplane. The nature of the FMS has also caused great difficulties learning and accessing this functionality. This study examines actual Air Force pilots who were qualified on the newly introduced advanced FMS and shows that the design of the system itself is a primary source of difficulty learning the system. Twenty representative tasks were selected which the pilots could be expected to accomplish on an ' actual flight. These tasks were analyzed using the RAFIV stage model (Sherry, Polson, et al. 2002). This analysis demonstrates that a great burden is placed on remembering complex reformulation of the task to function mapping. 65% of the tasks required retaining one access steps in memory to accomplish the task, 20% required two memorized access steps, and 15% required zero memorized access steps. The probability that a participant would make an access error on the tasks was: two memorized access steps - 74%, one memorized access step - 13%, and zero memorized access steps - 6%. Other factors were analyzed as well, including experience with the system and frequency of use. This completed the picture of a system with many memorized steps causing difficulty with the new system, especially when trying to fine where to access the correct function.

Fennell, Karl↗
DOE OSTI2024

Enriching OpenStreetMap network data for transportation applications: Insights into the impact of urban congestion on accessibility

OpenStreetMap (OSM) data is a valuable open-source resource for various transportation, traffic, and planning applications. However, OSM network data lack operating traffic speed information, which is critical for transport planning and operations. Addressing this shortcoming, this study leverages commercial vendor data (to serve as ground truth) with exogenous, open-source variables characterizing local transport infrastructure, land use, and demographic information to predict average congested traffic speeds on OSM networks. Three machine-learning models were tested and estimated for OSM links with and without speed limit information in the Denver metropolitan region. Among these, XGBoost performed best, with mean absolute errors of 3.27 and 3.62 mph for links with and without speed limits, respectively. The developed models accurately predicted traffic speeds for different hours and days of the week compared to ground truth data. Using these predicted speeds, drive accessibility scores were computed for the Denver region for different time periods using the Mobility Energy Productivity (MEP) metric to understand the impact of congestion on energy-efficient accessibility. Results show that congestion-adjusted drive accessibility can be significantly lower compared to accessibility calculated using free flow speeds. Specifically, weekday evening hours saw a 42 % drop in accessibility due to reduced speeds, particularly around downtown Denver. Across the Denver metro region, approximately half as many opportunities and jobs are accessible in under 20 min by car during the evening peak period relative to free flow conditions. These findings underscore the importance of using congestion-adjusted operating speeds rather than speed limits in accessibility calculations, as reliance on speed limits can substantially overestimate energy-efficient drive accessibility in large, car-centric cities susceptible to significant congestion. In conclusion, the methodology presented here could further enrich OSM network data, making them useful for an even broader range of transportation applications.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Delayed access to feed early post-hatch affects the development and maturation of gastrointestinal tract microbiota in broiler chickens

Background: The first two weeks of post-hatch (PH) growth in broilers (meat-type birds) are critical for gut development and microbiota colonization. In the current broiler production system, chicks may not receive feed and water for 24 to 72 h due to variations in hatching time and hatchery management. Post-hatch feed delay affects body weight, feed efficiency, mortality, and gut development. The goal of this study was to investigate changes in the microbiome in broiler chickens early PH and the effect of delayed access to feed on the microbiota. Results: Chicks either received feed and water immediately after hatch or access to feed was delayed for 48 h to mimic commercial hatchery settings (treatment, TRT). Both groups were sampled (n = 6) at -48, 0, 4 h, and 1 (24 h), 2 (48 h), 3 (72 h), 4 (96 h), 6 (144 h), 8 (192 h), 10 (240 h), 12 (288 h) and 14 (336 h) days PH. Ileal (IL) and cecal (CE) epithelial scrapings (mucosal bacteria, M) and digesta (luminal bacteria, L) were collected for microbiota analysis. Microbiota was determined by sequencing the V3-V4 region of bacterial 16S rRNA and analyzed using QIIME2. The microbiota of early ileal and cecal samples were characterized by high abundance of unclassified bacteria. Among four bacterial populations (IL-L, IL-M, CE-L, CE-M), IL-M was the least affected by delayed access to feed early PH. Both alpha and beta diversities were affected by delayed access to feed PH in IL-L, CE-M and CE-L. However, the development effect was more pronounced. In all four bacterial populations, significant changes due to developmental effect (time relative to hatch) was observed in taxonomic composition, with transient changes of bacterial taxa during the first two weeks PH. Delayed access to feed has limited influence on bacterial composition with only a few genera and species affected in all four bacterial populations. Predicted function based on 16S rRNA was also affected by delayed access to feed PH with most changes in metabolic pathway richness observed in IL-L, CE-L and CE-M. Conclusions: These results show transient changes in chicken microbiota biodiversity during the first two weeks PH and indicate that delayed access to feed affects microbiota development. Proper microbiota development could be an important factor in disease prevention and antibiotic use in broiler chickens. Moreover, significant differences in response to delayed access to feed PH between luminal and mucosal bacterial populations strongly suggests the need for separate analysis of these two populations.

16S↗
DOE OSTI2026

Optimal Methods for Estimating Cactus Pear Biomass Using Cladode Dimensions of Morphologically Diverse Accessions

Current allometric methods for photosynthetic-stem (cladode) plants, such as cactus pear (Opuntia spp.), require refinement to be used in field settings in which diverse accessions are grown. We analysed cladode dimensional data using 14 accessions representing four species and two hybrids to quantify statistically significant morphological differences among accessions and derived cross-accession models to approximate cladode fresh weight. A Box model using cladode dimensions (e.g., length, width, thickness and diameter) and factorial combinations of these measures (e.g., length*width*thickness*diameter vs. fresh weight) resulted in the highest coefficient of determination (R 2 = 0.95 general fit) across all accessions for estimating fresh weight along with parsimony estimates using the Schwarz–Bayes Criterion (SBC), which assesses the most consistent performance on individual accessions. A Fitting-box modelling approach used the measured cladode area captured using ImageJ (R 2 = 0.93 general fit). Lastly, an Elliptical model used an elliptical approximation for the measured area and performed well over all accessions (R 2 = 0.94 general fit) while avoiding extensive manual measurements. These models meet or exceed the performance of previously published approaches when applied across morphologically diverse accessions, providing efficient tools for nondestructive estimation of cactus pear biomass under the conditions tested.

Opuntia↗
DOE OSTI2023

Microbiome differences in sugarcane and metabolically engineered oilcane accessions and their implications for bioenergy production

Abstract Oilcane is a metabolically engineered sugarcane ( Saccharum spp. hybrid) that hyper-accumulates lipids in its vegetable biomass to provide an advanced feedstock for biodiesel production. The potential impact of hyper-accumulation of lipids in vegetable biomass on microbiomes and the consequences of altered microbiomes on plant growth and lipid accumulation have not been explored so far. Here, we explore differences in the microbiome structure of different oilcane accessions and non-modified sugarcane. 16S SSU rRNA and ITS rRNA amplicon sequencing were performed to compare the characteristics of the microbiome structure from different plant compartments (leaf, stem, root, rhizosphere, and bulk soil) of four greenhouse-grown oilcane accessions and non-modified sugarcane. Significant differences were only observed in the bacterial microbiomes. In leaf and stem microbiomes, more than 90% of the entire microbiome of non-modified sugarcane and oilcane was dominated by similar core taxa. Taxa associated with Proteobacteria led to differences in the non-modified sugarcane and oilcane microbiome structure. While differences were observed between multiple accessions, accession 1566 was notable in that it was consistently observed to differ in its microbial membership than other accessions and had the lowest abundance of taxa associated with plant-growth-promoting bacteria. Accession 1566 is also unique among oilcane accessions in that it has the highest constitutive expression of the WRI 1 transgene. The WRI 1 transcription factor is known to contribute to significant changes in the global gene expression profile, impacting plant fatty acid biosynthesis and photomorphogenesis. This study reveals for the first time that genetically modified oilcanes associate with distinct microbiomes. Our findings suggest potential relationships between core taxa, biomass yield, and TAG in oilcane accessions and support further research on the relationship between plant genotypes and their microbiomes.

09 BIOMASS FUELS↗
NASA NTRS2004

Access from Space: A New Perspective on NASA's Space Transportation Technology Requirements and Opportunities

The need for robust and reliable access from space is clearly demonstrated by the recent loss of the Space Shuttle Columbia; as well as the NASA s goals to get the Shuttle re-flying and extend its life, build new vehicles for space access, produce successful robotic landers and s a q k ret~rr? ~llisrions, and maximize the science content of ambitious outer planets missions that contain nuclear reactors which must be safe for re-entry after possible launch aborts. The technology lynch pin of access from space is hypersonic entry systems such the thermal protection system, along with navigation, guidance and control (NG&C). But it also extends to descent and landing systems such as parachutes, airbags and their control systems. Current space access technology maturation programs such as NASA s Next Generation Launch Technology (NGLT) program or the In-Space Propulsion (ISP) program focus on maturing laboratory demonstrated technologies for potential adoption by specific mission applications. A key requirement for these programs success is a suitable queue of innovative technologies and advanced concepts to mature, including mission concepts enabled by innovative, cross cutting technology advancements. When considering space access, propulsion often dominates the capability requirements, as well as the attention and resources. From the perspective of access from space some new cross cutting technology drivers come into view, along with some new capability opportunities. These include new miniature vehicles (micro, nano, and picosats), advanced automated systems (providing autonomous on-orbit inspection or landing site selection), and transformable aeroshells (to maximize capabilities and minimize weight). This paper provides an assessment of the technology drivers needed to meet future access from space mission requirements, along with the mission capabilities that can be envisioned from innovative, cross cutting access from space technology developments.

Rasky, Daniel J.↗
NASA NTRS2008

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗
NASA NTRSDate not supplied

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗
NASA NTRS2015

Enhancing Discovery, Search, and Access of NASA Hydrological Data by Leveraging GEOSS

An ongoing NASA-funded project has removed a longstanding barrier to accessing NASA data (i.e., accessing archived time-step array data as point-time series) for selected variables of the North American and Global Land Data Assimilation Systems (NLDAS and GLDAS, respectively) and other EOSDIS (Earth Observing System Data Information System) data sets (e.g., precipitation, soil moisture). These time series (data rods) are pre-generated. Data rods Web services are accessible through the CUAHSI Hydrologic Information System (HIS) and the Goddard Earth Sciences Data and Information Services Center (GES DISC) but are not easily discoverable by users of other non-NASA data systems. The Global Earth Observation System of Systems (GEOSS) is a logical mechanism for providing access to the data rods. An ongoing GEOSS Water Services project aims to develop a distributed, global registry of water data, map, and modeling services cataloged using the standards and procedures of the Open Geospatial Consortium and the World Meteorological Organization. The ongoing data rods project has demonstrated the feasibility of leveraging the GEOSS infrastructure to help provide access to time series of model grid information or grids of information over a geographical domain for a particular time interval. A recently-begun, related NASA-funded ACCESS-GEOSS project expands on these prior efforts. Current work is focused on both improving the performance of the generation of on-the-fly (OTF) data rods and the Web interfaces from which users can easily discover, search, and access NASA data.

GEOSS↗
DOE OSTI2021

Pore accessibility and trapping of methane in Marcellus shale

Accessibility of pore space in unconventional reservoirs is an important factor influencing both methane storage capacity and the kinetics of methane desorption. The determination of open (accessible) versus closed (inaccessible) porosity is therefore vital for the prediction of gas production potential. This study investigates accessibility of pores to methane in overmature middle Devonian Marcellus shale samples (cut parallel and perpendicular to bedding) using small and ultra-small neutron scattering (SANS and USANS) with contrast matching (CM), supplemented by other complementary techniques, such as mercury injection capillary pressure (MICP) and low pressure gas (N2 and CO2) adsorption. Our results demonstrate that for the samples studied, only about 6 % of pores with diameter 25-500 nm are accessible to methane. The accessibility fraction for pores larger than 500 nm is 35%. For nanopores smaller than 25 nm, pore accessibility could not be quantitatively determined due to increased methane density and condensation effects in confinement. Our observations indicate that methane penetrates the accessible small mesopores and micropores down to at least 1 nm in diameter, and the density of confined deuterated methane (CD4) is 0.68 g/cm3 for pores of diameter 25 nm and gradually increases with the decreased pore size. Moreover, elevated gas pressure causes formation of additional high-density methane nano-clusters. These clusters have a form of slightly anisotropic polydisperse discs oriented along bedding plane, about 1-12 nm in diameter and with average thickness of 3.6 nm. Utilizing samples cut parallel and perpendicular to the bedding, this study also briefly addresses anisotropy of pores. Based on the iso-size intensity ratio R, our SANS and USANS results demonstrate anisotropy in the out-of-bedding direction and suggest that the degree of anisotropy depends on the pore size. Specifically, for pore diameters ~2.5 to 250 nm, the extent of anisotropy is smaller than for pores ~500 nm to 6 µm in diameter. Finally, comparison of pore size distribution results calculated from SANS/USANS to those obtained using MICP shows good agreement at low pressures, but large difference at pressures above 1000 bar. Here, this discrepancy requires further testing; it is possible that the high mercury pressure used in MICP alters the mesopore and micropore structure of shales.

03 NATURAL GAS↗