SEARCH · Engineering Papers

Results for “data infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Reflections on the Shifting Experiences of Scientific Infrastructure

Infrastructure of all types is fundamental to modern work and life. Computing for scientific work, especially, extends from distributed local research sites, often at the edges of other major systems, outward into globally connected high-performance facilities and infrastructures. This commentary reviews longstanding research on the social characteristics of infrastructure. We reflect on social concerns that affect the ongoing development, use, and maintenance of a wide range of scientific computing and data resources. Reflecting on the social nature of infrastructure is timely for Computing in Science & Engineering readers, given continued emphasis on developing even more expansive platforms for data and artificial intelligence work in science (e.g., the United States’ Genesis Mission). We assert that, regardless of technological advances, the complex nature of scientific research and data will require continued understanding of longstanding and nascent social practices across varied communities. This is fundamentally necessary to build and sustain usable infrastructure or platforms that can productively advance scientific research.

Paine, Drew [Lawrence Berkeley National Laboratory↗

NASA NTRS2007

Online Analysis Enhances Use of NASA Earth Science Data

Giovanni, the Goddard Earth Sciences Data and Information Services Center (GES DISC) Interactive Online Visualization and Analysis Infrastructure, has provided researchers with advanced capabilities to perform data exploration and analysis with observational data from NASA Earth observation satellites. In the past 5-10 years, examining geophysical events and processes with remote-sensing data required a multistep process of data discovery, data acquisition, data management, and ultimately data analysis. Giovanni accelerates this process by enabling basic visualization and analysis directly on the World Wide Web. In the last two years, Giovanni has added new data acquisition functions and expanded analysis options to increase its usefulness to the Earth science research community.

Acker, James G.↗

NASA NTRS2010

EDOS Evolution to Support NASA Future Earth Sciences Missions

This paper presents a ground system architecture to service future NASA decadal missions and in particular, the high rate science data downlinks, by evolving EDOS current infrastructure and upgrading high rate network lines. The paper will also cover EDOS participation to date in formulation and operations concepts for the respective missions to understand the particular mission needs and derived requirements such as data volumes, downlink rates, data encoding, and data latencies. Future decadal requirements such as onboard data recorder management and file protocols drive the need to emulate these requirements within the ground system. The EDOS open system modular architecture is scalable to accommodate additional missions using the current sites antennas and future sites as well and meet the data security requirements and fulfill mission's objectives

Cordier, Guy R.↗

DOE OSTI2026

Throughput Estimation of Data Transport Networks From Digital Twin Measurements

Digital twins of networked infrastructures, known as Virtual Infrastructure Twins (VITs), are increasingly used for software development, pre-deployment testing, and design space exploration. While VITs avoid the costs and potential disruptions associated with experiments on operational networks, their throughput measurements are typically not sufficiently accurate for performance profiling of wide-area networks that they emulate. Here, machine learning (ML) methods are developed to transform these inaccurate VIT network throughput measurements to closely match in peak and overall profile of those from a physical testbed or production network. First, a micro kernel network reflecting a physical network is utilized to collect one-time measurements on a host to support this ML transformation. Then, a generic multi-modal ML method is developed to learn a map that transforms measurements from subsequent VITs on the same host to match past, current and follow-on testbed and cloud networks. ML generalization equations are derived to establish its correctness and probabilistically guarantee its generalization accuracy. Experimental results are presented for a variety of VIT hosts with target testbed and cloud networks; they include a case study of a four-site science ecosystem wherein inaccurate convex VIT measurement profiles are transformed into accurate concave profiles of target networks.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Electric Vehicle Charging Infrastructure Trends from the Alternative Fueling Station Locator: Third Quarter 2022

Electric vehicle (EV) charging infrastructure continues to rapidly change and grow. Using data from the U.S. Department of Energy's (DOE) Alternative Fueling Station Locator, this report provides a snapshot of the state of EV charging infrastructure in the United States in the third calendar quarter of 2022 (Q3 2022) by charging level, network, and location. Additionally, this report measures the current state of charging infrastructure compared with two different 2030 infrastructure requirement scenarios. This information is intended to help transportation planners, policymakers, researchers, infrastructure developers, and others understand the rapidly changing landscape of EV charging infrastructure. This is the eleventh report in a series. Reports from previous quarters can be found in the Alternative Fuels Data Center (AFDC) and National Renewable Energy Laboratory (NREL) publication databases, as well as the AFDC Charging Infrastructure Trends page (https://afdc.energy.gov/fuels/electricity_infrastructure_trends.html).

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2023

Electric Vehicle Charging Infrastructure Trends from the Alternative Fueling Station Locator (Fourth Quarter 2022)

Electric vehicle (EV) charging infrastructure continues to rapidly change and grow. Using data from the U.S. Department of Energy's (DOE) Alternative Fueling Station Locator, this report provides a snapshot of the state of EV charging infrastructure in the United States in the fourth calendar quarter of 2022 (Q4 2022) by charging level, network, and location. Additionally, this report measures the current state of charging infrastructure compared with two different 2030 infrastructure requirement scenarios. This information is intended to help transportation planners, policymakers, researchers, infrastructure developers, and others understand the rapidly changing landscape of EV charging infrastructure. This is the twelfth report in a series. Reports from previous quarters can be found in the Alternative Fuels Data Center (AFDC) and National Renewable Energy Laboratory (NREL) publication databases, as well as the AFDC Charging Infrastructure Trends page (https://afdc.energy.gov/fuels/electricity_infrastructure_trends.html).

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

AppSysFusion: CoMingling of appropriate data to drive Codesign of Applications, HPC Platforms, and Monitoring, Analysis, and Feedback Infrastructure.

Abstract not provided.

Brandt, James↗

NASA NTRS2015

The NASA Earth Science Program and Small Satellites

Earth's changing environment impacts every aspect of life on our planet and climate change has profound implications on society. Studying Earth as a single complex system is essential to understanding the causes and consequences of climate change and other global environmental concerns. NASA's Earth Science Division (ESD) shapes an interdisciplinary view of Earth, exploring interactions among the atmosphere, oceans, ice sheets, land surface interior, and life itself. This enables scientists to measure global and climate changes and to inform decisions by Government, other organizations, and people in the United States and around the world. The data collected and results generated are accessible to other agencies and organizations to improve the products and services they provide, including air quality indices, disaster prediction and response, agricultural yield projections, and aviation safety. ESD's Flight Program provides the spacebased observing systems and supporting infrastructure for mission operations and scientific data processing and distribution that support NASA's Earth science research and modeling activities. The Flight Program currently has 21 operating Earth observing space missions, including the recently launched Global Precipitation Measurement (GPM) mission, the Orbiting Carbon Observatory-2 (OCO-2), the Soil Moisture Active Passive (SMAP) mission, and the International Space Station (ISS) RapidSCAT and Cloud-Aerosol Transport System (CATS) instruments. The ESD has 22 more missions and instruments planned for launch over the next decade. These include first and second tier missions from the 2007 Earth Science Decadal Survey, Climate Continuity missions to assure availability of key climate data sets, and small-sized competitively selected orbital missions and instrument missions of opportunity belonging to the Earth Venture (EV) Program. Small satellites (~500 kg or less) are critical contributors to these current and future satellite missions. Some examples are the aforementioned Orbiting Carbon Observatory-2 (OCO-2), the Gravity Recovery and Climate Experiment Follow On (GRACE FO), and the Cyclone Global Navigation Satellite System (CYGNSS) microsatellite constellation. Small satellites also support ESD in space validation and risk reduction of enabling technologies (components and systems). The status of the ESD Flight Program and the role of small satellites will be discussed.

Earth Science Prog & Small Sat↗

NASA NTRS2007

A Contrast in Use of Metrics in Earth Science Data Systems

In recent years there has been a surge in the number of systems for processing, archiving and distributing remotely sensed data. Such systems, working independently as well as in collaboration, have been contributing greatly to the advances in the scientific understanding of the Earth system, as well as utilization of the data for nationally and internationally important applications. Among such systems, we consider those that are developed by or under the sponsorship of NASA to fulfill one of its strategic objectives: "Study Earth from space to advance scientific understanding and meet societal needs." NASA's Earth science data systems are of varying size and complexity depending on the requirements they are intended to meet. Some data systems are regarded as NASA's "Core Capabilities" that provide the basic infrastructure for processing, archiving and distributing a set of data products to a large and diverse user community in a robust and reliable manner. Other data systems constitute "Community Capabilities". These provide specialized and innovative services to data users and/or research products offering new scientific insight. Such data systems are generally supported by NASA through peer reviewed competition. Examples of Core Capabilities are 1. Earth Observing Data and Information System (EOSDIS) with its Distributed Active Archive Centers (DAACs), Science Investigator-led Processing Systems (SIPSs), and the EOS Clearing House (ECHO); 2. Tropical Rainfall Measurement Mission (TRMM) Science Data and Information System (TSDIS); 3. Ocean Data Processing System (ODPS); and 4. CloudSat Data Processing Center. Examples of Community Capabilities are projects under the Research, Education and Applications Solutions Network (REASON), and Advancing Collaborative Connections for Earth System Science (ACCESS) Programs. In managing these data system capabilities, it is necessary to have well-established goals and to measure progress relative to them. Progress is measured through "metrics", which can be a combination of quantitative as well as qualitative assessments. The specific metrics of interest depend on the user of the metrics as well as the type of data system. The users of metrics can be data system managers, program managers, funding agency or the public. Data system managers need metrics for assessing and improving the performance of the system and for future planning. Program managers need metrics to assess progress and the value of the data systems sponsored by them. Also, there is a difference in the metrics needed for core capabilities that tend to be more complex, larger and longer-term compared to community capabilities and the community capabilities that tend to be simpler, smaller and shorter-term. Even among community capabilities there are differences; hence the same set of metrics does not apply to all. Some provide data products to users, some provide services that enable better utilization of data or interoperability among other systems, and some are a part of a larger project where provision of data or services is only a minor activity. There is also a contrast between metrics used for internal and external purposes. Examples of internal purposes are: ensuring that the system meets its requirements, and planning for evolution and growth. Examples of external purposes are: providing to sponsors indicators of success of the systems, demonstrating the contributions of the system to overall program success, etc. This paper will consider EOSDIS, REASON and ACCESS programs to show the various types of metrics needed and how they need to be tailored to the types of data systems while maintaining the overall management goals of measuring progress and contributions made by the data systems.

Ramapriyan, Hampapuram↗

DOE OSTI2022

PAS: Privacy Algorithms in Systems

Today we face an explosion of data generation, ranging from health monitoring to national security infrastructure systems. More and more systems are connected to the Internet that collects data at regular time intervals. These systems share data and use machine learning methods for intelligent decisions, which resulted in numerous real-world applications (e.g., autonomous vehicles, recommendation systems, and heart-rate monitoring) that have benefited from it. However, these approaches are prone to identity thief and other privacy related cyber-security attacks. So, how can data privacy be protected efficiently in these scenarios? More dedicated efforts are needed to propose the integration of privacy techniques into existing systems and develop more advanced privacy techniques to address the complex challenges of multi-system connectivity and data fusion. Therefore, we have introduced Privacy Algorithms in Systems (PAS) at CIKM which provides a venue to gather academic researchers and industry researchers/practitioners to present their research in an effort to advance the frontier of this critical direction of privacy algorithms in systems.

Kotevska, Olivera↗

DOE OSTI2025

Evolution of the ATLAS TDAQ online software framework towards Phase-II upgrade: Use of Kubernetes as an orchestrator of the ATLAS Event Filter computing farm

The ATLAS experiment at the LHC at CERN continuously evolves its TDAQ system to meet the challenges of new physics goals and technological advancements. As ATLAS prepares for the Phase-II Run 4 of the LHC, significant enhancements in the TDAQ Controls and Configuration (TDAQ-CC) tools have been designed to ensure efficient data collection, processing, and management. This abstract presents the evolution of ATLAS TDAQ-CC system leading up to Phase-II Run 4. As part of the evolution towards Phase-II, Kubernetes has been chosen to orchestrate the Event Filter (EF) farm. By leveraging Kubernetes, ATLAS can dynamically allocate computing resources, scale processing capacity in response to changing data taking conditions and ensure high availability of data processing services. The integration of the Kubernetes with the TDAQ Run Control framework enables perfect synchronisation between the experiment’s data acquisition components and the computing infrastructure. We will discuss the architectural considerations and implementation challenges involved in Kubernetes integration with the ATLAS TDAQ-CC system. We will highlight the benefits of using Kubernetes as an EF farm orchestrator, including improved resource utilization, enhanced fault tolerance, and simplified deployment and management of data processing workflows. In addition, we will report on the extensive testing of Kubernetes that was conducted using a farm of 2500 servers within the experiment data taking environment, demonstrating its scalability and robustness in handling the demands of the ATLAS TDAQ system for Phase-II. The adoption of Kubernetes represents a significant step forward in the evolution of ATLAS TDAQ-CC system, aligning with industry best practices in container orchestration.

Corso Radu, Alina [Univ. of California, Irvine, CA↗

DOE OSTI2021

FTS3: Data Movement Service in containers deployed in OKD [Slides]

The File Transfer Service (FTS3) is a data movement service developed at CERN which is used to distribute the majority of the Large Hadron Collider's data across the Worldwide LHC Computing Grid (WLCG) infrastructure. At Fermilab, we have deployed FTS3 instances for Intensity Frontier experiments (e.g. DUNE) to transfer data in America and Europe, using a container-based strategy. In this article we summarize our experience building docker images based on work from the SLATE project (slateci.io) and deployed in OKD, the community distribution of Red Hat OpenShift. Additionally, we discuss our method of certificate management and maintenance utilizing Kubernetes CronJobs. Finally, we also report on the two different configurations currently running at Fermilab, comparing and contrasting a Docker-based OKD deployment against a traditional RPM-based deployment.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

FTS3: Data Movement Service in containers deployed in OKD

Lobato Pardavila, Lorena↗

DOE OSTI2023

Storm-DEPART (Damage Estimate Prediction and Recovery Tool)

Storm-DEPART (Damage Estimate Prediction and Restoration Tool): Each year hurricanes and tropical storms in the United States damage critical infrastructure assets, disrupt the services they provide, and cause millions to billions of dollars in economic impacts due to extended recovery times. The Storm-DEPART tool and analytical output enable more impactful data-driven decision-making capabilities and strengthen national-level disaster preparedness, response, and recovery. Storm-DEPART, built through multi-month collaboration between Entergy and INL, combines Entergy’s critical infrastructure inventory data with weather forecasts to predict damages to Electric utility’s assets due to natural disasters and the estimated recovery support needed, including time, materials, and resource allocation. In the event of an approaching hurricane, this innovative solution can assess potential damage to power generation capacity, transmission grids, distribution networks, and communications assets from wind bands, storm surge, and flooding. With more effective predictions, Entergy can more efficiently allocate resources to mitigate impacts and optimize recovery for customers. Storm-DEPART also allows Electric utilities the ability to apply a planning scenario and model expected damage to better inform infrastructure restoration needs leading to enhance system resiliency. The technology is fully transferrable to other electric utilities with the same damage estimating challenges. The INL team is working on the evolution of Storm-DEPART to include ice event damage prediction framework.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Storm-DEPART (Damage Estimate Prediction and Recovery Tool)

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2020

Recent NASA Wind Tunnel Free-Flight Testing of a Multirotor Unmanned Aircraft System Vehicle

Wind tunnel free-flight tests of a small quadrotor vehicle were completed in the NASA Langley 12-Foot Low Speed Tunnel and 20-Foot Vertical Spin Tunnel. The primary objective of these tests was to acquire flight data in forward and descending flight for the purpose of assessing the fidelity of an all-attitude flight dynamics simulation previously developed from static and dynamic wind tunnel data. A secondary objective was to demonstrate and mature free-flight test methods specific to the emerging class of small unmanned aircraft and urban air mobility vehicles. Experimental flight data correlated well with simulation predictions which included steady trim conditions consistent with straight and level flight and quasi-steady conditions associated with descent velocities prone to vortex ring state development. The test method was shown to be well suited to these classes of vehicles and several unique infrastructure requirements, including tether systems and data acquisition requirements were identified. In addition, unique operational test techniques and safety procedures were developed to accommodate the testing. Results of these tests will be used to support air traffic management studies and research into safety assurance concepts that enable the integration of these classes of vehicles into the National Airspace System.

John V Foster↗

DOE OSTI2023

A Data-Driven Framework for Direct Local Tensile Property Prediction of Laser Powder Bed Fusion Parts

This article proposes a generalizable, data-driven framework for qualifying laser powder bed fusion additively manufactured parts using part-specific in situ data, including powder bed imaging, machine health sensors, and laser scan paths. To achieve part qualification without relying solely on statistical processes or feedstock control, a sequence of machine learning models was trained on 6299 tensile specimens to locally predict the tensile properties of stainless-steel parts based on fused multi-modal in situ sensor data and a priori information. A cyberphysical infrastructure enabled the robust spatial tracking of individual specimens, and computer vision techniques registered the ground truth tensile measurements to the in situ data. The co-registered 230 GB dataset used in this work has been publicly released and is available as a set of HDF5 files. The extensive training data requirements and wide range of size scales were addressed by combining deep learning, machine learning, and feature engineering algorithms in a relay. The trained models demonstrated a 61% error reduction in ultimate tensile strength predictions relative to estimates made without any in situ information. Lessons learned and potential improvements to the sensors and mechanical testing procedure are discussed.

36 MATERIALS SCIENCE↗

NASA NTRSDate not supplied

NASA and Advanced Air Mobility (AAM) National Campaign (NC) Tech Talk: Integrated Data Product

NASA Advanced Air Mobility (AAM) National Campaign has hosted multiple flight tests in a effort to promote public confidence and accelerate the realization of emerging aviation markets for passenger and cargo transportation in urban, suburban, rural, and regional environments. The goals and objectives for each flight test are intended to assess the performance of the vehicle’s capacity to operate safely, efficiently, and sustainably in urban areas. The Airspace Test and Infrastructure (ATI) team processes the flight data to evaluate the effectiveness of air vehicle and airspace management integration, while its analysis capabilities support the assessment of the efficacy of proposed vehicles and ground systems required to enable the vehicles’ operations. The ATI data services team creates many products from the data, first by transforming and merging the data into a single Integrated Data Product (IDP). This aligns data from many sources by time, so that, for example, the winds that impacted a flight can be aligned with its ground track and speed. A detailed IDP enables many types of statistical computation and visualizations that help researchers understand what transpired during the flight and how it can be explained. This Tech Talk will give an overview of the IDP process, including examples of the resulting products created by the data services team. It will also share an application that will allow participants to perform their own data analysis.

National Campaign, Advanced Air Mobility, Integrat↗