Wide-Area Technologies and Services in the Trans-Pacific High Data Rate (HDR) Satellite Communications Experiments
Explore the source record for details and available documents.
distributed system high definition↗
SEARCH · Engineering Papers
Results for “data infrastructure”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Implementation of a Multichannel Serial Data Streaming Algorithm using the Xilinx Serial RapidIO Solution
In the current world of applications that use reconfigurable technology implemented on field programmable gate arrays (FPGAs), there is a need for flexible architectures that can grow as the systems evolve. A project has limited resources and a fixed set of requirements that development efforts are tasked to meet. Designers must develop robust solutions that practically meet the current customer demands and also have the ability to grow for future performance. This paper describes the development of a high speed serial data streaming algorithm that allows for transmission of multiple data channels over a single serial link. The technique has the ability to change to meet new applications developed for future design considerations. This approach uses the Xilinx Serial RapidIO LOGICORE Solution to implement a flexible infrastructure to meet the current project requirements with the ability to adapt future system designs.
RapidIO↗
Adoption of a token-based authentication model for the CMS Submission Infrastructure
The CMS Submission Infrastructure (SI) is the main computing resource provisioning system for CMS workloads. A number of HTCondor pools are employed to manage this infrastructure, which aggregates geographically distributed resources from the WLCG and other providers. Historically, the model of authentication among the diverse components of this infrastructure has relied on the Grid Security Infrastructure (GSI), based on identities and X509 certificates. In contrast, commonly used modern authentication standards are based on capabilities and tokens. The WLCG has identified this trend and aims at a transparent replacement of GSI for all its workload management, data transfer and storage access operations, to be completed during the current LHC Run 3. As part of this effort, and within the context of CMS computing, the Submission Infrastructure group is in the process of phasing out the GSI part of its authentication layers, in favor of IDTokens and Scitokens. The use of tokens is already well integrated into the HTCondor Software Suite, which has allowed us to fully migrate the authentication between internal components of SI. Additionally, recent versions of the HTCondor-CE support tokens as well, enabling CMS resource requests to Grid sites employing this CE technology to be granted by means of token exchange. After a rollout campaign to sites, successfully completed by the third quarter of 2022, the totality of HTCondor CEs in use by CMS are already receiving Scitoken-based pilot jobs. On the ARC CE side, a parallel campaign was launched to foster the adoption of the REST interface at CMS sites (required to enable token-based job submission via HTCondor-G), which is nearing completion as well. In this contribution, the newly adopted authentication model will be described. We will then report on the migration status and final steps towards complete GSI phase out in the CMS SI.
Pérez-Calero Yzquierdo, Antonio↗
Energy-Community-Geo-Database
Fundamental to understanding evolving infrastructure and technology is understanding the drivers for energy communities that affect where and how infrastructure is placed and used. An Energy Community Geo Database aligned to carbon storage systems will aid stakeholders in decision making around key future infrastructure (e.g., CCS injection locations) placement while helping contextualize these analyses against past and present-day social and environmental attributes. Much of the data required to support analyses are available from authoritative, largely governmental sources, but at present are disparate and require time-consuming acquisition, integration, and upkeep for currency. The CCS-EC-GB v2.0 integrates datasets from various federal agencies and authoritative sources to aid stakeholders and decision makers of the social and environmental factors that might impact the viability of CCS and energy related project implementation. There are 5 categories in the CCS-EC-GB v2 database. Most of the layers within each category have been updated in this version. As compared to the old database, there is 1 new category in the CCS-EC-GB v2 database: infrastructure. This is an evolving project and application will be updated periodically with new datasets and information. Notes for consideration: This database/web map will be updated with additional as new data and information becomes available and has been processed, reviewed, and approved for release. Additional state and federal entity data are planned to be integrated and included in future revisions. Summary layers provided in this application are derived from proprietary layers and do not always contain key features (age, status, or TVD) and therefore might not be shown when data are queried for those features.
CCS,Carbon capture and storage,Carbon storage,U.S.↗
Detecting Abnormal Machine Characteristics in Cloud Infrastructures
In the cloud computing environment resources are accessed as services rather than as a product. Monitoring this system for performance is crucial because of typical pay-peruse packages bought by the users for their jobs. With the huge number of machines currently in the cloud system, it is often extremely difficult for system administrators to keep track of all machines using distributed monitoring programs such as Ganglia1 which lacks system health assessment and summarization capabilities. To overcome this problem, we propose a technique for automated anomaly detection using machine performance data in the cloud. Our algorithm is entirely distributed and runs locally on each computing machine on the cloud in order to rank the machines in order of their anomalous behavior for given jobs. There is no need to centralize any of the performance data for the analysis and at the end of the analysis, our algorithm generates error reports, thereby allowing the system administrators to take corrective actions. Experiments performed on real data sets collected for different jobs validate the fact that our algorithm has a low overhead for tracking anomalous machines in a cloud infrastructure.
Bhaduri, Kanishka↗
Transportation Hub Infrastructure Expansion: Decision Support Under Uncertainty
The Athena project (www.athena-mobility.org) has worked to investigate the relationship between the Dallas-Fort Worth Airport (DFW) and the greater Dallas area in order to better understand and therefore better inform future decision-making regarding the critical infrastructure that influence mobility between the airport and the city. Through this work, infrastructure related to curbside pickup and drop-off, parking, public transit, and the road network congestion were identified as critical to the operation of the DFW transportation hub. The infrastructure analysis and expansion aspect of the Athena project is focused on the restructuring of the CTA curb as a hierarchical curb and the building or repurposing of parking infrastructure as the interplay between these two areas. Many sources of uncertainty exist that may impact future airport and transportation hub operations, such as passenger volume growth, population demographic changes over time, electric vehicle (EV) adoption rates, and autonomous vehicle (AV) adoption rates. Due to these sources of uncertainty, we have selected for our research a modeling framework that can capture various types of uncertainty and hedge against those uncertainties in the optimization process. We analyze road network and curb congestion, the rise of transportation networking companies, trends in parking usage, existing policies around this infrastructure, airport revenue streams, and other contributing factors to enable infrastructure decision making with less uncertainty. To accomplish this wholistic analysis, we have developed a novel multi-stage, multi-period stochastic optimization model which considers the airport's decisions from 2025-2045 under different possible future macro trajectories and day-to-day variations in operational conditions captured as "annual representation of operations" scenarios with respective probabilities. This model has also been designed to leverage the outputs of various efforts under the Athena project to create a combined decision framework for infrastructure decisions. These various efforts include the route optimization model, the ASPIRES simulation, the mode choice model, and the SUMO traffic simulation. Our computational experiments of this system at scale have resulted in a working version of our infrastructure model which enables the explicit representation and consideration of various sources of uncertainty in the decision process to enable robust, flexible decision-making. This model has been effectively run on NREL's HPC system, Eagle, with large numbers of stochastic scenarios and shows promise as a scalable tool for robust consideration of uncertainties in airport planning. We have tested our model using 30,240 operational circumstances in total, resulting in a problem with more 200 million variables. This model was solved in several different configurations, and a workflow to simulate the performance of the infrastructure model results was developed and deployed. In general, our results indicate that a combination of remote parking, remote curb infrastructure, and dynamic pricing can generate revenue, reduce emissions, accommodate emerging technologies such as AVs and EVs, and manage airport passenger growth over time. We note the success of the proposed strategy depends on the data collection and forecasting abilities of DFW. We have also seen that the AV adoption by TNCs might necessitate larger amounts of remote curb. The results of this work inform strategies for airport infrastructure decision making, as well as demonstrate the value of an adaptable model, but also indicate that there are avenues remaining where further research would be of value.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
White paper on science operations
Major changes are taking place in the way astronomy gets done. There are continuing advances in observational capabilities across the frequency spectrum, involving both ground-based and space-based facilities. There is also very rapid evolution of relevant computing and data management technologies. However, although the new technologies are filtering in to the astronomy community, and astronomers are looking at their computing needs in new ways, there is little coordination or coherent policy. Furthermore, although there is great awareness of the evolving technologies in the arena of operations, much of the existing operations infrastructure is ill-suited to take advantage of them. Astronomy, especially space astronomy, has often been at the cutting edge of computer use in data reduction and image analysis, but has been somewhat removed from advanced applications in operations, which have tended to be implemented by industry rather than by the end-user scientists. The purpose of this paper is threefold. First, we briefly review the background and general status of astronomy-related computing. Second, we make recommendations in three areas: data analysis; operations (directed primarily to NASA-related activities); and issues of management and policy, believing that these must be addressed to enable technological progress and to proceed through the next decade. Finally, we recommend specific NASA-related work as part of the Astrotech-21 plans, to enable better science operations in the operations of the Great Observatories and in the lunar outpost era.
Schreier, Ethan J.↗
OpenPATH and Itinerum Integration: A Case Study of Merging Open-Source Projects: Preprint
Throughout the transportation sector, multiple mobility tracking platforms have been developed independently, in parallel, with similar use cases and infrastructure. Maintaining such platforms on an individual level can result in duplicated effort. Innovation within the field could be slowed by the limited resource of people working on extremely similar projects. We provide a case study in how such platforms can be combined with low effort and provide an example in the mobility domain of what the resulting integration points, modules and ownership may look like. OpenPATH (formerly e-mission) and Itinerum are two examples of similar independently developed human mobility tracking platforms that extend beyond standard traffic data collection. Due to the open source nature of the projects, members from both teams decided to merge the functionality, thereby only hosting a single data collection process and limiting maintenance of separate intake platforms. On the front-end, specific questionnaire functionality from Itinerum, mainly the ability to display and return questions and results focused on sociodemographic attributes, was integrated into the OpenPATH user interface. On the back-end, an export pipeline stage was created to transport collected data back to the Itinerum database. Upon completion, the OpenPATH application retained its original functionality while adding the ability to export data for future data sharing and creating an avenue to incorporate Itinerum hosted questions and answers. Itinerum benefits from the rich feature set and infrastructure of OpenPATH without losing needed elements such as the questionnaire component. This case study, within the transportation sector, illustrates the various configurations in which open source software can be developed, maintained and deployed.
ADVANCED PROPULSION SYSTEMS↗
Authentication of smart grid communications using quantum key distribution
Smart grid solutions enable utilities and customers to better monitor and control energy use via information and communications technology. Information technology is intended to improve the future electric grid’s reliability, efficiency, and sustainability by implementing advanced monitoring and control systems. However, leveraging modern communications systems also makes the grid vulnerable to cyberattacks. Here we report the first use of quantum key distribution (QKD) keys in the authentication of smart grid communications. In particular, we make such demonstration on a deployed electric utility fiber network. The developed method was prototyped in a software package to manage and utilize cryptographic keys to authenticate machine-to-machine communications used for supervisory control and data acquisition (SCADA). This demonstration showcases the feasibility of using QKD to improve the security of critical infrastructure, including future distributed energy resources (DERs), such as energy storage.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Spatiotemporal Variability of Electric System Reliability Metrics
As urbanization continues to grow, urban density also rises, placing significant stress on critical infrastructure. Cities often face challenges in investing in new infrastructure or upgrading existing ones. One area of infrastructure that has come under strain is the electric grid, leading to prolonged power outages. According to data from the U.S. Energy Information Administration, the average duration of power outages has steadily doubled from 2013 to 2021, primarily due to extreme weather events. The IEEE has developed a series of reliability metrics to assess the reliability of the electric system. However, these metrics are only applied at the utility level, making it challenging to comprehend the variations in these indices at finer spatial resolutions and, consequently, evaluate reliability at the non-utility level. In this study, we leveraged electric outage data collected at 15-minute intervals at the county level to estimate electric system reliability over a six-year period using a novel data analysis approach. Our findings reveal a gradual decline in reliability in the U.S. Southwest compared to national averages. Furthermore, the duration of outages per customer per event has significantly decreased in large portions of California and Florida. These discoveries can be valuable for utility companies as they seek to pinpoint regional anomalies and plan for prioritized remediation efforts.
Singh, Nagendra↗
The challenges of theory-software translation
Background: Software is now ubiquitous within research. In addition to the general challenges common to all software development projects, research software must also represent, manipulate, and provide data for complex theoretical constructs. Ensuring this process of theory-software translation is robust is essential to maintaining the integrity of the science resulting from it, and yet there has been little formal recognition or exploration of the challenges associated with it. Methods: We thematically analyse the outputs of the discussion sessions at the Theory-Software Translation Workshop 2019, where academic researchers and research software engineers from a variety of domains, and with particular expertise in high performance computing, explored the process of translating between scientific theory and software. Results: We identify a wide range of challenges to implementing scientific theory in research software and using the resulting data and models for the advancement of knowledge. We categorise these within the emergent themes of design, infrastructure, and culture, and map them to associated research questions. Conclusions: Systematically investigating how software is constructed and its outputs used within science has the potential to improve the robustness of research software and accelerate progress in its development. We propose that this issue be examined within a new research area of theory-software translation, which would aim to significantly advance both knowledge and scientific practice.
97 MATHEMATICS AND COMPUTING↗
Electric Vehicle Adoption in Illinois
Over 1.3 million plug-in electric vehicles (PEVs) have been sold in the United States since 2010 when the first Chevy Volt and Nissan Leaf vehicles came on the market. Currently, electric vehicles account for about 2% of monthly light-duty vehicle (LDV) sales. More than 40 different electric vehicle models are actively being marketed, and most of these are LDVs. Over the last few years, automakers have brought more models, with varying mileage ranges, to the market, including medium-duty and heavy-duty trucks and buses. Government agencies at the federal, regional, and state levels, as well as utilities across the United States, have provided financial and non-financial incentives to promote electric vehicle adoption and charging infrastructure deployment. Argonne National Laboratory, sponsored by the U.S. Department of Energy, has developed tools and collected data to quantify the energy, economic, and environmental benefits of electric vehicles. This project has three objectives. First, we summarize the policies and other actions of the federal government, various states/regions, and utilities to promote PEV adoption, and evaluate their relative effectiveness based on a review of the literature. Second, we identify possible PEV adoption paths or scenarios that would result in PEVs making up 15% of all on-road vehicles in Illinois, and we quantify the resulting impacts on petroleum consumption and electricity demand. We also summarize the possible reduction in greenhouse gas (GHG) and criteria pollutant emissions due to PEV adoption. The PEV scenarios include private and public adoption of electric cars, light trucks (e.g., sports utility vehicles [SUVs], vans, pickups), medium-duty vehicles (MDVs), and heavy-duty vehicles (HDVs). Third, we estimate hourly charging loads of light-duty PEVs in 2030 associated with these scenarios, incorporating assumptions about vehicle electric range, efficiency, and travel behavior.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
HydroForecast Long-term: Improving hydropower’s resilience to climate change through accurate climate-scale
With hydrologic patterns and water availability across the globe shifting due to climate change, advancements in hydrologic prediction systems can help significantly reduce the uncertainties that utilities and water supply entities have in their decision making. Understanding and estimating hydrology at the climate scale is critical for managing water resources under changing climate scenarios. This project focuses on integrating state-of-the-art neural network modeling with downscaled climate projections to deliver the reliable water supply projections decades into the future to meet an urgent need from hydropower operators and water utilities. In this Phase 1 DOE SBIR proposal, we developed and validated a theory-guided neural network model, HydroForecast Long-term, for climate-scale hydrology and implemented the model within existing HydroForecast infrastructure. HydroForecast Long-term combines the most accurate streamflow modeling system with a flexible and scalable data architecture to generate water supply projections out to the year 2100. This report illustrates that we have achieved our four objectives: 1) create a prototype of HydroForecast Long-term, building the neural network prediction model, 2) build an automated data input pipeline that processes large amounts of data from the latest global temperature and precipitation climate models; 3) benchmark the accuracy of the hydrologic model over the recent two decades over a large set of diverse basins, and 4) create a set of output visuals and summary metrics informed by customer feedback that connect the data to critical decision points. This work empowers water users to make data-informed decisions supporting a resilient, renewable-powered grid and water system. The results advance the Department of Energy’s mission by addressing critical gaps in water supply planning under climate change.
13 HYDRO ENERGY↗
3D hydrogeophysical characterization of managed aquifer recharge basins
Aquifers are increasingly stressed. Managed aquifer recharge provides a potential solution to mitigate this stress and provide sustainable groundwater resources. Subsurface properties are known to have a strong control on the infiltration rates that can be achieved. However, these properties are often highly heterogeneous and difficult to assess with conventional probing techniques. Here, we show the application of 3D geophysical imaging to assess the recharge potential and its variation across several basins used for managed aquifer recharge. We link in-situ measurements of saturated hydraulic conductivity with the electrical resistivity of the subsurface to establish petrophysical relationships and use those relationships to estimate the distribution of hydraulic conductivity throughout the five recharge basins. Our results show a considerable variability in the hydraulic properties, i.e., soil texture and saturated hydraulic conductivity, that have a direct impact on potential infiltration rates. We use the 3D hydraulic property distributions to model groundwater recharge and provide estimates for infiltration rates and volumes, and use this approach to assess the impact of management activities on groundwater recharge performance. Having such data not only enables us to predict infiltration rates, but also provides means for optimizing such water infrastructure.
54 ENVIRONMENTAL SCIENCES↗
Southern Africa Validation of NASA's Earth Observing System (SAVE EOS)
Southern Africa Validation of EOS (SAVE) is 4-year, multidisciplinary effort to validate operational and experimental products from Terra-the flagship satellite of NASA's Earth Observing System (EOS). At test sites from Zambia to South Africa, we are measuring soil, vegetation and atmospheric parameters over a range of ecosystems for comparison with products from Terra, Landsat 7, AVHRR and SeaWiFS. The data are also employed to parameterize and improve vegetation process models. Fixed-point and mobile "transect" sampling are used to collect the ground data. These are extrapolated over larger areas with fine-resolution multispectral imagery. We describe the sites, infrastructure, and measurement strategies developed underSAVE, as well as initial results from our participation in the first Intensive Field Campaign of SAFARI 2000. We also describe SAVE's role in the Kalahari Transect Campaign (February/March 2000) in Zambia and Botswana.
Privette, Jeffrey L.↗
Secure Large-Scale Airport Simulations Using Distributed Computational Resources
To fully conduct research that will support the far-term concepts, technologies and methods required to improve the safety of Air Transportation a simulation environment of the requisite degree of fidelity must first be in place. The Virtual National Airspace Simulation (VNAS) will provide the underlying infrastructure necessary for such a simulation system. Aerospace-specific knowledge management services such as intelligent data-integration middleware will support the management of information associated with this complex and critically important operational environment. This simulation environment, in conjunction with a distributed network of supercomputers, and high-speed network connections to aircraft, and to Federal Aviation Administration (FAA), airline and other data-sources will provide the capability to continuously monitor and measure operational performance against expected performance. The VNAS will also provide the tools to use this performance baseline to obtain a perspective of what is happening today and of the potential impact of proposed changes before they are introduced into the system.
McDermott, William J.↗
Martian Infotech
The U.S. is beginning an $800-million project to create an information technology infrastructure at Mars. This will be essentially a Martian internet where robotic spacecraft will conduct high-data-rate exchanges between themselves and with their Earth-based teams. The objective is to better control increasingly ambitious robotic missions and to return more imagery and data from those flights for faster distribution to the science community and public. The focal point will be the Mars Telecommunication Orbiter (MTO), a Mars orbiting communications satellite already approved and funded by Congress for launch to the red planet in 2009.MTO's advanced operational microwave capability should be able to relay to Earth magnitudes more information than current spacecraft, as well as near real-time images from Nasa's next generation of rovers, also set for launch in 2009.
Covault, Craig↗
NASA's UAS NAS Access Project
The vision of the Unmanned Aircraft System (UAS) Integration in the National Airspace System (NAS) Project is "A global transportation system which allows routine access for all classes of UAS." The goal of the UAS Integration in the NAS Project is to "contribute capabilities that reduce technical barriers related to the safety and operational challenges associated with enabling routine UAS access to the NAS." This goal will be accomplished through a two-phased approach based on development of system-level integration of key concepts, technologies and/or procedures, and demonstrations of integrated capabilities in an operationally relevant environment. Phase 1 will take place the first two years of the Project and Phase 2 will take place the following three years. The Phase 1 and 2 technical objectives are: Phase 1: Developing a gap analysis between current state of the art and the Next Generation Air Transportation System (NextGen) UAS Concept of Operations . Validating the key technical areas identified by this Project . Conducting initial modeling, simulation, and flight testing activities . Completing Sub-project Phase 1 deliverables (spectrum requirements, comparative analysis of certification methodologies, etc.) and continue Phase 2 preparation (infrastructure, tools, etc.) Phase 2: Providing regulators with a methodology for developing airworthiness requirements for UAS, and data to support development of certifications standards and regulatory guidance . Providing systems-level, integrated testing of concepts and/or capabilities that address barriers to routine access to the NAS. Through simulation and flight testing, address issues including separation assurance, communications requirements, and human systems integration in operationally relevant environments. The UAS in the NAS Project will demonstrate solutions in specific technology areas, which will address operational/safety issues related to UAS access to the NAS. Since the resource allocation for this Project is limited ($150M over the five years), the focus is on reducing the technical barriers where NASA has unique capabilities. As a result, technical areas, such as Sense and Avoid (SAA) and beyond line of sight command and control will not be addressed. While these are critical barriers to UAS access, currently, there is a great deal of global effort being exercised to address these challenge areas. Instead, specific technology development in areas where there is certainty that NASA can advance the research to high technology readiness levels will be the Project's focus. Specific sub-projects include Separation Assurance, Human Systems Integration, Communications, Certification, and Integrated Test and Evaluation. Each sub-project will transfer technologies to relevant key stakeholders and decision makers through research transition teams, technology forums, or through other analogous means.
Johnson, Charles W.↗