Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “scalability test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Provider of Services for Urban Air Mobility (PSU) Prototype Simulation (X5) Final Report

Urban Air Mobility (UAM) is a new air transportation service concept to carry passengers or cargo in metropolitan areas, leveraged by innovative aircraft and air traffic automation technologies. NASA has conducted a series of simulations, called the X-series simulation, to evaluate the UAM concept of operations and support the development of airspace procedures and services for UAM operations. The simulation called “X5” was conducted in 2023 to test a Provider of Services for UAM (PSU) prototype developed by NASA for UAM flight planning, strategic conflict management support, and data exchange between UAM operators. In this simulation, two strategic conflict management capabilities, Demand-Capacity Balancing and Sequencing and Scheduling, were further investigated. This document describes the UAM system architecture modeled, the X5 simulation environment to be executed (e.g., traffic scenario and UAM airspace construct), and the strategic conflict management processes developed and evaluated in this study. Then, the simulation results are provided using several system performance metrics, such as the number of operations planned and activated, demand-capacity imbalances detected and resolved, and pre-departure delays. Based on these metrics, the test findings and lessons learned from this simulation are discussed. NASA developed a PSU prototype as part of a reference implementation of UAM system architecture and evolved strategic conflict management capabilities for UAM operations from the previous collaborative simulations with industry partners. Below is the summary of the achievements: - Aligned NASA’s UAM reference architecture with the FAA’s UAM ConOps notional architecture - Extended UAM airspace management capabilities to include 1) Demand-Capacity Balancing (DCB) to ensure operators coordinate planned usage of shared vertiports, and 2) Sequencing and Scheduling (S&S) at UAM corridor entry and exit points to help facilitate an orderly flow of traffic - Defined the PSU information exchange APIs and requirements towards informing industry standards - Developed and tested a NASA PSU prototype as reference implementation to validate the requirements and APIs - Developed a prototype service connecting NASA’s PSU and the FAA system for testing future PSU-ATM interface requirements - Tested NASA-developed assumptions for UAM operations such as airspace design, procedures, vehicle performance, and strategic conflict management methods to inform future Cooperative Operating Practices (COPs) development with industry - Evaluated system performance metrics such as number of simultaneous operations and ground delays that can help define system-level requirements. The simulation results showed that the UAM traffic demand could be managed to minimize the needs of tactical separation provision with ground delays assigned by DCB and S&S. These accomplishments and the lessons learned from the PSU Prototype X5 simulation activities will be valuable inputs for the Air Mobility Pathfinders (AMP) project, which is NASA’s new project to create and evaluate a reference architecture for safe, secure, and scalable UAM operations.

Simulation↗

Integration of LIBS with Machine Learning for Real-Time Monitoring of Feedstock in H 2 Gasification Applications

This project, funded by the U.S. Department of Energy (DOE) – Office of Fossil Energy under Award Number DE-FE0032177, aimed to assess the feasibility of an integrated Laser-Induced Breakdown Spectroscopy (LIBS) system with advanced machine learning (ML) models for real-time characterization and potential control of hydrogen gasifiers running on waste materials as feedstocks. This was a multidisciplinary effort that encompassed the acquisition and standardized analysis of individual and blended feedstocks—comprising biomass, coal waste, and plastic waste, followed by the development of a dynamic LIBS bench system for material sample analysis and development of predictive ML models. Comprehensive laboratory testing enabled the creation of a robust elemental dataset that served as the foundation for ML model training. Techniques such as Random Forest, Gradient Boosting, Support Vector Regression, and Neural Networks were employed to predict key feedstock properties, including higher heating value (HHV), moisture content, thermal conductivity, and ash composition with high accuracy. The results were validated against experimental data and demonstrated strong potential for real-time application in gasifier control systems. The project concluded with a study on the integration of the LIBS+ML approach for gasifier control and a techno-economic analysis of the implementation of the approach into hydrogen (H 2 ) gasification systems. Dissemination of results was carried out at a DOE meeting. This work establishes a scalable framework for automated, in-line feedstock quality assessment, offering significant implications for process optimization and emissions reduction in hydrogen production.

01 COAL, LIGNITE, AND PEAT↗

A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-Based Climate Data with MapReduce

Climate observations and model simulations are producing vast amounts of array-based spatiotemporal data. Efficient processing of these data is essential for assessing global challenges such as climate change, natural disasters, and diseases. This is challenging not only because of the large data volume, but also because of the intrinsic high-dimensional nature of geoscience data. To tackle this challenge, we propose a spatiotemporal indexing approach to efficiently manage and process big climate data with MapReduce in a highly scalable environment. Using this approach, big climate data are directly stored in a Hadoop Distributed File System in its original, native file format. A spatiotemporal index is built to bridge the logical array-based data model and the physical data layout, which enables fast data retrieval when performing spatiotemporal queries. Based on the index, a data-partitioning algorithm is applied to enable MapReduce to achieve high data locality, as well as balancing the workload. The proposed indexing approach is evaluated using the National Aeronautics and Space Administration (NASA) Modern-Era Retrospective Analysis for Research and Applications (MERRA) climate reanalysis dataset. The experimental results show that the index can significantly accelerate querying and processing (10 speedup compared to the baseline test using the same computing cluster), while keeping the index-to-data ratio small (0.0328). The applicability of the indexing approach is demonstrated by a climate anomaly detection deployed on a NASA Hadoop cluster. This approach is also able to support efficient processing of general array-based spatiotemporal data in various geoscience domains without special configuration on a Hadoop cluster.

big data↗

The Adaptable, Deployable, Entry and Placement Technology (ADEPT) Enabling Advanced Entry, Descent, and Landing Capabilities for SmallSat Missions

The Adaptable, Deployable Entry and Placement Technology (ADEPT) is a mechanically deployable low-ballistic coefficient aeroshell entry system which performs entry, descent, and landing (EDL) functions for a broad range of planetary destinations including Mars, Venus, Titan and Earth. The deployable system allows mission planners to develop an aeroshell design that is stowed like a folded umbrella, and yet prior to the EDL mission segment, transforms into a deployed, near-rigid low ballistic coefficient configuration. The ADEPT architecture is scalable from a sub-1m class to 6m diameter entry vehicles for Venus and and it has been studied at up to 15m – 20m scale for human exploration class missions. There has been growing interest in performing interplanetary missions with small spacecraft as secondary payloads and ADEPT offers small satellite mission designers the ability to consider Aeroassist technologies to expand mission applications. The ADEPT architecture introduces a new approach for entry vehicle design. It deploys a flexible 3D woven carbon fabric as the primary drag surface. It is capable of surviving high aerothermal heating during entry, while maintaining a robust impermeable membrane that provides high drag for vehicle deceleration. The ADEPT project team has advanced this decelerator technology via systems-level testing at the one meter diameter (nano-ADEPT) scale. A subsonic aeroloads test (May 2015) and a pathfinder arc-jet aeroheating test (Sept 2015) and a successful sounding rocket flight (SR-1) launch of a 0.7 meter deployed diameter ADEPT (September 2018). The SR-1 flight experiment demonstrated most of the primary end-to-end mission stages including: launch in a stowed configuration, separation and deployment in zero-g, exo-atmospheric conditions, and passive ballistic re-entry of a 70 degree half-angle cone geometry. The ADEPT SR-1 sounding rocket flight experiment had to address challenges such as stowing within the constrained payload envelope, fabric folding, and packaging concerns.

Paul Wercinski↗

Cost‐Effective and Scalable Approach for the Separation and Direct Cathode Recovery from End‐of‐Life Li‐Ion Batteries

Li-ion battery recycling presents a promising opportunity to decrease dependence on foreign sources of materials and harvest precious materials within the United States. Herein, a superior complete direct recycling process on individual end-of-life cells is reported where the recovered high-purity cathode active material, as well as electrolyte salt Li hexafluorophosphate (LiPF 6 ) can be reused without significant processing. This new process utilizes a series of mechanical separation steps that enable the separation of the cathode and anode active materials while they are still attached to their current collectors. Using this type of process can significantly reduce metal contamination and enable a clean cathode that can be directly recycled. The process if implemented commercially can greatly reduce the environmental burden of batteries as the greenhouse gas emissions of 8.25 kg CO 2 e kg −1 from the direct recycling process are 64% lower compared to those from virgin production of cathode material. During electrochemical testing of the recovered LiNi 0.6 Mn 0.2 Co 0.2 O 2 a discharge capacity of ≈160 mAh g −1 and good cyclability of over 250 cycles at 0.33C are achieved. This success paves a new pathway to explore and optimize existing Li-ion battery recycling procedures.

electrolyte reuse↗

Upper Class E Traffic Management: NASA's Collaborative Research and Technical Development to Enable Routine, Safe, and Scalable High Altitude Operation

In the past, operations at high altitudes have been limited in number and largely conducted for defense/security purposes. However, with broad technological advances, a growing number of commerical and public good use cases, and a significant rise in the number of capable platforms, the demand for operating in high altitude airspace - known as upper Class E in the United States - is increasing. With that increase in demand comes the need for a means to manage the airspace in a way that does not burden current air traffic services and infrastructure given that provisions for commercial operations are limited. NASA, in collaboration with other government agencies and strong representation from industry, has developed a cooperative approach to airspace management referred to as Upper Class E Traffic Management (ETM). Key aspects of the ETM concept are the ability to exchange information through services that enable the operators to share airspace in cetain areas by adhering to cooperative operating practices (COPs) and by having shared situation awareness. To advance the concept, NASA recently developed and formally tested the first dedicated reference ETM system and supportin architecture. The test involved real-time simulation of high altitude operations with a diverse set of aircraft and encourter situations that included industry partners connected to the system from their remote operating centers. This presentation will provide attendees with an understanding of the ETM concept, the details and importance of the system that has been developed, an overview of the groundbreaking simulation, and a glimpse of things to come in our next steps.

Conrad Dang-Gabriel↗

Face Recognition Oak Ridge (FaRO): A Framework for Distributed and Scalable Biometrics Applications

The facial biometrics community has seen a recent abundance of high-accuracy facial analytic models become freely available. Although these models' capabilities in facial detection, landmark detection, attribute analysis, and recognition are ever-increasing, they aren't always straightforward to deploy in a real-world environment. In reality, the use of the field's ever growing collection of models is becoming exceedingly difficult as library dependencies update and deprecate. Researchers often encounter headaches when attempting to utilize multiple models requiring different or conflicting software packages. Face Recognition Oak Ridge (FaRO) is an open-source project designed to provide a highly modular, flexible framework for unifying facial analytic models through a compartmentalized plug-and-play paradigm built on top of the gRPC (Google Remote Procedure Call) protocol. FaRO's server-client architecture and flexible portability allows easy construction of modularized and heterogeneous face analysis pipelines, distributed over many machines with differing hardware and software resources. This paper outlines FaRO's architecture and current capabilities, along with some experiments in model testing and distributed scaling through FaRO.

Bolme, David↗

Newton trust-region methods with primary variable switching for simulating high temperature multiphase porous media flow

Coupling multiphase flow with energy transport due to high temperature heat sources introduces significant new challenges since boiling and condensation processes can lead to dry-out conditions with subsequent re-wetting. The transition between two-phase and single-phase behavior can require changes to the primary dependent variables adding discontinuities as well as extending constitutive nonlinear relations to extreme physical conditions. Practical simulations of large-scale engineered domains lead to Jacobian systems with a very large number of unknowns that must be solved efficiently using iterative methods in parallel on high-performance computers. Performance assessment of potential nuclear repositories, carbon sequestration sites and geothermal reservoirs can require numerous Monte-Carlo simulations to explore uncertainty in material properties, boundary conditions, and failure scenarios. Due to the numerical challenges, standard NR iteration may not converge over the range of required simulations and require more sophisticated optimization method like trust-region. In this study, we use the open-source simulator PFLOTRAN for the important practical problem of the safety assessment of future nuclear waste repositories in the U.S. DOE geologic disposal safety assessment Framework. The simulator applies the PETSc parallel framework and a backward Euler, finite volume discretization. We demonstrate failure of the conventional NR method and the success of trust-region modifications to Newton’s method for a series of test problems of increasing complexity. Trust-region methods essentially modify the Newton step size and direction under some circumstances where the standard NR iteration can cause the solution to diverge or oscillate. Furthermore, we show how the Newton Trust-Region method can be adapted for Primary Variable Switching (PVS) when the multiphase state changes due to boiling or condensation. The simulations with high-temperature heat sources which led to extreme nonlinear processes with many state changes in the domain did not converge with NR, but they do complete successfully with the trust-region methods modified for PVS. This implementation effectively decreased weeks of simulation time needing manual adjustments to complete a simulation down to a day. Finally, we show the strong scalability of the methods on a single node and multiple nodes in an HPC cluster.

54 ENVIRONMENTAL SCIENCES↗

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗

Predicting measures of soil health using the microbiome and supervised machine learning

Soil health encompasses a range of biological, chemical, and physical soil properties that sustain the commercial and ecological value of agroecosystems. Monitoring soil health requires a comprehensive set of diagnostics that can be cost-prohibitive for routine analyses. The soil microbiome provides a rich source of information about soil properties, which can be assayed in a high-throughput, cost-effective way. We evaluated the accuracy of random forest (RF) and support vector machine (SVM) regression and classification models in predicting 12 measures of soil health, tillage status, and soil texture from 16S rRNA gene amplicon data with an operationally relevant sample set. We validated the efficacy of the best performing models against independent datasets and also tested best practices for processing microbiome data for use in machine learning. Soil health metrics could be predicted from microbiome data with the best models achieving a Kappa value of ~0.65, for categorical assessments, and a R2 value of ~0.8, for numerical scores. Biological health ratings were better predicted than chemical or physical ratings. Validation with independent datasets revealed that models had general predictive value for soil properties, including yield. The ecological profiles of several taxa important for model accuracy matched the observed relationships with soil health, including Pyrinomonadaceae, Nitrososphaeraceae, and Candidatus Udeaobacter. Models trained at the highest taxonomic resolution proved most accurate, with losses in accuracy resulting from rarefying, sparsity filtering, and aggregating at higher taxonomic ranks. Furthermore, our study provides the groundwork for developing scalable technology to use microbiome-based diagnostics for the assessment of soil health.

16S rRNA gene↗

Compact Radiative Control Structures for Millimeter Astronomy

We have designed, fabricated, and tested compact radiative control structures, including antireflection coatings and resonant absorbers, for millimeter through submillimeter wave astronomy. The antireflection coatings consist of micromachined single crystal silicon dielectric sub-wavelength honeycombs. The effective dielectric constant of the structures is set by the honeycomb cell geometry. The resonant absorbers consist of pieces of solid single crystal silicon substrate and thin phosphorus implanted regions whose sheet resistance is tailored to maximize absorption by the structure. We present an implantation model that can be used to predict the ion energy and dose required for obtaining a target implant layer sheet resistance. A neutral density filter, a hybrid of a silicon dielectric honeycomb with an implanted region, has also been fabricated with this basic approach. These radiative control structures are scalable and compatible for use large focal plane detector arrays.

Brown, Ari D.↗

Advancing stream temperature prediction with a generalizable large-sample framework across CONUS river reaches

Accurately predicting stream temperature in ungauged basins remains a critical challenge for water resource management, thermoelectric power plant cooling, and ecosystem conservation. Large-sample machine learning models trained on hundreds of well-monitored river basins have shown remarkable performance; however, such models have yet to be developed solely using forcing data that can be readily extracted to simulate stream temperatures anywhere in the contiguous United States (CONUS). In this study, we present a scalable, large-sample deep learning framework using Long Short-Term Memory (LSTM) networks to simulate daily stream temperatures in ungauged basins across the CONUS. The framework leverages both modeled reanalysis of meteorological and streamflow inputs as well as static attributes available for all 2.7 million CONUS river reaches in the National Hydrography Dataset Plus (NHDPlusV2). By generating dynamical inputs from predefined thermally relevant upstream contributing areas, rather than the entire upstream basin, the model also offers improvements in very large basins where full-basin averaging can dilute the most important influences on stream temperature. Evaluated across 300 basins, the model achieves a median Mean Absolute Error (MAE) of 1.1 °C and a Nash-Sutcliffe Efficiency (NSE) of 0.95 on temporally and spatially distinct test folds—comparable to models trained exclusively using meteorological and streamflow observational data. The flexible, high-performing framework generalizes to any unmonitored river reach without significant regulation or unnatural thermal input immediately upstream, substantially expanding predictive capabilities in data-scarce regions.

Hydrology↗

Compact ammonia reforming at low temperature using catalytic membrane reactors

Ammonia is a leading carrier for the storage and transport of renewable hydrogen, but its deployment requires scalable technologies for efficient decomposition and purification. In this work, we report on the efficient delivery of high purity hydrogen from ammonia decomposition using a catalytic membrane reactor (CMR). Improvements to the electroless plating process reduced the Pd membrane thickness by >35%, resulting in commensurate increases in hydrogen permeance without sacrificing selectivity. To increase throughput a commercial Ru/Al 2 O 3 catalyst was added to the lumen, and the CMR could process ammonia flowrates 10–50 times higher than an equivalent packed bed reactor while maintaining the same level of conversion. It is shown that the earth-abundant zeolite clinoptilolite could reduce ammonia impurities in the permeated H 2 to the levels required by PEM fuel cells (<25 ppb). Performance increased significantly across a >500-h durability test due to improvements in membrane permeability. Finally, the results show that CMRs are a viable technology for distributed production of hydrogen from ammonia.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Semi-Transparent Perovskite Solar Cells in a Stacked Tandem Module: Cooperative Research and Development Final Report, CRADA Number CRD-19-00810

This project seeks to develop device design, materials composition, and processing tools and parameters to fabricate semi-transparent perovskite solar cells and modules for application in stand-alone products or added to other solar cells in a mechanically stacked tandem configuration. This technology presents significant advanced manufacturing challenges and opportunities in getting to scale, including development of perovskite inks, scalable perovskite and heterojunction deposition and annealing processes, heterojunction composition, transparent electrode composition and deposition process, anti-reflection layer composition and deposition process, and cell to module integration processes. Modification 5: The proposed project seeks to develop device design, materials composition, and processing tools and parameters to fabricate semi-transparent perovskite solar cells and modules for application in stand-alone products or added to other solar cells in a mechanically-stacked tandem configuration. This technology presents significant advanced manufacturing challenges and opportunities in getting to scale, including development of perovskite inks, scalable perovskite and heterojunction deposition and annealing processes, heterojunction composition, transparent electrode composition and deposition process, passivation layers including in module scribes, anti-reflection layer composition and deposition process, and cell to module integration processes. Advanced metrology and characterization will be performed on perovskite films, cells and module. Furthermore, we will examine module or materials recycling for circular economy considerations. Modifcation 6: Gigahertz frequency microwave pump-probe spectroscopies are highly sensitive to thin film semiconductor photoconductivity of individual and stacks of layers that comprise perovskite solar cells. As such, these techniques will be used to qualify reproducibility and quality correlations during the manufacturing process. Modification 7: Mechanical adhesion of top contacts within perovskite modules significantly impacts the durability of the module when exposed to accelerated degradation testing. The adhesion between the perovskite/transport layer interface and the transport layer/top contact interface are both very sensitive small changes in processing. ALD processing conditions of the transport layer will be tuned to optimize the mechanical adhesion within the perovskite module stack.

14 SOLAR ENERGY↗

Hydrogen underground storage for grid electricity storage: An optimization study on techno-economic analysis

Here, this study performs a techno-economic analysis of hydrogen underground storage systems for grid electricity storage, evaluating their economic viability at the plant scale using dynamic optimization. It explores the feasibility of various system configurations and revenue models in the context of volatile electricity prices and the necessity for multiple revenue streams. The hypothesis tested is that large-scale hydrogen storage, despite its low round-trip efficiency, can be economically viable with the right mix of revenue streams. This study uses scenario-based analysis to assess the impacts of different system configurations, including engaging in time-shifting arbitrage, ancillary service markets and blending hydrogen with natural gas. Results indicate potential annual net cash flows of up to $\$$1.5 million from ancillary services integration and $\$$5.2 million from natural gas blending, contingent on specific system sizes. The study concludes that hydrogen underground storage for grid electricity storage can be profitable, and emphasizes that proper system design and precise electricity price forecasting are crucial for optimizing system performance and economic returns. This research sets the stage for further investigations into the scalability of hydrogen storage systems and their broader implications for grid electricity storage and energy market dynamics.

25 ENERGY STORAGE↗

Effect of 3D-printed surface textures on wear mechanism in 3-body abrasion of soil

This study systematically investigates the enhancement of wear resistance in 3D printed surface textures through both experimental and theoretical approaches. Three distinct surface morphologies (Smooth Surface, Surface with uniformly distributed Pits, and Surface with uniformly distributed Bumps) were fabricated using High-Impact Polystyrene, where the meso-scale textures were precisely controlled through the 3D printing process. Wear behavior was evaluated using a 3-body wear tester in an abrasive particle environment, analyzing the influence of surface textures under various operating conditions. Systematic wear tests revealed that optimally designed surface textures achieved a remarkable 77 % reduction in wear compared to the worst-performing sample. The wear mechanisms were comprehensively characterized through weight loss measurements, Scanning Electron Microscopy (SEM), and Energy Dispersive Spectroscopy (EDS) analyses, elucidating the surface morphology changes and their interaction with wear particles. Notably, the study identified how the geometric characteristics of surface textures influence the movement of wear particles and the distribution of contact stresses. Discrete element method simulations corroborated the experimental findings, providing theoretical validation for the enhanced wear resistance of the optimal structure. The high correlation between simulated wear patterns and experimental results validates the reliability of the proposed design methodology. In conclusion, these results demonstrate that 3D printed surface texturing offers a cost-effective and scalable approach to significantly improve wear resistance in engineering applications, presenting a practical alternative to conventional, high-cost surface engineering methods.

3-body abrasion↗

Use Computer-Aided Tools to Parallelize Large CFD Applications

Porting applications to high performance parallel computers is always a challenging task. It is time consuming and costly. With rapid progressing in hardware architectures and increasing complexity of real applications in recent years, the problem becomes even more sever. Today, scalability and high performance are mostly involving handwritten parallel programs using message-passing libraries (e.g. MPI). However, this process is very difficult and often error-prone. The recent reemergence of shared memory parallel (SMP) architectures, such as the cache coherent Non-Uniform Memory Access (ccNUMA) architecture used in the SGI Origin 2000, show good prospects for scaling beyond hundreds of processors. Programming on an SMP is simplified by working in a globally accessible address space. The user can supply compiler directives, such as OpenMP, to parallelize the code. As an industry standard for portable implementation of parallel programs for SMPs, OpenMP is a set of compiler directives and callable runtime library routines that extend Fortran, C and C++ to express shared memory parallelism. It promises an incremental path for parallel conversion of existing software, as well as scalability and performance for a complete rewrite or an entirely new development. Perhaps the main disadvantage of programming with directives is that inserted directives may not necessarily enhance performance. In the worst cases, it can create erroneous results. While vendors have provided tools to perform error-checking and profiling, automation in directive insertion is very limited and often failed on large programs, primarily due to the lack of a thorough enough data dependence analysis. To overcome the deficiency, we have developed a toolkit, CAPO, to automatically insert OpenMP directives in Fortran programs and apply certain degrees of optimization. CAPO is aimed at taking advantage of detailed inter-procedural dependence analysis provided by CAPTools, developed by the University of Greenwich, to reduce potential errors made by users. Earlier tests on NAS Benchmarks and ARC3D have demonstrated good success of this tool. In this study, we have applied CAPO to parallelize three large applications in the area of computational fluid dynamics (CFD): OVERFLOW, TLNS3D and INS3D. These codes are widely used for solving Navier-Stokes equations with complicated boundary conditions and turbulence model in multiple zones. Each one comprises of from 50K to 1,00k lines of FORTRAN77. As an example, CAPO took 77 hours to complete the data dependence analysis of OVERFLOW on a workstation (SGI, 175MHz, R10K processor). A fair amount of effort was spent on correcting false dependencies due to lack of necessary knowledge during the analysis. Even so, CAPO provides an easy way for user to interact with the parallelization process. The OpenMP version was generated within a day after the analysis was completed. Due to sequential algorithms involved, code sections in TLNS3D and INS3D need to be restructured by hand to produce more efficient parallel codes. An included figure shows preliminary test results of the generated OVERFLOW with several test cases in single zone. The MPI data points for the small test case were taken from a handcoded MPI version. As we can see, CAPO's version has achieved 18 fold speed up on 32 nodes of the SGI O2K. For the small test case, it outperformed the MPI version. These results are very encouraging, but further work is needed. For example, although CAPO attempts to place directives on the outer- most parallel loops in an interprocedural framework, it does not insert directives based on the best manual strategy. In particular, it lacks the support of parallelization at the multi-zone level. Future work will emphasize on the development of methodology to work in a multi-zone level and with a hybrid approach. Development of tools to perform more complicated code transformation is also needed.

Jin, H.↗