Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reproducible research”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Vapor Deposition Process for Engineering of Dispersed PEMFC ORR Pt/NbO x /C Catalysts

With support from the Department of Energy, and in partnership with Oak Ridge National Laboratory, Exothermics, Northeastern University, the University of Michigan, and IRD Fuel Cells, Ford has led an effort to use physical vapor deposition (PVD) to produce oxygen reduction reaction (ORR) catalysts for proton exchange membrane fuel cells (PEMFCs). Conventional ORR catalysts are made by wet chemical processes, and experience loss of electrochemical surface area and activity over voltage cycling due to Pt dissolution and Pt particle coalescence. Not only was PVD processing researched as a means to reduce solvent waste and enhance reproducibility in catalyst manufacturing, but it was also perceived as a means to deposit preferential phases of niobium oxide onto the catalyst, which would then serve to prevent Pt particle movement and extend PEMFC lifetime.

08 HYDROGEN↗

A Review of Inkjet Printed Graphene and Carbon Nanotubes Based Gas Sensors

Graphene and carbon nanotube (CNT)-based gas/vapor sensors have gained much traction for numerous applications over the last decade due to their excellent sensing performance at ambient conditions. Inkjet printing various forms of graphene (reduced graphene oxide or modified graphene) and CNT (single-wall nanotubes (SWNTs) or multiwall nanotubes (MWNTs)) nanomaterials allows fabrication onto flexible substrates which enable gas sensing applications in flexible electronics. This review focuses on their recent developments and provides an overview of the state-of-the-art in inkjet printing of graphene and CNT based sensors targeting gases, such as NO 2 , Cl 2 , CO 2 , NH 3 , and organic vapors. Moreover, this review presents the current enhancements and challenges of printing CNT and graphene-based gas/vapor sensors, the role of defects, and advanced printing techniques using these nanomaterials, while highlighting challenges in reliability and reproducibility. The future potential and outlook of this rapidly growing research are analyzed as well.

flexible electronics↗

Flight Research: Problems Encountered and What They Should Teach Us

The document by Milt Thompson that is reproduced here was an untitled rough draft found in Thompson's papers in the Dryden Historical Reference Collection. Internal evidence suggests that it was written around 1974. I have not attempted to second guess what Milt might have done in revising the paper, but I have made some minor stylistic changes to make it more readable without changing the sense of what Milt initially wrote. For the most part, I have not attempted to bring his comments up to date. For readers who may not be familiar with the history of what is today the NASA Dryden Flight Research Center and of its predecessor organizations, I have added a background section.

Thompson, Milton O.↗

Some Factors Affecting the Reproducibility of Penetration and the Cut-Off of Oil Sprays for Fuel-injection Engines

This investigation was undertaken at the Langley Memorial Aeronautical Laboratory in connection with a general research on fuel-injection for aircraft. The purpose of the investigation was to determine the factors controlling the reproducibility of spray penetration and secondary discharges after cut-off. The development of single sprays from automatic injection valves was recorded by means of special high-speed photographic apparatus capable of taking 25 consecutive pictures of the moving spray at a rate of 4,000 per second. The effect of two types of injection valves, injection-valve tube length, initial pressure in the injection-valve tube, speed of the injection control mechanism, and time of spray cut-off, on the reproducibility of spray penetration, and on secondary discharges were investigated. It was found that neither type of injection valve materially affected spray reproducibility. The initial pressure in the injection-valve tube controlled the reproducibility of spray penetrations. An increase in the initial pressure or in the length of the injection-valve tube slightly increased the spray penetration within the limits of this investigation. The speed of the injection-control mechanism did not affect the penetration. Analysis of the results indicates that secondary discharges were caused in this apparatus by pressure waves initiated by the rapid opening of the cut-off valve. The secondary discharges were eliminated in this investigation by increasing the length of the injection-valve tube. (author)

Beardsley, E G↗

Numerical Simulation of Screech Tones from Supersonic Jets: Physics and Prediction

The objectives of this project are to: (1) perform a numerical simulation of the jet screech phenomenon; and (2) use the data of the simulations to obtain a better understanding of the physics of jet screech. The original grant period was for three years. This was extended at no cost for an extra year to allow the principal investigator time to publish the results. We would like to report that our research work and results (supported by this grant) have fulfilled both objectives of the grant. The following is a summary of the important accomplishments: (1) We have now demonstrated that it is possible to perform accurate numerical simulations of the jet screech phenomenon. Both the axisymmetric case and the fully three-dimensional case were carried out successfully. It is worthwhile to note that this is the first time the screech tone phenomenon has been successfully simulated numerically; (2) All four screech modes were reproduced in the simulation. The computed screech frequencies and intensities were in good agreement with the NASA Langley Research Center data; (3) The staging phenomenon was reproduced in the simulation; (4) The effects of nozzle lip thickness and jet temperature were studied. Simulated tone frequencies at various nozzle lip thickness and jet temperature were found to agree well with experiments; (5) The simulated data were used to explain, for the first time, why there are two axisymmetric screech modes and two helical/flapping screech modes; (6) The simulated data were used to show that when two tones are observed, they co-exist rather than switching from one mode to the other, back and forth, as some previous investigators have suggested; and (7) Some resources of the grant were used to support the development of new computational aeroacoustics (CAA) methodology. (Our screech tone simulations have benefited because of the availability of these improved methods.)

Tam, Christopher K. W.↗

Curifactory

Curifactory is a library and CLI tool designed to help organize and manage research experiments in Python. Experiment management requires several aspects, including experiment orchestration, parameterization, caching, reproducibility, reporting, and parallelization. Existing projects such as MLFlow, MetaFlow, Luigi, and Pachyderm support these aspects in several different ways and to various degrees. Curifactory provides a different opinion to these, with a heavier focus on supporting general research experiment workflows for individuals or small teams working primarily in Python.

Martindale, Nathan [Oak Ridge National Lab. (ORNL)↗

Month-to-month and year-to-year reproducibility of high frequency QRS ECG signals

High frequency electrocardiography analyzing the entire QRS complex in the frequency range of 150 to 250 Hz may prove useful in the detection of coronary artery disease, yet the long-term stability of these waveforms has not been fully characterized. Therefore, we prospectively investigated the reproducibility of the root mean squared voltage, kurtosis, and the presence versus absence of reduced amplitude zones in signal averaged 12-lead high frequency QRS recordings acquired in the supine position one month apart in 16 subjects and one year apart in 27 subjects. Reproducibility of root mean squared voltage and kurtosis was excellent over these time intervals in the limb leads, and acceptable in the precordial leads using both the V-lead and CR-lead derivations. The relative error of root mean squared voltage was 12% month-to-month and 16% year-to-year in the serial recordings when averaged over all 12 leads. Reduced amplitude zones were also reproducible up to a rate of 87% and 81%, respectively, for the month-to-month and year-to-year recordings. We conclude that 12-lead high frequency QRS electrocardiograms are sufficiently reproducible for clinical use.

Coronary Disease/diagnosis↗

Conquering Data Chaos: Research Data Management with Kubernetes

Managing massive volumes of data and effectively making it accessible to researchers poses significant challenges and is a barrier to scientific discovery. In many cases, critical data is locked up in unwieldy file formats or one-off databases and is too large to effectively process on a single machine. This talk explores the role of Kubernetes, an open-source container orchestration platform, in addressing research data management challenges. I will discuss how we are using a set of publicly available open-source and home-grown tools in the National Renewable Energy Lab (NREL) Data, Analysis, and Visualization (DAV) group to help researchers overcome data-related bottlenecks. The talk will begin by providing an overview of the data challenges faced in research data management, including data storage, processing, and analysis. I will highlight Kubernetes' ability to handle large-scale data by leveraging containerization and distributed computing, including distributed storage. Kubernetes allows researchers to encapsulate data processing infrastructure and workflows into portable containers, enabling reproducibility and ease of deployment. Kubernetes can then schedule and manage the resource allocation of these containers to enable efficient utilization of limited computing resources, leading to more efficient data processing and analysis. I will discuss some limitations of traditional, siloed approaches to dealing with data and emphasize the need for solutions which foster collaboration. I will highlight how we are using Kubernetes at NREL to facilitate data sharing and cooperation among research teams. Kubernetes' flexible architecture enables the deployment of shared computing environments, such as Apache Superset, where researchers can seamlessly access and analyze shared datasets. Providing the ability to have one research team easily consume data generated by another, utilizing Kubernetes' as a central data platform, is one of the major wins we've encountered by adopting the platform. Finally, I will showcase real-world use cases from NREL where we have used Kubernetes to solve some persistent data challenges involving large volumes of sensor and monitoring data. I will discuss the challenges we encountered when creating our cluster and making it available as a production-ready resource. I will also discuss the specific suite of tools, including Postgres and Apache Druid for columnar and timeseries data, and Redpanda Kafka for streaming data we have deployed in our infrastructure, and the process that went into the selection of these tools.

collaborative environment↗

High concentrations of ice: Investigations using polarimetric radar observations combined with in situ measurements and cloud modeling (Final Report)

This DOE-funded joint project had the over-arching goal of understanding the reasons for observed size distributions of ice particles in cold clouds. Its approach involves the use of cloud models and field observations by radar and aircraft of real storms. The project addresses three major research objectives: (1) Utilize a novel polarimetric radar technique to retrieve size distributions and amounts of ice from radar data collected during the previous DOE ARM field campaigns; (2) Evaluate the results of ice microphysical retrievals using available in situ aircraft measurements and other remote sensors (e.g., vertically pointing cloud radars and wind profilers); (3) Improve the treatment of microphysical processes leading to cloud glaciation and ice multiplication in numerical cloud models. The study was performed by three research organizations: University of Oklahoma, The Hebrew University of Jerusalem, Israel, and Lund University, Sweden. The Israel and Swedish partners were funded by the sub-awards from the University of Oklahoma. Cloud modeling studies have been performed by the research teams at The Hebrew University of Jerusalem (HUJ) and Lund University to identify the origins of high concentrations of cloud ice in areas of high ice water content (HIWC). The Hebrew University Cloud Model (HUCM) with full spectral bin microphysics and the Lund University aerosol-cloud (AC) model with a hybrid bin / bulk microphysics scheme complementing HUCM were utilized for simulations. Both research teams had particular focus on secondary ice production (SIP) as one of the possible sources of enhanced ice concentration. The HUJ group suggested a novel concept of ice multiplication during droplet freezing. It is assumed that splintering and droplet fragmentation during droplet freezing takes place because of dendritic growth within a supercooled drop. The resulting simulations of SIP generated small ice in concentrations exceeding hundreds per liter similar to what was observed in the HIWC regions of the tropical storms. The Lund team explored the SIP mechanisms such as breakup of ice particles due to ice-ice collisions and ice sublimation that are expected to dominate the continental storms. They also quantified the impact of homogeneous nucleation of cloud droplets on the total number concentration of ice at very low temperatures near the tops of the clouds. Additionally, the Lund AC model is able to simulate the effect of aerosols of various types (including biological) on the cloud life cycle and the corresponding ice production. The HUCM / AC model was used to simulate one of the “golden” cases of the DOE MC3E campaign on 20 May 2011. The model output was converted into the fields of polarimetric radar variables using the polarimetric radar forward operator developed at the University of Oklahoma and compared with radar observations and in situ microphysical measurements onboard research aircraft. It was demonstrated that specific differential phase KDP is the best radar parameter to identify the HIWC areas and quantify the corresponding ice parameters. For the first time, the shape of the vertical profile of KDP was realistically reproduced by the cloud model with the KDP maximum in the dendritic growth layer (DGL) centered at the -15°C isotherm. The University of Oklahoma team has developed a methodology for polarimetric radar retrievals of such microphysical parameters of ice as ice water content (IWC), mean volume diameter (Dm), and total number concentration (Nt) of ice particles. These retrievals have been validated using in situ aircraft measurements during 6 field campaigns and proved to be quite robust and reliable. This allowed to build the first climatology of the vertical profiles of polarimetric radar variables and retrieved microphysical parameters for the three types of weather systems: continental MCSs, maritime MCSs, and tropical cyclones / hurricanes (Hu and Ryzhkov 2022). The data were collected by a multitude of the WSR-88D radars in 13 continental and 10 maritime MCSs and 11 landfalling hurricanes. The HIWC areas were identified within the examined storms and the corresponding “HIWC statistics” was compared with the “background” one without HIWC. An overarching conclusion of the study is that maritime tropical storms (MCSs and hurricanes) are characterized by smaller size ice in higher concentration compared to the continental MCSs. High ice water content in the HIWC areas is primarily caused by a strong jump in a number concentration of ice particles rather than the increase of their size compared to the “background” environment. This may point to the homogeneous nucleation of excessive amounts of supercooled droplets and / or secondary ice production as the possible origins of HIWC. Such a climatology provides a good observational reference for the modelers to evaluate the performance of their models. As an example, the in-depth analysis of the 20 May 2011 MC3E case shows that the advanced cloud models developed in the course of this study still tend to underestimate the number concentration of ice in the HIWC areas although they succeed in reproducing realistically looking vertical profiles of IWC and Nt. The results of the project research are summarized in 13 journal papers.

54 ENVIRONMENTAL SCIENCES↗

Description of the LASSO Data Bundles Product

The U. S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has evolved into the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) datastream. The datastream, broadly termed data bundles, contains high-resolution model output, input files, observations for evaluation, and skill scores for the simulations. The initial focus of LASSO is on shallow convection at the ARM Southern Great Plains (SGP) atmospheric observatory. The availability of LES simulations with concurrent observations serves many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO generates a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It also provides tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. The LASSO library of data bundles is designed to facilitate a wide range of research. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct observation system simulation experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO can help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model personally. For a modeler, LASSO can help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗

Optical Verification Laboratory Demonstration System for High Security Identification Cards

Document fraud including unauthorized duplication of identification cards and credit cards is a serious problem facing the government, banks, businesses, and consumers. In addition, counterfeit products such as computer chips, and compact discs, are arriving on our shores in great numbers. With the rapid advances in computers, CCD technology, image processing hardware and software, printers, scanners, and copiers, it is becoming increasingly easy to reproduce pictures, logos, symbols, paper currency, or patterns. These problems have stimulated an interest in research, development and publications in security technology. Some ID cards, credit cards and passports currently use holograms as a security measure to thwart copying. The holograms are inspected by the human eye. In theory, the hologram cannot be reproduced by an unauthorized person using commercially-available optical components; in practice, however, technology has advanced to the point where the holographic image can be acquired from a credit card-photographed or captured with by a CCD camera-and a new hologram synthesized using commercially-available optical components or hologram-producing equipment. Therefore, a pattern that can be read by a conventional light source and a CCD camera can be reproduced. An optical security and anti-copying device that provides significant security improvements over existing security technology was demonstrated. The system can be applied for security verification of credit cards, passports, and other IDs so that they cannot easily be reproduced. We have used a new scheme of complex phase/amplitude patterns that cannot be seen and cannot be copied by an intensity-sensitive detector such as a CCD camera. A random phase mask is bonded to a primary identification pattern which could also be phase encoded. The pattern could be a fingerprint, a picture of a face, or a signature. The proposed optical processing device is designed to identify both the random phase mask and the primary pattern [1-3]. We have demonstrated experimentally an optical processor for security verification of objects, products, and persons. This demonstration is very important to encourage industries to consider the proposed system for research and development.

Javidi, Bahram↗

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗

Best Practices for Nuclear Experiment Data Preservation at Idaho National Laboratory: A Guide for Researchers and Reactor Operators

Preserving experimental data is essential for supporting advancements in nuclear science and ensuring the longevity of Idaho National Laboratory's contributions to reactor technology and safety. This report provides a comprehensive guide to best practices for experimental data management and preservation, focusing on standardized data formats, redundancy in storage, metadata documentation, and alignment with international standards. By following these recommendations, experimentalists and reactor operators can enhance the accessibility, reproducibility, and utility of critical datasets for regulatory review, validation computational methods, and future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Minimal Information Set To Enable Verifiable Theoretical Battery Research

Batteries are an enabling technology for addressing sustainability through the electrification of various forms of transportation (1) and grid storage. (2) Batteries are truly multi-scale, multi-physics devices, and accordingly various theoretical descriptions exist to understand their behavior (3-5) ranging from atomistic details to techno-economic trends. As we explore advanced battery chemistries (6,7) or previously inaccessible aspects of existing ones, (8-10) new theories are required to drive decisions. (11-13) The decisions are influenced by the limitations of the underlying theory. Advanced theories used to understand battery phenomena are complicated and require substantial effort to reproduce. However, such constraints should not limit the insights from these theories. We can strive to make the theoretical research verifiable such that any battery stakeholder can assess the veracity of new theories, sophisticated simulations or elaborate analyses. We distinguish verifiability, which amounts to “Can I trust the results, conclusions and insights and identify the context where they are relevant?”, from reproducibility, which ensures “Would I get the same results if I followed the same steps?” With this motivation, we propose a checklist to guide future reports of theoretical battery research in Table 1. We hereafter discuss our thoughts leading to this and how it helps to consistently document necessary details while allowing complete freedom for creativity of individual researchers. Given the differences between experimental and theoretical studies, the proposed checklist differs from its experimental counterparts. (14,15) This checklist covers all flavors of theoretical battery research, ranging from atomic/molecular calculations (16-19) to mesoscale (20,21) and continuum-scale interactions, (9,22) and techno-economic analysis. (23,24) Finally, as more and more experimental studies analyze raw data, (25) we feel this checklist would be broadly relevant.

25 ENERGY STORAGE↗

On the Necessity of Adopting Irradiation Protocols Recommended by the Compatibility in Irradiation Research Protocols Expert Roundtable (CIRPER) in Published Research and Why It Matters to Health Physicists

The National Nuclear Security Administration (NNSA) seeks to assist and support all partners in the fields of radiobiology, health physics, radiation physics, and related areas to transition from cesium-137 chloride-based technologies that can potentially be used in an act of terrorism to X-ray technologies. The absence of information on experimental procedures, equipment, and irradiation parameters directly and negatively impacts the reproducibility and translatability of a sizable portion of radiation biology studies. It also discourages researchers from adopting new tools that eliminate the risks of a radiological dispersal device.

Stern, Warren [Brookhaven National Laboratory (BNL↗

Optimization of La 2–x Sr x CuO 4 Single Crystal Film Growth via Molecular Beam Epitaxy

Atomic layer-by-layer molecular beam epitaxy (ALL-MBE) combined with ozone is one of the best methods to fabricate single-crystal thin films of complex oxides. Cuprate such as La 2-x Sr x CuO 4 (LSCO) is a representative complex-oxide high-temperature superconductor (HTS) material. Our group utilizes this method to produce high-quality single-crystal HTS films with atomically smooth surfaces and interfaces. In addition, ALL-MBE enables us to engineer multilayer heterostructures with atomic precision. This allows the fabrication of tunnel junctions, various nanostructures, and other HTS devices of interest for superconducting electronics. We have synthesized over three thousand LSCO thin films in the past two decades. These films’ structural and electronic properties have been studied and characterized by various methods. Here, we distill the extensive experience we accumulated into a step-by-step protocol to fabricate atomically perfect LSCO films. The recipe includes substrate preparation, ozone generation and distillation, source calibration, the in situ monitoring of the film synthesis, post-growth annealing, and ex situ characterization. It discloses a reproducible way to fabricate single-crystal LSCO films for basic research and HTS electronic applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Material growth and characterization directed toward improving III-V heterojunction solar cells

In addition to the existing materials growth laboratory, the photolithographic facility and the device testing facility were completed. The majority of equipment for data acquisition, solar cell testing, materials growth and device characterization were received and are being put into operation. In the research part of the program, GaAs and GaA1As layers were grown reproducibly on GaAs substrates. These grown layers were characterized as to surface morphology, thickness and thickness uniformity. The liquid phase epitaxial growth process was used to fabricate p-n junctions in Ga(1-x)A1(x)As. Sequential deposition of two alloy layers was accomplished and detailed analysis of the effect of substrate quality and dopant on the GaA1As layer quality is presented. Finally, solar cell structures were formed by growing a thin p-GaA1As layer upon an epitaxial n-GaA1As layer. The energy gap corresponding to the long wavelength cutoff of the spectral response characteristic was 1.51-1.63 eV. Theoretical calculations of the spectral response were matched to the measured response.

Stefanakos, E. K.↗

Boost-phase discrimination research

The final report describes the combined work of the Computational Chemistry and Aerothermodynamics branches within the Thermosciences Division at NASA Ames Research Center directed at understanding the signatures of shock-heated air. Considerable progress was made in determining accurate transition probabilities for the important band systems of NO that account for much of the emission in the ultraviolet region. Research carried out under this project showed that in order to reproduce the observed radiation from the bow shock region of missiles in their boost phase it is necessary to include the Burnett terms in the constituent equation, account for the non-Boltzmann energy distribution, correctly model the NO formation and rotational excitation process, and use accurate transition probabilities for the NO band systems. This work resulted in significant improvements in the computer code NEQAIR that models both the radiation and fluid dynamics in the shock region.

Langhoff, Stephen R.↗