Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

Evaluation of a Compression-Loaded-Stitched-Multi-Bay Fuselage Panel With Barely Visible Impact Damage

The experimental results from a stitched VaRTM carbon-epoxy composite panel tested under uni-axial compression loading are presented along with nonlinear finite element analysis prediction of the response. The curved panel is divided by frames and stringers into six bays with a column of three bays along the compressive loading direction. The frames are supported at the frame ends to resist out-of-plane translation. Back-to-back strain gages are used to record the strain and displacement transducers were used to record the out-of-plane displacements. In addition a full-field-displacement measurement technique that utilizes a camera-based-stereo-vision system was used to record the displacements. The panel was loaded to 1.5 times the predicted initial buckling load (1st bay buckling load, P(sub er) from the nonlinear finite element analysis and then was removed from the test machine for impact testing. After impacting with 20 ft-lbs of energy using a spherical impactor to produce barely visible damage the panel was loaded in compression until failure. The buckling load of the first bay to buckle was 97% of the buckling load before impact. The stitching constrained the impact damage from growing during the loading to failure. Impact damage had very little overall effect on panel stiffness. Panel stiffness measured by the full-field-displacement technique indicated a 13% loss in stiffness after impact. The panel failed at 1.64 times the first panel buckling load. The barely visible impact damage did not grow noticeably as the panel failed by global instability due to stringer-web terminations at the frame locations. The predictions from the nonlinear analysis of the finite element modeling of the entire specimen were very effective in the capture of the initial buckling and global behavior of the panel. In addition, the prediction highlighted the weakness of the panel under compression due to stringer web terminations. Both the test results and the nonlinear predictions serve to reinforce the severe penalty in structural integrity caused by the low cost manufacturing technique to terminate the stringer webs, and demonstrates the importance of this type of sub-component testing and high fidelity failure analysis in the design of a composite fuselage.

Baker, Donald J.↗
NASA NTRS2018

Design and Development of Modules to Support Live Microscopic Imaging on Ground-Based Microgravity Simulators

In space, astronauts are exposed to environmental stressors that often result in physiological changes. One prominent stressor in spaceflight is microgravity, and research has shown that long term microgravity exposure causes muscle atrophy, bone loss, cardiovascular concerns, and vision impairment. It is critical to understand how altered gravity affects physiology on the cellular, molecular, and gene level in order to accurately assess health risks and to develop effective countermeasures. Ground-based microgravity simulators such as random positioning machines (RPMs) are used to produce some of the biological effects of altered gravity on different cell types and organisms. Real-time imaging during simulations are of particular interest as we can study how basic cell functions such as cell division, cell migration, and proliferation progress under microgravity conditions. However, design limitations of present microgravity simulators such as susceptibility to parasitic vibration and displacement of the sample from the center of rotation challenge the accuracy of experiment results and live images. We have developed a cell culture sample holder module suitable for live microscopic imaging on an RPM. CAD modeling and 3D printing technology were used to implement modifications to the sample holder and to install a digital microscope to perform live bright-field and fluorescent imaging. Vibration damping materials were also investigated to allow for stable imaging while the microgravity simulator was within a cell culture incubator. Novel methods and hardware modifications for improving live cell imaging on ground-based microgravity simulators were proposed and discussed.

3D printing↗
NASA NTRS1995

CaseMIDAS - A reactive planning architecture for the man-machine integration design and analysis system

MIDAS is a set of tools which allow a designer to specify the physical and functional characteristics of a complex system such as an aircraft cockpit, and analyze the system with regard to human performance. MIDAS allows for a number of static analyses such as military standard reach and fit analysis, display legibility analysis, and vision polars. It also supports dynamic simulation of mission segments with 3d visualization. MIDAS development has incorporated several models of human planning behavior. The CaseMIDAS effort has been to provide a simplified and unified approach to modeling task selection behavior. Except for highly practiced, routine procedures, a human operator exhibits a cognitive effort while determining what step to take next in the accomplishment of mission tasks. Current versions of MIDAS do not model this effort in a consistent and inclusive manner. CaseMIDAS also attempts to address this issue. The CaseMIDAS project has yielded an easy to use software module for case creation and execution which is integrated with existing MIDAS simulation components.

Pease, R. Adam↗
NASA NTRS1981

Symposium on Aviation Psychology, 1st, Ohio State University, Columbus, OH, April 21, 22, 1981, Proceedings

The impact of modern technology on the role, responsibility, authority, and performance of human operators in modern aircraft and ATC systems was examined in terms of principles defined by Paul Fitts. Research into human factors in aircraft operations and the use of human factors engineering for aircraft safety improvements were discussed, and features of the man-machine interface in computerized cockpit warning systems are examined. The design and operational features of computerized avionics displays and HUDs are described, along with results of investigations into pilot decision-making behavior, aircrew procedural compliance, and aircrew judgment training programs. Experiments in vision and visual perception are detailed, as are behavioral studies of crew workload, coordination, and complement. The effectiveness of pilot selection, screening, and training techniques are assessed, as are methods for evaluating pilot performance.

Source record↗
DOE OSTI2020

Atomic resolution convergent beam electron diffraction analysis using convolutional neural networks

Two types of convolutional neural network (CNN) models, a discrete classification network and a continuous regression network, were trained to determine local sample thickness from convergent beam diffraction (CBED) patterns of SrTiO 3 collected in a scanning transmission electron microscope (STEM) at atomic column resolution. Acquisition of atomic resolution CBED patterns for this purpose requires careful balancing of CBED feature size in pixels, acquisition speed, and detector dynamic range. The training datasets were derived from multislice simulations, which must be convolved with incoherent source broadening. Sample thicknesses were also determined using quantitative high-angle annular dark-field (HAADF) STEM images acquired simultaneously. The regression CNN performed well on sample thinner than 35 nm, with 70% of the CNN results within 1 nm of HAADF thickness, and 1.0 nm overall root mean square error between the two measurements. The classification CNN was trained for a thicknesses up to 100 nm and yielded 66% of CNN results within one classification increment of 2 nm of HAADF thickness. Our approach depends on methods from computer vision including transfer learning and image augmentation.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

Machine Learning Based Crater Detection for Terrain Relative Navigation

As Lunar exploration continues to become more commonplace, reliable methods of precise Terrain Relative Navigation (TRN) are needed. While there are many TRN techniques available, one that has received increased interest in the past few years is that of crater based navigation. Crater based navigation has numerous benefits, including being a human recognizable feature (important for crewed missions), as well as the fact that craters are often possible hazards that need to be detected and avoided. The use of crater based navigation has been limited however. This has been due to the difficulty of running such algorithms on board a spacecraft, as well as the difficulty in procuring large amounts of the required training data. This paper presents a new rendering tool for generating large amounts of high quality training data. It then looks at two recently developed machine learning techniques for crater detection and crater identification in real-time on near-future space hardware.

computer vision↗
DOE OSTI2025

How does ion temperature gradient turbulence depend on magnetic geometry? Insights from data and machine learning

Magnetic geometry has a significant effect on the level of turbulent transport in fusion plasmas. Here, we model and analyse this dependence using multiple machine learning methods and a dataset of >200 000 nonlinear gyrokinetic simulations of ion-temperature-gradient turbulence in diverse non-axisymmetric geometries. The dataset is generated using a large collection of both optimised and randomly generated stellarator equilibria. At fixed gradients and other input parameters, the turbulent heat flux varies between geometries by several orders of magnitude. Trends are apparent among the configurations with particularly high or particularly low heat flux. Regression and classification techniques from machine learning are then applied to extract patterns in the dataset. Due to a symmetry of the gyrokinetic equation, the heat flux and regressions thereof should be invariant to translations of the raw features in the parallel coordinate, similar to translation invariance in computer vision applications. Multiple regression models including convolutional neural networks (CNNs) and decision trees can achieve reasonable predictive power for the heat flux in held-out test configurations, with highest accuracy for the CNNs. Using Spearman correlation, sequential feature selection and Shapley values to measure feature importance, it is consistently found that the most important geometric lever on the heat flux is the flux surface compression in regions of bad curvature. The second most important geometric feature relates to the magnitude of geodesic curvature. These two features align remarkably with surrogates that have been proposed based on theory, while the methods here allow a natural extension to more features for increased accuracy. The dataset, released with this publication, may also be used to test other proposed surrogates, and we find that many previously published proxies do correlate well with both the heat flux and stability boundary.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Ultimate Colliders

Our understanding of the Universe critically depends on the fundamental knowledge of particles and fields, which represents a central endeavor of modern high-energy physics. Energy frontier particle colliders - arguably, among the largest, most complex and advanced scientific instruments of modern times - for many decades have been at the forefront of scientific discoveries in high-energy physics. Due to technology advances and beam physics breakthroughs, the colliding beam facilities have progressed immensely and now operate at energies and luminosities many orders of magnitude greater than the pioneering instruments of the early 1960s. While the Large Hadron Collider and the Super-KEKB factory represent the frontier hadron and lepton colliders of today, respectively, future colliders are an essential component of a strategic vision for particle physics. Conceptual studies and technical developments for several exciting near- and medium-term future collider options are underway internationally. Analysis of numerous proposals and studies for far-future colliders indicate the limits of the collider beam technology due to machine size, cost, and power consumption, and call for a paradigm shift of the particle physics research at ultra-high energy but low luminosity colliders approaching or exceeding 1 PeV center-of-mass energy scale.

43 PARTICLE ACCELERATORS↗
NASA NTRS1981

Data acquisition and analysis of range-finding systems for spacing construction

For space missions of future, completely autonomous robotic machines will be required to free astronauts from routine chores of equipment maintenance, servicing of faulty systems, etc. and to extend human capabilities in hazardous environments full of cosmic and other harmful radiations. In places of high radiation and uncontrollable ambient illuminations, T.V. camera based vision systems cannot work effectively. However, a vision system utilizing directly measured range information with a time of flight laser rangefinder, can successfully operate under these environments. Such a system will be independent of proper illumination conditions and the interfering effects of intense radiation of all kinds will be eliminated by the tuned input of the laser instrument. Processing the range data according to certain decision, stochastic estimation and heuristic schemes, the laser based vision system will recognize known objects and thus provide sufficient information to the robot's control system which can develop strategies for various objectives.

Shen, C. N.↗
NASA NTRS1990

Computation and parallel implementation for early vision

The problem of early vision is to transform one or more retinal illuminance images-pixel arrays-to image representations built out of such primitive visual features such as edges, regions, disparities, and clusters. These transformed representations form the input to later vision stages that perform higher level vision tasks including matching and recognition. Researchers developed algorithms for: (1) edge finding in the scale space formulation; (2) correlation methods for computing matches between pairs of images; and (3) clustering of data by neural networks. These algorithms are formulated for parallel implementation of SIMD machines, such as the Massively Parallel Processor, a 128 x 128 array processor with 1024 bits of local memory per processor. For some cases, researchers can show speedups of three orders of magnitude over serial implementations.

Gualtieri, J. Anthony↗
NASA NTRSDate not supplied

Measurement of Material Recession and Shock Standoff in Plasma Windtunnel using Neural Nets

Arcjets are plasma wind tunnels used to test the performance of heatshield materials for spacecraft atmospheric entry. These facilities present an extremely harsh flow environment with heat fluxes up to 109 W/m2 for up to 30 minutes. The plasma is low-temperature (∼1 eV) but high pressure (> 10 kPa) creating high-enthalpy supersonic flows similar to atmospheric entry conditions. Typically, material samples are measured before and after a test to characterize the total recession. However, this does not capture time-dependent effects such as material expansion and non-linear recession. This work will present new analysis of arcjet test videos which measure both the time-dependent 2D recession of the material samples and the shock standoff distance. The results show non-linear time-dependent effects are present for some conditions. The material and shock edges are extracted from the videos by training and applying a convolutional neural network. Due to the consistent camera settings, the machine learning model achieves high accuracy (± 2 px) relative to manually segmented images with only a small number of training frames (80).

Neural network↗
DOE OSTI2020

Forecasting Commercial Building Electricity Consumption, Zone Airflow and Zone Temperature: Update - Development of a Generalized Machine Learning Approach

The U.S. power grid is being transformed to make it smarter, more efficient, and cleaner. This transformation is leading to the addition of a significant of energy generated by distributed, variable, and renewable resources. Because of the variable nature of renewable generation, the short- and long-term supply and demand imbalances are less predictable, and conventional approaches to mitigating the imbalances will be less efficient or cost effective. To address this challenge and to support the mission and the vision of the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) Building Technologies Office has developed a Grid-Interactive Efficient Building Strategy. The strategy focuses on simultaneously improving building energy efficiency and supporting reliability and resilience of the electric grid more efficiently and at a lower cost. In addition, EERE and DOE’s Office of Electricity created an initiative led by DOE and supported by the national laboratories under the Grid Modernization Lab Consortium structure to enhance grid modernization. The work reported in this document is part of the first set of projects funded under the initiative to design, develop, and validate scalable transactive control technologies for the commercial buildings sector. Transactive controls requires the ability of individual end-use loads to express flexibility as a function of a transactive signal (e.g., price). Empirical grey- and black-box models have been widely used to express flexibility. Although this approach is generally easy to construct and simple to use, it does not capture non-linear behavior that some end-use loads represent. Therefore, Pacific Northwest National Laboratory (PNNL) with support from Western Washington University conducted this research to explore the use of deep machine learning (ML) techniques. The work reported in this document is limited to forecasting whole building electricity consumption, the zone airflow and the zone temperature predictions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1995

Machine learning for a Toolkit for Image Mining

A prototype user environment is described that enables a user with very limited computer skills to collaborate with a computer algorithm to develop search tools (agents) that can be used for image analysis, creating metadata for tagging images, searching for images in an image database on the basis of image content, or as a component of computer vision algorithms. Agents are learned in an ongoing, two-way dialogue between the user and the algorithm. The user points to mistakes made in classification. The algorithm, in response, attempts to discover which image attributes are discriminating between objects of interest and clutter. It then builds a candidate agent and applies it to an input image, producing an 'interest' image highlighting features that are consistent with the set of objects and clutter indicated by the user. The dialogue repeats until the user is satisfied. The prototype environment, called the Toolkit for Image Mining (TIM) is currently capable of learning spectral and textural patterns. Learning exhibits rapid convergence to reasonable levels of performance and, when thoroughly trained, Fo appears to be competitive in discrimination accuracy with other classification techniques.

Delanoy, Richard L.↗
NASA NTRS2006

The NASA Program Management Tool: A New Vision in Business Intelligence

This paper describes a novel approach to business intelligence and program management for large technology enterprises like the U.S. National Aeronautics and Space Administration (NASA). Two key distinctions of the approach are that 1) standard business documents are the user interface, and 2) a "schema-less" XML database enables flexible integration of technology information for use by both humans and machines in a highly dynamic environment. The implementation utilizes patent-pending NASA software called the NASA Program Management Tool (PMT) and its underlying "schema-less" XML database called Netmark. Initial benefits of PMT include elimination of discrepancies between business documents that use the same information and "paperwork reduction" for program and project management in the form of reducing the effort required to understand standard reporting requirements and to comply with those reporting requirements. We project that the underlying approach to business intelligence will enable significant benefits in the timeliness, integrity and depth of business information available to decision makers on all organizational levels.

Maluf, David A.↗
DOE OSTI2024

Hydra: Computer Vision for Data Quality Monitoring

Hydra: Computer Vision for Data Quality Monitoring Mar 13, 2024, 4:15 PM 30m Charles B. Wang Center, Stony Brook University Poster Track 1: Computing Technology for Physics Research Poster session with coffee break Speaker Ayan Roy Description Hydra is an extensible framework for training, managing, and deploying machine learning models for near real-time data quality monitoring. It is designed to take some of the burden off of shift crews by providing ‘round-the-clock’ monitoring of plots representing the data being collected. The Hydra system is backed by a database which is leveraged for near push button training and is primarily controlled and viewed through a set of web interfaces. This web interface contains a simple-to-use web based GUI for labeling of the datasets used in training; making it possible to label thousands of images quickly and efficiently. To aid in the analysis of Hydra inferences gradCAM, a method of interpretability, is performed and overlaid on the target image, highlighting regions of interest, making diagnosis of problems much faster. Development began in 2019 for the GlueX Experiment in Hall-D, the Hydra system has grown to encompass all of the experimental halls at Jefferson Laboratory. This talk will focus on the features of Hydra as well as provide details of the challenges present with deploying to disparate experimental halls. With a roadmap of development established, Hydra aims to continue to grow in richness of feature set and expand to encompass other monitoring tasks in differing communities.

Roy, Ayan↗
NASA NTRS2009

Humanlike Robots - The Upcoming Revolution in Robotics

Humans have always sought to imitate the human appearance, functions and intelligence. Human-like robots, which for many years have been a science fiction, are increasingly becoming an engineering reality resulting from the many advances in biologically inspired technologies. These biomimetic technologies include artificial intelligence, artificial vision and hearing as well as artificial muscles, also known as electroactive polymers (EAP). Robots, such as the vacuum cleaner Rumba and the robotic lawnmower, that don't have human shape, are already finding growing use in homes worldwide. As opposed to other human-made machines and devices, this technology raises also various questions and concerns and they need to be addressed as the technology advances. These include the need to prevent accidents, deliberate harm, or their use in crime. In this paper the state-of-the-art of the ultimate goal of biomimetics, the development of humanlike robots, the potentials and the challenges are reviewed.

EAP↗
DOE OSTI2022

Creating ground truth for nanocrystal morphology: a fully automated pipeline for unbiased transmission electron microscopy analysis

Control over colloidal nanocrystal morphology (size, size distribution, and shape) is important for tailoring the functionality of individual nanocrystals and their ensemble behavior. Despite this, traditional methods to quantify nanocrystal morphology are laborious. New developments in automated morphology classification will accelerate these analyses but the assessment of machine learning models is limited by human accuracy for ground truth, causing even unsupervised machine learning models to have inherent bias. Herein, we introduce synthetic image rendering to solve the ground truth problem of nanocrystal morphology classification. By simulating 2D images of nanocrystal shapes via a function of high-dimensional parameter space, we trained a convolutional neural network to link unique morphologies to their simulated parameters, defining nanocrystal morphology quantitatively rather than qualitatively. An automated pipeline then processes, quantitatively defines, and classifies nanocrystal morphology from experimental transmission electron microscopy (TEM) images. Using improved computer vision techniques, 42,650 nanocrystals were identified, assessed, and labeled with quantitative parameters, offering a 600-fold improvement in efficiency over best-practice manual measurements. Further, a classification algorithm was trained with a prediction accuracy of 99.5%, which can successfully analyze a range of concave, convex, and irregular nanocrystal shapes. The resulting pipeline was applied to differentiating two syntheses of nominally cuboidal CsPbBr 3 nanocrystals and uniquely classifying binary nickel sulfide nanocrystal phase based on morphology. This pipeline provides a simple, efficient, and unbiased method to quantify nanocrystal morphology and represents a practical route to construct large datasets with an absolute ground truth for training unbiased morphology-based machine learning algorithms.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions

Instruction finetuning is a popular paradigm to align large language models (LLM) with human intent. Despite its popularity, this idea is less explored in improving the LLMs to align existing foundation models with scientific disciplines, concepts and goals. In this work, we present SciTune as a tuning framework to improve the ability of LLMs to follow scientific multimodal instructions. To test our methodology, we use a human-generated scientific instruction tuning dataset and train a large multimodal model LLaMA-SciTune that connects a vision encoder and LLM for science-focused visual and language understanding. LLaMA-SciTune significantly outperforms the state-of-the-art models in the generated figure types and captions in multiple scientific multimodal benchmarks. In comparison to the models that are fine-tuned with machine generated data only, LLaMA-SciTune surpasses human performance on average and in many sub-categories on the ScienceQA benchmark.

• Artificial intelligence (AI) / machine learning ↗