Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Video”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Visualizing UPSP Data with Python

The Unsteady Pressure-Sensitive Paint (uPSP) projects uses Pressure-Sensitive paint applied over aerospace models during wind tunnel testing to collect pressure data with high spatial and temporal resolution in order to inform unsteady aerodynamics studies. For each of the 800+ experimental runs, four cameras generate up to 50 GB of video data, which must then be processed, analyzed, and visualized on the NASA Advanced Supercomputing system (NAS) to assess the result. One of the final data analysis products is the dynamic modal decomposition (DMD) results, which decomposes the pressure reading signals by their frequency component. The goal of this project is to visualize the DMD results over a 3D rendering of the model, using efficient and parallelized python routines. The software uses the pytecplot library, a high-level API that connects python scripting to a Tecplot 360 engine. Tecplot is an industry standard high-performance visualization tool that can handle large datasets and workflow. Various animation, rendering, and image-combination techniques were investigated to generate the final videos using OpenCV on the NAS. The final result is a software tool that takes in data products from the uPSP processing chain and generates high resolution visualization videos in parallel for every data file, allowing researchers to view their results efficiently and at an unprecedentedly detailed level.

Emma Dolores McMillian↗

Shoulder Postures in EVA Training in Reduced Gravity Analogues

Shoulder Postures in EVA Training in Reduced Gravity Analogues K. Guhl1, L. Vu2, H. Kim3, S. Rajulu4 1KBR Inc., Houston, TX, 2Aegis Aerospace Inc., Houston, TX, 3Leidos Innovations, Houston, TX, 4NASA Johnson Space Center, Houston, TX. During extravehicular activities (EVAs) and EVA training in both the Neutral Buoyancy Laboratory (NBL) and at the Active Response Gravity Offload System (ARGOS), crewmembers perform a variety of hand-intensive tasks with frequent arm/shoulder repositioning while wearing a pressurized spacesuit. As a result, crewmembers may experience ergonomic stressors such as awkward shoulder postures. The ergonomic shoulder risk is also compounded by limited or restricted shoulder mobility of the spacesuit, extreme work positions such as overhead tasks, and tasks with heavy tools and repetitive motions. Prolonged or frequent shoulder elevation and overhead work, in particular, can lead to excessive stresses and musculoskeletal injuries of the shoulder joints. Future EVA missions, specifically lunar surface EVAs, will also be longer in duration and thus increase the exposure to awkward shoulder postures. In this study, we aimed to assess the ergonomic risk of awkward shoulder postures in simulated lunar surface EVAs by quantifying when and how long the arms are raised above the chest level. We assessed video recordings of pilot lunar EVA simulations (3 lunar trials each in the NBL and at ARGOS and 2 microgravity EVA trials in the NBL). These runs consisted of both training and engineering test objectives. Actual demands for shoulder use varied for different EVA types and analogues, but many EVA runs have common tasks and require similar motion components. A video observation and event logging software was used to document the duration and occurrence of the subject’s arms being raised throughout the video recordings of each EVA run. An arm raised instance was classified as the arm being at 90 degrees or above with relation to gravity for lunar EVA training events and with relation to the body for microgravity EVA training events. Such events included EVA hardware maintenance or heavy geology sampling tool operations. Events where the arm load was partially supported by external objects, like climbing a ladder or leaning against a surface were separately identified and excluded. Statistical analysis was performed to summarize the timing, frequency, and durations of the arm raise events and compared across the different EVA tasks and analogue types. Preliminary observations indicated that the total duration and number of arm raised instances were surprisingly smaller for lunar surface EVA training as compared to microgravity EVA training. The observed difference may be attributed to differing task demands and unique environmental characteristics found in lunar EVAs in comparison to microgravity EVAs. A detailed statistical analysis will be performed between lunar surface EVA training events and microgravity EVA training events in the final submission. Overall, this analysis is expected to provide insight into how ergonomic recommendations can be refined for lunar EVA training with pressurized suits. It may also inform task design and influence suit padding design to better protect crewmembers during future lunar training.

Kaitlyn Lea Guhl↗

The Sun and Space Weather

Audio and video provided as separate files. • CHART 3 audio – “SrFeb022013_1954ut28.21_Ashcraft.mp3” • CHART 9 Sun video – “IA18167_304Whip_best.mpg” • CHART 15 sun animation – “Sun_Animation_Mar23A.mp4” • CHART 33 SDO plus SOHO C2 video – “X2_C2_combo.mov”

Sun↗

Learning About Routine Successful Pilot Techniques Using A Cued Retrospective Think-Aloud Task

Self-report can be a valuable method for collecting data about people’s goals and perceived motivations – data about aspects of crew thinking that are not otherwise readily observable. One of the challenges associated with collecting self-report data on routine successful performance, however, is that details may go unreported, be deemed unimportant, or may not be recalled. We report a study in which commercial airline flight crews participated in a video-cued retrospective think aloud after flying a high-fidelity simulated arrival into Charlotte airport. One day after flying the simulated arrival, crews were shown a video recording of their flight. The video was paused after each minute, and crew members were each asked to describe what they were doing and thinking during that interval. Reported data analysis focused on aspects of performance that are often ambiguously described as “pilot technique” or “airmanship,” in an attempt to provide more detail around these types of behaviors.

Jon Holbrook↗

“Just Do It” Mission Operations Training in a COVID World

“No”- “not”- “can’t do it” – these words don’t fly in M2020 Mission Operations. The M2020 Surface Mission Operations Team trained for landing the Perseverance Rover under COVID-19 remote work/mandatory stay-at-home conditions. Training activities included presenting Flight Schools to the team via video conferencing, training COVID personal safety requirements to on-premises staff, and constantly updating and communicating COVID restrictions to the team as safety requirements changed. This paper explores the impact of COVID on the Mission System Training for M2020 Mission Operations. The layers of COVID, aptly named the “COVID Tax” by team management, affected project roles, communications, personnel interactions, operations facility usage and training exercises practiced by the team. Flight Schools and Operational Readiness Tests (ORTs) are driving forces behind the surface mission operations training. These activities work hand-in-hand to prepare the team for landing day, surface operations that transition from cruise to nominal operations, and nominal operations. Under normal training conditions, Flight Schools and ORTs are only concerned with tactical operations for the Uplink (Command) Downlink (Analysis) and Campaign Implementation (Planning) Teams of scientists and system engineers. Due to COVID, and the necessity to maintain physical distance between people, training for the landing team needed to include the new category of COVID personal safety. COVID also necessitated remote teams and video conferencing of the entirety of Flight Schools. This reliance on distance learning had not been done on previous missions. We will explore the advantages and disadvantages of video conferencing as a training platform; training effectiveness in communicating and practicing the multiple changes to the COVID safety protocols; and the timing in which we received and responded to COVID directives. Additionally, this paper will review the practical measures taken by the on-premises team and how the team adapted during the readiness tests, landing, and early mission operations, as well as how the team responded to the post-vaccine ramping down of COVID Protocols. The M2020 Surface Mission Operations Team responded very well to the challenges of COVID. All pre-landing operational and COVID-related training was completed. Post-landing COVID Training was provided as needed to new on-premises personnel. Training presented on COVID for the first operational readiness test (ORT) consisted of 2.5 hours of training. Each ORT had COVID Training. A person who had participated in all of the ORTs from September 2020 – February 2021 would have received over 7 hours of COVID Training. By ORT-12 (approximately 8 weeks after the first ORT), the Training team consolidated the original COVID training to a one-hour COVID Basic Training course, with additional recommended training. The Basic training course was updated after landing, as vaccines became available. COVID Training had multiple Flight Schools in the self-directed Blackboard Learning system, as well as a Quick Reference Wiki for Onboarding of new on-premises personnel and keeping on-premises personnel up-to-date. COVID Training covered many topics including practical methods of 6-foot distancing, how to interact with an IT professional when help was needed at a workstation, and challenging indoor meal-eating protocols. COVID Training continued to be updated, as the lab and the project respond to the virus variants and federal, state and local ordinances.

Rosette, Theresa↗

ArcjetCV: Automating Recession Tracking

Arc jet Computer Vision (arcjetCV) is a software application built to automate time-resolved recession tracking of edges in test videos, specifically for tracking material recession and the shock-material standoff. This provides a new capability to resolve and validate new physics associated with non-linear processes and an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcticCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

Recession tracking↗

ArcjetCV: Automating Arc Jet Analysis

Arc jet Computer Vision (arcjetCV) is a software application built to automate time-resolved recession tracking of edges in test videos, specifically for tracking material recession and the shock-material standoff. This provides a new capability to resolve and validate new physics associated with non-linear processes and an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcticCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

Recession tracking↗

Exploring the Moon: Preserving the Legacy Through Spacesuit Knowledge Capture and Strategic Communication

NASA is returning to the Moon to stay. To establish a sustained lunar presence, astronauts will pack spacesuits, surface-mobility tools, rovers, and decades’ worth of knowledge. The U.S. Spacesuit Knowledge Capture (SKC) and Strategic Communications (Strat Comm) team is specialized in capturing, preserving, and sharing space-related knowledge with NASA scientists, technicians, engineers, vendors, and the public to support space exploration. Since the SKC Program’s 2007 inception, its focus has been to capture and share valuable spacesuit-related knowledge with the NASA community. As the program evolved, its notoriety, funding, scope, and staffing expanded from a one-person, part-time, unfunded operation to a small-team, funded entity. Currently, this team has been formulated with a diverse skillset to meet the requirements of its stakeholders. The SKC and Strat Comm team has used its skills to produce over 260 recorded knowledge captures of subject-matter experts (SMEs) and photoshoots. These knowledge captures are in the form of photographs, lectures, workshops, vignettes, videos, and interviews containing essential space-related knowledge. To help educate the space community and public, this trove of information (e.g., videos of world-class facilities, photographs, and SME lectures), produced inside NASA Johnson Space Center, can be obtained through various sources. During Fiscal Year 2024, the SKC and Strat Comm team will focus on several initiatives. Examples of initiatives include the following: 1) share lessons learned during NASA’s internal venues such as Safety & Health Day and Day of Remembrance; 2) share knowledge with the public, educators, and students through a media production titled Exploring the Moon; and 3) highlight NASA’s unique capabilities and expertise in a video series titled What’s Behind This Door? This paper discusses the team's approach, unique capture capability, initiatives, and much more.

Cinda Chullen↗

Spectral Measurement Errors due to CCD Serial Pixel-to-Pixel Readout Interference in the Ocean Color Instrument of the NASA PACE Mission

The Ocean Color Instrument on NASA’s PACE mission is a hyperspectral imager with a spatial resolution of 1km x 1km and spectral resolution of 5nm in 2.5nm steps over 320-890nm. The detection system is based on two Charge-Coupled Devices (CCDs) operating in Time Delay Integration (TDI) mode to achieve high signal-to-noise ratio. The front-end optical imager is a rotating mirror-based system that images the ground-scene onto a slit with a field of view of 16km x 1km. The slit-image is re-imaged and wavelength dispersed on the CCDs. As the ground-scene moves through the slit, it moves along the CCD columns as charge is moved along with it. The accumulated charge at the end of each column is collected in a serial pixel. Each of the 16 CCD outputs read out 32 columns of the same ground scene spaced 0.625nm apart. The 32-pixel serial register is swiftly read out before the next TDI cycle. The telescope is spinning at 5.77Hz to achieve the required spatial resolution. This results in a serial pixel readout speed of 8.5MHz. Each serial read-cycle goes through a reset and video period that are each sampled to create a low-noise correlated double sample value. This only allows 59ns for the reset and video to be asserted and settled before sampling. Due to the short time period, the response of the CCD exhibits serial pixel-to-pixel readout interference as the reset and video signals do not have time to fully settle before sampling. Each serial pixel value therefore has a dependence on the value of the preceding pixel value. This leads to a spectral measurement error of up to 0.3%. We explain the operation of the detection system, the behavior of the interference and the resulting wavelength error with results from ground testing and on-orbit characterization.

Ulrik B Gliese↗

Exploring the Moon: Preserving the Legacy Through Spacesuit Knowledge Capture and Strategic Communication

NASA is returning to the Moon to stay. To establish a sustained lunar presence, astronauts will pack spacesuits, surface-mobility tools, rovers, and decades’ worth of knowledge. The U.S. Spacesuit Knowledge Capture (SKC) and Strategic Communications (Strat Comm) team is specialized in capturing, preserving, and sharing space-related knowledge with NASA scientists, technicians, engineers, vendors, and the public to support space exploration. Since the SKC Program’s 2007 inception, its focus has been to capture and share valuable spacesuit-related knowledge with the NASA community. As the program evolved, its notoriety, funding, scope, and staffing expanded from a one-person, part-time, unfunded operation to a small-team, funded entity. Currently, this team has been formulated with a diverse skillset to meet the requirements of its stakeholders. The SKC and Strat Comm team has used its skills to produce over 260 recorded knowledge captures of subject-matter experts (SMEs) and photoshoots. These knowledge captures are in the form of photographs, lectures, workshops, vignettes, videos, and interviews containing essential space-related knowledge. To help educate the space community and public, this trove of information (e.g., videos of world-class facilities, photographs, and SME lectures), produced inside NASA Johnson Space Center, can be obtained through various sources. During Fiscal Year 2024, the SKC and Strat Comm team will focus on several initiatives. Examples of initiatives include the following: 1) share lessons learned during NASA’s internal venues such as Safety & Health Day and Day of Remembrance; 2) share knowledge with the public, educators, and students through a media production titled Exploring the Moon; and 3) highlight NASA’s unique capabilities and expertise in a video series titled What’s Behind This Door? This paper discusses the team's approach, unique capture capability, initiatives, and much more.

Cinda Chullen↗

Valkyrie Robot Capability Demonstration: Autonomous Grab of Body Stored Hand-Tool

A video that provides an automated tool grasp industrial scenario for the NASA Valkyrie Robot from the NASA Dexterous Robotics Team. The scenario is where the Valkyrie uses externally mounted sensors and tools to investigate a room for objects of interest and removes any hazards. This video highlights the tool pick component of the full demonstration. Video run time is 3 min. 28 sec, in color with no sound.

Valkyrie↗

Computer Vision Dataset for Aircraft Taxi Operations

The development and democratization of computer vision algorithms are contingent on the availability of high-quality datasets. In this paper, we introduce a database of forward-facing videos from taxiing aircraft as well as the time-correlated flight data at approximately 1 to10 Hz containing aircraft state data and environmental conditions. The video data is sourced from the National Aeronautics and Space Administration Airborne Science Program archive and includes over 33 hours of 4k, 1080p, and 720p video from twenty-two airports around the world. This paper describes the method of the database construction and a brief analysis of its contents.

Ryan Horn↗

Deep Learning for Automated Identification of Eels in Sonar Data

Freshwater eels, such as the American eel (Anguilla rostrata) present numerous challenges related to safe downstream fish passage at hydroelectric facilities. One of those challenges is effective monitoring of their abundance, movements, and behavior to facilitate design and operation of eel protection and passage facilities. A previous EPRI study documented the ability of human analysts to reliably identify American eels in data obtained with a 1100/1800 kHz, multibeam sonar. This report describes a project to develop deep learning (a subset of artificial intelligence) tools to automate the time-consuming, subjective process of eel identification in multibeam sonar data. The project exploited new data collected in the laboratory and the existing data from the prior EPRI field study to develop and test deep learning and other data analytic tools, including wavelet filtering, differencing for static object removal, and convolutional neural network analysis. The analysis of the laboratory data demonstrated feasibility of the approach, revealed object characteristics observed with the sonar that distinguish eels from similarly sized and shaped acoustic targets, and provided additional data for algorithm selection and training. Deep learning algorithms trained and tested on the laboratory data alone achieved accuracy rates of greater than 98% when classifying acoustic images of eels and similar-sized neutrally buoyant sticks. The algorithm trained and tested on the pre-existing field data alone, and yielded classification accuracy of 9.3% false positives and 13.3% false negatives when distinguishing between eels and sticks/PVC pipes based on video clips (i.e., multiple, consecutive images). This performance is comparable to the classification accuracy achieved by human analysts in the prior study. The deep learning algorithm trained on a combination of video clips obtained in the laboratory and the field and tested on video clips from the field, was able to distinguish eels from sticks and PVC pipes (a river debris analog) of similar size with 100% accuracy. Outreach to the hardware, software, and end-user communities early in the project helped to identify needs and specify the application space. Outreach to those communities at the end of the project communicated project results and opportunities for further development. The project achieved proof of concept for automated identification of eel in multibeam sonar data. Future work should focus on acquisition of additional data for more robust algorithm training and testing; modification of the software tools to accommodate multiple acoustic targets in the acoustic field at a given time; identification of additional object classes; incorporation of motion in the object identification and classification algorithms; operationalizing the software tools, including integration with other existing sonar data analysis tools; and partnering with hardware and software providers for distribution of the software tools with their commercial products.

13 HYDRO ENERGY↗

Feature identification or classification using task-specific metadata

Innovations in the identification or classification of features in a data set are described, such as a data set representing measurements taken by a scientific instrument. For example, a task-specific processing component, such as a video encoder, is used to generate task-specific metadata. When the data set includes video frames, metadata can include information regarding motion of image elements between frames, or other differences between frames. A feature of the data set, such as an event, can be identified or classified based on the metadata. For example, an event can be identified when metadata for one or more elements of the data set exceed one or more threshold values. When the feature is identified or classified, an output, such as a display or notification, can be generated. Although the metadata may be useable to generate a task-specific output, such as compressed video data, the identifying or classifying is not used solely in production of, or the creation of an association with, the task-specific output.

Teuton, Jeremy R.↗

Sensors and methods for monitoring flying objects

Described herein are sensing methods, sensor systems, and non-transitory, computer-readable, storage media having programs for long-duration, continuous monitoring of flying objects during the day or the night and regardless of weather conditions. The methods and systems are computationally efficient and can provide compact, three-dimensional representations of motion from the observed object. A 3D track of the flying object can be generated from a point-matched pair of stereo composite motion track images and not directly from the videos, wherein each composite motion track image is based on a composite of a plurality of video frames composited in part according to video frame numbers.

Matzner, Shari↗

Unmanned aircraft system (UAS) detection and assessment via temporal intensity aliasing

A method and system for temporal frequency analysis for identification of unmanned aircraft systems. The method includes obtaining a sequence of video image frames and providing a pixel from an output frame of the video; generating a fluctuating pixel value vector; examining the fluctuating pixel value vector over a period of time; obtaining the frequency information present in the pixel fluctuations; summing the frequency coefficients for the vectorized pixel values from the fluctuating pixel value vector; obtaining an image representing a two dimensional space based on the summed center frequency coefficients; generating a series of still frames equal to a summation of the center frequency coefficients for pixel variations; and combining the temporal information into spatial locations in a matrix to provide a single image containing the spatial and temporal information present in the sequence of video image frame.

Woo, Bryana Lynn↗

System, method, and computer-accessible medium for remote sensing of the electrical distribution grid with hypertemporal imaging

An exemplary system, method, and computer-accessible medium for determining a property(ies) regarding an electrical grid(s) can be provided, which can include, for example, receiving a video(s) of the electrical grid(s), determining a flicker(s) in the electrical grid(s) based on the video(s), and determining the property(ies) based on the flicker(s). The flicker(s) can be a 120 Hertz flicker. The flicker(s) can be a flicker in a light(s) recorded in the video(s). A frequency and a phase of the flicker(s) can be determined.

Bianco, Federica B.↗

Unmanned aircraft system (UAS) detection and assessment via temporal intensity aliasing

A method and system for temporal frequency analysis for identification of unmanned aircraft systems. The method includes obtaining a sequence of video image frames and providing a pixel from an output frame of the video; generating a fluctuating pixel value vector; examining the fluctuating pixel value vector over a period of time; obtaining the frequency information present in the pixel fluctuations; summing the frequency coefficients for the vectorized pixel values from the fluctuating pixel value vector; obtaining an image representing a two dimensional space based on the summed center frequency coefficients; generating a series of still frames equal to a summation of the center frequency coefficients for pixel variations; and combining the temporal information into spatial locations in a matrix to provide a single image containing the spatial and temporal information present in the sequence of video image frame.

Woo, Bryana Lynn↗