End-to-end machine learning for experimental physics: using simulated data to train a neural network for object detection in video microscopy
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
The tip cell of the protonema of the moss Ceratodon purpureus (Hedw.) Brid. is negatively gravitropic when grown in the dark on supplemented agar. Gravitropism, plastid distribution, and plastid movement were studied in living cells using time-lapse video microscopy and infrared light. A wrong-way (downward) curvature preceded upward curvature and was detected as early as 2 minutes after reorientation. Upward curvature began 30-45 minutes after reorientation to the horizontal. Cell division temporarily reversed upward curvature, but did not inhibit wrong-way curvature. Since significant amyloplast sedimentation always occurred before the start of upward curvature, it is possible that these amyloplasts function as statoliths for upward curvature. However, no significant amyloplast sedimentation occurred before wrong-way curvature. Thus, this early phase of gravitropism cannot require plastid sedimentation for gravity sensing. Most plastids moved within and between zones, and plastid zonation was highly dynamic. Plastids moved toward the apex and toward the base of the cell at rates much slower than cytoplasmic streaming. Despite the dynamic nature of plastid movement and zonation, during upward curvature the distance between sedimented plastids and the apex stayed constant. Time-lapse analysis has revealed intriguing events not readily seen previously using destructive sampling.
In an earlier communication (Munn et al., J Immunol. Methods 166: 11-25, 1993), we presented the initial development of a quantitative assay for monitoring the rates of cellular aggregation based on digital image processing and video microscopy. This study describes some important enhancements and modifications to the procedure. A new index is introduced to characterize the three-dimensional morphology of the aggregates. This index is based on temporal changes in the projected area of the cells and cell aggregates during the course of the experiment. By drawing an analogy with the kinetic theory of gases, we have also introduced a procedure to normalize for variations in cell seeding density among different experiments. In addition, the image analysis technique has been improved by introducing a background subtraction algorithm to remove illumination defects and an adaptive segmentation procedure. These improvements allowed us to completely automate the image analysis procedure, thus minimizing user intervention and improving the reproducibility of the measurements. The enhanced visual assay is evaluated using some recent results from our studies on homotypic lymphocyte aggregation.
Dormant spores of the fern Ceratopteris richardii were flown on Shuttle mission STS-93 to evaluate the effects of micro-g on their development and on their pattern of gene expression. Prior to flight the spores were sterilized and sown into one of two environments: (1) Microscope slides in a video-microscopy module; and (2) Petri dishes. All spores were then stored in darkness until use. Spore germination was initiated on orbit after exposure to light. For the spores on microscope slides, cell level changes were recorded through the clear spore coat of the spores by video microscopy. After their exposure to light, spores in petri dishes were frozen in orbit at four different time points during which on earth gravity fixes the polarity of their development. Spores were then stored frozen in Biological Research in Canister units until recovery on earth. The RNAs from these cells and from 1-g control cells were extracted and analyzed on earth after flight to assay changes in gene expression. Video microscopy results revealed that the germinated spores developed normally in microgravity, although the polarity of their development, which is guided by gravity on earth, was random in space. Differential Display-PCR analyses of RNA extracted from space-flown cells showed that there was about a 5% change in the pattern of gene expression between cells developing in micro-g compared to those developing on earth. c2002 Published by Elsevier Science Ltd on behalf of COSPAR.
The CCU and Incubator are habitats under development by SSBRP for gravitational biology research on ISS. They will accommodate multiple specimen types and reside in either Habitat Holding Racks, or the Centrifuge Rotor, which provides selectable gravity levels of up to 2 g. The CCU can support multiple Cell Specimen Chambers, CSCs (18, 9 or 6 CSCs; 3, 10 or 30 mL in volume, respectively). CSCs are temperature controlled from 4-39 degrees C, with heat shock to 45 degrees C. CCU provides automated nutrient supply, magnetic stirring, pH/O2 monitoring, gas supply, specimen lighting, and video microscopy. Sixty sample containers holding up to 2 mL each, stored at 4-39 degrees C, are available for automated cell sampling, subculture, and injection of additives and fixatives. CSCs, sample containers, and fresh/spent media bags are crew-replaceable for long-term experiments. The Incubator provides a 4-45 degrees C controlled environment for life science experiments or storage of experimental reagents. Specimen containers and experiment unique equipment are experimenter-provided. The Specimen Chamber exchanges air with ISS cabin and has 18.8 liters of usable volume that can accommodate six trays and the following instrumentation: five relocatable thermometers, two 60 W power outlets, four analog ports, and one each relative humidity sensor, video port, ethernet port and digital input/output port.
Computer imaging is rapidly becoming an indispensable tool for the quantification of variables in research and medicine. Whilst its use in medicine has largely been limited to qualitative observations, imaging in applied basic sciences, medical research and biotechnology demands objective quantification of the variables in question. In black and white densitometry (0-256 levels of intensity) the separation of subtle differences between closely related hues from stains is sometimes very difficult. True-colour and real-time video microscopy analysis offer choices not previously available with monochrome systems. In this paper we demonstrate the usefulness of colour thresholding, which has so far proven indispensable for proper objective quantification of the products of histochemical reactions and/or subtle differences in tissue and cells. In addition, we provide interested, but untrained readers with basic information that may assist decisions regarding the most suitable set-up for a project under consideration. Data from projects in progress at Tulane are shown to illustrate the advantage of colour thresholding over monochrome densitometry and for objective quantification of subtle colour differences between experimental and control samples.
The Fluids Integrated Rack (FIR), a facility class payload, and the Light Microscopy Module (LMM), a subrack payload, are scheduled to be launched in 2005. The LMM integrated into the FIR will provide a unique platform for conducting fluids and biological experiments on ISS. The FIR is a modular, multi-user scientific research facility that will fly in the U.S. laboratory module, Destiny, of the International Space Station (ISS). The first payload in the FIR will be the Light Microscopy Module (LMM). The LMM is planned as a remotely controllable, automated, on-orbit microscope subrack facility, allowing flexible scheduling and control of fluids and biology experiments within the FIR. Key diagnostic capabilities for meeting science requirements include video microscopy to observe microscopic phenomena and dynamic interactions, interferometry to make thin film measurements with nanometer resolution, laser tweezers for particle manipulation, confocal microscopy to provide enhanced three-dimensional visualization of structures, and spectrophotometry to measure photonic properties of materials. The LMM also provides experiment sample containment for frangibles and fluids. This paper will provide a description of the current FIR and LMM designs, planned capabilities and key features. In addition a brief description of the initial five experiments planned for LMM/FIR will be provided.
The Light Microscopy Module (LMM) is planned as a remotely controllable on-orbit microscope subrack facility, allowing flexible scheduling and operation of fluids and biology experiments within the Fluids and Combustion Facility (FCF) Fluids Integrated Rack (FIR) on the International Space Station (ISS). The LMM will be the first integrated payload with the FIR to conduct four fluid physics experiments. A description of the LMM diagnostic capabilities, including video microscopy, interferometry, laser tweezers, confocal, and spectrophotometry, will be provided.
A Light Microscopy Module (LMM) is being engineered, designed, and developed at the NASA Glenn Research Center. The LMM is planned as a remotely controllable on-orbit microscope subrack facility, allowing flexible scheduling and control of physical science and biological science experiments within Glenn s Fluids Integrated Rack on the International Space Station. The LMM concept is a modified commercial research imaging light microscope with powerful laser-diagnostic hardware and interfaces, creating a one-of-a-kind, state-of-the-art microscopic research facility. The microscope will house several different objectives, corresponding to magnifications of 10, 40, 50, 63, and 100. Features of the LMM include high-resolution color video microscopy, brightfield, darkfield, phase contrast, differential interference contrast, spectrophotometry, and confocal microscopy combined in a single configuration. Also, laser tweezers are integrated with the diagnostics as a sample manipulation technique. As part of the development phase of the LMM, it was necessary to quantify the microgravity disturbances generated by the control box fan. Isolating the fan was deemed necessary to reduce the fan speed harmonic amplitudes and to eliminate any broadband disturbances across the 60- to 70-Hz and 160- to 170-Hz frequency ranges. The accelerations generated by a control box fan component of the LMM were measured in the Microgravity Emissions Laboratory (MEL). The MEL is a low-frequency measurement system developed to simulate and verify the on-orbit International Space Station (ISS) microgravity environment. The accelerations generated by various operating components of the ISS, if too large, could hinder the science performed onboard by disturbing the microgravity environment. The MEL facility gives customers a test-verified way of measuring their compliance with ISS limitations on vibratory disturbance levels. The facility is unique in that inertial forces in 6 degrees of freedom can be characterized simultaneously for an operating test article. Vibratory disturbance levels are measured for engineering or flight-level hardware following development from component to subassembly through the rack-level configuration. The MEL can measure accelerations as small as 10-7g, the accuracy needed to confirm compliance with ISS requirements.
The Fluids Integrated Rack (FIR), a facility-class payload, and the Light Microscopy Module (LMM), a subrack payload, are integrated research facilities that will fly in the U.S. Laboratory module, Destiny, aboard the International Space Station. Both facilities are being engineered, designed, and developed at the NASA Glenn Research Center by Northrop Grumman Information Technology. The FIR is a modular, multiuser scientific research facility that is one of two racks that make up the Fluids and Combustion Facility (the other being the Combustion Integrated Rack). The FIR has a large volume dedicated for experimental hardware; easily reconfigurable diagnostics, power, and data systems that allow for unique experiment configurations; and customizable software. The FIR will also provide imagers, light sources, power management and control, command and data handling for facility and experiment hardware, and data processing and storage. The first payload in the FIR will be the LMM. The LMM integrated with the FIR is a remotely controllable, automated, on-orbit microscope subrack facility, with key diagnostic capabilities for meeting science requirements--including video microscopy to observe microscopic phenonema and dynamic interactions, interferometry to make thin-film measurements with nanometer resolution, laser tweezers to manipulate micrometer-sized particles, confocal microscopy to provide enhanced three-dimensional visualization of structures, and spectrophotometry to measure the photonic properties of materials. Vibration disturbances were identified early in the LMM development phase as a high risk for contaminating the science microgravity environment. An integrated FIR-LMM test was conducted in Glenn's Acoustics Test Laboratory to assess mechanical sources of vibration and their impact to microscopic imaging. The primary purpose of the test was to characterize the LMM response at the sample location, the x-y stage within the microscope, to vibration emissions from the FIR and LMM support structures.
The Light Microscopy Module (LMM) is planned as a fully remotely controllable on-orbit microscope subrack facility, allowing flexible scheduling and control of fluids and biology experiments within NASA Glenn Research Center's Fluids and Combustion Facility on the International Space Station. Within the Fluids and Combustion Facility, four fluids physics experiments will utilize an instrument built around a light microscope. These experiments are the Constrained Vapor Bubble experiment (Peter C. Wayner of Rensselaer Polytechnic Institute), the Physics of Hard Spheres Experiment-2 (Paul M. Chaikin of Princeton University), the Physics of Colloids in Space-2 experiment (David A. Weitz of Harvard University), and the Low Volume Fraction Colloidal Assembly experiment (Arjun G. Yodh of the University of Pennsylvania). The first experiment investigates heat conductance in microgravity as a function of liquid volume and heat flow rate to determine, in detail, the transport process characteristics in a curved liquid film. The other three experiments investigate various complementary aspects of the nucleation, growth, structure, and properties of colloidal crystals in microgravity and the effects of micromanipulation upon their properties. Key diagnostic capabilities for meeting the science requirements of the four experiments include video microscopy to observe sample features including basic structures and dynamics, interferometry to measure vapor bubble thin film thickness, laser tweezers for colloidal particle manipulation and patterning, confocal microscopy to provide enhanced three-dimensional visualization of colloidal structures, and spectrophotometry to measure colloidal crystal photonic properties.
A fiber push-out technique was used to determine fiber/matrix interfacial shear strength (ISS) for silicon carbide fiber reinforced reaction-bonded silicon nitride (SiC/RBSN) composites in the as-fabricated condition and after consolidation by hot isostatic pressing (HIPing). In situ video microscopy and acoustic emission detection greatly aided the interpretation of push-out load/displacement curves.
A fiber push-out technique was used to determine fiber/matrix interfacial shear strength (ISS) for silicon carbide fiber reinforced reaction-bonded silicon nitride (SiC/RBSN) composites in the as-fabricated condition and after consolidation by hot isostatic pressing (HIPing). In situ video microscopy and acoustic emission detection greatly aided the interpretation of push-out load/displacement curves.
A preliminary design for performing on orbit, autonomous research on microorganisms and cultured cells/tissues is presented. An understanding of gravity and its effects on cells is crucial for space exploration as well as for terrestrial applications. The payload is designed to be compatible with the Commercial Experiment Transporter (COMET) launch vehicle, an orbiter middeck locker interface, and with Space Station Freedom. Uplink/downlink capabilities and sample return through controlled reentry are available for all carriers. Autonomous testing activities are preprogrammed with in-flight reprogrammability. Sensors for monitoring temperature, pH, light, gravity levels, vibrations, and radiation are provided for environmental regulation and experimental data collection. Additional experimental data acquisition includes optical density measurement, microscopy, video, and film photography. On-board full data storage capabilities are provided. A fluid transfer mechanism is utilized for inoculation, sampling, and nutrient replenishment of experiment cultures. In addition to payload design, representative experiments were developed to ensure scientific objectives remained compatible with hardware capabilities. The project is defined to provide biological data pertinent to extended duration crewed space flight including crew health issues and development of a Controlled Ecological Life Support System (CELSS). In addition, opportunities are opened for investigations leading to commercial applications of space, such as pharmaceutical development, modeling of terrestrial diseases, and material processing.
A preliminary design for performing on-orbit, autonomous research on microorganisms and cultured cells/tissues is presented. An understanding of gravity and its effects on cells is crucial for space exploration as well as for terrestrial applications. The payload is designed to be compatible with the COMmercial Experiment Transported (COMET) launch vehicle, an orbiter middeck locker interface, and with Space Station Freedom. Uplink/downlink capabilities and sample return through controlled reentry are available for all carriers. Autonomous testing activities are preprogrammed with inflight reprogrammability. Sensors for monitoring temperature, pH, light, gravity levels, vibration, and radiation are provided for environmental regulation and experimental data collection. Additional experiment data acquisition includes optical density measurement, microscopy, video, and file photography. Onboard full data storage capabilities are provided. A fluid transfer mechanism is utilized for inoculation, sampling, and nutrient replenishment of experiment cultures. In addition to payload design, representative experiments were developed to ensure scientific objectives remained compatible with hardware capabilities. The project is defined to provide biological data pertinent to extended duration crewed space flight including crew health issues and development of a Controlled Ecological Life Support System (CELSS). In addition, opportunities are opened for investigations leading to commercial applications of space, such as pharmaceutical development, modeling of terrestrial diseases, and material processing.
The isothermal profiles of the extended meniscus in a quartz cuvette were measured in a gravitational field using an image analyzing interferometer which is based on computer enhanced video microscopy of the naturally occurring interference fringes. The experimental results for heptane and pentane menisci were analyzed using the extended Young-Laplace equation. These isothermal results characterized the interfacial force field in-situ at the start of the heat transfer experiments by quantifying the dispersion constant, which is a function of the liquid-solid system and cleaning procedures. The experimentally obtained values of the disjoining pressure and the dispersion constants were compared to that predicted from the DLP theory and good agreements were obtained. The measurements are critical to the subsequent non-isothermal experiments because one of the major variables in the heat sink capability of the CVBT is the dispersion constant. In all previous studies of micro heat pipes the value of the dispersion constant has been 'guesstimated'. One of the major advantages of the current glass cell is the ability to view the extended meniscus at all times. Experimentally. we find that the extended Young-Laplace equation is an excellent model for the force field at the solid-liquid-vapor interfaces.
The isothermal profiles of the extended meniscus in a quartz cuvette were measured in a gravitational field using IAI (image analyzing interferometer) which is based on computer enhanced video microscopy of the naturally occurring interference fringes. The experimental results for heptane and pentane menisci were analyzed using the extended Young-Laplace Equation. These isothermal results characterized the interfacial force field in-situ at the start of the heat transfer experiments by quantifying the dispersion constant for the specific liquid-solid system. The experimentally obtained values of the disjoining pressures and the dispersion constants are compared to the subsequent non-isothermal experiments because one of the major variables in the heat sink capability of the CVBT is the dispersion constant. In all previous studies of micro heat pipes the value of the dispersion constant has been 'guesstimated'. The major advantages of the current glass cell is the ability to view the extended meniscus at all times. Experimentally, we find that the extended Young-Laplace Equation is an excellent model for for the force field at the solid-liquid vapor interfaces.
The isothermal profiles of the extended meniscus in a quartz cuvette were measured in a gravitational field using an image analyzing interferometer which is based on computer enhanced video microscopy of the naturally occurring interference fringes. The experimental results for heptane and pentane menisci were analyzed using the extended Young Laplace Equation. These isothermal results characterized the interfacial force field in-siru at the start of the heat transfer experiments by quantifying the dispersion constant, which is a function of the liquid-solid system and cleaning procedures. The experimentally obtained values of the disjoining pressure and the dispersion constants were compared to that predicted from the DLP theory and good agreements were obtained. The measurements are critical to the subsequent non-isothermal experiments because one of the major variables in the heat sink capability of the Constrained Vapor Bubble Thermosyphon, CVBT, is the dispersion constant. In all previous studies of micro heat pipes the value of the dispersion constant has been 'estimated'. One of the major advantages of the current glass cell is the ability to view the extended meniscus at all times. Experimentally, we find that the extended Young-Laplace Equation is an excellent model for the force field at the solid-liquid-vapor interfaces.