Personnel-based aerial surveys have demonstrated their capability for monitoring marine animal populations. That being said, not many studies have been conducted on smaller shark species in coastal waters, where they can become a threat to beach-goers and possibly be killed by beach protection netting. In this paper we report our findings on real-time, automated detection of great white shark dummy targets using a multispectral imager. 2.5 × 1.2 m plywood shark cutouts were submerged to 1 m, 2 m, and 3 m below the surface in the Pacific Ocean off the coast of San Diego, CA. 66 passes were conducted over the course of three days, resulting in an average probability of detection of 84.8%. Automatic detection was mostly limited by water turbidity in this test, but other environmental conditions such as wind, wave speed and period, and sun glint also had an effect on detection. The high probability of detection and low false alarm rate from this study are an indication that using an automated remote sensing system could be an effective alternative to personnel-based aerial surveys.
A series of UAS-capable multi-channel imagers have been developed under SBIR funding through NAVAIR. This paper discusses the application of these sensors to littoral observations/ reconnaissance and littoral subsurface target detection. These imagers consist of a turreted multi-camera sensor head and an associated data acquisition and processing unit. A description of the sensor head, tailored for littoral operations, and the acquisition unit are given. Data collected off the coast of La Jolla, (north of San Diego) California over the last yearis used to demonstrate an environmental reconnaissance capability.The sensor systems are the EYEs series of sensors developed by Advanced Coherent Technologies, LLC (ACT). They integrate multiple 1.4 megapixel 12 bit charge-coupled devices (CCDs) into a commercial CloudCap TASE300 c turret. Each CCD is coupled with filters and optics appropriate for specific operations. The acquisition and processing system is based on the Vision4ce CPU/GPU ruggedized computer system.
The Navy recently began investing in the design of mission-specific payloads for the Small Tactical Unmanned Aircraft System (STUAS). STUAS is a Tier II size UAS with a roughly 35 pound mission payload and a gimbaled general-purpose electro optical/infrared (EO/IR) system. The EO/IR system is likely composed of a video camera in the visible, a mid-wave infrared (MWIR) and/or a long-wave infrared (LWIR) for night operations, and an infrared marker and laser range finder. Advanced Coherent Technologies, LLC (ACT), in a series of SBIR efforts, has developed a modular, multi-channel imaging system for deployment on airborne and UAV platforms. ACT's system, called EYE5, demonstrates how an EO/IR system combined with an on-board, real-time processor can be tailored for specific applications to produce real-time actionable data. The EYE5 sensor head and modular real-time processor descriptions are presented in this work. Examples of the system's abilities in various Navy-relevant applications are reviewed.
: Observing marine mammal distribution and determining population densities is a complex problem that has been ongoing for many decades. Modern approaches use a varying combination of sophisticated acoustic monitoring and highly trained visual observers from both ships and aircraft. New electro-optical and infrared (EO/IR) camera systems with automatic detection algorithms offer the option to do quantitative airborne surveys safely and quickly. This paper discusses an airborne EO/IR modular system used to observe marine mammals, make density measurements and eventually be used to quantify animal behaviors.
Determining marine mammal densities is a complex problem that has been ongoing for many decades. Modern approaches use a combination of sophisticated acoustic monitoring and highly trained visual observers from both ships and aircraft. New camera systems with automatic detection algorithms offer the option to do quantitative airborne surveys safely and quickly. This paper presents a discussion on the various methods of calculating marine mammal densities and demonstrates how all these methods can work together to present quantitative density measurements.
This paper describes an approach to utilize a multi-channel, multi-spectral electro-optic (EO) system for littoral zone characterization. Advanced Coherent Technologies, LLC (ACT) presents their EO sensor systems for the surf zone environmental assessment and potential surf zone target detection. Specifically, an approach is presented to determine a Surf Zone Index (SZI) from the multi-spectral EO sensor system. SZI provides a single quantitative value of the surf zone conditions delivering an immediate understanding of the area and an assessment as to how well an airborne optical system might perform in a mine countermeasures (MCM) operation. Utilizing consecutive frames of SZI images, ACT is able to measure variability over time. A surf zone nomograph, which incorporates targets, sensor, and environmental data, including the SZI to determine the environmental impact on system performance, is reviewed in this work. ACT's electro-optical multi-channel, multi-spectral imaging system and test results are presented and discussed.
Due to increased security concerns, the commitment to monitor and maintain security in the maritime environment is increasingly a priority. A country's coast is the most vulnerable area for the incursion of illegal immigrants, terrorists and contraband. This work illustrates the ability of a low-cost, light-weight, multi-spectral, multi-channel imaging system to handle the environment and see under difficult marine conditions. The system and its implemented detecting and tracking technologies should be organic to the maritime homeland security community for search and rescue, fisheries, defense, and law enforcement. It is tailored for airborne and ship based platforms to detect, track and monitor suspected objects (such as semi-submerged targets like marine mammals, vessels in distress, and drug smugglers). In this system, automated detection and tracking technology is used to detect, classify and localize potential threats or objects of interest within the imagery provided by the multi-spectral system. These algorithms process the sensor data in real time, thereby providing immediate feedback when features of interest have been detected. A supervised detection system based on Haar features and Cascade Classifiers is presented and results are provided on real data. The system is shown to be extendable and reusable for a variety of different applications.
This work presents an electro-optical multispectral capability that detects and monitors marine mammals. It is a continuance of Whale Search Radar SBIR program funded by PMA-264 through NAVAIR. A lightweight, multispectral, turreted imaging system is designed for airborne and ship based platforms to detect and monitor marine mammals. The system tests were conducted over the Humpback whale breeding and calving area in Maui, Hawaii. The results of the tests and the system description are presented. The development of an automatic whale detection algorithm is discussed as well as methodology used to turn raw survey data into quantifiable data products.
The objective of this work is to demonstrate an automated Electro-Optical and Infrared (EO/IR) system for measuring marine mammal densities. The ability of an EO/IR system to make density measurements without corresponding acoustic and visual data is only limited by the number of animals present and the probability that the animal is close enough to the surface to be detected and tracked. It is discussed the utility of this type of EO/IR system in measuring the densities of various species of interest.
Advanced Coherent Technologies, LLC has demonstrated the use of multi-channel imaging systems in a variety of applications. These systems are composed of multiple cameras or 'channels', each of which can be coupled with spectral filters, polarization analyzers, or unique optics (e.g. for field of view (FOV) or aperture adjustments). The channel content is designed specifically for the extraction of information and/or the detection of targets. Airborne data collects have been made over forest and maritime environments for the detection of various targets. The results of these collects are discussed and analyzed. Of particular concern is how channel content is chosen in each environment and for each target.
Advanced Coherent Technologies, LLC (ACT) is using a multi-spectral, multi-channel imaging system to detect and monitor marine mammals. The system, designed with US Navy funding, is intended to monitor mammals on US Navy submarine training ranges prior to and during Navy active acoustic training activities. ACT has conducted system tests and data collection activities at the St. Lawrence Seaway (Quebec, Canada), at Ma'alaea Bay (Maui, Hawaii), and from the Coronado Bay Bridge (San Diego, California). A description of the imaging system and the results of the data collections are discussed and presented.
Radiance Technologies, Inc. has tested and demonstrated real-time collection and on-board processing of Multispectral Imagery (MSI). Further, the test and demonstration consisted of a real-time downlink from the aircraft to the ground station and real-time display of the processed data product. The multispectral imagery was collected with a low-cost, low-profile MSI sensor, MANTIS-3T, from PAR Government Systems. The data product was created from output of a novel spectral algorithm combination that increases the probability of detection and decreases the false alarm rates for specific objects of interest. The display product was a compressed true color image in which the detected objects were delineated with red pixels. A description of the end-to-end solution, issues encountered as well as their resolution, and results will be discussed.
Multispectral visible and infrared observations of various species of whales were made in the St. Lawrence Seaway near Quebec, Canada and Papawai Point in Maui, Hawaii. The Multi-mission Adaptable Narrowband Imaging System (MANTIS) was deployed in two configurations: airborne looking down, and bluff mounted looking at low-grazing angles. An Infrared (IR) sensor was also deployed in the bluff mounted configuration. Detections of marine mammals were made with these systems of submerged mammals and surface mammals at ranges up to 8 miles. Automatic detection algorithms are being explored to detect, track and monitor the behavior of individuals and pods of whales. This effort is part of a United States Navy effort to insure that marine mammals are not injured during the testing of the US Navy's acoustic Anti-submarine Warfare (ASW) systems.
Narrow band polarization measurements were taken from a bridge in San Diego Harbor using the Advanced Coherent Technologies Multi-mission Adaptable Narrowband Imaging Spectrometer (MANTIS) multichannel imaging system. MANTIS was capable of simultaneously collecting four channels of imagery through a narrowband green (532 nm) filter together with linear polarizers oriented at 0, 45, 90, and 135 degrees. This configuration enabled the collection of the first three Stokes Vector elements. The data is being gathered to explore methods of calculating the sea surface Mueller Matrix. Models, methods, and measurements are presented. Of specific interest is the deviation of the modeled data from the measured data and its causes. The data and a model are used to estimate the contribution of upwelled polarized light.
PAR Government Systems Corporation (PAR) with Advanced Coherent Technologies, LLC (ACT) has developed affordable, narrow-band polarimetry sensor hardware and software based upon the PAR Mission Adaptable Narrowband Tunable Imaging Sensor (MANTIS). The sensor has been deployed in multiple environments. Polarimetric imagery of the clear blue sky and the sea surface has been collected. In addition, a significant amount of calibration data has been collected to correctly calibrate the sensor for real-time Stokes Vector imaging. Data collected with the MANTIS polarization sensor has been compared to modeled data. The sensor hardware and software is described and some representative collected calibration data are presented and compared to a developing model.
Narrow band polarization imagery of the sea surface was collected over water from the Coronado Bay Bridge in San Diego, CA. The MANTIS (Multi-mission Adaptive Narrowband Imaging Sensor) system was configured to simultaneously collect four linearly polarized images at 0 degrees, 45 degrees, 90 degrees, and 135 degrees polarization angles respectively. All images were collected using a 550 nm filter with a 40 run band pass. Images were made while scanning over the maximum range of elevation and azimuthal angles possible from the 70 meter high bridge platform. Methodology and results are presented. Representative results are given including derived Stokes parameters and Degree of Polarization for reflected light for an elevation scan at a fixed azimuth together with examples of polarization and Stokes parameter imagery.