Convolutional Neural Networks for Counting Fish in Fisheries Surveillance Video

Geoffrey French, Mark Fisher, Michal Mackiewicz and Coby Needle

Abstract

We present a computer vision tool that analyses video from a CCTV system installed on fishing trawlers to monitor discarded fish catch. The system aims to support expert observers who review the footage and verify numbers, species and sizes of discarded fish. The operational environment presents a significant challenge for these tasks. Fish are processed below deck under fluorescent lights, they are randomly oriented and there are multiple occlusions. The scene is unstructured and complicated by the presence of fishermen processing the catch. We describe an approach to segmenting the scene and counting fish that exploits the $N^4$-Fields algorithm. We performed extensive tests of the algorithm on a data set comprising 443 frames from 6 belts. Results indicate the relative count error (for individual fish) ranges from 2\% to 16\%. We believe this is the first system that is able to handle footage from operational trawlers.

Session

Workshop: Machine Vision of Animals and their Behaviour (MVAB 2015)

Files

PDF iconPaper (PDF, 2M)

DOI

10.5244/C.29.MVAB.7
https://dx.doi.org/10.5244/C.29.MVAB.7

Citation

Geoffrey French, Mark Fisher, Michal Mackiewicz and Coby Needle. Convolutional Neural Networks for Counting Fish in Fisheries Surveillance Video. In T. Amaral, S. Matthews, T. Plötz, S. McKenna, and R. Fisher, editors, Proceedings of the Machine Vision of Animals and their Behaviour (MVAB), pages 7.1-7.10. BMVA Press, September 2015.

Bibtex

@inproceedings{MVAB2015_7,
	title={Convolutional Neural Networks for Counting Fish in Fisheries Surveillance Video},
	author={ Geoffrey French and Mark Fisher and Michal Mackiewicz and Coby Needle},
	year={2015},
	month={September},
	pages={7.1-7.10},
	articleno={7},
	numpages={10},
	booktitle={Proceedings of the Machine Vision of Animals and their Behaviour (MVAB)},
	publisher={BMVA Press},
	editor={T. Amaral, S. Matthews, T. Plötz, S. McKenna, and R. Fisher},
	doi={10.5244/C.29.MVAB.7},
	isbn={1-901725-57-X},
	url={https://dx.doi.org/10.5244/C.29.MVAB.7}
}