AUTHOR=Atlas William I. , Ma Sami , Chou Yi Ching , Connors Katrina , Scurfield Daniel , Nam Brandon , Ma Xiaoqiang , Cleveland Mark , Doire Janvier , Moore Jonathan W. , Shea Ryan , Liu Jiangchuan TITLE=Wild salmon enumeration and monitoring using deep learning empowered detection and tracking JOURNAL=Frontiers in Marine Science VOLUME=10 YEAR=2023 URL=https://www.frontiersin.org/journals/marine-science/articles/10.3389/fmars.2023.1200408 DOI=10.3389/fmars.2023.1200408 ISSN=2296-7745 ABSTRACT=
Pacific salmon have experienced declining abundance and unpredictable returns, yet remain vital to livelihoods, food security, and cultures of coastal communities around the Pacific Rim, creating a need for reliable and timely monitoring to inform sustainable fishery management. Currently, spawning salmon abundance is often monitored with in-river video or sonar cameras. However, reviewing video for estimates of salmon abundance from these programs requires thousands of hours of staff time, and data are typically not available until after the fishing season is completed. Computer vision deep learning can enable rapid and reliable processing of data, with potentially transformative applications in salmon population assessment and fishery management. Working with two First Nations fishery programs in British Columbia, Canada, we developed, trained, and tested deep learning models to perform object detection and multi-object tracking for automated video enumeration of salmon passing two First Nation-run weirs. We gathered and annotated more than 500,000 frames of video data encompassing 12 species, including seven species of anadromous salmonids, and trained models for multi-object tracking and species detection. Our top performing model achieved a mean average precision (mAP) of 67.6%, and species-specific mAP scores