Standard

Underwater biotope mapping: automatic processing of underwater video data. / Iakushkin, O. O.; Pavlova, E. D. ; Lavrova, A. K. ; Polovkov, V. V. ; Frikh-Khar, A. U. ; Pen, E. A. ; Terekhina, Y. E. ; Bulanova, A. A. ; Shabalin, N. V. ; Sedova, O. S. .

The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022). 2022.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review

Harvard

Iakushkin, OO, Pavlova, ED, Lavrova, AK, Polovkov, VV, Frikh-Khar, AU, Pen, EA, Terekhina, YE, Bulanova, AA, Shabalin, NV & Sedova, OS 2022, Underwater biotope mapping: automatic processing of underwater video data. in The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022). The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022), Дубна, Russian Federation, 6/07/22. <https://pos.sissa.it/429/024/pdf>

APA

Iakushkin, O. O., Pavlova, E. D., Lavrova, A. K., Polovkov, V. V., Frikh-Khar, A. U., Pen, E. A., Terekhina, Y. E., Bulanova, A. A., Shabalin, N. V., & Sedova, O. S. (2022). Underwater biotope mapping: automatic processing of underwater video data. In The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022) https://pos.sissa.it/429/024/pdf

Vancouver

Iakushkin OO, Pavlova ED, Lavrova AK, Polovkov VV, Frikh-Khar AU, Pen EA et al. Underwater biotope mapping: automatic processing of underwater video data. In The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022). 2022

Author

Iakushkin, O. O. ; Pavlova, E. D. ; Lavrova, A. K. ; Polovkov, V. V. ; Frikh-Khar, A. U. ; Pen, E. A. ; Terekhina, Y. E. ; Bulanova, A. A. ; Shabalin, N. V. ; Sedova, O. S. . / Underwater biotope mapping: automatic processing of underwater video data. The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022). 2022.

BibTeX

@inproceedings{0d6211a31c004bdf9663b9d57a4967fd,
title = "Underwater biotope mapping: automatic processing of underwater video data",
abstract = "The task of analysing the inhabitants of the underwater world applies to a wide range of applied problems: construction, fishing, and mining. Currently, this task is applied on an industrial scale by a rigorous review done by human experts in underwater life. In this work, we present a tool that we have created that allows us to significantly reduce the time spent by a person on video analysis. Our technology offsets the painstaking video review task to AI, creating a shortcut that allows experts only to verify the accuracy of the results. To achieve this, we have developed an observation pipeline by dividing the video into frames; assessing their degree of noise and blurriness; performing corrections via resolution increase; analysing the number of animals on each frame; building a report on the content of the video, and displaying the obtained data of the biotope on the map. This dramatically reduces the time spent analysing underwater video data.Also, we considered the task of biotope mass calculation. We correlated the Few-shot learning segmentation model results with point cloud data to achieve that. That provided us with a biotope surface coverage area that allowed us to approximate its volume. Such estimation is helpful for precise area mapping and surveillance.Thus, this paper presents a system that allows detailed underwater biotope mapping using automatic processing of a single camera underwater video data. To achieve this, we combine into a single pipeline a set of deep neural networks that work in tandem.",
author = "Iakushkin, {O. O.} and Pavlova, {E. D.} and Lavrova, {A. K.} and Polovkov, {V. V.} and Frikh-Khar, {A. U.} and Pen, {E. A.} and Terekhina, {Y. E.} and Bulanova, {A. A.} and Shabalin, {N. V.} and Sedova, {O. S.}",
year = "2022",
month = dec,
day = "6",
language = "English",
booktitle = "The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022)",
note = "null ; Conference date: 06-07-2022 Through 08-07-2022",
url = "https://indico.jinr.ru/event/3084/sessions/1751/#20220707",

}

RIS

TY - GEN

T1 - Underwater biotope mapping: automatic processing of underwater video data

AU - Iakushkin, O. O.

AU - Pavlova, E. D.

AU - Lavrova, A. K.

AU - Polovkov, V. V.

AU - Frikh-Khar, A. U.

AU - Pen, E. A.

AU - Terekhina, Y. E.

AU - Bulanova, A. A.

AU - Shabalin, N. V.

AU - Sedova, O. S.

PY - 2022/12/6

Y1 - 2022/12/6

N2 - The task of analysing the inhabitants of the underwater world applies to a wide range of applied problems: construction, fishing, and mining. Currently, this task is applied on an industrial scale by a rigorous review done by human experts in underwater life. In this work, we present a tool that we have created that allows us to significantly reduce the time spent by a person on video analysis. Our technology offsets the painstaking video review task to AI, creating a shortcut that allows experts only to verify the accuracy of the results. To achieve this, we have developed an observation pipeline by dividing the video into frames; assessing their degree of noise and blurriness; performing corrections via resolution increase; analysing the number of animals on each frame; building a report on the content of the video, and displaying the obtained data of the biotope on the map. This dramatically reduces the time spent analysing underwater video data.Also, we considered the task of biotope mass calculation. We correlated the Few-shot learning segmentation model results with point cloud data to achieve that. That provided us with a biotope surface coverage area that allowed us to approximate its volume. Such estimation is helpful for precise area mapping and surveillance.Thus, this paper presents a system that allows detailed underwater biotope mapping using automatic processing of a single camera underwater video data. To achieve this, we combine into a single pipeline a set of deep neural networks that work in tandem.

AB - The task of analysing the inhabitants of the underwater world applies to a wide range of applied problems: construction, fishing, and mining. Currently, this task is applied on an industrial scale by a rigorous review done by human experts in underwater life. In this work, we present a tool that we have created that allows us to significantly reduce the time spent by a person on video analysis. Our technology offsets the painstaking video review task to AI, creating a shortcut that allows experts only to verify the accuracy of the results. To achieve this, we have developed an observation pipeline by dividing the video into frames; assessing their degree of noise and blurriness; performing corrections via resolution increase; analysing the number of animals on each frame; building a report on the content of the video, and displaying the obtained data of the biotope on the map. This dramatically reduces the time spent analysing underwater video data.Also, we considered the task of biotope mass calculation. We correlated the Few-shot learning segmentation model results with point cloud data to achieve that. That provided us with a biotope surface coverage area that allowed us to approximate its volume. Such estimation is helpful for precise area mapping and surveillance.Thus, this paper presents a system that allows detailed underwater biotope mapping using automatic processing of a single camera underwater video data. To achieve this, we combine into a single pipeline a set of deep neural networks that work in tandem.

UR - https://indico.jinr.ru/event/3084/sessions/1751/#20220707

UR - https://pos.sissa.it/429/#session-4601

M3 - Conference contribution

BT - The 6th International Workshop on Deep Learning in Computational Physics (DLCP2022)

Y2 - 6 July 2022 through 8 July 2022

ER -

ID: 102520152