Industrial Fisheye Image Segmentation Using Neural Networks

A. Beloshapko, V. Korkhov, C. Knoll, U. Iben

Research output

Abstract

Fisheye cameras have recently became very popular in computer vision applications due to their wide field of view. In addition to a better overview of the surrounding area, they enable to capture objects at extremely close ranges. These advantages come at a cost of strong image distortion, which cannot be removed completely maintaining image continuity. This complicates the use of traditional computer vision algorithms, which expect a single image as an input. This paper presents a performance evaluation of neural network algorithms for object detection and segmentation on fisheye camera images. Three approaches are evaluated: semantic image segmentation with Fully Convolutional Network (FCN) [13], a fully convolutional approach to instance segmentation with U-Net [18] and a region-based approach to instance segmentation with Mask R-CNN [10]. All of these networks successfully solved the task. However, as they were designed to different purposes, each of them has its own strengths and shortcomings. These three approaches are used to perform euro container image segmentation task. An image dataset was created in order to train and evaluate these algorithms. Huge part of this dataset was generated artificially, which simplified the task of ground truth labeling. The power of neural networks enable for fast and reliable image segmentation. As to our knowledge, this is the first neural networks application for euro container fisheye image detection and segmentation.

Original languageEnglish
Pages (from-to)678-690
Number of pages13
JournalLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11622
DOIs
Publication statusPublished - 1 Jul 2019
Event19th International Conference on Computational Science and Its Applications, ICCSA 2019 - Saint Petersburg
Duration: 1 Jul 20194 Jul 2019

Fingerprint

Image segmentation
Image Segmentation
Neural Networks
Neural networks
Computer vision
Containers
Segmentation
Cameras
Container
Computer Vision
Labeling
Masks
Camera
Semantics
Neural Network Applications
Wide-field
Object Detection
Network Algorithms
Field of View
Mask

Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

@article{b75bcddba4484c059e9bc287173b53e4,
title = "Industrial Fisheye Image Segmentation Using Neural Networks",
abstract = "Fisheye cameras have recently became very popular in computer vision applications due to their wide field of view. In addition to a better overview of the surrounding area, they enable to capture objects at extremely close ranges. These advantages come at a cost of strong image distortion, which cannot be removed completely maintaining image continuity. This complicates the use of traditional computer vision algorithms, which expect a single image as an input. This paper presents a performance evaluation of neural network algorithms for object detection and segmentation on fisheye camera images. Three approaches are evaluated: semantic image segmentation with Fully Convolutional Network (FCN) [13], a fully convolutional approach to instance segmentation with U-Net [18] and a region-based approach to instance segmentation with Mask R-CNN [10]. All of these networks successfully solved the task. However, as they were designed to different purposes, each of them has its own strengths and shortcomings. These three approaches are used to perform euro container image segmentation task. An image dataset was created in order to train and evaluate these algorithms. Huge part of this dataset was generated artificially, which simplified the task of ground truth labeling. The power of neural networks enable for fast and reliable image segmentation. As to our knowledge, this is the first neural networks application for euro container fisheye image detection and segmentation.",
keywords = "Euro container detection, FCN, Fisheye cameras, Image instance segmentation, Image semantic segmentation, Mask R-CNN, U-Net",
author = "A. Beloshapko and V. Korkhov and C. Knoll and U. Iben",
year = "2019",
month = "7",
day = "1",
doi = "10.1007/978-3-030-24305-0_50",
language = "English",
volume = "11622",
pages = "678--690",
journal = "Lecture Notes in Computer Science",
issn = "0302-9743",
publisher = "Springer",

}

TY - JOUR

T1 - Industrial Fisheye Image Segmentation Using Neural Networks

AU - Beloshapko, A.

AU - Korkhov, V.

AU - Knoll, C.

AU - Iben, U.

PY - 2019/7/1

Y1 - 2019/7/1

N2 - Fisheye cameras have recently became very popular in computer vision applications due to their wide field of view. In addition to a better overview of the surrounding area, they enable to capture objects at extremely close ranges. These advantages come at a cost of strong image distortion, which cannot be removed completely maintaining image continuity. This complicates the use of traditional computer vision algorithms, which expect a single image as an input. This paper presents a performance evaluation of neural network algorithms for object detection and segmentation on fisheye camera images. Three approaches are evaluated: semantic image segmentation with Fully Convolutional Network (FCN) [13], a fully convolutional approach to instance segmentation with U-Net [18] and a region-based approach to instance segmentation with Mask R-CNN [10]. All of these networks successfully solved the task. However, as they were designed to different purposes, each of them has its own strengths and shortcomings. These three approaches are used to perform euro container image segmentation task. An image dataset was created in order to train and evaluate these algorithms. Huge part of this dataset was generated artificially, which simplified the task of ground truth labeling. The power of neural networks enable for fast and reliable image segmentation. As to our knowledge, this is the first neural networks application for euro container fisheye image detection and segmentation.

AB - Fisheye cameras have recently became very popular in computer vision applications due to their wide field of view. In addition to a better overview of the surrounding area, they enable to capture objects at extremely close ranges. These advantages come at a cost of strong image distortion, which cannot be removed completely maintaining image continuity. This complicates the use of traditional computer vision algorithms, which expect a single image as an input. This paper presents a performance evaluation of neural network algorithms for object detection and segmentation on fisheye camera images. Three approaches are evaluated: semantic image segmentation with Fully Convolutional Network (FCN) [13], a fully convolutional approach to instance segmentation with U-Net [18] and a region-based approach to instance segmentation with Mask R-CNN [10]. All of these networks successfully solved the task. However, as they were designed to different purposes, each of them has its own strengths and shortcomings. These three approaches are used to perform euro container image segmentation task. An image dataset was created in order to train and evaluate these algorithms. Huge part of this dataset was generated artificially, which simplified the task of ground truth labeling. The power of neural networks enable for fast and reliable image segmentation. As to our knowledge, this is the first neural networks application for euro container fisheye image detection and segmentation.

KW - Euro container detection

KW - FCN

KW - Fisheye cameras

KW - Image instance segmentation

KW - Image semantic segmentation

KW - Mask R-CNN

KW - U-Net

UR - http://www.scopus.com/inward/record.url?scp=85068611843&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-24305-0_50

DO - 10.1007/978-3-030-24305-0_50

M3 - Article

AN - SCOPUS:85068611843

VL - 11622

SP - 678

EP - 690

JO - Lecture Notes in Computer Science

JF - Lecture Notes in Computer Science

SN - 0302-9743

ER -