ViBe

ViBe is a background subtraction algorithm which has been presented at the IEEE ICASSP 2009 conference and was refined in later publications.^[1]^[2]^[3]^[4] More precisely, it is a software module for extracting background information from moving images. It has been developed by Oliver Barnich and Marc Van Droogenbroeck of the Montefiore Institute, University of Liège, Belgium.^[5]

ViBe is patented:^[6] the patent covers various aspects such as stochastic replacement, spatial diffusion, and non-chronological handling.

ViBe is written in the programming language C, and has been implemented on CPU, GPU and FPGA.^[7]

Technical description^[2]

Pixel model and classification process

Many advanced techniques are used to provide an estimate of the temporal probability density function (pdf) of a pixel x. ViBe's approach is different, as it imposes the influence of a value in the polychromatic space to be limited to the local neighborhood. In practice, ViBe does not estimate the pdf, but uses a set of previously observed sample values as a pixel model. To classify a value pt(x), it is compared to its closest values among the set of samples.

Model update: Sample values lifespan policy

ViBe ensures a smooth exponentially decaying lifespan for the sample values that constitute the pixel models. This makes ViBe able to successfully deal with concomitant events with a single model of a reasonable size for each pixel. This is achieved by choosing, randomly, which sample to replace when updating a pixel model. Once the sample to be discarded has been chosen, the new value replaces the discarded sample. The pixel model that would result from the update of a given pixel model with a given pixel sample cannot be predicted since the value to be discarded is chosen at random.

Model update: Spatial Consistency

To ensure the spatial consistency of the whole image model and handle practical situations such as small camera movements or slowly evolving background objects, ViBe uses a technique similar to that developed for the updating process in which it chooses at random and update a pixel model in the neighborhood of the current pixel. By denoting NG(x) and p(x) respectively the spatial neighborhood of a pixel x and its value, and assuming that it was decided to update the set of samples of x by inserting p(x), then ViBe also use this value p(x) to update the set of samples of one of the pixels in the neighborhood NG(x), chosen at random. As a result, ViBe is able to produce spatially coherent results directly without the use of any post-processing method.

Model initialization

Although the model could easily recover from any type of initialization, for example by choosing a set of random values, it is convenient to get an accurate background estimate as soon as possible. Ideally a segmentation algorithm would like to be able to segment the video sequences starting from the second frame, the first frame being used to initialize the model. Since no temporal information is available prior to the second frame, ViBe populates the pixel models with values found in the spatial neighborhood of each pixel; more precisely, it initializes the background model with values taken randomly in each pixel neighborhood of the first frame. The background estimate is therefore valid starting from the second frame of a video sequence.

References

^ Barnich, Olivier; Van Droogenbroeck, Marc (2009). "ViBe: A powerful random technique to estimate the background in video sequences". 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. pp. 945–948. doi:10.1109/ICASSP.2009.4959741. hdl:2268/12087. ISBN 978-1-4244-2353-8. S2CID 10129753.
^ ^a ^b Barnich, O; Van Droogenbroeck, M (2011). "ViBe: A Universal Background Subtraction Algorithm for Video Sequences". IEEE Transactions on Image Processing. 20 (6): 1709–1724. Bibcode:2011ITIP...20.1709B. doi:10.1109/TIP.2010.2101613. hdl:2268/145853. ISSN 1057-7149. PMID 21189241. S2CID 783186.
^ Van Droogenbroeck, M.; Paquot, O. (2012). "Background subtraction: Experiments and improvements for ViBe". 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. pp. 32–37. doi:10.1109/CVPRW.2012.6238924. hdl:2268/117561. ISBN 978-1-4673-1612-5. S2CID 10545941.
^ Van Droogenbroeck, Marc; Barnich, Olivier (2014). "ViBe: A Disruptive Method for Background Subtraction". Background Modeling and Foreground Detection for Video Surveillance. pp. 7.1–7.23. doi:10.1201/b17223-10. ISBN 978-1-4822-0537-4.
^ "ViBe - a powerful technique for background detection and subtraction in video sequences".
^ World Intellectual Property Organization. ViBe patents
^ Kryjak, Tomasz; Gorgon, Marek. "Real-time Implementation of the ViBe Foreground Object Segmentation Algorithm". In Proceedings of the 2013 Federated Conference on Computer Science and Information Systems (FedCSIS) pp. 591–596

[BarnichVan_Droogenbroeck2009-1] Barnich, Olivier; Van Droogenbroeck, Marc (2009). "ViBe: A powerful random technique to estimate the background in video sequences". 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. pp. 945–948. doi:10.1109/ICASSP.2009.4959741. hdl:2268/12087. ISBN 978-1-4244-2353-8. S2CID 10129753.

[BarnichVan_Droogenbroeck2011-2] Barnich, O; Van Droogenbroeck, M (2011). "ViBe: A Universal Background Subtraction Algorithm for Video Sequences". IEEE Transactions on Image Processing. 20 (6): 1709–1724. Bibcode:2011ITIP...20.1709B. doi:10.1109/TIP.2010.2101613. hdl:2268/145853. ISSN 1057-7149. PMID 21189241. S2CID 783186.

[Van_DroogenbroeckPaquot2012-3] Van Droogenbroeck, M.; Paquot, O. (2012). "Background subtraction: Experiments and improvements for ViBe". 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. pp. 32–37. doi:10.1109/CVPRW.2012.6238924. hdl:2268/117561. ISBN 978-1-4673-1612-5. S2CID 10545941.

[Van_DroogenbroeckBarnich2014-4] Van Droogenbroeck, Marc; Barnich, Olivier (2014). "ViBe: A Disruptive Method for Background Subtraction". Background Modeling and Foreground Detection for Video Surveillance. pp. 7.1–7.23. doi:10.1201/b17223-10. ISBN 978-1-4822-0537-4.

[5] "ViBe - a powerful technique for background detection and subtraction in video sequences".

[6] World Intellectual Property Organization. ViBe patents

[7] Kryjak, Tomasz; Gorgon, Marek. "Real-time Implementation of the ViBe Foreground Object Segmentation Algorithm". In Proceedings of the 2013 Federated Conference on Computer Science and Information Systems (FedCSIS) pp. 591–596

[1]

[2]

[3]

[4]

[5]

[6]

[7]