5: Conclusion
5.4 Future work
To tackle the problem of occlusions directly using machine learning, the author would
like to proceed with another attempt based on the synthetic dataset generation. Given
the input images and semantic instance segmentation masks produced by the method
known occlusion properties by injecting a foreign instanceon top of the existing image. Having known instance segmentation masks for the original image and the introduced
foreign object one can train a neural network to estimate the features indicating the
presence of occlusions. To produce convincing images author explored the concept of
References
[1] Wenhan Luo, Junliang Xing, Anton Milan, Xiaoqin Zhang, Wei Liu, Xiaowei Zhao,
and Tae-Kyun Kim. Multiple object tracking: A literature review. arXiv preprint arXiv:1409.7618, 2014.
[2] Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification
with deep convolutional neural networks. In F. Pereira, C. J. C. Burges, L. Bottou,
and K. Q. Weinberger, editors,Advances in Neural Information Processing Systems 25, pages 1097–1105. Curran Associates, Inc., 2012.
[3] Yann LeCun, Bernhard Boser, John S Denker, Donnie Henderson, Richard E
Howard, Wayne Hubbard, and Lawrence D Jackel. Backpropagation applied to
handwritten zip code recognition. Neural computation, 1(4):541–551, 1989.
[4] Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross
Girshick, Sergio Guadarrama, and Trevor Darrell. Caffe: Convolutional
architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
[5] Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig
Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay
Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard,
Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg,
Dandelion Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike
Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete
Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015.
Software available from tensorflow.org.
[6] Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma,
Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, et al.
Imagenet large scale visual recognition challenge.International Journal of Computer Vision, 115(3):211–252, 2015.
[7] Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and
Andrew Zisserman. The pascal visual object classes (voc) challenge. International journal of computer vision, 88(2):303–338, 2010.
[8] T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L.
Zitnick. Microsoft coco: Common objects in context. InEuropean conference on computer vision, pages 740–755. Springer, 2014.
[9] Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton. The cifar-10 dataset. online: http://www. cs. toronto. edu/kriz/cifar. html, 2014.
[10] Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus
Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. The
cityscapes dataset for semantic urban scene understanding. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 3213–3223, 2016. [11] Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look
once: Unified, real-time object detection. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 779–788, 2016.
[12] Joseph Redmon and Ali Farhadi. Yolo9000: Better, faster, stronger. InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 7263–7271, 2017.
[13] Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed,
Cheng-Yang Fu, and Alexander C Berg. Ssd: Single shot multibox detector. In
European conference on computer vision, pages 21–37. Springer, 2016.
[14] Ross Girshick. Fast r-cnn. InProceedings of the IEEE international conference on computer vision, pages 1440–1448, 2015.
[15] S. Ren, K. He, R. Girshick, and J. Sun. Faster r-cnn: Towards real-time object
detection with region proposal networks. InAdvances in neural information processing systems, pages 91–99, 2015.
[16] CY Ren, VA Prisacariu, O Kähler, ID Reid, and DW Murray. Real-time tracking of
single and multiple objects from depth-colour imagery using 3d signed distance
functions. International Journal of Computer Vision, 124(1):80–95, 2017.
[17] FAM Tuyttens, Sophie de Graaf, Jasper LT Heerkens, Leonie Jacobs, Elena Nalon,
Sanne Ott, Lisanne Stadig, Eva Van Laer, and Bart Ampe. Observer bias in animal
behaviour research: can we believe what we score, if we score what we believe?
Animal Behaviour, 90:273–280, 2014.
[18] PIC North America. Standard animal care: Daily routines. InWean to finish manual, pages 23–24, 2014.
[19] David Mellor. Updating animal welfare thinking: Moving beyond the “five
freedoms” towards “a life worth living”.Animals, 6(3):21, 2016.
[20] Christian Boessen, Georgeanne Artz, and Lee Schulz. A baseline study of labor
issues and trends in us pork production, 2018.
[21] S. G. Matthews, A. L. Miller, J. Clapp, T. Plötz, and I. Kyriazakis. Early detection of
health and welfare compromises through automated detection of behavioural
[22] Abozar Nasirahmadi, Sandra A Edwards, and Barbara Sturm. Implementation of
machine vision for detecting behaviour of cattle and pigs. Livestock Science, 202:25–38, 2017.
[23] CM Wathes, Helle Halkjær Kristensen, J-M Aerts, and Daniel Berckmans. Is
precision livestock farming an engineer’s daydream or nightmare, an animal’s
friend or foe, and a farmer’s panacea or pitfall? Computers and electronics in agriculture, 64(1):2–10, 2008.
[24] Thomas M Banhazi, H Lehr, JL Black, H Crabtree, P Schofield, M Tscharke, and
D Berckmans. Precision livestock farming: an international review of scientific
and commercial aspects. International Journal of Agricultural and Biological Engineering, 5(3):1–9, 2012.
[25] E Tullo, I Fontana, and M Guarino. Precision livestock farming: an overview of
image and sound labelling. InEuropean Conference on Precision Livestock Farming 2013:(PLF) EC-PLF, pages 30–38. KU Leuven, 2013.
[26] So-Hyeon Kim, Do-Hyeun Kim, and Hee-Dong Park. Animal situation tracking
service using rfid, gps, and sensors. InComputer and Network Technology (ICCNT), 2010 Second International Conference on, pages 153–156. IEEE, 2010.
[27] A. Stukenborg, I. Traulsen, B. Puppe, U. Presuhn, and J. Krieter. Agonistic
behaviour after mixing in pigs under commercial farm conditions. Applied Animal Behaviour Science, 129(1):28–35, 2011.
[28] SMC Porto, C Arcidiacono, A Giummarra, U Anguzza, and G Cascone. Localisation
and identification performances of a real-time location system based on ultra wide
band technology for monitoring and tracking dairy cow behaviour in a semi-open
[29] Guerino Giancola, Ljubica Blazevic, Isabelle Bucaille, Luca De Nardis, M-G
Di Benedetto, Yves Durand, Gwillerm Froc, Begoña Molinete Cuezva, J-B Pierrot,
Pekka Pirinen, et al. Uwb mac and network solutions for low data rate with
location and tracking applications. In2005 IEEE International Conference on Ultra-Wideband, pages 758–763. IEEE, 2005.
[30] Patrick E Clark, Douglas E Johnson, Mark A Kniep, Phillip Jermann, Brad Huttash,
Andrew Wood, Michael Johnson, Craig McGillivan, and Kevin Titus. An advanced,
low-cost, gps-based animal tracking system.Rangeland Ecology & Management, 59(3):334–340, 2006.
[31] Mac Schwager, Dean M Anderson, Zack Butler, and Daniela Rus. Robust
classification of animal tracking data. Computers and Electronics in Agriculture, 56(1):46–59, 2007.
[32] K. Taylor. Cattle health monitoring using wireless sensor networks. InProceedings of the Communication and Computer Networks Conference, 2004.
[33] L. Ruiz-Garcia, L. Lunadei, P. Barreiro, and I. Robla. A Review of Wireless Sensor
Technologies and Applications in Agriculture and Food Industry: State of the Art
and Current Trends. Sensors, 9(6):4728–4750, June 2009.
[34] H. J. Escalante, S. V. Rodriguez, J. Cordero, A. R. Kristensen, and C. Cornou.
Sow-activity classification from acceleration patterns: a machine learning
approach. Computers and electronics in agriculture, 93:17–26, 2013.
[35] F. A. P. Alvarenga, I. Borges, L. Palkovič, J. Rodina, V. H. Oddy, and R. C. Dobos.
Using a three-axis accelerometer to identify and classify sheep behaviour at
pasture. Applied Animal Behaviour Science, 181:91–99, August 2016.
[36] Athanasios S Voulodimos, Charalampos Z Patrikakis, Alexander B Sideridis,
based on animal identification using rfid technology. Computers and electronics in agriculture, 70(2):380–388, 2010.
[37] Jianying Feng, Zetian Fu, Zaiqiong Wang, Mark Xu, and Xiaoshuan Zhang.
Development and evaluation on a rfid-based traceability system for cattle/beef
quality safety in china. Food control, 31(2):314–325, 2013.
[38] Raymond E Floyd. Rfid in animal-tracking applications. IEEE Potentials, 34(5):32–33, 2015.
[39] Mateusz Mittek, Eric T Psota, Lance C Pérez, Ty Schmidt, and Benny Mote. Health
monitoring of group-housed pigs using depth-enabled multi-object tracking. In
Proceedings of Int Conf Pattern Recognit, Workshop on Visual observation and analysis of Vertebrate And Insect Behavior, 2016.
[40] Mateusz Mittek, Eric T Psota, Jay D Carlson, Lance C Pérez, Ty Schmidt, and Benny
Mote. Tracking of group-housed pigs using multi-ellipsoid expectation
maximisation.IET Computer Vision, 12(2):121–128, 2017.
[41] Suresh Neethirajan. Recent advances in wearable sensors for animal health
management.Sensing and Bio-Sensing Research, 12:15–29, 2017.
[42] P. Ahrendt, T. Gregersen, and H. Karstoft. Development of a real-time computer
vision system for tracking loose-housed pigs. Computers and Electronics in Agriculture, 76(2):169 – 174, 2011.
[43] Salah Sukkarieh, Eduardo Mario Nebot, and Hugh F Durrant-Whyte. A high
integrity imu/gps navigation loop for autonomous land vehicle applications. IEEE Transactions on Robotics and Automation, 15(3):572–578, 1999.
[44] Hakan Ardö, Oleksiy Guzhva, Mikael Nilsson, and Anders H Herlin. Convolutional
neural network-based cow interaction watchdog. IET Computer Vision, 12(2):171–177, 2017.
[45] Miso Ju, Younchang Choi, Jihyun Seo, Jaewon Sa, Sungju Lee, Yongwha Chung,
and Daihee Park. A kinect-based segmentation of touching-pigs for real-time
monitoring. Sensors, 18(6):1746, 2018.
[46] Massimo Piccardi. Background subtraction techniques: a review. InSystems, man and cybernetics, 2004 IEEE international conference on, volume 4, pages 3099–3104. IEEE, 2004.
[47] Eric T Psota, Lance C Perez, Mateusz Mittek, and Ty Schmidt. Systems for tracking
individual animals in a group-housed environment, May 9 2019. US Patent App.
16/114,565.
[48] A. Nasirahmadi, U. Richter, O. Hensel, S. Edwards, and B. Sturm. Using machine
vision for investigation of changes in pig group lying patterns. Computers and Electronics in Agriculture, 119:184–190, 2015.
[49] M. A. Kashiha, C. Bahr, S. Ott, C. PH Moons, T. A. Niewold, F. Tuyttens, and
D. Berckmans. Automatic monitoring of pig locomotion using image analysis.
Livestock Science, 159:141–148, 2014.
[50] Nobuyuki Otsu. A threshold selection method from gray-level histograms. IEEE transactions on systems, man, and cybernetics, 9(1):62–66, 1979.
[51] Stephen G Matthews, Amy L Miller, Thomas PlÖtz, and Ilias Kyriazakis.
Automated tracking to measure behavioural changes in pigs for health and welfare
monitoring. Scientific reports, 7(1):17582, 2017.
[52] Philipp Bergmann, Tim Meinhardt, and Laura Leal-Taixe. Tracking without bells
and whistles. arXiv preprint arXiv:1903.05625, 2019.
[53] Wongun Choi. Near-online multi-target tracking with aggregated local flow
descriptor. InProceedings of the IEEE International Conference on Computer Vision, pages 3029–3037, 2015.