Neural Network For Bulk Sorting - EP4055520

The patent EP4055520 was granted to Tomra Sorting on Jan 1, 2025. The application was originally filed on Nov 4, 2020 under application number EP20799709A. The patent is currently recorded with a legal status of "Granted And Under Opposition".

EP4055520

TOMRA SORTING
Application Number
EP20799709A
Filing Date
Nov 4, 2020
Status
Granted And Under Opposition
Nov 29, 2024
Grant Date
Jan 1, 2025
External Links
Slate, Register, Google Patents

Patent Summary

Patent Family

Patent Family

Patent Oppositions (4)

Patent oppositions filed by competitors challenge the validity of a granted patent. These oppositions are typically based on claims of prior art, lack of novelty, or non-obviousness. They are a key part of the process for determining a patent's strength and enforceability.

CompanyOpposition DateRepresentativeOpposition Status

Get instant alerts for new oppositions and patent status changes

OPTIMUMOct 1, 2025CALLEWAERTADMISSIBLE
EVK DI KERSCHHAGGLSep 30, 2025NEUHOLDADMISSIBLE
FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EVSep 30, 2025PFENNINGADMISSIBLE
SESOTECSep 16, 2025GLUCK KRITZENBERGER PATENTANWALTE PARTGMBBADMISSIBLE

Patent Citations (16) New

Patent citations refer to prior patents cited during different phases such as opposition or international search.

Citation PhasePublication NumberPublication Link
DESCRIPTIONUS2018243800
DESCRIPTIONUS2019130560
INTERNATIONAL-SEARCH-REPORTUS2019130560
OPPOSITIONDE102015177241
OPPOSITIONUS2007029232
OPPOSITIONUS2009050540
OPPOSITIONUS2017100749
OPPOSITIONUS2018243800
OPPOSITIONUS2019130560
OPPOSITIONUS2021047132
OPPOSITIONUS6225620
OPPOSITIONWO2006054154
OPPOSITIONWO2014037290
OPPOSITIONWO2018183337
OPPOSITIONWO2019106641
OPPOSITIONWO9638708

Non-Patent Literature (NPL) Citations (62) New

NPL citations refer to non-patent references such as research papers, articles, or other publications cited during examination or opposition phases.

Citation PhaseReference TextLink
INTERNATIONAL-SEARCH-REPORT- MATTHIEU GRARD ET AL, "Object segmentation in depth maps with one user click and a synthetically trained fully convolutional network", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, (20180104), XP081195373 [Y] 1-13 * Section 3 *-
INTERNATIONAL-SEARCH-REPORT- BOBULSKI JANUSZ ET AL, Waste Classification System Using Image Processing and Convolutional Neural Networks, ROBOCUP 2008: ROBOCUP 2008: ROBOT SOCCER WORLD CUP XII; [LECTURE NOTES IN COMPUTER SCIENCE; LECT.NOTES COMPUTER], SPRINGER INTERNATIONAL PUBLISHING, CHAM, PAGE(S) 350 - 361, (20190516), ISBN 978-3-319-10403-4, XP047509573 [Y] 1-13 * Section 2.2-2.3 *
OPPOSITION- Anonymous, "BHS and NRT introduce Max-AI - Max is an artificial intelligence that uses machine vision to analyze and sort material streams. ", MAX AI, (20170420), pages 1 - 9, MAX AI , XP093323866-
OPPOSITION- Anonymous, "Digital Sorting Technology Overview", Key Technology, (20170101), pages 1 - 29, Key Technology, URL: https://afidol.org/wp-content/uploads/2017/05/Presentation-Digital-Sorting-Technical-Overview-1.pdf, XP093323706-
OPPOSITION- Anonymous, "Hyperspektral", Wikipedia (accessed via the Wayback Machine), (20190508), Wikipedia (accessed via the Wayback Machine), URL: https://web.archive.org/web/20190508095816/https://de.wikipedia.org/wiki/Hyperspektral, XP093317107-
OPPOSITION- Anonymous, "NRT Adds Max-AI Technology to Optical Sorters - New layer of advanced detection revolutionizes NIR optical sorting", NRT sorters, (20180905), pages 1 - 4, NRT sorters, URL: https://nrtsorters.com/nrt-adds-max-ai-technology-optical-sorters/, XP093323852-
OPPOSITION- Anonymous, "Objekterkennung", Wikipedia, (20200610), pages 1 - 4, Wikipedia, URL: https://de.wikipedia.org/w/index.php?title=Objekterkennung&oldid=200803020, XP093323749-
OPPOSITION- Anonymous, "Visys python smart laser sorter ", Key Technology, (20180101), pages 1 - 2, Key Technology, XP093323701-
OPPOSITION- Bosling Marcel , Tarek Stiebel, Aljosch Steffens, Dorit Merhof , Thomas Pretz, "An Evaluation of Plastic Classification Techniques using Hy-perspectral Near-Infrared Imaging", Sensor-Based Sorting and Control (SBSC), (20180101), pages 125 - 125, XP093323789-
OPPOSITION- D22a - Maschinenübersetzung der D22a in deutscher Sprache-
OPPOSITION- D67 - CN106238342A Panoramic-vision potato sorting and defect detection device as well as sorting detection method thereof-
OPPOSITION- D6a - Impressum und Verlagsinformation von D6-
OPPOSITION- Debidatta Dwibedi; Ishan Misra; Martial Hebert, "Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection", arXiv.org, (20170804), pages 1 - 11, XP080951494-
OPPOSITION- Dimitris Manolakis, Ronald Lockwood, Thomas Cooley, Hyperspectral Imaging and Remote Sensing - Physics, Sensors, and Algorithms, Cambridge University Press, (2016), page 29, 272, ISBN 978-1-107-08366-0-
OPPOSITION- Esben Jannik Bjerrum; Mads Glahder; Thomas Skov, "Data Augmentation of Spectral Data for Convolutional Neural Network (CNN) Based Deep Chemometrics", arXiv.org, (20171005), pages 1 - 10, XP080826305-
OPPOSITION- Huichao Hong, Lixin Zheng, Jianqing Zhu, Shuwan Pan, Kaiting Zhou, "Automatic Recognition of Coal and Gangue based on Convolution Neural Network", arXiv: Computer Vision and Pattern Recognition, (20171203), pages 1 - 7, XP093323813-
OPPOSITION- Matthieu Grard, Romain Brégier, Florian Sella, Emmanuel Dellandréa & Liming Chen, "Object Segmentation in Depth Maps with One User Click and a Synthetically Trained Fully Convolutional Network", Springer International Publishing AG, (20180602), ISBN 978-3-319-89326-6, pages 207 - 221-
OPPOSITION- Mckinlay Richard, "PlastiCircle - Too valuable to waste (Version 1)", PlastiCircle, Grant Agreement No 730292, (20180417), XP093317113-
OPPOSITION- Michael Sackewitz, Leitfaden zur hyperspektralen Bildverarbeitung, Fraunhofer Verlag, (2019), page 1-96, ISBN 978-3-8396-1502-7-
OPPOSITION- Specimspectral, "What Hyperspectral Imaging provides - Tutorial", Youtube, (20170814), Youtube, URL: https://www.youtube.com/watch?v=_sUZ96YZOQU, XP093323800-
OPPOSITION- Verstraeten Bram , "Development ofAI classification system for sorting food applications", Master Thesis, (20190917), pages 1 - 84, XP093323874-
OPPOSITION- Wanjala Judith, "Steinert KSS multi-sensor sorting system: Versatile performer of numerous sorting tasks Technology news Business", Recycling International, (20190927), Recycling International, URL: https://recyclinginternational.com/business/steinert-kss-multi-sensor-sorting-system-versatile-performer-of-numerous-sorting-tasks/28017/, XP093317134-
OPPOSITION- Niall O' Mahony; Sean Campbell; Anderson Carvalho; Suman Harapanahalli; Gustavo Velasco-Hernandez; Lenka Krpalkova; Daniel Riordan; Joseph Walsh, "Deep Learning vs. Traditional Computer Vision", arXiv.org, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY 14853, 201 Olin Library Cornell University Ithaca, NY 14853 , (20191030), doi:10.1007/978-3-030-17795-9, XP081523071
OPPOSITION- Bobulski Janusz; Kubanek Mariusz, "Waste Classification System Using Image Processing and Convolutional Neural Networks", Bobulski Janusz; Kubanek Mariusz, Andrea K; Christine Leitner; Herbert Leitold; Alexander Prosser, Advances in Databases and Information Systems, Cham , Springer International Publishing , (20190516), vol. 11507 Chap.30, pages 350 - 361, 032682, doi:10.1007/978-3-030-20518-8_30, ISBN 978-3-319-10403-4, XP047509573
OPPOSITION- Lin Chunhui; Bao Xudong; Zhou Xuan, "Smoother Soft-NMS for Overlapping Object Detection in X-Ray Images", Springer, (20190101), pages 103 - 113, doi:10.1007/978-3-030-36189-1_9, XP047529464
OPPOSITION- Gao Hongmin; Yang Yao; Li Chenming; Zhang Xiaoke; Zhao Jia; Yao Dan, "Convolutional neural network for spectral-spatial classification of hyperspectral images", Neural Computing and Applications, London, (20190801), vol. 31, no. 12, doi:10.1007/s00521-019-04371-x, ISSN 0941-0643, pages 8997 - 9012, XP036923049
OPPOSITION- Siddiqi Raheel, "Automated apple defect detection using state-of-the-art object detection techniques", SN Applied Sciences, (20190101), vol. 1, doi:10.1007/s42452-019-1393-4, ISSN 2523-3963, pages 1 - 12, XP093323771
OPPOSITION- Li Shuping, Luo Hongpei, Hu Menghan, Zhang Miao, Feng Jianlin, Liu Yangtai, Dong Qingli, Liu Baolin, "Optical non-destructive techniques for small berry fruits: A review", Artificial Intelligence in Agriculture, (20190601), vol. 2, doi:10.1016/j.aiia.2019.07.002, ISSN 2589-7217, pages 85 - 98, XP093108249
OPPOSITION- Al-Mallahi, A. ; Kataoka, T. ; Okamoto, H., "Discrimination between potato tubers and clods by detecting the significant wavebands", Biosystems Engineering, AMSTERDAM, NL, (20080701), vol. 100, no. 3, doi:10.1016/j.biosystemseng.2008.04.013, ISSN 1537-5110, pages 329 - 337, XP022764500
OPPOSITION- Liu Zihao; Jia Xiaojun; Xu Xinsheng, "Study of shrimp recognition methods using smart networks", Computers and Electronics in Agriculture, AMSTERDAM, NL , (20190812), vol. 165, doi:10.1016/j.compag.2019.104926, ISSN 0168-1699, pages 1 - 10, XP085810721
OPPOSITION- Nasiri Amin, Taheri-Garavand Amin, Zhang Yu-Dong, "Image-based deep learning automated sorting of date fruit", Postharvest Biology and Technology, AMSTERDAM, NL , (20190701), vol. 153, doi:10.1016/j.postharvbio.2019.04.003, ISSN 0925-5214, pages 133 - 141, XP093323769
OPPOSITION- Nagaoka Yoshito; Miyazaki Tomo; Sugaya Yoshihiro; Omachi Shinichiro, "Automatic Mackerel Sorting Machine Using Global and Local Features", IEEE Access, USA , (19000101), vol. 7, doi:10.1109/ACCESS.2019.2917554, pages 63767 - 63777, XP011727008
OPPOSITION- Ni Chao, Li Zhenye, Zhang Xiong, Sun Xinyan, Huang Yuping, Zhao Ling, Zhu Tingting, Wang Dongyi, "Online Sorting of the Film on Cotton Based on Deep Learning and Hyperspectral Imaging", IEEE Access, USA , (20200515), vol. 8, doi:10.1109/ACCESS.2020.2994913, ISSN 2169-3536, pages 93028 - 93038, XP093323843
OPPOSITION- BinYan Liang; YanBo Wang; ZhiHong Chen; JiaYu Liu; JunQin Lin, "Object detection and robotic sorting system in complex industrial environment", 2017 Chinese Automation Congress (CAC), (20171020), doi:10.1109/CAC.2017.8244092, pages 7277 - 7281, XP033290680
OPPOSITION- Joseph Redmon, Divvala Santosh, Girshick Ross, Farhadi Ali, "You Only Look Once: Unified, Real-Time Object Detection", doi:10.1109/CVPR.2016.91, (20160509), pages 1 - 10, Arxiv, URL: https://arxiv.org/pdf/1506.02640.pdf, (20190214), XP055556774
OPPOSITION- McDonnell Mark D.; Moezzi Bahar; Brinkworth Russell S. A., "Using Style-Transfer to Understand Material Classification for Robotic Sorting of Recycled Beverage Containers", 2019 Digital Image Computing: Techniques and Applications (DICTA), (20191202), doi:10.1109/DICTA47822.2019.8945993, pages 1 - 8, XP033683100
OPPOSITION- Pinto Carlito; Furukawa Junya; Fukai Hidekazu; Tamura Satoshi, "Classification of Green coffee bean images basec on defect types using convolutional neural network (CNN)", 2017 International Conference on Advanced Informatics, (20170816), doi:10.1109/ICAICTA.2017.8090980, pages 1 - 5, XP033244546
OPPOSITION- Bigdeli Siavash; Susstrunk Sabine, "Deep Semantic Segmentation Using Nir as Extra Physical Information", 2019 IEEE International Conference on Image Processing (ICIP), IEEE, (20190922), doi:10.1109/ICIP.2019.8803242, pages 2439 - 2443, XP033647209
OPPOSITION- Wu Yuqi; Zhang Yinhui; Zhang Chunquan; He Zifen; Zhang Yue, "Semantic segmentation of mechanical parts based on fully convolutional network", 2017 9th International Conference on Modelling, Identification and Control (ICMIC), (20170710), doi:10.1109/ICMIC.2017.8321528, pages 612 - 617, XP033332241
OPPOSITION- Pei Yuekun; Lian Mingyue; Jiang Yanchao; Ye JiaMin; Han Xinxin; Gu Yu, "Real-time Cherry Color Grading Based on Machine Vision", 2019 IEEE International Conference on Signal, Information and Data Processing (ICSIDP), (20191211), doi:10.1109/ICSIDP47821.2019.9173073, pages 1 - 6, XP033813203
OPPOSITION- Lee Hyungtae; Kwon Heesung, "Contextual deep CNN based hyperspectral classification", 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), IEEE, (20160710), doi:10.1109/IGARSS.2016.7729859, pages 3322 - 3325, XP032991052
OPPOSITION- Sakr George E.; Mokbel Maria; Darwich Ahmad; Khneisser Mia Nasr; Hadi Ali, "Comparing deep learning and support vector machines for autonomous waste sorting", 2016 IEEE International Multidisciplinary Conference on Engineering Technology (IMCET), IEEE, (20161102), doi:10.1109/IMCET.2016.7777453, pages 207 - 212, XP033018297
OPPOSITION- Bircanoglu Cenk; Atay Meltem; Beser Fuat; Genc Ozgun; Kizrak Merve Ayyuce, "RecycleNet: Intelligent Waste Sorting Using Deep Neural Networks", 2018 Innovations in Intelligent Systems and Applications (INISTA), IEEE, (20180703), doi:10.1109/INISTA.2018.8466276, pages 1 - 7, XP033404361
OPPOSITION- Farazi Mohammad; Abbas-Zadeh Mohammad Javad; Moradi Hadi, "A machine vision based pistachio sorting using transferred mid-level image representation of Convolutional Neural Network", 2017 10th Iranian Conference on Machine Vision and Image Processing (MVIP), (20171122), doi:10.1109/IranianMVIP.2017.8342335, pages 145 - 148, XP033334131
OPPOSITION- Wang Tian , Yuting Yao, Yang Chen, Mengyi Zhang, Fei Tao, "Auto-sorting System Towards Smart Factory based on Deep learning for Image Segmentation", Ieee Sensors Journal, (20181015), vol. 18, no. 20, doi:10.1109/JSEN.2018.2866943, ISSN 1530-437X, pages 8493 - 85001, XP093323766
OPPOSITION- Heo Young Jin, Kim Se Jin, Kim Dayeon, Lee Keondo, Chung Wan Kyun, "Super-High-Purity Seed Sorter Using Low-Latency Image-Recognition Based on Deep Learning", IEEE ROBOTICS AND AUTOMATION LETTERS, (20181001), vol. 3, no. 4, doi:10.1109/LRA.2018.2849513, ISSN 2377-3774, pages 3035 - 3042, XP093323780
OPPOSITION- Raka Suraj; Kamat Ashutosh; Chavan Shubhada; Tyagi Aanchal; Soygaonkar Pratik, "Taste-wise fruit sorting system using thermal image processing", 2019 IEEE Pune Section International Conference (PuneCon), (20191218), doi:10.1109/PuneCon46936.2019.9105726, pages 1 - 4, XP033776178
OPPOSITION- Karbasi Hamidreza; Sanderson Adam; Sharifi Alireza; Pop Cristian, "Robotic Sorting of Used Button Cell Batteries: Utilizing Deep Learning", 2018 IEEE Conference on Technologies for Sustainability (SusTech), (20181111), doi:10.1109/SusTech.2018.8671351, pages 1 - 6, XP033531887
OPPOSITION- Sousa Joao; Rebelo Ana; Cardoso Jaime S., "Automation of Waste Sorting with Deep Learning", 2019 XV Workshop de Visão Computacional (WVC), IEEE, (20190909), doi:10.1109/WVC.2019.8876924, pages 43 - 48, XP033637925
OPPOSITION- Chu Yinghao, Huang Chen, Xie Xiaodan, Tan Bohai, Kamal Shyam, Xiong Xiaogang, "Multilayer Hybrid Deep-Learning Method for Waste Classification and Recycling", Computational Intelligence and Neuroscience, US , Hindawi Publishing Corporation , (20181101), pages 1 - 9, doi:10.1155/2018/5060857, ISSN 1687-5265, XP055936089
OPPOSITION- Balaji Veeramani;John W. Raymond;Pritam Chanda, "DeepSort: deep convolutional networks for sorting haploid maize seeds", BMC Bioinformatics, London, UK , (20180813), vol. 19, no. 9, doi:10.1186/s12859-018-2267-2, pages 85 - 93, XP021259500
OPPOSITION- Boldrini Barbara, Kessler Waltraud, Rebner Karsten, Kessler Rudolf W, "Hyperspectral imaging: a review of best practice, performance and pitfalls for in-line and on-line applications", JOURNAL OF NEAR INFRARED SPECTROSCOPY, GB , (20120618), doi:10.1255/1003, ISSN 0967-0335, pages 483 - 508, XP093323823
OPPOSITION- Basri Hasan, Syarif Iwan, Sukaridhoto Sritrusta, Falah Muhammad Fajrul, "INTELLIGENT SYSTEM FOR AUTOMATIC CLASSIFICATION OF FRUIT DEFECT USING FASTER REGION-BASED CONVOLUTIONAL NEURAL NETWORK (FASTER R-CNN)", Kursor journal, (20190708), vol. 10, no. 1, doi:10.28961/kursor.v10i1.187, ISSN 0216-0544, pages 1 - 12, XP093323777
OPPOSITION- Chou Yung-Chien, Kuo Cheng-Ju, Chen Tzu-Ting, Horng Gwo-Jiun, Pai Mao-Yuan, Wu Mu-En, Lin Yu-Chuan, Hung Min-Hsiung, Su Wei-Tsung, Chen Yi-Chung, Wang Ding-Chau, Chen Chao-Chun, "Deep-Learning-Based Defective Bean Inspection with GAN-Structured Automated Labeled Data Augmentation in Coffee Industry", Applied Sciences, Basel, (20190101), vol. 9, no. 19, doi:10.3390/app9194166, ISSN 2076-3417, pages 1 - 26, XP093323879
OPPOSITION- Al-Sarayreh Mahmoud, M. Reis Marlon, Qi Yan Wei, Klette Reinhard, "Detection of Red-Meat Adulteration by Deep Spectral-Spatial Features in Hyperspectral Images", Journal of Imaging, (20180101), vol. 4, no. 5, doi:10.3390/jimaging4050063, ISSN 2313-433X, pages 1 - 20, XP093323835
OPPOSITION- De-La-Torre Miguel, Zatarain Omar, Avila-George Himer, Muñoz Mirna, Oblitas Jimy, Lozada Russel, Mejía Jezreel, Castro Wilson, "Multivariate Analysis and Machine Learning for Ripeness Classification of Cape Gooseberry Fruits", Processes , CH , (20190101), vol. 7, no. 12, doi:10.3390/pr7120928, ISSN 2227-9717, pages 1 - 15, XP093323755
OPPOSITION- Li Ying, Zhang Haokui, Shen Qiang, "Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network", Remote sensing, Basel, (20170101), vol. 9, no. 1, doi:10.3390/rs9010067, ISSN 2072-4292, pages 1 - 21, XP093323829
OPPOSITION- Zhao Huijie, Xu Lunbao, Shi Shaoguang, Jiang Hongzhi, Chen Da, "A High Throughput Integrated Hyperspectral Imaging and 3D Measurement System", Sensors, CH , (20180101), vol. 18, no. 4, doi:10.3390/s18041068, ISSN 1424-8220, pages 1 - 17, XP093323826
OPPOSITION- Dörr Laura, Brandt Felix, Pouls Martin, Naumann Alexander, "Fully-Automated Packaging Structure Recognition in Logistics Environments", doi:10.48550/arxiv.2008.04620, (20200811), pages 1 - 9, Arxiv, URL: https://arxiv.org/pdf/2008.04620.pdf, (20230223), XP093026618
OPPOSITION- Costa Bernardo S., Bernardes Aiko C. S., Pereira Julia V. A., Zampa Vitoria H., Pereira Vitoria A., Matos Guilherme F., Soares Eduardo A., Soares Claiton L., Silva Alexandre F., "Artificial Intelligence in Automated Sorting in Trash Recycling", Anais do XV Encontro Nacional de Inteligência Artificial e Computacional (ENIAC 2018), Sociedade Brasileira de Computação - SBC, doi:10.5753/eniac.2018.4416, pages 198 - 205, XP093317125
OPPOSITION- Gao Zhenyu, Wang An;Liu Yong;Zhang Long;Xia Yingwei, "Intelligent Fresh-tea-leaves Sorting System Research Based on Convolution Neural Network ", Transaction of the Chinese Society for Agricultural Machinery, (20170531), vol. 48, no. 7, doi:10.6041/j.issn.1000-1298.2017.07.007, ISSN 1000-1298, pages 53 - 58, XP093323762
OPPOSITION- Ni Chao, Li Zhenye , Zhang Xiong , "Film Sorting Algorithm in Seed Cotton Based on Near-infrared Hyper-spectral Image and Deep Learning", Transaction of the Chinese Society for Agricultural Machinery, (20191210), doi:10.6041/j.issn.1000-1298.2019.12.019, ISSN 1000-1298, pages 170 - 179, XP093323713

Download Citation Report

Get a free citation report including examiner, opposition, and international search citations.

Get Citation Report

Dossier Documents

The dossier documents provide a comprehensive record of the patent’s prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent’s legal journey and any challenges it may have faced during examination.

  • Date

    Description

  • Get instant alerts for new documents