Download pdf Artificial neural networks and machine learning icann 2021 30th international conferenc

Page 1


Artificial Neural Networks and Machine Learning

Neural Networks Bratislava Slovakia II Lecture

Notes in Computer Science 12892 Igor Farkaš (Editor)

Visit to download the full and correct content document: https://ebookmeta.com/product/artificial-neural-networks-and-machine-learning-icann2021-30th-international-conference-on-artificial-neural-networks-bratislava-slovakia-iilecture-notes-in-computer-science-12892-igor-farkas-edit/

More products digital (pdf, epub, mobi) instant download maybe you interests ...

Artificial Neural Networks and Machine Learning ICANN

2021 30th International Conference on Artificial Neural Networks Bratislava Slovakia I Igor Farkaš (Editor)

https://ebookmeta.com/product/artificial-neural-networks-andmachine-learning-icann-2021-30th-international-conference-onartificial-neural-networks-bratislava-slovakia-i-igor-farkaseditor/

Artificial Neural Networks and Machine Learning ICANN

2022 31st International Conference on Artificial Neural Networks

Bristol UK September 6 9 2022 Proceedings Part II Elias Pimenidis

https://ebookmeta.com/product/artificial-neural-networks-andmachine-learning-icann-2022-31st-international-conference-onartificial-neural-networks-bristol-ukseptember-6-9-2022-proceedings-part-ii-elias-pimenidis/

Artificial Neural Networks and Machine Learning ICANN

2022 31st International Conference on Artificial Neural Networks

Bristol UK September 6 9 2022 Proceedings Part I Elias Pimenidis

https://ebookmeta.com/product/artificial-neural-networks-andmachine-learning-icann-2022-31st-international-conference-onartificial-neural-networks-bristol-ukseptember-6-9-2022-proceedings-part-i-elias-pimenidis/

Artificial Neural Networks and Machine Learning ICANN

2022 31st International Conference on Artificial Neural Networks

Bristol UK September 6 9 2022 Proceedings Part III Elias Pimenidis

https://ebookmeta.com/product/artificial-neural-networks-andmachine-learning-icann-2022-31st-international-conference-onartificial-neural-networks-bristol-ukseptember-6-9-2022-proceedings-part-iii-elias-pimenidis/

Artificial Neural Networks with Java: Tools for Building Neural Network Applications, 2nd Edition Igor Livshin

https://ebookmeta.com/product/artificial-neural-networks-withjava-tools-for-building-neural-network-applications-2nd-editionigor-livshin/

Artificial Neural Networks with TensorFlow 2 ANN Architecture Machine Learning Projects Poornachandra Sarang

https://ebookmeta.com/product/artificial-neural-networks-withtensorflow-2-ann-architecture-machine-learning-projectspoornachandra-sarang/

Flexible Query Answering Systems 14th International Conference FQAS 2021 Bratislava Slovakia September 19 24 2021 Proceedings Lecture Notes in Artificial Intelligence Troels Andreasen (Editor)

https://ebookmeta.com/product/flexible-query-answeringsystems-14th-international-conference-fqas-2021-bratislavaslovakia-september-19-24-2021-proceedings-lecture-notes-inartificial-intelligence-troels-andreasen-editor/

Building Computer Vision Applications Using Artificial Neural Networks, 2nd Edition Shamshad Ansari

https://ebookmeta.com/product/building-computer-visionapplications-using-artificial-neural-networks-2nd-editionshamshad-ansari/

Advances in Deep Learning, Artificial Intelligence and Robotics: Proceedings of the 2nd International Conference on Deep Learning, Artificial ... 2020 (Lecture Notes in Networks and Systems) Luigi Troiano (Editor) https://ebookmeta.com/product/advances-in-deep-learningartificial-intelligence-and-robotics-proceedings-of-the-2ndinternational-conference-on-deep-learningartificial-2020-lecture-notes-in-networks-and-systems-luigi-tro/

Igor

Artificial Neural Networks and Machine Learning –ICANN 2021

30th International Conference on Artificial Neural Networks Bratislava, Slovakia, September 14–17, 2021

Proceedings, Part II

LectureNotesinComputerScience12892

FoundingEditors

GerhardGoos

KarlsruheInstituteofTechnology,Karlsruhe,Germany

JurisHartmanis

CornellUniversity,Ithaca,NY,USA

EditorialBoardMembers

ElisaBertino

PurdueUniversity,WestLafayette,IN,USA

WenGao

PekingUniversity,Beijing,China

BernhardSteffen

TUDortmundUniversity,Dortmund,Germany

GerhardWoeginger

RWTHAachen,Aachen,Germany

MotiYung

ColumbiaUniversity,NewYork,NY,USA

Moreinformationaboutthissubseriesat http://www.springer.com/series/7407

IgorFarkaš • PaoloMasulli • SebastianOtte • StefanWermter(Eds.)

Arti ficialNeuralNetworks andMachineLearning

ICANN2021

30thInternationalConferenceonArti ficialNeuralNetworks Bratislava,Slovakia,September14–17,2021 Proceedings,PartII

Editors

IgorFarkaš

ComeniusUniversityinBratislava Bratislava,Slovakia

SebastianOtte UniversityofTübingen Tübingen,Baden-Württemberg,Germany

PaoloMasulli iMotionsA/S Copenhagen,Denmark

StefanWermter UniversitätHamburg Hamburg,Germany

ISSN0302-9743ISSN1611-3349(electronic) LectureNotesinComputerScience

ISBN978-3-030-86339-5ISBN978-3-030-86340-1(eBook) https://doi.org/10.1007/978-3-030-86340-1

LNCSSublibrary:SL1 – TheoreticalComputerScienceandGeneralIssues

© SpringerNatureSwitzerlandAG2021

Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartofthe materialisconcerned,specificallytherightsoftranslation,reprinting,reuseofillustrations,recitation, broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,andtransmissionorinformation storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodologynow knownorhereafterdeveloped.

Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant protectivelawsandregulationsandthereforefreeforgeneraluse.

Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbookare believedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsortheeditors giveawarranty,expressedorimplied,withrespecttothematerialcontainedhereinorforanyerrorsor omissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictionalclaimsin publishedmapsandinstitutionalaffiliations.

ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSwitzerlandAG Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland

Preface

Researchonarti ficialneuralnetworkshasprogressedoverdecades,inrecentyears beingfueledespeciallybydeeplearningthathasproven,albeitdata-greedy,efficientin solvingvarious,mostlysupervised,tasks.Applicationsofartificialneuralnetworks, especiallyrelatedtoartifi cialintelligence,affectourlives,providingnewhorizons. Examplesrangefromautonomouscardriving,virtualassistants,anddecisionsupport systemstohealthcaredataanalytics, fi nancialforecasting,andsmartdevicesinour homes,justtonameafew.Thesedevelopments,however,alsoprovidechallenges, whichwerenotimaginablepreviously,e.g.,veri ficationofrawdata,explainingthe contentsofneuralnetworks,andadversarialmachinelearning.

TheInternationalConferenceonArti ficialNeuralNetworks(ICANN)istheannual flagshipconferenceoftheEuropeanNeuralNetworkSociety(ENNS).Lastyear,dueto theCOVID-19pandemic,wedecidednottoholdtheconferencebuttopreparethe ICANNproceedingsinwrittenform.Thisyear,duetothestillunresolvedpandemic, theOrganizingCommittee,togetherwiththeExecutiveCommitteeofENNSdecided toorganizeICANN2021online,sincewefelttheurgetoallowresearchpresentations andlivediscussions,followingthenowavailablealternativesofonlineconference organization.Soforthe fi rsttime,ENNSandtheOrganizingCommitteeprepared ICANNasanonlineeventwithallitschallengesandsometimesunforeseeableevents! Followingalong-standingsuccessfulcollaboration,theproceedingsofICANNare publishedasvolumeswithintheLectureNotesinComputerScienceSpringerseries. Theresponsetothisyear ’scallforpapersresulted,unexpectedly,inarecordnumberof 557articlesubmissions(a46%risecomparedtopreviousyear),ofwhichalmostall werefullpapers.Thepaperselectionandreviewprocessthatfollowedwasdecided duringtheonlinemeetingoftheBratislavaorganizingteamandtheENNSExecutive Committee.The40ProgramCommittee(PC)membersagreedtocheckthesubmissionsfortheformalrequirementsand64paperswereexcludedfromthesubsequent reviews.ThemajorityofthePCmembershavedoctoraldegrees(80%)and75% ofthemarealsoprofessors.Wealsotookadvantageof filled-inonlinequestionnaires providingthereviewers’ areasofexpertise.Thereviewerswereassignedonetofour papers,andthepaperswithundecidedscoresalsoreceivedreportsfromPCmembers whichhelpedinmakinga fi naldecision.

Intotal,265articleswereacceptedfortheproceedingsandtheauthorswere requestedtosubmit finalversions.Theacceptanceratewashenceabout47%when calculatedfromallinitialsubmissions.AlistofPCmembersandreviewerswhoagreed topublishtheirnamesisincludedintheproceedings.Withtheseprocedureswetriedto keepthequalityoftheproceedingshighwhilestillhavingacriticalmassofcontributionsreflectingtheprogressofthe fi eld.Overallwehopethattheseproceedingswill contributetothedisseminationofnewresultsbytheneuralnetworkcommunityduring thesechallengingtimesandwehopethatwecanhaveaphysicalICANNin2022.

Finally,weverymuchthanktheProgramCommitteeandthereviewersfortheir invaluablework.

September2021IgorFarkaš PaoloMasulli

SebastianOtte

StefanWermter

Organization

OrganizingCommittee

CabessaJérémieUniversité Paris2Panthéon-Assas,France

KerzelMatthiasUniversityofHamburg,Germany

LintasAlessandraUniversityofLausanne,Switzerland

Malinovská KristínaComeniusUniversityinBratislava,Slovakia

MasulliPaoloiMotionsA/S,Copenhagen,Denmark

OtteSebastianUniversityofTübingen,Germany

WedemanRoseliUniversidadedoEstadodoRiodeJaneiro,Brazil

ProgramCommitteeChairs

IgorFarkaš ComeniusUniversityinBratislava,Slovakia

PaoloMasulliiMotionsA/S,Denmark

SebastianOtteUniversityofTübingen,Germany

StefanWermterUniversityofHamburg,Germany

ProgramCommittee

Andrejková GabrielaPavolJozef ŠafárikUniversityinKošice,Slovakia

AtenciaMiguelUniversidaddeMalaga,Spain

BodapatiJyostnaDeviIndianInstituteofTechnology,Madras,India

BougieNicolasSokendai/NationalInstituteofInformatics,Japan

BožaVladim írComeniusUniversityinBratislava,Slovakia

CabessaJérémieUniversité Paris2Panthéon-Assas,France

DiNuovoAlessandroSheffieldHallamUniversity,UK

DuchWłodzisławNicolausCopernicusUniversity,Poland

EppeManfredUniversitätHamburg,Germany

FangYuchunShanghaiUniversity,China

GarckeJochenUniversitätBonn,Germany

GregorMichalUniversityof Žilina,Slovakia

GuckertMichaelTechnischeHochschuleMittelhessen,Germany

GuillénAlbertoUniversityofGranada,Spain

HeinrichStefanUniversityofTokyo,Japan

HinautXavierInria,France

HumaidanDaniaUniversityofTübingen,Germany

JolivetRenaudUniversityofGeneva,Switzerland

Koprinkova-HristovaPetiaBulgarianAcademyofSciences,Bulgaria

LintasAlessandraUniversityofLausanne,Switzerland

Lü ShuaiJilinUniversity,China

MicheliAlessioUniversità diPisa,Italy

OravecMiloš SlovakUniversityofTechnologyinBratislava, Slovakia

OtteSebastianUniversityofTübingen,Germany

PeltonenJaakkoTampereUniversity,Finland PiuriVincenzoUniversityofMilan,Italy

PonsRiveroAntonioJavierUniversitatPolitècnicadeCatalunya,Barcelona,Spain

SchmidtJochenTHRosenheim,Germany

SchockaertCedricPaulWurthS.A.,Luxembourg SchwenkerFriedhelmUniversityofUlm,Germany

Takáč MartinComeniusUniversityinBratislava,Slovakia

TartaglioneEnzoUniversità degliStudidiTorino,Italy

TetkoIgorHelmholtzZentrumMünchen,Germany

TrieschJochenFrankfurtInstituteforAdvancedStudies,Germany

Vavre čkaMichalCzechTechnicalUniversityinPrague,CzechRepublic

VermaSagarCentraleSupélec,Université Paris-Saclay,France

VigárioRicardoNovaSchoolofScienceandTechnology,Portugal WedemannRoseliUniversidadedoEstadodoRiodeJaneiro,Brazil WennekersThomasPlymouthUniversity,UK

Reviewers

AbawiFaresUniversityofHamburg,Germany

AganianDustinTechnicalUniversityIlmenau,Germany

AhrensKyraUniversityofHamburg,Germany

AlexandreFredericInriaBordeaux,France

AlexandreLuísUniversityofBeiraInterior,Portugal

AliHazratUmeå University,Sweden AlkhamaisehKoloudWesternMichiganUniversity,USA AmabaTakafumiFukuokaUniversity,Japan

AmbitaAraAbigailUniversityofthePhilippinesDiliman,Philippines AmeurHanenUniversityofSfax,Tunisia

AmigoGalánGlaucoA.BaylorUniversity,USA AnShuqiChongqingUniversity,China

AouitiChaoukiUniversité deCarthage,Tunisia

AranyAdamKatholiekeUniversiteitLeuven,Belgium ArnoldJoshuaUniversityofQueensland,Australia

ArteltAndré BielefeldUniversity,Germany

AugeDanielTechnicalUniversityofMunich,Germany

BacLeHoaiUniversityofScience,Vietnam

Bacaicoa-BarberDanielUniversityCarlosIIIofMadrid,Spain BaiXinyiNationalUniversityofDefenseTechnology,China BankaAsifIslamicUniversityofScience&Technology,India

BasallaMarcusUniversityofLiechtenstein,Liechtenstein

BasterrechSebastianTechnicalUniversityofOstrava,CzechRepublic BauckhageChristianFraunhoferIAIS,Germany

BayerMarkusTechnicalUniversityofDarmstadt,Germany

Bečková IvetaComeniusUniversityinBratislava,Slovakia

BenalcázarMarcoEscuelaPolitécnicaNacional,Ecuador

BennisAchrafInstitutdeRechercheenInformatiquedeToulouse, France

BerlemontSamuelOrangeLabs,Grenoble,France

BermeitingerBernhardUniversitätSt.Gallen,Switzerland

BhoiSumanNationalUniversityofSingapore,Singapore

BiesnerDavidFraunhoferIAIS,Germany

BilbreyJennaPaci ficNorthwestNationalLab,USA

BlasingameZanderClarksonUniversity,USA

BochkarevVladimirKazanFederalUniversity,Russia

BohteSanderUniversiteitvanAmsterdam,TheNetherlands

BouchachiaAbdelhamidBournemouthUniversity,UK

BourguinGrégoryUniversité duLittoralCôted’Opale,France

BreckonTobyDurhamUniversity,UK

BuhlFredUniversityofFlorida,USA

ButzMartinV.UniversityofTübingen,Germany

CaillonPaulUniversité deLorraine,Nancy,France

CamachoHugoC.E.UniversidadAutónomadeTamaulipas,Mexico

CamurriAntonioUniversità diGenova,Italy

CaoHexinOneConnectFinancialTechnology,China

CaoTianyangPekingUniversity,China

CaoZhijieShanghaiJiaoTongUniversity,China

CarneiroHugoUniversitätHamburg,Germany ChadhaGavneetSinghSouthWestphaliaUniversityofAppliedSciences, Germany

ChakrabortySaikatC.V.RamanGlobalUniversity,India ChangHao-YuanUniversityofCalifornia,LosAngeles,USA ChangHaodongUniversityofTechnologySydney,Australia ChenChengTsinghuaUniversity,China ChenHaopengShanghaiJiaoTongUniversity,China ChenJunliangShenzhenUniversity,China ChenTianyuNorthwestNormalUniversity,China ChenWenjieCommunicationUniversityofChina,China ChengZhanglinChineseAcademyofSciences,China ChenuAlexandreSorbonneUniversité,France ChoiHeeyoulHandongGlobalUniversity,SouthKorea ChristaSharonRVInstituteofTechnologyandManagement,India CîteaIngridBitdefenderCentral,Romania ColliriTiagoUniversidadedeSãoPaulo,Brazil CongCongChineseAcademyofSciences,China CoroiuAdrianaMihaelaBabes-BolyaiUniversity,Romania CortezPauloUniversityofMinho,Portugal CuayáhuitlHeribertoUniversityofLincoln,UK CuiXiaohuiWuhanUniversity,China CutsuridisVassilisUniversityofLincoln,UK

CvejoskiKostadinFraunhoferIAIS,Germany

D’SouzaMeenakshiInternationalInstituteofInformationTechnology, Bangalore,India

DaiFeifeiChineseAcademyofSciences,China DaiPeilunBostonUniversity,USA DaiRuiqiINSALyon,France

DangKaiNankaiUniversity,China

DangXuanTsinghuaUniversity,China DashTirtharajBirlaInstituteofTechnologyandScience,Pilani,India DavalasCharalamposHarokopioUniversityofAthens,Greece DeBrouwerEdwardKatholiekeUniversiteitLeuven,Belgium DengMinghuaPekingUniversity,China DevamaneShridharKLEInstituteofTechnology,Hubballi,India DiCaterinaGaetanoUniversityofStrathclyde,UK

DiSarliDanieleUniversità diPisa,Italy

DingJunchengUniversityofNorthTexas,USA DingZhaoyunNationalUniversityofDefenseTechnology,China

DoldDominikSiemens,Munich,Germany DongZihaoJinanUniversity,China

DuSonglinSoutheastUniversity,China EdwardsJoshuaUniversityofNorthCarolinaWilmington,USA EguchiShuFukuokaUniversity,Japan

EisenbachMarkusIlmenauUniversityofTechnology,Germany

ErlhagenWolframUniversityofMinho,Portugal FangTiyuUniversityofJinan,China

FeldagerCilieTechnicalUniversityofDenmark,Denmark FeriancMartinUniversityCollegeLondon,UK FerreiraFloraUniversityofMinho,Portugal FevensThomasConcordiaUniversity,Canada Friedjungová MagdaCzechTechnicalUniversityinPrague,CzechRepublic FuXianghuaShenzhenUniversity,China

FuhlWolfgangUniversitätTübingen,Germany GamageVihangaTechnologicalUniversityDublin,Ireland GangulyUdayanIndianInstituteofTechnology,Bombay,India

GaoRuijunTianjinUniversity,China

GaoYapengUniversityofTübingen,Germany GaoYueBeijingUniversityofPostsandTelecommunications, China

GaoZikaiNationalUniversityofDefenseTechnology,China

GaultRichardQueen’sUniversityBelfast,UK GeLiangChongqingUniversity,China

GeisslerDominikRelayrGmbH,Munich,Germany

GepperthAlexanderENSTAParisTech,France

GerumChristophUniversityofTübingen,Germany GiancaterinoClaudioG.CatholicUniversityofMilan,Italy

GieseMartinUniversityClinicTübingen,Germany

GikundaPatrickDedanKimathiUniversityofTechnology,Kenya GoelAnmolGuruGobindSinghIndraprasthaUniversity,India

GöpfertChristinaBielefeldUniversity,Germany

GöpfertJanPhilipBielefeldUniversity,Germany

GoyalNidhiIndraprasthaInstituteofInformationTechnology,India

GrangettoMarcoUniversità diTorino,Italy

GrüningPhilippUniversityofLübeck,Germany

GuXiaoyanChineseAcademyofSciences,Beijing,China

GuoHongcunChinaThreeGorgesUniversity,China

GuoLingNorthwestUniversity,China

GuoQingNanyangTechnologicalUniversity,Singapore

GuoSongXi’anUniversityofArchitectureandTechnology, China

GuptaSohanGlobalInstituteofTechnology,Jaipur,India

HakenesSimonRuhr-UniversitätBochum,Germany

HanFuchangCentralSouthUniversity,China

HanYiUniversityofMelbourne,Australia

HansenLarsKaiTechnicalUniversityofDenmark,Denmark

HaqueAyaanSaratogaHighSchool,USA

HassenAlanKaiLeidenUniversity,TheNetherlands HaubergSørenTechnicalUniversityofDenmark,Denmark

HeTiekeNanjingUniversity,China

HeWeiNanyangTechnologicalUniversity,Singapore

HeZiwenChineseAcademyofSciences,China

HeeseRaoulFraunhoferITWM,Germany

HermanPawelKTHRoyalInstituteofTechnology,Sweden

HolasJurajComeniusUniversityinBratislava,Slovakia

HorioYoshihikoTohokuUniversity,Japan

HouHongxuInnerMongoliaUniversity,China

HuMing-FeiChinaUniversityofPetroleum,China

HuTingHassoPlattnerInstitute,Germany

HuWenxinEastChinaNormalUniversity,China

HuYanqingSichuanUniversity,China

HuangChenglongNationalUniversityofDefenseTechnology,China

HuangChengqiangHuaweiTechnology,Ltd.,China

HuangJunChineseAcademyofSciences,Shanghai,China

HuangRuoranChineseAcademyofSciences,China HuangWuliangChineseAcademyofSciences,Beijing,China

HuangZhongzhanTsinghuaUniversity,China

IannellaNicolangeloUniversityofOslo,Norway IencoDinoINRAE,France

IlliumSteffenLudwig-Maximilians-UniversitätMünchen,Germany

IyerNareshGEResearch,USA

JalalvandAzarakhshGhentUniversity,Belgium

JapaSaiSharathSouthernIllinoisUniversity,USA

JavaidMuhammadUsamaEuraNova,Belgium

JiaQiaomeiNorthwestUniversity,China JiaXiaoningInnerMongoliaUniversity,China

JinPeiquanUniversityofScienceandTechnologyofChina,China

JirakDoreenIstitutoItalianodiTecnologia,Italy JodeletQuentinTokyoInstituteofTechnology,Japan KaiTangToshiba,China

KaramRalphUniversité Franche-Comté,France

KarlbauerMatthiasUniversityofTübingen,Germany KaufholdMarc-André TechnicalUniversityofDarmstadt,Germany

KerzelMatthiasUniversityofHamburg,Germany

KeurulainenAnttiBitvilleOy,Finland

KitamuraTakuyaNationalInstituteofTechnology,Japan KocurViktorComeniusUniversityinBratislava,Slovakia

KoikeAtsushiNationalInstituteofTechnology,Japan KotropoulosConstantineAristotleUniversityofThessaloniki,Greece KovalenkoAlexanderCzechTechnicalUniversity,CzechRepublic KrzyzakAdamConcordiaUniversity,Canada

KurikawaTomokiKansaiMedicalUniversity,Japan KurpiewskiEvanUniversityofNorthCarolinaWilmington,USA

KurtMehmetNecipColumbiaUniversity,USA KushwahaSumitKamlaNehruInstituteofTechnology,India LaiZhipingFudanUniversity,China LangJanaHertieInstituteforClinicalBrainResearch,Germany LeHieuBostonUniversity,USA

LeNgocHanoiUniversityofScienceandTechnology,Vietnam LeThanhUniversityofScience,HochiminhCity,Vietnam LeeJinhoYonseiUniversity,SouthKorea LefebvreGrégoireOrangeLabs,France LehmannDanielUniversityofGreifswald,Germany LeiFangUniversityofLincoln,UK LéonardonMathieuIMTAtlantique,France

LewandowskiArnaudUniversité duLittoralCôted’Opale,Calais,France LiCaiyuanShanghaiJiaoTongUniversity,China LiChuangXi’anJiaotongUniversity,China LiMing-FanPingAnLifeInsuranceofChina,Ltd.,China LiQingTheHongKongPolytechnicUniversity,China LiTaoPekingUniversity,China LiXinyiSouthwestUniversity,China LiXiumeiHangzhouNormalUniversity,China LiYanqiUniversityofJinan,China LiYuanDefenceInnovationInstitute,China LiZhixinGuangxiNormalUniversity,China LianYahongDalianUniversityofTechnology,China LiangNieSouthwestUniversityofScienceandTechnology, China

LiangQiChineseAcademyofSciences,Beijing,China

LiangSenweiPurdueUniversity,USA LiangYuxinNorthwestUniversity,China

LimNengliSingaporeUniversityofTechnologyandDesign, Singapore

LiuGongshenShanghaiJiaoTongUniversity,China LiuHaolinChineseAcademyofSciences,China

LiuJian-WeiChinaUniversityofPetroleum,China LiuJuanWuhanUniversity,China LiuJunxiuGuangxiNormalUniversity,China LiuQiChongqingUniversity,China

LiuShuangHuazhongUniversityofScienceandTechnology, China

LiuShutingUniversityofShanghaiforScienceandTechnology, China

LiuWeifengChinaUniversityofPetroleum,China LiuYanUniversityofShanghaiforScienceandTechnology, China

LiuYangFudanUniversity,China

LiuYi-LingImperialCollegeLondon,UK LiuZhuUniversityofElectronicScienceandTechnology ofChina,China LongZiShenzhenTechnologyUniversity,China LopesVascoUniversidadedaBeiraInterior,Portugal LuSiweiGuangdongUniversityofTechnology,China LuWeizengShenzhenUniversity,China LukyanovaOlgaRussianAcademyofSciences,Russia LuoLeiKansasStateUniversity,USA LuoXiaoPekingUniversity,China LuoYihaoHuazhongUniversityofScienceandTechnology, China

MaChaoWuhanUniversity,China MaZeyuHarbinInstituteofTechnology,China MalialisKleanthisUniversityofCyprus,Cyprus ManoonpongPoramateVidyasirimedhiInstituteofScienceandTechnology, Thailand

MartinezRegoDavidDataSpartanLtd.,UK MatsumuraTadayukiHitachi,Ltd.,Tokyo,Japan MekkiAsmaUniversité deSfax,Tunisia MerkelCoryRochesterInstituteofTechnology,USA MirusFlorianIntelLabs,Germany MizunoHideyukiSuwaUniversityofScience,Japan MohTeng-ShengSanJoseStateUniversity,USA MohammedElmahdiK.KasdiMerbahuniversity,Algeria MonshiMaramUniversityofSydney,Australia MorenoFelipeUniversidadCatólicaSanPablo,Peru MorraLiaPolitecnicodiTorino,Italy

MorzyMikołajPoznań UniversityofTechnology,Poland MoučekRomanUniversityofWestBohemia,CzechRepublic Mouka fihYounessInternationalUniversityofRabat,Morocco MouyssetSandrineUniversityofToulouse,France

MüllerRobertLudwig-Maximilians-UniversitätMünchen,Germany MutschlerMaximusUniversityofTübingen,Germany NajariNajiOrangeLabs,France

NandaAbhilashaVelloreInstituteofTechnology,India NguyenThiNguyetQueTechnologicalUniversityDublin,Ireland NikitinOlegRussianAcademyofSciences,Russia NjahHasnaUniversityofSfax,Tunisia NyabugaDouglasDonghuaUniversity,China Obafemi-AjayiTayoMissouriStateUniversity,USA OjhaVarunUniversityofReading,UK OldenhofMartijnKatholiekeUniversiteitLeuven,Belgium OnetoLucaUniversità diGenova,Italy OotaSubbaReddyInria,Bordeaux,France

OpreaMihaelaPetroleum-GasUniversityofPloiesti,Romania OsorioJohnBarcelonaSupercomputingCenter,Spain

OuniAchrefInstitutPascalUCA,France

PanYongpingSunYat-senUniversity,China ParkHyeyoungKyungpookNationalUniversity,SouthKorea

PateuxStéphaneOrangeLabs,France

Pecháč MatejComeniusUniversityinBratislava,Slovakia PecynaLeszekUniversityofLiverpool,UK PengXuyangChinaUniversityofPetroleum,China PhamVietToshiba,Japan

Pietroń MarcinAGHUniversityofScienceandTechnology,Poland PócošŠtefanComeniusUniversityinBratislava,Slovakia PosoccoNicolasEuraNova,Belgium

PrasojoRadityoEkoUniversitasIndonesia,Indonesia PreussMikeUniversiteitLeiden,TheNetherlands QiaoPengNationalUniversityofDefenseTechnology,China QiuShoumengShanghaiInstituteofMicrosystemandInformation Technology,China

QuanHongyanEastChinaNormalUniversity,China

Rafi eeLayaConcordiaUniversity,Canada RangarajanAnandUniversityofFlorida,USA RavichandranNareshBalajiKTHRoyalInstituteofTechnology,Sweden RenzulliRiccardoUniversityofTurin,Italy

RichterMatsUniversitätOsnabrück,Germany

RobineJanHeinrichHeineUniversityDüsseldorf,Germany

RochaGilUniversityofPorto,Portugal

Rodriguez-SanchezAntonioUniversitätInnsbruck,Austria RosipalRomanSlovakAcademyofSciences,Slovakia

RusieckiAndrzejWroclawUniversityofScienceandTechnology, Poland

SalomonMichelUniversité BourgogneFranche-Comté,France

SarishviliAlexFraunhoferITWM,Germany

SasiSwapnaBirlaInstituteofTechnologyandScience,India

SataerYikemaitiSoutheastUniversity,China

SchaafNinaFraunhoferIPA,Germany

SchakMonikaUniversityofAppliedSciences,Fulda,Germany

SchillingMalteBielefeldUniversity,Germany

SchmidKyrillLudwig-Maximilians-UniversitätMünchen,Germany

SchneiderJohannesUniversityofLiechtenstein,Liechtenstein

SchwabMalgorzataUniversityofColoradoatDenver,USA

SedlmeierAndreasLudwig-Maximilians-UniversitätMünchen,Germany

SenderaMarcinJagiellonianUniversity,Poland

ShahriyarRifatBangladeshUniversityofEngineeringandTechnology, Bangladesh

ShangChengFudanUniversity,China

ShaoJieUniversityofElectronicScienceandTechnology ofChina,China

ShaoYangHitachiLtd.,Japan

ShehuAmardaGeorgeMasonUniversity,USA

ShenLinlinShenzhenUniversity,China

Shenfi eldAlexSheffieldHallamUniversity,UK

ShiYingChongqingUniversity,China

ShresthaRomanIntelligentVoiceLtd.,UK

SifaRafetFraunhoferIAIS,Germany

SinhaAmanCNRSandUniversityofLorraine,France

SoltaniZarrinPouyaInstituteforHighPerformanceMicroelectronics, Germany

SongXiaozhuangSouthernUniversityofScienceandTechnology,China

SongYuhengShanghaiJiaoTongUniversity,China

SongZiyueShanghaiJiaoTongUniversity,China

Sowinski-MydlarzViktorLondonMetropolitanUniversity,UK

SteinerPeterTechnischeUniversitätDresden,Germany

StettlerMichaelUniversityofTübingen,Germany

StoeanRuxandraUniversityofCraiova,Romania SuDiBeijingInstituteofTechnology,China

SuarezOscarJ.InstitutoPolitécnicoNacional,México

SublimeJérémieInstitutsupérieurd’électroniquedeParis,France

SudharsanBharathNationalUniversityofIreland,Galway,Ireland

SugawaraToshiharuWasedaUniversity,Japan

SuiYongduoUniversityofScienceandTechnologyofChina,China

SuiZhentaoSoochowUniversity,China

Swiderska-ChadajZanetaWarsawUniversityofTechnology,Poland

SzandałaTomaszWroclawUniversityofScienceandTechnology, Poland

Šejnová

GabrielaCzechTechnicalUniversityinPrague,CzechRepublic

TangChenweiSichuanUniversity,China

TangJialiangSouthwestUniversityofScienceandTechnology, China

TaubertNickUniversityClinicTübingen,Germany

TekFaikBorayIsikUniversity,Turkey

TessierHugoStellantis,France

TianZhihongGuangzhouUniversity,China TianzeZhouBeijingInstituteofTechnology,China

TihonSimonEuraNova,Belgium

TingwenLiuChineseAcademyofSciences,China

TongHaoSouthernUniversityofScienceandTechnology,China

Torres-Moreno

Juan-Manuel

Université d’Avignon,France

TowobolaOluyemisiFolakeObafemiAwolowoUniversity,Nigeria

TrinhAnhDuongTechnologicalUniversityDublin,Ireland

TunaMatúš ComeniusUniversityinBratislava,Slovakia

UelwerTobiasHeinrichHeineUniversityDüsseldorf,Germany

VanRullenRufinCNRS,Toulouse,France

VarlamisIraklisHarokopioUniversityofAthens,Greece VašataDanielCzechTechnicalUniversityinPrague,CzechRepublic VásconezJuanEscuelaPolitécnicaNacional,Ecuador VataiEmilRIKEN,Japan

ViévilleThierryInria,Antibes,France

WagnerStefanHeinrichHeineUniversityDüsseldorf,Germany

WanKejiaDefenceInnovationInstitute,China WangHuilingTampereUniversity,Finland

WangJiaanSoochowUniversity,China WangJinlingUlsterUniversity,UK

WangJunliTongjiUniversity,China

WangQianDurhamUniversity,UK

WangXingNingxiaUniversity,China

WangYongguangBeihangUniversity,China

WangZimingShanghaiJiaoTongUniversity,China

WanigasekaraChathuraUniversityofAuckland,NewZealand WatsonPatrickMinervaKGI,USA

WeiBaoleChineseAcademyofSciences,China WeiFengYorkUniversity,Canada

WenningerMarcRosenheimTechnicalUniversityofAppliedSciences, Germany

WieczorekTadeuszSilesianUniversityofTechnology,Poland WilesJanetUniversityofQueensland,Australia

WindheuserChristophThoughtWorksInc.,Germany

WolterMoritzRheinischeFriedrich-Wilhelms-Universit ätBonn, Germany

WuAnchengPinganInsurance,China

WuDayanChineseAcademyofSciences,China

WuJingzhengChineseAcademyofSciences,China

WuNierInnerMongoliaUniversity,China

WuSongSouthwestUniversity,China

XieYuanlunUniversityofElectronicScienceandTechnology ofChina,China

XuDongshengNationalUniversityofDefenseTechnology,China

XuJianhuaNanjingNormalUniversity,China

XuPengTechnicalUniversityofMunich,Germany

YaguchiTakaharuKobeUniversity,Japan

YamamotoHideakiTohokuUniversity,Japan

YangGangRenminUniversityofChina,China

YangHaizhaoPurdueUniversity,USA

YangJingGuangxiNormalUniversity,China

YangJingHefeiUniversityofTechnology,China

YangLiuTianjinUniversity,China

YangSidiConcordiaUniversity,Canada

YangSunSoochowUniversity,China

YangWanliHarbinInstituteofTechnology,China

YangXiaoChenTianjinUniversityofTechnology,China

YangXuanShenzhenUniversity,China

YangZhaoLeidenUniversity,TheNetherlands

YangZhengfengEastChinaNormalUniversity,China

YangZhiguangChineseAcademyofSciences,China

YaoZhenjieChineseAcademyofSciences,China

YeKaiWuhanUniversity,China

YinBojianCentrumWiskunde&Informatica,TheNetherlands YuJamesSouthernUniversityofScienceandTechnology,China

YuWenxinSouthwestUniversityofScienceandTechnology, China

YuYipengTencent,China

YuYueBNU-HKBUUnitedInternationalCollege,China

YuanLimengziTianjinUniversity,China

YuchenGeHefeiUniversityofTechnology,China

YuhangGuoPekingUniversity,China

YuryTsoySolidware,SouthKorea

ZengJiaJilinUniversity,China

ZengJiayuanUniversityofShanghaiforScienceandTechnology, China

ZhangDongyangUniversityofElectronicScienceandTechnology ofChina,China

ZhangJiachengBeijingUniversityofPostsandTelecommunications, China

ZhangJieNanjingUniversity,China

ZhangKaiChineseAcademyofSciences,China

ZhangKaifengIndependentResearcher,China ZhangKunChineseAcademyofSciences,China

ZhangLuningChinaUniversityofPetroleum,China

ZhangPanpanChineseAcademyofSciences,China ZhangPengChineseAcademyofSciences,China ZhangWenbinCarnegieMellonUniversity,USA

ZhangXiangNationalUniversityofDefenseTechnology,China

ZhangXuewenSouthwestUniversityofScienceandTechnology, China

ZhangYichengUniversityofLincoln,UK ZhangYingjieHunanUniversity,China

ZhangYunchenUniversityofElectronicScienceandTechnology ofChina,China

ZhangZhiqiangSouthwestUniversityofScienceandTechnology, China

ZhaoLiangUniversityofSãoPaulo,Brazil ZhaoLiangDalianUniversityofTechnology,China

ZhaoQingchaoHarbinEngineeringUniversity,China ZhaoYingUniversityofShanghaiforScienceandTechnology, China

ZhaoYuekaiNationalUniversityofDefenseTechnology,China

ZhengYuchenKyushuUniversity,Japan

ZhongJunpeiPlymouthUniversity,UK ZhouShiyangDefenseInnovationInstitute,China ZhouXiaomaoHarbinEngineeringUniversity,China ZhouYucanChineseAcademyofSciences,China

ZhuHaijiangBeijingUniversityofChemicalTechnology,China ZhuMengtingNationalUniversityofDefenseTechnology,China ZhuShaolinZhengzhouUniversityofLightIndustry,China ZhuShuyingTheUniversityofHongKong,China ZugariniAndreaUniversityofFlorence,Italy

Contents – PartII

ComputerVisionandObjectDetection

SelectiveMulti-scaleLearningforObjectDetection...................3 JunliangChen,WeizengLu,andLinlinShen

DRENet:GivingFullScopetoDetectionandRegression-BasedEstimation forVideoCrowdCounting....................................15 ChangshengLiu,YuanHuang,YadongMu,andXiaomingYu

SisfrutosPapaya:ADatasetforDetectionandClassificationofDiseases inPapaya................................................28

JairoLucasdeMoraes,JorcydeOliveiraNeto,JacsonR.Correia-Silva, ThiagoM.Paixão,ClaudineBadue,ThiagoOliveira-Santos, andAlbertoF.DeSouza

Faster-LTN:ANeuro-Symbolic,End-to-EndObject DetectionArchitecture.......................................40 FrancescoManigrasso,FilomenoDavideMiro,LiaMorra, andFabrizioLamberti

GC-MRNet:GatedCascadeMulti-stageRegressionNetwork forCrowdCounting........................................53 YingShi,JunSang,JinghanTan,ZhongyuanWu,BinCai, andNongSang

LatentFeature-AwareandLocalStructure-PreservingNetworkfor3D CompletionfromaSingleDepthView...........................67 CaixiaLiu,DehuiKong,ShaofanWang,JinghuaLi,andBaocaiYin

FacialExpressionRecognitionbyExpression-Specific RepresentationSwapping.....................................80 JieLei,ZhaoLiu,ZeyuZou,TongLi,JuanXu,ZunleiFeng, andRonghuaLiang

IterativeErrorRemovalforTime-of-FlightDepthImaging..............92 ZhuolinZheng,YinzhangDing,XiaotianTang,YuCai,DongxiaoLi, MingZhang,HongyangXie,andXuanfuLi

BlurredImageRecognition:AJointMotionDeblurring andClassificationLoss-AwareApproach..........................106 WenjieZhangandZhiWang

LearningHowtoZoomIn:WeaklySupervisedROI-Based-DAM forFine-GrainedVisualClassification............................118

WenjieChen,ShuangRan,TianWang,andLihongCao

ConvolutionalNeuralNetworksandKernelMethods

(Input)SizeMattersforCNNClassifiers..........................133

MatsL.Richter,WolfByttner,UlfKrumnack,AnnaWiedenroth, LudwigSchallner,andJustinShenk

AcceleratingDepthwiseSeparableConvolutionswithVectorProcessor.....145

YuekaiZhao,JianzhuangLu,andXiaowenChen

KCNet:Kernel-BasedCanonicalizationNetworkforEntities inRecruitmentDomain......................................157

NidhiGoyal,NiharikaSachdeva,AnmolGoel,JushaanSinghKalra, andPonnurangamKumaraguru

DeepUnitaryConvolutionalNeuralNetworks......................170

Hao-YuanChangandKangL.Wang

DeepLearningandOptimizationI

DPWTE:ADeepLearningApproachtoSurvivalAnalysisUsing aParsimoniousMixtureofWeibullDistributions....................185 AchrafBennis,SandrineMouysset,andMathieuSerrurier

First-OrderandSecond-OrderVariantsoftheGradientDescent inaUnifiedFramework......................................197

ThomasPierrot,NicolasPerrin-Gilbert,andOlivierSigaud

BayesianOptimizationforBackpropagationinMonte-CarloTreeSearch....209 NengliLimandYueqinLi

GrowingNeuralNetworksAchieveFlatterMinima...................222

PaulCaillonandChristopheCerisara

DynamicNeuralDiversification:PathtoComputationallySustainable NeuralNetworks...........................................235

AlexanderKovalenko,PavelKordík,andMagdaFriedjungová

CurvedSDE-NetLeadstoBetterGeneralizationforUncertaintyEstimates ofDNNs................................................248

YongGuangWang,HuoBinTan,andShuZhenYao

EIS-EfficientandTrainableActivationFunctionsforBetterAccuracy andPerformance...........................................260 KoushikBiswas,SandeepKumar,ShilpakBanerjee, andAshishKumarPandey

DeepLearningandOptimizationII

WhyMixupImprovestheModelPerformance......................275 MasanariKimura

MixupGamblers:LearningtoAbstainwithAuto-CalibratedReward forMixedSamples.........................................287 TakumiYamaguchiandMasahiroMurakawa

Non-iterativePhaseRetrievalwithCascadedNeuralNetworks...........295 TobiasUelwer,TobiasHoffmann,andStefanHarmeling

IncorporatingDiscreteWaveletTransformationDecomposition ConvolutionintoDeepNetworktoAchieveLightTraining.............307 GuihuaTao,WentaoRong,WanlinWeng,TingtingDan,BinZhang, andHongminCai

MMF:ALossExtensionforFeatureLearninginOpenSetRecognition....319 JingyunJiaandPhilipK.Chan

OntheSelectionofLossFunctionsUnderKnownWeakLabelModels.....332 DanielBacaicoa-Barber,MiquelPerello-Nieto,RaúlSantos-Rodríguez, andJesúsCid-Sueiro

DistributedandContinualLearning

BilevelOnlineDeepLearninginNon-stationaryEnvironment...........347 Ya-nanHan,Jian-weiLiu,Bing-biaoXiao,Xin-TanWang, andXiong-linLuo

ABlockchainBasedDecentralizedGradientAggregationDesign forFederatedLearning.......................................359 JianZhao,XinWu,YanZhang,YuWu,andZhiWang

ContinualLearningforFakeNewsDetectionfromSocialMedia.........372 YiHan,ShanikaKarunasekera,andChristopherLeckie

BalancedSoftmaxCross-EntropyforIncrementalLearning.............385 QuentinJodelet,XinLiu,andTsuyoshiMurata

GeneralisedControllerDesignUsingContinualLearning...............397 DianaBenavides-Prado,ChathuraWanigasekara,andAkshyaSwain

DRILL:DynamicRepresentationsforImbalancedLifelongLearning.......409 KyraAhrens,FaresAbawi,andStefanWermter

PrincipalGradientDirectionandConfidenceReservoirSampling forContinualLearning.......................................421 ZhiyiChenandTongLin

ExplainableMethods

SpontaneousSymmetryBreakinginDataVisualization................435 CilieW.Feldager,SørenHauberg,andLarsKaiHansen

DeepNLPExplainer:UsingPredictionSlopetoExplainNLPModels......447 RezaMarzbanandChristopherCrick

EmpiricallyExplainingSGDfromaLineSearchPerspective............459 MaximusMutschlerandAndreasZell

TowardsOntologicallyExplainableClassifiers......................472 GrégoryBourguin,ArnaudLewandowski,MouradBouneffa, andAdeelAhmad

Few-shotLearning

LeveragingtheFeatureDistributioninTransfer-BasedFew-ShotLearning...487 YuqingHu,VincentGripon,andStéphanePateux

One-ShotMeta-learningforRadar-BasedGestureSequencesRecognition...500 GianfrancoMauro,MateuszChmurski,MuhammadArsalan, MariuszZubert,andVadimIssakov

Few-ShotLearningwithRandomErasingandTask-Relevant FeatureTransforming........................................512 XinWang,ShouhongWan,andPeiquanJin

FosteringCompositionalityinLatent,GenerativeEncodingstoSolve theOmniglotChallenge......................................525 SarahFabi,SebastianOtte,andMartinV.Butz

BetterFew-ShotTextClassificationwithPre-trainedLanguageModel......537 ZhengChenandYunchenZhang

GenerativeAdversarialNetworks

LeveragingGANsviaNon-localFeatures..........................551 XuyangPeng,WeifengLiu,BaodiLiu,KaiZhang,XiaopingLu, andYicongZhou

OnModeCollapseinGenerativeAdversarialNetworks................563 KaifengZhang

ImageInpaintingUsingWassersteinGenerativeAdversarial ImputationNetwork.........................................575 DanielVašata,Tomáš Halama,andMagdaFriedjungová

COViT-GAN:VisionTransformerforCOVID-19DetectioninCTScan ImageswithSelf-AttentionGANforDataAugmentation...............587 AraAbigailE.Ambita,EujeneNikkaV.Boquio, andProsperoC.NavalJr.

PhonicsGAN:SynthesizingGraphicalVideosfromPhonicsSongs........599 NuhaAldausari,ArcotSowmya,NadineMarcus, andGelarehMohammadi

AProgressiveImageInpaintingAlgorithmwithaMask Auto-updateBranch.........................................611 LiangNie,WenxinYu,XuewenZhang,SiyuanLi,NingJiang, andZhiqiangZhang

HybridGenerativeModelsforTwo-DimensionalDatasets..............623 HodaShajari,JaemoonLee,SanjayRanka,andAnandRangarajan

TowardsCompressingEfficientGenerativeAdversarialNetworks forImageTranslationviaPruningandDistilling.....................637 LuqiGong,ChaoLi,HailongHong,HuiZhu,TangwenQian, andYongjunXu

AuthorIndex

ComputerVisionandObjectDetection

SelectiveMulti-scaleLearningforObject Detection

JunliangChen1,2,3 ,WeizengLu1,2,3 ,andLinlinShen1,2,3(B)

1 ComputerVisionInstitute,SchoolofComputerScienceandSoftwareEngineering, ShenzhenUniversity,Shenzhen,China

2 ShenzhenInstituteofArtificialIntelligenceofRoboticsofSociety,Shenzhen,China

3 GuangdongKeyLaboratoryofIntelligentInformationProcessing,Shenzhen University,Shenzhen518060,China

{chenjunliang2016,luweizeng2018}@email.szu.edu.cn,llshen@szu.edu.cn

Abstract. Pyramidalnetworksarestandardmethodsformulti-scale objectdetection.Currentresearchesonfeaturepyramidnetworksusually adoptlayerconnectionstocollectfeaturesfromcertainlevelsofthefeature hierarchy,anddonotconsiderthesignificantdifferencesamongthem.We proposeabetterarchitectureoffeaturepyramidnetworks,namedselectivemulti-scalelearning(SMSL),toaddressthisissue.SMSLisefficient andgeneral,whichcanbeintegratedinbothsingle-stageandtwo-stage detectorstoboostdetectionperformance,withnearlynoextrainference cost.RetinaNetcombinedwithSMSLobtains1.8%improvementinAP (from39.1%to40.9%)onCOCOdataset.WhenintegratedwithSMSL, two-stagedetectorscangetaround1.0%improvementinAP.

Keywords: Multi-scale · Objectdetection

1Introduction

Objectdetectionisafundamentaltaskincomputervision,whosetargetisto classifyandlocateallobjectsinanimage.Imagerecognitionaimstopredict theprobabilityofallclassesforanimage,andadoptthetopprobabilitiesand theircorrespondingclassesasfinalresult.Unlikeimagerecognitionwherethere isusuallyonlyoneobjectinanimage,inobjectdetection,thereusuallyexists variousobjectsinthesameimage,withawiderangeofscales.Therefore,itis difficulttorepresentdifferentkindsofobjectsatthesamefeaturerepresentation level.Toachievethisgoal,asolutionistousemulti-levelfeaturerepresentations. Thefeaturesathigherlevelsaresemanticallystrongwithlowerresolutions. Whilethelow-levelfeaturesarespatiallyfinerwithhigherresolutions.Hence, thehigh-levelfeaturesaremoresuitableforlarge-objectdetectionwhilethelowlevelfeaturesaremorebeneficialfordetectingsmallerobjects.Thepyramidal architecturewithmulti-scalefeaturerepresentationsiswidelyusedbymany powerfulobjectdetectors[16, 22, 23].

c SpringerNatureSwitzerlandAG2021

I.Farkaˇsetal.(Eds.):ICANN2021,LNCS12892,pp.3–14,2021. https://doi.org/10.1007/978-3-030-86340-1 1

OneofthewidelyusedpyramidalarchitectureisFeaturePyramidNetworks (FPN)[15].FPNtakesinputsfromabackbonemodel,whichisusuallyconstructedforimagerecognition.Thebackbonemodelgeneratesfeaturerepresentationsindifferenthierarchieswithdecreasingresolutions.FPNsequentially takestwoadjacentlayersfromdifferentlevelsinbackboneasinputs,andcombinesthemwithatop-downpathwayandlateralconnections.Thehigh-level features,withstrongersemanticbutlowerresolution,areupsampledtofitthe spatialsizeofthelow-levelfeatureswithhigherresolution.Thenabinaryoperation,usuallyelement-wisesummation,isconductedtoaggregatethefeatures. Thelow-levelfinerfeaturesaresemanticallyenhancedaftercombinationwith high-levelfeaturesfromtop-downpathway.

AlthoughFPNissimpleandeffectiveformanydetectors,therearesome aspectstobeimproved.PathAggregationNetwork(PANet)[18]addsanadditionalbottom-uppathwayonthebaseofFPN.Thisadditionalbranchcan strengthenthesemanticallyenhancedfeaturesafterFPN,withfinerspatialfeaturesatlowerlevels.BalancedFeaturePyramid(BFP)[21]gatherscross-level featuresfromFPNorotherpyramidalarchitecturestothesamelevel.Then arefinementmoduleiscarriedoutafterelement-wiseaverageofthegathered features.Theaveragedfeatures,afusionoffeaturescrossalllevels,canbeconsideredasglobalinformation.Thefusedfeaturesarethenscatteredtoalllevels andsummedupwiththeoriginalinputfeatures.Thisprocessmergestheoriginalfeatureswithfeaturesfromallotherlevels,enablingdetectorstoperceive informationfromalllevels.Recentresearches[9, 11]explorebetterconnections ofcross-scalefeaturestoproduceapyramidalarchitectureforfeaturerepresentations.

However,theaboveworksignorethevariancesamongfeaturesfromdifferent scalesandgivethemthesameweightsforcombination,oronlymergefeatures frompartialscales.Inspiredbythese,weproposeanarchitecture,namedselectivemulti-scalelearning(SMSL),todynamicallylearnabetterfeaturerepresentationforeachlevelfrommulti-scalefeatures.SMSLcanefficientlyimprovethe detectionperformanceofbothsingle-stageandtwo-stagedetectorswithonlya smallincreaseofinferencecost.

Inthisstudy,wemakethefollowingcontributions:

–Weproposetheselectivemulti-scalelearning(SMSL)togeneratespecific featuresforeachlevelbyselectivelymergefeaturesfrommultiscales.

–CombinedwithSMSL,RetinaNetachievesperformanceof44.3%APon COCOdataset.

–Theproposedframeworkcanalsobeappliedtotwo-stageobjectdetectorsto improvethedetectionperformance.

2RelatedWork

Recognizingmulti-scaleobjectsisafundamentalbutchallengingtaskincomputervision.Pyramidalfeaturerepresentationsisageneraltechnique[1]inthis area.Asimplemethodistouseconvolutionalnetworks(ConvNets)toextract featuresfromimagepyramids.However,thismethodbringshugecomputation burden,astheConvNetsforwardrepeatedlyforthesameimage.Tosolvethe problem,aneffectivesolutionistodirectlytakeadvantageofthefeaturesgeneratedbytheConvNets,insteadofusingimagepyramids.Recentresearches [3, 7, 16, 20]proposemanycross-scaleconnectionstoconnectmulti-levelfeatures fromtheConvNets.Thoughkeeptheoriginalresolution,theconnectedfeatures aresemanticallyenhanced.

PartialConnections. Partialconnectionsareoneofthestandardpyramidal architectures.FPN[15]connectstwoadjacentlayersinthetop-downpathway byupsamplingthehigh-levelfeaturestofitthesizeofthefeaturesatlower levelandelement-wiselysumupthem.Thisarchitectureenhancesthelow-level featureswithstrongersemanticinformationfromhigherlevels.AlthoughFPN issimpleandeffectivetoimprovefeaturerepresentations,thefeaturesstilllack informationfromlowerlevels.Toaddressthisproblem,Liuetal.[18]propose PathAggregationNetwork(PANet)toaddanaccessionalbottom-uppathwayon thebasisofFPN.InPANet,low-levelfeaturesaredownsampledandsummedup withfeaturesathigherlevel.Therefore,thesemanticallyenhancedfeaturesafter FPNcanobtainfinerspatialinformation.NAS-FPN[6]usesNeuralArchitecture Search(NAS)algorithmtodiscoverabetterpyramidalarchitecturecoveringall cross-scaleconnections.

FullConnections. Anotherwaytointegratemulti-levelfeaturesistogather featuresandfusethemtogeneratefeaturesfordifferentlevelsandscatterthe fusedfeaturestothecorrespondinglevel.Kongetal.[11]firstgathermultilevelfeaturesandcombinethem,thenuseglobalattentionforfurtherrefinement.Afterthat,thelocalreconfigurationmoduleisemployedtofurthercapturelocalinformation.Theproducedfeaturesareresizedandelement-wisely summedupwiththeoriginalinputwhichislinearlyprojectedbya1 × 1convolution.BalancedFeaturePyramid(BFP)[21]gathersfeaturestoaleveland applieselement-wiseaveraging.Thenanon-localmoduleisutilizedtorefinethe integratedfeatures,whicharethenscatteredtoalllevels.Therefinedfeatures areelement-wiselysummedupwiththeoriginalinputfeaturesateachlevel. Theabovemethodsobtainfeaturesfrompartialscales,andusuallymerge themthroughlinearoperation(suchaselement-wisesummation)whichgives featuresfromdifferentscalesthesameweights.However,foraspecificlevel,the featuresfromdifferentscaleshavedifferentimportance.Therefore,thedetector shouldlearntoselectivelymergethemulti-scalefeatures.

Fig.1. (a)Theoverviewoftheproposedselectivemulti-scalelearning.(b)Thechannel rescalingmodule.“ C ”and“ S ”denotechannelconcatenationandchannelspliting, respectively.

3SelectiveMulti-scaleLearning

3.1NetworkArchitecture

Overview. Figure 1(a)showsthearchitectureofselectivemulti-scalelearning. Weusethe C 3 ,C 4 ,C 5 layersfromResNet[8]backbone.Thenwegenerate C 6 and C 7 layersbyseparatelyapplyinga3 × 3convolutionwithstride2on C 5 and C 6 layers.Therefore,theoriginalinputsare C 3 ,C 4 ,C 5 ,C 6 ,C 7 ,whichare gatheredtoalevelandthenpassedtochannelrescaling(CR)moduleshownin Fig. 1(b)andselectivefeaturecombination(SFC)module(Fig. 2(a))togenerate level-specificfeatures.Ateachlevel,thegeneratedfeaturesarethenelementwiselysummedupwiththecorrespondinginputasthefinaloutput.

ChannelRescaling. Thefeaturesatlevel l afterresizingaredenotedas Dl ∈ RC ×H ×W witharesolution H × W ,andtheindexesoftheinputlevelswithlowest andhighestresolutionaredenotedas lmin and lmax .Let L bethenumberof levels,then L = lmax lmin +1.Inourexperiments,thegatherlevelissetto (lmin + lmax )/2.

Thecontextofthemulti-levelfeaturesateachchannelisdifferent,sothe importanceoffeaturesateachchannelisaswelldifferent.Therefore,weaimto emphasizetheimportantfeaturesandsuppressthelessusefulfeatures,which canberegardedtoselecttheinformationviaagate.Toachievethisgoal,we proposechannelrescalingmoduletorescalethefeaturesatdifferentchannelsof themulti-levelfeatures.Aftergatheringthemulti-levelfeatures,wefirstconcat themas:

Fig.2. (a)Theselectivefeaturecombinationmodule.“SCB”denotestheselective combinationmodule.(b)Anselectivecombinationmoduleforthe l -thlevel.“ S ” denoteschannelspliting.

where D ∈ RLC ×H ×W .Thenchannelrescaling(CR)isaccomplishedbythe followingsteps.

Foraspecificchannelof D,wegettheglobalinformationbyusingglobal averagepooling(GAP).WedenotetheresultafterGAPas x.Theresultofthe c -thchannelcanbecalculatedas:

Wethengeneratetheweightsforeachchannelbytwofullyconnected(FC) layersfollowedbythesigmoidfunction:

where W1 ∈ R LC r ×LC , W2

, δ istheReLUfunctionand σ denotes thesigmoidfunction. r isthereductionratio,andissetto8inourexperiments. Wedenotetheoutputafterchannelrescalingmoduleas J.Forthe c -th channel,theoutput Jc isgeneratedbyrescaling Dc with sc :

where ⊗ denotesthechannel-wisemultiplication. Thenwesplit J into L groups:

(6) where l ∈{lmin ,...,lmax }

Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.