Enhancing inter-class representation with a new global center loss

Myeong K. Kang, In H. Lee, Eun H. Lee, Sang Y. Baek, Sang C. Lee

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The challenge of training convolutional neural networks (CNNs) is mapping a set of high dimensional low data to a lower dimensional feature point on the manifold. However, the dimensionality reduced feature from CNN always suffers from verifying a new unseen class, such as measuring a computably meaningful distance on the dimensionality distorted space. The mapped feature on the lower dimension is formed by interrelated with training dataset and measure of penalization of learning. These methods can boost performance by training a large dataset or applying extra penalizations, which help forming feature more discriminatively. The discriminatively learned feature has a balanced inter-class distance and a reduced intra-class variation. In this paper, we propose a new loss function so called global center loss to extract more meaningful distance on feature space. The method leads to a sufficient inter-class variation which helps forming feature more discriminatively. The insufficient enforcement of negative-log likelihood or local center loss can be complementarily enhanced by utilizing the proposed global center method which is a valuable joint supervisory signal.

Original languageEnglish
Title of host publicationProceedings of 2017 International Conference on Industrial Design Engineering, ICIDE 2017
PublisherAssociation for Computing Machinery
Pages112-120
Number of pages9
ISBN (Electronic)9781450348669
DOIs
StatePublished - 29 Dec 2017
Event2017 International Conference on Industrial Design Engineering, ICIDE 2017 - Dubai, United Arab Emirates
Duration: 28 Dec 201731 Dec 2017

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2017 International Conference on Industrial Design Engineering, ICIDE 2017
Country/TerritoryUnited Arab Emirates
CityDubai
Period28/12/1731/12/17

Bibliographical note

Publisher Copyright:
© 2017 Association for Computing Machinery.

Keywords

  • Center loss
  • Discriminative feature learning
  • Global center loss
  • Joint center loss
  • Joint supervisory signal

Fingerprint

Dive into the research topics of 'Enhancing inter-class representation with a new global center loss'. Together they form a unique fingerprint.

Cite this