PyTorchKR Papers

최신 논문

총 2편
태그·기간 등 상세 필터

카테고리 탐색

로그인 후 이 태그 구독

논문 ID: document/9643106

A Vision-based Solution for Track Misalignment Detection

Derailment is one of the most frequent ways railway accidents happen. Track defects such as buckling and hogging that cause misalignment of tracks can easily lead to derailments. While railway tracks get laterally misaligned due to buckling, vertical misalignments can result from hogging. Such misalignments are visibly recognizable, and we can even automate the recognition using data-driven models. This paper discusses how we build such data-driven models. There are no public datasets available to build such models; therefore, we introduce TMD (Track Misalignment Detection) dataset. It consists of misaligned and normal track images. The problem we try to solve here is essentially a binary image classification problem, which we solve by exploring the feature extraction approach to transfer learning (TL). In this approach, we employ a pre-trained network to extract rich features, which are then supplied with annotations to a learning algorithm for building a candidate TL model. Several pre-trained networks and learning algorithms exist, resulting in many TL models; therefore, it becomes essential to identify effective ones. We propose an evaluation criterion to decide which are effective ones even before we test them. Our experiments demonstrate that the TL models selected based on our proposed evaluation criterion really perform better than other candidate TL models during testing.

arXiv:2206.09379

0/1 Deep Neural Networks via Block Coordinate Descent

The step function is one of the simplest and most natural activation functions for deep neural networks (DNNs). As it counts 1 for positive variables and 0 for others, its intrinsic characteristics (e.g., discontinuity and no viable information of subgradients) impede its development for several decades. Even if there is an impressive body of work on designing DNNs with continuous activation functions that can be deemed as surrogates of the step function, it is still in the possession of some advantageous properties, such as complete robustness to outliers and being capable of attaining the best learning-theoretic guarantee of predictive accuracy. Hence, in this paper, we aim to train DNNs with the step function used as an activation function (dubbed as 0/1 DNNs). We first reformulate 0/1 DNNs as an unconstrained optimization problem and then solve it by a block coordinate descend (BCD) method. Moreover, we acquire closed-form solutions for sub-problems of BCD as well as its convergence properties. Furthermore, we also integrate $\ell_{2,0}$-regularization into 0/1 DNN to accelerate the training process and compress the network scale. As a result, the proposed algorithm has a high performance on classifying MNIST and Fashion-MNIST datasets. As a result, the proposed algorithm has a desirable performance on classifying MNIST, FashionMNIST, Cifar10, and Cifar100 datasets.