PyTorchKR Papers

최신 논문

총 1,635편
태그·기간 등 상세 필터

카테고리 탐색

로그인 후 이 태그 구독

arXiv:2211.08919

Efficient implementation of portfolio strategies involving cryptocurrencies and VIX INDEX and Gold

This research mainly explores the characteristics of different strategies and whether VIX INDEX positively influences the investment portfolio in any period. Our portfolio has six significant cryptocurrencies, VIX INDEX and gold. We perform parameter estimation on all raw data and bring the two types into different investment strategies, complete them effectively according to other characteristics, and compare the results. At the same time, we make two different portfolios, one contains VIX INDEX, and one does not have VIX INDEX. We use different portfolios in different portfolio strategies and find that VIX INDEX can positively impact the investment portfolio of cryptocurrencies, no matter in the standard market or the downward market. The research shows that gold has the same attributes as VIX INDEX and should have a specific positive effect, but no comparative experiment has been done.

arXiv:2211.08797

Assessing potential insights of an imperfect testing strategy: Parameter estimation and practical identifiability using early COVID-19 data in India

A deterministic model with testing of infected individuals has been proposed to investigate the potential consequences of the impact of testing strategy. The model exhibits global dynamics concerning the disease-free and a unique endemic equilibrium depending on the basic reproduction number when the recruitment of infected individuals is zero; otherwise, the model does not have a disease-free equilibrium, and disease never dies out in the community. Model parameters have been estimated using the maximum likelihood method with respect to the data of early COVID-19 outbreak in India. The practical identifiability analysis shows that the model parameters are estimated uniquely. The consequences of the testing rate for the weekly new cases of early COVID-19 data in India tell that if the testing rate is increased by 20% and 30% from its baseline value, the weekly new cases at the peak are decreased by 37.63% and 52.90%; and it also delayed the peak time by four and fourteen weeks, respectively. Similar findings are obtained for the testing efficacy that if it is increased by 12.67% from its baseline value, the weekly new cases at the peak are decreased by 59.05% and delayed the peak by 15 weeks. Therefore, a higher testing rate and efficacy reduce the disease burden by tumbling the new cases, representing a real scenario. It is also obtained that the testing rate and efficacy reduce the epidemic's severity by increasing the final size of the susceptible population. The testing rate is found more significant if testing efficacy is high. Global sensitivity analysis using partial rank correlation coefficients (PRCCs) and Latin hypercube sampling (LHS) determine the key parameters that must be targeted to worsen/contain the epidemic.

arXiv:2211.08801

Adapting to noise distribution shifts in flow-based gravitational-wave inference

Deep learning techniques for gravitational-wave parameter estimation have emerged as a fast alternative to standard samplers $\unicode{x2013}$ producing results of comparable accuracy. These approaches (e.g., DINGO) enable amortized inference by training a normalizing flow to represent the Bayesian posterior conditional on observed data. By conditioning also on the noise power spectral density (PSD) they can even account for changing detector characteristics. However, training such networks requires knowing in advance the distribution of PSDs expected to be observed, and therefore can only take place once all data to be analyzed have been gathered. Here, we develop a probabilistic model to forecast future PSDs, greatly increasing the temporal scope of DINGO networks. Using PSDs from the second LIGO-Virgo observing run (O2) $\unicode{x2013}$ plus just a single PSD from the beginning of the third (O3) $\unicode{x2013}$ we show that we can train a DINGO network to perform accurate inference throughout O3 (on 37 real events). We therefore expect this approach to be a key component to enable the use of deep learning techniques for low-latency analyses of gravitational waves.

arXiv:2211.07272

Enhancing Flood Forecasting with Dual State-Parameter Estimation and Ensemble-based SAR Data Assimilation

Ensemble data assimilation in flood forecasting depends strongly on the density, frequency and statistics of errors associated with the observation network. This work focuses on the assimilation of 2D flood extent data, expressed in terms of wet surface ratio, in addition to the in-situ water level data. The objective is to improve the representation of the flood plain dynamics with a TELEMAC-2D model and an Ensemble Kalman Filter (EnKF). The EnKF control vector is composed of friction coefficients and corrective parameters to the input forcing. It is augmented with the water level state averaged over selected subdomains of the floodplain. This work focuses on the 2019 flood event that occurred over the Garonne Marmandaise catchment. The merits of assimilating SAR-derived flood plain data complementary to in-situ water level observations are shown in the control parameter and observation spaces with 1D and 2D assessment metrics. It was also shown that the assimilation of Wet surface Ratio in the flood plain complementary to in-situ data in the river bed brings significative improvement when a corrective term on flood plain hydraulic state is included in the control vector. Yet, it has barely no impact in the river bed that is sufficiently well described by in-situ data. We highlighted that the correction of the hydraulic state in the flood plain significantly improved the flood dynamics, especially during the recession. This proof-of-concept study paves the way towards near-real-time flood forecast, making the most of remote sensing-derived flood observations.

arXiv:2211.05723

A Python library for nonlinear system identification using Multi-Gene Genetic Programming algorithm

Models can be built directly from input and output data trough a process known as system identification. The Nonlinear AutoRegressive with eXogenous inputs (NARMAX) models are among the most used mathematical representations in the area and has many successful applications on data-driven modeling in different fields. Such models become extremely large when they have high degree of non-linearity and long-term dependencies. Hence, a structure selection process must be performed to make them parsimonious. In the present paper, it is introduced a toolbox in Python that performs the structure selection process using the evolutionary algorithm named Multi-Gene Genetic Programming (MGGP). The toolbox encapsulates basic tools for parameter estimation, simulation and validation, and it allows the users to customize their evaluation function including prior knowledge and constraints in the individual structure (gray-box identification).

arXiv:2211.04846공식 코드 · Papers with Code

Grid-free Harmonic Retrieval and Model Order Selection using Deep Convolutional Neural Networks

Harmonic retrieval techniques are the foundation of radio channel sounding, estimation, and modeling. This paper introduces a Deep Learning approach for joint delay- and Doppler estimation from frequency and time samples of a radio channel transfer function. Our work estimates the two-dimensional parameters from a signal containing an unknown number of paths. Compared to existing deep learning-based methods, the signal parameters are not estimated via classification but in a quasi-grid-free manner. This alleviates the bias, spectral leakage, and ghost targets that grid-based approaches produce. The proposed architecture also reliably estimates the number of paths in the measurement. Hence, it jointly solves the model order selection and parameter estimation task. Additionally, we propose a multi-channel windowing of the data to increase the estimator's robustness. We also compare the performance to other harmonic retrieval methods and integrate it into an existing maximum likelihood estimator for efficient initialization of a gradient-based iteration.

arXiv:2211.01849

Unsupervised Parameter Estimation using Model-based Decoder

In this work, we consider the use of a model-based decoder in combination with an unsupervised learning strategy for direction-of-arrival (DoA) estimation. Relying only on unlabeled training data we show in our analysis that we can outperform existing unsupervised machine learning methods and classical methods. The proposed approach consists of introducing a model-based decoder in an autoencoder architecture which leads to a meaningful representation of the statistical model in the latent space of the autoencoder. Our numerical simulations show that the performance of the presented approach is not affected by correlated signals and performs well for both, uncorrelated and correlated, scenarios. This is a result of the fact, that, in the proposed framework, the signal covariance matrix and the DOAs are estimated simultaneously.

arXiv:2211.01554공식 코드 · Papers with Code

Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification

This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a corresponding multichannel time series. Our task is to accurately estimate a range of likely values of the underlying parameters. Standard iterative approaches necessitate running the simulator many times, which is computationally prohibitive. This paper describes a novel framework for learning feature embeddings of observed dynamics jointly with an emulator that can replace high-cost simulators for parameter estimation. Leveraging a contrastive learning approach, our method exploits intrinsic data properties within and across parameter and trajectory domains. On a coupled 396-dimensional multiscale Lorenz 96 system, our method significantly outperforms a typical parameter estimation method based on predefined metrics and a classical numerical simulator, and with only 1.19% of the baseline's computation time. Ablation studies highlight the potential of explicitly designing learned emulators for parameter estimation by leveraging contrastive learning.

arXiv:2211.00175

Homodyned K-distribution: parameter estimation and uncertainty quantification using Bayesian neural networks

Quantitative ultrasound (QUS) allows estimating the intrinsic tissue properties. Speckle statistics are the QUS parameters that describe the first order statistics of ultrasound (US) envelope data. The parameters of Homodyned K-distribution (HK-distribution) are the speckle statistics that can model the envelope data in diverse scattering conditions. However, they require a large amount of data to be estimated reliably. Consequently, finding out the intrinsic uncertainty of the estimated parameters can help us to have a better understanding of the estimated parameters. In this paper, we propose a Bayesian Neural Network (BNN) to estimate the parameters of HK-distribution and quantify the uncertainty of the estimator.

arXiv:2211.00515

Infinite-Dimensional Adaptive Boundary Observer for Inner-Domain Temperature Estimation of 3D Electrosurgical Processes using Surface Thermography Sensing

We present a novel 3D adaptive observer framework for use in the determination of subsurface organic tissue temperatures in electrosurgery. The observer structure leverages pointwise 2D surface temperature readings obtained from a real-time infrared thermographer for both parameter estimation and temperature field observation. We introduce a novel approach to decoupled parameter adaptation and estimation, wherein the parameter estimation can run in real-time, while the observer loop runs on a slower time scale. To achieve this, we introduce a novel parameter estimation method known as attention-based noise-robust averaging, in which surface thermography time series are used to directly estimate the tissue's diffusivity. Our observer contains a real-time parameter adaptation component based on this diffusivity adaptation law, as well as a Luenberger-type corrector based on the sensed surface temperature. In this work, we also present a novel model structure adapted to the setting of robotic surgery, wherein we model the electrosurgical heat distribution as a compactly supported magnitude- and velocity-controlled heat source involving a new nonlinear input mapping. We demonstrate satisfactory performance of the adaptive observer in simulation, using real-life experimental ex vivo porcine tissue data.

arXiv:2210.15279

On the Approximation and Complexity of Deep Neural Networks to Invariant Functions

Recent years have witnessed a hot wave of deep neural networks in various domains; however, it is not yet well understood theoretically. A theoretical characterization of deep neural networks should point out their approximation ability and complexity, i.e., showing which architecture and size are sufficient to handle the concerned tasks. This work takes one step on this direction by theoretically studying the approximation and complexity of deep neural networks to invariant functions. We first prove that the invariant functions can be universally approximated by deep neural networks. Then we show that a broad range of invariant functions can be asymptotically approximated by various types of neural network models that includes the complex-valued neural networks, convolutional neural networks, and Bayesian neural networks using a polynomial number of parameters or optimization iterations. We also provide a feasible application that connects the parameter estimation and forecasting of high-resolution signals with our theoretical conclusions. The empirical results obtained on simulation experiments demonstrate the effectiveness of our method.

arXiv:2210.14476공식 코드 · Papers with Code

Sinusoidal Frequency Estimation by Gradient Descent

Sinusoidal parameter estimation is a fundamental task in applications from spectral analysis to time-series forecasting. Estimating the sinusoidal frequency parameter by gradient descent is, however, often impossible as the error function is non-convex and densely populated with local minima. The growing family of differentiable signal processing methods has therefore been unable to tune the frequency of oscillatory components, preventing their use in a broad range of applications. This work presents a technique for joint sinusoidal frequency and amplitude estimation using the Wirtinger derivatives of a complex exponential surrogate and any first order gradient-based optimizer, enabling end to-end training of neural network controllers for unconstrained sinusoidal models.

arXiv:2210.12978

Three-component contour dynamics model to simulate and analyze amoeboid cell motility

Amoeboid cell motility is relevant in a wide variety of biomedical applications such as wound healing, cancer metastasis, and embryonic morphogenesis. It is characterized by pronounced changes of the cell shape associated with expansions and retractions of the cell membrane, which result in a crawling kind of locomotion. Despite existing computational models of amoeboid motion, the inference of expansion and retraction components of individual cells, the corresponding classification of cells, and the a priori specification of the parameter regime to achieve a specific motility behavior remain challenging open problems. We propose a novel model of the spatio-temporal evolution of two-dimensional cell contours comprising three biophysiologically motivated components: a stochastic term accounting for membrane protrusions and two deterministic terms accounting for membrane retractions by regularizing the shape and area of the contour. Mathematically, these correspond to the intensity of a self-exciting Poisson point process, the area-preserving curve-shortening flow, and an area adjustment flow. The model is used to generate contour data for a variety of qualitatively different, e.g., polarized and non-polarized, cell tracks that are hardly distinguishable from experimental data. In application to experimental cell tracks, we inferred the protrusion component and examined its correlation to commonly used biomarkers: the actin concentration close to the membrane and its local motion. Due to the low model complexity, parameter estimation is fast, straightforward and offers a simple way to classify contour dynamics based on two locomotion types: the amoeboid and a so-called fan-shaped type. For both types, we use cell tracks segmented from fluorescence imaging data of the model organism D. discoideum. An implementation of the model is provided within the open-source software package AmoePy.

arXiv:2210.12706

Robust Adaptive Prescribed-Time Control for Parameter-Varying Nonlinear Systems

It is an interesting open problem to achieve adaptive prescribed-time control for strict-feedback systems with unknown and fast or even abrupt time-varying parameters. In this paper we present a solution with the aid of several design and analysis innovations. First, by using a spatiotemporal transformation, we convert the original system operational over finite time interval into one operational over infinite time interval, allowing for Lyapunov asymptotic design and recasting prescribed-time stabilization on finite time domain into asymptotic stabilization on infinite time domain. Second, to deal with time-varying parameters with unknown variation boundaries, we use congelation of variables method and establish three separate adaptive laws for parameter estimation (two for the unknown parameters in the feedback path and one for the unknown parameter in the input path), in doing so we utilize two tuning functions to eliminate over-parametrization. Third, to achieve asymptotic convergence for the transformed system, we make use of nonlinear damping design and non-regressor-based design to cope with time-varying perturbations, and finally, we derive the prescribed-time control scheme from the asymptotic controller via inverse temporal-scale transformation. The boundedness of all closed-loop signals and control input is proved rigorously through Lyapunov analysis, squeeze theorem, and two novel lemmas built upon the method of variation of constants. Numerical simulation verifies the effectiveness of the proposed method.

arXiv:2210.12595공식 코드 · Papers with Code

Online Probabilistic Model Identification using Adaptive Recursive MCMC

Although the Bayesian paradigm offers a formal framework for estimating the entire probability distribution over uncertain parameters, its online implementation can be challenging due to high computational costs. We suggest the Adaptive Recursive Markov Chain Monte Carlo (ARMCMC) method, which eliminates the shortcomings of conventional online techniques while computing the entire probability density function of model parameters. The limitations to Gaussian noise, the application to only linear in the parameters (LIP) systems, and the persistent excitation (PE) needs are some of these drawbacks. In ARMCMC, a temporal forgetting factor (TFF)-based variable jump distribution is proposed. The forgetting factor can be presented adaptively using the TFF in many dynamical systems as an alternative to a constant hyperparameter. By offering a trade-off between exploitation and exploration, the specific jump distribution has been optimised towards hybrid/multi-modal systems that permit inferences among modes. These trade-off are adjusted based on parameter evolution rate. We demonstrate that ARMCMC requires fewer samples than conventional MCMC methods to achieve the same precision and reliability. We demonstrate our approach using parameter estimation in a soft bending actuator and the Hunt-Crossley dynamic model, two challenging hybrid/multi-modal benchmarks. Additionally, we compare our method with recursive least squares and the particle filter, and show that our technique has significantly more accurate point estimates as well as a decrease in tracking error of the value of interest.

arXiv:2210.12791

O-type Stars Stellar Parameter Estimation Using Recurrent Neural Networks

In this paper, we present a deep learning system approach to estimating luminosity, effective temperature, and surface gravity of O-type stars using the optical region of the stellar spectra. In previous work, we compare a set of machine learning and deep learning algorithms in order to establish a reliable way to fit a stellar model using two methods: the classification of the stellar spectra models and the estimation of the physical parameters in a regression-type task. Here we present the process to estimate individual physical parameters from an artificial neural network perspective with the capacity to handle stellar spectra with a low signal-to-noise ratio (S/N), in the $<$20 S/N boundaries. The development of three different recurrent neural network systems, the training process using stellar spectra models, the test over nine different observed stellar spectra, and the comparison with estimations in previous works are presented. Additionally, characterization methods for stellar spectra in order to reduce the dimensionality of the input data for the system and optimize the computational resources are discussed.

arXiv:2210.12142

Target Aware Poisson-Gaussian Noise Parameters Estimation from Noisy Images

Digital sensors can lead to noisy results under many circumstances. To be able to remove the undesired noise from images, proper noise modeling and an accurate noise parameter estimation is crucial. In this project, we use a Poisson-Gaussian noise model for the raw-images captured by the sensor, as it fits the physical characteristics of the sensor closely. Moreover, we limit ourselves to the case where observed (noisy), and ground-truth (noise-free) image pairs are available. Using such pairs is beneficial for the noise estimation and is not widely studied in literature. Based on this model, we derive the theoretical maximum likelihood solution, discuss its practical implementation and optimization. Further, we propose two algorithms based on variance and cumulant statistics. Finally, we compare the results of our methods with two different approaches, a CNN we trained ourselves, and another one taken from literature. The comparison between all these methods shows that our algorithms outperform the others in terms of MSE and have good additional properties.

arXiv:2210.11284

Robust Multitask Diffusion Normalized M-estimate Subband Adaptive Filtering Algorithm Over Adaptive Networks

In recent years, the multitask diffusion least mean square (MD-LMS) algorithm has been extensively applied in the distributed parameter estimation and target tracking of multitask network. However, its performance is mainly limited by two aspects, i.e, the correlated input signal and impulsive noise interference. To overcome these two limitations simultaneously, this paper firstly introduces the subband adaptive filter (SAF) into the multitask network. Then, a robust multitask diffusion normalized M-estimate subband adaptive filtering (MD-NMSAF) algorithm is proposed by solving the modified Huber function based global network optimization problem in a distributed manner, which endows the multitask network strong decorrelation ability for correlated inputs and robustness to impulsive noise interference, and accelerates the convergence of the algorithm significantly. Compared with the robust multitask diffusion affine projection M-estimate (MD-APM) algorithm, the computational complexity of the proposed MD-NMSAF is greatly reduced. In addition, the stability condition, the analytical expressions of the theoretical transient and steady-state network mean square deviation (MSD) of the MD-NMSAF are also provided and verified through computer simulations. Simulation results under different input signals and impulsive noise environment fully demonstrate the performance advantages of the MD-NMSAF algorithm over some other competitors in terms of steady-state accuracy and tracking speed.

arXiv:2210.10904

Joint Transmit and Receive Beamforming Design in Full-Duplex Integrated Sensing and Communications

Integrated sensing and communication (ISAC) has been envisioned as a solution to realize the sensing capability required for emerging applications in wireless networks, while efficiently utilizing the available spectral, hardware and energy resources. A commonly studied scenario in the ISAC literature involves a transceiver (e.g., a base station) serving a communication user, while simultaneously sensing targets from the reflected echo signals, by acting as a mono-static radar. However, as signal transmission durations are typically much longer than the radar echo round-trip times, the radar returns are drowned by the strong self interference (SI) from the transmitter - a phenomenon termed the echo-miss problem. A promising approach involves the ISAC transceiver to be full-duplex (FD), and in this paper we jointly design the transmit and receive beamformers at the transceiver, transmit precoder at the uplink user, and receive combiner at the downlink user to simultaneously (a) maximize the uplink and downlink rate, (b) maximize the transmit and receive radar beampattern power at the target, and (c) suppress the residual SI. Numerical results illustrate that the proposed design can effectively achieve up to 60 dB digital-domain SI cancellation, a higher average sum-rate, and more accurate radar parameter estimation compared with previous ISAC FD studies.

arXiv:2210.10150

Joint User Localization and Location Calibration of A Hybrid Reconfigurable Intelligent Surface

The recent research in the emerging technology of reconfigurable intelligent surfaces (RISs) has identified its high potential for localization and sensing. However, to accurately localize a user placed in the area of influence of an RIS, the RIS location needs to be known a priori and its phase profile is required to be optimized for localization. In this paper, we study the problem of the joint localization of a hybrid RIS (HRIS) and a user, considering that the former is equipped with a single reception radio-frequency (RF) chain enabling simultaneous tunable reflections and sensing via power splitting. Focusing on the downlink of a multi-antenna base station, we present a multi-stage approach for the estimation of the HRIS position and orientation as well as the user position. Our simulation results, including comparisons with the Cram\'er-Rao lower bounds, demonstrate the efficiency of the proposed localization approach, while showcasing that there exists an optimal HRIS power splitting ratio for the desired multi-parameter estimation problem.