Datasets for data-to-text generation typically focus either on multi-domain, single-sentence generation or on single-domain, long-form generation. In this work, we cast generating Wikipedia sections as a data-to-text generation task and create a large-scale dataset, WikiTableT, that pairs Wikipedia sections with their corresponding tabular data and various metadata. WikiTableT contains millions of instances, covering a broad range of topics, as well as a variety of flavors of generation tasks with different levels of flexibility. We benchmark several training and decoding strategies on WikiTableT. Our qualitative analysis shows that the best approaches can generate fluent and high quality texts but they struggle with coherence and factuality, showing the potential for our dataset to inspire future work on long-form generation.
Form validators based on regular expressions are often used on digital forms to prevent users from inserting data in the wrong format. However, writing these validators can pose a challenge to some users. We present FOREST, a regular expression synthesizer for digital form validations. FOREST produces a regular expression that matches the desired pattern for the input values and a set of conditions over capturing groups that ensure the validity of integer values in the input. Our synthesis procedure is based on enumerative search and uses a Satisfiability Modulo Theories (SMT) solver to explore and prune the search space. We propose a novel representation for regular expressions synthesis, multi-tree, which induces patterns in the examples and uses them to split the problem through a divide-and-conquer approach. We also present a new SMT encoding to synthesize capture conditions for a given regular expression. To increase confidence in the synthesized regular expression, we implement user interaction based on distinguishing inputs. We evaluated FOREST on real-world form-validation instances using regular expressions. Experimental results show that FOREST successfully returns the desired regular expression in 72% of the instances and outperforms REGEL, a state-of-the-art regular expression synthesizer.
In this paper, we construct a new Japanese speech corpus for speech-based summarization and simplification, "JSSS" (pronounced "j-triple-s"). Given the success of reading-style speech synthesis from short-form sentences, we aim to design more difficult tasks for delivering information to humans. Our corpus contains voices recorded for two tasks that have a role in providing information under constraints: duration-constrained text-to-speech summarization and speaking-style simplification. It also contains utterances of long-form sentences as an optional task. This paper describes how we designed the corpus, which is available on our project page.
The standard closed form lower bound on $\sigma$ for providing $(\epsilon, \delta)$-differential privacy by adding zero mean Gaussian noise with variance $\sigma^2$ is $\sigma > \Delta\sqrt {2}(\epsilon^{-1}) \sqrt {\log \left( 5/4\delta^{-1} \right)}$ for $\epsilon \in (0,1)$. We present a similar closed form bound $\sigma \geq \Delta (\epsilon\sqrt{2})^{-1} \left(\sqrt{az+\epsilon} + s\sqrt{az}\right)$ for $z=-\log(4\delta(1-\delta))$ and $(a,s)=(1,1)$ if $\delta \leq 1/2$ and $(a,s)=(\pi/4,-1)$ otherwise. Our bound is valid for all $\epsilon > 0$ and is always lower (better). We also present a sufficient condition for $(\epsilon, \delta)$-differential privacy when adding noise distributed according to even and log-concave densities supported everywhere.
Tensioned cable nets can be used as supporting structures for the efficient construction of lightweight building elements, such as thin concrete shell structures. To guarantee important mechanical properties of the latter, the tolerances on deviations of the tensioned cable net geometry from the desired target form are very tight. Therefore, the form needs to be readjusted on the construction site. In order to employ model-based optimization techniques, the precise identification of important uncertain model parameters of the cable net system is required. This paper proposes the use of Gaussian process regression to learn the function that maps the cable net geometry to the uncertain parameters. In contrast to previously proposed methods, this approach requires only a single form measurement for the identification of the cable net model parameters. This is beneficial since measurements of the cable net form on the construction site are very expensive. For the training of the Gaussian processes, simulated data is efficiently computed via convex programming. The effectiveness of the proposed method and the impact of the precise identification of the parameters on the form of the cable net are demonstrated in numerical experiments on a quarter-scale prototype of a roof structure.
We investigate Kantian equilibria in finite normal form games, a class of non-Nashian, morally motivated courses of action that was recently proposed in the economics literature. We highlight a number of problems with such equilibria, including computational intractability, a high price of miscoordination, and expensive/problematic extension to general normal form games. We point out that such a proper generalization will likely involve the concept of program equilibrium. Finally we propose some general, intuitive, computationally tractable, other-regarding equilibria related to Kantian equilibria, as well as a class of courses of action that interpolates between purely self-regarding and Kantian behavior.
In this paper, we report experimental results on assessing the impact of COVID-19 on college students by processing free-form texts generated by them. By free-form texts, we mean textual entries posted by college students (enrolled in a four year US college) via an app specifically designed to assess and improve their mental health. Using a dataset comprising of more than 9000 textual entries from 1451 students collected over four months (split between pre and post COVID-19), and established NLP techniques, a) we assess how topics of most interest to student change between pre and post COVID-19, and b) we assess the sentiments that students exhibit in each topic between pre and post COVID-19. Our analysis reveals that topics like Education became noticeably less important to students post COVID-19, while Health became much more trending. We also found that across all topics, negative sentiment among students post COVID-19 was much higher compared to pre-COVID-19. We expect our study to have an impact on policy-makers in higher education across several spectra, including college administrators, teachers, parents, and mental health counselors.
Skew-Gaussian processes (SkewGPs) extend the multivariate Unified Skew-Normal distributions over finite dimensional vectors to distribution over functions. SkewGPs are more general and flexible than Gaussian processes, as SkewGPs may also represent asymmetric distributions. In a recent contribution we showed that SkewGP and probit likelihood are conjugate, which allows us to compute the exact posterior for non-parametric binary classification and preference learning. In this paper, we generalize previous results and we prove that SkewGP is conjugate with both the normal and affine probit likelihood, and more in general, with their product. This allows us to (i) handle classification, preference, numeric and ordinal regression, and mixed problems in a unified framework; (ii) derive closed-form expression for the corresponding posterior distributions. We show empirically that the proposed framework based on SkewGP provides better performance than Gaussian processes in active learning and Bayesian (constrained) optimization. These two tasks are fundamental for design of experiments and in Data Science.
Compositionality is a widely discussed property of natural languages, although its exact definition has been elusive. We focus on the proposal that compositionality can be assessed by measuring meaning-form correlation. We analyze meaning-form correlation on three sets of languages: (i) artificial toy languages tailored to be compositional, (ii) a set of English dictionary definitions, and (iii) a set of English sentences drawn from literature. We find that linguistic phenomena such as synonymy and ungrounded stop-words weigh on MFC measurements, and that straightforward methods to mitigate their effects have widely varying results depending on the dataset they are applied to. Data and code are made publicly available.
With the overwhelming transition to smart phones, storing important information in the form of unstructured text has become habitual to users of mobile devices. From grocery lists to drafts of emails and important speeches, users store a lot of data in the form of unstructured text (for eg: in the Notes application) on their devices, leading to cluttering of data. This not only prevents users from efficient navigation in the applications but also precludes them from perceiving the relations that could be present across data in those applications. This paper proposes a novel pipeline to generate a set of tags using world knowledge based on the keywords and concepts present in unstructured textual data. These tags can then be used to summarize, categorize or search for the desired information thus enhancing user experience by allowing them to have a holistic outlook of the kind of information stored in the form of unstructured text. In the proposed system, we use an on-device (mobile phone) efficient CNN model with pruned ConceptNet resource to achieve our goal. The architecture also presents a novel ranking algorithm to extract the top n tags from any given text.
We present the closed-form solution to the problem of hedging price and quantity risks for energy retailers (ER), using financial instruments based on electricity price and weather indexes. Our model considers an ER who is intermediary in a regulated electricity market. ERs buy a fixed quantity of electricity at a variable cost and must serve a variable demand at a fixed cost. Thus ERs are subject to both price and quantity risks. To hedge such risks, an ER could construct a portfolio of financial instruments based on price and weather indexes. We construct the closed form solution for the optimal portfolio for the mean-Var model in the discrete setting. Our model does not make any distributional assumption.
The BS equations with fractional order two asset price models give a better prediction of options pricing in the monetary market. In this paper, the changed form of BS-condition with two asset price models dependent on the Liovelle-Caputo derivative for good predictions of options prices are utilized. The analytical solution is demonstrated in form of convergent infinite series and obtained by the properties of Samudu Transform.
This work studies and optimizes the performance of reconfigurable intelligent surface (RIS)-aided networks in Nakagami-m fading environment. First, accurate closed-form approximations for the channel distributions are derived. Then, closed-form formulas for the system outage probability, average symbol error probability (ASEP), and the channel capacity are obtained. Furthermore, we provide three different optimization approaches for finding the optimum number of reflecting elements to achieve a target outage probability. At the high signal-to-noise ratio (SNR) regime, a closed-form expression for the asymptotic outage probability is obtained to give more insights into the system performance. Results show that the considered system can achieve a diversity order of (a+1)/2, where a is a function of the Nakagami-m fading parameter m and the number of reflecting elements N. Moreover, findings show that m is more influential on the diversity order than N. Finally, the achieved expressions are applicable to non-integer values of m and any number of meta-surface elements N.
Microwave remote sensors mounted on center pivot irrigation systems provide a feasible approach to obtain soil moisture information, in the form of water content maps, for the implementation of closed-loop irrigation. Major challenges such as significant time delays in the soil moisture measurements, the inability of the sensors to provide soil moisture information in instances where the center pivot is stationary, and the inability of the sensors to provide soil moisture information in the root zone reduce the usability of the water content maps in the effective implementation of closed-loop irrigation. In this paper, we seek to address the aforementioned challenges and consequently describe a water content map construction procedure that is suitable for the implementation of closed-loop irrigation. Firstly, we propose the cylindrical coordinates version of the Richards equation (field model) which naturally models fields equipped with a center pivot irrigation system. Secondly, measurements obtained from the microwave sensors are assimilated into the field model using the extended Kalman filter to form an information fusion system, which will provide frequent soil moisture estimates and predictions in the form of moisture content maps. The utility of the proposed information fusion system is first investigated with simulated microwave sensor measurements. The information fusion system is then applied to a real large-scale agriculture field where we demonstrate the its ability to address the challenges. Three performance evaluation criteria are used to validate the soil moisture estimates and predictions provided by the proposed information fusion system.
In this paper, the Dirac's quantum mechanical interaction picture is applied to option pricing to obtain a solution of the Black-Scholes equation in the presence of a time-dependent arbitrage bubble. In particular, for the case of a call perturbed by a square bubble, an approximate solution (valid up third order in a perturbation series) is given in terms of the three first Greeks: Delta, Gamma, and Speed. Then an exact solution is constructed in terms of all higher order $S$-derivatives of the Black-Scholes formula. It is also shown that the interacting Black-Scholes equation is invariant under a discrete transformation that interchanges the interest rate with the mean of the underlying asset and vice versa. This implies that the interacting Black-Scholes equation can be written in a 'low energy' and a 'high energy' form, in such a way that the high-interaction limit of the low energy form corresponds to the weak-interaction limit of the high energy form. One can apply a perturbative analysis to the high energy form to study the high-interaction limit of the low energy form.
Sports franchises invest a lot in training their athletes. use of latest technology for this purpose is also very common. We propose a system of capturing motion of athletes during weight training and analyzing that data to find out any shortcomings and imperfections. Our system uses Kinect depth image to compute different parameters of athlete's selected joints. These parameters are passed through certain algorithms to process them and formulate results on their basis. Some parameters like range of motion, speed and balance can be analyzed in real time. But for comparison to be performed between motions, data is first recorded and stored and then processed for accurate results. Our results depict that this system can be easily deployed and implemented to provide a very valuable insight to dynamics of a work out and help an athlete in improving his form.
Newton-step approximations to pseudo maximum likelihood estimates of spatial autoregressive models with a large number of parameters are examined, in the sense that the parameter space grows slowly as a function of sample size. These have the same asymptotic efficiency properties as maximum likelihood under Gaussianity but are of closed form. Hence they are computationally simple and free from compactness assumptions, thereby avoiding two notorious pitfalls of implicitly defined estimates of large spatial autoregressions. For an initial least squares estimate, the Newton step can also lead to weaker regularity conditions for a central limit theorem than those extant in the literature. A simulation study demonstrates excellent finite sample gains from Newton iterations, especially in large multiparameter models for which grid search is costly. A small empirical illustration shows improvements in estimation precision with real data.
The paper studies the problem of auction design in a setting where the auctioneer accesses the knowledge of the valuation distribution only through statistical samples. A new framework is established that combines the statistical decision theory with mechanism design. Two optimality criteria, maxmin, and equivariance, are studied along with their implications on the form of auctions. The simplest form of the equivariant auction is the average bid auction, which set individual reservation prices proportional to the average of other bids and historical samples. This form of auction can be motivated by the Gamma distribution, and it sheds new light on the estimation of the optimal price, an irregular parameter. Theoretical results show that it is often possible to use the regular parameter population mean to approximate the optimal price. An adaptive average bid estimator is developed under this idea, and it has the same asymptotic properties as the empirical Myerson estimator. The new proposed estimator has a significantly better performance in terms of value at risk and expected shortfall when the sample size is small.
Current model-free adaptive control (MFAC) method has no been analysed in linear system and is not straightforward for the practical engineers to understand accurately. This correspondence presents a family of MFAC based on a modified equivalent-dynamic-linearization model (EDLM), which facilitates to show the working principle of method more directly and objectively. Compared to the current work, i) the researches on MFAC focus on linear model, which is easy to understand its working behaviour; ii) the full-form EDLM is extended with unmeasured stochastic and measured disturbance, respectively. Then the controllers is modified correspondingly; iii) the stability analysis of system cannot be proved by current contraction mapping technique when the sign of leading coefficient of control input changes, therefore we prove it by analysing the function of the closed-loop poles. Several simulated examples are used to show the principles of this kind of method.
A general stochastic model for susceptible -> infective -> recovered (SIR) epidemics in non homogeneous populations is considered. The heterogeneity is a very important aspect here since it allows more realistic but also more complex models. The basic reproduction number $R_0$, an indication of the probability of an outbreak for homogeneous populations does not indicate the probability of an outbreak for non homogeneous models anymore, because it changes with the initially infected case. Therefore, we use "individual $R_0$" that is the expected number of secondary cases for a given initially infected individual. Thus, the effectiveness of intervention strategies can be assessed by their capability to reduce individual $R_0$ values. Also an intelligent vaccination plan for fully heterogeneous populations is proposed. It is based on the recursive calculation of individual R0 values.