New on arXiv
Sort: by field | by arXiv number | trending
Machine learning (statistics)
Alignment Myopia in Generative AI
Current generative AI alignment relies on a myopic paradigm that prioritizes immediate conversational satisfaction. By relying on short-horizon feedback, this approach ignores the profound, longitudinal externalities of persistent human-AI interaction, which can lead to adverse outcomes such as cognitive atrophy, social erosion, and diminished human agency. To address this, we propose a paradigm...
Fundamental Limits of Coherent Imaging in The Presence of Atmospheric Turbulence
We study the fundamental limits of jointly estimating the signal amplitude and the atmospheric phase distortion in complex-valued multi-look coherent imaging, where the measurements are corrupted by multiplicative speckle and additive Gaussian noise, all looks share a known Gaussian sensing matrix, and both parameters belong to structured classes. By analyzing a constrained maximum likelihood...
Regularization vs. Convolution in Kernel-Based Hypothesis Testing
The maximum mean discrepancy (MMD) test is a popular nonparametric test on general domains. Two lines of work have studied its optimality through structurally different approaches. The first, a convolution approach on $\mathbb{R}^d$, uses translation-invariant kernels with a shrinking bandwidth and is minimax optimal over Sobolev balls under $L^2$-separation; the second, a regularization approach...
TestBED: An Open-Source Toolkit for Bayesian Experimental Design
Bayesian experimental design (BED) is a principled framework for intelligent data acquisition with applications across a wide range of scientific and industrial domains. However, the development and adoption of BED remains hindered by a lack of standardised software and benchmarks. Existing methods are typically implemented in bespoke codebases and evaluated on a small subset of tasks, making...
Risk-Sensitive Non-Parametric and Kernel Bandits
We study non-parametric bandits in which arms are evaluated using Cumulative Prospect Theory (CPT) rather than expected reward. We consider continuous action spaces with arm-dependent noise and propose Non-Parametric CPT Bandits ($\mathtt{NPCB}$), an optimistic algorithm that decouples mean estimation from CPT-based decision-making. We prove CPT regret of order $\widetilde{\mathcal...
Towards the Query Complexity of Sampling under Strong Log-Concavity and Log-Sobolev Inequalities
We study the query complexity of sampling from smooth distributions on $\mathbb R^d$ using first-order oracles. For $d$-dimensional strongly log-concave targets with condition number $\kappa=2$, we prove that any randomized sampler requires $\exp({\Omega(\log^{1/3} d)})$ queries even from a constant warm start. This rules out polylogarithmic dimension dependence and strictly separates strongly...
Generative Modeling for Cascading Extremes via Autoregressive Transformers
Extreme events often occur sequentially, from earthquake-tsunami cascades to successive extreme losses in financial markets. We introduce an extremal token representation that encodes multivariate observations as a categorical sequence. A quiet token records the absence of threshold exceedances; otherwise, the token identifies the exceeding component with the largest marginal probability-scale...
Near-Minimax Sample Complexity for Multi-Objective Reinforcement Learning under Generative Models
In multi-objective reinforcement learning, preferences may be specified only after data collection, requiring one dataset to support a continuum of reward trade-offs. We study finite discounted Markov decision processes with unknown transitions, $S$ states, $A$ actions, and $m$ known reward functions taking values in $[0,1]$, given access to a generative model. The learner must provide an...
A Unified Framework for Training-Dataset Aggregation and Exact Machine Unlearning via Gibbs Probability Measures
In this paper, three operations on Gibbs probability measures are studied: renormalization, normalized log-linear combination, and nesting. The resulting measures are shown to be Gibbs probability measures with explicit expressions for their objective functions, reference measures, and regularization factors. These measures are further characterized as unique solutions to optimization problems...
Generalized Hyperrectangular Prediction Sets in Multivariate Conformal Prediction
In multivariate conformal prediction, many nonconformity scores yield prediction sets with complex geometry (e.g., ellipsoids or density level sets) that are difficult to interpret and visualize. Hyperrectangles offer a practical alternative by providing one interval per output. We extend this notion to Cartesian products of arbitrary one-dimensional sets, which we call generalized...
Statistical methodology
Inherited Local Shrinkage for Adaptive Functional Form Discovery
Statistical models frequently employ nonlinear effects, interactions, and multiresolution basis expansions to represent complex relationships between predictors and responses. Determining the appropriate level of model complexity, however, remains a fundamental challenge. This paper introduces \textit{Inherited Local Shrinkage} (ILS), a Bayesian global-local shrinkage framework for adaptive...
Online Control of the Family-wise Error Rate (FWER) for Multi-stage Platform Trials
In platform trials, multiple intervention arms can enter or leave the study at any time, which brings the challenge of how to control the type I error rate. Online testing procedures, where a stream of hypotheses are tested over time and the total number of hypotheses is unknown, might be a viable choice for error rate control in platform trials. Interim analyses in a multi-stage design offer the...
A latent space hidden Markov model for clustering views in longitudinal multilayer networks
We propose a Bayesian latent space model for clustering longitudinal multilayer networks in which network slices are represented by a finite set of recurrent latent regimes, each associated with a regime-specific latent geometric configuration. Layer-specific hidden Markov chains govern regime membership through a parsimonious additive transition model, allowing heterogeneous temporal dynamics...
Efficient estimation of regression models for recurrent events in presence of terminal events
Recurrent events are common in biomedical studies, and efficient methods are needed to analyse them, particularly when a terminal event may occur. Regression modelling of the marginal mean of recurrent events provides a simply interpretable approach, but standard estimation based on inverse probability of censoring weighting may not fully exploit observed event histories in multiple events...
All reweighted paths lead to Rome: Unification of reweighting schemes for stratified path sampling
Path sampling-based stratification algorithms such as Transition Interface Sampling (TIS) enable the evaluation of kinetic rate constants and mechanisms of complex molecular rare event transitions. By sampling only short dynamical trajectories, TIS allows constructing an estimate of the unbiased dynamics by reweighting the interface path ensembles. In the past decades several methods have been...
Time-Varying Tails: Estimation, Inference, and Risk Measurement
Motivated by evidence that the tails of economic and financial time series need not be stable over time, we develop a framework for studying time-varying tails. We model the extreme value index as a smooth function of time in the locally stationary framework of Zhou and Wu (2009). We estimate it by a ratio-form kernel Hill estimator in which a single intermediate quantile thresholds the whole...
Prior-data fitted networks for variable selection
Prior-data fitted networks (PFNs) have become state-of-the-art for tabular prediction but remain underexplored in other areas of statistics. In this work, we present two PFNs for Bayesian variable selection: CD-PFN identifies conditional dependencies, and PC-PFN identifies parents and children in a causal graph. Both networks estimate posterior inclusion probabilities (PIPs) without posterior...
Right, Wrong, or Unfinished: A Competing Risks Framework for Language-Model Reasoning under Token Budgets
Assessing language-model performance under a token budget requires understanding both when a response will finish and whether it will be correct. We develop Competing Risks Analysis of Token Expenditure in Reasoning (CRATER), a statistically principled framework that treats correct and incorrect completion as distinct competing event types and responses unfinished at the generation limit as...
Doubly robust win statistics for hierarchical survival endpoints in individual- and cluster-randomized trials
Prioritized composite endpoints compare trial participants according to a prespecified clinical hierarchy, and the win estimands are increasingly used to summarize treatment effects. When the component event times are right-censored, a pairwise comparison may remain unresolved, and treating unresolved pairs as ties yields a win statistic whose value depends on the censoring distribution. We...
Local Whittle estimation for distributional time series: A regularization framework in Bayes Hilbert space
We study local Whittle estimation of long memory in density-valued time series in Bayes Hilbert space. The centered log-ratio (clr) transformation maps densities to a linear Hilbert space, allowing analysis using standard Hilbert space methods. When densities are reconstructed from finite samples, however, small absolute estimation errors can remain large relative to the true density in...
Balance-Guided Forest for Causal Effect Estimation
Covariate balancing is widely used for estimating causal effects in observational studies. A central challenge is determining which covariate features should be balanced. Forest-kernel balancing provides a data-driven way to learn informative balancing features. Existing forest-kernel balancing methods first learn a tree-based representation and then construct balancing weights. However, this...
High-dimensional Four-Level Structured Functional Principal Component Analysis for Unbalanced Level Data with Application to Concussion Data
We implement the Structured Functional Principal Component Analysis (SFPCA) framework of Shou et al. (2015) in a four-level nested setting with arbitrarily unbalanced group sizes at every level of the hierarchy. While the SFPCA framework can in principle accommodate deeper hierarchical structures, practical implementations remain challenging when the number of curves is large and the hierarchy is...
Bayesian Superpopulation Models for Population-Based Diabetes Surveillance Using Multi-Site Electronic Health Record Data
Electronic health records (EHRs) are increasingly used for disease surveillance. However, data collected in EHRs may not be a representative sample of the target population for inference. Methods for EHR-based surveillance remain in their nascence. In addition to simple weighting approaches, researchers have used multilevel regression and poststratification (MRP), a popular technique for finite...
Geometric ergodicity of the block Gibbs sampler for Bayesian linear mixed models with scale mixtures of normal random effects
We study a Bayesian linear mixed model whose random effects follow a scale mixture of normal distributions with an arbitrary mixing distribution, a class that contains the Student-t, slash, contaminated normal, normal-generalized inverse Gaussian and Laplace laws. Conditionally conjugate priors lead to a three-block Gibbs sampler that alternates between the variance components, the latent...
A covariance density for a point process and a random field
The spatial point process literature offers a well-developed theory for characterizing covariances within a point process or between different point processes using joint intensity functions or cross joint intensity functions. However, similar summary statistics are missing for characterizing the covariance between a point process and a random field. We introduce a normalized mixed covariance...
Only titles, authors and the start of each abstract are shown here, as arXiv published them. Open a paper to read its whole abstract and, with your own AI key, a plain-language summary. Papers on arXiv are preprints and may not have been peer reviewed.
Data from arXiv, used through the arXiv API. Thank you to arXiv for use of its open access interoperability.