New on arXiv
Sort: by field | by arXiv number | trending
Machine learning (statistics)
Unifying Central Flow, Rod Flow, and the Edge Coupling
At the edge of stability, the iterates of gradient descent oscillate along the sharp directions of the Hessian. This poses a significant challenge for continuous-time models as the usual continuous-time approximation -- the gradient flow -- admits no oscillations. Several continuous-time models have been proposed to capture the behavior at the edge of stability, among them central flow and rod...
Series-wise Cross-validation for Global Time Series Forecasting
We consider the problem of cross-validation (CV) in time series forecasting, with a focus on global forecasting models based on deep learning. The prevailing CV strategy in forecasting is to partition data across time with the last part of each series used for testing. With global models trained on collections of time series, however, a fundamentally different approach becomes possible:...
Patch Attention Wisely: Understanding Patch Length in Attention-Based Forecasting
Attention-based time series forecasters commonly group consecutive observations into patches. Patch length is known to have a substantial impact on forecasting performance, yet its selection remains largely empirical. We develop a theoretical framework that explains why patch length matters for forecasting accuracy and provides a principled basis for its selection. For linear state-space models,...
Identifying Neural Dynamics Using Nonlinear Interventional State Space Models
State-space models (SSMs) recover low-dimensional latent dynamics from high-dimensional observations, but latents are generally not identifiable from observational data alone. Interventional state-space models (iSSMs) use perturbations to break observational symmetries and identify parameters up to permutation, scaling, and shift. However, prior work restricts identifiability to linear latent...
Joint Modeling of Conditional Mean and Variability in Multilevel Functional Data: Application to Postprandial Glucose Trajectories in the AEGIS Study
Functional data analysis provides a framework for studying time-varying associations between covariates and high-frequency biological signals. In digital health, participants often contribute repeated functional trajectories, yet existing multilevel regression methods largely focus on the conditional mean, overlooking variability and its role in biological heterogeneity. We propose a...
Network Effect Decomposition for Causal Effect Estimation under Network Interference
Estimating causal effects from observational network data requires accounting for both individual treatment and neighborhood exposure. Existing outcome models commonly incorporate these intervention variables into a joint predictor and estimate causal effects through prediction contrasts, leaving the corresponding response components implicit. We propose the $\underline{N}$etwork...
Neural Realized Measures: Forecast-Supervised Intraday Aggregation for Volatility Forecasting
High-frequency volatility forecasting typically separates measurement from prediction: intraday observations are first compressed into a daily realized measure using a fixed aggregation rule, and the resulting statistic is then passed to a forecasting model. This conventional pipeline therefore treats measure construction as forecast-agnostic preprocessing. We ask whether the aggregation stage...
Task-Calibrated Random Features via Influence-Based Error Cancellation
Random features approximate kernel integrals by Monte Carlo, yet only selected frequency-sampling errors affect a downstream task. We propose Task-Calibrated Random Features (TCRF), which balance frequency moments constructed from task-specific influence using weights shared across kernel entries. Closed-form weights coincide with classical minimum-distance calibration; the contribution is a...
ShapleyOG: Fast Adaptive Shapley Value Estimation with Odd Gaussian Processes
Shapley values are a central tool for attribution in machine learning. Since their exact computation requires evaluating the cooperative game to be explained on exponentially many player coalitions, they are typically estimated from a limited number of evaluations. Recently, ShaplEIG has shown that adaptively selecting the coalitions to evaluate substantially improves sample efficiency over...
Bayesian Tensor Train Kernel Machines with Automatic Model Complexity Inference
Tensor Network (TN) kernel machines accelerate supervised learning by using low-rank TNs to reduce computation and memory. However, most TN-based methods are deterministic with manually tuned ranks and feature dimensions, while the existing Bayesian TN kernel machine is restricted to the CANDECOMP/PARAFAC decomposition (CPD), whose single rank is shared by all modes. We extend this framework to...
ToroFit: Fitting Wedge Sums of Tori to High-Dimensional Data
Data arising in scientific applications often exhibits complex nonlinear structure. Identifying and parameterizing said nonlinearities can enable better modeling, enhance predictive analysis, data interpolation, denoising, and anomaly detection. In this paper, we develop theoretical and computational methods to detect and parametrize Euclidean point cloud data lying near a wedge sum of tori....
Statistical methodology
An Improved Minimization Method: Eliminating Shift and Variance Inflation While Maintaining Marginal Balance
Pocock and Simon's minimization method is a widely used approach for covariate-adaptive randomization in clinical trials. However, it can exhibit the shift problem under unequal allocation and variance inflation of the imbalances in additional covariates. In this paper, we propose a new minimization method that preserves the conventional biased-coin allocation probability while ensuring marginal...
Risk-matched case-control sampling and semiparametric weight calibration for efficient biomarker assessment with binary outcomes
Two-phase designs provide a cost-effective framework for biomarker studies and have been widely used to reduce the burden of collecting expensive biomarker measurements. Most methodological research has focused on efficient Phase II sampling and estimation of biomarker--outcome associations. A natural subsequent step, however, is to incorporate identified biomarkers into risk prediction models,...
Bounded GARCH Processes
We propose a novel class of Bounded GARCH (B-GARCH) processes designed to characterise the conditional heteroskedasticity of continuous time series constrained within a compact interval. While standard GARCH specifications are tailored for R-valued data, many empirical series, such as realised correlation, unemployment rates, expenditure shares, and relative humidity, are bounded. Fitting a...
Between Hi-Fi and MMI: the overlap of redundancy and synergy in partial information decomposition
Partial information decomposition (PID) splits the information that two sources carry about a target into redundant, unique and synergistic parts, with nonnegative decompositions lying on a segment where redundancy measures are bounded by the positive part of the co-information and the smaller source-target information. We parameterize this segment by the overlap, the common excess of redundancy...
Doubly-robust causal inference for multi-valued treatment regimes with recurrent neural networks
We propose a doubly-robust method to estimate the causal effects of multi-valued treatment regimes on patient outcomes. A multi-valued treatment regime assigns personalized treatments from a set of competing options based on a patient's history. Existing methods for optimal treatment regimes are largely limited to binary or continuous treatments. We extend the longitudinal targeted minimum...
Intensity-Based Estimation of Extreme Value Models for Highly Censored Data via a Latent Poisson Process
Extreme value theory provides a natural framework for modelling rare events and extrapolating tail probabilities, but its direct application to survival analysis is complicated by right censoring, heterogeneous follow-up, and the need for coherent inference beyond the range of the observed data. We propose a Bayesian survival model that integrates extreme value theory with a hazard-based...
Generalized confidence intervals for the covariate-specific overlap coefficient
Continuous diagnostic tests are often used to discriminate between diseased and healthy populations. Therefore, it is important to look for measures to assess the effectiveness of diagnostic markers in discriminating between these two states. The overlap coefficient (OVL), which is defined as the area of intersection of the graphs of two probability density functions, is considered as a summary...
CountScan: Simultaneous Lower Bounds on Historical Watermark Matches over All Text Intervals
A provider holding a watermark key may audit an external document and choose passages after reading it. A bound computed for a fixed passage is not valid for a passage chosen after seeing the evidence. One remedy splits the evidence between selection and validation. We take the other route and make the statement hold for every interval at once. CountScan gives finite-sample lower bounds on the...
MSR-CP: A Modified Segmented Regression Approach to Change Point Estimation in Rainfall Patterns in West Bengal
This study presents a methodology for detecting change point in precipitation series using a smooth version of segmented regression model. We examine several existing change point detection methods and identify their limitations in capturing gradual changes commonly observed in climate data. To address these limitations, we discuss an extension of the traditional segmented regression model...
Identification and Bounding of Joint Expectation over Potential Outcomes
The joint expectation of functions of potential outcomes $(Y_1,Y_0)$ is a fundamental quantity in causal inference, particularly when investigating the variation or heterogeneity of causal effects. This paper provides novel assumptions for their identification: comonotonicity and countercomonotonicity. These assumptions offer a unified framework for their identification across discrete,...
Adaptive Experimentation Can Hide Model Error:Detection Limits and Falsification Budget
An experiment can be informative about the parameters of a working model and uninformative about whether that model is wrong. Adaptive design can reinforce this mismatch by repeatedly selecting settings where an incorrect model fits. We bound the power of any valid adequacy test in terms of the experimenter's own sampling distribution, then distinguish information absent from the selected data...
marp: Model-Averaged Inference for Parametric Renewal Processes in R
Renewal processes model inter-event times between recurrent events using a parametric distribution, but selecting a single model can ignore model uncertainty and affect inference, particularly in small samples. This paper introduces marp, an R package for model-averaged inference in parametric renewal processes. The package fits six commonly used distributions, compares them using Akaike and...
Statistical and Privacy Guarantees for Deep M-Regression via Stochastic Gradient Langevin Dynamics
In this article, we study deep nonparametric regression trained via stochastic gradient Langevin dynamics (SGLD), a variant of stochastic gradient descent that injects carefully calibrated Gaussian noise during optimization. Using a PAC-Bayesian analysis tailored to deep ReLU networks, we establish an excess-risk bound that simultaneously accounts for network approximation error, statistical...
Inference after selection on randomized p-values
We consider inference on parameters and hypotheses selected using p-values. We provide a simple procedure to decompose a p-value into two components, one for inference and one for selection, that are independent under the null hypothesis. To control the Type 1 error rate conditional on selection of the null hypothesis from randomized p-values, we develop tests motivated by the selective inference...
Changepoint localization via nested exchangeability tests: from point estimates to confidence intervals
We study distribution-free uncertainty quantification for a changepoint estimate in an offline setting. We observe a sequence with a single changepoint and are given an estimate of its location. The pre- and post-change segments are independent and each consists of i.i.d. (or, more generally, exchangeable) observations from arbitrary and unknown distributions. We introduce Changepoint...
A Unified Coordinate Descent Framework for Penalized Longitudinal Log-Contrast Quantile Regression
Quantile regression characterizes heterogeneous covariate effects across the response distribution, but its extension to high-dimensional longitudinal compositional data poses substantial challenges, such as the nonsmooth check loss, the unit-sum structure of compositional covariates. Existing work is confined to Lasso penalization, and does not readily extend to nonconvex penalties. We propose...
When Do Sports Leagues Stop Being Competitive? Bayesian Detection of Competitive-Balance Eras from Match-Level Data
Competitive balance shapes outcome uncertainty, fan interest, and league regulation, yet standard measures summarize realized standings and cannot separate structural ability differences from match-level randomness. We develop a Bayesian framework that infers structural competitive balance from longitudinal match outcomes. Team abilities are obtained by projecting Gaussian auxiliary variables...
Clouded Representatives and Score Matching for Distributed Quantile Regression
Quantile regression is widely used in high-stakes applications where the data are distributed across many sites and the individual records cannot be shared. The existing distributed methods for quantile regression typically require homogeneous sites, large sites, or synchronous communication, which are rarely all satisfied in practice. In this paper, we propose a new method named cloudqr. Each...
Neyman Orthogonalized Specification Tests for Conditional Tail Index Models
We develop specification tests for parametric conditional tail index models of heavy-tailed distributions. The tests are based on a projected empirical process that removes the first-order effect of estimating the null parameter. Within the conditional Hall class, we identify conditions under which projection also eliminates the leading Pareto approximation bias in the test process, permitting...
Sample size calculation comparing two survival curves in the presence of nonproportional hazards utilizing the concept of Weighted Relative Time using two different Weibull distributions
Sample size calculations in two-arm clinical trials with survival endpoint often utilize the proportional hazards (PH) assumption. In case of nonproportional hazards (NPH), much research is ongoing with some newer methods developed that work well in specific scenarios. Recent developments have considered the nonparametric Max-Combo logrank test for both design and analysis of survival data with...
dsp: An R Package for Bayesian Time Series Modeling with the Dynamic Shrinkage Process
dsp provides a unified state-space framework for modeling nonstationary time series using the Dynamic Shrinkage Process (DSP), a class of global-local shrinkage priors. DSP adaptively regularizes time-varying parameters to shrink noise while preserving abrupt changes and other local structure. The package supports Gaussian and count-data smoothing, changepoint detection, time-varying parameter...
Only titles, authors and the start of each abstract are shown here, as arXiv published them. Open a paper to read its whole abstract and, with your own AI key, a plain-language summary. Papers on arXiv are preprints and may not have been peer reviewed.
Data from arXiv, used through the arXiv API. Thank you to arXiv for use of its open access interoperability.