1: \begin{abstract}
2: Predicting sets of outcomes---instead of unique outcomes---is a promising solution to uncertainty quantification in statistical learning. Despite a rich literature on constructing prediction sets with statistical guarantees, adapting to unknown covariate shift---a prevalent issue in practice---poses a serious
3: unsolved challenge.
4: In this paper, we
5: show that prediction sets with finite-sample coverage guarantee are uninformative and
6: propose a novel flexible distribution-free method, PredSet-1Step, to efficiently construct prediction sets with an asymptotic coverage guarantee under unknown covariate shift.
7: We formally show that our method is \textit{asymptotically probably approximately correct}, having well-calibrated coverage error with high confidence for large samples.
8: We illustrate that it
9: achieves nominal
10: coverage in a number of experiments
11: and a data set concerning HIV risk prediction in a South African cohort study.
12: Our theory hinges on a new bound for the convergence rate of
13: the coverage of Wald confidence intervals based on general
14: asymptotically linear estimators.
15: \end{abstract}
16: