$k$-center Clustering under Perturbation Resilience

Maria-Florina Balcan, Nika Haghtalab, Colin White

Introduction

Clustering is a fundamental problem in combinatorial optimization with a wide range of applications including bioinformatics, computer vision, text analysis, and countless others. The underlying goal is to partition a given set of points to maximize similarity within a partition and minimize similarity across different partitions. A common approach to clustering is to consider an objective function over all possible partitionings and seek solutions that are optimal according to the objective. Given a set of points (and a distance metric), common clustering objectives include finding kk centers to minimize the sum of the distance from each point to its closest center (kk-median), or to minimize the maximum distance from a point to its closest center (kk-center).

Traditionally, the theory of clustering (and more generally, the theory of algorithms) has focused on the analysis of worst-case instances (Arya et al., 2004; Byrka et al., 2015; Charikar et al., 1999, 2001; Chen, 2008; Gonzalez, 1985; Makarychev et al., 2016). For example, it is well known the popular objective functions are provably NP-hard to optimize exactly or even approximately (APX-hard) (Gonzalez, 1985; Jain et al., 2002; Lee et al., 2017), so research has focused on finding approximation algorithms. While this perspective has led to many elegant approximation algorithms and lower bounds for worst-case instances, it is often overly pessimistic of an algorithm’s performance on “typical” instances or real world instances. A rapidly developing line of work in the algorithms community, the so-called beyond worst-case analysis of algorithms (BWCA), considers the design and analysis of problem instances under natural structural properties which may be satisfied in real-world applications. For example, the popular notion of α\alpha-perturbation resilience, introduced by Bilu and Linial (2012), considers instances such that the optimal solution does not change when the input distances are allowed to increase by up to a factor of α\alpha. The goals of BWCA are twofold: (1) to design new algorithms with strong performance guarantees under the added assumptions (Balcan et al., 2013; Hardt and Roth, 2013; Kumar et al., 2004; Roughgarden, 2014), and (2) to prove strong guarantees under BWCA assumptions for existing algorithms used in practice (Makarychev et al., 2014; Ostrovsky et al., 2012; Spielman and Teng, 2004). An example of goal (1) is a series of work focused on finding exact algorithms for kk-median, kk-means, and kk-center clustering under α\alpha-perturbation resilience (Awasthi et al., 2012; Balcan and Liang, 2016; Angelidakis et al., 2017). The goal in this line of work is to find the minimum value of α≥1\alpha\geq 1 for which optimal clusterings of α\alpha-perturbation resilient instances can be found efficiently. Two examples of goal (2) are as follows. Ostrovsky et al. showed that kk-means++ outputs a near-optimal clustering, as long as the data satisfies a natural clusterability criterion (Ostrovsky et al., 2012), and Spielman and Teng (2004) established the expected runtime of the simplex method is O(n)O(n) under smoothed analysis.

In approaches for answering goals (1) and (2), researchers have developed an array of sophisticated tools exploiting the structural properties of such instances leading to algorithms which can output the optimal solution. However, overly exploiting a BWCA assumption can lead to algorithms that perform poorly when the input data does not exactly satisfy the given assumption. Indeed, recent analyses and technical tools are susceptible to small deviations from the BWCA assumptions which can propagate when just a small fraction of the data does not satisfy the assumption. For example, some recent algorithms make use of a dynamic programming subroutine which crucially need the entire instance to satisfy the specific structure guaranteed by the BWCA assumption. To continue the efforts of BWCA in bridging the theory-practice gap, it is essential to study algorithms whose guarantees degrade gracefully to address scenarios that present mild deviations from the standard BWCA assumptions. Another downside of existing approaches is that BWCA assumptions are often not efficiently verifiable. This creates a catch-22 scenario: it is only useful to run the algorithms if the data satisfies certain assumptions, but a user cannot check these assumptions efficiently. For example, by nature of α\alpha-perturbation resilience (that the optimal clustering does not change under all α\alpha-perturbations of the input), it is not known how to test this condition without computing the optimal clustering over Ω(2n)\Omega\left(2^{n}\right) different perturbations. To alleviate these issues, in this work we also focus on what we propose should be a third goal for BWCA: to show (new or existing) algorithms whose performance degrades gracefully on instances that only partially meet the BWCA assumptions.

In this work, we address goals (1), (2), and (3) of BWCA by providing robust algorithms which give the optimal solution under perturbation resilience, and also perform well when the data is partially perturbation resilient, or not at all perturbation resilient. These algorithms act as an interpolation between worst-case and beyond worst-case analysis. We focus on the symmetric/asymmetric kk-center objective under perturbation resilience. Our algorithms simultaneously output the optimal clusters from the stable regions of the data, while achieving state-of-the-art approximation ratios over the rest of the data. In most cases, our algorithms are natural modifications to existing approximation algorithms, thus achieving goal (2) of BWCA. To achieve these two-part guarantees, we define the notion of perturbation resilience on a subset of the datapoints. All prior work has only studied perturbation resilience as it applies to the entire dataset. Informally, a subset S′⊆SS^{\prime}\subseteq S satisfies α\alpha-perturbation resilience if all points v∈S′v\in S^{\prime} remain in the same optimal cluster under any α\alpha-perturbation to the input. We show that our algorithms return all optimal clusters from these locally stable regions. Most of our results also apply under the recently defined, weaker condition of α\alpha-metric perturbation resilience (Angelidakis et al., 2017), which states that the optimal solution cannot change under the metric closure of any α\alpha-perturbation. We list all our results in Table 1, and give a summary of the results and techniques below.

In Section 3, we show that any 2-approximation algorithm for kk-center will always return the clusters satisfying 22-perturbation resilience. Therefore, since there are well-known 2-approximation algorithms for symmetric kk-center, our analysis shows these will output the optimal clustering under 2-perturbation resilience. For asymmetric kk-center, we give a new algorithm which outputs the optimal clustering under 2-perturbation resilience. It works by first computing the “symmetrized set”, or the points which demonstrate a rough symmetry. We show how to optimally cluster the symmetrized set, and then we show how to add back the highly asymmetric points into their correct clusters.

In Section 3.2.2, we prove there is no polynomial time algorithm for symmetric kk-center under (2−δ)(2-\delta)-perturbation resilience unless NP=RPNP=RP, which shows that our perturbation resilience results are tight for both symmetric and asymmetric kk-center. In particular, it implies that we have identified the exact moment (α=2\alpha=2) where the problem switches from efficiently computable to NP-hard, for both symmetric and asymmetric kk-center. For this hardness result, we use a reduction from a variant of perfect dominating set. To show that this variant is itself hard, we construct a chain of parsimonious reductions (reductions which conserve the number of solutions) from 3-dimensional matching to perfect dominating set.

Our upper bound for asymmetric kk-center under 2-PR and lower bound for symmetric kk-center under (2−δ)(2-\delta)-PR illustrate a surprising relationship between symmetric and asymmetric kk-center instances under perturbation resilience. Unlike approximation ratio, for which symmetric kk-center is easily solved to a factor of 2 but asymmetric kk-center cannot be approximated to any constant factor, both symmetric and asymmetric kk-center can be solved optimally under resilience to 2-perturbations. Overall, this is the first tight result quantifying the power of perturbation resilience for a canonical combinatorial optimization problem.

In Section 5, we apply our results from Section 3 to the local perturbation resilience setting. For symmetric kk-center, we show that any 2-approximation outputs all optimal clusters from 2-perturbation resilient regions. For asymmetric kk-center, we design a new algorithm based off of the worst-case O(log⁡∗n)O(\log^{*}n) approximation algorithm due to Vishwanathan (1996), which is tight (Chuzhoy et al., 2005). We give new insights into this algorithm, which allow us to show a modification of the algorithm which outputs all optimal clusters from 2-perturbation resilient regions, while keeping the worst-case O(log⁡∗n)O(\log^{*}n) guarantee overall. If the entire dataset satisfies 2-perturbation resilience, then our algorithm outputs the optimal clustering. We combine the tools of Vishwanathan with the perturbation resilience assumption to prove this two-part guarantee. Specifically, we use the notion of a center-capturing vertex (CCV), which is used in the first phase of the approximation algorithm to pull out supersets of clusters. We show that each optimal center from a 2-perturbation resilient subset is a CCV and satisfies a separation property; we prove this by carefully constructing a 2-perturbation in which points from other clusters cannot be too close to the center without causing a contradiction. The structure allows us to modify the approximation algorithm of Vishwanathan (1996) to ensure that optimal clusters from perturbation resilient subsets are pulled out separately in the first phase. All of our guarantees hold under the weaker notion of metric perturbation resilience.

In Section 6, we consider (α,ϵ)(\alpha,\epsilon)-perturbation resilience, which states that at most ϵn\epsilon n total points can swap into or out of each cluster under any α\alpha-perturbation. For symmetric kk-center, we show that any 2-approximation algorithm will return the optimal clusters from (3,ϵ)(3,\epsilon)-perturbation resilient regions, assuming a mild lower bound on optimal cluster sizes, and for asymmetric kk-center, we give an algorithm which outputs a clustering that is ϵ\epsilon-close to the optimal clustering. Our main structural tool is showing that if any single point vv is close to an optimal cluster other than its own, then k−1k-1 centers achieve the optimal radius under a carefully constructed 3-perturbation. Any other point we add to the set of centers must create a clustering that is ϵ\epsilon-close to the optimal clustering, and we show all of these sets cannot simultaneously be consistent with one another, thus causing a contradiction. A key concept in our analysis is defining the notion of a cluster-capturing center, which allows us to reason about which points can capture a cluster when its center is removed.

2 Related work

There are three classic 2-approximations for kk-center from the 1980’s (Gonzalez, 1985; Hochbaum and Shmoys, 1985; Dyer and Frieze, 1985), which are known to be tight (Hochbaum and Shmoys, 1985). Asymmetric kk-center proved to be a much harder problem. The first nontrivial result was an O(log⁡∗n)O(\log^{*}n) approximation algorithm (Vishwanathan, 1996), and this was later improved to O(log⁡∗k)O(\log^{*}k) (Archer, 2001). This result was later proven to be asymptotically tight (Chuzhoy et al., 2005).

The first constant-factor approximation algorithm for kk-median was given by Charikar et al. (1999), and the current best approximation ratio is 2.675 by Byrka et al. (2015). Jain et al. (2002) proved kk-median is NP-hard to approximate to a factor better than 1.73.

Perturbation resilience was introduced by Bilu and Linial (2012), who showed algorithms that outputted the optimal solution for max cut under Ω(n)\Omega(\sqrt{n})-perturbation resilience (this was later improved by Makarychev et al. (2014)). The study of clustering under perturbation resilience was initiated by Awasthi et al. (2012), who provided an optimal algorithm for center-based clustering objectives (which includes kk-median, kk-means, and kk-center clustering, as well as other objectives) under 3-perturbation resilience. This result was improved by Balcan and Liang (2016), who showed an algorithm for center-based clustering under (1+2)(1+\sqrt{2})-perturbation resilience. They also gave a near-optimal algorithm for kk-median under (2+3,ϵ)(2+\sqrt{3},\epsilon)-perturbation resilience when the optimal clusters are not too small.

Recently, Angelidakis et al. (2017) gave algorithms for center-based clustering (including kk-median, kk-means, and kk-center) under 2-perturbation resilience, and defined the more general notion of metric perturbation resilience, although their algorithm does not extend to the (α,ϵ)(\alpha,\epsilon)-perturbation resilience or local perturbation resilience settings. Cohen-Addad and Schwiegelshohn (2017) showed that local search outputs the optimal kk-median, kk-means, and kk-center solution when the data satisfies a stronger variant of 3-perturbation resilience, in which both the optimal clustering and optimal centers are not allowed to change under any 3-perturbation. Perturbation resilience has also been applied to other problems, such as min multiway cut, the traveling salesman problem, finding Nash equilibria, metric labeling, and facility location (Makarychev et al., 2014; Mihalák et al., 2011; Balcan and Braverman, 2017; Lang et al., 2017; Manthey and Tijink, 2018).

Vijayaraghavan et al. (2017) study kk-means under additive perturbation resilience, in which the optimal solution cannot change under additive perturbations to the input distances. Deshpande et al. (2018) gave an algorithm for Euclidean kk-means under perturbation resilience which runs in time linear in nn and the dimension dd, and exponentially in kk and 1α−1\frac{1}{\alpha-1}. Chekuri and Gupta (2018) showed the natural LP relaxation of kk-center and asymmetric kk-center is integral for 2-perturbation resilient instances. They also define a new model of perturbation resilience for clustering with outliers, and they show the algorithm of Angelidakis et al. (2017) exactly solves clustering with outliers under 2-perturbation resilience, and they further show the natural LP relaxation for kk-center with outliers is integral for 2-perturbation resilient instances. Their algorithms have the desirable property that either they output the optimal solution, or they guarantee the input did not satisfy 2-perturbation resilience (but note this is not the same thing as determining whether or not a given instance satisfies perturbation resilience).

A related notion, approximation stability (Balcan et al., 2013), states that any (1+α)(1+\alpha)-approximation to the objective must be ϵ\epsilon-close to the target clustering. There are several positive results for kk-means, kk-median (Balcan et al., 2013, 2009; Gupta et al., 2014), and min-sum (Balcan et al., 2013; Balcan and Braverman, 2009; Voevodski et al., 2011) under approximation stability. Ostrovsky et al. (2012) show how to efficiently cluster instances in which the kk-means clustering cost is much lower than the (k−1)(k-1)-means cost. Kumar and Kannan (2010) give an efficient clustering algorithm for instances in which the projection of any point onto the line between its cluster center to any other cluster center is a large additive factor closer to its own center than the other center. This result was later improved along multiple axes by Awasthi and Sheffet (2012). There are many other works that show positive results for different natural notions of stability in various settings (Arora et al., 2012; Awasthi et al., 2010; Gupta et al., 2014; Hardt and Roth, 2013; Kumar and Kannan, 2010; Kumar et al., 2004; Roughgarden, 2014).

Preliminaries and basic properties

Some of our results assume distance functions which are metrics, and some of our results assume asymmetric distance functions. A distance function dd is a metric if

for all u,vu,v, d(u,v)=0d(u,v)=0 if and only if u=vu=v,

for all u,v,wu,v,w, d(u,w)≤d(u,v)+d(v,w)d(u,w)\leq d(u,v)+d(v,w), and

An asymmetric distance function satisifies (1), (2), and (3), but not (4).

Now we formally define perturbation resilience, a notion introduced by Bilu and Linial (2012). d′d^{\prime} is called an α\alpha-perturbation of the distance function dd, if for all u,v∈Su,v\in S, d(u,v)≤d′(u,v)≤αd(u,v)d(u,v)\leq d^{\prime}(u,v)\leq\alpha d(u,v). We only consider perturbations in which the distances increase because without loss of generality we can scale the distances to simulate decreasing distances.

(Perturbation resilience) A clustering instance (S,d)(S,d) satisfies α\alpha-perturbation resilience (α\alpha-PR) if for any α\alpha-perturbation d′d^{\prime} of dd, the optimal clustering C′\mathcal{C^{\prime}} under d′d^{\prime} is unique and equal to OPT\mathcal{OPT}.

Note that the optimal centers might change under an α\alpha-perturbation, but the optimal clustering must stay the same. We also consider a relaxed variant of α\alpha-perturbation resilience, called (α,ϵ)(\alpha,\epsilon)-perturbation resilience, that allows a small change in the optimal clustering when distances are perturbed. We say that two clusterings C\mathcal{C} and C′\mathcal{C}^{\prime} are ϵ\epsilon-close if min⁡σ∑i=1k∣Ci∖Cσ(i)′∣≤ϵn\min_{\sigma}\sum_{i=1}^{k}\left|C_{i}\setminus C_{\sigma(i)}^{\prime}\right|\leq\epsilon n, where σ\sigma is a permutation on [k][k].

((α,ϵ)(\alpha,\epsilon)-perturbation resilience) A clustering instance (S,d)(S,d) satisfies (α,ϵ)(\alpha,\epsilon)-perturbation resilience if for any α\alpha-perturbation d′d^{\prime} of dd, any optimal clustering C′\mathcal{C}^{\prime} under d′d^{\prime} is ϵ\epsilon-close to OPT\mathcal{OPT}.

In Definitions 2.1 and 2.2, we do not assume that the α\alpha-perturbations satisfy the triangle inequality. Angelidakis et al. (2017) recently studied the weaker definition in which the α\alpha-perturbations must satisfy the triangle inequality, called metric perturbation resilience. We can update these definitions accordingly. For symmetric clustering objectives, α\alpha-metric perturbations are restricted to metrics. For asymmetric clustering objectives, the α\alpha-metric perturbations must satisfy the directed triangle inequality.

(Metric perturbation resilience) A clustering instance (S,d)(S,d) satisfies α\alpha-metric perturbation resilience (α\alpha-MPR) if for any α\alpha-metric perturbation d′d^{\prime} of dd, the optimal clustering C′\mathcal{C^{\prime}} under d′d^{\prime} is unique and equal to OPT\mathcal{OPT}.

In our arguments, we will sometimes convert a non-metric perturbation d′d^{\prime} into a metric perturbation by taking the metric completion d′′d^{\prime\prime} of d′d^{\prime} (also referred to as the shortest-path metric on d′d^{\prime}) by setting the distances in d′′d^{\prime\prime} as the length of the shortest path on the graph whose edges are the lengths in d′d^{\prime}. Note that for all u,vu,v, we have d(u,v)≤d′′(u,v)d(u,v)\leq d^{\prime\prime}(u,v) since dd was originally a metric.

Now we define perturbation resilience for an optimal cluster rather than the entire dataset. All prior work has considered perturbation resilience with respect to the entire dataset.

(Local perturbation resilience) Given a clustering instance (S,d)(S,d) with optimal clustering C={C1,…,Ck}\mathcal{C}=\{C_{1},\dots,C_{k}\}, an optimal cluster CiC_{i} satisfies α\alpha-perturbation resilience (α\alpha-PR) if for any α\alpha-perturbation d′d^{\prime} of dd, the optimal clustering C′\mathcal{C}^{\prime} under d′d^{\prime} is unique and contains CiC_{i}.

As a sanity check, we show that a clustering is perturbation resilient if and only if every optimal cluster satisfies perturbation resilience.

A clustering instance (S,d)(S,d) satisfies α\alpha-PR if and only if each optimal cluster satisfies α\alpha-PR.

Given a clustering instance (S,d)(S,d), the forward direction follows by definition: assume (S,d)(S,d) satisfies α\alpha-PR, and given an optimal cluster CiC_{i}, then for each α\alpha-perturbation d′d^{\prime}, the optimal clustering stays the same under d′d^{\prime}, therefore CiC_{i} is contained in the optimal clustering under d′d^{\prime}. Now we prove the reverse direction. Given a clustering instance with optimal clustering C\mathcal{C}, and given an α\alpha-perturbation d′d^{\prime}, let the optimal clustering under d′d^{\prime} be C′\mathcal{C}^{\prime}. For each Ci∈CC_{i}\in\mathcal{C}, by assumption, CiC_{i} satisfies α\alpha-PR, so Ci∈C′C_{i}\in\mathcal{C}^{\prime}. Therefore C=C′\mathcal{C}=\mathcal{C}^{\prime}. ∎

Next we define the local version of (α,ϵ)(\alpha,\epsilon)-PR.

(Local (α,ϵ)(\alpha,\epsilon)-perturbation resilience) Given a clustering instance (S,d)(S,d) with optimal clustering C={C1,…,Ck}\mathcal{C}=\{C_{1},\dots,C_{k}\}, an optimal cluster CiC_{i} satisfies (α,ϵ)(\alpha,\epsilon)-PR if for any α\alpha-perturbation d′d^{\prime} of dd, the optimal clustering C′\mathcal{C}^{\prime} under d′d^{\prime} contains a cluster Ci′C_{i}^{\prime} which is ϵ\epsilon-close to CiC_{i}.

In Sections 5 and 6, we will consider a slightly stronger notion of local perturbation resilience. Informally, an optimal cluster satisfies α\alpha-strong local perturbation resilience if it is α\alpha-PR, and all nearby optimal clusters are also α\alpha-PR. We will sometimes be able to prove guarantees for clusters satisfying strong local perturbation resilience which are not true under standard local perturbation resilience.

(Strong local perturbation resilience) Given a clustering instance (S,d)(S,d) with optimal clustering C={C1,…,Ck}\mathcal{C}=\{C_{1},\dots,C_{k}\}, an optimal cluster CiC_{i} satisfies α\alpha-strong local perturbation resilience (α\alpha-SLPR) if for each jj such that there exists u∈Ciu\in C_{i}, v∈Cjv\in C_{j}, and d(u,v)≤r∗d(u,v)\leq r^{*}, then CjC_{j} is α\alpha-PR (any cluster that is close to CiC_{i} must be α\alpha-PR).

To conclude this section, we state a lemma for asymmetric (and symmetric) kk-center which allows us to reason about a specific class of α\alpha-perturbations which will be important throughout the paper. We give two versions of the lemma, each of which will be useful in different sections of the paper.

Given a clustering instance (S,d)(S,d) and α≥1\alpha\geq 1,

assume we have an α\alpha-perturbation d′d^{\prime} of dd with the following property: for all p,qp,q, if d(p,q)≥r∗d(p,q)\geq r^{*} then d′(p,q)≥αr∗d^{\prime}(p,q)\geq\alpha r^{*}. Then the optimal cost under d′d^{\prime} is αr∗\alpha r^{*}.

assume we have an α\alpha-perturbation d′d^{\prime} of dd with the following property: for all u,vu,v, either d′(u,v)=min⁡(αr∗,αd(u,v))d^{\prime}(u,v)=\min(\alpha r^{*},\alpha d(u,v)) or d′(u,v)=αd(u,v)d^{\prime}(u,v)=\alpha d(u,v). Then the optimal cost under d′d^{\prime} is αr∗\alpha r^{*}.

Assume there exists a set of centers C′={c1′,…,ck′}C^{\prime}=\{c_{1}^{\prime},\dots,c_{k}^{\prime}\} whose kk-center cost under d′d^{\prime} is <αr∗<\alpha r^{*}. Then for all ii and s∈VorC′,d′(ci′)s\in\text{Vor}_{C^{\prime},d^{\prime}}(c_{i}^{\prime}), d′(ci′,s)<αr∗d^{\prime}(c_{i}^{\prime},s)<\alpha r^{*}, implying d(ci′,s)<r∗d(c_{i}^{\prime},s)<r^{*} by construction. It follows that the kk-center cost of C′C^{\prime} under dd is r∗r^{*}, which is a contradiction. Therefore, the optimal cost under d′d^{\prime} must be αr∗\alpha r^{*}.

Given u,vu,v such that d(u,v)≥r∗d(u,v)\geq r^{*}, then d′(u,v)≥αr∗d^{\prime}(u,v)\geq\alpha r^{*} by construction. Now the proof follows from part one.

k𝑘k-center under perturbation resilience

In this section, we provide efficient algorithms for finding the optimal clustering for symmetric and asymmetric instances of kk-center under 22-perturbation resilience. Our results directly improve on the result by Balcan and Liang (2016) for symmetric kk-center under (1+2)(1+\sqrt{2})-perturbation resilience. We also show that it is NP-hard to recover OPT\mathcal{OPT} even for symmetric kk-center instance under (2−δ)(2-\delta)-perturbation resilience. As an immediate consequence, our results are tight for both symmetric and asymmetric kk-center instances. This is the first problem for which the exact value of perturbation resilience is found (α=2\alpha=2), where the problem switches from efficiently computable to NP-hard.

First, we show that any α\alpha-approximation algorithm returns the optimal solution for α\alpha-perturbation resilient instances. An immediate consequence is an algorithm for symmetric kk-center under 2-perturbation resilience. Next, we provide a novel algorithm for asymmetric kk-center under 2-perturbation resilience. Finally, we show hardness of kk-center under (2−δ)(2-\delta)-PR.

The following theorem shows that any α\alpha-approximation algorithm for kk-center will return the optimal solution on clustering instances that are α\alpha-perturbation resilient.

Given a clustering instance (S,d)(S,d) satisfying α\alpha-perturbation resilience for asymmetric kk-center, and a set CC of kk centers which is an α\alpha-approximation, i.e., ∀p∈S\forall p\in S, ∃c∈C\exists c\in C such that d(c,p)≤αr∗d(c,p)\leq\alpha r^{*}, then the Voronoi partition induced by CC is the optimal clustering.

For a point p∈Sp\in S, let c(p):=argminc∈Cd(c,p)c(p):=\text{argmin}_{c\in C}d(c,p), the closest center in CC to pp. The idea is to construct an α\alpha-perturbation in which CC is the optimal solution by increasing all distances except between pp and c(p)c(p), for all pp. Then the theorem will follow by using the definition of perturbation resilience.

By assumption, ∀p∈S\forall p\in S, d(c(p),p)≤αr∗d(c(p),p)\leq\alpha r^{*}. Create a perturbation d′d^{\prime} as follows. Increase all distances by a factor of α\alpha, except for all p∈Sp\in S, set d′(c(p),p)=min⁡(αd(c(p),p),αr∗)d^{\prime}(c(p),p)=\min(\alpha d(c(p),p),\alpha r^{*}) (recall in Definition 2.1, the perturbation need not satisfy the triangle inequality). Then no distances were increased by more than a factor of α\alpha. And since we had that d(c(p),p)≤αr∗d(c(p),p)\leq\alpha r^{*}, no distances decrease either. Therefore, d′d^{\prime} is an α\alpha-perturbation of dd. By Lemma 2.8, the optimal cost for d′d^{\prime} is αr∗\alpha r^{*}. Also, CC achieves cost ≤αr∗\leq\alpha r^{*} by construction, so CC is an optimal set of centers under d′d^{\prime}. Then by α\alpha-perturbation resilience, the Voronoi partition induced by CC under d′d^{\prime} is the optimal clustering.

Finally, we show the Voronoi partition of CC under dd is the same as the Voronoi partition of CC under d′d^{\prime}. Given p∈Sp\in S whose closest point in CC is c(p)c(p) under dd, then under d′d^{\prime}, all distances from pp to C∖{c(p)}C\setminus\{c(p)\} increased by exactly α\alpha, and d(p,c(p))d(p,c(p)) increased by ≤α\leq\alpha. Therefore, the closest point in CC to pp under d′d^{\prime} is still c(p)c(p). ∎

2 k𝑘k-center under 2-PR

An immediate consequence of Theorem 3.1 is that we have an exact algorithm for symmetric kk-center under 2-perturbation resilience by running a simple 2-approximation algorithm (e.g., (Gonzalez, 1985; Hochbaum and Shmoys, 1985; Dyer and Frieze, 1985)). However, Theorem 3.1 only gives an algorithm for asymmetric kk-center under O(log⁡∗(k))O(\log^{*}(k))-perturbation resilience. Next, we show it is possible to substantially improve the latter result.

One of the challenges involved in dealing with asymmetric kk-center instances is the fact that even though for all p∈Cip\in C_{i}, d(ci,p)≤r∗d(c_{i},p)\leq r^{*}, the reverse distance, d(p,ci)d(p,c_{i}), might be arbitrarily large. Such points for which d(p,ci)≫r∗d(p,c_{i})\gg r^{*} pose a challenge to the structure of the clusters, as they can be very close to points or even centers of other clusters. To deal with this challenge, we first define a set of “good” points, AA, such that A={p∣∀q,d(q,p)≤r∗  ⟹  d(p,q)≤r∗}A=\{p\mid\forall q,d(q,p)\leq r^{*}\implies d(p,q)\leq r^{*}\}. A “good” point is referred to as a center-capturing vertex in other works, e.g., (Vishwanathan, 1996). We formally define this notion in Section 5. Intuitively speaking, these points behave similarly to a set of points with symmetric distances up to a distance r∗r^{*}. To explore this, we define a desirable property of AA with respect to the optimal clustering.

AA is said to respect the structure of OPT\mathcal{OPT} if

(2) for all p∈S∖Ap\in S\setminus A, if A(p):=arg⁡min⁡q∈Ad(q,p)∈CiA(p):=\arg\min_{q\in A}d(q,p)\in C_{i}, then p∈Cip\in C_{i}.

For all ii, define Ci′=Ci∩AC_{i}^{\prime}=C_{i}\cap A (which is in fact the optimal clustering of AA). Satisfying Definition 3.2 implies that if we can optimally cluster AA, then we can optimally cluster the entire instance (formalized in Theorem 3.5). Thus our goal is to show that AA does indeed respect the structure of OPT\mathcal{OPT}, and to show how to return C1′,…,Ck′C_{1}^{\prime},\dots,C_{k}^{\prime}.

Intuitively, AA is similar to a symmetric 2-perturbation resilient clustering instance. However, some structure is no longer there, for instance, a point pp may be at distance ≤2r∗\leq 2r^{*} from every point in a different cluster, which is not true for 2-perturbation resilient instances. This implies we cannot simply run a 2-approximation algorithm on the set AA, as we did in the previous section. However, we show that the remaining structural properties are sufficient to optimally cluster AA. To this end, we define two properties and show how they lead to an algorithm that returns C1′,…,Ck′C_{1}^{\prime},\dots,C_{k}^{\prime}, and help us prove that AA respects the structure of OPT\mathcal{OPT}.

The first of these properties requires each point to be closer to its center than any point in another cluster.

Property (1): For all p∈Ci′p\in C_{i}^{\prime} and q∈Cj≠i′q\in C_{j\neq i}^{\prime}, d(ci,p)<d(q,p)d(c_{i},p)<d(q,p).

The second property requires that any point within distance r∗r^{*} of a cluster center belongs to that cluster.

Property (2): For all i≠ji\neq j and q∈Cjq\in C_{j}, d(q,ci)>r∗d(q,c_{i})>r^{*} (see Figure 1). Property (1) first appeared in the work of Awasthi et al. (2012), for symmetric clustering instances. A weaker variation of Property (2) was introduced by Balcan and Liang (2016), which showed that in 1+21+\sqrt{2}-perturbation resilient instances for any cluster CiC_{i} with radius rir_{i}, Bri(ci)=CiB_{r_{i}}(c_{i})=C_{i}. Our Property (2) shows that this is true for a universal radius, r∗r^{*}, even for 22-perturbation resilient instances, and even for asymmetric instances.

Let us illustrate how these properties allow us to optimally cluster AA. Other algorithms work, such as single linkage with dynamic programming at the end to find the minimum cost pruning of kk clusters. However, our algorithm is able to recognize optimal clusters locally (without a complete view of the point set). Consider a ball of radius r∗r^{*} around a center cic_{i}. By Property 2, such a ball exactly captures Ci′C_{i}^{\prime}. Furthermore, by Property 1, any point in this ball is closer to the center than to points outside of the ball. Is this true for a ball of radius r∗r^{*} around a general point pp? Not necessarily. If this ball contains a point q∈Cj′q\in C_{j}^{\prime} from a different cluster, then qq will be closer to a point outside the ball than to pp (namely, cjc_{j}, which is guaranteed to be outside of the ball by Property 2). This allows us to determine that the center of such a ball must not be an optimal center.

This structure motivates our Algorithm 1 for asymmetric kk-center under 2-perturbation resilience. At a high level, we start by constructing the set AA (which can be done easily in polynomial time). Then we create the set of all balls of radius r∗r^{*} around all points in AA (if r∗r^{*} is not known, we can use a guess-and-check wrapper). Next, we prune this set by throwing out any ball that contains a point farther from its center than to a point outside the ball. We also throw out any ball that is a subset of another one. Our claim is that the remaining balls are exactly C1′,…,Ck′C_{1}^{\prime},\dots,C_{k}^{\prime}. Finally, we add the points in S∖AS\setminus A to their closest point in AA.

Properties 1 and 2 hold for asymmetric kk-center instances satisfying 2-perturbation resilience.

Property 1: Assume false, d(q,p)≤d(ci,p)d(q,p)\leq d(c_{i},p). The idea will be that since qq is in AA, it is close to its own center, so we can construct a perturbation in which qq replaces its center cjc_{j}. Then pp will join qq’s cluster, causing a contradiction. Construct the following d′d^{\prime}:

Property 2: Assume on the contrary that there exists q∈Cjq\in C_{j}, i≠ji\neq j such that d(q,ci)≤r∗d(q,c_{i})\leq r^{*}. Now we will define a d′d^{\prime} in which qq can become a center for CiC_{i}.

The set AA respects the structure of OPT\mathcal{OPT}.

From Lemma 3.3, we can use Property 2 in our analysis. First we show that ci∈Ac_{i}\in A for all i∈[k]i\in[k]. Given cic_{i}, ∀p∈Ci\forall p\in C_{i}, then d(ci,p)≤r∗d(c_{i},p)\leq r^{*} by definition of OPT\mathcal{OPT}. ∀q∉Ci\forall q\notin C_{i}, then by Property 2, d(q,ci)>r∗d(q,c_{i})>r^{*}. It follows that for any point p∈Sp\in S, it cannot be the case that d(p,ci)≤r∗d(p,c_{i})\leq r^{*} and d(ci,p)>r∗d(c_{i},p)>r^{*}. Therefore, ci∈Ac_{i}\in A.

Now we show that for all p∈S∖Ap\in S\setminus A, if A(p)∈CiA(p)\in C_{i}, then p∈Cip\in C_{i}. Given p∈S∖Ap\in S\setminus A, let p∈Cip\in C_{i} and assume towards contradiction that q=A(p)∈Cjq=A(p)\in C_{j} for some i≠ji\neq j. We will construct a 2-perturbation d′d^{\prime} in which qq replaces cjc_{j} as the center for CjC_{j} and pp switches from CiC_{i} to CjC_{j}, causing a contradiction. We construct d′d^{\prime} as follows. All distances are increased by a factor of 22 except for d(q,p)d(q,p) and d(q,q′)d(q,q^{\prime}) for all q′∈Cjq^{\prime}\in C_{j}. These distances are increased by a factor of 22 up to 2r∗2r^{*}. Formally,

Now we are ready to show Algorithm 1 returns the optimal clustering.

Algorithm 1 returns the exact solution for asymmetric kk-center under 2-perturbation resilience.

In this proof, we refer to the first line of Prune balls in Algorithm 1 as Pruning step 1 and the second line as Pruning step 2. First we must show that after Pruning step 2, the remaining sets are exactly C1′,…,Ck′=C1∩A,…,Ck∩AC_{1}^{\prime},\dots,C_{k}^{\prime}=C_{1}\cap A,\dots,C_{k}\cap A. We prove this in three steps: the sets GciG_{c_{i}} correspond to Ci′C_{i}^{\prime}, these sets are not thrown out in Pruning step 1 and Pruning step 2, and all other sets are thrown out in steps Pruning step 1 and Pruning step 2. Because of Lemma 3.3, we can use Properties 1 and 2.

For all ii, Gci=Ci′G_{c_{i}}=C_{i}^{\prime}: From Lemma 3.4, all centers are in AA, so GciG_{c_{i}} will be created in step 2. For all p∈Cip\in C_{i}, d(ci,p)≤r∗d(c_{i},p)\leq r^{*}. For all q∉Ci′q\notin C_{i}^{\prime}, then by Property 2, d(q,ci)>r∗d(q,c_{i})>r^{*} (and since ci,q∈Ac_{i},q\in A, d(ci,q)>r∗d(c_{i},q)>r^{*} as well). For all ii, GciG_{c_{i}} is not thrown out in step Pruning step 1: Given s∈Gcis\in G_{c_{i}} and t∉Gcit\notin G_{c_{i}}. Then s∈Ci′s\in C_{i}^{\prime} and t∈Cj′t\in C_{j}^{\prime} for j≠ij\neq i. If d(t,s)<d(ci,s)d(t,s)<d(c_{i},s), then we get a contradiction from Property 1. For all non-centers pp, GpG_{p} is thrown out in Pruning step 1 or Pruning step 2: From the previous paragraph, Gci=Ci′G_{c_{i}}=C_{i}^{\prime}. If Gp⊆GciG_{p}\subseteq G_{c_{i}}, then GpG_{p} will be thrown out in Pruning step 2 (if Gp=GciG_{p}=G_{c_{i}}, it does not matter which set we keep, so without loss of generality say that we keep GciG_{c_{i}}). Then if GpG_{p} is not thrown out in Pruning step 2, ∃s∈Gp∩Cj′\exists s\in G_{p}\cap C_{j}^{\prime}, j≠ij\neq i. If s=cjs=c_{j}, then d(p,cj)≤r∗d(p,c_{j})\leq r^{*} and we get a contradiction from Property 2. So, we can assume ss is a non-center (and that cj∉Gpc_{j}\notin G_{p}). But d(cj,s)<d(p,s)d(c_{j},s)<d(p,s) from Property 1, and therefore GpG_{p} will be thrown out in Pruning step 1. Thus, the remaining sets after Pruning step 2 are exactly C1′,…,Ck′C_{1}^{\prime},\dots,C_{k}^{\prime}.

Finally, by Lemma 3.4, for each p∈Ci∖Ap\in C_{i}\setminus A, A(p)∈CiA(p)\in C_{i}, so pp will be added to GciG_{c_{i}}. Therefore, the final output is C1,…,CkC_{1},\dots,C_{k}. ∎

2.2 Hardness of k𝑘k-center under perturbation resilience

In this section, we show NP-hardness for kk-center under (2−δ)(2-\delta)-perturbation resilience. We show that if there exists a polynomial time algorithm which returns the optimal solution for symmetric kk-center under (2−δ)(2-\delta)-perturbation resilience, In fact, our result holds even under the strictly stronger notion of approximation stability (Balcan et al., 2013). then NP=RPNP=RP, even under the condition that the optimal clusters are all size ≥n2k\geq\frac{n}{2k}. Because symmetric kk-center is a special case of asymmetric kk-center, we have the same hardness results for asymmetric kk-center. This proves Theorem 3.5 is tight with respect to the level of perturbation resilience assumed.

There is no polynomial time algorithm for finding the optimal kk-center clustering under (2−δ)(2-\delta)-perturbation resilience, even when assuming all optimal clusters are size ≥n2k\geq\frac{n}{2k}, unless NP=RPNP=RP.

We show a reduction from a special case of Dominating Set which we call Unambiguous-Balanced-Perfect Dominating Set. Below, we formally define this problem and all intermediate problems. Part of our reduction is based off of the proof of Ben-David and Reyzin (2012), who showed a reduction from a variant of dominating set to the weaker problem of clustering under (2−δ)(2-\delta)-center proximity. α\alpha-center proximity is the property that for all p∈Cip\in C_{i} and j≠ij\neq i, αd(ci,p)<d(cj,p)\alpha d(c_{i},p)<d(c_{j},p), and it follows from α\alpha-perturbation resilience. We use four NP-hard problems in a chain of reductions. Here, we define all of these problems up front. We introduce the “balanced” variants of two existing problems.

We are given three disjoint sets X1X_{1}, X2X_{2}, and X3X_{3} each of size mm, and a set TT such that t∈Tt\in T is a triple t=(x1,x2,x3)t=(x_{1},x_{2},x_{3}) where x1∈X1x_{1}\in X_{1}, x2∈X2x_{2}\in X_{2}, and x3∈X3x_{3}\in X_{3}. The problem is to find a set M⊆TM\subseteq T of size mm which exactly hits all the elements in X1∪X2∪X3X_{1}\cup X_{2}\cup X_{3}. In other words, for all pairs (x1,x2,x3),(y1,y2,y3)∈M(x_{1},x_{2},x_{3}),(y_{1},y_{2},y_{3})\in M, it is the case that x1≠y1x_{1}\neq y_{1}, x2≠y2x_{2}\neq y_{2}, and x3≠y3x_{3}\neq y_{3}.

This is the 3DM problem (X1,X2,X3,T)(X_{1},X_{2},X_{3},T) with the additional constraint that 2m≤∣T∣≤3m2m\leq|T|\leq 3m, where ∣X1∣=∣X2∣=∣X3∣=m|X_{1}|=|X_{2}|=|X_{3}|=m.

Given a graph G=(V,E)G=(V,E) and an integer kk, the problem is to find a set of vertices D⊆VD\subseteq V of size kk such that for all v∈V∖Dv\in V\setminus D, there exists exactly one d∈Dd\in D such that (v,d)∈E(v,d)\in E (then we say vv “hits” dd).

This is the PDS problem (G,k)(G,k) with the additional assumption that if the graph has nn vertices and a dominating set of size kk exists, then each vertex in the dominating set hits at least n2k\frac{n}{2k} vertices.

Additionally, each problem has an “Unambiguous” variant, which is the added constraint that the problem has at most one solution. Valiant and Vazirani (1986) showed that Unambiguous-3SAT is hard unless NP=RPNP=RP. To show the Unambiguous version of another problem is hard, one must establish a parsimonious polynomial time reduction from Unambiguous-3SAT to that problem. A parsimonious reduction is one that conserves the number of solutions. For two problems AA and BB, we denote A≤parBA\leq_{par}B to mean there is a reduction from AA to BB that is parsimonious and polynomial time. Some common reductions involve 1-to-1 mappings which are easy to verify parsimony, but many other common reductions are not parsimonious. For instance, the standard reduction from 3SAT to 3DM is not parsimonious (Kleinberg and Tardos, 2006), yet there is a more roundabout series of reductions which all use 1-to-1 mappings, and are therefore easy to verify parsimony. In order to prove Theorem 3.6, we start with the claim that Unambiguous-BPDS is hard unless NP=RPNP=RP. We use a parsimonious series of reductions from 3SAT to B3DM to BPDS. All of these reductions are from prior work, yet we verify parsimony and balancedness.

There is no polynomial time algorithm for Unambiguous-BPDS unless NP=RPNP=RP.

We give a parsimonious series of reductions from 3SAT to B3DM to BPDS. Then it follows from the result by Valiant and Vazirani (1986) that there is no polynomial time algorithm for Unambiguous-BPDS unless NP=RPNP=RP.

To show that B3DM is NP-hard, we use the reduction of Dyer and Frieze (1986) who showed that Planar-3DM is NP-hard. While planarity is not important for the purpose of our problems, their reduction from 3SAT has two other nice properties that we crucially use. First, the reduction is parsimonious, as pointed out by Hunt III et al. (1998). Second, given their 3DM instance X1,X2,X3,TX_{1},X_{2},X_{3},T, each element in X1∪X2∪X3X_{1}\cup X_{2}\cup X_{3} appears in either two or three tuples in TT. (Dyer and Frieze (1986) mention this observation just before their Theorem 2.3.) From this, it follows that 2m≤∣T∣≤3m2m\leq|T|\leq 3m, and so their reduction proves that B3DM is NPNP-hard via a parsimonious reduction from 3SAT.

Next, we reduce B3DM to BPDS using a reduction similar to the reduction by Ben-David and Reyzin (2012). Their reduction maps every element in X1∪X2∪X3∪TX_{1}\cup X_{2}\cup X_{3}\cup T to a vertex in VV, and adds one extra vertex vv to VV. There is an edge from each element (x1,x2,x3)∈T(x_{1},x_{2},x_{3})\in T to the corresponding elements x1∈X1x_{1}\in X_{1}, x2∈X2x_{2}\in X_{2}, and x3∈X3x_{3}\in X_{3}. Furthermore, there is an edge from vv to every element in TT. Ben-David and Reyzin (2012) show that if the 3DM instance is a yes instance with matching M⊆TM\subseteq T then the minimum dominating set is v∪Mv\cup M. Now we will verify this same reduction can be used to reduce B3DM to BPDS. If we start with B3DM, our graph has ∣X1∣+∣X2∣+∣X3∣+∣T∣+1≤6m+1|X_{1}|+|X_{2}|+|X_{3}|+|T|+1\leq 6m+1 vertices since ∣T∣≤3m|T|\leq 3m, so n≤6m+1n\leq 6m+1. Also note that in the yes instance, the dominating set is size m+1m+1 by construction. Therefore, to verify the reduction to BPDS, we must show that in the yes instance, each node in the dominating set hits ≥6m+12(m+1)\geq\frac{6m+1}{2(m+1)} nodes. Given t∈Mt\in M, tt hits 3 nodes in the graph, and n2(m+1)≤6m+12m+2≤3\frac{n}{2(m+1)}\leq\frac{6m+1}{2m+2}\leq 3. The final node in the dominating set is vv, and vv hits ∣T∣−m≥2m−m=m|T|-m\geq 2m-m=m nodes, and 6m+12(m+1)≤m\frac{6m+1}{2(m+1)}\leq m when m≥3m\geq 3. Therefore, the resulting instance is a BPDS instance.

Now we have verified that there exists a parsimonious reduction 3SAT ≤par\leq_{par} BPDS, so it follows that there is no polynomial time algorithm for Unambiguous-BPDS unless NP=RPNP=RP. ∎

Now we can prove Theorem 3.6 by giving a reduction from Unambiguous-BPDS to kk-center clustering under (2−δ)(2-\delta)-perturbation resilience, where all clusters are size ≥n2k\geq\frac{n}{2k}. We use the same reduction as Ben-David and Reyzin (2012), but we must verify that the resulting instance is (2−δ)(2-\delta)-perturbation resilient. Note that our reduction requires the Unambiguous variant while the reduction of Ben-David and Reyzin (2012) does not, since we are reducing to a stronger problem.

From Lemma 3.11, Unambiguous-BPDS is NP-hard unless NP=RPNP=RP. Now for all δ>0\delta>0, we reduce from Unambiguous-BPDS to kk-center clustering and show the resulting instance has all cluster sizes ≥n2k\geq\frac{n}{2k} and satisfies (2−δ)(2-\delta)-perturbation resilience.

Given an instance of Unambiguous-BPDS, for every v∈Vv\in V, create a point v∈Sv\in S in the clustering instance. For every edge (u,v)∈E(u,v)\in E, let d(u,v)=1d(u,v)=1, otherwise let d(u,v)=2d(u,v)=2. Since all distances are either 11 or 22, the triangle inequality is trivially satisfied. Then a kk-center solution of cost 1 exists if and only if there exists a dominating set of size kk.

Since each vertex in the dominating set hits at least n2k\frac{n}{2k} vertices, the resulting clusters will be size at least n2k+1\frac{n}{2k}+1. Additionally, if there exists a dominating set of size kk, then the corresponding optimal kk-center clustering has cost 1. Because this dominating set is perfect and unique, any other clustering has cost 2. It follows that the kk-center instance is (2−δ)(2-\delta)-perturbation resilient. ∎

k𝑘k-center under metric perturbation resilience

In this section, we extend the results from Section 3 to the metric perturbation resilience setting (Angelidakis et al., 2017). We first give a generalization of Lemma 2.8 to show that it can be extended to metric perturbation resilience. Then we show how this immediately leads to corollaries of Theorem 3.1 and Theorem 3.5 extended to the metric perturbation resilience setting.

Recall that in the proofs from the previous section, we created α\alpha-perturbations d′d^{\prime} by increasing all distances by α\alpha, except a few distances d(u,v)≤αr∗d(u,v)\leq\alpha r^{*} which we increased to min⁡(αd(u,v),αr∗)\min(\alpha d(u,v),\alpha r^{*}). In this specific type of α\alpha-perturbation, we used the crucial property that the optimal clustering has cost αr∗\alpha r^{*} (Lemma 2.8). However, d′d^{\prime} may be highly non-metric, so our challenge is arguing that the proof still goes through after taking the metric completion of d′d^{\prime} (recall the metric completion of d′d^{\prime} is defined as the shortest path metric on d′d^{\prime}). In the following lemma, we show that Lemma 2.8 remains true after taking the metric completion of the perturbation.

Given α≥1\alpha\geq 1 and an asymmetric kk-center clustering instance (S,d)(S,d) with optimal radius r∗r^{*}, let d′′d^{\prime\prime} denote an α\alpha-perturbation such that for all u,vu,v, either d′′(u,v)=min⁡(αr∗,αd(u,v))d^{\prime\prime}(u,v)=\min(\alpha r^{*},\alpha d(u,v)) or d′′(u,v)=αd(u,v)d^{\prime\prime}(u,v)=\alpha d(u,v). Let d′d^{\prime} denote the metric completion of d′′d^{\prime\prime}. Then d′d^{\prime} is an α\alpha-metric perturbation of dd, and the optimal cost under d′d^{\prime} is αr∗\alpha r^{*}.

By construction, d′(u,v)≤d′′(u,v)≤αd(u,v)d^{\prime}(u,v)\leq d^{\prime\prime}(u,v)\leq\alpha d(u,v). Since dd satisfies the triangle inequality, we have that d(u,v)≤d′(u,v)d(u,v)\leq d^{\prime}(u,v), so d′d^{\prime} is a valid α\alpha-metric perturbation of dd.

Now given u,vu,v such that d(u,v)≥r∗d(u,v)\geq r^{*}, we will prove that d′(u,v)≥αr∗d^{\prime}(u,v)\geq\alpha r^{*}. By construction, d′′(u,v)≥αr∗d^{\prime\prime}(u,v)\geq\alpha r^{*}. Then since d′d^{\prime} is the metric completion of d′′d^{\prime\prime}, there exists a path u=u0u=u_{0}–u1u_{1}–⋯\cdots–us−1u_{s-1}–us=vu_{s}=v such that d′(u,v)=∑i=0s−1d′(ui,ui+1)d^{\prime}(u,v)=\sum_{i=0}^{s-1}d^{\prime}(u_{i},u_{i+1}) and for all 0≤i≤s−10\leq i\leq s-1, d′(ui,ui+1)=d′′(ui,ui+1)d^{\prime}(u_{i},u_{i+1})=d^{\prime\prime}(u_{i},u_{i+1}).

Case 1: there exists an ii such that d′′(ui,ui+1)≥αr∗d^{\prime\prime}(u_{i},u_{i+1})\geq\alpha r^{*}. Then d′(u,v)≥αr∗d^{\prime}(u,v)\geq\alpha r^{*} and we are done.

Case 2: for all 0≤i≤s−10\leq i\leq s-1, d′′(ui,ui+1)<αr∗d^{\prime\prime}(u_{i},u_{i+1})<\alpha r^{*}. Then by construction, d′(ui,ui+1)=d′′(ui,ui+1)=αd(ui,ui+1)d^{\prime}(u_{i},u_{i+1})=d^{\prime\prime}(u_{i},u_{i+1})=\alpha d(u_{i},u_{i+1}), and so d′(u,v)=∑i=0s−1d′(ui,ui+1)=α∑i=0s−1d(ui,ui+1)≥αd(u,v)≥αr∗d^{\prime}(u,v)=\sum_{i=0}^{s-1}d^{\prime}(u_{i},u_{i+1})=\alpha\sum_{i=0}^{s-1}d(u_{i},u_{i+1})\geq\alpha d(u,v)\geq\alpha r^{*}.

We have proven that for all u,vu,v, if d(u,v)≥r∗d(u,v)\geq r^{*}, then d′(u,v)≥αr∗d^{\prime}(u,v)\geq\alpha r^{*}. Then by Lemma 2.8, the optimal cost under d′d^{\prime} must be αr∗\alpha r^{*}. ∎

Recall that metric perturbation resilience states that the optimal solution does not change under any metric perturbation to the input distances. In the proofs of Theorems 3.1 and 3.5, the only perturbations constructed were the type as in Lemma 2.8. Since Lemma 4.1 shows this type of perturbation is indeed a metric, Theorems 3.1 and 3.5 are true even under metric perturbation resilience.

Given a clustering instance (S,d)(S,d) satisfying α\alpha-metric perturbation resilience for asymmetric kk-center, and a set CC of kk centers which is an α\alpha-approximation, i.e., ∀p∈S\forall p\in S, ∃c∈C\exists c\in C such that d(c,p)≤αr∗d(c,p)\leq\alpha r^{*}, then the Voronoi partition induced by CC is the optimal clustering.

Algorithm 1 returns the exact solution for asymmetric kk-center under 2-metric perturbation resilience.

k𝑘k-center under local perturbation resilience

In this section, we further extend the results from Sections 3 and 4 to the local perturbation resilience setting. First we show that any α\alpha-approximation to kk-center will return each optimal α\alpha-MPR cluster, i.e., Corollary 4.2 holds even in the local perturbation resilience setting. Then for asymmetric kk-center, we show that a natural modification to the O(log⁡∗n)O(\log^{*}n) approximation algorithm of Vishwanathan (1996) leads to an algorithm that maintains its performance in the worst case, while exactly returning each optimal cluster located within a 2-MPR region of the dataset. This generalizes Corollary 4.3.

In section 3, we showed that any α\alpha-approximation algorithm for kk-center returns the optimal solution for instances satisfying α\alpha-perturbation resilience (and this was generalized to metric perturbation resilience in the previous section). In this section, we extend this result to the local perturbation resilience setting. We show that any α\alpha-approximation will return each (local) α\alpha-MPR cluster. For example, if a clustering instance is half 2-perturbation resilient, running a 2-approximation algorithm will return the optimal clusters for half the dataset, and a 2-approximation for the other half.

Given an asymmetric kk-center clustering instance (S,d)(S,d), a set CC of kk centers which is an α\alpha-approximation, and a clustering C\mathcal{C} defined as the Voronio partition induced by CC, then each α\alpha-MPR cluster is contained in C\mathcal{C}.

The proof is very similar to the proof of Theorem 3.1. The key difference is that we reason about each perturbation resilient cluster individually, rather than reasoning about the global structure of perturbation resilience.

Given an α\alpha-approximate solution C\mathcal{C} to a clustering instance (S,d)(S,d), and given an α\alpha-MPR cluster CiC_{i}, we will create an α\alpha-perturbation as follows. Define C(v):=argminc∈Cd(c,v)\mathcal{C}(v):=\text{argmin}_{c\in\mathcal{C}}d(c,v). For all v∈Sv\in S, set d′′(v,C(v))=min⁡{αr∗,αd(v,C(v))}d^{\prime\prime}(v,\mathcal{C}(v))=\min\{\alpha r^{*},\alpha d(v,\mathcal{C}(v))\}. For all other points u∈Su\in S, set d′′(v,u)=αd(v,u)d^{\prime\prime}(v,u)=\alpha d(v,u). Then by Lemma 4.1, the metric completion d′d^{\prime} of d′′d^{\prime\prime} is an α\alpha-perturbation of dd with optimal cost αr∗\alpha r^{*}. By construction, the cost of C\mathcal{C} is ≤αr∗\leq\alpha r^{*} under d′d^{\prime}, therefore, C\mathcal{C} is an optimal clustering. Denote the set of centers of C\mathcal{C} by CC. By definition of α\alpha-MPR, there exists vi∈Cv_{i}\in C such that VorC,d′(vi)=Ci\text{Vor}_{C,d^{\prime}}(v_{i})=C_{i}. Now, given v∈Civ\in C_{i}, argminu∈Cd′(u,v)=vi\text{argmin}_{u\in C}d^{\prime}(u,v)=v_{i}, so by construction, argminu∈Cd(u,v)=vi\text{argmin}_{u\in C}d(u,v)=v_{i}. Therefore, VorC,d(vi)=Ci\text{Vor}_{C,d}(v_{i})=C_{i}, so Ci∈CC_{i}\in\mathcal{C}.

2 Asymmetric k𝑘k-center

In Section 3, we gave an algorithm which outputs the optimal clustering for asymmetric kk-center under 2-perturbation resilience (Algorithm 1 and Theorem 3.5), and we extended it to metric perturbation resilience in Section 4. In this section, we extend the result further to the local perturbation resilience setting, and we show how to add a worst-case guarantee of O(log⁡∗n)O(\log^{*}n). Specifically, we give a new algorithm, which is a natural modification to the O(log⁡∗n)O(\log^{*}n) approximation algorithm of Vishwanathan (1996), and show that it maintains the O(log⁡∗n)O(\log^{*}n) guarantee in the worst case while returning each optimal perturbation resilient cluster in its own superset. As a consequence, if the entire clustering instance satisfies 2-metric perturbation resilience, then the output of our algorithm is the optimal clustering.

Given an asymmetric kk-center clustering instance (S,d)(S,d) of size nn with optimal clustering {C1,…,Ck}\{C_{1},\dots,C_{k}\}, for each 2-MPR cluster CiC_{i}, there exists a cluster outputted by Algorithm 3 that is a superset of CiC_{i} and does not contain any other 2-MPR cluster. Formally, given the output clustering C′\mathcal{C}^{\prime} of Algorithm 3, for all 2-MPR clusters CiC_{i} and CjC_{j}, there exists Ci′∈C′C_{i}^{\prime}\in\mathcal{C}^{\prime} such that Ci⊆Ci′C_{i}\subseteq C_{i}^{\prime} and Cj∩Ci′=∅C_{j}\cap C_{i}^{\prime}=\emptyset. Furthermore, the overall clustering returned by Algorithm 3 is an O(log⁡∗n)O(\log^{*}n)-approximation.

At the end of this section, we will also show an algorithm that outputs an optimal cluster CiC_{i} exactly, if CiC_{i} and any optimal cluster near CiC_{i} are 2-MPR.

We start with a recap of the O(log⁡∗n)O(\log^{*}n)-approximation algorithm by Vishwanathan (1996). This was the first nontrivial algorithm for asymmetric kk-center, and the approximation ratio was later proven to be tight by (Chuzhoy et al., 2005). To explain the algorithm, it is convenient to think of asymmetric kk-center as a set covering problem. Given an asymmetric kk-center instance (S,d)(S,d), define the directed graph D(S,d)=(S,A)D_{(S,d)}=(S,A), where A={(u,v)∣d(u,v)≤r∗}A=\{(u,v)\mid d(u,v)\leq r^{*}\}. For a point v∈Sv\in S, we define Γin(v)\Gamma_{\text{in}}(v) and Γout(v)\Gamma_{\text{out}}(v) as the set of vertices with an arc to and from vv, respectively, in D(S,d)D_{(S,d)}. The asymmetric kk-center problem is equivalent to finding a subset C⊆SC\subseteq S of size kk such that ∪c∈CΓout(c)=S\cup_{c\in C}\Gamma_{\text{out}}(c)=S. We also define Γinx(v)\Gamma_{\text{in}}^{x}(v) and Γoutx(v)\Gamma_{\text{out}}^{x}(v) as the set of vertices which have a path of length ≤x\leq x to and from vv in D(S,d)D_{(S,d)}, respectively, and we define Γoutx(A)=⋃v∈AΓoutx(v)\Gamma_{\text{out}}^{x}(A)=\bigcup_{v\in A}\Gamma_{\text{out}}^{x}(v) for a set A⊆SA\subseteq S, and similarly for Γinx(A)\Gamma_{\text{in}}^{x}(A). It is standard to assume the value of r∗r^{*} is known; since it is one of O(n2)O(n^{2}) distances, the algorithm can search for the correct value in polynomial time. Vishwanathan (1996) uses the following concept.

Given an asymmetric kk-center clustering instance (S,d)(S,d), a point v∈Sv\in S is a center-capturing vertex (CCV) if Γin(v)⊆Γout(v)\Gamma_{\text{in}}(v)\subseteq\Gamma_{\text{out}}(v). In other words, for all u∈Su\in S, d(u,v)≤r∗d(u,v)\leq r^{*} implies d(v,u)≤r∗d(v,u)\leq r^{*}.

As the name suggests, each CCV v∈Civ\in C_{i}, “captures” its center, i.e. ci∈Γout(v)c_{i}\in\Gamma_{\text{out}}(v) (see Figure 2(a)). Therefore, vv’s entire cluster is contained inside Γout2(v)\Gamma_{\text{out}}^{2}(v), which is a nice property that the approximation algorithm exploits. At a high level, the approximation algorithm has two phases. In the first phase, the algorithm iteratively picks a CCV vv arbitrarily and removes all points in Γout2(v)\Gamma_{\text{out}}^{2}(v). This continues until there are no more CCVs. For every CCV picked, the algorithm is guaranteed to remove an entire optimal cluster. In the second phase, the algorithm runs log⁡∗n\log^{*}n rounds of a greedy set-cover subroutine on the remaining points. See Algorithm 2. To prove the second phase terminates in O(log⁡∗n)O(\log^{*}n) rounds, the analysis crucially assumes there are no CCVs among the remaining points. We refer the reader to (Vishwanathan, 1996) for these details.

We show a modification to the approximation algorithm of Vishwanathan (1996) leads to simultaneous guarantees in the worst case and under local perturbation resilience. Note that the set of all CCV’s is identical to the symmetric set AA defined in Section 3.2.1. In Section 3.2.1, we showed that all centers are in AA, therefore, all centers are CCV’s, assuming 2-PR. In this section, we have that each 2-MPR center is a CCV (Lemma 5.5), which is true by definition of r∗r^{*}, (Ci⊆Γout(ci)C_{i}\subseteq\Gamma_{\text{out}}(c_{i})) and by using the definition of 2-MPR (Γin(ci)⊆Ci\Gamma_{\text{in}}(c_{i})\subseteq C_{i}). Since each 2-MPR center is a CCV, we might hope that we can output the 2-MPR clusters by iteratively choosing a CCV vv and removing all points in Γout2(v)\Gamma_{\text{out}}^{2}(v). However, using this approach we might remove two or more 2-MPR centers in the same iteration, which means we would not output one separate cluster for each 2-MPR cluster. If we try to get around this problem by iteratively choosing a CCV vv and removing all points in Γout1(v)\Gamma_{\text{out}}^{1}(v), then we may not remove one full cluster in each iteration, so for example, some of the 2-MPR clusters may be cut in half.

The key challenge is thus carefully specifying which nearby points get marked by each CCV cc chosen by the algorithm. We fix this problem with two modifications that carefully balance the two guarantees. First, any CCV cc chosen will mark points in the following way: for all c′∈Γin(c)c^{\prime}\in\Gamma_{\text{in}}(c), mark all points in Γout(c′)\Gamma_{\text{out}}(c^{\prime}). Intuitively, we still mark points that are two hops from cc, but the first ‘hop’ must go backwards, i.e., mark vv such that there exists c′c^{\prime} and d(c′,c)≤r∗d(c^{\prime},c)\leq r^{*} and d(c′,v)≤r∗d(c^{\prime},v)\leq r^{*}. This gives us a useful property: if the algorithm picks a CCV c∈Cic\in C_{i} and it marks a different 2-MPR center cjc_{j}, then the middle hop must be a point qq in CjC_{j}. However, we know from perturbation resilience that d(cj,q)<d(c,q)d(c_{j},q)<d(c,q). This fact motivates the final modification to the algorithm. Instead of picking arbitrary CCVs, we require the algorithm to choose CCVs with an extra structural property which we call CCV-proximity (Definition 5.4). See Figure 2(b). Intuitively, a point cc satisfying CCV-proximity must be closer than other CCVs to each point in Γin(c)\Gamma_{\text{in}}(c). Going back to our previous example, cc will NOT satisfy CCV-proximity because cjc_{j} is closer to qq, but we will be able to show that all 2-MPR centers do satisfy CCV-proximity. Thus Algorithm 3 works as follows. It first chooses points satisfying CCV-proximity and marks points according to the rule mentioned earlier. When there are no more points satisfying CCV-proximity, the algorithm chooses regular CCVs. Finally, it runs Phase II as in Algorithm 2. This ensures that Algorithm 3 will output each 2-MPR center in its own cluster.

Now we formally define CCV-proximity. The other properties in the following definition, center-separation, and weak CCV-proximity, are defined in terms of the optimal clustering, so they cannot be explicitly used by an algorithm, but they will simplify all of our proofs.

An optimal center cic_{i} satisfies center-separation if any point within distance r∗r^{*} of cic_{i} belongs to its cluster CiC_{i}. That is, Γin(ci)⊆Ci\Gamma_{\text{in}}(c_{i})\subseteq C_{i} (see Figure 3(a)). Center-separation is the local-PR equivalent of property 2 from Section 3.2.1.

A CCV c∈Cic\in C_{i} satisfies weak CCV-proximity if, given a CCV c′∉Cic^{\prime}\notin C_{i} and a point v∈Civ\in C_{i}, we have d(c,v)<d(c′,v)d(c,v)<d(c^{\prime},v) (see Figure 3(b)). This is a variant of α\alpha-center proximity (Awasthi et al., 2012), a property defined over an entire clustering instance, which states for all ii, for all v∈Civ\in C_{i}, j≠ij\neq i, we have αd(ci,v)<d(cj,v)\alpha d(c_{i},v)<d(c_{j},v). Our variant generalizes to local-PR, asymmetric instances, and general CCV’s.

A point cc satisfies CCV-proximity if it is a CCV, and each point in Γin(c)\Gamma_{\text{in}}(c) is closer to cc than any CCV outside of Γout(c)\Gamma_{\text{out}}(c). That is, for all points v∈Γin(c)v\in\Gamma_{\text{in}}(c) and CCVs c′∉Γout(c)c^{\prime}\notin\Gamma_{\text{out}}(c), d(c,v)<d(c′,v)d(c,v)<d(c^{\prime},v) (see Figure 2(b)) This is similar to a property in (Balcan and Liang, 2016).

Next we prove that all 2-MPR centers satisfy center-separation, and all CCV’s from a 2-MPR cluster satisfy CCV-proximity and weak CCV-proximity.

Given an asymmetric kk-center clustering instance (S,d)(S,d) and a 2-MPR cluster CiC_{i}, (1) cic_{i} satisfies center-separation, (2) any CCV c∈Cic\in C_{i} satisfies CCV-proximity, (3) any CCV c∈Cic\in C_{i} satisfies weak CCV-proximity.

Given an instance (S,d)(S,d) and a 2-MPR cluster CiC_{i}, we show that CiC_{i} has the desired properties.

Center separation: Assume there exists a point v∈Cjv\in C_{j} for j≠ij\neq i such that d(v,ci)≤r∗d(v,c_{i})\leq r^{*}. The idea is to construct a 22-perturbation in which vv becomes the center for CiC_{i}.

d′′d^{\prime\prime} is a valid 2-perturbation of dd because for each point u∈Ciu\in C_{i}, d(v,u)≤d(v,ci)+d(ci,u)≤2r∗d(v,u)\leq d(v,c_{i})+d(c_{i},u)\leq 2r^{*}. Define d′d^{\prime} as the metric completion of d′′d^{\prime\prime}. Then by Lemma 4.1, d′d^{\prime} is a 2-metric perturbation with optimal cost 2r∗2r^{*}. The set of centers {ci′}i′=1k∖{ci}∪{v}\{c_{i^{\prime}}\}_{i^{\prime}=1}^{k}\setminus\{c_{i}\}\cup\{v\} achieves the optimal cost, since vv is distance 2r∗2r^{*} from CiC_{i}, and all other clusters have the same center as in OPT\mathcal{OPT} (achieving radius 2r∗2r^{*}). If vv is a noncenter, then {ci′}i′=1k∖{ci}∪{v}\{c_{i^{\prime}}\}_{i^{\prime}=1}^{k}\setminus\{c_{i}\}\cup\{v\} is a valid set of kk centers. If v=cjv=c_{j}, then add an arbitrary point v′∈Cjv^{\prime}\in C_{j} to this set of centers (it still achieves the optimal cost since adding another center can only decrease the cost). Then in this new optimal clustering, cic_{i}’s center is a point in {ci′}i′=1k∖{ci}∪{v,v′}\{c_{i^{\prime}}\}_{i^{\prime}=1}^{k}\setminus\{c_{i}\}\cup\{v,v^{\prime}\}, none of which are from CiC_{i}. We conclude that CiC_{i} is no longer an optimal cluster, contradicting 2-MPR.

Weak CCV-proximity: Given a CCV c∈Cic\in C_{i}, a CCV c′∈Cjc^{\prime}\in C_{j} such that j≠ij\neq i, and a point v∈Civ\in C_{i}, assume to the contrary that d(c′,v)≤d(c,v)d(c^{\prime},v)\leq d(c,v). We will construct a perturbation in which cc and c′c^{\prime} become centers of their respective clusters, and then vv switches clusters. Define the following perturbation d′′d^{\prime\prime}.

d′′d^{\prime\prime} is a valid 2-perturbation of dd because for each point u∈Ciu\in C_{i}, d(c,u)≤d(c,ci)+d(ci,u)≤2r∗d(c,u)\leq d(c,c_{i})+d(c_{i},u)\leq 2r^{*}, for each point u∈Cju\in C_{j}, d(c′,u)≤d(c′,cj)+d(cj,u)≤2r∗d(c^{\prime},u)\leq d(c^{\prime},c_{j})+d(c_{j},u)\leq 2r^{*}, and d(c′,v)≤d(c,v)≤d(c,ci)+d(ci,v)≤2r∗d(c^{\prime},v)\leq d(c,v)\leq d(c,c_{i})+d(c_{i},v)\leq 2r^{*}. Define d′d^{\prime} as the metric completion of d′′d^{\prime\prime}. Then by Lemma 4.1, d′d^{\prime} is a 2-metric perturbation with optimal cost 2r∗2r^{*}. The set of centers {ci′}i′=1k∖{ci,cj}∪{c,c′}\{c_{i^{\prime}}\}_{i^{\prime}=1}^{k}\setminus\{c_{i},c_{j}\}\cup\{c,c^{\prime}\} achieves the optimal cost, since cc and c′c^{\prime} are distance 2r∗2r^{*} from CiC_{i} and CjC_{j}, and all other clusters have the same center as in OPT\mathcal{OPT} (achieving radius 2r∗2r^{*}). Then since d′(c′,v)≤d(c,v)d^{\prime}(c^{\prime},v)\leq d(c,v), vv can switch clusters, contradicting perturbation resilience.

CCV-proximity: First we show that cic_{i} is a CCV. By center-separation, we have that Γin(ci)⊆Ci\Gamma_{\text{in}}(c_{i})\subseteq C_{i}, and by definition of r∗r^{*}, we have that Ci⊆Γout(ci)C_{i}\subseteq\Gamma_{\text{out}}(c_{i}). Therefore, Γin(ci)⊆Ci⊆Γout(ci)\Gamma_{\text{in}}(c_{i})\subseteq C_{i}\subseteq\Gamma_{\text{out}}(c_{i}), so cic_{i} is a CCV. Now given a point v∈Γin(ci)v\in\Gamma_{\text{in}}(c_{i}) and a CCV c∉Γout(ci)c\notin\Gamma_{\text{out}}(c_{i}), from center-separation and definition of r∗r^{*}, we have v∈Civ\in C_{i} and c∈Cjc\in C_{j} for j≠ij\neq i. Then from weak CCV-proximity, d(ci,v)<d(c,v)d(c_{i},v)<d(c,v). ∎

Now using Lemma 5.5, we can prove Theorem 5.2.

First we explain why Algorithm 3 retains the approximation guarantee of Algorithm 2. Given any CCV c∈Cic\in C_{i} chosen in Phase I, since cc is a CCV, then ci∈Γout(c)c_{i}\in\Gamma_{\text{out}}(c), and by definition of r∗r^{*}, Ci⊆Γout(ci)C_{i}\subseteq\Gamma_{\text{out}}(c_{i}). Therefore, each chosen CCV always marks its cluster, and we start Phase II with no remaining CCVs. This condition is sufficient for Phase II to return an O(log⁡∗n)O(\log^{*}n) approximation (Theorem 3.1 from Vishwanathan (1996)).

Next we claim that for each 2-MPR cluster CiC_{i}, there exists a cluster outputted by Algorithm 3 that is a superset of CiC_{i} and does not contain any other 2-MPR cluster. To prove this claim, we first show there exists a point from CiC_{i} satisfying CCV-proximity that cannot be marked by any point from a different cluster in Phase I. From Lemma 5.5, cic_{i} satisfies CCV-proximity and center-separation. If a point c∉Cic\notin C_{i} marks cic_{i}, then ∃v∈Γin(c)∩Γin(ci)\exists v\in\Gamma_{\text{in}}(c)\cap\Gamma_{\text{in}}(c_{i}). By center-separation, ci∉Γout(c)c_{i}\notin\Gamma_{\text{out}}(c), and therefore since cc is a CCV, c∉Γout(ci)c\notin\Gamma_{\text{out}}(c_{i}). But then from the definition of CCV-proximity for cic_{i} and cc, we have d(c,v)<d(ci,v)d(c,v)<d(c_{i},v) and d(ci,v)<d(c,v)d(c_{i},v)<d(c,v), so we have reached a contradiction (see Figure 4(a)).

At this point, we know a point c∈Cic\in C_{i} will always be chosen by the algorithm in Phase I. To finish the proof, we show that each point vv from CiC_{i} is closer to cc than to any other point c′∉Cic^{\prime}\notin C_{i} chosen as a center in Phase I. Since cc and c′c^{\prime} are both CCVs, this follows directly from weak CCV-proximity. It is possible that a center c′c^{\prime} chosen in Phase 2 may be closer to vv than cc is to vv, causing c′c^{\prime} to “steal” vv; this is unavoidable. This is why Algorithm 3 separately computes the voronoi tiling from Phase I and Phase II, and so the final output is technically not a valid voronoi tiling over the entire instance SS. ∎

2.1 Strong local perturbation resilience

Theorem 5.2 shows that Algorithm 3 will output each 2-PR center in its own cluster. Given some 2-PR center cic_{i}, it is unavoidable that cic_{i} might mark a non 2-PR center cjc_{j}, and capture all points in its cluster. In this section, we show that Algorithm 3 with a slight modification outputs each 2-strong local perturbation resilient cluster exactly. Recall that intuitively, an optimal cluster CiC_{i} satisfies α\alpha-strong local perturbation resilience if all nearby clusters satisfy α\alpha-perturbation resilience (definition 2.7).

Intuitively, the nearby 2-PR clusters ‘shield’ CiC_{i} from all other points (see Figure 5). The only modification is that at the end of Phase II, instead of calculating the Voronoi diagram using the metric dd, we assign each point v∈S∖Γout5(C)v\in S\setminus\Gamma^{5}_{\text{out}}(C) to the point in C∪Ai+1C\cup A_{i+1} which minimizes the path length in D(S,d)D_{(S,d)}, breaking ties by distance to first common vertex in the shortest path.

Given an asymmetric kk-center clustering instance (S,d)(S,d) with optimal clustering C={C1,…,Ck}\mathcal{C}=\{C_{1},\dots,C_{k}\}, consider a 2-PR cluster CiC_{i}. Assume that for all CjC_{j} for which there is v∈Cjv\in C_{j}, u∈Ciu\in C_{i}, and d(u,v)≤r∗d(u,v)\leq r^{*}, we have that CjC_{j} is also 2-PR (CiC_{i} satisfies 2-strong local perturbation resilience). Then Algorithm 4 returns CiC_{i} exactly.

Given a 2-PR cluster CiC_{i} with the property in the theorem statement, by Theorem 5.2, there exists a CCV c∈Cic\in C_{i} from Phase I satisfying CCV-proximity such that Ci⊆VcC_{i}\subseteq V_{c}. Our goal is to show that Vc=CiV_{c}=C_{i}. First we show that Γin(c)⊆Ci\Gamma_{\text{in}}(c)\subseteq C_{i}, which will help us prove the theorem. Assume towards contradiction that there exists a point v∈Γin(c)∖Civ\in\Gamma_{\text{in}}(c)\setminus C_{i}. Let v∈Cjv\in C_{j}. Since cc is a CCV, we have v∈Γout(c)v\in\Gamma_{\text{out}}(c), so CjC_{j} must be 2-PR by definition. By Lemma 5.5, cjc_{j} is a CCV and d(cj,v)<d(c,v)d(c_{j},v)<d(c,v). But this violates CCV-proximity of cc, so we have reached a contradiction. Therefore, Γin(c)⊆Ci\Gamma_{\text{in}}(c)\subseteq C_{i}.

To finish the proof, we must show that Vc⊆CiV_{c}\subseteq C_{i}. Assume towards contradiction there exists v∈Vc∖Civ\in V_{c}\setminus C_{i} at the end of the algorithm.

Case 1: vv was marked by cc in Phase I. Let v∈Cjv\in C_{j}. Then there exists a point u∈Γin(c)u\in\Gamma_{\text{in}}(c) such that v∈Γout(u)v\in\Gamma_{\text{out}}(u). From the previous paragraph we have that Γin(c)⊆Ci\Gamma_{\text{in}}(c)\subseteq C_{i}, so u∈Ciu\in C_{i}. Therefore, v∈Γout(u)v\in\Gamma_{\text{out}}(u) implies CjC_{j} must be 2-PR. Since vv is from a different 2-PR cluster, it cannot be contained in VcV_{c}, so we have reached a contradiction.

k𝑘k-center under (α,ϵ)𝛼italic-ϵ(\alpha,\epsilon)-perturbation resilience

In this section, we consider (α,ϵ)(\alpha,\epsilon)-perturbation resilience. First, we show that any 2-approximation algorithm for symmetric kk-center must be optimal under (3,ϵ)(3,\epsilon)-perturbation resilience (Theorem 6.1). Next, we show how to extend this result to local perturbation resilience (Theorem 6.8). Then we give an algorithm for asymmetric kk-center which returns a clustering that is ϵ\epsilon-close to OPT\mathcal{OPT} under (3,ϵ)(3,\epsilon)-perturbation resilience (Theorem 6.17). For all of these results, we assume a lower bound on the size of the optimal clusters, ∣Ci∣>2ϵn|C_{i}|>2\epsilon n for all i∈[k]i\in[k]. We show the lower bound on cluster sizes is necessary; in its absence, the problem becomes NPNP-hard for all values of α≥1\alpha\geq 1 and ϵ>0\epsilon>0 (Theorem 6.18). The theorems in this section require a careful reasoning about sets of centers under different perturbations that cannot all simultaneously be optimal.

We show that for any (3,ϵ)(3,\epsilon)-perturbation resilient kk-center instance such that ∣Ci∣>2ϵn|C_{i}|>2\epsilon n for all i∈[k]i\in[k], there cannot be any pair of points from different clusters which are distance ≤r∗\leq r^{*}. This structural result implies that simple algorithms will return the optimal clustering, such as running any 2-approximation algorithm or running the Single Linkage algorithm, which is a fast algorithm widely used in practice for its simplicity.

Given a (3,ϵ)(3,\epsilon)-perturbation resilient symmetric kk-center instance (S,d)(S,d) where all optimal clusters are size >max⁡(2ϵn,3)>\max(2\epsilon n,3), then the optimal clusters in OPT\mathcal{OPT} are exactly the connected components of the threshold graph Gr∗=(S,E)G_{r^{*}}=(S,E), where E={(u,v)∣d(u,v)≤r∗}E=\{(u,v)\mid d(u,v)\leq r^{*}\}.

First we explain the high-level idea behind the proof.

Proof idea. Since each optimal cluster center is distance r∗r^{*} from all points in its cluster, it suffices to show that any two points in different clusters are greater than r∗r^{*} apart from each other. Assume on the contrary that there exist p∈Cip\in C_{i} and q∈Cj≠iq\in C_{j\neq i} such that d(p,q)≤r∗d(p,q)\leq r^{*}. First we find a set of k+2k+2 points and a 3-perturbation d′d^{\prime}, such that every size kk subset of the points are optimal centers under d′d^{\prime}. Then we show how this leads to a contradiction under (3,ϵ)(3,\epsilon)-perturbation resilience.

Here is how we find a set of k+2k+2 points and a perturbation d′d^{\prime} such that all size kk subsets are optimal centers under d′d^{\prime}. From our assumption, pp is distance ≤3r∗\leq 3r^{*} from every point in Ci∪CjC_{i}\cup C_{j} (by the triangle inequality). Under a 3-perturbation in which all distances are blown up by a factor of 3 except d(p,Ci∪Cj)d(p,C_{i}\cup C_{j}), then replacing cic_{i} and cjc_{j} with pp would still give us a set of k−1k-1 centers that achieve the optimal cost. But, would this contradict (3,ϵ)(3,\epsilon)-perturbation resilience? Not necessarily! Perturbation resilience requires exactly kk distinct centers. This distinction is well-motivated; if for some application, the best kk-center solution is to put two centers at the same location, then we could achieve the exact same solution with k−1k-1 centers. That implies we should have been running k′k^{\prime}-center for k′=k−1k^{\prime}=k-1 instead of kk. The key challenge is to pick a final “dummy” center to guarantee that the Voronoi partition is ϵ\epsilon-far from OPT\mathcal{OPT}. The dummy center might “accidentally” be the closest center for almost all points in CiC_{i} or CjC_{j}. Even worse, it might be the case that the new center sets off a chain reaction in which it becomes center to a cluster CxC_{x}, and cxc_{x} becomes center to CjC_{j}, which would also result in a partition that is not ϵ\epsilon-far from OPT\mathcal{OPT}.

To deal with the chain reactions, we crucially introduce the notion of a cluster capturing center (CCC). A cluster capturing center (CCC) is not to be confused with a center-capturing vertex (CCV), defined by Vishwanathan (1996) and used in the previous section. cxc_{x} is a CCC for CyC_{y}, if for all but ϵn\epsilon n points p∈Cyp\in C_{y}, d(cx,p)≤r∗d(c_{x},p)\leq r^{*} and for all i≠x,yi\neq x,y, d(cx,p)<d(ci,p)d(c_{x},p)<d(c_{i},p). Intuitively, a CCC exists if and only if cxc_{x} is a valid center for CyC_{y} when cyc_{y} is taken out of the set of optimal centers (i.e., a chain reaction will occur). We argue that if a CCC does not exist then every dummy center we pick must be close to either CiC_{i} or CjC_{j}, since there are no chain reactions. If there does exist a CCC cxc_{x} for CyC_{y}, then it is much harder to reason about what happens to the dummy centers under d′d^{\prime}, since there may be chain reactions. However, we can define a new d′′d^{\prime\prime} by increasing all distances except d(cx,Cy)d(c_{x},C_{y}), which allows us to take cyc_{y} out of the set of optimal centers, and then any dummy center must be close to CxC_{x} or CyC_{y}. There are no chain reactions because we already know cxc_{x} is the best center for CyC_{y} among the original optimal centers. Thus, whether or not there exists a CCC, we can find k+2k+2 points close to the entire dataset by picking points from both CiC_{i} and CjC_{j} (resp. CxC_{x} and CyC_{y}).

Because of the assumption that all clusters are size >2ϵn>2\epsilon n, for every 3-perturbation there must be a bijection between clusters and centers, where the center is closest to the majority of points in the corresponding cluster. We show that all size kk subsets of the k+2k+2 points cannot simultaneously admit bijections that are consistent with one another.

Formal analysis. We start out with a simple implication from the assumption that ∣Ci∣>2ϵn|C_{i}|>2\epsilon n for all ii.

Given a clustering instance which is (α,ϵ)(\alpha,\epsilon)-perturbation resilient for α≥1\alpha\geq 1, and all optimal clusters have size >2ϵn>2\epsilon n, then for any α\alpha-perturbation d′d^{\prime}, for any set of optimal centers c1′,…,ck′c^{\prime}_{1},\dots,c^{\prime}_{k} of d′d^{\prime}, for each optimal cluster CiC_{i}, there must be a unique center ci′c^{\prime}_{i} which is the center for more than half of the points in CiC_{i} under d′d^{\prime}.

This fact follows simply from the definition of (α,ϵ)(\alpha,\epsilon)-perturbation resilience (under d′d^{\prime}, at most ϵn\epsilon n points in the optimal solution can change clusters), and the assumption that all optimal clusters are size >2ϵn>2\epsilon n. Now we formally define a CCC.

A center cic_{i} is a first-order cluster-capturing center (CCC) for CjC_{j} if for all x≠jx\neq j, for more than half of the points p∈Cjp\in C_{j}, d(ci,p)<d(cx,p)d(c_{i},p)<d(c_{x},p) and d(ci,p)≤r∗d(c_{i},p)\leq r^{*} (see Figure 6(a)). cic_{i} is a second-order cluster-capturing center (CCC2) for CjC_{j} if there exists a clc_{l} such that for all x≠j,lx\neq j,l, for more than half of points p∈Cjp\in C_{j}, d(ci,p)<d(cx,p)d(c_{i},p)<d(c_{x},p) and d(ci,p)≤r∗d(c_{i},p)\leq r^{*} (see Figure 6(b)).

Each cluster CjC_{j} can have at most one CCC cic_{i} because cic_{i} is closer than any other center to more than half of CjC_{j}. Every CCC is a CCC2, since the former is a stronger condition. However, it is possible for a cluster to have multiple CCC2’s. In fact, a cluster can have at most three CCC2’s, but we do not use this in our analysis. We needed to define CCC2 for the following reason. Assuming there exist p∈Cip\in C_{i} and q∈Cjq\in C_{j} which are close, and we replace cic_{i} and cjc_{j} with pp in the set of centers. It is possible that cjc_{j} is a CCC for CiC_{i}, but this does not help us, since we want to analyze the set of centers after removing cjc_{j}. However, if we know that cxc_{x} is a CCC2 for CiC_{i} (it is the best center for CiC_{i}, disregarding cjc_{j}), then we know that cxc_{x} will be the best center for CiC_{i} after replacing cic_{i} and cjc_{j} with pp. Now we use this definition to show that if two points from different clusters are close, we can find a set of k+2k+2 points and a 3-perturbation d′d^{\prime}, such that every size kk subset of the points are optimal centers under d′d^{\prime}. To formalize this notion, we give one more definition.

A set C⊆SC\subseteq S (β,γ)(\beta,\gamma)-hits SS if for all s∈Ss\in S, there exist β\beta points in CC at distance ≤γr∗\leq\gamma r^{*} to ss.

Note that if a set CC of k+2k+2 points (3,3)(3,3)-hits SS, then any size kk subset of CC is still 3r∗3r^{*} from every point in SS, and later we will show that means there exists a perturbation d′d^{\prime} such that every size kk subset must be an optimal set of centers.

Given a clustering instance satisfying (3,ϵ)(3,\epsilon)-perturbation resilience such that all optimal clusters are size >2ϵn>2\epsilon n and there are two points from different clusters which are ≤r∗\leq r^{*} apart from each other, then there exists a set C⊆SC\subseteq S of size k+2k+2 which (3,3)(3,3)-hits SS.

First we prove the lemma assuming that a CCC2 exists, and then we prove the other case. When a CCC2 exists, we do not need the assumption that two points from different clusters are close.

Case 1: There exists a CCC2. If there exists a CCC, then denote cxc_{x} as a CCC for CyC_{y}. If there does not exist a CCC, then denote cxc_{x} as a CCC2 for CyC_{y}. We will show that all points are close to either CxC_{x} or CyC_{y}. cxc_{x} is distance ≤r∗\leq r^{*} to all but ϵn\epsilon n points in CyC_{y}. Therefore, d(cx,cy)≤2r∗d(c_{x},c_{y})\leq 2r^{*} and so cxc_{x} is distance ≤3r∗\leq 3r^{*} to all points in CyC_{y}. Consider the following d′d^{\prime}.

Now partition all the non-centers into two sets SxS_{x} and SyS_{y}, such that Sx={u′∣for the majority of points v′∈Cx, d(u′,v′)≤r∗}S_{x}=\{u^{\prime}\mid\text{for the majority of points }v^{\prime}\in C_{x},\text{ }d(u^{\prime},v^{\prime})\leq r^{*}\} and Sy={u′∣u′∉Sx and for the majority of points v′∈Cy, d(u′,v′)≤r∗}S_{y}=\{u^{\prime}\mid u^{\prime}\notin S_{x}\text{ and for the majority of points }v^{\prime}\in C_{y},\text{ }d(u^{\prime},v^{\prime})\leq r^{*}\}.

Then given u′,v′∈Sxu^{\prime},v^{\prime}\in S_{x}, there exists an s∈Cxs\in C_{x} such that d(u′,v′)≤d(u′,s)+d(s,v′)≤2r∗d(u^{\prime},v^{\prime})\leq d(u^{\prime},s)+d(s,v^{\prime})\leq 2r^{*} (since both points are close to more than half of points in CxC_{x}). Similarly, any two points u′,v′∈Syu^{\prime},v^{\prime}\in S_{y} are ≤2r∗\leq 2r^{*} apart. See Figure 7.

Case 2: There does not exist a CCC2. Now we use the assumption that there exist p∈Cxp\in C_{x}, q∈Cyq\in C_{y}, x≠yx\neq y, such that d(p,q)≤r∗d(p,q)\leq r^{*}. Then by the triangle inequality, pp is distance ≤3r∗\leq 3r^{*} to all points in CxC_{x} and CyC_{y}. Consider the following d′d^{\prime}.

This is a 33-perturbation because d(p,t)≤3r∗d(p,t)\leq 3r^{*} for all t∈Cx∪Cyt\in C_{x}\cup C_{y}. Then by Lemma 2.8, the optimal cost is 3r∗3r^{*}. Given any s∈Ss\in S, the set of centers {cl}i=1k∖{cx,cy}∪{p,s}\{c_{l}\}_{i=1}^{k}\setminus\{c_{x},c_{y}\}\cup\{p,s\} achieves the optimal cost, since pp is distance 3r∗3r^{*} from Cx∪CyC_{x}\cup C_{y}, and all other clusters have the same center as in OPT\mathcal{OPT} (achieving radius 3r∗3r^{*}). Therefore, this set of centers must create a partition that is ϵ\epsilon-close to OPT\mathcal{OPT}, or else there would be a contradiction. Then from Fact 6.2, one of the centers in {cl}i=1k∖{cx,cy}∪{p,s}\{c_{l}\}_{i=1}^{k}\setminus\{c_{x},c_{y}\}\cup\{p,s\} must be the center for the majority of points in CxC_{x} under d′d^{\prime}.

Similar logic applies to the center for the majority of points in CyC_{y}. Therefore, pp and ss must be the centers for CxC_{x} and CyC_{y}. Since ss was an arbitrary noncenter, all noncenters are distance ≤r∗\leq r^{*} to all but ϵn\epsilon n points in either CxC_{x} or CyC_{y}.

Similar to Case 1, we now partition all the non-centers into two sets SxS_{x} and SyS_{y}, such that Sx={u∣for the majority of points v∈Cx, d(u,v)≤r∗}S_{x}=\{u\mid\text{for the majority of points }v\in C_{x},\text{ }d(u,v)\leq r^{*}\} and Sy={u∣u∉Sx and for the majority of points v∈Cy, d(u,v)≤r∗}S_{y}=\{u\mid u\notin S_{x}\text{ and for the majority of points }v\in C_{y},\text{ }d(u,v)\leq r^{*}\}. As before, each pair of points in SxS_{x} are distance ≤2r∗\leq 2r^{*} apart, and similarly for SyS_{y}. It is no longer true that d(cx,cy)≤2r∗d(c_{x},c_{y})\leq 2r^{*}, however, we can prove that for both SxS_{x} and SyS_{y}, there exist points from two distinct clusters each. From the previous paragraph, given a non-center s∈Cis\in C_{i} for i≠x,yi\neq x,y, we know that pp and ss are centers for CxC_{x} and CyC_{y}. With an identical argument, given t∈Cjt\in C_{j} for j≠x,y,ij\neq x,y,i, we can show that qq and tt are centers for CxC_{x} and CyC_{y}. It follows that SxS_{x} and SyS_{y} both contain points from at least two distinct clusters.

So far, we have shown that by just assuming two points from different clusters are close, we can find a set of k+2k+2 points that (3,3)(3,3)-hits SS. Now we will show that such a set leads to a contradiction under (3,ϵ)(3,\epsilon)-perturbation resilience. Specifically, we will show there exists a perturbation d′d^{\prime} such that any size kk subset can be an optimal set of centers. But it is not possible that all (k+2k){k+2\choose k} of these sets of centers simultaneously create partitions that are ϵ\epsilon-close to OPT\mathcal{OPT}. First we state a lemma which proves there does exist a perturbation d′d^{\prime} such that any size kk subset is an optimal set of centers.

Given a kk-center clustering instance (S,d)(S,d), given z≥0z\geq 0, and given a set C⊆SC\subseteq S of size k+zk+z which (z+1,α)(z+1,\alpha)-hits SS, there exists an α\alpha-metric perturbation d′d^{\prime} such that all size kk subsets of CC are optimal sets of centers under d′d^{\prime}.

Consider the following perturbation d′′d^{\prime\prime}.

By Lemma 4.1, the metric closure d′d^{\prime} of d′′d^{\prime\prime} is an α\alpha-metric perturbation with optimal cost αr∗\alpha r^{*}. Given any size kk subset C′⊆CC^{\prime}\subseteq C, then for all v∈Sv\in S, there is still at least one c∈C′c\in C^{\prime} such that d(c,v)≤αr∗d(c,v)\leq\alpha r^{*}, therefore by construction, d′(c,v)≤αr∗d^{\prime}(c,v)\leq\alpha r^{*}. It follows that C′C^{\prime} is a set of optimal centers under d′d^{\prime}. ∎

Next, we state a fact that helps clusters rank their best centers from the set of k+2k+2 points. For each cluster CiC_{i}, we would like to have a ranking of all points such that for a given d′d^{\prime} and set of kk centers, the center for CiC_{i} is the highest point in the ranking. The following fact shows this ranking is well-defined.

Given a kk-center clustering instance (S,d)(S,d) with optimal clustering C={C1,…,Ck}\mathcal{C}=\{C_{1},\dots,C_{k}\} such that for all i∈[k]i\in[k], ∣Ci∣>2ϵn|C_{i}|>2\epsilon n, let d′d^{\prime} denote an α\alpha-perturbation of dd. There are rankings Rx,d′R_{x,d^{\prime}} for all x∈[k]x\in[k] such that for any optimal set of centers c1′,…,ck′c^{\prime}_{1},\dots,c^{\prime}_{k} under d′d^{\prime}, the center that is closest in d′d^{\prime} to all but ϵn\epsilon n points in CxC_{x} is the highest-ranked point in Rx,d′R_{x,d^{\prime}}. Formally, for each CxC_{x}, there exists a bijection Rx,d′:S→[n]R_{x,d^{\prime}}:S\rightarrow[n] such that for all sets of kk centers CC that achieve the optimal cost under d′d^{\prime}, we have c=argminc′∈CRx,d′(c′)c=\text{argmin}_{c^{\prime}\in C}R_{x,d^{\prime}}(c^{\prime}) if and only if VorC(c)\text{Vor}_{C}(c) is ϵ\epsilon-close to CxC_{x}.

Assume the fact is false. Then there exists a d′d^{\prime}, a cluster CiC_{i}, two points pp and qq, and two sets of kk centers p,q∈Cp,q\in C and p,q∈C′p,q\in C^{\prime} which achieve the optimal cost under d′d^{\prime}, but pp is the center for CiC_{i} in CC while qq is the center for CiC_{i} in C′C^{\prime}. Then pp is closer than all other points in CC to all but ϵn\epsilon n points in CiC_{i}. Similarly, qq is closer than all other points in C′C^{\prime} to all but ϵn\epsilon n points in CiC_{i}. Since ∣Ci∣>2ϵn|C_{i}|>2\epsilon n, this causes a contradiction. ∎

We also define Rx,d′,C:C→[n′]R_{x,d^{\prime},C}:C\rightarrow[n^{\prime}] as the ranking specific to a set of centers CC, where ∣C∣=n′|C|=n^{\prime}. Now we can prove Theorem 6.1.

It suffices to prove that any two points from different clusters are at distance >r∗>r^{*} from each other. Assume towards contradiction that this is not true. Then by Lemma 6.5, there exists a set CC of size k+2k+2 which (3,3)(3,3)-hits SS. From Lemma 6.6, there exists a 3-metric perturbation d′d^{\prime} such that all size kk subsets of CC are optimal sets of centers under d′d^{\prime}. Consider the ranking of each cluster for CC over d′d^{\prime} guaranteed from Fact 6.7. We will show this ranking leads to a contradiction.

Consider the set of all points ranked 1 or 2 by any cluster, formally, {p∈C∣∃i s.t. Ri,d′,C≤2}\{p\in C\mid\exists i\text{ s.t. }R_{i,d^{\prime},C}\leq 2\}. This set is a subset of CC, since we are only considering the rankings of points in CC, so it is size ≤k+2\leq k+2. Note that a point cannot be ranked both 1 and 2 by a cluster. Then as long as k>2k>2, it follows by the Pigeonhole Principle that there exists a point c∈Cc\in C which is ranked in the top two by two different clusters. Formally, there exists xx and yy such that x≠yx\neq y, Rx,d′,C(c)≤2R_{x,d^{\prime},C}(c)\leq 2, and Ry,d′,C(c)≤2R_{y,d^{\prime},C}(c)\leq 2. Denote uu and vv such that Rx,d′,C(u)=1R_{x,d^{\prime},C}(u)=1 and Ry,d′,C(v)=1R_{y,d^{\prime},C}(v)=1. If uu or vv is equal to cc, then redefine it to an arbitrary center in C∖{c,u,v}C\setminus\{c,u,v\}. Consider the set of centers C′=C∖{u,v}C^{\prime}=C\setminus\{u,v\} which is optimal under d′d^{\prime} by construction. But then from Fact 6.7, cc is the center for all but ϵn\epsilon n points in both CxC_{x} and CyC_{y}, contradicting Fact 6.2. This completes the proof. ∎

2 Local perturbation resilience

Now we extend the argument from the previous section to local perturbation resilience. First we state our main structural result, which is that any pair of points from different (3,ϵ)(3,\epsilon)-PR clusters must be distance >r∗>r^{*} from each other. Then we will show how the structural result easily leads to an algorithm for (3,ϵ)(3,\epsilon)-SLPR clusters.

Given a kk-center clustering instance (S,d)(S,d) with optimal radius r∗r^{*} such that all optimal clusters are size >2ϵn>2\epsilon n and there are at least three (3,ϵ)(3,\epsilon)-PR clusters, then for each pair of (3,ϵ)(3,\epsilon)-PR clusters CiC_{i} and CjC_{j}, for all u∈Ciu\in C_{i} and v∈Cjv\in C_{j}, we have d(u,v)>r∗d(u,v)>r^{*}.

Before we prove this theorem, we show how it implies an algorithm to output the optimal (3,ϵ)(3,\epsilon)-SLPR clusters exactly. Since the distance from each point to its closest center is ≤r∗\leq r^{*}, a corollary of Theorem 6.8 is that any 2-approximate solution must contain the optimal (3,ϵ)(3,\epsilon)-SLPR clusters, as long as the 2-approximation satisfies two sensible conditions: (1) for every point vv and its assigned center uu (so we know d(u,v)≤2r∗d(u,v)\leq 2r^{*}), ∃w\exists w such that d(u,w)d(u,w) and d(w,v)d(w,v) are ≤r∗\leq r^{*}, and (2) there cannot be multiple clusters outputted in the 2-approximation that can be combined into one cluster with radius smaller than r∗r^{*}. Both of these properties are easily satisfied using quick pre- or post-processing steps. For condition (1), before running the algorithm, remove all edges of distance >r∗>r^{*}, and then take the metric completion of the resulting graph. For condition (2), given the radius r^\hat{r} of the outputted solution, for each v∈Sv\in S, check if the ball of radius r^\hat{r} around vv captures multiple clusters. If so, combine them.

Given a kk-center clustering instance (S,d)(S,d) such that all optimal clusters are size >2ϵn>2\epsilon n and there are at least three (3,ϵ)(3,\epsilon)-PR clusters, then any 2-approximate solution satisfying conditions (1) and (2) must contain all optimal (3,ϵ)(3,\epsilon)-SLPR clusters.

Given such a clustering instance, then Theorem 6.8 ensures that there is no edge of length r∗r^{*} between points from two different (3,ϵ)(3,\epsilon)-PR clusters. Given a (3,ϵ)(3,\epsilon)-SLPR cluster CiC_{i}, it follows that there is no point v∉Civ\notin C_{i} such that d(v,Ci)≤r∗d(v,C_{i})\leq r^{*}. Therefore, given a 2-approximate solution C\mathcal{C} satisfying condition (1), any u∈Ciu\in C_{i} and v∉Civ\notin C_{i} cannot be in the same cluster. This is because in the graph of datapoints where edges signify a distance ≤r∗\leq r^{*}, CiC_{i} is an isolated component. Finally, by condition (2), CiC_{i} must not be split into two clusters. Therefore, Ci∈CC_{i}\in\mathcal{C}. ∎

The high level idea of this proof is similar to the proof of Theorem 6.1. In fact, the first half is very similar to Lemma 6.5: we show that if two points from different PR clusters are close together, then there must exist a set of k+2k+2 points CC which (3,3)(3,3)-hits the entire point set. In the previous section, we arrived at a contradiction by showing that it is not possible that all (k+2k){k+2\choose k} subsets of CC can be centers that are ϵ\epsilon-close to OPT\mathcal{OPT}. However, the weaker local PR assumption poses a new challenge.

We start with a local perturbation resilience variant of Fact 6.2.

Given a kk-center clustering instance (S,d)(S,d) such that all optimal clusters have size >2ϵn>2\epsilon n, let d′d^{\prime} denote an α\alpha-perturbation with optimal centers C′={c1′,…,ck′}C^{\prime}=\{c^{\prime}_{1},\dots,c^{\prime}_{k}\}. Let C′\mathcal{C^{\prime}} denote the set of (α,ϵ)(\alpha,\epsilon)-PR clusters. Then there exists a one-to-one function f:C′→C′f:\mathcal{C^{\prime}}\rightarrow C^{\prime} such that for all Ci∈C′C_{i}\in\mathcal{C^{\prime}}, ∣VorC,d′(f(Ci))∩Ci∣≥∣Ci∣−ϵn|\text{Vor}_{C,d^{\prime}}(f(C_{i}))\cap C_{i}|\geq|C_{i}|-\epsilon n. That is, the optimal cluster in d′d^{\prime} whose center is f(Ci)f(C_{i}) contains all but ϵn\epsilon n of the points in CiC_{i}.

In words, for any set of optimal centers under an α\alpha-perturbation, each PR cluster can be paired to a unique center. This follows simply because all optimal clusters are size >2ϵn>2\epsilon n, yet under a perturbation, <ϵn<\epsilon n points can switch out of each PR cluster. Because of this fact, for a perturbation d′d^{\prime} with set of optimal centers CC and an (α,ϵ)(\alpha,\epsilon)-PR cluster CxC_{x}, we will say that cc is the center for CxC_{x} under d′d^{\prime} if cc is the center for all but ϵn\epsilon n points in CxC_{x}. Now we are ready to prove the first half of Theorem 6.8, stated in the following lemma. The proof is similar to Lemma 6.5.

This proof is split into two main cases. The first case is the following: there exists a CCC2 for a (3,ϵ)(3,\epsilon)-PR cluster, disregarding a (3,ϵ)(3,\epsilon)-PR cluster. In fact, in this case, we do not need the assumption that two points from different PR clusters are close. If there exists a CCC to a (3,ϵ)(3,\epsilon)-PR cluster, denote the CCC by cxc_{x} and the cluster by CyC_{y}. Otherwise, let cxc_{x} denote a CCC2 to a (3,ϵ)(3,\epsilon)-PR cluster CyC_{y}, disregarding a (3,ϵ)(3,\epsilon)-PR center czc_{z}. Then cxc_{x} is at distance ≤r∗\leq r^{*} to all but ϵn\epsilon n points in CyC_{y}. Therefore, d(cx,cy)≤2r∗d(c_{x},c_{y})\leq 2r^{*} and so cxc_{x} is at distance ≤3r∗\leq 3r^{*} to all points in CyC_{y}. Consider the following perturbation d′′d^{\prime\prime}.

Now partition all the non-centers into two sets SxS_{x} and SyS_{y}, such that Sx={p∣for the majority of points q∈Cx, d(p,q)≤r∗}S_{x}=\{p\mid\text{for the majority of points }q\in C_{x},\text{ }d(p,q)\leq r^{*}\} and Sy={p∣p∉Sx and for the majority of points q∈Cy, d(p,q)≤r∗}S_{y}=\{p\mid p\notin S_{x}\text{ and for the majority of points }q\in C_{y},\text{ }d(p,q)\leq r^{*}\}.

Then given p,q∈Sxp,q\in S_{x}, there exists an s∈Cxs\in C_{x} such that d(p,q)≤d(p,s)+d(s,q)≤2r∗d(p,q)\leq d(p,s)+d(s,q)\leq 2r^{*} (since both points are close to more than half of points in CxC_{x}). Similarly, any two points p,q∈Syp,q\in S_{y} are ≤2r∗\leq 2r^{*} apart.

Now we turn to the other case. Assume there does not exist a CCC2 to a PR cluster, disregarding a PR center. In this case, we need to use the assumption that there exist (3,ϵ)(3,\epsilon)-PR clusters CxC_{x} and CyC_{y}, and p∈Cxp\in C_{x}, q∈Cyq\in C_{y} such that d(p,q)≤r∗d(p,q)\leq r^{*}. Then by the triangle inequality, pp is distance ≤3r∗\leq 3r^{*} to all points in CxC_{x} and CyC_{y}. Consider the following d′′d^{\prime\prime}.

Similar to Case 1, we now partition all the non-centers into two sets SxS_{x} and SyS_{y}, such that Sx={u∣for the majority of points v∈Cx, d(u,v)≤r∗}S_{x}=\{u\mid\text{for the majority of points }v\in C_{x},\text{ }d(u,v)\leq r^{*}\} and Sy={u∣u∉Sx and for the majority of points v∈Cy, d(u,v)≤r∗}S_{y}=\{u\mid u\notin S_{x}\text{ and for the majority of points }v\in C_{y},\text{ }d(u,v)\leq r^{*}\}. As before, each pair of points in SxS_{x} are distance ≤2r∗\leq 2r^{*} apart, and similarly for SyS_{y}. It is no longer true that d(cx,cy)≤2r∗d(c_{x},c_{y})\leq 2r^{*}, however, we can prove that for both SxS_{x} and SyS_{y}, there exist points from two distinct clusters each. From the previous paragraph, given a non-center s∈Cis\in C_{i} for i≠x,yi\neq x,y, we know that pp and ss are centers for CxC_{x} and CyC_{y}. With an identical argument, given t∈Cjt\in C_{j} for j≠x,y,ij\neq x,y,i, we can show that qq and tt are centers for CxC_{x} and CyC_{y}. It follows that SxS_{x} and SyS_{y} both contain points from at least two distinct clusters.

Now we move to the second half of the proof of Theorem 6.8. Recall that the proof from the previous section relied on a ranking argument, in which optimal clusters were mapped to their closest centers from the set CC of k+2k+2 points from the first half of the proof. This is the basis for the following fact.

Given a kk-center clustering instance (S,d)(S,d) with optimal clustering C={C1,…,Ck}\mathcal{C}=\{C_{1},\dots,C_{k}\} such that for all i∈[k]i\in[k], ∣Ci∣>2ϵn|C_{i}|>2\epsilon n, let d′d^{\prime} denote an α\alpha-perturbation of dd and let C′\mathcal{C^{\prime}} denote the set of (α,ϵ)(\alpha,\epsilon)-PR clusters. For each Cx∈C′C_{x}\in\mathcal{C^{\prime}}, there exists a ranking Rx,d′R_{x,d^{\prime}} of SS such that for any set of optimal centers C={c1′,…,ck′}C=\{c^{\prime}_{1},\dots,c^{\prime}_{k}\} under d′d^{\prime}, the center that is closest in d′d^{\prime} to all but ϵn\epsilon n points in CxC_{x} is the highest-ranked point in Rx,d′R_{x,d^{\prime}}. Formally, for each Cx∈C′C_{x}\in\mathcal{C^{\prime}}, there exists a bijection Rx,d′:S→[n]R_{x,d^{\prime}}:S\rightarrow[n] such that for all sets of kk centers CC that achieve the optimal cost under d′d^{\prime}, then c=argminc′∈CRx,d′(c′)c=\text{argmin}_{c^{\prime}\in C}R_{x,d^{\prime}}(c^{\prime}) if and only if VorC(c)\text{Vor}_{C}(c) is ϵ\epsilon-close to CxC_{x}.

Assume the lemma is false. Then there exists an (α,ϵ)(\alpha,\epsilon)-PR cluster CiC_{i}, two distinct points u,v∈Su,v\in S, and two sets of kk centers CC and C′C^{\prime} both containing uu and vv, and both sets achieve the optimal score under an α\alpha-perturbation d′d^{\prime}, but uu is the center for CiC_{i} in CC while vv is the center for CiC_{i} in C′C^{\prime}. Then VorC(u)\text{Vor}_{C}(u) is ϵ\epsilon-close to CiC_{i}; similarly, VorC′(v)\text{Vor}_{C^{\prime}}(v) is ϵ\epsilon-close to CiC_{i}. This implies uu is closer to all but ϵn\epsilon n points in CiC_{i} than vv, and vv is closer to all but ϵn\epsilon n points in CiC_{i} than uu. Since ∣Ci∣>2ϵn|C_{i}|>2\epsilon n, this causes a contradiction. ∎

We also define Rx,d′,C:C→[n′]R_{x,d^{\prime},C}:C\rightarrow[n^{\prime}] as the ranking specific to CC. Recall that our goal is to show a contradiction assuming two points from different PR clusters are close. From Lemma 6.6 and Lemma 6.11, we know there is a set of k+2k+2 points, and any size kk subset is optimal under a suitable perturbation. By Lemma 6.10, each size kk subset must have a mapping from PR clusters to centers, and from Fact 6.12, these mappings are derived from a ranking of all possible center points by the PR clusters. In other words, each PR cluster CxC_{x} can rank all the points in SS, so that for any set of optimal centers for an α\alpha-perturbation, the top-ranked center is the one whose cluster is ϵ\epsilon-close to CxC_{x}. Now, using Fact 6.12, we can try to give a contradiction by showing that there is no set of rankings for the PR clusters that is consistent with all the optimal sets of centers guaranteed by Lemmas 6.6 and 6.11. The following lemma gives relationships among the possible rankings. These will be our main tools for contradicting PR and thus finishing the proof of Theorem 6.8.

Given Cx∈C′C_{x}\in\mathcal{C^{\prime}} and CiC_{i} such that i≠xi\neq x, Rx,d′(cx)<Rx,d′(ci)R_{x,d^{\prime}}(c_{x})<R_{x,d^{\prime}}(c_{i}).

There do not exist s∈Cs\in C and Cx,Cy∈C′C_{x},C_{y}\in\mathcal{C^{\prime}} such that x≠yx\neq y, and Rx,d′,C(s)+Ry,d′,C(s)≤4R_{x,d^{\prime},C}(s)+R_{y,d^{\prime},C}(s)\leq 4.

Given CiC_{i} and Cx∈C′C_{x}\in\mathcal{C^{\prime}} such that x≠ix\neq i, if Rx,d′,C(ci)≤3R_{x,d^{\prime},C}(c_{i})\leq 3, then for all Cy∈C′C_{y}\in\mathcal{C^{\prime}} such that y≠x,iy\neq x,i, Ry,d′,C(p)≥3R_{y,d^{\prime},C}(p)\geq 3 and Ry,d′,C(q)≥3R_{y,d^{\prime},C}(q)\geq 3.

By definition of the optimal clusters, for each s∈Cxs\in C_{x}, d(cx,s)<d(ci,s)d(c_{x},s)<d(c_{i},s), and therefore by construction, d′(cx,s)<d′(ci,s)d^{\prime}(c_{x},s)<d^{\prime}(c_{i},s). It follows that Rx,d′(cx)<Rx,d′(ci)R_{x,d^{\prime}}(c_{x})<R_{x,d^{\prime}}(c_{i}).

Assume there exists s∈Cs\in C and Cx,Cy∈C′C_{x},C_{y}\in\mathcal{C^{\prime}} such that Rx,d′,C(s)+Ry,d′,C(s)≤4R_{x,d^{\prime},C}(s)+R_{y,d^{\prime},C}(s)\leq 4.

Case 1: Rx,d′,C(s)=1R_{x,d^{\prime},C}(s)=1 and Ry,d′,C(s)≤3R_{y,d^{\prime},C}(s)\leq 3. Define uu and vv such that Ry,d′,C(u)=1R_{y,d^{\prime},C}(u)=1 and Ry,d′,C(v)=2R_{y,d^{\prime},C}(v)=2. (If uu or vv is equal to ss, then redefine it to an arbitrary center in C∖{s,u,v}C\setminus\{s,u,v\}.) Consider the set of centers C′=C∖{u,v}C^{\prime}=C\setminus\{u,v\} which is optimal under d′d^{\prime} by Lemma 6.6. By Fact 6.12, ss is the center for all but ϵn\epsilon n points in both CxC_{x} and CyC_{y}, causing a contradiction.

Case 2: Rx,d′,C(s)=2R_{x,d^{\prime},C}(s)=2 and Ry,d′,C(s)=2R_{y,d^{\prime},C}(s)=2. Define uu and vv such that Rx,d′,C(u)=1R_{x,d^{\prime},C}(u)=1 and Ry,d′,C(v)=1R_{y,d^{\prime},C}(v)=1. (Again, if uu or vv is equal to ss, then redefine it to an arbitrary center in C∖{s,u,v}C\setminus\{s,u,v\}.) Consider the set of centers C′=C∖{u,v}C^{\prime}=C\setminus\{u,v\} which is optimal under d′d^{\prime} by Lemma 6.6. However, by Fact 6.12, ss is the center for all but ϵn\epsilon n points in both CxC_{x} and CyC_{y}, causing a contradiction.

Assume Rx,d′,C(ci)≤3R_{x,d^{\prime},C}(c_{i})\leq 3.

Case 1: Rx,d′,C(ci)=2R_{x,d^{\prime},C}(c_{i})=2. Then by Lemma 6.13 part 1, Rx,d′,C(cx)=1R_{x,d^{\prime},C}(c_{x})=1. Consider the set of centers C′=C∖{cx,p}C^{\prime}=C\setminus\{c_{x},p\}, which is optimal under d′d^{\prime}. By Fact 6.12, VorC′(ci)\text{Vor}_{C^{\prime}}(c_{i}) must be ϵ\epsilon-close to CxC_{x}. In particular, VorC′(ci)\text{Vor}_{C^{\prime}}(c_{i}) cannot contain more than ϵn\epsilon n points from CiC_{i}. But by definition, for all j≠ij\neq i and s∈Cis\in C_{i}, d(ci,s)<d(cj,s)d(c_{i},s)<d(c_{j},s). It follows that VorC′(q)\text{Vor}_{C^{\prime}}(q) must contain all but ϵn\epsilon n points from CiC_{i}. Therefore, for all but ϵn\epsilon n points s∈Cis\in C_{i}, for all jj, d′(q,s)<d′(cj,s)d^{\prime}(q,s)<d^{\prime}(c_{j},s). If Ry,d′,C(q)≤2R_{y,d^{\prime},C}(q)\leq 2, then CyC_{y} ranks cyc_{y} or pp number one. Then for the set of centers C′=C∖{cy,p}C^{\prime}=C\setminus\{c_{y},p\}, VorC′(q)\text{Vor}_{C^{\prime}}(q) contains more than ϵn\epsilon n points from CyC_{y} and CiC_{i}, contradicting the fact that CyC_{y} is (3,ϵ)(3,\epsilon)-PR. Therefore, Ry,d′,C(q)≥3R_{y,d^{\prime},C}(q)\geq 3. The argument to show Ry,d′,C(p)≥3R_{y,d^{\prime},C}(p)\geq 3 is symmetric.

Case 2: Rx,d′,C(ci)=3R_{x,d^{\prime},C}(c_{i})=3. If there exists j≠i,xj\neq i,x such that Rx,d′,C(ci)=2R_{x,d^{\prime},C}(c_{i})=2, then without loss of generality we are back in case 1. By Lemma 6.13 part 1, Rx,d′,C(cx)≤2R_{x,d^{\prime},C}(c_{x})\leq 2. Then either pp or qq are ranked top two, without loss of generality Rx,d′,C(p)≤2R_{x,d^{\prime},C}(p)\leq 2. Consider the set C′=C∖{cx,p}C^{\prime}=C\setminus\{c_{x},p\}. Then as in the previous case, VorC′(ci)\text{Vor}_{C^{\prime}}(c_{i}) must be ϵ\epsilon-close to CxC_{x}, implying for all but ϵn\epsilon n points s∈Cis\in C_{i}, for all jj, d′(q,s)<d′(cj,s)d^{\prime}(q,s)<d^{\prime}(c_{j},s). If Ry,d′,C(q)≤2R_{y,d^{\prime},C}(q)\leq 2, again, CyC_{y} ranks cyc_{y} or pp as number one. Let C′=C∖{cy,p}C^{\prime}=C\setminus\{c_{y},p\}, and then VorC′(q)\text{Vor}_{C^{\prime}}(q) contains more than ϵn\epsilon n points from CyC_{y} and CiC_{i}, causing a contradiction. Furthermore, if Ry,d′,C(p)≤2R_{y,d^{\prime},C}(p)\leq 2, then we arrive at a contradiction by Lemma 6.13 part 2.

Given a kk-center clustering instance (S,d)(S,d) such that all optimal clusters are size >2ϵn>2\epsilon n, given an (α,ϵ)(\alpha,\epsilon)-PR cluster CxC_{x}, and given i≠xi\neq x, then there are fewer than ϵn\epsilon n points s∈Cxs\in C_{x} such that d(ci,s)≤min⁡(r∗,αd(cx,s))d(c_{i},s)\leq\min(r^{*},\alpha d(c_{x},s)).

Assume the fact is false. Then let B⊆CxB\subseteq C_{x} denote a set of size ϵn\epsilon n such that for all s∈Bs\in B, d(ci,s)≤min⁡(r∗,αd(cx,s))d(c_{i},s)\leq\min(r^{*},\alpha d(c_{x},s)). Construct the following perturbation d′d^{\prime}. For all s∈Bs\in B, set d′(cx,s)=αd(cx,s)d^{\prime}(c_{x},s)=\alpha d(c_{x},s). For all other pairs s,ts,t, set d′(s,t)=d(s,t)d^{\prime}(s,t)=d(s,t). This is clearly an α\alpha-perturbation by construction. Then the original set of optimal centers still achieves cost r∗r^{*} under d′d^{\prime} because for all s∈Bs\in B, d′(ci,s)≤r∗d^{\prime}(c_{i},s)\leq r^{*}. Clearly, the optimal cost under d′d^{\prime} cannot be <r∗<r^{*}. It follows that the original set of optimal centers CC is still optimal under d′d^{\prime}. However, all points in BB are no longer in VorC(cx)\text{Vor}_{C}(c_{x}) under d′d^{\prime}, contradicting the fact that CxC_{x} is (α,ϵ)(\alpha,\epsilon)-PR. ∎

Case 1: d(cx′,s)>r∗d(c_{x}^{\prime},s)>r^{*}. Then by construction, d′(cx′,s)≥3r∗d^{\prime}(c_{x}^{\prime},s)\geq 3r^{*}, and so d′(p,s)≤d′(cx′,s)d^{\prime}(p,s)\leq d^{\prime}(c_{x}^{\prime},s).

Case 2: 3d(cx,s)<d(cx′,s)3d(c_{x},s)<d(c_{x}^{\prime},s). Then

Because Rx,d′,C(p)<Rx,d′,C(cx′)R_{x,d^{\prime},C}(p)<R_{x,d^{\prime},C}(c_{x}^{\prime}), and Rx,d′,C(cx)<Rx,d′,C(cx′)R_{x,d^{\prime},C}(c_{x})<R_{x,d^{\prime},C}(c_{x}^{\prime}), it follows that the top two can only be cxc_{x}, pp, or qq. Therefore, either Rx,d′,C(p)≤2R_{x,d^{\prime},C}(p)\leq 2 or Rx,d′,C(q)≤2R_{x,d^{\prime},C}(q)\leq 2. The rest of the argument is broken up into cases.

Case 1: Rx,d′,C(cx′)≤3R_{x,d^{\prime},C}(c_{x}^{\prime})\leq 3. From Lemma 6.13 part 3, then Ry,d′,C(p)≥3R_{y,d^{\prime},C}(p)\geq 3 and Ry,d′,C(q)≥3R_{y,d^{\prime},C}(q)\geq 3. It follows by process of elimination that Ry,d′,C(cy)=1R_{y,d^{\prime},C}(c_{y})=1 and Ry,d′,C(cy′)=2R_{y,d^{\prime},C}(c_{y^{\prime}})=2. Again by Lemma 6.13 part 3, Rx,d′,C(p)≥3R_{x,d^{\prime},C}(p)\geq 3 and Rx,d′,C(q)≥3R_{x,d^{\prime},C}(q)\geq 3, causing a contradiction.

Case 2: Rx,d′,C(cx′)>3R_{x,d^{\prime},C}(c_{x^{\prime}})>3 and Ry,d′,C(cy′)≤3R_{y,d^{\prime},C}(c_{y^{\prime}})\leq 3. Then Rx,d′,C(p)≤3R_{x,d^{\prime},C}(p)\leq 3 and Rx,d′,C(q)≤3R_{x,d^{\prime},C}(q)\leq 3. From Lemma 6.13 part 3, Rx,d′,C(p)≥3R_{x,d^{\prime},C}(p)\geq 3 and Rx,d′,C(q)≥3R_{x,d^{\prime},C}(q)\geq 3, therefore we have a contradiction. Note, the case where Rx,d′,C(cx′)>3R_{x,d^{\prime},C}(c_{x^{\prime}})>3 and Rz,d′,C(cz′)≤3R_{z,d^{\prime},C}(c_{z^{\prime}})\leq 3 is identical to this case.

Case 3: The final case is when Rx,d′,C(cx′)>3R_{x,d^{\prime},C}(c_{x^{\prime}})>3, Ry,d′,C(cy′)>3R_{y,d^{\prime},C}(c_{y^{\prime}})>3, and Rz,d′,C(cz′)>3R_{z,d^{\prime},C}(c_{z^{\prime}})>3. So for each i∈{x,y,z}i\in\{x,y,z\}, the top three for CiC_{i} in CC is a permutation of {ci,p,q}\{c_{i},p,q\}. Then each i∈{x,y,z}i\in\{x,y,z\} must rank pp or qq in the top two, so by the Pigeonhole Principle, either pp or qq is ranked top two by two different PR clusters, contradicting Lemma 6.13. This completes the proof. ∎

We note that Case 3 in Theorem 6.8 is the reason why we need to assume there are at least three (3,ϵ)(3,\epsilon)-PR clusters. If there are only two, CxC_{x} and CyC_{y}, it is possible that there exist u∈Cxu\in C_{x}, v∈Cyv\in C_{y} such that d(u,v)≤r∗d(u,v)\leq r^{*}. In this case, for p,q,d′,p,q,d^{\prime}, and CC as defined in the proof of Theorem 6.8, if CxC_{x} ranks cxc_{x}, pp, qq as its top three and CyC_{y} ranks cyc_{y}, qq, pp as its top three, then there is no contradiction.

3 Asymmetric k𝑘k-center

Now we consider asymmetric kk-center under (3,ϵ)(3,\epsilon)-PR. The asymmetric case is a more challenging setting, and our algorithm does not return the optimal solution, however, our algorithm outputs a clustering that is ϵ\epsilon-close to the optimal solution.

Recall the definition of the symmetric set AA from Section 3, A={p∣∀q,d(q,p)≤r∗  ⟹  d(p,q)≤r∗}A=\{p\mid\forall q,d(q,p)\leq r^{*}\implies d(p,q)\leq r^{*}\}, equivalently, the set of all CCV’s. We might first ask whether AA respects the structure of OPT\mathcal{OPT}, as it did under 2-perturbation resilience. Namely, whether Condition 1: all optimal centers are in AA, and Condition 2: arg⁡min⁡q∈Ad(q,p)∈Ci  ⟹  p∈Ci\arg\min_{q\in A}d(q,p)\in C_{i}\implies p\in C_{i} hold. In fact, we will show that neither conditions hold in the asymmetric case, but both conditions are only slightly violated.

First we give upper and lower bounds on the number of optimal centers in AA, which will help us construct an algorithm for (3,ϵ)(3,\epsilon)-PR later on. We call a center cic_{i} “bad” if it is not in the set AA, i.e., ∃q\exists q such that d(q,ci)≤r∗d(q,c_{i})\leq r^{*} but d(ci,q)>r∗d(c_{i},q)>r^{*}. First we give an example of a (3,ϵ)(3,\epsilon)-PR instance with at least one bad center, and then we show that all (3,ϵ)(3,\epsilon)-PR instances must have at most 6 bad centers.

Now we show there are at most 6 bad centers for any asymmetric kk-center instance satisfying (3,ϵ)(3,\epsilon)-PR.

Given a (3,ϵ)(3,\epsilon)-perturbation resilient asymmetric kk-center instance such that all optimal clusters are size >2ϵn>2\epsilon n, there are at most 6 bad centers, i.e., at most 6 centers cic_{i} such that ∃q\exists q with d(q,ci)≤r∗d(q,c_{i})\leq r^{*} and d(ci,q)>r∗d(c_{i},q)>r^{*}.

Assume the lemma is false. By assumption, there exists a set BB, ∣B∣≥7|B|\geq 7, of centers cic_{i} such that ∃q\exists q with d(q,ci)≤r∗d(q,c_{i})\leq r^{*} and d(ci,q)>r∗d(c_{i},q)>r^{*}. The first step is to use this set of bad centers to construct a set CC of ≤k−3\leq k-3 points which are ≤3r∗\leq 3r^{*} from every point in SS. Once we find CC, we will show how this set cannot exist under (3,ϵ)(3,\epsilon)-perturbation resilience, causing a contradiction.

Given a center ci∈Bc_{i}\in B, and qq such that d(q,ci)≤r∗d(q,c_{i})\leq r^{*} and d(ci,q)>r∗d(c_{i},q)>r^{*}, note that d(ci,q)>r∗d(c_{i},q)>r^{*} implies q∉Ciq\notin C_{i}. For each ci∈Bc_{i}\in B, define a(i)a(i) as the center of qq’s cluster. Then d(a(i),ci)≤d(a(i),q)+d(q,ci)≤2r∗d(a(i),c_{i})\leq d(a(i),q)+d(q,c_{i})\leq 2r^{*} and so for all p∈Cip\in C_{i}, we have d(a(i),p)≤d(a(i),ci)+d(ci,p)≤3r∗d(a(i),p)\leq d(a(i),c_{i})+d(c_{i},p)\leq 3r^{*}. If for each ci∈Bc_{i}\in B, a(i)a(i) is not in BB, then we would be able to remove BB from the set of optimal centers, and the remaining centers are still distance 3r∗3r^{*} from all points in SS (finishing the first half of the proof). However, we need to consider the case where there exist centers cic_{i} in BB such that a(i)a(i) is also in BB. Our goal is to show there exists a subset B′⊆BB^{\prime}\subseteq B of size 3, such that for each ci∈B′c_{i}\in B^{\prime}, a(i)∉B′a(i)\notin B^{\prime}, therefore, the set of optimal centers without B′B^{\prime} is still distance 3r∗3r^{*} from all points in SS.

Construct a directed graph G=(B,E)G=(B,E) where E={(ci,c)∣c=a(i)}E=\{(c_{i},c)\mid c=a(i)\}. Then every point has out-degree ≤1\leq 1. Finding B′B^{\prime} corresponds to finding ≥3\geq 3 points with no edges to one another, i.e., an independent set of GG. Consider a connected component G′=(V′,E′)G^{\prime}=(V^{\prime},E^{\prime}) of GG. Since V′V^{\prime} is connected, we have ∣E′∣≥∣V′∣−1|E^{\prime}|\geq|V^{\prime}|-1. Since every vertex has out-degree ≤1\leq 1, ∣E′∣≤∣V′∣|E^{\prime}|\leq|V^{\prime}|. Then we have two cases.

Case 1: ∣E′∣=∣V′∣−1|E^{\prime}|=|V^{\prime}|-1. Then G′G^{\prime} is a tree, and so there must exist an independent set of size ⌈∣V′∣2⌉\left\lceil\frac{|V^{\prime}|}{2}\right\rceil.

Case 2: ∣E′∣=∣V′∣|E^{\prime}|=|V^{\prime}|. Then G′G^{\prime} contains a cycle, and so there exists an independent set of size ⌊∣V′∣2⌋\left\lfloor\frac{|V^{\prime}|}{2}\right\rfloor.

It follows that we can always find an independent set of size ⌊∣V′∣2⌋\left\lfloor\frac{|V^{\prime}|}{2}\right\rfloor for the entire graph GG. For ∣B∣≥7|B|\geq 7, there exists such a set B′B^{\prime} of size ≥3\geq 3. Then we have the property that ci∈B′  ⟹  a(i)∉B′c_{i}\in B^{\prime}\implies a(i)\notin B^{\prime}.

We pick five arbitrary points p1,p2,p3,p4,p5∈S∖Cp_{1},p_{2},p_{3},p_{4},p_{5}\in S\setminus C, and define C′=C∪{p1,p2,p3,p4,p5}C^{\prime}=C\cup\{p_{1},p_{2},p_{3},p_{4},p_{5}\}. From the above paragraph, each size 3 subset P⊆{p1,p2,p3,p4,p5}P\subseteq\{p_{1},p_{2},p_{3},p_{4},p_{5}\} added to CC will result in a set of optimal centers under d′d^{\prime}. Then by Fact 6.2, each point in C∪PC\cup P must be the center for the majority of points in exactly one cluster. To obtain a contradiction, we consider the ranking defined by Fact 6.7 of C′C^{\prime} over d′d^{\prime}.

We we start with a claim about the rankings: for each c′∈C′c^{\prime}\in C^{\prime}, for all pairs x,yx,y such that x≠yx\neq y, if ∄c∈C\nexists c\in C such that Rx,d′,C′(c)<Rx,d′,C′(c′)R_{x,d^{\prime},C^{\prime}}(c)<R_{x,d^{\prime},C^{\prime}}(c^{\prime}) or Ry,d′,C′(c)<Ry,d′,C′(c′)R_{y,d^{\prime},C^{\prime}}(c)<R_{y,d^{\prime},C^{\prime}}(c^{\prime}), then Rx,d′,C′(c′)+Ry,d′,C′(c′)≥5R_{x,d^{\prime},C^{\prime}}(c^{\prime})+R_{y,d^{\prime},C^{\prime}}(c^{\prime})\geq 5. In words, there cannot be two clusters such that c′c^{\prime} is ranked first among C∪{c′}C\cup\{c^{\prime}\} and top two (or first and third) among C′C^{\prime} for both clusters. Assume this is false. Then there exist x≠yx\neq y such that Rx,d′,C′(c′)+Ry,d′,C′(c′)≤4R_{x,d^{\prime},C^{\prime}}(c^{\prime})+R_{y,d^{\prime},C^{\prime}}(c^{\prime})\leq 4, so there are at most two total points ranked above c′c^{\prime} in Rx,d′,C′R_{x,d^{\prime},C^{\prime}} and Ry,d′,C′R_{y,d^{\prime},C^{\prime}}, and these points must be from the set {p1,p2,p3,p4,p5}\{p_{1},p_{2},p_{3},p_{4},p_{5}\}. Without loss of generality, denote these points by pp and p′p^{\prime} (if there are one or zero points ranked above c′c^{\prime}, let one or both of pp and p′p^{\prime} be arbitrary). Then consider the set of centers C′∖{p,p′}C^{\prime}\setminus\{p,p^{\prime}\} which is size kk and must be optimal under d′d^{\prime} as described earlier. However, the partitioning is not ϵ\epsilon-close to OPT\mathcal{OPT}, since c′c^{\prime} is the best center (ranked 1) for both CxC_{x} and CyC_{y}. This completes the proof of the claim.

Now consider the set D={ci∈C∣∃x s.t. Rx,d′,C′(ci)=1}D=\{c_{i}\in C\mid\exists x\text{ s.t. }R_{x,d^{\prime},C^{\prime}}(c_{i})=1\}, i.e., the set of points in CC which are ranked 1 for some cluster. Denote m=(k−3)−∣D∣m=(k-3)-|D|, which is the number of points in CC which are not ranked 1 for any cluster. By the claim and since ∣C∣=k−3|C|=k-3, there are exactly m+3m+3 clusters whose top-ranked point is not in CC. Given one such cluster CxC_{x}, again by the claim, the top two ranked points must not be from the set DD. Therefore, there are 2(m+3)2(m+3) slots that must be filled by m+5m+5 points, so (for all m≥0m\geq 0) by the Pigeonhole Principle, there must exist a point p∈C′p\in C^{\prime} ranked in the top two by two different clusters. This directly contradicts the claim, so we have a contradiction which completes the proof. ∎

3.2 Algorithm under (3,ϵ)3italic-ϵ(3,\epsilon)-PR

From the previous lemma, we know that at most a constant number of centers are bad. Essentially, our algorithm runs a symmetric 2-approximation algorithm on AA, for all k−6≤k′≤kk-6\leq k^{\prime}\leq k, to find a 2-approximation for the clusters in AA. For instance, iteratively pick an unmarked point, and mark all points distance 2r∗2r^{*} away from it (Hochbaum and Shmoys, 1985). Then we use brute force to find the remaining 6 centers, which will give us a 3-approximation for the entire point set. Under (3,ϵ)(3,\epsilon)-perturbation resilience, this 3-approximation must be ϵ\epsilon-close to OPT\mathcal{OPT}. We are not able to output OPT\mathcal{OPT} exactly, since Condition 2 may not be satisfied for up to ϵn\epsilon n points. The asymmetric kk-center algorithm runs an approximation algorithm for symmetric kk-center as a subroutine. The symmetric kk-center instance (S,A,d)(S,A,d) is a generalization: the set of allowable centers AA is a subset of the points SS to be clustered. The classic 2-approximation algorithms for kk-center apply to this setting as well.

Algorithm 5 runs in polynomial time and outputs a clustering that is ϵ\epsilon-close to OPT\mathcal{OPT}, for (3,ϵ)(3,\epsilon)-perturbation resilient asymmetric kk-center instances such that all optimal clusters are size >2ϵn>2\epsilon n.

We define three types of clusters. A cluster CiC_{i} is green if ci∈Ac_{i}\in A, it is yellow if ci∉Ac_{i}\notin A but Ci∩A≠∅C_{i}\cap A\neq\emptyset, and it is red if Ci∩A=∅C_{i}\cap A=\emptyset. Denote the number of yellow clusters by yy, and the number of red clusters by xx. From Lemma 6.16, we know that x+y≤6x+y\leq 6. The symmetric kk-center instance (S,A,d′)(S,A,d^{\prime}) constructed in step 2 of the algorithm is a subset of an instance with k−xk-x optimal clusters of cost r∗r^{*}, so the (k−x)(k-x)-center cost of (S,A,d′)(S,A,d^{\prime}) is at most r∗r^{*}. Therefore, step 3 will return a set of centers achieving cost ≤2r∗\leq 2r^{*} for some k′≤k−xk^{\prime}\leq k-x. By definition of green clusters, we know that k−x−yk-x-y clusters have their optimal center in AA. For each green cluster CiC_{i}, let c(i)∈Cc(i)\in C denote the center which is distance ≤2r∗\leq 2r^{*} to cic_{i} (if there is more than one point in CC, denote c(i)c(i) by one of them arbitrarily). Let C′={c(i)∣Ci is green}C^{\prime}=\{c(i)\mid C_{i}\text{ is green}\}, and ∣C′∣≤k−x−y|C^{\prime}|\leq k-x-y. Then the set C′∪{cx∣x is not green}C^{\prime}\cup\{c_{x}\mid x\text{ is not green}\} is cost ≤3r∗\leq 3r^{*}, and the algorithm is guaranteed to encounter this set in the final step.

Finally, we explain why C′∪{cx∣x is not green}C^{\prime}\cup\{c_{x}\mid x\text{ is not green}\} must be ϵ\epsilon-close to OPT\mathcal{OPT}. Let B={cx∣x is not green}B=\{c_{x}\mid x\text{ is not green}\}. Create a 3-perturbation in which we increase all distances by 3, except for the distances from C′∪BC^{\prime}\cup B to all points in their Voronoi tile, which we increase up to 3r∗3r^{*}. Then, the optimal score is 3r∗3r^{*} by Lemma 4.1, and C′∪BC^{\prime}\cup B achieves this score. Therefore, by (3,ϵ)(3,\epsilon)-perturbation resilience, the Voronoi tiling of C′∪BC^{\prime}\cup B must be ϵ\epsilon-close to OPT\mathcal{OPT}. This completes the proof. ∎

4 APX-Hardness under perturbation resilience

Now we show hardness of approximation even when it is guaranteed the clustering satisfies (α,ϵ)(\alpha,\epsilon)-perturbation resilience for α≥1\alpha\geq 1 and ϵ>0\epsilon>0. The hardness is based on a reduction from the general clustering instances, so the APX-hardness constants match the non-stable APX-hardness results. This shows the condition on the cluster sizes in Theorem 6.1 is tight. In fact, this hardness holds even under the strictly stronger notion of approximation stability (Balcan et al., 2013), therefore, it generalizes a hardness result by Balcan et al. (2013).

Given α≥1\alpha\geq 1, ϵ>0\epsilon>0, it is NP-hard to approximate kk-center to 2, kk-median to 1.731.73, or kk-means to 3.94, even when it is guaranteed the instance satisfies (α,ϵ)(\alpha,\epsilon)-perturbation resilience.

Given α≥1\alpha\geq 1, ϵ>0\epsilon>0, assume there exists a β\beta-approximation algorithm A\mathcal{A} for kk-median under (α,ϵ)(\alpha,\epsilon)-perturbation resilience. We will show a reduction to kk-median without perturbation resilience. Given a kk-median clustering instance (S,d)(S,d) of size nn, we will create a new instance (S′,d′)(S^{\prime},d^{\prime}) for k′=k+n/ϵk^{\prime}=k+n/\epsilon with size n′=n/ϵn^{\prime}=n/\epsilon as follows. First, set S′=SS^{\prime}=S and d′=dd^{\prime}=d, and then add n/ϵn/\epsilon new points to S′S^{\prime}, such that their distance to every other point is 2αnmax⁡u,v∈Sd(u,v)2\alpha n\max_{u,v\in S}d(u,v). Let OPT\mathcal{OPT} denote the optimal solution of (S,d)(S,d). Then the optimal solution to (S′,d′)(S^{\prime},d^{\prime}) is to use OPT\mathcal{OPT} for the vertices in SS, and make each of the n/ϵn/\epsilon added points a center. Note that the cost of OPT\mathcal{OPT} and the optimal clustering for (S′,d′)(S^{\prime},d^{\prime}) are identical, since the added points are distance 0 to their center. Given a clustering C\mathcal{C} on (S,d)(S,d), let C′\mathcal{C}^{\prime} denote the clustering of (S′,d′)(S^{\prime},d^{\prime}) that clusters SS as in C\mathcal{C}, and then adds n/ϵn/\epsilon extra centers on each of the added points. Then the cost of C\mathcal{C} and C′\mathcal{C}^{\prime} are the same, so it follows that C\mathcal{C} is a β\beta-approximation to (S,d)(S,d) if and only if C′\mathcal{C}^{\prime} is a β\beta-approximation to (S′,d′)(S^{\prime},d^{\prime}). Next, we claim that (S′,d′)(S^{\prime},d^{\prime}) satisfies (α,ϵ)(\alpha,\epsilon)-perturbation resilience. Given a clustering C′\mathcal{C}^{\prime} which is an α\alpha-approximation to (S′,d′)(S^{\prime},d^{\prime}), then there must be a center located at all n/ϵn/\epsilon of the added points, otherwise the cost of C′\mathcal{C}^{\prime} would be >αOPT>\alpha\mathcal{OPT}. Therefore, C′\mathcal{C}^{\prime} agrees with the optimal solution on all points except for SS, therefore, C′\mathcal{C}^{\prime} must be ϵ\epsilon-close to the optimal solution. Now that we have established a reduction, the theorem follows from hardness of 1.731.73-approximation for kk-median (Jain et al., 2002). The proofs for kk-center and kk-means are identical, using hardness from (Gonzalez, 1985) and (Jain et al., 2002), respectively. ∎

Conclusion

Our work pushes the understanding of (promise) stability conditions farther in several ways. We are the first to design computationally efficient algorithms to find the optimal clustering under α\alpha-perturbation resilience with a constant value of α\alpha for a problem that is hard to approximate to any constant factor in the worst case, thereby demonstrating the power of perturbation resilience. Furthermore, we demonstrate the limits of this power by showing the first tight results in this space for perturbation resilience. Our work also shows a surprising relation between symmetric and asymmetric instances, in that they are equivalent under resilience to 2-perturbations, which is in stark contrast to their widely differing tight approximation factors. Finally, we initiate the study of clustering under local stability. We define a local notion of perturbation resilience, and we give algorithms that simultaneously output all optimal clusters satisfying local stability, while ensuring the worst-case approximation guarantee. Although α=2\alpha=2 is tight for kk-center, the best value of perturbation resilience for symmetric kk-median and other center-based objectives is not known. Currently, the best upper bound is α=2\alpha=2 (Angelidakis et al., 2017), but no lower bounds are known for α=1+ϵ\alpha=1+\epsilon, for constant ϵ>0\epsilon>0.

Acknowledgments

This work was supported in part by NSF grants CCF 1535967, CCF-1422910, CCF-145117, IIS-1618714, a Sloan Research Fellowship, a Microsoft Research Faculty Fellowship, a Google Research Award, an IBM Ph.D. fellowship, a National Defense Science & Engineering Graduate (NDSEG) fellowship, and by the generosity of Eric and Wendy Schmidt by recommendation of the Schmidt Futures program.

References