Parameterized approximation algorithm
A parameterized approximation algorithm is a type of algorithm that aims to find approximate solutions to NP-hard optimization problems in polynomial time in the input size and a function of a specific parameter. These algorithms are designed to combine the best aspects of both traditional approximation algorithms and fixed-parameter tractability.
In traditional approximation algorithms, the goal is to find solutions that are at most a certain factor α away from the optimal solution, known as an α-approximation, in polynomial time. On the other hand, parameterized algorithms are designed to find exact solutions to problems, but with the constraint that the running time of the algorithm is polynomial in the input size and a function of a specific parameter k. The parameter describes some property of the input and is small in typical applications. The problem is said to be fixed-parameter tractable (FPT) if there is an algorithm that can find the optimum solution in time, where is a function independent of the input size n.
A parameterized approximation algorithm aims to find a balance between these two approaches by finding approximate solutions in FPT time: the algorithm computes an α-approximation in time, where is a function independent of the input size n. This approach aims to overcome the limitations of both traditional approaches by having stronger guarantees on the solution quality compared to traditional approximations while still having efficient running times as in FPT algorithms. An overview of the research area studying parameterized approximation algorithms can be found in the survey of Marx[1] and the more recent survey by Feldmann et al.[2]
Obtainable approximation ratios
editThe full potential of parameterized approximation algorithms is utilized when a given optimization problem is shown to admit an α-approximation algorithm running in time, while in contrast the problem neither has a polynomial-time α-approximation algorithm (under some complexity assumption, e.g., ), nor an FPT algorithm for the given parameter k (i.e., it is at least W[1]-hard).
For example, some problems that are APX-hard and W[1]-hard admit a parameterized approximation scheme (PAS), i.e., for any a -approximation can be computed in time for some functions f and g. This then circumvents the lower bounds in terms of polynomial-time approximation and fixed-parameter tractability. A PAS is similar in spirit to a polynomial-time approximation scheme (PTAS) but additionally exploits a given parameter k. Since the degree of the polynomial in the runtime of a PAS depends on a function , the value of is assumed to be arbitrary but constant in order for the PAS to run in FPT time. If this assumption is unsatisfying, is treated as a parameter as well to obtain an efficient parameterized approximation scheme (EPAS), which for any computes a -approximation in time for some function f. This is similar in spirit to an efficient polynomial-time approximation scheme (EPTAS).
k-cut
editThe k-cut problem has no polynomial-time -approximation algorithm for any , assuming and the small set expansion hypothesis.[3] It is also W[1]-hard parameterized by the number k of required components.[4] However an EPAS exists, which computes a -approximation in time.[5]
Steiner Tree
editThe Steiner Tree problem is FPT parameterized by the number of terminals.[6] However, for the "dual" parameter consisting of the number k of non-terminals contained in the optimum solution, the problem is W[2]-hard (due to a folklore reduction from the Dominating Set problem). Steiner Tree is also known to be APX-hard.[7] However, there is an EPAS computing a -approximation in time.[8] The more general Steiner Forest problem is NP-hard on graphs of treewidth 3. However, on graphs of treewidth t an EPAS can compute a -approximation in time.[9]
Strongly-connected Steiner subgraph
editIt is known that the Strongly Connected Steiner Subgraph problem is W[1]-hard parameterized by the number k of terminals,[10] and also does not admit an -approximation in polynomial time (under standard complexity assumptions).[11] However a 2-approximation can be computed in time.[12] Furthermore, this is best possible, since no -approximation can be computed in time for any function f, under Gap-ETH.[13]
k-median and k-means
editFor the well-studied metric clustering problems of k-median and k-means parameterized by the number k of centers, it is known that no -approximation for k-Median and no -approximation for k-Means can be computed in time for any function f, under Gap-ETH.[14] Matching parameterized approximation algorithms exist,[14] but it is not known whether matching approximations can be computed in polynomial time.
Clustering is often considered in settings of low dimensional data, and thus a practically relevant parameterization is by the dimension of the underlying metric. In the Euclidean space, the k-Median and k-Means problems admit an EPAS parameterized by the dimension d,[15][16] and also an EPAS parameterized by k.[17][18] The former was generalized to an EPAS for the parameterization by the doubling dimension.[19] For the loosely related highway dimension parameter, only an approximation scheme with XP runtime is known to date.[20]
k-center
editFor the metric k-center problem a 2-approximation can be computed in polynomial time. However, when parameterizing by either the number k of centers,[21] the doubling dimension (in fact the dimension of a Manhattan metric),[22] or the highway dimension,[21] no parameterized -approximation algorithm exists, under standard complexity assumptions. Furthermore, the k-Center problem is W[1]-hard even on planar graphs when simultaneously parameterizing it by the number k of centers, the doubling dimension, the highway dimension, and the pathwidth.[23] However, when combining k with the doubling dimension an EPAS exists,[23] and the same is true when combining k with the highway dimension.[24] For the more general version with vertex capacities, an EPAS exists for the parameterization by k and the doubling dimension, but not when using k and the highway dimension as the parameter.[25] Regarding the pathwidth, k-Center admits an EPAS even for the more general treewidth parameter, and also for cliquewidth.[26]
Densest subgraph
editAn optimization variant of the k-Clique problem is the Densest k-Subgraph problem (which is a 2-ary Constraint Satisfaction problem), where the task is to find a subgraph on k vertices with maximum number of edges. It is not hard to obtain a -approximation by just picking a matching of size in the given input graph, since the maximum number of edges on k vertices is always at most . This is also asymptotically optimal, since under Gap-ETH no -approximation can be computed in FPT time parameterized by k.[27]
Dominating set
editFor the Dominating set problem it is W[1]-hard to compute any -approximation in time for any functions g and f.[28]
Approximate kernelization
editKernelization is a technique used in fixed-parameter tractability to pre-process an instance of an NP-hard problem in order to remove "easy parts" and reveal the NP-hard core of the instance. A kernelization algorithm takes an instance I and a parameter k, and returns a new instance with parameter such that the size of and is bounded as a function of the input parameter k, and the algorithm runs in polynomial time. An α-approximate kernelization algorithm is a variation of this technique that is used in parameterized approximation algorithms. It returns a kernel such that any β-approximation in can be converted into an αβ-approximation to the input instance I in polynomial time. This notion was introduced by Lokshtanov et al.,[29] but there are other related notions in the literature such as Turing kernels[30] and α-fidelity kernelization.[31]
As for regular (non-approximate) kernels, a problem admits an α-approximate kernelization algorithm if and only if it has a parameterized α-approximation algorithm. The proof of this fact is very similar to the one for regular kernels.[29] However the guaranteed approximate kernel might be of exponential size (or worse) in the input parameter. Hence it becomes interesting to find problems that admit polynomial sized approximate kernels. Furthermore, a polynomial-sized approximate kernelization scheme (PSAKS) is an α-approximate kernelization algorithm that computes a polynomial-sized kernel and for which α can be set to for any .
For example, while the Connected Vertex Cover problem is FPT parameterized by the solution size, it does not admit a (regular) polynomial sized kernel (unless ), but a PSAKS exists.[29] Similarly, the Steiner Tree problem is FPT parameterized by the number of terminals, does not admit a polynomial sized kernel (unless ), but a PSAKS exists.[29] When parameterizing Steiner Tree by the number of non-terminals in the optimum solution, the problem is W[2]-hard (and thus admits no exact kernel at all, unless FPT=W[2]), but still admits a PSAKS.[8]
Talks on parameterized approximations
edit- Daniel Lokshtanov: A Parameterized Approximation Scheme for k-Min Cut
- Tuukka Korhonen: Single-Exponential Time 2-Approximation Algorithm for Treewidth
- Karthik C. S.: Recent Hardness of Approximation results in Parameterized Complexity
- Ariel Kulik. Two-variable Recurrence Relations with Application to Parameterized Approximations
- Meirav Zehavi. FPT Approximation
- Vincent Cohen-Added: On the Parameterized Complexity of Various Clustering Problems
- Fahad Panolan. Parameterized Approximation for Independent Set of Rectangles
- Andreas Emil Feldmann. Approximate Kernelization Schemes for Steiner Networks
References
edit- ^ Marx, Daniel (2008). "Parameterized Complexity and Approximation Algorithms". The Computer Journal. 51 (1): 60–78. doi:10.1093/comjnl/bxm048.
- ^ Feldmann, Andreas Emil; Karthik C. S; Lee, Euiwoong; Manurangsi, Pasin (2020). "A Survey on Approximation in Parameterized Complexity: Hardness and Algorithms". Algorithms. 13 (6): 146. arXiv:2006.04411. doi:10.3390/a13060146. ISSN 1999-4893. This article incorporates text from this source, which is available under the CC BY 4.0 license.
- ^ Manurangsi, Pasin (2018). "Inapproximability of Maximum Biclique Problems, Minimum k-Cut and Densest At-Least-k-Subgraph from the Small Set Expansion Hypothesis". Algorithms. 11 (1): 10. arXiv:1705.03581. doi:10.3390/a11010010. ISSN 1999-4893.
- ^ G. Downey, Rodney; Estivill-Castro, Vladimir; Fellows, Michael; Prieto, Elena; Rosamund, Frances A. (April 1, 2003). "Cutting Up Is Hard To Do: The Parameterised Complexity of k-Cut and Related Problems". Electronic Notes in Theoretical Computer Science. CATS'03, Computing: the Australasian Theory Symposium. 78: 209–222. doi:10.1016/S1571-0661(04)81014-4. hdl:10230/36518. ISSN 1571-0661.
- ^ Lokshtanov, Daniel; Saurabh, Saket; Surianarayanan, Vaishali (April 25, 2022). "A Parameterized Approximation Scheme for Min $k$-Cut". SIAM Journal on Computing: FOCS20–205. arXiv:2005.00134. doi:10.1137/20M1383197. ISSN 0097-5397.
- ^ Dreyfus, S. E.; Wagner, R. A. (1971). "The steiner problem in graphs". Networks. 1 (3): 195–207. doi:10.1002/net.3230010302.
- ^ Chlebík, Miroslav; Chlebíková, Janka (October 31, 2008). "The Steiner tree problem on graphs: Inapproximability results". Theoretical Computer Science. Algorithmic Aspects of Global Computing. 406 (3): 207–214. doi:10.1016/j.tcs.2008.06.046. ISSN 0304-3975.
- ^ a b Dvořák, Pavel; Feldmann, Andreas E.; Knop, Dušan; Masařík, Tomáš; Toufar, Tomáš; Veselý, Pavel (January 1, 2021). "Parameterized Approximation Schemes for Steiner Trees with Small Number of Steiner Vertices". SIAM Journal on Discrete Mathematics. 35 (1): 546–574. arXiv:1710.00668. doi:10.1137/18M1209489. ISSN 0895-4801. S2CID 3581913.
- ^ Feldmann, Andreas Emil; Lampis, Michael (2024). "Parameterized Algorithms for Steiner Forest in Bounded Width Graphs". In Bringmann, Karl; Grohe, Martin; Puppis, Gabriele; Svensson, Ola (eds.). 51st International Colloquium on Automata, Languages, and Programming, ICALP 2024, July 8–12, 2024, Tallinn, Estonia. LIPIcs. Vol. 297. Schloss Dagstuhl – Leibniz-Zentrum für Informatik. pp. 61:1–61:20. arXiv:2402.09835. doi:10.4230/LIPICS.ICALP.2024.61.
- ^ Guo, Jiong; Niedermeier, Rolf; Suchý, Ondřej (January 1, 2011). "Parameterized Complexity of Arc-Weighted Directed Steiner Problems". SIAM Journal on Discrete Mathematics. 25 (2): 583–599. doi:10.1137/100794560. ISSN 0895-4801.
- ^ Halperin, Eran; Krauthgamer, Robert (June 9, 2003). "Polylogarithmic inapproximability". Proceedings of the thirty-fifth annual ACM symposium on Theory of computing. STOC '03. New York, NY, USA: Association for Computing Machinery. pp. 585–594. doi:10.1145/780542.780628. ISBN 978-1-58113-674-6. S2CID 8554166.
- ^ Chitnis, Rajesh; Hajiaghayi, MohammadTaghi; Kortsarz, Guy (2013). "Fixed-Parameter and Approximation Algorithms: A New Look". In Gutin, Gregory; Szeider, Stefan (eds.). Parameterized and Exact Computation. Lecture Notes in Computer Science. Vol. 8246. Cham: Springer International Publishing. pp. 110–122. arXiv:1308.3520. doi:10.1007/978-3-319-03898-8_11. ISBN 978-3-319-03898-8. S2CID 6796132.
- ^ Chitnis, Rajesh; Feldmann, Andreas Emil; Manurangsi, Pasin (April 19, 2021). "Parameterized Approximation Algorithms for Bidirected Steiner Network Problems". ACM Transactions on Algorithms. 17 (2): 12:1–12:68. arXiv:1707.06499. doi:10.1145/3447584. ISSN 1549-6325. S2CID 235372580.
- ^ a b Cohen-Addad, Vincent; Gupta, Anupam; Kumar, Amit; Lee, Euiwoong; Li, Jason (2019). Baier, Christel; Chatzigiannakis, Ioannis; Flocchini, Paola; Leonardi, Stefano (eds.). "Tight FPT Approximations for k-Median and k-Means". 46th International Colloquium on Automata, Languages, and Programming (ICALP 2019). Leibniz International Proceedings in Informatics (LIPIcs). 132. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik: 42:1–42:14. doi:10.4230/LIPIcs.ICALP.2019.42. ISBN 978-3-95977-109-2. S2CID 139103417.
- ^ Kolliopoulos, Stavros G.; Rao, Satish (1999). "A Nearly Linear-Time Approximation Scheme for the Euclidean k-median Problem". In Nešetřil, Jaroslav (ed.). Algorithms - ESA' 99. Lecture Notes in Computer Science. Vol. 1643. Berlin, Heidelberg: Springer Berlin Heidelberg. pp. 378–389. doi:10.1007/3-540-48481-7_33. ISBN 978-3-540-66251-8.
- ^ Cohen-Addad, Vincent (2018). "A Fast Approximation Scheme for Low-Dimensional k-Means". Proceedings of the 2018 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). Proceedings. Society for Industrial and Applied Mathematics. pp. 430–440. arXiv:1708.07381. doi:10.1137/1.9781611975031.29. ISBN 978-1-61197-503-1. S2CID 30474859.
- ^ Feldman, Dan; Monemizadeh, Morteza; Sohler, Christian (June 6, 2007). "A PTAS for k-means clustering based on weak coresets". Proceedings of the twenty-third annual symposium on Computational geometry - SCG '07. New York, NY, USA: Association for Computing Machinery. pp. 11–18. doi:10.1145/1247069.1247072. ISBN 978-1-59593-705-6. S2CID 5694112.
- ^ Feldman, Dan; Langberg, Michael (June 6, 2011). "A unified framework for approximating and clustering data". Proceedings of the forty-third annual ACM symposium on Theory of computing. STOC '11. New York, NY, USA: Association for Computing Machinery. pp. 569–578. doi:10.1145/1993636.1993712. ISBN 978-1-4503-0691-1. S2CID 2677556.
- ^ Cohen-Addad, Vincent; Feldmann, Andreas Emil; Saulpic, David (October 31, 2021). "Near-linear Time Approximation Schemes for Clustering in Doubling Metrics". Journal of the ACM. 68 (6): 44:1–44:34. arXiv:1812.08664. doi:10.1145/3477541. ISSN 0004-5411. S2CID 240476191.
- ^ Feldmann, Andreas Emil; Saulpic, David (December 1, 2021). "Polynomial time approximation schemes for clustering in low highway dimension graphs". Journal of Computer and System Sciences. 122: 72–93. doi:10.1016/j.jcss.2021.06.002. ISSN 0022-0000.
- ^ a b Feldmann, Andreas Emil (March 1, 2019). "Fixed-Parameter Approximations for k-Center Problems in Low Highway Dimension Graphs". Algorithmica. 81 (3): 1031–1052. arXiv:1605.02530. doi:10.1007/s00453-018-0455-0. ISSN 1432-0541. S2CID 46886829.
- ^ Feder, Tomás; Greene, Daniel (January 1, 1988). "Optimal algorithms for approximate clustering". Proceedings of the twentieth annual ACM symposium on Theory of computing - STOC '88. New York, NY, USA: Association for Computing Machinery. pp. 434–444. doi:10.1145/62212.62255. ISBN 978-0-89791-264-8. S2CID 658151.
- ^ a b Feldmann, Andreas Emil; Marx, Dániel (July 1, 2020). "The Parameterized Hardness of the k-Center Problem in Transportation Networks". Algorithmica. 82 (7): 1989–2005. arXiv:1802.08563. doi:10.1007/s00453-020-00683-w. ISSN 1432-0541. S2CID 3532236.
- ^ Becker, Amariah; Klein, Philip N.; Saulpic, David (2018). Azar, Yossi; Bast, Hannah; Herman, Grzegorz (eds.). "Polynomial-Time Approximation Schemes for k-center, k-median, and Capacitated Vehicle Routing in Bounded Highway Dimension". 26th Annual European Symposium on Algorithms (ESA 2018). Leibniz International Proceedings in Informatics (LIPIcs). 112. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik: 8:1–8:15. doi:10.4230/LIPIcs.ESA.2018.8. ISBN 978-3-95977-081-1.
- ^ Feldmann, Andreas Emil; Vu, Tung Anh (2022). "Generalized k-Center: Distinguishing Doubling and Highway Dimension". In Bekos, Michael A.; Kaufmann, Michael (eds.). Graph-Theoretic Concepts in Computer Science. Lecture Notes in Computer Science. Vol. 13453. Cham: Springer International Publishing. pp. 215–229. arXiv:2209.00675. doi:10.1007/978-3-031-15914-5_16. ISBN 978-3-031-15914-5.
- ^ Katsikarelis, Ioannis; Lampis, Michael; Paschos, Vangelis Th. (July 15, 2019). "Structural parameters, tight bounds, and approximation for (k,r)-center". Discrete Applied Mathematics. Combinatorial Optimization: between Practice and Theory. 264: 90–117. arXiv:1704.08868. doi:10.1016/j.dam.2018.11.002. ISSN 0166-218X.
- ^ Dinur, Irit; Manurangsi, Pasin (2018). Karlin, Anna R. (ed.). "ETH-Hardness of Approximating 2-CSPs and Directed Steiner Network". 9th Innovations in Theoretical Computer Science Conference (ITCS 2018). Leibniz International Proceedings in Informatics (LIPIcs). 94. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik: 36:1–36:20. doi:10.4230/LIPIcs.ITCS.2018.36. ISBN 978-3-95977-060-6. S2CID 4681120.
- ^ S., Karthik C.; Laekhanukit, Bundit; Manurangsi, Pasin (June 20, 2018). "On the parameterized complexity of approximating dominating set". Proceedings of the 50th Annual ACM SIGACT Symposium on Theory of Computing. STOC 2018. New York, NY, USA: Association for Computing Machinery. pp. 1283–1296. arXiv:1711.11029. doi:10.1145/3188745.3188896. ISBN 978-1-4503-5559-9. S2CID 3170316.
- ^ a b c d Lokshtanov, Daniel; Panolan, Fahad; Ramanujan, M. S.; Saurabh, Saket (June 19, 2017). "Lossy kernelization". Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing (PDF). STOC 2017. New York, NY, USA: Association for Computing Machinery. pp. 224–237. doi:10.1145/3055399.3055456. ISBN 978-1-4503-4528-6. S2CID 14599219.
- ^ Hermelin, Danny; Kratsch, Stefan; Sołtys, Karolina; Wahlström, Magnus; Wu, Xi (March 1, 2015). "A Completeness Theory for Polynomial (Turing) Kernelization". Algorithmica. 71 (3): 702–730. doi:10.1007/s00453-014-9910-8. ISSN 1432-0541. S2CID 253973283.
- ^ Fellows, Michael R.; Kulik, Ariel; Rosamond, Frances; Shachnai, Hadas (May 1, 2018). "Parameterized approximation via fidelity preserving transformations". Journal of Computer and System Sciences. 93: 30–40. doi:10.1016/j.jcss.2017.11.001. ISSN 0022-0000.