liu.seSearch for publications in DiVA
Change search
Link to record
Permanent link

Direct link
Publications (6 of 6) Show all publications
Präntare, F. (2024). Dividing the Indivisible: Algorithms, Empirical Advances, and Complexity Results for Value-Maximizing Combinatorial Assignment Problems. (Doctoral dissertation). Linköping: Linköping University Electronic Press
Open this publication in new window or tab >>Dividing the Indivisible: Algorithms, Empirical Advances, and Complexity Results for Value-Maximizing Combinatorial Assignment Problems
2024 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

Allocating resources, goods, agents (e.g., humans), expertise, production, and assets is one of the most influential and enduring cornerstone challenges at the intersection of artificial intelligence, operations research, politics, and economics. At its core—as highlighted by a number of seminal works [181, 164, 125, 32, 128, 159, 109, 209, 129, 131]—is a timeless question: 

How can we best allocate indivisible entities—such as objects, items, commodities, jobs, or personnel—so that the outcome is as valuable as possible, be it in terms of expected utility, fairness, or overall societal welfare? 

This thesis confronts this inquiry from multiple algorithmic viewpoints, focusing on the value-maximizing combinatorial assignment problem: the optimization challenge of partitioning a set of indivisibles among alternatives to maximize a given notion of value. 

To exemplify, consider a scenario where an international aid organization is responsible for distributing medical resources, such as ventilators and vaccines, and allocating medical personnel, including doctors and nurses, to hospitals during a global health crisis. These resources and personnel—inherently indivisible and non-fragmentable—necessitate an allocation process designed to optimize utility and fairness. Rather than using manual interventions and ad-hoc methods, which often lack precision and scalability, a rigorously developed and demonstrably performant approach can often be more desirable. 

With this type of challenge in mind, our thesis begins through the lens of computational complexity theory, commencing with an initial insight: In general, under prevailing complexity-theoretic assumptions (P ≠ NP), it is impossible to develop an efficient method guaranteeing a value-maximizing allocation that is better than “arbitrarily bad”, even under severely constraining limitations and simplifications. This inapproximability result not only underscores the problem’s complexity but also sets the stage for our ensuing work, wherein we develop novel algorithms and concise representations for utilitarian, egalitarian, and Nash welfare maximization problems, aimed at maximizing average, equitable, and balanced utility, respectively. For example, we introduce the synergy hypergraph—a hypergraph-based characterization of utilitarian combinatorial assignment—which allows us to prove several new state-of-the-art complexity results to help us better understand how hard the problem is. We then provide efficient approximation algorithms and (non-trivial) exponential-time algorithms for many hard cases. In addition, we explore complexity bounds for generalizations with interdependent effects between allocations, known as externalities in economics. Natural applications in team formation, resource allocation, and combinatorial auctions are also discussed; and a novel “bootstrapped” dynamic-programming method is introduced. 

We then transition from theory to practice as we shift our focus to the utilitarian variant of the problem—an incarnation of the problem particularly applicable to many real-world scenarios. For this variation, we achieve substantial empirical algorithmic improvements over existing methods, including industry-grade solvers. This work culminates in the development of a new hybrid algorithm that combines dynamic programming with branch-and-bound techniques that is demonstrably faster than all competing methods in finding both optimal and near-optimal allocations across a wide range of experiments. For example, it solves one of our most challenging problem sets in just 0.25% of the time required by the previous best methods, representing an improvement of approximately 2.6 orders of magnitude in processing speed. 

Additionally, we successfully integrate and commercialize our algorithm into Europa Universalis IV—one of the world’s most popular strategy games, with a player base exceeding millions. In this dynamic and challenging setting, our algorithm efficiently manages complex strategic agent interactions, highlighting its potential to improve computational efficiency and decision-making in real-time, multi-agent scenarios. This also represents one of the first instances where a combinatorial assignment algorithm has been applied in a commercial context. 

We then introduce and evaluate several highly efficient heuristic algorithms. These algorithms—while lacking provable quality guarantees—employ general-purpose heuristic and random-sampling techniques to significantly outperform existing methods in both speed and quality in large-input scenarios. For instance, in one of our most challenging problem sets, involving a thousand indivisibles, our best algorithm generates outcomes that are 99.5% of the expected optimal in just seconds. This performance is particularly noteworthy when compared to state-of-the-art industry-grade solvers, which struggle to produce any outcomes under similar conditions. 

Further advancing our work, we employ novel machine learning techniques to generate new heuristics that outperform the best hand-crafted ones. This approach not only showcases the potential of machine learning in combinatorial optimization but also sets a new standard for combinatorial assignment heuristics to be used in real-world scenarios demanding rapid, high-quality decisions, such as in logistics, real-time tactics, and finance. 

In summary, this thesis bridges many gaps between the theoretical and practical aspects of combinatorial assignment problems such as those found in coalition formation, combinatorial auctions, welfare-maximizing resource allocation, and assignment problems. It deepens the understanding of the computational complexities involved and provides effective and improved solutions for longstanding real-world challenges across various sectors—providing new algorithms applicable in fields ranging from artificial intelligence to logistics, finance, and digital entertainment, while simultaneously paving the way for future work in computational problem-solving and optimization. 

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2024. p. 167
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2382
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-202652 (URN)10.3384/9789180756013 (DOI)9789180756006 (ISBN)9789180756013 (ISBN)
Public defence
2024-05-28, Ada Lovelace, B-building, Campus Valla, Linköping, 09:15 (English)
Opponent
Supervisors
Note

Funding: MIRAI; the Wallenberg AI, Autonomous Systems and Software Program; and the Knut and Alice Wallenberg Foundation.

Available from: 2024-04-18 Created: 2024-04-18 Last updated: 2024-05-07Bibliographically approved
Präntare, F. & Heintz, F. (2021). Hybrid Dynamic Programming for Simultaneous Coalition Structure Generation and Assignment. In: Uchiya, Takahiro, Bai, Quan, Marsa-Maestre, Ivan (Ed.), PRIMA 2020: Principles and Practice of Multi-Agent Systems: 23rd International Conference, Nagoya, Japan, November 18–20, 2020, Proceedings. Paper presented at PRIMA 2020: Principles and Practice of Multi-Agent Systems. 23rd International Conference, Nagoya, Japan, November 18–20, 2020, Proceedings (pp. 19-33). Springer
Open this publication in new window or tab >>Hybrid Dynamic Programming for Simultaneous Coalition Structure Generation and Assignment
2021 (English)In: PRIMA 2020: Principles and Practice of Multi-Agent Systems: 23rd International Conference, Nagoya, Japan, November 18–20, 2020, Proceedings / [ed] Uchiya, Takahiro, Bai, Quan, Marsa-Maestre, Ivan, Springer, 2021, p. 19-33Conference paper, Published paper (Refereed)
Abstract [en]

We present, analyze and benchmark two algorithms for simultaneous coalition structure generation and assignment: one based entirely on dynamic programming, and one anytime hybrid approach that uses branch-and-bound together with dynamic programming. To evaluate the algorithms’ performance, we benchmark them against both CPLEX (an industry-grade solver) and the state-of-the-art using difficult randomized data sets of varying distribution and complexity. Our results show that our hybrid algorithm greatly outperforms CPLEX, pure dynamic programming and the current state-of-the-art in all of our benchmarks. For example, when solving one of the most difficult problem sets, our hybrid approach finds optimum in roughly 0.1% of the time that the current best method needs, and it generates 98% efficient interim solutions in milliseconds in all of our anytime benchmarks; a considerable improvement over what previous methods can achieve.

Place, publisher, year, edition, pages
Springer, 2021
Series
Lecture notes in artificial intelligence ; 12568
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-174078 (URN)10.1007/978-3-030-69322-0_2 (DOI)978-3-030-69322-0 (ISBN)978-3-030-69321-3 (ISBN)
Conference
PRIMA 2020: Principles and Practice of Multi-Agent Systems. 23rd International Conference, Nagoya, Japan, November 18–20, 2020, Proceedings
Available from: 2021-03-12 Created: 2021-03-12 Last updated: 2022-02-01Bibliographically approved
Domova, V., Gärtner, E., Präntare, F., Pallin, M., Källström, J. & Korzhitskii, N. (2020). Improving Usability of Search and Rescue Decision Support Systems: WARA-PS Case Study. In: In proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA): . Paper presented at IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), September 8-11, 2020 (pp. 1251-1254). Vienna, Austria: IEEE conference proceedings
Open this publication in new window or tab >>Improving Usability of Search and Rescue Decision Support Systems: WARA-PS Case Study
Show others...
2020 (English)In: In proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria: IEEE conference proceedings, 2020, p. 1251-1254Conference paper, Published paper (Refereed)
Abstract [en]

Novel autonomous search and rescue systems, although powerful, still require a human decision-maker involvement. In this project, we focus on the human aspect of one such novel autonomous SAR system. Relying on the knowledge gained in a field study, as well as through the literature, we introduced several extensions to the system that allowed us to achieve a more user-centered interface. In the evaluation session with a rescue service specialist, we received positive feedback and defined potential directions for future work.

Place, publisher, year, edition, pages
Vienna, Austria: IEEE conference proceedings, 2020
Series
IEEE International Conference on Emerging Technologies and Factory Automation, ISSN 1946-0740, E-ISSN 1946-0759 ; 25
Keywords
Public Safety, Search and Rescue, Control System, User Interface
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-170328 (URN)10.1109/ETFA46521.2020.9211980 (DOI)000627406500186 ()9781728189574 (ISBN)9781728189567 (ISBN)
Conference
IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), September 8-11, 2020
Funder
Vinnova, 2017-04885Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

Funding: Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2020-10-09 Created: 2020-10-09 Last updated: 2023-04-03Bibliographically approved
Präntare, F., Tiger, M., Bergström, D., Appelgren, H. & Heintz, F. (2020). Towards Utilitarian Combinatorial Assignment with Deep Neural Networks and Heuristic Algorithms. In: Fredrik Heintz, Michela Milano, Barry O'Sullivan (Ed.), Trustworthy AI - Integrating Learning, Optimization and Reasoning: First International Workshop, TAILOR 2020, Virtual Event, September 4–5, 2020, Revised Selected Papers. Paper presented at European Conference on Artificial Intelligence TAILOR Workshop - Foundations of Trustworthy AI (pp. 104-111). Cham, Germany: Springer
Open this publication in new window or tab >>Towards Utilitarian Combinatorial Assignment with Deep Neural Networks and Heuristic Algorithms
Show others...
2020 (English)In: Trustworthy AI - Integrating Learning, Optimization and Reasoning: First International Workshop, TAILOR 2020, Virtual Event, September 4–5, 2020, Revised Selected Papers / [ed] Fredrik Heintz, Michela Milano, Barry O'Sullivan, Cham, Germany: Springer, 2020, p. 104-111Conference paper, Published paper (Refereed)
Abstract [en]

This paper presents preliminary work on using deep neural networksto guide general-purpose heuristic algorithms for performing utilitarian combinatorial assignment. In more detail, we use deep learning in an attempt to produce heuristics that can be used together with e.g., search algorithms to generatefeasible solutions of higher quality more quickly. Our results indicate that ourapproach could be a promising future method for constructing such heuristics.

Place, publisher, year, edition, pages
Cham, Germany: Springer, 2020
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 12641 LNAI
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-175570 (URN)10.1007/978-3-030-73959-1_10 (DOI)2-s2.0-85105930783 (Scopus ID)9783030739584 (ISBN)9783030739591 (ISBN)
Conference
European Conference on Artificial Intelligence TAILOR Workshop - Foundations of Trustworthy AI
Available from: 2021-05-09 Created: 2021-05-09 Last updated: 2024-09-08Bibliographically approved
Präntare, F. & Heintz, F. (2018). An Anytime Algorithm for Simultaneous Coalition Structure Generation and Assignment. In: Tim Miller, Nir Oren, Yuko Sakurai, Itsuki Noda, Bastin Tony Roy Savarimuthu and Tran Cao Son (Ed.), PRIMA 2018: Principles and Practice of Multi-Agent Systems: 21st International Conference, Tokyo, Japan, October 29-November 2, 2018, Proceedings. Paper presented at PRIMA 2018: Principles and Practice of Multi-Agent Systems: 21st International Conference, Tokyo, Japan, October 29-November 2, 2018 (pp. 158-174). Cham, 11224
Open this publication in new window or tab >>An Anytime Algorithm for Simultaneous Coalition Structure Generation and Assignment
2018 (English)In: PRIMA 2018: Principles and Practice of Multi-Agent Systems: 21st International Conference, Tokyo, Japan, October 29-November 2, 2018, Proceedings / [ed] Tim Miller, Nir Oren, Yuko Sakurai, Itsuki Noda, Bastin Tony Roy Savarimuthu and Tran Cao Son, Cham, 2018, Vol. 11224, p. 158-174Conference paper, Published paper (Refereed)
Abstract [en]

A fundamental problem in artificial intelligence is how to organize and coordinate agents to improve their performance and skills. In this paper, we consider simultaneously generating coalitions of agents and assigning the coalitions to independent tasks, and present an anytime algorithm for the simultaneous coalition structure generation and assignment problem. This optimization problem has many real-world applications, including forming goal-oriented teams of agents. To evaluate the algorithm’s performance, we extend established methods for synthetic problem set generation, and benchmark the algorithm against CPLEX using randomized data sets of varying distribution and complexity. We also apply the algorithm to solve the problem of assigning agents to regions in a major commercial strategy game, and show that the algorithm can be utilized in game-playing to coordinate smaller sets of agents in real-time.

Place, publisher, year, edition, pages
Cham: , 2018
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 11224Lecture notes in artificial intelligence ; 11224
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-152438 (URN)10.1007/978-3-030-03098-8_10 (DOI)9783030030971 (ISBN)9783030030988 (ISBN)
Conference
PRIMA 2018: Principles and Practice of Multi-Agent Systems: 21st International Conference, Tokyo, Japan, October 29-November 2, 2018
Available from: 2018-10-31 Created: 2018-10-31 Last updated: 2021-04-19
Präntare, F., Ragnemalm, I. & Heintz, F. (2017). An Algorithm for Simultaneous Coalition Structure Generation and Task Assignment. In: Bo An, Ana Bazzan, João Leite, Serena Villata and Leendert van der Torre (Ed.), PRIMA 2017: Principles and Practice of Multi-Agent Systems 20th International Conference, Nice, France, October 30 – November 3, 2017, Proceedings: . Paper presented at PRIMA International Conference on Principles and Practice of Multi-Agent Systems, Nice, France, 30 October - 3 November, 2017 (pp. 514-522). Cham: Springer, 10621
Open this publication in new window or tab >>An Algorithm for Simultaneous Coalition Structure Generation and Task Assignment
2017 (English)In: PRIMA 2017: Principles and Practice of Multi-Agent Systems 20th International Conference, Nice, France, October 30 – November 3, 2017, Proceedings / [ed] Bo An, Ana Bazzan, João Leite, Serena Villata and Leendert van der Torre, Cham: Springer, 2017, Vol. 10621, p. 514-522Conference paper, Published paper (Refereed)
Abstract [en]

Groups of agents in multi-agent systems may have to cooperate to solve tasks efficiently, and coordinating such groups is an important problem in the field of artificial intelligence. In this paper, we consider the problem of forming disjoint coalitions and assigning them to independent tasks simultaneously, and present an anytime algorithm that efficiently solves the simultaneous coalition structure generation and task assignment problem. This NP-complete combinatorial optimization problem has many real-world applications, including forming cross-functional teams aimed at solving tasks. To evaluate the algorithm's performance, we extend established methods for synthetic problem set generation, and benchmark the algorithm using randomized data sets of varying distribution and complexity. Our results show that the presented algorithm efficiently finds optimal solutions, and generates high quality solutions when interrupted prior to finishing an exhaustive search. Additionally, we apply the algorithm to solve the problem of assigning agents to regions in a commercial computer-based strategy game, and empirically show that our algorithm can significantly improve the coordination and computational efficiency of agents in a real-time multi-agent system.

Place, publisher, year, edition, pages
Cham: Springer, 2017
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 10621
Keywords
coalition formation, task allocation, multi-agent system, artificial intelligence, optimal assignment
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-141867 (URN)10.1007/978-3-319-69131-2_34 (DOI)9783319691305 (ISBN)9783319691312 (ISBN)
Conference
PRIMA International Conference on Principles and Practice of Multi-Agent Systems, Nice, France, 30 October - 3 November, 2017
Available from: 2017-10-10 Created: 2017-10-10 Last updated: 2021-04-19Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-0367-2430

Search in DiVA

Show all publications