Browsing by Author "Cisternas-Caneo, Felipe"

Now showing 1 - 3 of 3
  • No Thumbnail Available
    Item
    A Novel Learning-Based Binarization Scheme Selector for Swarm Algorithms Solving Combinatorial Problems
    (2021) Lemus-Romani, Jose; Becerra-Rozas, Marcelo; Crawford, Broderick; Soto, Ricardo; Cisternas-Caneo, Felipe; Vega, Emanuel; Castillo, Mauricio; Tapia, Diego; Astorga, Gino; Palma, Wenceslao; Castro, Carlos; Garcia, Jose
    Currently, industry is undergoing an exponential increase in binary-based combinatorial problems. In this regard, metaheuristics have been a common trend in the field in order to design approaches to successfully solve them. Thus, a well-known strategy includes the employment of continuous swarm-based algorithms transformed to perform in binary environments. In this work, we propose a hybrid approach that contains discrete smartly adapted population-based strategies to efficiently tackle binary-based problems. The proposed approach employs a reinforcement learning technique, known as SARSA (State-Action-Reward-State-Action), in order to utilize knowledge based on the run time. In order to test the viability and competitiveness of our proposal, we compare discrete state-of-the-art algorithms smartly assisted by SARSA. Finally, we illustrate interesting results where the proposed hybrid outperforms other approaches, thus, providing a novel option to tackle these types of problems in industry.
  • No Thumbnail Available
    Item
    Binarization of Metaheuristics: Is the Transfer Function Really Important?
    (2023) Lemus-Romani, Jose; Crawford, Broderick; Cisternas-Caneo, Felipe; Soto, Ricardo; Becerra-Rozas, Marcelo
    In this work, an approach is proposed to solve binary combinatorial problems using continuous metaheuristics. It focuses on the importance of binarization in the optimization process, as it can have a significant impact on the performance of the algorithm. Different binarization schemes are presented and a set of actions, which combine different transfer functions and binarization rules, under a selector based on reinforcement learning is proposed. The experimental results show that the binarization rules have a greater impact than transfer functions on the performance of the algorithms and that some sets of actions are statistically better than others. In particular, it was found that sets that incorporate the elite or elite roulette binarization rule are the best. Furthermore, exploration and exploitation were analyzed through percentage graphs and a statistical test was performed to determine the best set of actions. Overall, this work provides a practical approach for the selection of binarization schemes in binary combinatorial problems and offers guidance for future research in this field.
  • No Thumbnail Available
    Item
    Swarm-Inspired Computing to Solve Binary Optimization Problems: A Backward Q-Learning Binarization Scheme Selector
    (2022) Becerra-Rozas, Marcelo; Lemus-Romani, Jose; Cisternas-Caneo, Felipe; Crawford, Broderick; Soto, Ricardo; Garcia, Jose
    In recent years, continuous metaheuristics have been a trend in solving binary-based combinatorial problems due to their good results. However, to use this type of metaheuristics, it is necessary to adapt them to work in binary environments, and in general, this adaptation is not trivial. The method proposed in this work evaluates the use of reinforcement learning techniques in the binarization process. Specifically, the backward Q-learning technique is explored to choose binarization schemes intelligently. This allows any continuous metaheuristic to be adapted to binary environments. The illustrated results are competitive, thus providing a novel option to address different complex problems in the industry.