Self-attentive vision in evolutionary robotics
- Authors: Botha, Bouwer
- Date: 2024-04
- Subjects: Evolutionary robotics , Robotics , Neural networks (Computer science)
- Language: English
- Type: Master's theses , text
- Identifier: http://hdl.handle.net/10948/63628 , vital:73566
- Description: The autonomy of a robot refers to its ability to achieve a task in an environment with minimal human supervision. This may require autonomous solutions to be able to perceive their environment to inform their decisions. An inexpensive and highly informative way that robots can perceive the environment is through vision. The autonomy of a robot is reliant on the quality of the robotic controller. These controllers are the software interface between the robot and environment that determine the actions of the robot based on the perceived environment. Controllers are typically created using manual programming techniques, which become progressively more challenging with increasing complexity of both the robot and task. An alternative to manual programming is the use of machine learning techniques such as those used by Evolutionary Robotics (ER). ER is an area of research that investigates the automatic creation of controllers. Instead of manually programming a controller, an Evolutionary Algorithms can be used to evolve the controller through repeated interactions with the task environment. Employing the ER approach on camera-based controllers, however, has presented problems for conventional ER methods. Firstly, existing architectures that are capable of automatically processing images, have a large number of trained parameters. These architectures over-encumber the evolutionary process due to the large search space of possible configurations. Secondly, the evolution of complex controllers needs to be done in simulation, which requires either: (a) the construction of a photo-realistic virtual environment with accurate lighting, texturing and models or (b) potential reduction of the controller capability by simplifying the problem via image preprocessing. Any controller trained in simulation also raises the inherent concern of not being able to transfer to the real world. This study proposes a new technique for the evolution of camera-based controllers in ER, that aims to address the highlighted problems. The use of self-attention is proposed to facilitate the evolution of compact controllers that are able to evolve specialized sets of task-relevant features in unprocessed images by focussing on important image regions. Furthermore, a new neural network-based simulation approach, Generative Neuro-Augmented Vision (GNAV), is proposed to simplify simulation construction. GNAV makes use of random data collected in a simple virtual environment and the real world. A neural network is trained to overcome the visual discrepancies between these two environments. GNAV enables a controller to be trained in a simple simulated environment that appears similar to the real environment, while requiring minimal human supervision. The capabilities of the new technique were demonstrated using a series of real-world navigation tasks based on camera vision. Controllers utilizing the proposed self-attention mechanism were trained using GNAV and transferred to a real camera-equipped robot. The controllers were shown to be able to perform the same tasks in the real world. , Thesis (MSc) -- Faculty of Science, School of Computer Science, Mathematics, Physics and Statistics, 2024
- Full Text:
- Date Issued: 2024-04
- Authors: Botha, Bouwer
- Date: 2024-04
- Subjects: Evolutionary robotics , Robotics , Neural networks (Computer science)
- Language: English
- Type: Master's theses , text
- Identifier: http://hdl.handle.net/10948/63628 , vital:73566
- Description: The autonomy of a robot refers to its ability to achieve a task in an environment with minimal human supervision. This may require autonomous solutions to be able to perceive their environment to inform their decisions. An inexpensive and highly informative way that robots can perceive the environment is through vision. The autonomy of a robot is reliant on the quality of the robotic controller. These controllers are the software interface between the robot and environment that determine the actions of the robot based on the perceived environment. Controllers are typically created using manual programming techniques, which become progressively more challenging with increasing complexity of both the robot and task. An alternative to manual programming is the use of machine learning techniques such as those used by Evolutionary Robotics (ER). ER is an area of research that investigates the automatic creation of controllers. Instead of manually programming a controller, an Evolutionary Algorithms can be used to evolve the controller through repeated interactions with the task environment. Employing the ER approach on camera-based controllers, however, has presented problems for conventional ER methods. Firstly, existing architectures that are capable of automatically processing images, have a large number of trained parameters. These architectures over-encumber the evolutionary process due to the large search space of possible configurations. Secondly, the evolution of complex controllers needs to be done in simulation, which requires either: (a) the construction of a photo-realistic virtual environment with accurate lighting, texturing and models or (b) potential reduction of the controller capability by simplifying the problem via image preprocessing. Any controller trained in simulation also raises the inherent concern of not being able to transfer to the real world. This study proposes a new technique for the evolution of camera-based controllers in ER, that aims to address the highlighted problems. The use of self-attention is proposed to facilitate the evolution of compact controllers that are able to evolve specialized sets of task-relevant features in unprocessed images by focussing on important image regions. Furthermore, a new neural network-based simulation approach, Generative Neuro-Augmented Vision (GNAV), is proposed to simplify simulation construction. GNAV makes use of random data collected in a simple virtual environment and the real world. A neural network is trained to overcome the visual discrepancies between these two environments. GNAV enables a controller to be trained in a simple simulated environment that appears similar to the real environment, while requiring minimal human supervision. The capabilities of the new technique were demonstrated using a series of real-world navigation tasks based on camera vision. Controllers utilizing the proposed self-attention mechanism were trained using GNAV and transferred to a real camera-equipped robot. The controllers were shown to be able to perform the same tasks in the real world. , Thesis (MSc) -- Faculty of Science, School of Computer Science, Mathematics, Physics and Statistics, 2024
- Full Text:
- Date Issued: 2024-04
Supporting competitive robot game mission planning using machine learning
- Authors: Strydom, Elton
- Date: 2024-04
- Subjects: Machine learning , High performance computing , Robotics , LEGO Mindstorms toys Computer programming
- Language: English
- Type: Master's theses , text
- Identifier: http://hdl.handle.net/10948/64841 , vital:73929
- Description: This dissertation presents a study aimed at supporting the strategic planning and execution of missions in competitive robot games, particularly in the FIRST LEGO® League (FLL), through the use of machine learning techniques. The primary objective is to formulate guidelines for evaluating mission strategies using machine learning techniques within the FLL landscape, thereby supporting participants in the mission strategy design journey within the FLL robot game. The research methodology encompasses a literature review, focusing on the current practices in the FLL mission strategy design process. This is followed by a literature review of machine learning techniques on a broad level pivoting towards evolutionary algorithms. The study then delves into the specifics of genetic algorithms, exploring their suitability and potential advantages for mission strategy evaluation in competitive robotic environments within the FLL robot game. A significant portion of the research involves the development and testing of a prototype system that applies a genetic algorithm to simulate and evaluate different mission strategies, providing a practical tool for FLL teams. During the development of the evaluation prototype, guidelines were formulated aligning with the primary research objective which is to formulate guidelines for evaluating mission strategies in robot games using machine learning techniques. Key findings of this study highlight the effectiveness of genetic algorithms in identifying optimal mission strategies. The prototype demonstrates the feasibility of using machine learning to provide real-time, feedback to participating teams, enabling more informed decision-making in the formulation of mission strategies. , Thesis (MIT) -- Faculty of Engineering, the Built Environment, and Technology, School of Information Technology, 2024
- Full Text:
- Date Issued: 2024-04
- Authors: Strydom, Elton
- Date: 2024-04
- Subjects: Machine learning , High performance computing , Robotics , LEGO Mindstorms toys Computer programming
- Language: English
- Type: Master's theses , text
- Identifier: http://hdl.handle.net/10948/64841 , vital:73929
- Description: This dissertation presents a study aimed at supporting the strategic planning and execution of missions in competitive robot games, particularly in the FIRST LEGO® League (FLL), through the use of machine learning techniques. The primary objective is to formulate guidelines for evaluating mission strategies using machine learning techniques within the FLL landscape, thereby supporting participants in the mission strategy design journey within the FLL robot game. The research methodology encompasses a literature review, focusing on the current practices in the FLL mission strategy design process. This is followed by a literature review of machine learning techniques on a broad level pivoting towards evolutionary algorithms. The study then delves into the specifics of genetic algorithms, exploring their suitability and potential advantages for mission strategy evaluation in competitive robotic environments within the FLL robot game. A significant portion of the research involves the development and testing of a prototype system that applies a genetic algorithm to simulate and evaluate different mission strategies, providing a practical tool for FLL teams. During the development of the evaluation prototype, guidelines were formulated aligning with the primary research objective which is to formulate guidelines for evaluating mission strategies in robot games using machine learning techniques. Key findings of this study highlight the effectiveness of genetic algorithms in identifying optimal mission strategies. The prototype demonstrates the feasibility of using machine learning to provide real-time, feedback to participating teams, enabling more informed decision-making in the formulation of mission strategies. , Thesis (MIT) -- Faculty of Engineering, the Built Environment, and Technology, School of Information Technology, 2024
- Full Text:
- Date Issued: 2024-04
- «
- ‹
- 1
- ›
- »