Skip navigation
Please use this identifier to cite or link to this item: http://arks.princeton.edu/ark:/88435/dsp01rn3014599
Title: Applications of Reinforcement Learning to Effectively and Safely Control a Gantry Crane
Authors: Shih, Matthew
Advisors: Ramadge, Peter
Department: Electrical and Computer Engineering
Certificate Program: Center for Statistics and Machine Learning
Class Year: 2022
Abstract: When operating a gantry crane, a widely used machine in construction and transportation, an operator must carefully balance between delivering the load quickly and safely. However, the task of dampening the swing of the load, both during its transport and when it is at the target location, poses a difficult task for human operators and causes inefficiencies in this transportation process. PID controller systems, which is the standard in industrial applications, have had limited success in addressing this issue, facing difficulties controlling a nonlinear system or an inability to strictly enforce safety requirements. To address this issue, I test the viability of using reinforcement learning to train an agent to control a gantry crane in an efficient and safe manner. I demonstrate the success of agents trained with reinforcement learning to deliver a load to its destination in different environments and under various success conditions, even outperforming standard PID controllers. Additionally, I demonstrate the ability of these controller agents to learn novel strategies, suggesting their efficacy in learning in more complex environments or with additional constraints.
URI: http://arks.princeton.edu/ark:/88435/dsp01rn3014599
Type of Material: Princeton University Senior Theses
Language: en
Appears in Collections:Electrical and Computer Engineering, 1932-2023

Files in This Item:
File Description SizeFormat 
SHIH-MATTHEW-THESIS.pdf1.6 MBAdobe PDF    Request a copy


Items in Dataspace are protected by copyright, with all rights reserved, unless otherwise indicated.