Paddy was an Olympic boxer who fought at the Toyko Olympics in 1964. He briefly turned professional in 1965. In this fight, he was up against Simon Tiger of Nigeria whom he beat on points. Paddy would go on to found the Dockers Boxing Club and have a successful career as a couch.