The Executive Committee member believes calls for the FA president to resign are premature.
Kwesi Nyantakyi has been an unpopular figure among many locals, with his critics particularly pointing out the dwindling fortunes of the Ghana Premier League as a failure on his part.
Certain quarters also believe the FA boss has overstayed his welcome, having led the country’s football for the past 12 years.
However, Palmer believes Nyantakyi is in office because he has the backing of all stakeholders, insisting no one can force him out.
“He (Nyantakyi) must be allowed to serve his term in office, he was elected and not appointed,” Palmer is quoted as saying in an interview with told Atinka FM.
“And I don’t think anyone can force him out especially when he is not ready to resign. He is working and he must be allowed to work.
READ ALSO: Edward Nketiah scores hat-trick for England
“He should be allowed to serve his term, if delegates think he is not the right person to lead Ghana Football he will be out but if delegates are in support of his works he will still continue.”
Kwesi Nyantakyi became Ghana’s FA president in 2005, and has since been re-elected three times.