At present, Twitter users cannot remove followers and only rely on blocking them.

Source: Top Tech News- News18.com