Former governor targeted PM Modi