It's possible, but given that the holder of One For All has to actually pick someone to pass their power on to, it seems unlikely they'd pass it on to someone who just wouldn't do anything with it.