In episode 1, the yakuza boss drove off after saying that if Denji runs, he will kill him and sell his organs. He wasn't "left to do whatever he wants" because they can easily find him, at least that is what both Denji and the yakuza believe. Even after he got Pochita, both parties still believed this to be true.