[ . . . ]

Let's stay on that assumption for a while.

There's two options with that. First, that the "quality" of souls, either for the purposes of being viable fuel or for his own amusement isn't sufficient. The other, and perhaps worse, is that the "quantity" wasn't sufficient.

... Which would imply there is no one left from his original world.