Alternative Explanation

Elves are usually described as long-lived, but what if they just all look the same so nobody can tell? And they have a small pool of names. You could get away with a bunch before regular censuses.