why did the elves leave middle earth