This is such a wonderful idea, that the Teleri built multiple magnificent temples to the Valar.... having seen what happened to the Noldor when they disobeyed, and left Aman. Coupled with the news that only around six elves had been re-embodied, perhaps that fear is justified.... 

If built, it does make sense to use them as intended. 

And for poor Glorfindel, on his way back to Middle Earth, it is a shock that so few have Returned, and no one has ever heard about the glory that was Gondolin.