> Greentext

It's actually not an issue in Starfield, people just don't have a clue about the game. Everyone that touches one of the artifacts for the first time gets the vision and can get the temple power. There's an entire quest where you go to a temple with Barrett and get him a power as well. When you talk to the Emissary and the Hunter, it's revealed that you die in quite a lot of the other universes. You're not the chosen one in any capacity, you're just a random person, there's nothing special about you.

The main quest also gives you literally zero urgency to complete it. The fate of the universe isn't at stake, no great threat is looming that requires you to collect them (at least not until way later and even then not really), they're just a mystery that a group of scientists and explorers is investigating.